You would.I have an older machine that doesn't have the connections for NVME, but I could use a PCIe card. Would I get a lot more performance doing that than over standard SATA off the motherboard?
However, you may not notice it for music, unless you stream directly from SSD, or your libraries have huge patches.
On the other hand, if you setup your OS on it, it could be night and day.