I like the music, and it helps with my flow to listen to it. It actually is more disruptive to pause music when the game is paused. I would love to see an option at least in the menu to turn music pause off.
I actually like the effect of the music pausing as well. It sells the effect of the world holding still.
An interesting middle ground could be a slight change in music to soften it. Maybe a slower pace or lesser instruments. But a mellow as the soundtrack already is, this could be difficult to achieve.