I posted this same question on the forum some time ago. My reason being the same as yours. The one reply that stood out to me was, " not everyone requires a subwoofer".
I have not removed mine yet but most likely will. I have some high frequency rearing loss so the low's seem accentuated to me anyway.
It is a pretty simple procedure in my 2017 so if I don't like the results I can always put it back to original.
Honestly most of the bass on the stock system comes from the door speakers. Just unplug the sub and see for yourself. I went the opposite direction and just filled all the under seat storage with subs, but clearly that's not for you. Pretty sure you have to pull the box out to unplug it, but feel around and you might get lucky. There is a fair bit of slack in the wiring.