Kind of does, kind of doesn't. I began muting all the human voices in video games long long ago (if possible through in-game options; if not I usually tend to mute it altogether).
As for anime it usually doesn't bother me that much. I think part of it is related to the fact that I can't speak Japanese so it's more or less gibberish for me. The other part is that I'm prepared for it and willingfully expose myself to it. But sometimes I mute it either way, I've got subs to read afterall.
I think big part of my growing disdain for this ear grating noise is that I have tons of days when I simply do not wish to hear anyone, much less speak with them. And the all of a sudden someone decides it's a perfectly fine idea to talk to me. When it comes to anime when I don't feel like listening to it I can mute it, unfortunately it's not as easy to mute people IRL.