I don't quite understand the indignation and antagonism that comes from some about others not caring for one of their heroes. (Sorry Gvdadrummasum, I love your drumming and most of your posts, but I've got to quibble with you on this one)
There's a Neil Peart fan on here who does the same thing and I don't see this as any different.
Speaking for myself. I like Elvins's drumming... what of it I've heard, that is. See, I also hear in colors. Some colors I like better than others. For example, despite that I know Led Zeppelin were a great band, I never got into them because to me their colors were drab enough to give me a headache (smears of avocado, harvest gold, orange, and brown). I can say the same thing for a lot of jazz of this era. I've tried to like Coltrane, Dolphy, Miles, etc but for whatever reason the sounds aren't aesthetically pleasing to me and the colors are all over the map.
Basically, if I don't like the music, it almost doesn't matter what the drummer is doing. I could force myself to listen, take some classes to get a better understanding, but I'm not interested in relegating music to an academic exercise. There are too many styles of music that I really like the sound (and colors) of that really excite me to spend much time on music that doesn't. Nothing wrong with that, is there?