I'm not a fan either.
About twenty years ago I worked with a chap who was really into Yes and Rush, when he found out I played bass he couldn't believe I was into them. I borrowed a few of his albums and listened to them all the way through a couple of times, but nothing, just didn't like it. He couldn't understand why.
I've now stopped trying to like stuff that I feel I should like.
I've tried to like Stanley Clarke and the usual suspects talked about on here but I just don't like them.
I like a very varied mix of styles but there's a few that do nothing for me so I've stopped feeling guilty for not liking it and just enjoy what I do like.
Prog is still way above jazz-fusion in the pecking order though. 😉