I'm not sure about that - I've got quite a few free jazz albums and enjoy listening to them. Of course, I usually have to wait until my other half is out in case she complains of "oh no, not more Desolate Shore"...
BTW, a couple of times I've seen arguments about free jazz break out on another forum, where things can get quite heated indeed. I failed to make clear that I liked listening to it and received some interesting abuse.
Re your jams, it seems a bit off that there's no planning. Good luck getting a house band together and starting your own!