I'm with you on this one. Been getting comments like that for years. I'm trying to smile a bit more and get involved up front with the singer and guitarist which seems to be working
Just so long you are comfortable with yourself that's the main thing. You can always reply that you are from the Bil Wyman / John Entwistle etc school of bass playing.
Edit. I find if try being more cheerful or involved I can loose concentration and mistakes happen.