I use loads of FX, but only as and when they're required. I've got 6 distortion / overdrive / fuzz units (not all on the same board), and depending what and where I'm playing I'll pack certain ones for a specific sound. My MXR 80 tends to follow me around, as it's a quality DI, and my amp won't let me do 'post EQ' DI out, other than than I use a bit of chorus and /or delay on slower songs, particularly on fretless, and octave on a few songs too.
The envelope filter takes up the most space on the board, but gets the least use. I just can't bring myself to get rid though.
Using effects that need to 'track' the pitch being played (octaver / SYB5) requires really precise technique, so as far as the OP goes, I'd say it works the other way - a more accurate playing style is needed for certain FX pedals.