Because if you do it based on recommended measurements (I use the Fender guide) you have to set relief first because string height above the frets is affected by how much relief there is. Refer to any bass setup guide and it'll advise you to set relief first. If, after correctly setting relief and action, you find that fret buzz still occurs, then it's time to start checking for high/uneven frets.