Since the neck is off already I will assume you mean to remove the fretboard. Those frets look well worn. Will a fret dressing be enough?
Great colour.
Never mind... I see what you mean now. Perhaps best not to remove the fretboard as it has some nice binding and concealed fret ends.