maybe your pick technique is more suited to 4 strings? ie, lots of pick movement on a bass with tight string spacing would be difficult.
It might be worth watching players such as anthony jackson use a pick, he has barely any motion in his arm or wrist when he does. Or go back to fingerstyle.
Also a good way to get used to 5 string basses, play scales over 3 octaves using every string