The most sensible thing to do for all concerned is just to carry on as you are now. I think it would be foolish to turn down the job offer, after all your job pays your bills. If it turns out that things don't work with the band then at least you tried, but things may work absolutely fine! Ask them for some understanding and if they value you, they will try and cooperate with you!