Musically, facility wise it certainly is worth having a Tyros 4. Money wise only you can answer. Probably the sensible course of action is to play and listen to one yourself (assuming available in a store).
I went for a Tyros 2 to a Tyros 4 and am happy I made the right decision.
Keith