Very good points made so far!

Do you know what legengary saxophonist John Coltrane would do during breaks (at least after he broke his drug addiction) He practiced!
Miles Davis said when Trane was on stage blowing, even if the most beautiful naked lady came by, Trane would not even notice. He was all about the music! Women are attracted to skillful talented men. I'm sure Trane had all kinds of women after him. But by all accounts he was completely focussed on the music and improving himself both spiritually and musically.

As Gary said, you have to live with yourself. Say you were on your death bed. Would rather go knowing that you gave your all to your Family, and art or that you just wasted your talent on cheap,shallow, empty, meaningless pursuits? The choice is yours.