That's what happened to me. My mother was a concert pianist and later played organ in church, so we always had one around.
I took piano lessons for about a year when I was six, then later played trumpet in high school, but all along I was tinkering with the piano or organ. My mother became both proud and jealous, because she couldn't play happy birthday without the music, or memorizing it. I could do it either way, reading or by chord structure. She never could understand.
I exposed my kids to the music and they enjoy listening and singing. Who knows, maybe when they mature some more they'll get back to wanting to play.
DonM