Chas, all good advice so far (motivational wise) if you WANT to do it, go for it for your own use AND pleasure. If you feel an affinity with the drums (as you said) then you WILL find it easier to succeed.

However:

Speaking as someone who's first instrument was Drums & Percussion since I was maybe 7 or 8 (I too, picked up keyboards "late" in life) I think you should look at what LEVEL of playing you want to achieve. You say enough to hold a basic beat, but even then, there's holding a basic beat, and REALLY holding a basic beat.

I must admit it kind of burns me (still) when people say it's easy to play drums. It is - but it's harder TO PLAY THEM WELL.
There's MUCH more to it than non-drummers realise.

(Still, just be aware of that, and go for it!!! )