The chord progression above definitely makes the song in the key of E minor.
What do you mean by numbers, you've got me lost there?