Well, in essence all you will need to do is plug the mics and whatever else you need into the mixer (by using audio cables). To be more precise, everything you plug in will go into its own input on a mixer (they are called channels). Then you connect the main outputs of the mixer to a PA. Done. Do a quick sound check before the show and you're good to go.

Something like a Mackie 12/02 ought to do the trick. Or even a smaller and cheaper mixer... Depending on what you'll find. Just shop around. Go to a music store and ask for what's available. Explain your situation and I think you'll find what you need.

Also, regarding power (not to mix up with audio connections). Well, the mixer will definitely need to be connected to an outlet. But not the mics. Mics are generally passive or require phantom power which most okay mixers have. I guess a CD player will need some juice to run too. So all you need to worry about connecting to an outlet is a mixer and a CD player.

Hope this helps.