The difference is that a controller keyboard has no sounds of its own. They have no voices/patches. To use a controller keyboard you will need another synth, sound module, or soundcard that does have voices/patches.
The Pros of having a full fledge synth is that there is no need for anything else (well, except speakers or headphones etc.). The Pros of having a controller is that they are usually small and cheap.