It can be a bit annoying not to mention unsafe, when a light bulb breaks leaving just a base in the socket. Here's a simple and safe way to get it out.
Take a bar of soap and insert the corner into the socket. Give it a few turns and that base will unscrew. Make sure that the soap is dry and that the power is turned off.
Never use a potato. Potatoes contain moisture and that could be dangerous.