Not as easy as it might seem, it’s kind of hidden away a little. Anyway, here’s how to do it:
Account > Privacy Settings
Apps and websites > Edit your settings
Apps you use > Edit settings
You can then remove an application by clicking on the cross next to it.