Double-click on NameSpace and check inside each of the GUID folders. If you can identify the icon by name, delete it. This is especially useful for deleting some un-deletable system icons.

Removing an app from your home screen doesnt remove it from your device. To remove an app, tap and hold its icon until the context menu appears, and then tap Remove App followed by Remove from ...