Governor's Island, just off the southern tip of Manhattan and its financial district has sat abandoned since 1996 when the former federal run military and then Coast Guard base was closed.