Here, residents and vacationers alike enjoy waterfront views in towns like Southampton, Bridgehampton, and Montauk. However, your stop is at Sag Harbor, one of the island's oldest towns.