On the hunt for hidden gems in New York State? You can't do better ... The town's bustling Water Street Market is a European-style shopping district in the heart of New Paltz village.