A stallion sculpture to celebrate gipsies and travellers has been refused planning permission because it may not be inclusive enough to locals.