Brooklyn owners of East Hampton property say home has become ‘House of Ill Repute’