A developer’s hopes to build more than 20 homes on a southwest Sydney plot of land riddled with asbestos have been dashed.