Residents refuse to relocate