Nature versus nurture: Relic nature and environment of the most massive passive galaxies at z < 0.5