Stability of the Spin Glass Phase under Perturbations