Impact of three-body forces on elastic nucleon-nucleus scattering observables