Constraining Lyman-alpha spatial offsets at 3 < z < 5.5 from VANDELS slit spectroscopy