Geometrical destabilisation of ultra-light axions in string inflation