A visual-haptic display for human and autonomous systems integration

This paper introduces a novel concept of visual-haptic display for situational awareness improvement for crowded and low altitude airspace situations. The visual augmentation display that constitutes of Virtual Fences delimiting no-fly zones, and a specific tri-dimensional highlight graphics that enhances visibility of other remotely piloted or autonomous agents, as well as conventional manned aircraft operating in the area is presented first. Then the Shared Control paradigm and the Haptic Force generation mechanism, based on a Proportional-Derivativelike controller applied to repulsive forces generated by the Virtual Fences and other UAVs are introduced and discussed. Simulations with 26 pilots were performed in a photo-realistic synthetic environment showing that the combined use of Visual-haptic feedback outperforms the Visual Display only in helping the pilot keeping a safe distance from no-fly zones and other vehicles.