HuBar: Revolutionizing Pilot Training with Augmented Reality

In the aviation industry, a pilot's capability to operate effectively under pressure is vital for flight safety. **HuBar** is a novel tool, developed by a team at NYU Tandon School of Engineering, aimed at revolutionizing pilot training by evaluating cognitive workload and behavior during AR-guided simulations. Set to be presented at the 2024 IEEE Visualization and Visual Analytics Conference, HuBar allows for in-depth analysis of performance, identifying patterns and areas of struggle. While primarily demonstrated through aviation, HuBar's utility extends to other fields, such as surgery and military operations. The tool works by visualizing complex data streams, including brain activity and body movements, providing a holistic view of task performance. Its ability to analyze non-linear tasks and compare different sessions makes it a unique asset in understanding pilot behavior and optimizing training. The NYU team, backed by a DARPA contract, aims to expand the tool's application across various scenarios, paving the way for adaptive AR training systems that respond in real-time to mental states.