Integrated Head-Mounted Display Interface for Hands-Free Control

Eye tracking and voice recognition provide a means for hands-free control of information displayed within a head-mounted display (HMD) environment. This project developed a program for combining eye tracking, voice recognition, and HMD technology to achieve an integrated hands-free soldier interface. With this device, the soldier can quickly adapt displayed information to meet changing needs of the tactical environment without use of his hands. This Phase II SBIR Plus option allowed us to: 1) improve the optical performance of the HMD-user interface; 2) present realistic 3D images to the user, and 3) deliver a real-time head tracking device based on Cybernet's FireFly product.

Capability

Human Computer Interaction

Technology

Graphical User Interface (GUI)
Eye Tracking
Speech Recognition