Multi-Modal Hands-Free Interface for Aircraft Maintainers

This project aims to develop a hands-free data entry system to be used by Air Force aircraft maintenance personnel in noisy environments. To mitigate the noise sensitivity of voice recognition systems, simultaneous methods of input are used, including voice, non-interfering gestures, facial feature extraction, and workspace analysis to disambiguate user focus of intention. Cybernet is ideally suited to do this work because of our corporate focus on man/machine interfaces, our current work creating aircraft maintenance aids, and our previous work with all of the component technologies including voice recognition, gestures, facial feature extraction, and real-time image processing.

Capability

Sensors and Data

Technology

Multimodal Interface
Gesture Recognition
Machine Vision