JTAC VR

Speech recognition meets virtual reality

The National Research Council Canada is Canada’s largest federal research and development organization. Funding was made available using the Industrial Research Assistance Program (IRAP) which helps drive innovation in Canadian business.

We developed a guided virtual reality scenario that trains users how to perform the in-field operations of a joint terminal attack controller (JTAC). We integrated our speech recognition software - TASR (training augmented by speech recognition) - into the virtual reality training scenario to provide two-way communication between the user and the simulated instructor. Using TASR, the guided scenario allows users to train and familiarize themselves with the complex lexicon and phrasing terminology of a JTAC. This training tool exercises decision-making and includes fail conditions that detects gross errors in judgement. The JTAC trainer provides an open-ended decision-making experience, multiple ways to attack, multi-aircraft communication, and an in-depth after-action review (AAR) process to evaluate performance – including failures.