Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “on-screen”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

22 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

Incorporating Speech Recognition into a Natural User Interface

The Augmented/ Virtual Reality (AVR) Lab has been working to study the applicability of recent virtual and augmented reality hardware and software to KSC operations. This includes the Oculus Rift, HTC Vive, Microsoft HoloLens, and Unity game engine. My project in this lab is to integrate voice recognition and voice commands into an easy to modify system that can be added to an existing portion of a Natural User Interface (NUI). A NUI is an intuitive and simple to use interface incorporating visual, touch, and speech recognition. The inclusion of speech recognition capability will allow users to perform actions or make inquiries using only their voice. The simplicity of needing only to speak to control an on-screen object or enact some digital action means that any user can quickly become accustomed to using this system. Multiple programs were tested for use in a speech command and recognition system. Sphinx4 translates speech to text using a Hidden Markov Model (HMM) based Language Model, an Acoustic Model, and a word Dictionary running on Java. PocketSphinx had similar functionality to Sphinx4 but instead ran on C. However, neither of these programs were ideal as building a Java or C wrapper slowed performance. The most ideal speech recognition system tested was the Unity Engine Grammar Recognizer. A Context Free Grammar (CFG) structure is written in an XML file to specify the structure of phrases and words that will be recognized by Unity Grammar Recognizer. Using Speech Recognition Grammar Specification (SRGS) 1.0 makes modifying the recognized combinations of words and phrases very simple and quick to do. With SRGS 1.0, semantic information can also be added to the XML file, which allows for even more control over how spoken words and phrases are interpreted by Unity. Additionally, using a CFG with SRGS 1.0 produces a Finite State Machine (FSM) functionality limiting the potential for incorrectly heard words or phrases. The purpose of my project was to investigate options for a Speech Recognition System. To that end I attempted to integrate Sphinx4 into a user interface. Sphinx4 had great accuracy and is the only free program able to perform offline speech dictation. However it had a limited dictionary of words that could be recognized, single syllable words were almost impossible for it to hear, and since it ran on Java it could not be integrated into the Unity based NUI. PocketSphinx ran much faster than Sphinx4 which would've made it ideal as a plugin to the Unity NUI, unfortunately creating a C# wrapper for the C code made the program unusable with Unity due to the wrapper slowing code execution and class files becoming unreachable. Unity Grammar Recognizer is the ideal speech recognition interface, it is flexible in recognizing multiple variations of the same command. It is also the most accurate program in recognizing speech due to using an XML grammar to specify speech structure instead of relying solely on a Dictionary and Language model. The Unity Grammar Recognizer will be used with the NUI for these reasons as well as being written in C# which further simplifies the incorporation.

Chapa, Nicholas↗
NASA NTRS2018

Airspace Technology Demonstration 2 (ATD-2) Phase 1 Concept of Use (ConUse)

This document presents an operational Concept of Use (ConUse) for the Phase 1 Baseline Integrated Arrival, Departure, and Surface (IADS) prototype system of NASA's Airspace Technology Demonstration 2 (ATD-2) sub-project, which began demonstration in 2017 at Charlotte Douglas International Airport (CLT). NASA is developing the IADS system under the ATD-2 sub-project in coordination with the Federal Aviation Administration (FAA) and aviation industry partners. The primary goal of ATD-2 sub-project is to improve the predictability and the operational efficiency of the air traffic system in metroplex environments, through the enhancement, development, and integration of the nation's most advanced and sophisticated arrival, departure, and surface prediction, scheduling, and management systems. The ATD-2 effort is a five-year research activity through 2020. The initial phase of the ATD-2 sub-project, which is the focus of this document, will demonstrate the Phase 1 Baseline IADS capability at CLT in 2017. The Phase 1 Baseline IADS capabilities of the ATD-2 sub-project consists of: (a) Strategic and tactical surface scheduling to improve efficiency and predictability of airport surface operations, (b) Tactical departure scheduling to enhance merging of departures into overhead traffic streams via accurate predictions of takeoff times and automated coordination between the Airport Traffic Control Tower (ATCT, or Tower) and the Air Route Traffic Control Center (ARTCC, or Center), (c) Improvements in departure surface demand predictions in Time Based Flow Management (TBFM), (d) A prototype Electronic Flight Data (EFD) system provided by the FAA via the Terminal Flight Data Manager (TFDM) early implementation effort, and (e) Improved situational awareness and demand predictions through integration with the Traffic Flow Management System (TFMS), TBFM, and TFDM (3Ts) for electronic data integration and exchange, and an on-screen dashboard displaying pertinent analytics in real-time. The surface scheduling and metering element of the capability is consistent with the Surface CDM Concept of Operations published in 2014 by the FAA Surface Operations Directorate.1 Upon successful demonstration of the Phase 1 Baseline IADS capability, follow-on demonstrations of the matured IADS traffic management capabilities will be conducted in the 2018-2020 timeframe. At the end of each phase of the demonstrations, NASA will transfer the ATD-2 sub-project technology to the FAA and industry partners.

integrated arrival↗
NASA NTRSDate not supplied

Preliminary Design of an 'Autonomous Medical Response Agent' Interface Prototype for Long Duration Spaceflight

Major challenges for astronauts in future long-duration exploration missions (LDEMs) will be that crewmembers are not expected to be medical professionals, may be under high workload and stress, are facing physiological challenges caused by spaceflight, and will have limited, delayed voice communications with medical support from Earth. An autonomous medical response agent (AMRA) is envisioned to help astronauts address medical complaints, develop a differential diagnosis, and guide self-treatment until a healthy state is restored. AMRA develops a process of personalized diagnosis and treatment through a Bayesian predictive control system that recommends therapeutic control actions including diagnostic tests and treatments to crewmembers (Menon, 2020). The Human Computer Interaction (HCI) lab from NASA Ames Research Center’s Human Systems Integration Division (Code TH) has collaborated with Nahlia Inc in human-centered design augmentation research for AMRA. The project, titled Design of ‘Autonomous Medical Response Agent Interface Prototype for Long Duration Spaceflight, has been funded by the Translational Research Institute for Space Health (TRISH) and introduces an interactive user-interface prototype that guides astronauts through self-diagnosis, treatment, and rehabilitation while communicating with remote specialists in ground support (most notably a patient’s flight surgeon). Our project develops the interaction design for the crewmember using AMRA through user research, iterative design, and usability testing to evaluate the user interface and workflow designed. The interface design deliverable for this project, titled AMRA Aggregate Information Display (AMRA AID) is an integrated information display system for comprehensive autonomous medical guidance, diagnosis, and treatment of in-flight medical conditions experienced by crewmembers. AMRA AID demonstrates how we might ensure crew autonomy, increase the crew’s medical capabilities, and decrease cognitive burden within a front-end user interface. AMRA AID refrains from relying on input from ground or mission control for self-treatment of medical issues—though ground awareness and communication with ground is maintained as a means of ensuring trust between mission control and crew. AMRA AID demonstrates how the crew’s on-board medical system might integrate with information from vehicle monitoring and crew schedule, without assuming causal relationships. AMRA AID’s comprehensive view enables efficient information access for both crew and ground support, reducing cognitive burden in the event of an unplanned or emergency medical incident and enabling informed analytical decisions to be made based on both crew and vehicle health. Human-centered design augmentation advanced within the prototype included: enhanced workflow and treatment guidance for two medical scenarios for a non-specialist user base with various levels of medical training, interaction design which considered speech (conversational user interface) elements and on-screen interactions to be developed in future iterations of the project, communication design and functional requirements relevant to self-care versus caring for another astronaut, as well as user testing of the prototype with an international space medical community. This project arrives at critical findings regarding usability needs, communication requirements, and integrated information requirements for a future technology interface functioning to increase confidence between ground support and LDEM crewmembers.

TRISH↗
NASA NTRSDate not supplied

Eye Glance Behaviors of Ground Control Station Operators in a Simulated Urban Air Mobility Environment

Research into concepts such as advanced air mobility (AAM) and urban air mobility (UAM) offers an opportunity for successfully and safely adding new classes of vehicles into the National Airspace System. However, a need exists for research into the human factors associated with these concepts. In this paper, we evaluate the gaze behaviors of three remote ground control station operators (GCSOs) conducting simulated UAM operations. The participants monitored and controlled an unmanned aircraft system (UAS) from pre-flight to landing using ground control station (GCS) software across nine scenarios within a remote UAS operations center at NASA Langley Research Center (LaRC). As this work was exploratory, descriptive statistics were calculated to provide some initial insight into GCSO gaze patterns associated with the GCS display. Scenarios that required the operator to directly interact with an airspace scheduling system off-screen resulted in fewer on-screen glances than scenarios that did not include direct interactions with the off-screen system. After investigating several areas of interest (AOIs) within the GCS display, participants primarily viewed three AOIs: the map, vehicle status, and operations checklist. The results yielded several GCS design and operational improvement recommendations to include: (a) adding altitude information to the vehicle icon, (b) adding additional traffic information, and (c) including additional GCS training, to reduce the need to scan an operations checklist, which would allow allocation of visual attention towards other AOIs.

Urban Air Mobility↗