Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “usability studies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Usability Evaluation of Fleet Management Interface for High Density Vertiplex Environments

To meet the rising demand for an Advanced Air Mobility (AAM) (i.e. urban and rural unmanned aircraft systems) ecosystem, the NASA Aeronautics Research Mission Directorate (ARMD) is hosting a series of simulations and flight tests under the High Density Vertiplex sub-project (HDV) to prototype and study the effectiveness AAM capabilities under various operational contexts. HDV aims to develop an integrated automation architecture to support terminal area flight operations. The HDV simulations and flight tests address safety, integration, and operational challenges, while integrated systems and software demonstrate design readiness, robustness, and interoperability. During the initial HDV simulation in 2021, a prototype traffic management tool developed by NASA called the Fleet Management Interface (FMI) was tested. FMI was designed to introduce an advanced level of human-automation interaction to aid both Ground Control Station Operators (GCSOs) and Fleet Managers (FMs) in remotely managing flights under their ownership. In a human-in-the-loop simulation, a usability study was conducted with the FMI to identify optimal approaches for displaying information to human operators using subjective measures of usability, workload, situation awareness, risk, and trust, along with qualitative feedback. This study consisted of task analysis in which GCSO and FM subjects used an Urban Air Mobility (UAM) environment to develop and execute a plan for two different traffic scenarios of remotely controlled vehicles. In each scenario, a remotely controlled vehicle completed a takeoff, active flight, and landing sequence while simulated traffic flew in the background at a rate of 20 operations per hour. In the first scenario, the controlled vehicle flew a nominal route with takeoff and landing at the same vertiport. In the second scenario, the controlled vehicle started on the nominal route, then diverted to an unplanned location mid-flight. Results showed that self- reported performance, usability, trust, and situation awareness ratings of FMI were moderately to strongly high. There were small differences between scenarios, with Scenario 2 being perceived as more unstable, complex, variable, risky, and potentially harmful than Scenario 1. Furthermore, participants described improvements that could be made to create a better user experience. For example, users suggested customizable interfaces to accommodate information display preferences, and the ability to review routes before assigning them. The results from this study will inform future development of the FMI with the end goal of creating a reference automation tool for airspace management procedures in AAM. The FMI could serve to reduce dependency on traditional air navigation services through increased automation in high density vertiplex environments.

Fleet manager↗

Usability Evaluation of Spot and Runway Departure Advisor (SARDA) Concept in Dallas/Fort Worth Airport Tower Simulation

Spot and Runway Departure Advisor (SARDA) is a proposed decision-support tool for air traffic control tower controllers for reducing taxi delay and optimizing the departure sequence. In the present study, the tool's usability was evaluated to ensure that its claimed performance benefits are not being realized at the cost of increasing the work burden on controllers. For the evaluation, workload ratings and questionnaire responses collected during a human-in-the-loop simulation experiment were analyzed to assess the SARDA advisories' effects on the controllers' ratings on cognitive resources (e.g., workload, spare attention) and satisfaction. The results showed that SARDA reduced the controllers' workload and increased their spare attention. It also made workload and attention levels less susceptible to the effects of increases in the traffic load. The questionnaire responses suggested that the controllers generally were satisfied with the ease of use of the tool and the objectives of the SARDA concept, but with some caution. To gain more trust from controllers, the the reasoning behind advisories may need to be made more transparent to them.

human factors↗

Methods to Reduce Communication Workload for UAM Operations

Implementation of Urban Air Mobility (UAM) operations, or air passenger transportation systems within densely populated metropolitan areas, seeks to mitigate increasing traffic congestion. However, the development and integration of UAM operations into the national airspace system comes with its own unique challenges, such as vehicle requirements, flight planning and scheduling, and coordination between UAM flights and air traffic controllers. In particular, verbal coordination will play an integral part in the determined success of UAM operations and its ability to meet projected high consumer demands. In order to meet demands and higher traffic volumes on UAM routes, verbal communication between the UAM pilot and controller must be streamlined to reduce the controller's workload while helping to maintain safety within a given airspace. One method of reducing verbal workload are Letters Of Agreement (LOAs) that outline responsibilities and procedures for operations in an airspace. These LOAs will specify the operations, procedures, and routes for UAM flights. The proposed study will examine the usability of two route formatting styles for LOAs; (i) Verbal route descriptions and (ii) Tower En Route Control (TECs) routes. Verbal route descriptions will include the route name and associated visual cues on the route. The TEC route versions will include relevant waypoints and charts outlining the route with waypoints marked. The study will be part of a UAM X1 human in the loop (HITL) simulation. Controller participants will handle traditional air traffic including moderate levels of UAM traffic on current and modified helicopter routes within the Dallas Fort-Worth area. Scenarios will be counterbalanced and repeated to test both route formatting versions. After each trial, participants will rate the usability of the LOA used in the previous trial via a subjective questionnaire. We expect that controllers will prefer the LOA with TEC routes due to simplicity and visual elements available.

aerospace human factors↗

Extreme ultraviolet photometer for observations of helium in interplanetary space

A four-channel photometer sensitive to two solar EUV lines which are resonantly scattered by helium gas was developed for flight on the Apollo-Soyuz Test Project. Two channels observed the 58.4-nm line of He I and used helium gas resonant absorption cells to determine the intensities of the center and wings of that line. The other two channels observed the 30.4-nm line of He II. The instrument surveyed much of the celestial sphere during a series of slow rolling maneuvers by the Apollo spacecraft. The experiment operated properly, and usable data were obtained. Study of the distributions of flux seen, and of the ratio 58.4-nm fluxes seen with gas cells full and empty, will refine current understanding of several poorly known properties of the local interstellar medium. Study of the 30.4-nm flux distribution will refine present knowledge of the structure of the earth's plasmasphere.

Bowyer, S.↗

Space station Simulation Computer System (SCS) study for NASA/MSFC. Volume 5: Study analysis report

The Simulation Computer System (SCS) is the computer hardware, software, and workstations that will support the Payload Training Complex (PTC) at the Marshall Space Flight Center (MSFC). The PTC will train the space station payload scientists, station scientists, and ground controllers to operate the wide variety of experiments that will be on-board the Freedom Space Station. The further analysis performed on the SCS study as part of task 2-Perform Studies and Parametric Analysis-of the SCS study contract is summarized. These analyses were performed to resolve open issues remaining after the completion of task 1, and the publishing of the SCS study issues report. The results of these studies provide inputs into SCS task 3-Develop and present SCS requirements, and SCS task 4-develop SCS conceptual designs. The purpose of these studies is to resolve the issues into usable requirements given the best available information at the time of the study. A list of all the SCS study issues is given.

Source record↗

Domain-Specific Languages and Diagram Customization for a Concurrent Engineering Environment

A major open question for advocates of Model-Based Systems Engineering (MBSE) is the question of how system and subsystem engineers will work together. The Systems Modeling Language (SysML), like any language intended for a large audience, is in tension between the desires for simplicity and for expressiveness. In order to be more expressive, many specialized language elements may be introduced, which will unfortunately make a complete understanding of the language a more daunting task. While this may be acceptable for systems modelers, it will increase the challenge of including subsystem engineers in the modeling effort. One possible answer to this situation is the use of Domain-Specific Languages (DSL), which are fully supported by the Unified Modeling Language (UML). SysML is in fact a DSL for systems engineering. The expressive power of a DSL can be enhanced through the use of diagram customization. Various domains have already developed their own schematic vocabularies. Within the space engineering community, two excellent examples are the propulsion and telecommunication subsystems. A return to simple box-and-line diagrams (e.g., the SysML Internal Block Diagram) are in many ways a step backward. In order allow subsystem engineers to contribute directly to the model, it is necessary to make a system modeling tool at least approximate in accessibility to drawing tools like Microsoft PowerPoint and Visio. The challenge is made more extreme in a concurrent engineering environment, where designs must often be drafted in an hour or two. In the case of the Jet Propulsion Laboratory's Team X concurrent design team, a subsystem is specified using a combination of PowerPoint for drawing and Excel for calculation. A pilot has been undertaken in order to meld the drawing portion and the production of master equipment lists (MELs) via a SysML authoring tool, MagicDraw. Team X currently interacts with its customers in a process of sharing presentations. There are several inefficiencies that arise from this situation. The first is that a customer team must wait two weeks to a month (which is 2-4 times the duration of most Team X studies themselves) for a finalized, detailed design description. Another is that this information must be re-entered by hand into the set of engineering artifacts and design tools that the mission concept team uses after a study is complete. Further, there is no persistent connection to Team X or institutionally shared formulation design tools and data after a given study, again reducing the direct reuse of designs created in a Team X study. This paper presents the underpinnings of subsystem DSLs as they were developed for this pilot. This includes specialized semantics for different domains as well as the process by which major categories of objects were derived in support of defining the DSLs. The feedback given to us by the domain experts on usability, along with a pilot study with the partial inclusion of these tools is also discussed.

Cole, Bjorn↗

A study of commuter airplane design optimization

The usability of the general aviation synthesis program (GASP) was enhanced by the development of separate computer subroutines which can be added as a package to this assembly of computerized design methods or used as a separate subroutine program to compute the dynamic longitudinal, lateral-directional stability characteristics for a given airplane. Currently available analysis methods were evaluated to ascertain those most appropriate for the design functions which the GASP computerized design program performs. Methods for providing proper constraint and/or analysis functions for GASP were developed as well as the appropriate subroutines.

Keppel, B. V.↗

Full-scale aircraft simulation with cryogenic tunnels and status of the National Transonic Facility

The effect of thermal and caloric imperfections in cryogenic nitrogen on boundary layers was determined to indicate that in order to simulate nonadiabatic laminar or turbulent boundary layers in a cryogenic nitrogen wind tunnel, the flight enthalpy ratio, rather than the temperature ratio, should be reproduced. The absence of significant real gas effects on both viscous and inviscid flows makes it unlikely that there will be large real gas effects on the cryogenic tunnel simulation of shock boundary layer interactions or other complex flow conditions encountered in flight. Condensation effects were studied to determine the minimum usable temperature and indicated that under most circumstances free stream Mach number rather than maximum local Mach number determines the onset of condensation effects.

Kilgore, R. A.↗

Development of a distributed-parameter mathematical model for simulation of cryogenic wind tunnels

A one-dimensional distributed-parameter dynamic model of a cryogenic wind tunnel was developed which accounts for internal and external heat transfer, viscous momentum losses, and slotted-test-section dynamics. Boundary conditions imposed by liquid-nitrogen injection, gas venting, and the tunnel fan were included. A time-dependent numerical solution to the resultant set of partial differential equations was obtained on a CDC CYBER 203 vector-processing digital computer at a usable computational rate. Preliminary computational studies were performed by using parameters of the Langley 0.3-Meter Transonic Cryogenic Tunnel. Studies were performed by using parameters from the National Transonic Facility (NTF). The NTF wind-tunnel model was used in the design of control loops for Mach number, total temperature, and total pressure and for determining interactions between the control loops. It was employed in the application of optimal linear-regulator theory and eigenvalue-placement techniques to develop Mach number control laws.

Tripp, J. S.↗

Comparison of waste combustion and waste electrolysis - A systems analysis

A steady state model of a closed environmental system has been developed which includes higher plant growth for food production, and is designed to allow wastes to be combusted or electrolyzed. The stoichiometric equations have been developed to evaluate various trash compositions, food items (both stored and produced), metabolic rates, and crew sizes. The advantages of waste electrolysis versus combustion are: (1) oxygen is not required (which reduces the load on the oxygen producing system); (2) the CO2 and H2 products are produced in pure form (reducing the load on the separators); and (3) nitrogen is converted to nitrate (which is directly usable by plants). Weight tradeoff studies performed using this model have shown that waste electrolysis reduces the life support weight of a 4-person crew by 1000 to 2000 kg.

Holtzapple, Mark T.↗

Satellite-derived surface latent heat fluxes in a rapidly intensifying marine cyclone

Surface latent heat fluxes are estimated in the vicinity of a rapidly deepening cyclone before and during its period of most rapid intensification. This was done with a bulk parameterization scheme and remotely sensed input data. A method is studied for estimating the difference in specific humidity between the surface and a ten meter height using the Special Sensor Microwave/Imager (SSM/I) observed integrated water vapor field and a sea surface temperature analysis. The surface latent heat flux fields generally have estimated errors below 40 pct. south of 40 deg. N and outside the region of high integrated water vapor values associated with frontal bands. The method of estimating surface latent heat fluxes for the case study was found to be usable in most regions of the Northwest Atlantic Ocean except for those locations directly adjacent to coastlines in instances of offshore flow and in the vicinity of surface fronts.

Miller, Douglas K.↗

Satellite-derived surface latent heat fluxes in a rapidly intensifying marine cyclone

The aim of this article is to estimate surface latent heat fluxes in the vicinity of a rapidly deepening cyclone before and during its period of most rapid intensification. This is done with a bulk parameterization scheme and remotely sensed input data. A method for estimating the difference in specific humidity between the surface and a 10-m height is investigated using the Special Sensor Microwave/Imager-observed integrated water vapor field and a sea surface temperature analysis. The surface latent heat flux fields generally have estimated errors below 40 percent south of 40 deg N and outside the region of high integrated water vapor values associated with frontal bands. The method of estimating surface latent heat fluxes for the case study was found to be usable in most regions of the northwest Atlantic Ocean except for those locations directly adjacent to coastlines in instances of offshore flow and in the vicinity of surface fronts.

Miller, Douglas K.↗

Understanding the Impact of User Frustration Intensities on Task Performance Using the OCC Theory of Emotions

Have you heard the saying "frustration is written all over your falce"? Well this saying is true, but that is not the only place. Frustration is written all over your face and your body. The human body has various means to communicate an emotion without the utterance of a single word. The Media Equation says that people interact with computers as if they are human: this includes experiencing frustration. This research measures frustration by monitoring human body-based measures such as heart rate, posture, skin temperature. and respiration. The OCC Theory of Emotions is used to separate frustration into different levels or intensities. The results of this study showed that individual intensities of frustration exist, so that task performance is not degraded. Results from this study can be used by usability testers to model how much frustration is needed before task performance measures start to decrease.

Washington, Gloria↗

User Needs and Assessing the Impact of Low Latency NASA Earth Observation Data Availability on Societal Benefit

Since the advent of NASA's Earth Observing System, knowledge of the practical benefits of Earth science data has grown considerably. The community using NASA Earth science observations in applications has grown significantly, with increasing sophistication to serve national interests. Data latency, or how quickly communities receive science observations after acquisition, can have a direct impact on the applications and usability of the information. This study was conducted to determine how users are incorporating NASA data into applications and operational processes to benefit society beyond scientific research, as well as to determine the need for data latency of less than 12 h. The results of the analysis clearly show the significant benefit to society of serving the needs of the agricultural, emergency response, environmental monitoring and weather communities who use rapidly delivered, accurate Earth science data. The study also showed the potential of expanding the communities who use low latency NASA science data products to provide new ways of transforming data into information. These benefits can be achieved with a clear and consistent NASA policy on product latency.

NASA↗

Usability of Operational Performance Support Tools - Findings from Sea Test II

Sea Test II, aka NASA Extreme Environment Mission Operations 17(NEEMO 17) took place in the Florida Aquarius undersea habitat. This confined underwater environment provides a excellent analog for space habitation providing similarities to space habitation such as hostile environment, difficult logistics, autonomous operations, and remote communications. This study collected subjective feedback on the usability of two performance support tools during the Sea Test II mission, Sept 10‐14, 2013; Google Glass and iPAD. The two main objectives: - Assess the overall functionality and usability of each performance support tool in a mission analog environment. - Assess the advantages and disadvantages of each tool when performing operational procedures and Just‐In‐Time‐Training (JITT).

Byrne, Vicky↗

Validation of Self-Scheduling Countermeasures in NASA's HERA Campaign 6

Enhancing crew capabilities for planning and scheduling activities is critical for periods of increased crew autonomy in future long-duration missions where communication delays preclude real-time ground support from Earth. Our study focuses on how to empower astronauts to manage their timelines independently from the experts in the mission control center (MCC). Our objective was to evaluate the impact of scheduling countermeasures on crew scheduling performance, workload, and usability in an analog mission environment. The study involved 16 crew members across four missions in the Limited Autonomy phase of Human Exploration Research Analog (HERA) Campaign 6. Crew members used Playbook to schedule one operational day for the entire crew. Half the participants accessed scheduling aids, and we compared their performance to a control group with no aids. Performance, workload, and usability were assessed using time on task, violation counts, NASA Task Load Index (NASA-TLX), and System Usability Scale (SUS). Participants using scheduling aids completed sessions 20% faster and committed 33% fewer violations. While these differences were not statistically significant due to the study’s operational limitations, trends indicate that scheduling aids may reduce errors and improve efficiency. These results can inform the design of scheduling tools to enhance astronauts’ autonomy in long-duration space missions, contributing to improved crew performance and reduced reliance on ground support.

space robotics↗

Validation of Self-Scheduling Countermeasures in NASA's HERA Campaign 6

Enhancing crew capabilities for planning and scheduling activities is critical for periods of increased crew autonomy in future long-duration missions where communication delays preclude real-time ground support from Earth. Our study focuses on how to empower astronauts to manage their timelines independently from the experts in the mission control center (MCC). Our objective was to evaluate the impact of scheduling countermeasures on crew scheduling performance, workload, and usability in an analog mission environment. The study involved 16 crew members across four missions in the Limited Autonomy phase of Human Exploration Research Analog (HERA) Campaign 6. Crew members used Playbook to schedule one operational day for the entire crew. Half the participants accessed scheduling aids, and we compared their performance to a control group with no aids. Performance, workload, and usability were assessed using time on task, violation counts, NASA Task Load Index (NASA-TLX), and System Usability Scale (SUS). Participants using scheduling aids completed sessions 20% faster and committed 33% fewer violations. While these differences were not statistically significant due to the study’s operational limitations, trends indicate that scheduling aids may reduce errors and improve efficiency. These results can inform the design of scheduling tools to enhance astronauts’ autonomy in long-duration space missions, contributing to improved crew performance and reduced reliance on ground support.

space robotics↗

Evaluation of Usability and Workload Associated with Paper Strips as Compared to Virtual Flight Strips Used for Ramp Operations

This paper describes a study comparing the use of paper strips with virtual flight strips depicted on a new user interface, the Ramp Traffic Console (RTC), designed for use by ramp controllers to be used in place of paper strips. A Human-In-the-Loop (HITL) experiment was performed as the fifth in a series of six HITL simulation studies designed to evaluate a pushback Decision Support Tool (DST) concept for Charlotte Douglas International Airport (CLT). Workload and usability were assessed in post-run and post-study questionnaires. In the RTC virtual flight strip condition, post-run questionnaire results show lower workload ratings across all aspects of workload; additionally a trend is found toward increased usability ratings. Post-study questionnaire results indicate a preference for RTC over paper strips. Additional research is suggested with more training runs and a greater number of participants to increase statistical power. It is also suggested that this new technology be re-evaluated as a part of the ATD-2 (Airspace Technology Demonstration 2) field testing activities.

Human Factors↗