Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “usability studies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Reinventing Image Detective: An Evidence-Based Approach to Citizen Science Online

Usability studies demonstrate that web users are notoriously impatient, spending as little as 15 seconds on a home page. How do you get users to stay long enough to understand a citizen science project? How do you get users to complete complex citizen science tasks online? Image Detective, a citizen science project originally developed by scientists and science engagement specialists at the NASA Johnson Space center to engage the public in the analysis of images taken from space by astronauts to help enhance NASA's online database of astronaut imagery, partnered with the CosmoQuest citizen science platform to modernize, offering new and improved options for participation in Image Detective. The challenge: to create a web interface that builds users' skills and knowledge, creating engagement while learning complex concepts essential to the accurate completion of tasks. The project team turned to usability testing for an objective understanding of how users perceived Image Detective and the steps required to complete required tasks. A group of six users was recruited online for unmoderated and initial testing. The users followed a think-aloud protocol while attempting tasks, and were recorded on video and audio. The usability test examined users' perception of four broad areas: the purpose of and context for Image Detective; the steps required to successfully complete the analysis (differentiating images of Earth's surface from those showing outer space and identifying common surface features); locating the image center point on a map of Earth; and finally, naming geographic locations or natural events seen in the image. Usability test findings demonstrated that the following best practices can increase participation in Image Detective and can be applied to the successful implementation of any citizen science project: (1) Concise explanation of the project, its context, and its purpose; (2) Including a mention of the funding agency (in this case, NASA); (3) A preview of the specific tasks required of participants; (4) A dedicated user interface for the actual citizen science interaction. In addition, testing revealed that users may require additional context when a task is complex, difficult, or unusual (locating a specific image and its center point on a map of Earth). Video evidence will be made available with this presentation.

Romano, Cia↗

Usability of an Updated Version of the Supplemental Data Service Provider-Consolidated Dashboard for Supporting Uncrewed Aircraft System Traffic Management

The Supplemental Data Service Provider-Consolidated Dashboard (SDSP-CD) is a preflight planning user interface (UI) that serves to aid operators when drafting routes for small uncrewed aircraft systems (sUASs). The primary function of the SDSP-CD is to identify hazards that an sUAS may encounter along a proposed flight path and assess the severity of these risks. A usability study was conducted on an updated version of the SDSP-CD to determine if the most recent iterations made to the system improved objective performance and subjective user experience. There are two main components of the SDSP-CD interface: (1) the dashboard and (2) the interactive map. The dashboard provides users with hazard and vehicle limitations for each sUAS in their fleet while the map contains a graphical representation of each vehicle’s route, hazard details, and geographic information. A series of preflight risk-assessment questions and tasks were developed to examine how participants interact with the updated version of the SDSP-CD. Additionally, a new service that measures vertiport congestion was developed and included as one of the services that was tested. In the present study, participants were trained to use the SDSP-CD and then completed two simulated scenarios during which they performed a variety of tasks, responded to questions, and completed surveys. The two scenarios developed for the present study were the Package Delivery and Hurricane Preparation scenarios. The Package Delivery scenario involved a fleet of four sUASs delivering low-stakes items (e.g., lunches and snacks) to people in a fictitious city. The Hurricane Preparation scenario involved a fleet of 11 sUASs delivering a range of supplies (from medicine to boardgames) to employees stranded at an office park due to road closures caused by an impending hurricane. Participants assumed the role of a fleet manager during both scenarios and were responsible for managing the sUASs in their fleet. Questions included those with objectively correct responses, open-ended strategy responses, and subjective user experience feedback. It was found that participants were largely successful at using the SDSP-CD interface to answer questions with objectively correct responses. Additionally, participants were able to use reasoning and logic based on the information available in the SDSP-CD to determine the cause of various risks and what actions they would consider taking. Finally, although participants reported that there were elements of the UI that could be improved, overall feedback pertaining to user experience suggested that the SDSP-CD concept is viable.

usability testing↗

A Prototype Flight-Deck Airflow Hazard Visualization System

Airflow hazards such as turbulence, vortices, or low-level wind shear can pose a threat to landing aircraft and are especially dangerous to helicopters. Because pilots usually cannot see airflow, they may be unaware of the extent of the hazard. We have developed a prototype airflow hazard visual display for use in helicopter cockpits to alleviate this problem. We report on the results of a preliminary usability study of our airflow hazard visualization system in helicopter-shipboard operations.

Aragon, Cecilia R.↗

Data Visualization of Invisible Airflow Hazards During Helicopter Takeoff and Landing Operations

Many aircraft accidents each year are caused by encounters with unseen airflow hazards near the ground such as vortices, downdrafts, wind shear, microbursts, or other turbulence. While such hazards frequently pose problems to fixed-wing airplanes, they are especially dangerous to helicopters, which often have to operate in confined spaces and under operationally stressful conditions. We are developing flight-deck visualizations of airflow hazards during helicopter takeoff and landing operations, and are evaluating their effectiveness with usability studies. Our hope is.that this work will lead to the production of an airflow hazard detection system for pilots that will save lives.

Aragon, Cecilia R.↗

Using Visualization in Cockpit Decision Support Systems

In order to safely operate their aircraft, pilots must make rapid decisions based on integrating and processing large amounts of heterogeneous information. Visual displays are often the most efficient method of presenting safety-critical data to pilots in real time. However, care must be taken to ensure the pilot is provided with the appropriate amount of information to make effective decisions and not become cognitively overloaded. The results of two usability studies of a prototype airflow hazard visualization cockpit decision support system are summarized. The studies demonstrate that such a system significantly improves the performance of helicopter pilots landing under turbulent conditions. Based on these results, design principles and implications for cockpit decision support systems using visualization are presented.

Aragon, Cecilia R.↗

Application of the H-Mode, a Design and Interaction Concept for Highly Automated Vehicles, to Aircraft

Driven by increased safety, efficiency, and airspace capacity, automation is playing an increasing role in aircraft operations. As aircraft become increasingly able to autonomously respond to a range of situations with performance surpassing human operators, we are compelled to look for new methods that help us understand their use and guide their design using new forms of automation and interaction. We propose a novel design metaphor to aid the conceptualization, design, and operation of highly-automated aircraft. Design metaphors transfer meaning from common experiences to less familiar applications or functions. A notable example is the "Desktop metaphor" for manipulating files on a computer. This paper describes a metaphor for highly automated vehicles known as the H-metaphor and a specific embodiment of the metaphor known as the H-mode as applied to aircraft. The fundamentals of the H-metaphor are reviewed followed by an overview of an exploratory usability study investigating human-automation interaction issues for a simple H-mode implementation. The envisioned application of the H-mode concept to aircraft is then described as are two planned evaluations.

Goodrich, Kenneth H.↗

The GuideView System for Interactive, Structured, Multi-modal Delivery of Clinical Guidelines

GuideView is a computerized clinical guideline system which delivers clinical guidelines in an easy-to-understand and easy-to-use package. It may potentially enhance the quality of medical care or allow non-medical personnel to provide acceptable levels of care in situations where physicians or nurses may not be available. Such a system can be very valuable during space flight missions when a physician is not readily available, or perhaps the designated medical personnel is unable to provide care. Complex clinical guidelines are broken into simple steps. At each step clinical information is presented in multiple modes, including voice,audio, text, pictures, and video. Users can respond via mouse clicks or via voice navigation. GuideView can also interact with medical sensors using wireless or wired connections. The system's interface is illustrated and the results of a usability study are presented.

Iyengar, Sriram↗

Developing a Dashboard Interface to Display Assessment of Hazards and Risks to sUAS Flights

The Supplemental Data Services Provider-Consolidated Dashboard (SDSP-CD) is a graphical user interface (GUI) that displays the results of predictive tools in a single location. It is intended to be used in the preflight planning phase of an operation to allow users to proactively assess predicted flight hazards off-line; expanding an operator’s overall situational awareness of a flight plan and providing an opportunity for decision making and assessing the associated risks prior to flight. Hazard data and risk predictions are informative but can be complex to read and understand. However, presented visually and in relation to flight parameters (such as flight path), the nature and significance of hazards become much more evident. The SDSP-Consolidation Dashboard interface was designed to offer a means to present the results of hazard services in an easy to-use format. Two usability studies were run to explore what features might make a suite of hazard assessment services easy to use, and to assess the SDSP-CD interface. The first study evaluated the presentation of information on the GUI and the second evaluated users’ ability to understand and use the information. The studies gathered valuable information about how users approach a hazard assessment task and interpret information from the interface. Many suggestions were given for improving the interface’s information display, to allow users to more quickly understand and interpret the information being presented.

UAV display↗

Developing a Dashboard Interface to Display Assessment of Hazards and Risks to sUAS Flights

The Supplemental Data Services Provider-Consolidated Dashboard (SDSP-CD) is a graphical user interface (GUI) that displays the results of predictive tools in a single location. It is intended to be used in the prefight planning phase of an operation to allow users to proactively assess predicted flight hazards off-line; expanding an operator’s overall situational awareness of a flight plan and providing an opportunity for decision making and assessing the associated risks prior to flight. Hazard data and risk predictions are informative but can be complex to read and understand. However, presented visually and in relation to flight parameters (such as flight path), the nature and significance of hazards become much more evident. The SDSP-Consolidation Dashboard interface was designed to offer a means to present the results of hazard services in an easy to-use format. Two usability studies were run to explore what features might make a suite of hazard assessment services easy to use, and to assess the SDSP-CD interface. The first study evaluated the presentation of information on the GUI and the second evaluated users’ ability to understand and use the information. The studies gathered valuable information about how users approach a hazard assessment task and interpret information from the interface. Many suggestions were given for improving the interface’s information display, to allow users to more quickly understand and interpret the information being presented

UAV display↗

Earthdata Search Client: Usability Review Process, Results, and Implemented Changes, Using Earthdata Search Client as a Case Study

User experience and visual design are greatly improved when usability testing is performed on a periodic basis. Design decisions should be tested by real users so that application owners can understand the effectiveness of each decision and identify areas for improvement. It is important that applications be tested not just once, but as a part of a continuing process that looks to build upon previous tests. NASA's Earthdata Search Client has undergone a usability study to ensure its users' needs are being met and that users understand how to use the tool efficiently and effectively. This poster will highlight the process followed for usability study, the results of the study, and what has been implemented in light of the results to improve the application's interface.

design↗

Developing and Validating Measurement Scales During Pandemic Conditions: A Case Study with the Scale for Habitat Usability

The Scale for Habitat Usability (SHU) is a standardized subjective scale created for collecting user feedback on habitat/vehicle design at NASA. The second phase of the study occurred during COVID-19. The scale developers were unable to collect psychometric data in person. This was challenging because the SHU is meant to collect post-use ratings after users complete a task in a habitat. Non-traditional approaches were employed to evaluate the SHU in terms of validity and reliability.

Ian Robertson↗

Low-speed wind tunnel study of longitudinal stability and usable-lift improvement of a cranked wing

An exploratory low-speed investigation of a 70 deg/46 deg cranked-wing planform was undertaken to evaluate two vortex-control concepts aimed at alleviating a severe pitch up which limits the usable lift well below the C(sub L,max) of the basic wing. One concept was a strake-like extension introduced across the wing crank, whose vortex helps to stabilize the outer-wing flow and alleviate tip stall. The other was a lower-surface cavity flap employed to trap a vortex just beneath the inboard leading edge, resulting in reduced vortex lift over the inner-wing panel. Each of these concepts was shown to eliminate the high-alpha pitch up, potentially raising the maximum usable lift of the cranked wing practically to its C(sub L,max) value.

Rao, Dhanvada M.↗

Developing and Validating Measurement Scales During Pandemic Conditions: A Case Study with the Scale for Habitat Usability

At NASA, habitat evaluations often employ subjective measures. Some measures are frequently used, well established tools, whereas others are homegrown measures tailored to specific projects. The variety of measures used makes evaluation comparisons across projects difficult. Additionally, some of these measures are burdensome, may be too specialized, or may require an expert to use and interpret, limiting their utility. Taken together, these drawbacks suggest the need for a new measurement tool. To that purpose, a team at NASA worked on developing a new scale for measuring habitat usability, the Scale for Habitat Usability (SHU). The SHU is intended to be a quick, multi-faceted measure for evaluating habitat usability across the development lifecycle. However, like many research projects, the development of the SHU faced setbacks due to the COVID-19 pandemic. Pandemic prevention protocols precluded in-person data collection, forcing the team to take some non-traditional approaches to scale development. This paper reports the steps the team took to complete the project.

Ian Robertson↗

Finite element analysis of a composite material interface

A finite element model of a composite material interface is developed to study the influence of the interface on the thermal strain in the composite. A plane stress model is used with an axisymmetric model as a check. The interface thickness, thermal coefficient, modulus, Poisson's ratio and the percent of mineral in the composite are variables in the study. The results confirmed the usability of the finite element model in studying the polymer-mineral interface.

Murray, K. H.↗

Usability Evaluation of a Flight-Deck Airflow Hazard Visualization System

Many aircraft accidents each year are caused by encounters with unseen airflow hazards near the ground, such as vortices, downdrafts, low level wind shear, microbursts, or turbulence from surrounding vegetation or structures near the landing site. These hazards can be dangerous even to airliners; there have been hundreds of fatalities in the United States in the last two decades attributable to airliner encounters with microbursts and low level wind shear alone. However, helicopters are especially vulnerable to airflow hazards because they often have to operate in confined spaces and under operationally stressful conditions (such as emergency search and rescue, military or shipboard operations). Providing helicopter pilots with an augmented-reality display visualizing local airflow hazards may be of significant benefit. However, the form such a visualization might take, and whether it does indeed provide a benefit, had not been studied before our experiment. We recruited experienced military and civilian helicopter pilots for a preliminary usability study to evaluate a prototype augmented-reality visualization system. The study had two goals: first, to assess the efficacy of presenting airflow data in flight; and second, to obtain expert feedback on sample presentations of hazard indicators to refine our design choices. The study addressed the optimal way to provide critical safety information to the pilot, what level of detail to provide, whether to display specific aerodynamic causes or potential effects only, and how to safely and effectively shift the locus of attention during a high-workload task. Three-dimensional visual cues, with varying shape, color, transparency, texture, depth cueing, and use of motion, depicting regions of hazardous airflow, were developed and presented to the pilots. The study results indicated that such a visualization system could be of significant value in improving safety during critical takeoff and landing operations, and also gave clear indications of the best design choices in producing the hazard visual cues.

Aragon, Cecilia R.↗

MPATH (Measuring Performance for Autonomy Teaming with Humans) Ground Control Station: Design Approach and Initial Usability Results

Envisioned future Advanced Air Mobility (AAM) operations will require a transition of aircraft command and control from onboard pilots to remote operators. The National Aeronautics and Space Administration (NASA) has developed a research ground control station (GCS) software called MPATH (Measuring Performance for Autonomy Teaming with Humans) to study the human factors of remote operators in a representative AAM environment, where small uncrewed aerial systems (sUAS; simulated or real) act as surrogates for larger AAM aircraft. A primary focus of the research being conducted with the MPATH GCS is scalability (i.e., one human managing multiple vehicles). MPATH has demonstrated to be a useful capability for human factors research and remote operations. Two initial usability studies and a multi-vehicle control assessment were recently conducted, and usability data and operator feedback were collected. Generally, participants rated MPATH high on usability and interface quality, whereas information quality was rated slightly lower. These results were supported by specific feedback. Several generalized GCS design recommendations are proposed based on the results and feedback from these flight activities. Future updates to MPATH will incorporate the proposed recommendations. In practice, these recommendations could be used by any GCS software designer or developer to promote usability and safety.

Advanced Air Mobility↗