Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “usability testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Testing of Two Mars Powered Descent Vehicle Concepts in the Langley Unitary Plan Wind Tunnel

Testing was conducted in the NASA Langley Unitary Plan Wind Tunnel in order to investigate the aerodynamic interference of sub-scale versions of two Mars powered descent vehicle concepts at supersonic Mach numbers (2.4 and 3.5): a model based on a blunt hypersonic inflatable aerodynamic decelerator (HIAD) and the second representing a more slender rigid vehicle with body flaps (CobraMRV). Each model was designed to accommodate up to eight nozzles, with the HIAD model having five different nozzle configurations to investigate the effects of nozzle location, cant angle, and area ratio. The models were tested with high pressure air as the nozzle plume gas, and included the following instrumentation: high-speed video, discrete steady state and high-frequency pressure, pressure sensitive paint, and a new flow-through force and moment balance for the HIAD model. The high-speed imagery showed the overall expected growth of the shock layer to increasing thrust levels. The discrete stagnation pressure data on the HIAD model with four and eight blowing nozzles was sensitive to thrust coefficient with the nozzles canted at 0 degrees, whereas having nozzles canted outward 20 degrees and/or being located closer to the heatshield shoulder largely removed that sensitivity. The CobraMRV model stagnation pressure was more sensitive to tunnel Mach number and sideslip angle, due to the nozzle arrangement and plume interference. Pressure sensitive paint data quality was compromised by paint damage from frequent model changes, especially for the HIAD model. However, pressure coefficient data on the CobraMRV model showed the same trends as the discrete pressure measurements, as well as a sensitivity to non-zero sideslip angles. The aerodynamic force coefficients were derived from the pressure sensitive paint data. On the HIAD models, the primary force coefficient decreased with increasing thrust due to the nozzle plumes blocking flow to the heatshield area surrounding the nozzle exist. On the CobraMRV model, the force coefficient was relatively insensitive to thrust coefficient at the lower Mach number when sideslip angle was 0 degrees The force coefficient decreases with increasing thrust coefficient when the sideslip angle is 10 degrees. Balance data quality was negatively impacted by thermal drift issues that were not apparent in pre-test calibration measurements, thus preventing usable test data. Results and lessons learned will be used to take further technology development steps, including more advanced ground test techniques and flight testing.

Karl T Edquist↗

Testing of Two Mars Powered Descent Vehicle Concepts in the Langley Unitary Plan Wind Tunnel

Testing was conducted in the NASA Langley Unitary Plan Wind Tunnel in order to investigate the aerodynamic interference of sub-scale versions of two Mars powered descent vehicle concepts at supersonic Mach numbers (2.4 and 3.5): a model based on a blunt hypersonic inflatable aerodynamic decelerator (HIAD) and the second representing a more slender rigid vehicle with body flaps (CobraMRV). Each model was designed to accommodate up to eight nozzles, with the HIAD model having five different nozzle configurations to investigate the effects of nozzle location, cant angle, and area ratio. The models were tested with high pressure air as the nozzle plume gas, and included the following instrumentation: high-speed video, discrete steady state and high-frequency pressure, pressure sensitive paint, and a new flow-through force and moment balance for the HIAD model. The high-speed imagery showed the overall expected growth of the shock layer to increasing thrust levels. The discrete stagnation pressure data on the HIAD model with four and eight blowing nozzles was sensitive to thrust coefficient with the nozzles canted at 0 degrees, whereas having nozzles canted outward 20 degrees and/or being located closer to the heatshield shoulder largely removed that sensitivity. The CobraMRV model stagnation pressure was more sensitive to tunnel Mach number and sideslip angle, due to the nozzle arrangement and plume interference. Pressure sensitive paint data quality was compromised by paint damage from frequent model changes, especially for the HIAD model. However, pressure coefficient data on the CobraMRV model showed the same trends as the discrete pressure measurements, as well as a sensitivity to non-zero sideslip angles. The aerodynamic force coefficients were derived from the pressure sensitive paint data. On the HIAD models, the primary force coefficient decreased with increasing thrust due to the nozzle plumes blocking flow to the heatshield area surrounding the nozzle exist. On the CobraMRV model, the force coefficient was relatively insensitive to thrust coefficient at the lower Mach number when sideslip angle was 0 degrees The force coefficient decreases with increasing thrust coefficient when the sideslip angle is 10 degrees. Balance data quality was negatively impacted by thermal drift issues that were not apparent in pre-test calibration measurements, thus preventing usable test data. Results and lessons learned will be used to take further technology development steps, including more advanced ground test techniques and flight testing.

Supersonic Retropropulsion↗

Experiences with a Flexible User Research Process to Build Data Change Tools

Scientific software development processes are understood to be distinct from commercial software development practices due to uncertain and evolving states of scientific knowledge. Sustaining these software products is a recognized challenge, but under-examined is the usability and usefulness of such tools to their scientific end users. User research is a well-established set of techniques (e.g., interviews, mockups, usability tests) applied in commercial software projects to develop foundational, generative, and evaluative insights about products and the people who use them. Currently these approaches are not commonly applied and discussed in scientific software development work. The use of user research techniques in scientific environments can be challenging due to the nascent, fluid problem spaces of scientific work, varying scope of projects and their user communities, and funding/economic constraints on projects.In this paper, we reflect on our experiences undertaking a multi-method user research process in the Deduce project. The Deduce project is investigating data change to develop metrics, methods, and tools that will help scientists make decisions around data change. There is a lack of common terminology since the concept of systematically measuring and managing data change is under explored in scientific environments. To bridge this gap we conducted user research that focuses on user practices, needs, and motivations to help us design and develop metrics and tools for data change. This paper contributes reflections and the lessons we have learned from our experiences. We offer key takeaways for scientific software project teams to effectively and flexibly incorporate similar processes into their projects.

97 MATHEMATICS AND COMPUTING↗

Earthdata Search Client: Usability Review Process, Results, and Implemented Changes, Using Earthdata Search Client as a Case Study

User experience and visual design are greatly improved when usability testing is performed on a periodic basis. Design decisions should be tested by real users so that application owners can understand the effectiveness of each decision and identify areas for improvement. It is important that applications be tested not just once, but as a part of a continuing process that looks to build upon previous tests. NASA's Earthdata Search Client has undergone a usability study to ensure its users' needs are being met and that users understand how to use the tool efficiently and effectively. This poster will highlight the process followed for usability study, the results of the study, and what has been implemented in light of the results to improve the application's interface.

design↗

Calibration of HYPULSE for hypervelocity air flows corresponding to flight Mach numbers 13.5, 15, and 17

A series of air calibration tests were performed in GASL's HYPULSE facility in order to more accurately determine test section flow conditions for flows simulating total enthalpies in the Mach 13 to 17 range. Present calibration data supplements previous data and includes direct measurement of test section pitot and static pressure, acceleration tube wall pressure and heat transfer, and primary and secondary incident shock velocities. Useful test core diameters along with the corresponding free-stream conditions and usable testing times were determined. For the M13.5 condition, in-stream static pressure surveys showed the temporal and spacial uniformity of this quantity across the useful test core. In addition, finite fringe interferograms taken of the free-stream flow at the test section did not indicate the presence of any 'strong' wave system for any of the conditions investigated.

Calleja, John↗

Human Factors Evaluation of Energy Visualization Dashboards

Energy visualization systems provide information about use in real-time to assist users with energy efficiency. In this study, three energy visualization dashboards for small businesses were developed and tested. Performance measurement, NASA Task Load Index (TLX) workload assessment, and posttest survey were used to conduct the usability testing. Compared with the dashboards that were designed using line charts and tables, a dashboard designed using visuals (e.g., gauges, pie charts, and flashing lights) produced quicker response time, lower mental and temporal demand and effort ratings, and higher ratings of engagement, interest, and trustworthiness.

Nimbarte, Ashish D. (ORCID:0000000210599112)↗

Propulsion simulation test technique for V/STOL configurations

Ames Research Center is developing the technology for turbine-powered jet engine simulators so that airframe/propulsion system interactions on V/STOL fighter aircraft and other highly integrated configurations can be studied. This paper describes the status of the compact multimission aircraft propulsion simulator (CMAPS) technology. Three CMAPS units have accumulated a total of 340 hr during approximately 1-1/2 yr of static and wind-tunnel testing. A wind-tunnel test of a twin-engine CMAPS-equipped close-coupled canard-wing V/STOL model configuration with nonaxisymmetric nozzles was recently completed. During this test approximately 140 total hours were logged on two CMAPS units, indicating that the rotating machinery is reliable and that the CMAPS and associated control system provide a usable test tool. However, additional development is required to correct a drive manifold O-ring problem that limits the engine-pressure-ratio (EPR) to approximately 3.5.

Bailey, R. O.↗

Transient, hypervelocity flow in an axisymmetric nozzle

The performance of an axisymmetric nozzle was examined which was designed to produce uniform, parallel flow with a nominal Mach number of 8. A free-piston driven shock tube was used to supply the nozzle with high-temperature, high-pressure test gas. Performance was assessed by measuring Pitot pressures across the exit plane of the nozzle and, over the range of operating conditions examined, the nozzle produced satisfactory test flows. However, there were flow disturbances that persisted for significant times after flow initiation. The detailed starting process of the nozzle was also investigated by performing numerical simulations at several nominal test conditions. The classical description of the starting process, based on a quasi-one-dimensional model, provided a reasonable approximation and was used to demonstrate that the starting process could consume a significant fraction of the otherwise usable test gas. This was especially important at high operating enthalpies where nozzle supply conditions were maintained for shorter times. Multidimensional simulations illustrated a mechanism by which the starting process in the actual nozzle could take longer than that predicted by the quasi-one-dimensional analysis. However, the cause of the persistent disturbances observed in the experimental calibration was not identified.

Jacobs, P. A.↗

Preliminary Design of an 'Autonomous Medical Response Agent' Interface Prototype for Long Duration Spaceflight

Major challenges for astronauts in future long-duration exploration missions (LDEMs) will be that crewmembers are not expected to be medical professionals, may be under high workload and stress, are facing physiological challenges caused by spaceflight, and will have limited, delayed voice communications with medical support from Earth. An autonomous medical response agent (AMRA) is envisioned to help astronauts address medical complaints, develop a differential diagnosis, and guide self-treatment until a healthy state is restored. AMRA develops a process of personalized diagnosis and treatment through a Bayesian predictive control system that recommends therapeutic control actions including diagnostic tests and treatments to crewmembers (Menon, 2020). The Human Computer Interaction (HCI) lab from NASA Ames Research Center’s Human Systems Integration Division (Code TH) has collaborated with Nahlia Inc in human-centered design augmentation research for AMRA. The project, titled Design of ‘Autonomous Medical Response Agent Interface Prototype for Long Duration Spaceflight, has been funded by the Translational Research Institute for Space Health (TRISH) and introduces an interactive user-interface prototype that guides astronauts through self-diagnosis, treatment, and rehabilitation while communicating with remote specialists in ground support (most notably a patient’s flight surgeon). Our project develops the interaction design for the crewmember using AMRA through user research, iterative design, and usability testing to evaluate the user interface and workflow designed. The interface design deliverable for this project, titled AMRA Aggregate Information Display (AMRA AID) is an integrated information display system for comprehensive autonomous medical guidance, diagnosis, and treatment of in-flight medical conditions experienced by crewmembers. AMRA AID demonstrates how we might ensure crew autonomy, increase the crew’s medical capabilities, and decrease cognitive burden within a front-end user interface. AMRA AID refrains from relying on input from ground or mission control for self-treatment of medical issues—though ground awareness and communication with ground is maintained as a means of ensuring trust between mission control and crew. AMRA AID demonstrates how the crew’s on-board medical system might integrate with information from vehicle monitoring and crew schedule, without assuming causal relationships. AMRA AID’s comprehensive view enables efficient information access for both crew and ground support, reducing cognitive burden in the event of an unplanned or emergency medical incident and enabling informed analytical decisions to be made based on both crew and vehicle health. Human-centered design augmentation advanced within the prototype included: enhanced workflow and treatment guidance for two medical scenarios for a non-specialist user base with various levels of medical training, interaction design which considered speech (conversational user interface) elements and on-screen interactions to be developed in future iterations of the project, communication design and functional requirements relevant to self-care versus caring for another astronaut, as well as user testing of the prototype with an international space medical community. This project arrives at critical findings regarding usability needs, communication requirements, and integrated information requirements for a future technology interface functioning to increase confidence between ground support and LDEM crewmembers.

TRISH↗

Earthdata Search Summer ESIP Usability Workshop

The Earthdata Search Client has undergone multiple rounds of usability testing during 2017 and the user feedback received has resulted in an enhanced user interface. This session will showcase the new Earthdata Search Client user interface and provide hands-on experience for participants to learn how to search, visualize and download data in the desired format.

Discovery↗

Assessment of Electric Grid Transmission System Simulator for Human Factors Research

Over the past decades, various technologies have been developed for electric grid operations to support clean energy, meet rising electricity demands, and address infrastructure concerns. However, the human factors aspect is often overlooked during rapid integration. Questions persist about how these technologies impact human performance. Simulators play a critical role in supporting investigation of human factors design concepts and conducting comprehensive usability testing to evaluate human performance and assess human reliability. This paper aims to address human factors research simulator requirements and conduct a comparative study of six different simulators. A detailed evaluation reveals that the evaluated simulators lack the ability to customize user interfaces. Additionally, their user interface designs do not fulfill the basic human factors design principles, potentially leading to increased response variability and reduced statistical power when conducting controlled experimental research. In the future, it is essential to develop scripting tools to integrate customizable user interfaces and simulation models, ensuring meeting research requirements.

Li, Ruixuan↗

Investigating Scientific Data Change with User Research Methods

Scientific datasets are continually expanding and changing due to fluctuations with instruments, quality assessment and quality control processes, and modifications to software pipelines. Datasets include minimal information about these changes or their effects requiring scientists manually assess modifications through a number of labor intensive and ad-hoc steps. The Deduce project is investigating data change to develop metrics, methods, and tools that will help scientists systematically identify and make decisions around data changes. Currently, there is a lack of understanding, and common practices, for identifying and evaluating changes in datasets since systematically measuring and managing data change is under explored in scientific work. We are conducting user research to address this need by exploring scientist's conceptualizations, behaviors, needs, and motivations when dealing with changing datasets. Our user research utilizes multiple methods to produce foundational, generative insights and evaluate research products produced by our team. In this paper, we detail our user research process and outline our findings about data change that emerge from our studies. Our work illustrates how scientific software teams can push beyond just usability testing user interfaces or tools to better probe the underlying ideas they are developing solutions to address.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE BSSD Performance Management Metrics Report Q2

The vision of the National Microbiome Data Collaborative (NMDC) centers on the concept of connecting data, people, and ideas to advance microbiome innovation and discovery. Building data infrastructure, while key to NMDC’s ability to execute on our vision, can only go so far in creating scientific impact. By fostering strong community partnerships and developing a set of robust community outreach and training programs, we are able to turn our products – the Submission Portal, NMDC EDGE, and the Data Portal – into tools that empower the scientific community. Our multi-pronged community building approach spans individual researchers, research teams, consortia and scientific societies, and institutions and federal agencies. To foster a collaborative and inclusive community-centered environment, we have identified three strategic objectives to promote an inclusive and connected community: (1) recognize and support the diverse research needs and perspectives of the microbiome research community; (2) promote best practices across the microbiome community, from researchers to funders, through community-driven practices (FAIR, CARE, and TRUST); and (3) build a microbiome ecosystem that enables scientific discovery and innovation across stakeholders. These strategic objectives allow our team to focus on impact across a diverse range of activities, from launching the American Society for Microbiology (ASM) Microbiome Data Prize to supporting the Ambassador and Champions programs fostering learning and building a collaborative network. We broadly communicate our work through social media (X/Twitter, LinkedIn, and Instagram), The Microbiome Standard (our quarterly newsletter), and Annual Reports. All our work is underpinned by a strong commitment to diversity, equity, and inclusion as articulated in our Action Plan that tracks progress towards key metrics. A core component of our engagement strategy is user research. User research ensures the Submission Portal, NMDC EDGE, Data Portal, and the new Field Notes mobile app are designed with and for the scientific community. Our user research efforts consist of asking researchers exploratory questions to collect information on researcher priorities, methodologies, and perceptions to ensure that we are aware of the current state of microbiome research. Our usability testing provides researchers with prototypes or test environments of the NMDC products, and we capture valuable information on how users interact with the products to make improvements. Given the diverse nature of microbiome work, we acknowledge that we are not aware of all pressing data challenges and thus rely on the research community to help us identify the most important issues to prioritize. To date, we have conducted 24 interviews and one beta-testing call with 10 participants across all NMDC products, which have generated 321 insights and 120 action items. Herein, we describe the ways we engage with the microbiome research community to advance the NMDC mission.

59 BASIC BIOLOGICAL SCIENCES↗

The use of analytical models in human-computer interface design

Recently, a large number of human-computer interface (HCI) researchers have investigated building analytical models of the user, which are often implemented as computer models. These models simulate the cognitive processes and task knowledge of the user in ways that allow a researcher or designer to estimate various aspects of an interface's usability, such as when user errors are likely to occur. This information can lead to design improvements. Analytical models can supplement design guidelines by providing designers rigorous ways of analyzing the information-processing requirements of specific tasks (i.e., task analysis). These models offer the potential of improving early designs and replacing some of the early phases of usability testing, thus reducing the cost of interface design. This paper describes some of the many analytical models that are currently being developed and evaluates the usefulness of analytical models for human-computer interface design. This paper will focus on computational, analytical models, such as the GOMS model, rather than less formal, verbal models, because the more exact predictions and task descriptions of computational models may be useful to designers. The paper also discusses some of the practical requirements for using analytical models in complex design organizations such as NASA.

Gugerty, Leo↗

Knowledge-based critiquing of graphical user interfaces with CHIMES

CHIMES is a critiquing tool that automates the process of checking graphical user interface (GUI) designs for compliance with human factors design guidelines and toolkit style guides. The current prototype identifies instances of non-compliance and presents problem statements, advice, and tips to the GUI designer. Changes requested by the designer are made automatically, and the revised GUI is re-evaluated. A case study conducted at NASA-Goddard showed that CHIMES has the potential for dramatically reducing the time formerly spent in hands-on consistency checking. Capabilities recently added to CHIMES include exception handling and rule building. CHIMES is intended for use prior to usability testing as a means, for example, of catching and correcting syntactic inconsistencies in a larger user interface.

Jiang, Jianping↗

Independent Verification and Validation of Complex User Interfaces: A Human Factors Approach

The Usability Testing and Analysis Facility (UTAF) at the NASA Johnson Space Center has identified and evaluated a potential automated software interface inspection tool capable of assessing the degree to which space-related critical and high-risk software system user interfaces meet objective human factors standards across each NASA program and project. Testing consisted of two distinct phases. Phase 1 compared analysis times and similarity of results for the automated tool and for human-computer interface (HCI) experts. In Phase 2, HCI experts critiqued the prototype tool's user interface. Based on this evaluation, it appears that a more fully developed version of the tool will be a promising complement to a human factors-oriented independent verification and validation (IV&V) process.

Whitmore, Mihriban↗

Special Purpose Crew Restraints for Teleoperation

With permanent human presence onboard the International Space Station (ISS), and long duration space missions being planned for the moon and Mars, humans will be living and working in microgravity over increasingly long periods of time. In addition to weightlessness, the confined nature of a spacecraft environment results in ergonomic challenges such as limited visibility, and access to the activity area. These challenges can result in prolonged periods of unnatural postures for the crew, ultimately causing pain, injury, and loss of productivity. Determining the right set of human factors requirements and providing an ergonomically designed environment is crucial to mission success. While a number of general purpose restraints have been used on ISS (handrails, foot loops), experience has shown that these general purpose restraints may not be optimal, or even acceptable for some tasks that have unique requirements. For example, some onboard activities require extreme stability (e.g., glovebox microsurgery), and others involve the use of arm, torso and foot movements in order to perform the task (e-g. robotic teleoperation); standard restraint systems will not work in these situations. The Usability Testing and Analysis Facility (WAF) at the NASA Johnson Space Center began evaluations of crew restraints for these special situations by looking at NASAs Robonaut. Developed by the Robot Systems Technology Branch, Robonaut is a humanoid robot that can be remotely operated through a tetepresence control system by an operator. It was designed to perform work in hazardous environments (e.g., Extra Vehicular Activities). A Robonaut restraint was designed, modeled for the population, and ultimately tested onboard the KC-135 microgravity aircraft. While in microgravity, participants were asked to get in and out of the restraint from different locations, perform maximum reach exercises, and finally to teleoperate Robonaut while in the restraint. The sessions were videotaped, and participants completed a questionnaire at the end of each flight day. Results from this evaluation are being used to develop the human factors design requirements for teleoperation tasks in microgravity.

Whitmore, Mihriban↗