Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Human Factors Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Team-Centered Perspective for Adaptive Automation Design

Automation represents a very active area of human factors research. The journal, Human Factors, published a special issue on automation in 1985. Since then, hundreds of scientific studies have been published examining the nature of automation and its interaction with human performance. However, despite a dramatic increase in research investigating human factors issues in aviation automation, there remain areas that need further exploration. This NASA Technical Memorandum describes a new area of automation design and research, called adaptive automation. It discusses the concepts and outlines the human factors issues associated with the new method of adaptive function allocation. The primary focus is on human-centered design, and specifically on ensuring that adaptive automation is from a team-centered perspective. The document shows that adaptive automation has many human factors issues common to traditional automation design. Much like the introduction of other new technologies and paradigm shifts, adaptive automation presents an opportunity to remediate current problems but poses new ones for human-automation interaction in aerospace operations. The review here is intended to communicate the philosophical perspective and direction of adaptive automation research conducted under the Aerospace Operations Systems (AOS), Physiological and Psychological Stressors and Factors (PPSF) project.

Prinzel, Lawrence J., III

Maintenance Human Factors and Flight Safety

This chapter will chronicle the journey of the community of operators, regulators, and researchers who embarked upon the task of identifying critical human factors of maintenance and inspection, establishing a database and research tools, developing practical strategies for reducing the risks of maintenance and inspection errors, and understanding its critical role in preserving flight safety. We will take a historical perspective, developing a timeline that is largely driven by key events such as accidents and regulatory/government actions and initiatives. Part 1 focuses on how the field of maintenance human factors was built, beginning in the late 1980’s. Part 2 describes the development of methods and tools for meeting the maintenance human factors challenges identified. Finally, Part 3 updates the original chapter by focusing on issues that have persisted or emerged since 2010.

maintenance

Usability Evaluation Technical Report: A Usability Evaluation of the Communication Tool Prototype Prepared in Adobe XD for High Density Vertiplex (HDV) Team

Purpose: As cities get more crowded, the roadway infrastructure cannot keep up with the travel demands. Aviation can be a solution. Organizations supporting NASA’s Urban Air Mobility (UAM) concept are conducting studies on feasible concepts of operations for the new air traffic management system required to implement UAM. NASA’s High Density Vertiplex (HDV) team conducts studies using both live flights and simulations. Significance: The goal of this study is to evaluate the effectiveness of a communication tool developed for this team to enhance team situation awareness. Specifically, the study aims to determine if the communication tool is effective in allowing NASA-Langley and NASA-Ames team members playing different roles to understand what others are doing so that completed steps can be communicated to the whole team. Methods: This study asks participants to conduct four distinct scenarios using an Adobe XD prototype. Participants included five members of the target audience, who each received up to 15 minutes of training on how to use the Adobe XD prototype. The participants were NASA-Ames or NASA-Langley researchers, developers or tech leads who had 0 to 15 years of experience. Their ages ranged from 20 to 40 years old, and they were of both genders. After training, each participant was asked to do 4 tasks of varying difficulty, using the prototype testbed. After each task they reported on task difficulty and after all tasks were completed they were asked to fill out the System Usability Survey (SUS). Performance will be assessed through task completion time and accuracy rating. Results: User perception was evaluated by the SUS which showed a mean score over the six participants of 84. All the participants were above the acceptable range which was 70 and nobody was in the marginal usability zone between 50 and 70. In addition, most of the participants did well in terms of time on task, success rate and task difficulty on all the tasks except for Task 3. Participants had two minutes to do the task correctly to succeed at the task, otherwise it was marked as a failure. The geomean for Task 1 for completion time was 22.20; Task 2 was 58.28; Task 3 was 84.68 and Task 4 was 19.61. In Task 3, three out of six people failed this task but all five scored this with an average score 4.2 out of 5 for self-rating on task difficulty.

human factors

Examining Performance and Usability of Situation Awareness Communication Tool for NASA's High Density Vertiplex (HDV) Team

Purpose: As cities get more crowded, the roadway infrastructure cannot keep up with the travel demands. Aviation can be a solution. Organizations supporting NASA’s Urban Air Mobility (UAM) concept are conducting studies on feasible concepts of operations for the new air traffic management system required to implement UAM. NASA’s High Density Vertiplex (HDV) team conducts studies using both live flights and simulations. Significance: The goal of this study is to evaluate the effectiveness of a communication tool developed for this team to enhance team situation awareness. Specifically, the study aims to determine if the communication tool is effective in allowing NASA-Langley and NASA-Ames team members playing different roles to understand what others are doing so that completed steps can be communicated to the whole team. Methods: This study asks participants to conduct four distinct scenarios using an Adobe XD prototype. Participants included five members of the target audience, who each received up to 15 minutes of training on how to use the Adobe XD prototype. The participants were NASA-Ames or NASA-Langley researchers, developers or tech leads who had 0 to 15 years of experience. Their ages ranged from 20 to 40 years old, and they were of both genders. After training, each participant was asked to do 4 tasks of varying difficulty, using the prototype testbed. After each task they reported on task difficulty and after all tasks were completed they were asked to fill out the System Usability Survey (SUS). Performance will be assessed through task completion time and accuracy rating. Results: User perception was evaluated by the SUS which showed a mean score over the six participants of 84. All the participants were above the acceptable range which was 70 and nobody was in the marginal usability zone between 50 and 70. In addition, most of the participants did well in terms of time on task, success rate and task difficulty on all the tasks except for Task 3. Participants had two minutes to do the task correctly to succeed at the task, otherwise it was marked as a failure. The geomean for Task 1 for completion time was 22.20; Task 2 was 58.28; Task 3 was 84.68 and Task 4 was 19.61. In Task 3, three out of six people failed this task but all five scored this with an average score 4.2 out of 5 for self-rating on task difficulty.

human factors

Everybody Needs Somebody Sometimes: Validation of Adaptive Recovery in Robotic Space Operations

This work assesses an adaptive approach to fault recovery in autonomous robotic space operations, which uses indicators of opportunity, such as physiological state measurements and observations of past human assistant performance, to inform future selections. We validated our reinforcement learning approach using data we collected from humans executing simulated mission scenarios. We present a method of structuring human-factors experiments that permits collection of relevant indicator of opportunity and assigned assistance task performance data, as well as evaluation of our adaptive approach, without requiring large numbers of test subjects. Application of our reinforcement learning algorithm to our experimental data shows that our adaptive assistant selection approach can achieve lower cumulative regret compared to existing non-adaptive baseline approaches when using real human data. Our work has applications beyond space robotics to any application where autonomy failures may occur that require external intervention.

Human-centered robotics

Certification for civil flight decks and the human-computer interface

This paper will address the issue of human factor aspects of civil flight deck certification, with emphasis on the pilot's interface with automation. In particular, three questions will be asked that relate to this certification process: (1) are the methods, data, and guidelines available from human factors to adequately address the problems of certifying as safe and error tolerant the complex automated systems of modern civil transport aircraft; (2) do aircraft manufacturers effectively apply human factors information during the aircraft flight deck design process; and (3) do regulatory authorities effectively apply human factors information during the aircraft certification process?

Mcclumpha, Andrew J.

Previous experience in manned space flight: A survey of human factors lessons learned

Previous experience in manned space flight programs can be used to compile a data base of human factors lessons learned for the purpose of developing aids in the future design of inhabited spacecraft. The objectives are to gather information available from relevant sources, to develop a taxonomy of human factors data, and to produce a data base that can be used in the future for those people involved in the design of manned spacecraft operations. A study is currently underway at the Johnson Space Center with the objective of compiling, classifying, and summarizing relevant human factors data bearing on the lessons learned from previous manned space flights. The research reported defines sources of data, methods for collection, and proposes a classification for human factors data that may be a model for other human factors disciplines.

Chandlee, George O.

Interface Consistency: Phase I Results & Phase II Status

Future exploration missions will rely on designing and developing vehicles and complex systems from within NASA and through multiple external commercial partners to meet mission goals. Despite existing consistency-related agency requirements, NASA’s approach to commercial spaceflight development encourages providers’ flexibility and innovation. This strategy is resulting in significant design diversity across Artemis vehicles. Design best practices and guidelines champion interface consistency to promote mental model development and knowledge transfer. However, research investigating the benefits of consistency is mixed, and little is known about its role in complex systems. Determining the level of risk that system diversity presents is difficult, as there is no established method for quantifying the degree of consistency within and across interfaces, nor is there information about the differential impacts of different types of inconsistency. Phase I of this project (Characterization and Measurement) served as a starting point to better understand the construct of consistency, its application, and the range of studies and methods for measuring it. The project team created a taxonomy of consistency to apply to interfaces as a framework to guide the development of tools to assess intersystem consistency. Checklist and cognitive walkthrough methods were developed for use by human factors (HF) and human-computer interaction (HCI) experts. The Intersystem Consistency Scale (ICS) was developed for interface evaluations with crew. A pilot study evaluated the methods’ ability to distinguish differences between Artemis-like prototype pairs exhibiting either high or low design consistency. In addition, click errors and time on task were collected within the ICS (crew-like) group. Results from our exploratory analysis and lessons learned from the pilot study will be discussed. The project team will also present the status of Phase II (Risk Assessment, Standards and Guidelines). This includes incorporating feedback to redesign the assessment tools, and inputs from displays and training Subject Matter Experts to update tasks and prototype designs. The team will present the risk assessment study design to identify the types and levels of inconsistency that pose the greatest risk to performance. Plans to apply these results toward agency standards and guideline recommendations will also be discussed.

Human-Computer Interaction

Psychophysiological Methods to Assess Pilot Productive Safety Behaviors

The NASA System-Wide Safety (SWS) Project is focused on developing new technologies and operational concepts for the aviation industry to meet the increasing global demand while maintaining the current ultra-safe system safety levels. To achieve this, the SWS Project is developing research priorities, including In-time System-wide Safety Assurance (ISSA) and In-time Aviation Safety Management System (IASMS; Ellis et al., 2019). A critical component of the IASMS is the human as pilot and in other roles in aviation operations as demonstrated by SWS human factors research on rare occurrences of human error and the far more prevalent human safety producing behaviors (e.g., Hollnagel, 2016). The talk presented by Chad Stephens of NASA Langley Research Center and NASA SWS Project will describe the history of human factors research involving psychophysiological and biocybernetics methods supporting aviation safety conducted at NASA. Specific examples of recent NASA crew state monitoring research focused on a psychophysiological assessment method and system to enable Training for Attention Management will be demonstrated. Current SWS research including the SWS Operations and Technologies for Enabling Resilient In-Time Assurance (SOTERIA) flight simulation study and a data testbed created to enable study of Human Contributions to Safety (HC2S) will be presented. Ongoing collaborative research efforts with Boeing researchers will be highlighted and opportunities for further collaboration will be discussed.

psychophysiology

Microgreens Root Zone/Shoot Zone Partitioned Planting Box

To enable sustainable food production in future human exploration missions, plant growth is being studied by the Space Crop Production Team at KSC. Microgreens are good candidates for food supplements and contain specific nutrients that are lacking in the prepackaged diet, including vitamin C and vitamin K. Because they are densely sown, typical growth methods do not allow the ability to distinguish between the levels of evaporation from the rooting substrate and transpiration from the leaves. With larger plants, the root and shoot zone can be separated to distinguish these fluxes and accurate transpiration measurements of plant canopies are feasible. Furthermore, separation of the root and shoot zone may also be beneficial when harvesting microgreens in microgravity as it may reduce microbial contamination of the edible biomass by the roots, which have high microbial loads. Using a root and shoot separator box when harvesting may help with microbial contamination, but these tiny plants are challenging to handle in microgravity, so harvest management remains an open question. The innovation proposed here is a microgreen root/shoot partitioned planting box, which offers a solution to these challenges with accurate gas exchange measurements and a safe microgreen harvest in low gravity environments. Being able to measure transpiration of a microgreen canopy will be important for modeling plant growth in reduced gravity environments, so the first objective was to develop a planting unit with a seal between the root zone and the shoot zone. With an unsuitable harvesting technique, freshly harvested microgreens may add debris to the cabin, so the second objective was to test different harvesting techniques and management approaches associated with this innovation. These two objectives were pursued in parallel since many goals were the same: develop a planting unit that 1) separates the shoots from the roots, 2) allows acceptable germination rate, and 3) allows for seedlings to emerge and develop. What differed was the need to have a seal, which was only applicable for our gas exchange goal, and the need to have an embedded harvesting mechanism and bagging method which only applied to our harvesting goal. Testing of the various harvesting mechanisms and bagging methods was performed during a series of parabolic flights. All parabolic flight procedures took place inside a rented secondary containment chamber (e.g., glovebox) that was developed by the University of Louisville specifically for experiments involving fluids and other materials that may become airborne during reduced gravity flight. Three different harvesting methods and two different bagging collection methods were tested for microgreens. A third bagging method was initially tested but found to be unsuitable. Human factors were also taken into consideration, to identify which harvest and bagging collection methods would be easiest to use with favorable results in microgravity. Three parabolic flight tests were performed in total, one in November 2021 and two in December 2021.

Gioia Massa

Parametric identification of human operator models

The accurate and efficient identification of the human operator is still a need in human factors engineering especially concerning multivariable control. Control theoretic identification methods need to be tested with human operator models under realistic boundary conditons. The requirements and criteria for the use of parametric methods, selected models as well as the Maximum Likelihood Method and the Extended Kalman Filter are displayed. The experiments and results are comparatively discussed from the point of practical engineering.

Ninz, N. R.

An Independent Human Factors Analysis and Evaluation of the Emergency Medical Protocol Checklist for the International Space Station

Emergency medical capabilities aboard the ISS include a Crew Medical Officer (CMO) (not necessarily a physician), and back-up, resuscitation equipment, and a medical checklist. It is essential that CMOs have reliable, usable and informative medical protocols that can be carried out independently in flight. The study evaluates the existing ISS Medical Checklist layout against a checklist updated to reflect a human factors approach to structure and organization. Method: The ISS Medical checklist was divided into non-emergency and emergency sections, and re-organized based on alphabetical and a body systems approach. A desk-top evaluation examined the ability of subjects to navigate to specific medical problems identified as representative of likely non-emergency events. A second evaluation aims to focus on the emergency section of the Medical Checklist, based on the preliminary findings of the first. The final evaluation will use Astronaut CMOs as subjects comparing the original checklist against the updated layout in the task of caring for a "downed crewmember" using a Human Patient Simulator [Medical Education Technologies, Inc.]. Results: Initial results have demonstrated a clear improvement of the re-organized sections to determine the solution to the medical problems. There was no distinct advantage for either alternative, although subjects stated having a preference for the body systems approach. In the second evaluation, subjects will be asked to identify emergency medical conditions, with measures including correct diagnosis, time to completion and solution strategy. The third evaluation will compare the original and fully updated checklists in clinical situations. Conclusions: Initial findings indicate that the ISS Medical Checklist will benefit from a reorganization. The present structure of the checklist has evolved over recent years without systematic testing of crewmember ability to diagnose medical problems. The improvements are expected to enable ISS Crewmembers to more speedily and accurately respond to medical situations on the ISS.

Marshburn, Thomas

Addressing Human System Risks to Future Space Exploration

NASA is contemplating future human exploration missions to destinations beyond low Earth orbit, including the Moon, deep-space asteroids, and Mars. While we have learned much about protecting crew health and performance during orbital space flight over the past half-century, the challenges of these future missions far exceed those within our current experience base. To ensure success in these missions, we have developed a Human System Risk Board (HSRB) to identify, quantify, and develop mitigation plans for the extraordinary risks associated with each potential mission scenario. The HSRB comprises research, technology, and operations experts in medicine, physiology, psychology, human factors, radiation, toxicology, microbiology, pharmacology, and food sciences. Methods: Owing to the wide range of potential mission characteristics, we first identified the hazards to human health and performance common to all exploration missions: altered gravity, isolation/confinement, increased radiation, distance from Earth, and hostile/closed environment. Each hazard leads to a set of risks to crew health and/or performance. For example the radiation hazard leads to risks of acute radiation syndrome, central nervous system dysfunction, soft tissue degeneration, and carcinogenesis. Some of these risks (e.g., acute radiation syndrome) could affect crew health or performance during the mission, while others (e.g., carcinogenesis) would more likely affect the crewmember well after the mission ends. We next defined a set of design reference missions (DRM) that would span the range of exploration missions currently under consideration. In addition to standard (6-month) and long-duration (1-year) missions in low Earth orbit (LEO), these DRM include deep space sortie missions of 1 month duration, lunar orbital and landing missions of 1 year duration, deep space journey and asteroid landing missions of 1 year duration, and Mars orbital and landing missions of 3 years duration. We then assessed the likelihood and consequences of each risk against each DRM, using three levels of likelihood (Low: less than or equal to 0.1%; Medium: 0.1%–1.0%; High: greater than or equal to 1.0%) and four levels of consequence ranging from Very Low (temporary or insignificant) to High (death, loss of mission, or significant reduction to length or quality of life). Quantitative evidence from clinical, operational, and research sources were used whenever available. Qualitative evidence was used when quantitative evidence was unavailable. Expert opinion was used whenever insufficient evidence was available. Results: A set of 30 risks emerged that will require further mitigation efforts before being accepted by the Agency. The likelihood by consequence risk assessment process provided a means of prioritizing among the risks identified. For each of the high priority risks, a plan was developed to perform research, technology, or standards development thought necessary to provide suitable reduction of likelihood or consequence to allow agency acceptance. Conclusion: The HSRB process has successfully identified a complete set of risks to human space travelers on planned exploration missions based on the best evidence available today. Risk mitigation plans have been established for the highest priority risks. Each risk will be reassessed annually to track the progress of our risk mitigation efforts.

Paloski, W. H.

The Human Subsystem - Definition and Integration

This paper will discuss the use of the human subsystem in development phases of human space flight. Any space mission has clearly defined subsystems, managed by experts attached to these. Clearly defined subsystems and correct use provide easier and more efficient development for each independent subsystem and for the relation between these subsystems. Furthermore, this paper will argue that a defined subsystem related to humans in space has not always been clearly present, and that correct implementation is perhaps missing, based on experience and survey data. Finally, the authors will discuss why the human subsystem has not been fully integrated, why it must be a mandatory part of the programming, a re-definition of the human subsystem, and suggestions of methods to improve the integration of human factors in the development.

vonBengston, Kristian

Human Modeling for Ground Processing Human Factors Engineering Analysis

There have been many advancements and accomplishments over the last few years using human modeling for human factors engineering analysis for design of spacecraft. The key methods used for this are motion capture and computer generated human models. The focus of this paper is to explain the human modeling currently used at Kennedy Space Center (KSC), and to explain the future plans for human modeling for future spacecraft designs

Stambolian, Damon B.

Artemis Internal Science Team Update: Data and Software Development

Artemis will reestablish human presence on the Moon and lead to a new era of scientific discovery and exploration. Led by the National Aeronautics and Space Administration (NASA), Artemis includes a collaboration of space agencies and companies from around the world. In support of Artemis, a cross-disciplinary effort of science, engineering, mission operations, and human factors personnel is developing the best methods, facilities, and field locations to test hardware, train astronauts, and evaluate modern concepts of operations. This abstract, as part of the Artemis Internal Science Team (AIST), provides an update to the science-relevant data and software developments and integrated testing efforts that have occurred in 2022.

M. J. Miller

Human factors issues in the design of user interfaces for planning and scheduling

The purpose is to provide and overview of human factors issues that impact the effectiveness of user interfaces to automated scheduling tools. The following methods are employed: (1) a survey of planning and scheduling tools; (2) the identification and analysis of human factors issues; (3) the development of design guidelines based on human factors literature; and (4) the generation of display concepts to illustrate guidelines.

Murphy, Elizabeth D.