SEARCH · Engineering Papers

Results for “human in the loop”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

All sources NASA NTRS DOE OSTI

NASA NTRS2018

Automated Scenario Generation for Human-in-the-Loop Simulations

Automated Multi-Aircraft Control System scenario generation for Human-in-the-Loop (HITL) evaluations of air traffic management concepts is described. The objective is to replace the difficult manual process with the automated process for creating an initial (seed) scenario that serves as a starting point for manual adjustments for creating the Human-in-the-Loop scenario. Methods for analyzing and comparing the seed-scenario generated using the automated process and the Human-in-the-Loop-scenario derived from it to meet the experiment objectives are discussed. Results of comparison of input Human-in-the-Loop-scenario with the Multi-Aircraft Control System output are also presented. The main findings are: (1) many of the characteristics of the seed-scenario used for constructing the Human-in-the-Loop-scenario are preserved in the Human-in-the-Loop-scenario, (2) landing rate profile of the traffic generated by the Multi-Aircraft Control System (MACS) using the input scenario compares reasonably well with that intended in the input scenario, and (3) many of the desired characteristics of the Human-in-the-Loop-scenario can be achieved by further automation.

Automated Scenario Generation↗

NASA NTRS2018

Automated Scenario Generation for Human-in-the-Loop Simulations

Automated Multi-Aircraft Control System scenario generation for Human-in-the-Loop evaluations of air traffic management concepts is described. Methods for analyzing and comparing the seed-scenario generated using the automated process and the Human-in-the-Loop-scenario designed to meet the experiment objectives are discussed. The main findings are: (1) many of the characteristics of the seed-scenario used for constructing the Human-in-the-Loop-scenario are preserved in the Human-in-the-Loop Scenario, (2) landing characteristics of the traffic generated by the Multi-Aircraft Control System using the input scenario compare reasonably well with that intended in the input scenario, and (3) many of desired characteristics of the Human-in-the-Loop-scenario can be achieved by further automation.

SMART-NAS Testbed↗

NASA NTRSDate not supplied

Human-in-the-Loop Evaluations: Process and Mockup Fidelity

Human-in-the-loop (HITL) evaluations are iterative events used during design and development to identify issues with the implementation of human systems integration. HITL evaluations involve human test subjects who are user-representative participants performing activities with representative hardware, software, and procedures. The paper will describe the process by which HITL evaluations can be implemented in a program or project. This will include definitions for developmental and verification HITL evaluations, levels of mockup fidelity, and certification of HITL articles. The proposed process can be tailored depending on the type of HITL evaluation being conducted. It is highly recommended that findings are timely reported and incorporated in the hardware and/or software design.

Jackelynne Silva-Martinez↗

NASA NTRSDate not supplied

A Human-In-The-Loop Simulation for Urban Air Mobility in the Terminal Area

In this paper researchers propose a human-in-the-loop experiment to study human performance when tasked with tactical deconfliction in terminal area air taxi operations. The air taxi operations being considered herein are an advanced air transportation concept called Urban Air Mobility (UAM). The UAM concept aims to support not only air taxi operations, but also package delivery and emergency response among other use cases. The key innovation over current air transportation lies with the introduction of highly automated aircraft and air traffic management systems. Development of the UAM system will include transitional midterm phases where some operational services will be provided by a mixture of automation and human actors. Midterm operations present a unique challenge, since the scope of responsibility of automated systems is largely undefined, suggesting the need for direct human participation with little to inform how much human intervention is necessary. Here it is assumed that traffic management responsibilities require coordination between human actors and automated systems and focus on arrival flows for midterm operations. In the proposed human-in-the-loop simulation, virtual UAM traffic is strategically deconflicted by a Provider of Services for UAM at departure, then tactically managed by a human at the arrival facility. Generated traffic consists of UAM participants flying in UAM exclusive airspace structures, thus isolated from traditional traffic. The human operator is tasked with managing spacing of arrival traffic and executing speed adjustments as deemed necessary. Researchers propose the investigation of three levels of automation assistance: 1) no assistance; 2) spacing violation detection; 3) spacing violation detection and speed adjustment recommendations. Quantitative measures like throughput and delay are used to assess the human's capacity for accommodating airborne delays. Qualitative evaluations such as surveys and open-ended feedback are used to gain insight into human factors. These factors could introduce additional capacity constraints on traffic, independent of physical or technical constraints. Although findings for this study will not be reported as the study has not yet been executed, the authors conclude with potential outcomes informed by previous simulations in the literature and suggestions for the structure and procedures of midterm human-automation air traffic management.

UAM↗

NASA NTRS2013

Comparisons of a Constrained Least Squares Model versus Human-in-the-Loop for Spectral Unmixing to Determine Material Type of GEO Debris

Constrained Linear Least Squares model is generally more accurate than the "human-in-the-loop". However, "human-in-the-loop" can remove materials that make no sense. The speed of the model in determining a "first cut" at the material ID makes it a viable option for spectral unmixing of debris objects.

Abercromby, Kira J.↗

NASA NTRS2016

Impact of Automation Support on the Conflict Resolution Task in a Human-in-the-Loop Air Traffic Control Simulation

To determine the capabilities and limitations of human operators and automation in separation assurance roles, the second of three Human-in-the-Loop (HITL) part-task studies investigated air traffic controllers ability to detect and resolve conflicts under varying task sets, traffic densities, and run lengths. Operations remained within a single sector, staffed by a single controller, and explored, among other things, the controllers responsibility for conflict resolution with or without their involvement in the conflict detection task. Furthermore, these conditions were examined across two different traffic densities; 1x (current-day traffic) and a 20 increase above current-day traffic levels (1.2x). Analyses herein offer an examination of the conflict resolution strategies employed by controllers. In particular, data in the form of elapsed time between conflict detection and conflict resolution are used to assess if, and how, the controllers involvement in the conflict detection task affected the way in which they resolved traffic conflicts.

human-in-the-loop simulation↗

NASA NTRS2017

And the Human Saves the Day or Maybe They Ruin It, The Importance of Humans in the Loop

Flying a mission in space requires a massive commitment of resources, and without the talent and commitment of the people involved in this effort we would never leave the atmosphere of Earth as safely as we have. When we use the phrase "humans in the loop", it could apply to almost any endeavor since everything starts with humans developing a concept, completing the design process, building or implementing a product and using the product to achieve a goal or purpose. Narrowing the focus to spaceflight, there are a variety of individuals involved throughout the preparations for flight and the flight itself. All of the humans involved add value and support for program success. The paper discusses the concepts of human involvement in technological programs, how a Probabilistic Risk Assessment (PRA) accounts for the human in the loop for potential missions using a technique called Human Reliability Analysis (HRA) and the tradeoffs between having a human in the loop or not. Human actions can increase or decrease the overall risk via initiating events or mitigating them, thus removing the human from the loop doesn't always lowers the risk.

DeMott, Diana L.↗

NASA NTRSDate not supplied

Immersive Technologies for Human-in-the-Loop Lunar Surface Simulations

NASA, the National Aeronautics and Space Administration, continually seeks innovative solutions to enhance its operations, particularly in the realms of testing, evaluation, and training for future missions. Immersive technologies, such as virtual, augmented, and mixed reality have proven to be powerful tools for realistic, interactive, and engaging environments. This paper explores how the Simulation and Graphics Branch at NASA’s Johnson Space Center (JSC) leverages immersive technology, modern commercial rendering engines, and physics-based systems simulations to develop human-in-the-loop systems for humanity’s return to the Moon through the Artemis program. When NASA returns to the Moon, astronauts will travel to the Moon’s South Pole where lighting conditions will cause a more complex operational environment. Human-in-the-loop testing plays a crucial role in NASA's mission planning, spacecraft and space systems development, and evaluation of operational scenarios. The development of immersive environments such as a lunar rover mockup at a video wall enables engineers and astronauts to simulate and experience mission scenarios, integrated spacecraft systems, and operational procedures in a relevant environment before deployment. By integrating realistic virtual environments, immersive technology allows for the visualization and interaction with virtual spacecraft models, mission landscapes, and complex operational tasks. This approach helps identify potential design flaws, operational challenges, and safety considerations. It also provides valuable insights for risk reduction and helps improve mission efficiency and effectiveness. With advanced motion tracking systems and custom virtual environments data can be gathered and evaluated to help NASA refine training protocols, develop specialized training procedures and optimize human-robotic interactions for future space missions. Furthermore, immersive technology offers opportunities for future training initiatives at NASA. The Virtual Reality Laboratory at JSC has pioneered training with Virtual Reality (VR) since the Hubble Space Telescope repair missions in the early 1990’s. Extended Reality (XR) simulations enable astronauts to rehearse complex spacewalks, spacecraft maneuvers, and extravehicular activities in a safe and controlled environment. By replicating the physical and cognitive challenges of space missions, immersive training experiences enhance astronauts' situational awareness, decision-making abilities, and adaptability to unexpected scenarios. Additionally, immersive technology facilitates collaborative training, allowing geographically dispersed crew and mission control personnel to engage in synchronized simulations, fostering teamwork and effective communication. The adoption of immersive technology in NASA's testing, evaluation, and future training programs has yielded significant benefits. By incorporating human-in-the-loop testing for studies involving Extra Vehicular Activities (EVA), surface mobility and landing systems, NASA can identify and mitigate risks, optimize operational procedures, and enhance mission success. Ultimately, immersive training experiences can empower astronauts to better navigate the complexities of space missions, ensuring their safety, productivity, and success in the dynamic and challenging environments they will experience at the Lunar South Pole.

Simulation Modeling Virtual Reality Immersive Tech↗

NASA NTRSDate not supplied

Immersive Technologies for Human-in-the-Loop Lunar Surface Simulations

NASA, the National Aeronautics and Space Administration, continually seeks innovative solutions to enhance its operations, particularly in the realms of testing, evaluation, and training for future missions. Immersive technologies, such as virtual, augmented, and mixed reality have proven to be powerful tools for immersing users in realistic, interactive, and engaging environments. This paper explores how the Simulation and Graphics Branch at NASA’s Johnson Space Center (JSC) leverages immersive technology, modern commercial rendering engines, and physics-based systems simulations to develop human-in-the-loop systems for humanity’s return to the Moon through the Artemis program. When NASA returns to the Moon, astronauts will travel to the Moon’s South Pole where lighting conditions will cause a more complex operational environment. Human-in-the-loop simulations play a crucial role in NASA’s mission planning, spacecraft and space systems development, and evaluation of operational scenarios. The development of immersive environments such as a lunar rover mockup at a video wall enables engineers and astronauts to simulate and experience mission scenarios, integrated spacecraft systems, and operational procedures in a relevant environment before deployment. By integrating realistic virtual environments, immersive technology allows for the visualization and interaction with virtual spacecraft models, mission landscapes, and complex operational tasks. This approach helps identify potential design flaws, operational challenges, and safety considerations. It also provides valuable insights for risk reduction and helps improve mission efficiency and effectiveness. With advanced motion tracking systems and custom virtual environments, data can be gathered and evaluated to help NASA refine training protocols, develop specialized training procedures, and optimize human-robotic interactions for future space missions. Furthermore, immersive technology offers opportunities for future training initiatives at NASA. The Virtual Reality Laboratory at JSC has pioneered training with Virtual Reality (VR) since the Hubble Space Telescope repair missions in the early 1990’s. Extended Reality (XR) simulations enable astronauts to rehearse complex spacewalks, spacecraft maneuvers, and extravehicular activities in a safe and controlled environment. By replicating the physical and cognitive challenges of space missions, immersive training experiences enhance astronauts’ situational awareness, decision-making abilities, and adaptability to unexpected scenarios. Additionally, immersive technology facilitates collaborative training, allowing geographically dispersed crew and mission control personnel to engage in synchronized simulations, fostering teamwork and effective communication. The adoption of immersive technology in NASA’s testing, evaluation, and future training programs has yielded significant benefits. By incorporating human-in-the-loop simulations for studies involving Extra Vehicular Activities (EVA), surface mobility and landing systems, NASA can identify and mitigate risks, optimize operational procedures, and enhance mission success. Ultimately, immersive simulation experiences can empower astronauts to better navigate the complexities of space missions, ensuring their safety, productivity, and success in the dynamic and challenging environments they will experience at the Lunar South Pole.

HITL↗

NASA NTRSDate not supplied

A Human-In-The-Loop Simulation for Urban Air Mobility in the Terminal Area

In this presentation we propose a human-in-the-loop experiment to study the potential impact of human engagement in tactical mitigation of delay in terminal area air taxi operations. The air taxi operations being considered herein is an advanced air transportation concept called Urban Air Mobility (UAM). The UAM concept aims to support not only air taxi operations, but also package delivery and emergency response among other use cases. The key innovation over current air transportation lies with the introduction of autonomous aircraft and autonomous air traffic management systems. Development of the UAM system will include transitional midterm phases where some operational services will be provided by a mixture of automation and human actors. Midterm operations present a unique challenge, since the scope of responsibility of automated systems is largely undefined, suggesting the need for direct human participation with little to inform how much human intervention is necessary. Here we assume that traffic management responsibilities require coordination between human actors and automated systems and focus on arrival flows for midterm operations. In the proposed human-in-the-loop simulation, virtual UAM traffic is strategically deconflicted by a Provider of Services for UAM at departure, then tactically managed by a human at the arrival facility. Generated traffic consists of UAM participants flying in UAM exclusive airspace structures, thus isolated from traditional traffic. The human operator is tasked with managing spacing of arrival traffic and executing speed adjustments as deemed necessary. We propose the investigation of three levels of automation assistance: 1) no assistance; 2) spacing violation detection; 3) spacing violation detection and speed adjustment recommendations. Quantitative measures like throughput and delay are used to assess the human's capacity for accommodating airborne delays. Qualitative evaluations such as surveys and open-ended feedback are used to gain insight into human factors. These factors could introduce additional capacity constraints on traffic, independent of physical or technical constraints. Although findings for this study will not be reported as the study has not yet been executed, we conclude with potential outcomes informed by previous simulations in the literature and suggestions for the structure and procedures of midterm human-automation air traffic management.

UAM↗

NASA NTRS2017

And the Humans Save the Day or Maybe They Ruin It: The Importance of Humans in the Loop

Flying a mission in space requires a massive commitment of resources, and without the talent and commitment of the people involved in this effort we would never leave the atmosphere of Earth. When we use the phrase "humans in the loop", it could apply to almost any endeavor since everything starts with humans developing a concept, completing the design process, building or implementing a product and using the product to achieve a goal or purpose. Narrowing the focus to spaceflights, there are a variety of individuals involved throughout the preparations for flight and the flight itself. All of the humans involved add value and support for program success. The purpose of this paper focuses on how a Probabilistic Risk Assessment (PRA) accounts for the human in the loop for potential missions using a technique called Human Reliability Analysis (HRA). Human actions can increase or decrease the overall risk via initiating events or mitigating them, thus removing the human from the loop doesn't always lower the risk.

DeMott, Diana↗

NASA NTRS2010

A Human-in-the Loop Exploration of the Dynamic Airspace Configuration Concept

An exploratory human-in-the-loop study was conducted to better understand the impact of Dynamic Airspace Configuration (DAC) on air traffic controllers. To do so, a range of three progressively more aggressive algorithmic approaches to sectorizations were chosen. Sectorizations from these algorithms were used to test and quantify the range of impact on the controller and traffic. Results show that traffic count was more equitably distributed between the four test sectors and duration of counts over MAP were progressively lower as the magnitude of boundary change increased. However, taskload and workload were also shown to increase with the increase in aggressiveness and acceptability of the boundary changes decreased. Overall, simulated operations of the DAC concept did not appear to compromise safety. Feedback from the participants highlighted the importance of limiting some aspects of boundary changes such as amount of volume gained or lost and the extent of change relative to the initial airspace design.

Homola, Jeffrey↗

NASA NTRS2011

Human-in-the-Loop Integrated Life Support Systems Ground Testing

Human exploration missions beyond low earth orbit will be long duration with abort scenarios of days to months. This necessitates provisioning the crew with all the things they will need to sustain themselves while carrying out mission objectives. Systems engineering and integration is critical to the point where extensive integrated testing of life support systems on the ground is required to identify and mitigate risks. Ground test facilities (human-rated altitude chamber) at the Johnson Space Center are being readied to integrate all the systems for a mission along with a human test crew. The relevant environment will include deep space habitat human accommodations, sealed atmosphere of 8 psi total pressure and 32% oxygen concentration, life support systems (food, air, water), communications, crew accommodations, medical, EVA, tools, etc. Testing periods will approximate those of the expected missions (such as a near Earth asteroid, Earth-Moon L2 or L1, the moon). This type of integrated testing is needed for research and technology development as well as later during the mission design, development, test, and evaluation (DDT&E) phases of an approved program. Testing will evolve to be carried out at the mission level fly the mission on the ground . Mission testing will also serve to inform the public and provide the opportunity for active participation by international partners.

Henninger, Donald L.↗

NASA NTRS2012

Human in the Loop Integrated Life Support Systems Ground Testing

Human exploration missions beyond low earth orbit will be long duration with abort scenarios of days to months. This necessitates provisioning the crew with all the things they will need to sustain themselves while carrying out mission objectives. Systems engineering and integration is critical to the point where extensive integrated testing of life support systems on the ground is required to identify and mitigate risks. Ground test facilities (human-rated altitude chambers) at the Johnson Space Center are being readied to integrate all the systems for a mission along with a human test crew. The relevant environment will include deep space habitat human accommodations, sealed atmosphere capable of 14.7 to 8 psi total pressure and 21 to 32% oxygen concentration, life support systems (food, air, and water), communications, crew accommodations, medical, EVA, tools, etc. Testing periods will approximate those of the expected missions (such as a near Earth asteroid, Earth-Moon L2 or L1, the moon, Mars). This type of integrated testing is needed for research and technology development as well as later during the mission design, development, test, and evaluation (DDT&E) phases of an approved program. Testing will evolve to be carried out at the mission level fly the mission on the ground . Mission testing will also serve to inform the public and provide the opportunity for active participation by international, industrial and academic partners.

Henninger, Donald L.↗

NASA NTRS2019

Automated Scenario Generation for Meeting Human-in-the-Loop Simulation Requirements

A two-step automated Multi-Aircraft Control System traffic scenario generation process for Human-in-the-Loop evaluations of air traffic management concepts is described. The first step of the two-step process employs the scenario generation capability currently available in NASA's Air Traffic Management Testbed. The second step refines the scenario by filtering flights from the traffic scenario based on route length, cruise speed, cruise altitude, entry time and the desired ratio of internal to external flights. A solution for achieving the desired ratio of internal to external flights, where internal flights are shorter flights and external flights are longer flights based on a distance threshold, is described. Finally, schedulers are described for shaping the hourly arrival traffic count as a function of time in response to airport capacity constraint or for increasing the traffic demand with respect to the available arrival capacity. Results generated for arrival traffic to the four major airports in the New York Metroplex on a busy day using the two-step procedure are discussed. These results show that traffic scenarios for Multi-Aircraft Control System that meet the Human-in-the-Loop and fast-time simulation requirements can be created automatically following the procedures described in the paper. The automated process will improve the accuracy and efficiency by eliminating the tedious manual process for scenario generation.

Automated Scenario Generation↗

NASA NTRS2019

Automated Scenario Generation for Meeting Human-In-The-Loop Simulation Requirements

Automated Scenario Generation↗

NASA NTRS2008

Enhanced Oceanic Operations Human-In-The-Loop In-Trail Procedure Validation Simulation Study

The Enhanced Oceanic Operations Human-In-The-Loop In-Trail Procedure (ITP) Validation Simulation Study investigated the viability of an ITP designed to enable oceanic flight level changes that would not otherwise be possible. Twelve commercial airline pilots with current oceanic experience flew a series of simulated scenarios involving either standard or ITP flight level change maneuvers and provided subjective workload ratings, assessments of ITP validity and acceptability, and objective performance measures associated with the appropriate selection, request, and execution of ITP flight level change maneuvers. In the majority of scenarios, subject pilots correctly assessed the traffic situation, selected an appropriate response (i.e., either a standard flight level change request, an ITP request, or no request), and executed their selected flight level change procedure, if any, without error. Workload ratings for ITP maneuvers were acceptable and not substantially higher than for standard flight level change maneuvers, and, for the majority of scenarios and subject pilots, subjective acceptability ratings and comments for ITP were generally high and positive. Qualitatively, the ITP was found to be valid and acceptable. However, the error rates for ITP maneuvers were higher than for standard flight level changes, and these errors may have design implications for both the ITP and the study's prototype traffic display. These errors and their implications are discussed.

Murdoch, Jennifer L.↗

NASA NTRS2016

Integrated Human-in-the-Loop Ground Testing - Value, History, and the Future

Systems for very long-duration human missions to Mars will be designed to operate reliably for many years and many of these systems will never be returned to Earth. The need for high reliability is driven by the requirement for safe functioning of remote, long-duration crewed systems and also by unsympathetic abort scenarios. Abort from a Mars mission could be as long as 450 days to return to Earth. The key to developing a human-in-the-loop architecture is a development process that allows for a logical sequence of validating successful development in a stepwise manner, with assessment of key performance parameters (KPPs) at each step; especially important are KPPs for technologies evaluated in a full systems context with human crews on Earth and on space platforms such as the ISS. This presentation will explore the implications of such an approach to technology development and validation including the roles of ground and space-based testing necessary to develop a highly reliable system for long duration human exploration missions. Historical development and systems testing from Mercury to the International Space Station (ISS) to ground testing will be reviewed. Current work as well as recommendations for future work will be described.

Henninger, Donald L.↗