Engineering PapersSearch

SEARCH · Engineering Papers

Results for “human in the loop”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Human-in-the-Loop Flight Simulation Experiment on Unmanned Aircraft Terminal Operations

A Detect and Avoid (DAA) System is a suite of sensors, tracker, and alerting and guidance algorithms that assist a remote pilot of an Unmanned Aircraft System in maintaining separation from airborne traffic by complying with current ‘see and avoid’ requirements. To date, work has focused on operations transiting to and from Class A or special use airspace. Current efforts are defining DAA system requirements for operations in and around terminal airspace. As a contribution to the current efforts, this paper presents results from a Human-in-the-Loop experiment comparing methods of changing from the transit-specific alerting and guidance criteria to the reduced terminal-specific alerting and guidance criteria.

Devin Patrick Jack

Machine-Learning-Driven Discovery of Water Splitting BaFe 2 O 4 and Human-in-the-Loop Improvement via Al-Substitution for Increased Thermal Stability

Thermochemical hydrogen (TCH) production offers a promising method for converting thermal energy into hydrogen fuel through heat-driven redox cycles of metal oxides. Here, in this work a defect graph neural network (dGNN) was used to predict oxygen vacancy formation energies ΔH V O combined with Materials Project predictions of oxygen chemical potential stability to screen candidate oxides via high-throughput database analysis. BaFe 2 O 4 was identified as a promising material for experimental validation based on its predicted ΔH V O , oxygen chemical potential stability range, and potential for tunable substitutions to improve thermal properties. Experimental validation using thermogravimetric analysis (TGA), stagnation flow reactor (SFR), X-ray diffraction (XRD), and electron microscopy confirmed positive water-splitting behavior but also revealed limitations in thermal stability under aggressive reduction conditions. To address this, a human-in-the-loop modification strategy was employed introducing Al substitution in BaFe 2–x Al x O 4 ; this modification improves thermal stability, alters the crystal structure and enhances overall performance. These results demonstrate a combined computational and experimental workflow in which machine learning accelerates identification of promising candidates, while targeted experimental design enables optimization of functional performance. This approach advances the development of robust, cost-effective TCH materials and highlights the importance of integrating data-driven discovery with human-guided materials design in paving the way for scalable hydrogen production technologies.

organic

Using Flory–Huggins-informed human-in-the-loop Bayesian optimization to map the phase diagram of polymer blends

Mapping the phase diagram of polymer blends is an essential step in controlling the structure–property relationship of polymer-based materials. However, traditional grid-based approaches are inefficient and rely on subjective judgements for terminating the experimental campaign. Artificial intelligence-guided experimentation offers a compelling alternative, especially when data-driven decision-making is interfaced with established polymer thermodynamics to improve efficiency and interpretability. Here, we introduce a physics-informed Bayesian optimization approach to guide the mapping of the phase diagram of a model blend containing poly(methyl methacrylate) and poly(styrene-ran-acrylonitrile). Physical information is derived from a Flory–Huggins representation of the spinodal curve, which is integrated into the Bayesian optimization process as a structured prior mean that acts as a soft constraint. Implemented as a human-in-the-loop workflow, the approach leverages optical imaging of film cloudiness with iterative Gaussian process surrogate modeling and a parameter selection decision policy to identify the composition-temperature conditions for sequential iterations. Convergence of kernel and Flory–Huggins-based hyperparameters provided a stopping criterion, ensuring an objective and interpretable termination of the experimental campaign. The framework recovered the known lower critical solution temperature (∼160 °C), while increasing material efficiency through targeted sampling. This work establishes a proof-of-concept for the application of Bayesian optimization workflows to study polymer blend miscibility.

36 MATERIALS SCIENCE

Bone Conduction Headphone Research and Human-in-the-Loop Test Results

The new space suit being developed for exploration EVAs on the surface of the Moon and in microgravity environments is called xEMU. A government reference model had been developed and had undergone testing. This suit contains new upgrades from the current EMU on ISS, such as integrated speakers and microphones, eliminating the need for astronauts to wear a Communications Carrier Assembly (CCA) on their head during spacewalks. However, upon testing, it was noticed that this feature causes acoustic coupling, that results in communications echo and feedback. A proposed solution to this issue is to have the astronaut wear a bone conduction headset for audio capabilities while on EVA to receive incoming voice communications from Mission Control and other EVA or IVA crew members. This would eliminate the acoustic coupling and echo effect while being more ergonomically sound than the current CCA and leave the ear open to suit ambient sound for situational awareness. A human-in-the-loop evaluation was performed, comparing five commercially available bone conduction headsets, to evaluate comfort, fit, and adjustability for long-duration wear. Five engineering test subjects with different head sizes were utilized to wear the headsets for six hours and provide succinct feedback and score the headsets on a variety of factors, to help determine which of the headsets performed the best and could advance to future bone conduction audio testing. Three of the headsets were well-received among the diverse group of subjects, and at least one of these will advance to further testing to be considered for future use under the xEMU helmet for exploration EVAs. Rating results and evaluation methods for this bone conduction headset evaluation will be presented.

Bridget M Cavanaugh

Preliminary Human-in-the-Loop Assessment of Procedures for Very-Closely-Spaced Parallel Runways

Demand in the future air transportation system concept is expected to double or triple by 2025 [1]. Increasing airport arrival rates will help meet the growing demand that could be met with additional runways but the expansion airports is met with environmental challenges for the surrounding communities when using current standards and procedures. Therefore, changes to airport operations can improve airport capacity without adding runways. Building additional runways between current ones, or moving them closer, is a potential solution to meeting the increasing demand, as addressed by the Terminal Area Capacity Enhancing Concept (TACEC). TACEC requires robust technologies and procedures that need to be tested such that operations are not compromised under instrument meteorological conditions. The reduction of runway spacing for independent simultaneous operations dramatically exacerbates the criticality of wake vortex incursion and the calculation of a safe and proper breakout maneuver. The study presented here developed guidelines for such operations by performing a real-time, human-in-the-loop simulation using precision navigation, autopilot-flown approaches, with the pilot monitoring aircraft spacing and the wake vortex safe zone during the approach.

Verma, Savita

Comparisons of a Constrained Least Squares Model Versus Human-in-the-Loop for Spectral Unmixing to Determine Material Type of GEO Debris

Spectral reflectance data through the visible regime was collected at Las Campanas Observatory in Chile using an imaging spectrograph on one of the twin 6.5-m Magellan telescopes. The data were obtained on 1-2 May 2012 on the 'Landon Clay' telescope with the LDSS3 (Low Dispersion Survey Spectrograph 3). Five pieces of Geosynchronous Orbit (GEO) or near-GEO debris were identified and observed with an exposure time of 30 seconds on average. In addition, laboratory spectral reflectance data was collected using an Analytical Spectral Device (ASD) field spectrometer at California Polytechnic State University in San Luis Obispo on several typical common spacecraft materials including solar cells, circuit boards, various Kapton materials used for multi-layer insulation, and various paints. The remotely collected data and the laboratory-acquired data were then incorporated in a newly developed model that uses a constrained least squares method to unmix the spectrum in specific material components. The results of this model are compared to the previous method of a human-in-the-loop (considered here the traditional method) that identifies possible material components by varying the materials and percentages until a spectral match is obtained. The traditional model was found to match the remotely collected spectral data after it had been divided by the continuum to remove the space weathering effects, or a "reddening" of the materials. The constrained least-squares model also used the de-reddened spectra as inputs and the results were consistent with those obtained through the traditional method. For comparison, a first-order examination of including reddening effects into the constrained least-squares model will be explored and comparisons to the remotely collected data will be examined. The identification of each object's suspected material component will be discussed herein.

Rapp, Jason

Comparisons of a Constrained Least Squares Model versus Human-in-the-Loop for Spectral Unmixing to Determine Material Type of GEO Debris

Spectral reflectance data through the visible regime was collected at Las Campanas Observatory in Chile using an imaging spectrograph on one of the twin 6.5-m Magellan telescopes. The data were obtained on 1-2 May 2012 on the 'Landon Clay' telescope with the LDSS3 (Low Dispersion Survey Spectrograph 3). Five pieces of Geosynchronous Orbit (GEO) or near-GEO debris were identified and observed with an exposure time of 30 seconds on average. In addition, laboratory spectral reflectance data was collected using an Analytical Spectral Device (ASD) field spectrometer at California Polytechnic State University (Cal Poly) in San Luis Obispo on several typical common spacecraft materials including solar cells, circuit boards, various Kapton materials used for multi-layer insulation, and various paints. The remotely collected data and the laboratory-acquired data were then incorporated in a newly developed model that uses a constrained least squares method to unmix the spectrum in specific material components. The results of this model are compared to the previous method of a human-in-the-loop (considered here the traditional method) that identifies possible material components by varying the materials and percentages until a spectral match is obtained. The traditional model was found to match the remotely collected spectral data after it had been divided by the continuum to remove the space weathering effects, or a reddening of the materials. The constrained least-squares model also used the de-reddened spectra as inputs and the results were consistent with those obtained through the traditional method. For comparison, a first-order examination of including reddening effects into the constrained least-squares model will be explored and comparisons to the remotely collected data will be examined. The identification of each object s suspected material component will be discussed herein.

Abercromby, Kira J.

A Human-in-the Loop Evaluation of a Coordinated Arrival Departure Scheduling Operations for Managing Departure Delays at LaGuardia Airport

LaGuardia (LGA) departure delay was identified by the stakeholders and subject matter experts as a significant bottleneck in the New York metropolitan area. Departure delay at LGA is primarily due to dependency between LGA's arrival and departure runways: LGA departures cannot begin takeoff until arrivals have cleared the runway intersection. If one-in one-out operations are not maintained and a significant arrival-to-departure imbalance occurs, the departure backup can persist through the rest of the day. At NASA Ames Research Center, a solution called "Departure-sensitive Arrival Spacing" (DSAS) was developed to maximize the departure throughput without creating significant delays in the arrival traffic. The concept leverages a Terminal Sequencing and Spacing (TSS) operations that create and manage the arrival schedule to the runway threshold and added an interface enhancement to the traffic manager's timeline to provide the ability to manually adjust inter-arrival spacing to build precise gaps for multiple departures between arrivals. A more complete solution would include a TSS algorithm enhancement that could automatically build these multi-departure gaps. With this set of capabilities, inter-arrival spacing could be controlled for optimal departure throughput. The concept was prototyped in a human-in-the- loop (HITL) simulation environment so that operational requirements such as coordination procedures, timing and magnitude of TSS schedule adjustments, and display features for Tower, TRACON and Traffic Management Unit could be determined. A HITL simulation was conducted in August 2014 to evaluate the concept in terms of feasibility, controller workload impact, and potential benefits. Three conditions were tested, namely a Baseline condition without scheduling, TSS condition that schedules the arrivals to the runway threshold, and TSS+DSAS condition that adjusts the arrival schedule to maximize the departure throughput. The results showed that during high arrival demand period, departure throughput could be incrementally increased under TSS and TSS+DSAS conditions without compromising the arrival throughput. The concept, operational procedures, and summary results were originally published in ATM20151 but detailed results were omitted. This paper expands on the earlier paper to provide the detailed results on throughput, conformance, safety, flight time/distance, etc. that provide extra insights into the feasibility and the potential benefits on the concept.

trajectory-based operations

Building workflows for an interactive human-in-the-loop automated experiment (hAE) in STEM-EELS

Exploring the structural, chemical, and physical properties of matter on the nano- and atomic scales has become possible with the recent advances in aberration-corrected electron energy-loss spectroscopy (EELS) in scanning transmission electron microscopy (STEM). However, the current paradigm of STEM-EELS relies on the classical rectangular grid sampling, in which all surface regions are assumed to be of equal a priori interest. However, this is typically not the case for real-world scenarios, where phenomena of interest are concentrated in a small number of spatial locations, such as interfaces, structural and topological defects, and multi-phase inclusions. One of the foundational problems is the discovery of nanometer- or atomic-scale structures having specific signatures in EELS spectra. Herein, we systematically explore the hyperparameters controlling deep kernel learning (DKL) discovery workflows for STEM-EELS and identify the role of the local structural descriptors and acquisition functions in experiment progression. In agreement with the actual experiment, we observe that for certain parameter combinations the experiment path can be trapped in the local minima. We demonstrate the approaches for monitoring the automated experiment in the real and feature space of the system and knowledge acquisition of the DKL model. Based on these, we construct intervention strategies defining the human-in-the-loop automated experiment (hAE). This approach can be further extended to other techniques including 4D STEM and other forms of spectroscopic imaging. The hAE library is available on Github at https://github.com/utkarshp1161/hAE/tree/main/hAE.

Pratiush, Utkarsh [Univ. of Tennessee, Knoxville,

An Interoperability Concept for Detect and Avoid and Collision Avoidance Systems: Results from a Human-In-The-Loop Simulation

The integration of Unmanned Aircraft Systems (UAS) into the National Airspace System (NAS) poses a variety of technical challenges to UAS developers and aviation regulators. In response to growing demand for access to civil airspace in the United States, the Federal Aviation Administration (FAA) has produced a roadmap identifying key areas requiring further research and development. One such technical challenge is the development of a "detect and avoid" system (DAA) capable of providing a means of compliance with the "see and avoid" requirement in manned aviation. The purpose of the DAA system is to support the pilot, situated at a ground control station (GCS), in maintaining "DAA well clear" of nearby aircraft through the use of GCS displays and alerts. In addition to its primary function of aiding the pilot in maintaining DAA well clear, the DAA system must also safely interoperate with existing NAS systems and operations, such as the airspace management procedures of air traffic controllers (ATC) and Collision Avoidance (CA) systems currently in use by manned aircraft, namely the Traffic Alert and Collision Avoidance System (TCAS II). It is anticipated that many UAS architectures will integrate both a DAA system and a TCAS II. It is therefore necessary to explicitly study the integration of DAA and TCAS II alerting structures and maneuver guidance formats to ensure that pilots understand the appropriate type and urgency of their response to the various alerts. This paper presents a concept of interoperability for the two systems. The concept was developed with the goal of avoiding any negative impact on the performance level of TCAS II while retaining a DAA system that still effectively enables pilots to maintain DAA well clear. The interoperability concept described in the paper focuses primarily on facilitating the transition from a late-stage DAA encounter (where a loss of DAA well clear is imminent) to a TCAS II Corrective Resolution Advisory (RA), which requires pilot compliance within five seconds of its issuance. The interoperability concept was presented to 10 participants (6 active UAS pilots and 4 active commercial pilots) in a medium-fidelity, human-in-the-loop simulation designed to stress different aspects of the DAA and TCAS II systems. Pilots' ability to maintain separation, their rate of compliance and response times using the interoperability concept are reported. Results indicated that pilots exhibited comprehension of, and appropriate prioritization within, the DAA-TCAS II combined alert structure. Pilots demonstrated a high rate of compliance with TCAS II RAs and were also seen to respond to corrective RAs within the five second requirement established for manned aircraft. The DAA system presented under test was also shown to be effective in supporting pilots' ability to maintain DAA well clear in the overwhelming majority of cases in which pilots had sufficient time to respond.

Rorie, R. Conrad

NASA Processes and Requirements for Conducting Human-in-the-Loop Closed Chamber Tests

NASA has specific processes and requirements that must be followed for tests involving human subjects to be conducted in a safe and effective manner. There are five distinct phases of test operations. Phase one, the test request phase, consists of those activities related to initiating, processing, reviewing, and evaluating the test request. Phase two, the test preparation phase consists of those activities related to planning, coordinating, documenting, and building up the test. Phase three, the test readiness phase consists of those activities related to verifying and reviewing the planned test operations. Phase four, the test activity phase, consists of all pretest operations, functional checkouts, emergency drills, and test operations. Phase five, the post test activity phase, consists of those activities performed once the test is completed, including briefings, documentation of anomalies, data reduction and archiving, and reporting. Project management processes must be followed for facility modifications and major test buildup, which include six phases: initiation and assessment, requirements evaluation, preliminary design, detailed design, use readiness review (URR) and acceptance. Compliance with requirements for safety and quality assurance are documented throughout the test buildup and test operation processes. Tests involving human subjects must be reviewed by the applicable Institutional Review Board (IRB).

Barta, Daniel J.

Human-in-the-Loop Operations over Time Delay: NASA Analog Missions Lessons Learned

Teams at NASA have conducted studies of time-delayed communications as it effects human exploration. In October 2012, the Advanced Exploration Systems (AES) Analog Missions project conducted a Technical Interchange Meeting (TIM) with the primary stakeholders to share information and experiences of studying time delay, to build a coherent picture of how studies are covering the problem domain, and to determine possible forward plans (including how to best communicate study results and lessons learned, how to inform future studies and mission plans, and how to drive potential development efforts). This initial meeting s participants included personnel from multiple NASA centers (HQ, JSC, KSC, ARC, and JPL), academia, and ESA. It included all of the known studies, analog missions, and tests of time delayed communications dating back to the Apollo missions including NASA Extreme Environment Mission Operations (NEEMO), Desert Research and Technology Studies (DRATS/RATS), International Space Station Test-bed for Analog Research (ISTAR), Pavilion Lake Research Project (PLRP), Mars 520, JPL Mars Orbiters/Rovers, Advanced Mission Operations (AMO), Devon Island analog missions, and Apollo experiences. Additionally, the meeting attempted to capture all of the various functional perspectives via presentations by disciplines including mission operations (flight director and mission planning), communications, crew, Capcom, Extra-Vehicular Activity (EVA), Behavioral Health and Performance (BHP), Medical/Surgeon, Science, Education and Public Outreach (EPO), and data management. The paper summarizes the descriptions and results from each of the activities discussed at the TIM and includes several recommendations captured in the meeting for dealing with time delay in human exploration along with recommendations for future development and studies to address this issue.

Rader, Steven N.

Small Unmanned Aircraft Systems Integration into the National Airspace System Visual-Line-of-Sight Human-in-the-Loop Experiment

As part of the Unmanned Aircraft Systems (UAS) in the National Airspace System (NAS) project, research on integrating small UAS (sUAS) into the NAS was underway by a human-systems integration (HSI) team at the NASA Langley Research Center. Minimal to no research has been conducted on the safe, effective, and efficient manner in which to integrate these aircraft into the NAS. sUAS are defined as aircraft weighing 55 pounds or less. The objective of this human system integration team was to build a UAS Ground Control Station (GCS) and to develop a research test-bed and database that provides data, proof of concept, and human factors guidelines for GCS operations in the NAS. The objectives of this experiment were to evaluate the effectiveness and safety of flying sUAS in Class D and Class G airspace utilizing manual control inputs and voice radio communications between the pilot, mission control, and air traffic control. The design of the experiment included three sets of GCS display configurations, in addition to a hand-held control unit. The three different display configurations were VLOS, VLOS + Primary Flight Display (PFD), and VLOS + PFD + Moving Map (Map). Test subject pilots had better situation awareness of their vehicle position, altitude, airspeed, location over the ground, and mission track using the Map display configuration. This configuration allowed the pilots to complete the mission objectives with less workload, at the expense of having better situation awareness of other aircraft. The subjects were better able to see other aircraft when using the VLOS display configuration. However, their mission performance, as well as their ability to aviate and navigate, was reduced compared to runs that included the PFD and Map displays.

Trujillo, Anna C.

A Remote, Human-in-the-Loop Evaluation of a Multiple-Drone Delivery Operation

Over time, advances in unmanned aircraft systems (UAS) have enabled a shift in the operational paradigm from one operator managing one aircraft to that of multiple operators working together to manage multiple aircraft. This shift has highlighted the need for effective human-autonomy teaming methods to maintain manageable workload levels for operators as well as high standards of system performance and safety. This paper presents a study aimed at evaluating whether automation can help operators manage workload during small UAS (sUAS) package delivery scenarios featuring contingency situations. These contingency situations, resulting from unplanned UAS Volume Reservations (UVRs), required flight path reroutes for multiple aircraft simultaneously. The study manipulated the number of aircraft affected by the UVRs and the level of automation support. The presence of terrain conflicts was also controlled within each scenario. Due to the COVID-19 pandemic, subjects were not able to gain direct access to the Ground Control System (GCS). Therefore, the study was conducted using a subject-surrogate paradigm that required subjects to relay commands through a verbal protocol from remote locations outside of the lab to a researcher surrogate who had direct control of the GCS interfaces at the lab location. Results show that the automated support condition was associated with faster reroute response times, more efficient reroute maneuvers, and significantly lower levels of perceived workload than the manual reroute condition. However, the automation support level did not significantly impact pilots’ ability to avoid the UVR successfully; pilots were overwhelmingly capable of avoiding the UVR in all conditions. The presence of terrain conflicts primarily impacted pilot performance by leading to multiple uploads per vehicle, which was not typically required when pilots only needed to maneuver laterally. Although subjects did not have direct control over the GCS, subjective ratings indicate that the displays under test provided them with sufficient information to manage their aircraft and promptly respond to the unplanned UVRs. Overall, the objective and subjective data strongly suggest that the verbal protocol and subject-surrogate paradigm were effective methods for collecting data remotely amid the COVID-19 pandemic.

multi-UAS

Data Comm Flight Deck Human-in-the-Loop Simulation

This presentation discusses an upcoming simulation for data comm in the terminal area. The purpose of the presentation is to provide the REDAC committee with a summary of some of the work in Data Comm that is being sponsored by the FAA. The focus of the simulation is upon flight crew human performance variables, such as crew procedures, timing and errors. The simulation is scheduled to be conducted in Sept 2012.

Lozito, Sandra

A dual-loop model of the human controller in single-axis tracking tasks

A dual loop model of the human controller in single axis compensatory tracking tasks is introduced. This model possesses an inner-loop closure which involves feeding back that portion of the controlled element output rate which is due to control activity. The sensory inputs to the human controller are assumed to be system error and control force. The former is assumed to be sensed via visual, aural, or tactile displays while the latter is assumed to be sensed in kinesthetic fashion. A nonlinear form of the model is briefly discussed. This model is then linearized and parameterized. A set of general adaptive characteristics for the parameterized model is hypothesized. These characteristics describe the manner in which the parameters in the linearized model will vary with such things as display quality. It is demonstrated that the parameterized model can produce controller describing functions which closely approximate those measured in laboratory tracking tasks for a wide variety of controlled elements.

Hess, R. A.