Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “operator complexity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Towards Informing an Intuitive Mission Planning Interface for Autonomous Multi-Asset Teams via Image Descriptions

Establishing a basis for certification of autonomous systems using trust and trustworthiness is the focus of Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR). The Human-Machine Interface (HMI) team is working to capture and utilize the multitude of ways in which humans are already comfortable communicating mission goals and translate that into an intuitive mission planning interface. Several input/output modalities (speech/audio, typing/text, touch, and gesture) are being considered and investigated in the context human-machine teaming for the ATTRACTOR design reference mission (DRM) of Search and Rescue or (more generally) intelligence, surveillance, and reconnaissance (ISR). The first of these investigations, the Human Informed Natural-language GANs Evaluation (HINGE) data collection effort, is aimed at building an image description database to train a Generative Adversarial Network (GAN). In addition to building an image description database, the HMI team was interested if, and how, modality (spoken vs. written) affects different aspects of the image description given. The results will be analyzed to better inform the designing of an interface for mission planning.

Generative Adversarial Network (GAN)↗

Analyzing Natural Language Context in Human-Machine Teaming using Supervised Machine Learning

Building a foundation for trustworthiness and trust verification in multi-asset teaming is the research challenge of Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR). The Design Reference Mission (DRM) for ATTRACTOR is a search and rescue mission objective governed by a multi-member team consisting of human and machine operators. A crucial component to the effort is the communication between humans and autonomous agents throughout both planning and execution stages of the mission. Intuitive communication methods and modalities are posited as critical enablers for certifying trust and trustworthiness. This paper reports on the data collection and analysis conducted in support of the Human Informed Natural-language GANs Evaluation (HINGE)project to attain explainable and trusted communication between human-machine assets. Two identically curated image description datasets were acquired for HINGE, both consisting of two unique input modalities (typed vs. verbal) and retrieved in two distinct contexts (general vs. specific). The gathered datasets were assessed and compared using Parts-of-Speech (POS)features, sentence similarity metrics, and linguistic analysis. Then, the datasets were modeled and tested separately and in combination with one another using machine learning algorithms. The comparison and testing results reveal a superior dataset, by which a preferred context and input is understood, for generating image representations of missing persons using a Generative Adversarial Network (GAN).

Bryan A Barrows↗

A Distributed Simulation-to-Flight Framework to Support Investigating Trust/Trustworthiness in Multi-Agent Systems

As autonomous systems continue to grow both in use and complexity, the necessity for robust and extensible simulation-to-flight frameworks is paramount for establishing an effective architecture for autonomous systems. Hardware test flights are time-consuming and cost prohibitive during early system design and development. Simulation environments can be useful tools to accelerate algorithm development and testing. However, transitions from simulation to flight (sim-to-flight) can be challenging, unless systems are designed with this transition in mind and with the necessary capabilities built into the architecture and framework. One of the objectives of Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) was to design and develop a distributed mixed-reality simulation environment to begin establishing a basis for certification of autonomous systems via research into trust and trustworthiness. ATTRACTOR’s objective was to construct computational concepts of trustworthiness and justifiable trust in multi-agent autonomous teams, to inform future certification of safety-critical and time-critical autonomous systems in aviation. In this paper, we present an autonomous systems architecture and development framework paired with a persistent distributed modeling and simulation (ModSim) environment for test and evaluation of autonomous systems. They were designed under ATTRACTOR in order to measure and establish trustworthiness and trust in single-and multi-agent human-machine systems whether these machines are fixed-wing general aviation, rotary-wing Unmanned Aerial Vehicles (UAVs), ground rovers, or even spacecraft. The Autonomous Entity Operational Network (AEON) framework enables autonomous system development with an easily extensible collection of libraries and plug-n-play nodes facilitated by the Data Distribution Service (DDS) communication protocol standard. The Baseline Environment for Autonomous Modeling (BEAM) simulation environment is a distributed mixed-reality Unity™-based environment built around the same DDS communication paradigm allowing for easy integration with AEON-based autonomous applications, enabling sim-to-flight with minimal configuration changes. Using AEON and BEAM, source code that runs in simulation ports directly to hardware and has successfully flown in the National Airspace System (NAS) at NASA LaRC many times over the lifetime of ATTRACTOR.

Benjamin N Kelley↗

Bootstrapping Multi-Agent Unmanned Aerial Vehicle (UAV) System Integration Using Ground-Based Assets: Lessons Learned

The highly dynamic nature of UAVs imposes significant challenges when conducting initial testing ranging from safety risks posed by high-capacity lithium batteries and spinning propellers to rigorous timing demands on controllers and the consequences of failures mid-air. Flight testing of a single vehicle is time and labor intensive due to these challenges and more, and the complexity increases exponentially with the number of vehicles. While simulations and hardware-in-the-loop bench testing can provide adequate environments for preliminary validation, differences in system deployment architecture, software interfaces, and hardware infrastructure between simulation and a fleet of real UAVs create a sizable gap that must be navigated carefully during system integration. In support of the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project, which had the goal of establishing a basis of certification of trust and trustworthiness in multi-agent autonomous systems, this gap was tackled from two directions. First, a novel mixed-reality simulation environment was engineered to blur the transition from simulation to flight hardware. Second, a fleet of Unmanned Surface Vehicles (USVs) was developed as a test and evaluation platform that more closely represented the final aerial fleet while eliminating many of the risks associated with air vehicles. This paper delves into the second element, analyzing the efficacy of the USV platform in performing system integration testing for the UAV system. In this paper we present the USV fleet and its role in reducing the aforementioned gaps in deployment architecture, software interfaces, and hardware infrastructure when moving from simulation to flight. An overview of the hardware and software onboard the vehicles will be provided along with supporting infrastructure. The system integration process will be documented including results in supporting both the overarching design reference mission (DRM) of ATTRACTOR and individual research efforts conducted during the project. Finally, we will discuss some of the practical lessons learned regarding the testing, deployment, and operation of multi-agent autonomous systems.

Matthew P Vaughan↗

A Distributed Simulation-to-Flight Framework to Support Investigating Trust/Trustworthiness in Multi-Agent Systems

As autonomous systems continue to grow both in use and complexity, the necessity for robust and extensible simulation-to-flight methods is paramount for establishing an effective architecture for autonomous systems. A fundamental objective of the ATTRACTOR (Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability) project was to design and develop a distributed mixed-reality simulation environment to begin establishing a basis for certification of autonomous systems via research into trust and trustworthiness. In this paper, we present an autonomous systems architecture and development framework paired with a persistent distributed modeling and simulation environment for test and evaluation of autonomous systems. The Autonomous Entity Operations Network (AEON) framework enables autonomous system development with an easily extensible collection of libraries and plug-n-play nodes facilitated by the Data Distribution Service (DDS) communication protocol standard. The Baseline Environment for Autonomous Modeling (BEAM) simulation environment is a distributed mixed-reality Unity™-based environment built around the same DDS communication paradigm allowing for easy integration with AEON-based autonomous applications. They were designed under ATTRACTOR in order to measure and establish trustworthiness and trust in single- and multi-agent human-machine systems whether these machines are fixed-wing general aviation, rotary-wing Unmanned Aerial Vehicles (UAVs), ground rovers, or even spacecraft. Together AEON and BEAM enable sim-to-flight with minimal configuration changes. By using AEON and BEAM, source code that runs in simulation ports directly to hardware and has successfully flown in the lab and in the National Airspace System (NAS) at NASA LaRC many times over the lifetime of ATTRACTOR.

Benjamin N Kelley↗

Bootstrapping Multi-Agent Unmanned Aerial Vehicle (UAV) System Integration Using Ground-Based Assets: Lessons Learned

In support of the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project, a fleet of unmanned ground vehicles (UGVs) was developed as a test and evaluation (T\&E) platform to reduce system integration gaps between simulation and live flight hardware. While simulation and hardware-in-the-loop bench testing provide adequate environments for preliminary validation, differences in system deployment architecture, software interfaces, and hardware infrastructure increase the risks to safety, property, and the project. Given ATTRACTOR’s goal of establishing a basis of certification of trust and trustworthiness in multi-agent autonomous systems, bridging these gaps was critical to successful project execution and feasibility assessment. In this paper we present the UGV fleet and its role in speeding up system integration, smoothing the transition from simulation to flight, and providing researchers an easy-to-use hardware test bed. An overview of the hardware and software on-board the vehicles is provided along with supporting infrastructure. The system integration process is documented including results in supporting both the overarching design reference mission (DRM) of ATTRACTOR and individual research efforts conducted since the creation of the fleet. Finally, we discuss the practical lessons learned regarding the testing, deployment, and operation of multi-agent autonomous systems.

Matthew P. Vaughan↗

Exploring Multimodal Interactions in Human-Autonomy Teaming Using a Natural User Interface

The creation of a multimodal, natural user interface to facilitate multi-agent interaction is essential to establishing trust among human and machine teammates in multi-agent systems. Trust is being researched, along with trustworthiness, as a path to certification of autonomous systems by the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project at NASA. The Autonomous Mission Experimental Logistics Interactive Assistant (AMELIA) is a natural user interface that enables multimodal interaction and is designed for rapid mission planning. AMELIA is an intelligent system that considers the user’s preferred communication strategies, as well as the time-critical aspect of the multi-agent system decision-making process. Twenty-four participants planned a multi-agent search and rescue mission, with the aid of an intelligent assistant. The results show that while the combined use of touch and speech was faster than speech alone, the single modality, touch, was still the most efficient. Future research should investigate additional input technologies.

Lisa R Le Vie↗

A Distributed Simulation-to-Flight Framework to Support Investigating Trust/Trustworthiness in Multi-Agent Systems

As autonomous systems continue to grow both in use and complexity, the necessity for robust and extensible simulation-to-flight methods is paramount for establishing an effective architecture for autonomous systems. A fundamental objective of the ATTRACTOR (Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability) project was to design and develop a distributed mixed-reality simulation environment to begin establishing a basis for certification of autonomous systems via research into trust and trustworthiness. In this paper, we present an autonomous systems architecture and development framework paired with a persistent distributed modeling and simulation environment for test and evaluation of autonomous systems. The Autonomous Entity Operations Network (AEON) framework enables autonomous system development with an easily extensible collection of libraries and plug-n-play nodes facilitated by the Data Distribution Service (DDS) communication protocol standard. The Baseline Environment for Autonomous Modeling (BEAM) simulation environment is a distributed mixed-reality Unity™-based environment built around the same DDS communication paradigm allowing for easy integration with AEON-based autonomous applications. They were designed under ATTRACTOR in order to measure and establish trustworthiness and trust in single- and multi-agent human-machine systems whether these machines are fixed-wing general aviation, rotary-wing Unmanned Aerial Vehicles (UAVs), ground rovers, or even spacecraft. Together AEON and BEAM enable sim-to-flight with minimal configuration changes. By using AEON and BEAM, source code that runs in simulation ports directly to hardware and has successfully flown in the lab and in the National Airspace System (NAS) at NASA LaRC many times over the lifetime of ATTRACTOR.

Benjamin N Kelley↗

Exploring Multimodal Interactions in Human-Autonomy Teaming Using a Natural User Interface

The creation of a multimodal, natural user interface to facilitate multi-agent interaction is essential to establishing trust among human and machine teammates in multi-agent systems. Trust is being researched, along with trustworthiness, as a path to certification of autonomous systems by the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project at NASA. The Autonomous Mission Experimental Logistics Interactive Assistant (AMELIA) is a natural user interface that enables multimodal interaction and is designed for rapid mission planning. AMELIA is an intelligent system that considers the user’s preferred communication strategies, as well as the time-critical aspect of the multi-agent system decision-making process. Twenty-four participants planned a multi-agent search and rescue mission, with the aid of an intelligent assistant. The results show that while the combined use of touch and speech was faster than speech alone, the single modality, touch, was still the most efficient. Future research should investigate additional input technologies.

Lisa Renee Le Vie↗

How Do Different Knowledge Frameworks Help Us Learn From Aviation Line Observations?

Human performance includes actions that increase safety, as well as actions that can reduce safety. Ensuring safety in complex dynamic operations like commercial aviation depends on the ability to institute appropriate responses based on what is learned from flightcrew performance and the contexts in which it occurs. To do this systemically at the organization level requires collecting data on flightcrew performance, developing effective approaches to analyzing those data, and understanding how to translate what has been learned into policies, procedures, and practice. Systematic observation of front-line operators is a vital source of human performance data. Much has been learned from such observations, including methodological principles. Most observations have been based on a framework focused on managing safety challenges and the ensuing unsafe events. A complementary perspective focuses on flexibility and actions that promote continued safe and effective operation. We consider lessons learned about observational methods from an established framework focused on undesired actions and how these might be extended for a framework focused on desired actions.

safety↗

Urban Air Mobility: A Control-Centric Approach to Addressing Technical Challenges

Urban Air Mobility (UAM) is an emerging aviation sector and is playing an integral part in the on-demand mobility revolution. UAM is powered by the convergence of advances in distributed electrical propulsion (DEP) and vehicle autonomy. The complexity of operations in the urban environment and the unconventional vehicle configurations designed to take advantage of new propulsion technologies, result in numerous challenges that benefit from a control-centric approach. In this talk we outline some of these challenges and present our current approach to addressing them. For example, in order to achieve full market potential and access to UAM, vehicle autonomous flight is required. A key barrier to autonomous flight in a large multi-agent system is dealing with off-nominal situations and contingencies in a safe and predictable manner. We present our approach to intelligent contingency management, and share recent results and open problems. Additionally, we discuss another major barrier to ubiquitous UAM – the noise signature produced by vehicles with multiple rotors. We present our approach to minimizing such noise within the framework of the acoustically-aware vehicle.

UAM↗

Establishing Recommendations for the Development of Space Suit Integrated Food Systems and the Delivery of Nutrition Before, During, and After Lunar EVA

Extravehicular activity (EVA) operations are complex and challenging, and Artemis missions will include a higher tempo and frequency of EVAs than any previous space program. For this reason, surface EVAs greater than 4 h require additional nutrition support. The ability to provide this additional nutritional support is limited on Artemis missions given crew schedules and the current inability to provide nutrition to astronauts while suited. This project seeks to help define means for provision of nutritional support to Artemis astronauts during lunar EVAs.

E L Dillon↗

A Data-Driven Reduced Order Model of an Isolated Rotor

There are numerous conceptual design stage rotorcraft analysis tasks which demand a high-fidelity and low cost method for rotor load distribution predictions. Considering Urban Air Mobility (UAM) vehicles aim to operate in close proximity to buildings and with unique rotor configurations, there is a significant challenge in quickly and accurately modeling rotors operating in complex, turbulent flow fields. One potential path for deriving a high-fidelity, low cost rotor model is with data-driven surrogate modeling. In this study, an initial investigation is taken to apply a proper orthogonal decomposition (POD) based reduced order model (ROM) for the purpose of pressure distribution prediction. In this study, a POD ROM was derived to produce distributed pressure predictions on rotor blades subjected to topology change due to variation in twist and taper ratio. Rotor twist was varied between 0◦, 10◦, 20◦, and 30◦ while taper ratio was varied between 1.0, 0.9, 0.8, and 0.7. All rotors consisted of a single blade. The POD ROM was validated for three demonstration cases; a high thrust rotor in hover, a low thrust rotor in hover, and a rotor in forward flight with a flight speed of M = 0.1. Results showed highly accurate distributed load predictions could be achieved at minimal computational cost. Computational cost for hovering blade surface pressure modeling was reduced from 12 hours on 440 cores to 10−5 seconds on a single core. For blade in forward flight cost was reduced from 20 hours on 440 cores to 0.6 seconds on a single core. For cases of high thrust and low thrust rotors, POD ROM was used to undergo a design optimization of the rotor such that figure of merit was maximized. Total optimization time for each case was 1 minute.

Data-Driven↗

Constraining Arctic Climate Projections of Wintertime Warming With Surface Turbulent Flux Observations and Representation of Surface-Atmosphere Coupling

The drivers of rapid Arctic climate change—record sea ice loss, warming SSTs, and a lengthening of the sea ice melt season—compel us to understand how this complex system operates and use this knowledge to enhance Arctic predictability. Changing energy flows sparked by sea ice decline, spotlight atmosphere-surface coupling processes as central to Arctic system function and its climate change response. Despite this, the representation of surface turbulent flux parameterizations in models has not kept pace with our understanding. The large uncertainty in Arctic climate change projections, the central role of atmosphere-surface coupling, and the large discrepancy in model representation of surface turbulent fluxes indicates that these processes may serve as useful observational constraints on projected Arctic climate change. This possibility requires an evaluation of surface turbulent fluxes and their sensitivity to controlling factors (surface-air temperature and moisture differences, sea ice, and winds) within contemporary climate models (here Coupled Model Intercomparison Project 6). The influence of individual controlling factors and their interactions is diagnosed using a multi-linear regression approach. This evaluation is done for four sea ice loss regimes, determined from observational sea ice loss trends, to control for the confounding effects of natural variability between models and observations. The comparisons between satellite- and model-derived surface turbulent fluxes illustrate that while models capture the general sensitivity of surface turbulent fluxes to declining sea ice and to surface-air gradients of temperature and moisture, substantial mean state biases exist. Specifically, the central Arctic is too weak of a heat sink to the winter atmosphere compared to observations, with implications to the simulated atmospheric circulation variability and thermodynamic profiles. Models were found to be about 50% more efficient at turning an air-sea temperature gradient anomaly into a sensible heat flux anomaly relative to observations. Further, the influence of sea ice concentration on the sensible heat flux is underestimated in models compared to observations. The opposite is found for the latent heat flux variability in models; where the latent heat flux is too sensitive to a sea ice concentration anomaly. Lastly, the results suggest that present-day trends in sea ice retreat regions may serve as suitable observational constraints of projected Arctic warming.

turbulent fluxes↗

Swarm Mentality: Toward Automatic Swarm State Awareness with Runtime Verification

Cyber-Physical Systems (CPSs) already exhibit impressive performance in all areas of human life, and swarms of CPSs promise to increase their capabilities even further. However, to effectively utilize CPS swarms their complexity of operation has to scale sub-linearly with the number of swarm members. Presenting the swarm to an operator as a single entity almost eliminates the additional per-member overhead entirely. To operate a swarm as one entity, and/or to increase the swarm’s autonomy, the operator and the swarm members need to reason and communicate at the same level of abstraction, i.e. the swarm needs a sense of “self.” Therefore, we require the ability to specify whole swarm properties yet monitor them at the member level. We examine one architecture for achieving this awareness by: 1) Defining a taxonomy for comparing techniques that synthesize this belief-state 2) Propose use of the Runtime Verification formal method to fill this role 3) Present preliminary designs for extending and embedding such a system in the Distributed Spacecraft Autonomy architecture to generate per-member monitors from swarm level specification.

Runtime Verification↗

The MOCHII ISS National Laboratory: The First Spacecraft Based Scanning Electron Microscope

Introduction: Scanning electron microscopy (SEM) in concert with element identification by energy dispersive Xray (EDX) spectroscopy has become an indispensable tool in the analyses of extraterrestrial materials. Nevertheless, to-date, SEM-EDX instrumentation has remained purely in the purview of terrestrial laboratories due to their size, complexity, and operational requirements. However, in January 2022 a miniaturized SEM-EDX called MOCHII became the first successful space-based instrument of its kind, following its deployment onboard the International Space Station (ISS). It represents the culmination of nearly 40 years of technological development. We have performed an on-orbit study with MOCHII with the goal of evaluating its potential as the progenitor of a new generation of spacecraftbased instruments for use in future manned and robotic planetary exploration missions. Out goal has been to validate the on-orbit investigation of samples relevant to astromaterials and astrobiology. We have performed in-situ analyses on standards and a freshly fractured fragment of the Martian meteorite Allan Hills 84001 which was first analyzed, prior to launch, using an engineering MOCHII ground unit located at Johnson Space Center in Houston. Results of both imaging and compositional analyses substantiates the utility of remote SEM-EDX analyses in low Earth orbit (LEO).

Miniature Scanning Electron Microscope↗

Dynamic Path Planning Automation Concept for Advanced Air Mobility

Advanced Air Mobility (AAM) aims to develop an air transportation system for novel air vehicles between local, regional, intraregional, and urban places. Safety and efficiency of increasingly complex AAM operations are expected to require extensive use of automation, ranging from controlling the revolutionary new aircraft to managing flights dynamically in the high tempo airspace and aerodrome operations. Both onboard and ground automation will play central roles in assisting AAM operators with managing the flight paths of their fleet. This document presents a concept for dynamic path planning (DPP) automation applicable to AAM and other flight operations. The role of the DPP automation system is fivefold: (1) it creates a flight path with desired qualities of being feasible, deconflicted, harmonized, flexible, and optimal; (2) it monitors the progress of flight in a dynamic operating environment; (3) it supports the user in evaluating continued acceptability of the flight path in changing conditions; (4) it revises the flight path as needed to maintain the desired flight path qualities; and (5) it coordinates the flight path with airspace users and service providers. Key users of the DPP automation system include flight planners, pilots, and airspace service providers The concept allows for the system to be installed onboard the aircraft as well as on the ground. The system responds automatically to the dynamic operating environment to ensure that a safe and operationally acceptable flight path is available throughout the flight.

Vivek Sharma↗

A Data Analysis and Simulation Study of Urban Air Mobility

For the Urban Air Mobility (UAM) industry, NASA has defined a series of UAM Maturity Levels (UML) corresponding to increasingly more complex and operationally dense UAM operations. In support of the gradual progression towards higher UML levels, NASA is currently conducting a set of UAM air traffic simulations—collectively referred to as X4. This paper describes a set of system effectiveness measures, and their associated metrics, for data analysis of X4 simulations. The descriptions, rationales, and calculation procedures for two metrics to be used in data analysis of simulation results, the number of predicted demand-capacity imbalances and the pre-departure delays, are described. Results from data analysis of one set of simulation runs are presented to demonstrate how these metrics support the assessment of performance of the system architecture for X4 simulations and the verification of experiment requirements.

Urban Air Mobility↗