SEARCH · Engineering Papers

Results for “agent based simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

All sources NASA NTRS DOE OSTI

NASA NTRS2013

Autonomous Formations of Multi-Agent Systems

Autonomous formation control of multi-agent dynamic systems has a number of applications that include ground-based and aerial robots and satellite formations. For air vehicles, formation flight ("flocking") has the potential to significantly increase airspace utilization as well as fuel efficiency. This presentation addresses two main problems in multi-agent formations: optimal role assignment to minimize the total cost (e.g., combined distance traveled by all agents); and maintaining formation geometry during flock motion. The Kuhn-Munkres ("Hungarian") algorithm is used for optimal assignment, and consensus-based leader-follower type control architecture is used to maintain formation shape despite the leader s independent movements. The methods are demonstrated by animated simulations.

Dhali, Sanjana↗

NASA NTRSDate not supplied

Towards Autonomous Lunar Resource Excavation via Reinforcement Learning

To continue on a sustainable and flexible path, NASA needs to address the challenge of collecting and moving large amounts of regolith at the destination. NASA’s Regolith Advanced Surface Systems Operations Robot (RASSOR) is principally designed to mine and deliver regolith for In-Situ Resource Utilization (ISRU) processing. RASSOR’s design enables it to efficiently collect and deposit regolith, return collected material for processing, and myriad related ISRU activities. To reliably perform these operations on the lunar surface, RASSOR software and sensory systems need to be robust and maximize the information extracted from a reduced sensor payload. Herein, we present preliminary findings from the Intelligent Capabilities Enhanced RASSOR project. We created reduced-order simulation environments to develop autonomous trenching controllers via reinforcement learning and prototype state estimation architectures. The goal of reinforcement learning is for an agent to learn a policy (task strategy) through interactions with an environment. When the agent performs an action, a change occurs in environment state and a numerical reward is received which informs the agent whether the action performed was good or not. Since reinforcement learning algorithms learn through trial-and-error, a simulation is a desirable first environment for development and learning. We developed two simulations, the first is a 2D excavation simulation developed to facilitate parameter selection, and a 3D simulation developed using a game physics engine, to simulate simplified soil interactions and increase the fidelity of the dynamic models of the robotic agents. The development of this 3D simulation has enabled the training of additional sensing capabilities and research both at the granular mechanics and operations levels. We experimented with various virtual sensor payloads to identify a combination that enabled efficient excavation operation and learning. Our reward function is based on how much material is excavated per step. A penalty is also received for leaving the dig site and to smooth the acceleration of the drum arms. We implemented pseudo time-of-flight sensors to report distance from each drum to ground and the height above ground which was found to be more efficient than existing solutions. Our findings suggest that reinforcement learning for autonomous operations has learned viable trenching strategies within 3000 training episodes in our simplified 2D environment and helped identify desirable sensing capabilities, arrangements, and considerations such as the positioning of time-of-flight sensors. Future work includes expanding our simulation to more complex environments and scenarios, and transfer learning from simulation to RASSOR 2.0 hardware for deployment in the Regolith Test Bin at NASA's Kennedy Space Center.

rassor↗

NASA NTRS2004

Two Formal Gas Models For Multi-Agent Sweeping and Obstacle Avoidance

The task addressed here is a dynamic search through a bounded region, while avoiding multiple large obstacles, such as buildings. In the case of limited sensors and communication, maintaining spatial coverage - especially after passing the obstacles - is a challenging problem. Here, we investigate two physics-based approaches to solving this task with multiple simulated mobile robots, one based on artificial forces and the other based on the kinetic theory of gases. The desired behavior is achieved with both methods, and a comparison is made between them. Because both approaches are physics-based, formal assurances about the multi-robot behavior are straightforward, and are included in the paper.

Kerr, Wesley↗

NASA NTRSDate not supplied

Designing a Distributed Web-based Simulation Environment for Enabling Autonomous Systems Research

In the continued pursuit of creating a future with robust Urban Air Mobility (UAM) operations defined as safe and efficient air traffic operations in metropolitan environments for both piloted and autonomous systems, development of the concepts, technologies, and procedures to establish this UAM ecosystem remains an active area of research. In particular, as autonomous systems continue to grow in both complexity and use throughout UAM concepts the need for simulation environments to both test individual components and systems and to study the complex interactions between them is paramount. In this paper we address design considerations, technologies, and challenges of adapting native simulation environment application concepts to an interactive and distributed web-based framework. The proposed web-based design allows for easier and wider access for developing, testing, integrating, and studying emergent behaviors of complex autonomous systems interaction. We demonstrate the utility of the proposed approach by showing multi-agent interaction and emergent behavior in two scenarios: (1) autonomous urban air mobility vehicles flying in a convoy and (2) interaction of a convoy with a search and rescue operation.

Benjamin N Kelley↗

NASA NTRS2001

Physical and Chemical Aspects of Fire Suppression in Extraterrestrial Environments

A fire, whether in a spacecraft or in occupied spaces on extraterrestrial bases, can lead to mission termination or loss of life. While the fire-safety record of US space missions has been excellent, the advent of longer duration missions to Mars, the moon, or aboard the International Space Station (ISS) increases the likelihood of fire events, with more limited mission termination options. The fire safety program of NASA's manned space flight program is based largely upon the principles of controlling the flammability of on-board materials and greatly eliminating sources of ignition. As a result, very little research has been conducted on fire suppression in the microgravity or reduced-gravity environment. The objectives of this study are: to obtain fundamental knowledge of physical and chemical processes of fire suppression, using gravity and oxygen concentration as independent variables to simulate various extraterrestrial environments, including spacecraft and surface bases in Mars and moon missions; to provide rigorous testing of analytical models, which include comprehensive descriptions of combustion and suppression chemistry; and to provide basic research results useful for technological advances in fire safety, including the development of new fire-extinguishing agents and approaches, in the microgravity environment associated with ISS and in the partial-gravity Martian and lunar environments.

Takahashi, F.↗

NASA NTRS1987

Mission planning and simulation via intelligent agents

A system that can operate from a flight manifest to plan and simulate payload preparation and transport via Shuttle flights is described. The design alternatives and the prototype implementation of the payload hardware and inventory tracking system are discussed. It is shown how intelligent agents can be used to generate mission schedules, and how, through the use of these intelligent agents, knowledge becomes separated into small manageable knowledge bases.

Gargan, Robert A., Jr.↗

NASA NTRS2004

Fire Suppression in Low Gravity Using a Cup Burner

Longer duration missions to the moon, to Mars, and on the International Space Station increase the likelihood of accidental fires. The goal of the present investigation is to: (1) understand the physical and chemical processes of fire suppression in various gravity and O2 levels simulating spacecraft, Mars, and moon missions; (2) provide rigorous testing of numerical models, which include detailed combustion-suppression chemistry and radiation sub-models; and (3) provide basic research results useful for advances in space fire safety technology, including new fire-extinguishing agents and approaches.The structure and extinguishment of enclosed, laminar, methane-air co-flow diffusion flames formed on a cup burner have been studied experimentally and numerically using various fire-extinguishing agents (CO2, N2, He, Ar, CF3H, and Fe(CO)5). The experiments involve both 1g laboratory testing and low-g testing (in drop towers and the KC-135 aircraft). The computation uses a direct numerical simulation with detailed chemistry and radiative heat-loss models. An agent was introduced into a low-speed coflowing oxidizing stream until extinguishment occurred under a fixed minimal fuel velocity, and thus, the extinguishing agent concentrations were determined. The extinguishment of cup-burner flames, which resemble real fires, occurred via a blowoff process (in which the flame base drifted downstream) rather than the global extinction phenomenon typical of counterflow diffusion flames. The computation revealed that the peak reactivity spot (the reaction kernel) formed in the flame base was responsible for attachment and blowoff of the trailing diffusion flame. Furthermore, the buoyancy-induced flame flickering in 1g and thermal and transport properties of the agents affected the flame extinguishment limits.

Takahashi, Fumiaki↗

NASA NTRS2004

Fire Suppression in Low Gravity Using a Cup Burner

Longer duration missions to the moon, to Mars, and on the International Space Station increase the likelihood of accidental fires. The goal of the present investigation is to: (1) understand the physical and chemical processes of fire suppression in various gravity and O2 levels simulating spacecraft, Mars, and moon missions; (2) provide rigorous testing of numerical models, which include detailed combustion suppression chemistry and radiation sub-models; and (3) provide basic research results useful for advances in space fire safety technology, including new fire-extinguishing agents and approaches. The structure and extinguishment of enclosed, laminar, methane-air co-flow diffusion flames formed on a cup burner have been studied experimentally and numerically using various fire-extinguishing agents (CO2, N2, He, Ar, CF3H, and Fe(CO)5). The experiments involve both 1g laboratory testing and low-g testing (in drop towers and the KC-135 aircraft). The computation uses a direct numerical simulation with detailed chemistry and radiative heat-loss models. An agent was introduced into a low-speed coflowing oxidizing stream until extinguishment occurred under a fixed minimal fuel velocity, and thus, the extinguishing agent concentrations were determined. The extinguishment of cup-burner flames, which resemble real fires, occurred via a blowoff process (in which the flame base drifted downstream) rather than the global extinction phenomenon typical of counterflow diffusion flames. The computation revealed that the peak reactivity spot (the reaction kernel) formed in the flame base was responsible for attachment and blowoff of the trailing diffusion flame. Furthermore, the buoyancy-induced flame flickering in 1g and thermal and transport properties of the agents affected the flame extinguishment limits.

Takahashi, Fumiaki↗

NASA NTRS2003

Advantages of Brahms for Specifying and Implementing a Multiagent Human-Robotic Exploration System

We have developed a model-based, distributed architecture that integrates diverse components in a system designed for lunar and planetary surface operations: an astronaut's space suit, cameras, all-terrain vehicles, robotic assistant, crew in a local habitat, and mission support team. Software processes ('agents') implemented in the Brahms language, run on multiple, mobile platforms. These mobile agents interpret and transform available data to help people and robotic systems coordinate their actions to make operations more safe and efficient. The Brahms-based mobile agent architecture (MAA) uses a novel combination of agent types so the software agents may understand and facilitate communications between people and between system components. A state-of-the-art spoken dialogue interface is integrated with Brahms models, supporting a speech-driven field observation record and rover command system. An important aspect of the methodology involves first simulating the entire system in Brahms, then configuring the agents into a runtime system Thus, Brahms provides a language, engine, and system builder's toolkit for specifying and implementing multiagent systems.

Clancey, William J.↗

NASA NTRSDate not supplied

Deep Learning-Based Negotiation Strategy Selection for Cooperative Conflict Resolution in Urban Air Mobility

This paper presents a collaborative conflict resolution technique using deep neural network-based intelligent search of the solution space. This approach offers a rapid convergence to a mutually acceptable solution for real-time conflict resolution, suitable for urban air mobility operations. Furthermore, the presented technique allows operational flexibility to the urban air mobility agents where these agents can collaboratively devise the solution via integrative negotiation, based on their local utility functions, as long as such a solution does not violate the global safety thresholds. The presented machine-to-machine negotiation method is built on our prior work on holistic assessment of the airspace and potential conflict detection implemented at-the-edge, onboard the unmanned aircraft systems. This paper extends the prior work to augment decision-making at-the-edge, thereby, promising a true distributed control architecture for urban air mobility. In this approach, each agent (a) builds a potential in-flight conflict map, (b) identifies the conflicting agents, (c) dynamically prepares a list of alternatives based on its current utility functions, (d) negotiates with the conflicting agents to pick one of these alternatives, and (e) implements the negotiated alternative to mutually resolve the conflict. Note that such an approach does not require a contingency plan to be made pre-flight, as the conflict resolution strategies are decided and negotiated in real time based on the present state of the agent. The contingency plan, if available, can serve as an input to the real-time conflict resolution strategy formulation, and also can be used as a fallback plan in case the negotiation fails and the impacted agents need to switch to a rule-based/supervisory resolution mode from the discussed distributed resolution mode. The presented collaborative negotiation-based conflict resolution technique incorporates a time-dependent reward function to catalyze collaborative resolution by incentivizing the agents with local and global rewards beneficial to their business operations.

Advanced Air Mobility↗

NASA NTRS2022

Neurosymbolic Hybrid Approach to Driver Collision Warning

There are two main algorithmic approaches to autonomous driving systems: (1) An end-to-end system in which a single deep neural network learns to map sensory input directly into appropriate warning and driving responses. (2) A mediated hybrid recognition system in which a system is created by combining independent modules that detect each semantic feature. While some researchers believe that deep learning can solve any problem, others believe that a more engineered and symbolic approach is needed to cope with complex environments with less data. Deep learning alone has achieved state-of-the-art results in many areas, from complex gameplay to predicting protein structures. In particular, in image classification and recognition, deep learning models have achieved accuracies as high as humans. But sometimes it can be very difficult to debug if the deep learning model doesn't work. Deep learning models can be vulnerable and are very sensitive to changes in data distribution. Generalization can be problematic. It's usually hard to prove why it works or doesn't. Deep learning models can also be vulnerable to adversarial attacks. Here, we combine deep learning-based object recognition and tracking with an adaptive neurosymbolic network agent, called the Non-Axiomatic Reasoning System (NARS), that can adapt to its environment by building concepts based on perceptual sequences. We achieved an improved intersection-over-union (IOU) object recognition performance of 0.65 in the adaptive retraining model compared to IOU 0.31 in the COCO data pre-trained model. We improved the object detection limits using RADAR sensors in a simulated environment, and demonstrated the weaving car detection capability by combining deep learning-based object detection and tracking with a neurosymbolic model.

Wang, Pei↗

NASA NTRS2004

Human-Centric Teaming in a Multi-Agent EVA Assembly Task

NASA's Human Space Flight program depends heavily on spacewalks performed by pairs of suited human astronauts. These Extra-Vehicular Activities (EVAs) are severely restricted in both duration and scope by consumables and available manpower.An expanded multi-agent EVA team combining the information-gathering and problem-solving skills of human astronauts with the survivability and physical capabilities of highly dexterous space robots is proposed. A 1-g test featuring two NASA/DARPA Robonaut systems working side-by-side with a suited human subject is conducted to evaluate human-robot teaming strategies in the context of a simulated EVA assembly task based on the STS-61B ACCESS flight experiment.

Rehnmark, Fredrik↗

NASA NTRS2008

Emergency Response Virtual Environment for Safe Schools

An intelligent emergency response virtual environment (ERVE) that provides emergency first responders, response planners, and managers with situational awareness as well as training and support for safe schools is presented. ERVE incorporates an intelligent agent facility for guiding and assisting the user in the context of the emergency response operations. Response information folders capture key information about the school. The system enables interactive 3D visualization of schools and academic campuses, including the terrain and the buildings' exteriors and interiors in an easy to use Web..based interface. ERVE incorporates live camera and sensors feeds and can be integrated with other simulations such as chemical plume simulation. The system is integrated with a Geographical Information System (GIS) to enable situational awareness of emergency events and assessment of their effect on schools in a geographic area. ERVE can also be integrated with emergency text messaging notification systems. Using ERVE, it is now possible to address safe schools' emergency management needs with a scaleable, seamlessly integrated and fully interactive intelligent and visually compelling solution.

Wasfy, Ayman↗

NASA NTRS2006

A Robust Scalable Transportation System Concept

This report documents the 2005 Revolutionary System Concept for Aeronautics (RSCA) study entitled "A Robust, Scalable Transportation System Concept". The objective of the study was to generate, at a high-level of abstraction, characteristics of a new concept for the National Airspace System, or the new NAS, under which transportation goals such as increased throughput, delay reduction, and improved robustness could be realized. Since such an objective can be overwhelmingly complex if pursued at the lowest levels of detail, instead a System-of-Systems (SoS) approach was adopted to model alternative air transportation architectures at a high level. The SoS approach allows the consideration of not only the technical aspects of the NAS", but also incorporates policy, socio-economic, and alternative transportation system considerations into one architecture. While the representations of the individual systems are basic, the higher level approach allows for ways to optimize the SoS at the network level, determining the best topology (i.e. configuration of nodes and links). The final product (concept) is a set of rules of behavior and network structure that not only satisfies national transportation goals, but represents the high impact rules that accomplish those goals by getting the agents to "do the right thing" naturally. The novel combination of Agent Based Modeling and Network Theory provides the core analysis methodology in the System-of-Systems approach. Our method of approach is non-deterministic which means, fundamentally, it asks and answers different questions than deterministic models. The nondeterministic method is necessary primarily due to our marriage of human systems with technological ones in a partially unknown set of future worlds. Our goal is to understand and simulate how the SoS, human and technological components combined, evolve.

Hahn, Andrew↗

NASA NTRS2018

Autonomous Power Controller for the NASA Gateway

Intelligent autonomous control of a spacecraft is an enabling technology that must be developed for deep space human exploration. NASA's current long term human space platform, the International Space Station which is in Low Earth Orbit, is in almost continuous communication with ground based mission control. This allows near real-time operation of all the vehicle core systems, including power, from the ground. As the focus shifts from Low Earth Orbit to deep space, challenges associated with communication time-lag and bandwidth limitations beyond geosynchronous orbit do not permit this type of ground based operation. These communication limitations motivate autonomous vehicle operations, including the vehicle subsystems such as power. This presentation will describe the ongoing development of an Autonomous Power Control (APC) system that can be used for a deep space exploration spacecraft. This work extends previous work on developing an autonomous power control which includes developing a control architecture for deep space vehicles, the use of software agents, and constructing a control simulation lab for demonstrating this capability. This presentation will begin with a discussion of the representative future power architectures that will be required for deep space exploration vehicles. The presentation then will describe how the power controller will integrate with the vehicle followed with a discussion of the autonomous power controller. Next it will describe the test setup used to evaluate the performance of the system and lastly show some of the test results. To develop the type of controller envisioned, it will be necessary to employ a detailed real-time simulation to evaluate its performance and ultimately verify its functionality.

Csank, Jeffrey↗

NASA NTRS2018

Autonomous Power Control

Intelligent autonomous control of a spacecraft is an enabling technology that must be developed for deep space human exploration. NASA's current long term human space platform, the International Space Station which is in Low Earth Orbit, is in almost continuous communication with ground based mission control. This allows near realtime operation of all the vehicle core systems, including power, from the ground. As the focus shifts from Low Earth Orbit to deep space, challenges associated with communication time-lag and bandwidth limitations beyond geosynchronous orbit do not permit this type of ground based operation. These communication limitations motivate autonomous vehicle operations, including the vehicle subsystems such as power. This presentation will describe the ongoing development of an Autonomous Power Control (APC) system that can be used for a deep space exploration spacecraft. This work extends previous work on developing an autonomous power control which includes developing a control architecture for deep space vehicles, the use of software agents, and constructing a control simulation lab for demonstrating this capability. This presentation will begin with a discussion of the representative future power architectures that will be required for deep space exploration vehicles. The presentation then will describe how the power controller will integrate with the vehicle followed with a discussion of the autonomous power controller. Next it will describe the test setup used to evaluate the performance of the system and lastly show some of the test results. To develop the type of controller envisioned, it will be necessary to employ a detailed real-time simulation to evaluate its performance and ultimately verify its functionality.

Csank, Jeffrey↗

NASA NTRS2015

An Integrated Framework for Modeling Air Carrier Behavior, Policy, and Impacts in the U.S. Air Transportation System

The implementation of the Next Generation Air Transportation System (NextGen) in the United States is an ongoing challenge for policymakers due to the complexity of the air transportation system (ATS) with its broad array of stakeholders and dynamic interdependencies between them. The successful implementation of NextGen has a hard dependency on the active participation of U.S. commercial airlines. To assist policymakers in identifying potential policy designs that facilitate the implementation of NextGen, the National Aeronautics and Space Administration (NASA) and LMI developed a research framework called the Air Transportation System Evolutionary Simulation (ATS-EVOS). This framework integrates large empirical data sets with multiple specialized models to simulate the evolution of the airline response to potential future policies and explore consequential impacts on ATS performance and market dynamics. In the ATS-EVOS configuration presented here, we leverage the Transportation Systems Analysis Model (TSAM), the Airline Evolutionary Simulation (AIRLINE-EVOS), the Airspace Concept Evaluation System (ACES), and the Aviation Environmental Design Tool (AEDT), all of which enable this research to comprehensively represent the complex facets of the ATS and its participants. We validated this baseline configuration of ATS-EVOS against Airline Origin and Destination Survey (DB1B) data and subject matter expert opinion, and we verified the ATS-EVOS framework and agent behavior logic through scenario-based experiments that explored potential implementations of a carbon tax, congestion pricing policy, and the dynamics for equipage of new technology by airlines. These experiments demonstrated ATS-EVOS's capabilities in responding to a wide range of potential NextGen-related policies and utility for decision makers to gain insights for effective policy design.

Horio, Brant M.↗

NASA NTRS2015

Reinforcement Learning with Autonomous Small Unmanned Aerial Vehicles in Cluttered Environments

We present ongoing work in the Autonomy Incubator at NASA Langley Research Center (LaRC) exploring the efficacy of a data set aggregation approach to reinforcement learning for small unmanned aerial vehicle (sUAV) flight in dense and cluttered environments with reactive obstacle avoidance. The goal is to learn an autonomous flight model using training experiences from a human piloting a sUAV around static obstacles. The training approach uses video data from a forward-facing camera that records the human pilot's flight. Various computer vision based features are extracted from the video relating to edge and gradient information. The recorded human-controlled inputs are used to train an autonomous control model that correlates the extracted feature vector to a yaw command. As part of the reinforcement learning approach, the autonomous control model is iteratively updated with feedback from a human agent who corrects undesired model output. This data driven approach to autonomous obstacle avoidance is explored for simulated forest environments furthering autonomous flight under the tree canopy research. This enables flight in previously inaccessible environments which are of interest to NASA researchers in Earth and Atmospheric sciences.

Tran, Loc↗