SEARCH · Engineering Papers

Results for “agent based simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

NASA NTRS2022

A 3D Simulation Platform for Decentralized Decision-Making in Advanced Air Mobility

This paper presents a general purpose, plug-and-play simulation platform for the use of future aviation stakeholders, such as urban airspace planners, air vehicle operators, ground operation managers, air traffic controllers and aviation researchers. The presented simulator platform is envisioned to serve as a toolkit to visualize, evaluate, and configure future advanced air mobility (AAM) operations. Highlighting features of this toolkit include a modular architecture that allows multiple smart unmanned aerial systems (UASs) to remotely connect to the simulation server and participate in decentralized decision-making scenario simulations. As an example of the decentralized decision-making scenario, an inter-agent negotiation-based conflict resolution use case is considered in this paper, where the UASs leverage the on-board/on-the-edge artificial intelligence (AI) capability to continually build situational awareness, and use this information to predict future conflicts and resolve them through machine-to-machine negotiation. As such operations are non-existent at scale currently, the presented simulation platform offers a viable and cost-effective alternative for assessing the efficacy of AAM research outcomes and challenges in future shared airspace usage. The simulation platform allows plug-n-play connectivity with AI and non-AI compute modules representing individual UAS’s flight control. Each module can interact with the simulation platform independently to communicate current and desired future states, situational awareness, and conflict resolution utilization costs for inter-agent negotiation. The simulation environment orchestrates realistic operational scenarios with spatiotemporal details, dynamic events, tactical conflict-resolution methods, interfaces for customizing air traffic control parameters, and information exchange uncertainties. In the future, this can serve as a community focused cloud simulation platform, incorporating multi-stakeholder airspace constraints from regulatory, government, city, and local agencies.

Aditya Das↗

NASA NTRS2015

Understanding Air Transportation Market Dynamics Using a Search Algorithm for Calibrating Travel Demand and Price

This paper presents a search algorithm based framework to calibrate origin-destination (O-D) market specific airline ticket demands and prices for the Air Transportation System (ATS). This framework is used for calibrating an agent based model of the air ticket buy-sell process - Airline Evolutionary Simulation (Airline EVOS) -that has fidelity of detail that accounts for airline and consumer behaviors and the interdependencies they share between themselves and the NAS. More specificially, this algorithm simultaneous calibrates demand and airfares for each O-D market, to within specified threshold of a pre-specified target value. The proposed algorithm is illustrated with market data targets provided by the Transportation System Analysis Model (TSAM) and Airline Origin and Destination Survey (DB1B). Although we specify these models and datasources for this calibration exercise, the methods described in this paper are applicable to calibrating any low-level model of the ATS to some other demand forecast model-based data. We argue that using a calibration algorithm such as the one we present here to synchronize ATS models with specialized forecast demand models, is a powerful tool for establishing credible baseline conditions in experiments analyzing the effects of proposed policy changes to the ATS.

Kumar, Vivek↗

NASA NTRS2011

Entanglement in Self-Supervised Dynamics

A new type of correlation has been developed similar to quantum entanglement in self-supervised dynamics (SSD). SSDs have been introduced as a quantum-classical hybrid based upon the Madelung equation in which the quantum potential is replaced by an information potential. As a result, SSD preserves the quantum topology along with superposition, entanglement, and wave-particle duality. At the same time, it can be implemented in any scale including the Newtonian scale. The main properties of SSD associated with simulating intelligence have been formulated. The attention with this innovation is focused on intelligent agents interaction based upon the new fundamental non-New tonian effect; namely, entanglement.

Zak, Michail↗

NASA NTRS1999

Reinforcement Learning in a Nonstationary Environment: The El Farol Problem

This paper examines the performance of simple learning rules in a complex adaptive system based on a coordination problem modeled on the El Farol problem. The key features of the El Farol problem are that it typically involves a medium number of agents and that agents' pay-off functions have a discontinuous response to increased congestion. First we consider a single adaptive agent facing a stationary environment. We demonstrate that the simple learning rules proposed by Roth and Er'ev can be extremely sensitive to small changes in the initial conditions and that events early in a simulation can affect the performance of the rule over a relatively long time horizon. In contrast, a reinforcement learning rule based on standard practice in the computer science literature converges rapidly and robustly. The situation is reversed when multiple adaptive agents interact: the RE algorithms often converge rapidly to a stable average aggregate attendance despite the slow and erratic behavior of individual learners, while the CS based learners frequently over-attend in the early and intermediate terms. The symmetric mixed strategy equilibria is unstable: all three learning rules ultimately tend towards pure strategies or stabilize in the medium term at non-equilibrium probabilities of attendance. The brittleness of the algorithms in different contexts emphasize the importance of thorough and thoughtful examination of simulation-based results.

Bell, Ann Maria↗

NASA NTRS1992

Distributed environmental control

We present an architecture of distributed, independent control agents designed to work with the Computer Aided System Engineering and Analysis (CASE/A) simulation tool. CASE/A simulates behavior of Environmental Control and Life Support Systems (ECLSS). We describe a lattice of agents capable of distributed sensing and overcoming certain sensor and effector failures. We address how the architecture can achieve the coordinating functions of a hierarchical command structure while maintaining the robustness and flexibility of independent agents. These agents work between the time steps of the CASE/A simulation tool to arrive at command decisions based on the state variables maintained by CASE/A. Control is evaluated according to both effectiveness (e.g., how well temperature was maintained) and resource utilization (the amount of power and materials used).

Cleveland, Gary A.↗

NASA NTRS1997

An Agent-Based Cockpit Task Management System

An agent-based program to facilitate Cockpit Task Management (CTM) in commercial transport aircraft is developed and evaluated. The agent-based program called the AgendaManager (AMgr) is described and evaluated in a part-task simulator study using airline pilots.

Funk, Ken↗

NASA NTRS2014

Simulation and Control Lab Development for Power and Energy Management for NASA Manned Deep Space Missions

The development of distributed hierarchical and agent-based control systems will allow for reliable autonomous energy management and power distribution for on-orbit missions. Power is one of the most critical systems on board a space vehicle, requiring quick response time when a fault or emergency is identified. As NASAs missions with human presence extend beyond low earth orbit autonomous control of vehicle power systems will be necessary and will need to reliably function for long periods of time. In the design of autonomous electrical power control systems there is a need to dynamically simulate and verify the EPS controller functionality prior to use on-orbit. This paper presents the work at NASA Glenn Research Center in Cleveland, Ohio where the development of a controls laboratory is being completed that will be utilized to demonstrate advanced prototype EPS controllers for space, aeronautical and terrestrial applications. The control laboratory hardware, software and application of an autonomous controller for demonstration with the ISS electrical power system is the subject of this paper.

Space Flight↗

NASA NTRS2003

Mobile Agents: A Distributed Voice-Commanded Sensory and Robotic System for Surface EVA Assistance

A model-based, distributed architecture integrates diverse components in a system designed for lunar and planetary surface operations: spacesuit biosensors, cameras, GPS, and a robotic assistant. The system transmits data and assists communication between the extra-vehicular activity (EVA) astronauts, the crew in a local habitat, and a remote mission support team. Software processes ("agents"), implemented in a system called Brahms, run on multiple, mobile platforms, including the spacesuit backpacks, all-terrain vehicles, and robot. These "mobile agents" interpret and transform available data to help people and robotic systems coordinate their actions to make operations more safe and efficient. Different types of agents relate platforms to each other ("proxy agents"), devices to software ("comm agents"), and people to the system ("personal agents"). A state-of-the-art spoken dialogue interface enables people to communicate with their personal agents, supporting a speech-driven navigation and scheduling tool, field observation record, and rover command system. An important aspect of the engineering methodology involves first simulating the entire hardware and software system in Brahms, and then configuring the agents into a runtime system. Design of mobile agent functionality has been based on ethnographic observation of scientists working in Mars analog settings in the High Canadian Arctic on Devon Island and the southeast Utah desert. The Mobile Agents system is developed iteratively in the context of use, with people doing authentic work. This paper provides a brief introduction to the architecture and emphasizes the method of empirical requirements analysis, through which observation, modeling, design, and testing are integrated in simulated EVA operations.

Clancey, William J.↗

NASA NTRS1973

Evaluation of proposed Skylab and SSP soap products.

Four candidate cleansing agents evaluated in terms of potential hazards to crew members included two soaps (Neutrogena bar soap and Olive Leaf Liquid), one nonfoaming surfactant (Miranol JEM), and one laundry detergent (sodium dodecylbenzene sulfonate). None of the four exhibited adverse dermatological effects from skin patch tests or supported growth of potentially pathogenic microorganisms. Aqueous solutions of Neutrogena did support a mold species. Neutrogena and Miranol JEM were used in a simulated Skylab personal hygiene regimen with no adverse effects on skin or skin microflora. Based on our results, each of these agents appear to be a promising candidate material for the use intended.

Durfee, R. L.↗

NASA NTRS2001

Adjustable Autonomy Testbed

The Adjustable Autonomy Testbed (AAT) is a simulation-based testbed located in the Intelligent Systems Laboratory in the Automation, Robotics and Simulation Division at NASA Johnson Space Center. The purpose of the testbed is to support evaluation and validation of prototypes of adjustable autonomous agent software for control and fault management for complex systems. The AA T project has developed prototype adjustable autonomous agent software and human interfaces for cooperative fault management. This software builds on current autonomous agent technology by altering the architecture, components and interfaces for effective teamwork between autonomous systems and human experts. Autonomous agents include a planner, flexible executive, low level control and deductive model-based fault isolation. Adjustable autonomy is intended to increase the flexibility and effectiveness of fault management with an autonomous system. The test domain for this work is control of advanced life support systems for habitats for planetary exploration. The CONFIG hybrid discrete event simulation environment provides flexible and dynamically reconfigurable models of the behavior of components and fluids in the life support systems. Both discrete event and continuous (discrete time) simulation are supported, and flows and pressures are computed globally. This provides fast dynamic simulations of interacting hardware systems in closed loops that can be reconfigured during operations scenarios, producing complex cascading effects of operations and failures. Current object-oriented model libraries support modeling of fluid systems, and models have been developed of physico-chemical and biological subsystems for processing advanced life support gases. In FY01, water recovery system models will be developed.

Malin, Jane T.↗

NASA NTRS1990

Pharmacokinetics and Pharmacodynamics in Space

The Pharmacokinetics and Pharmacodynamics Panel met on 29-30 Aug. 1988 at the Lunar and Planetary Institute in Houston, Texas to discuss pharmacokinetic and pharmacodynamic implications of space flight and make recommendations for operational and research strategies. Based on the knowledge available on the physiological changes that occur during space flight, the dependence of pharmacokinetics on physiological factors, and the therapeutic requirements for future space missions, the panel made several recommendations for research. It was suggested that using medications available with a large (wide) therapeutic window will avoid unforeseen therapeutic consequences during flight. The sequence for conducting research was outlined as follows: (1) identify ground-based simulation models (e.g., antiorthostatic bed rest) for conducting pharmacokinetic and pharmacodynamic research; (2) estimate parametric changes in these models using pharmacologic agents that have different pharmacokinetic characteristics and a narrow therapeutic index; (3) verify these findings during flight; and (4) develop and identify appropriate and effective drug delivery systems, dosage forms, and regimens. The panel recommended gaining a thorough understanding of the pharmacokinetic deviations of medications that have a narrow therapeutic index (e.g. cardiovascular drugs and sedative hypnotics) in order to ensure safe and effective treatment during flight with these agents. It was also suggested that basic information on physiological factors such as organ blood flow, protein composition and binding, tissue distribution, and metabolism by hepatic enzymes must be accumulated by conducting ground-based animal and human studies using models of weightlessness. This information will be useful to construct and identify physiologically based pharmacokinetic models that can provide valuable information on the pharmacodynamic consequences of space flight and aid in identifying appropriate therapeutic regimens.

Putcha, Lakshmi↗

NASA NTRS2001

A component based implementation of agents and brokers for design coordination

NASA's mission design coordination has been based on expert opinion of parametric data presented in Excel or Powerpoint. Common access is required to more powerful design tools supporting performance simulation and analysis. Components provide the means for inexpensively adding the desired functionality.

agents components↗

NASA NTRS2012

A Model of Rapid Radicalization Behavior Using Agent-Based Modeling and Quorum Sensing

Understanding the dynamics of radicalization, especially rapid radicalization, has become increasingly important to US policy in the past several years. Traditionally, radicalization is considered a slow process, but recent social and political events demonstrate that the process can occur quickly. Examining this rapid process, in real time, is impossible. However, recreating an event using modeling and simulation (M&S) allows researchers to study some of the complex dynamics associated with rapid radicalization. We propose to adapt the biological mechanism of quorum sensing as a tool to explore, or possibly explain, rapid radicalization. Due to the complex nature of quorum sensing, M&S allows us to examine events that we could not otherwise examine in real time. For this study, we employ Agent Based Modeling (ABM), an M&S paradigm suited to modeling group behavior. The result of this study was the successful creation of rapid radicalization using quorum sensing. The Battle of Mogadishu was the inspiration for this model and provided the testing conditions used to explore quorum sensing and the ideas behind rapid radicalization. The final product has wider applicability however, using quorum sensing as a possible tool for examining other catalytic rapid radicalization events.

Schwartz, Noah↗

NASA NTRS2009

Complexity Science Applications to Dynamic Trajectory Management: Research Strategies

The promise of the Next Generation Air Transportation System (NextGen) is strongly tied to the concept of trajectory-based operations in the national airspace system. Existing efforts to develop trajectory management concepts are largely focused on individual trajectories, optimized independently, then de-conflicted among each other, and individually re-optimized, as possible. The benefits in capacity, fuel, and time are valuable, though perhaps could be greater through alternative strategies. The concept of agent-based trajectories offers a strategy for automation of simultaneous multiple trajectory management. The anticipated result of the strategy would be dynamic management of multiple trajectories with interacting and interdependent outcomes that satisfy multiple, conflicting constraints. These constraints would include the business case for operators, the capacity case for the Air Navigation Service Provider (ANSP), and the environmental case for noise and emissions. The benefits in capacity, fuel, and time might be improved over those possible under individual trajectory management approaches. The proposed approach relies on computational agent-based modeling (ABM), combinatorial mathematics, as well as application of "traffic physics" concepts to the challenge, and modeling and simulation capabilities. The proposed strategy could support transforming air traffic control from managing individual aircraft behaviors to managing systemic behavior of air traffic in the NAS. A system built on the approach could provide the ability to know when regions of airspace approach being "full," that is, having non-viable local solution space for optimizing trajectories in advance.

Sawhill, Bruce↗

NASA NTRSDate not supplied

A Framework for Sense and Follow Convoys for Collective Autonomous Mobility

Convoys are collections of vehicles that share similar velocity profiles. In the sense-and follow convoy construct, a vehicle can follow a member of an existing convoy resulting in convoy chaining. We prove conditions under which this can occur such that the resulting convoy chain is bounded and the velocities of all members converge to the leader velocity through locally distributed control algorithms. To assess the approach, we utilize a six degree-of-freedom rigid body vehicle dynamics model for each agent. A dynamic inversion based control law is used to track the desired trajectory generated by the convoy algorithms. To simulate the system, we utilize Unity, a cross-platform game engine, where 3-dimensional terrain, building, and vehicle data can be visualized. Numerous simulations are presented to illustrate the concept.

convoys↗

NASA NTRSDate not supplied

A Framework for Sense and Follow Convoys for Collective Autonomous Mobility

convoys↗

NASA NTRS2020

Detection and Mitigation of Transient Instabilities in Multi-Agent Systems and Swarms

We first introduce the novel concept of transient instabilities in multi-agent systems and swarms, i.e., a small disturbance leads to increasing-amplitude oscillations throughout the swarm, which results in a large number of inter-agent collisions. This instability is dominant in the transient phase of the system and it does not appear in the steady-state behavior of the system, as each agent uses Lyapunov-stable feedback control laws. We present a rigorous definition of transient instability in swarms, and discuss its key properties. We also present a sufficient condition to check if a swarm will be transient stable. We study the behaviour of different control laws under this condition. We also show how transient instability phenomenon could impact the dynamics of deployable structures. Next, we present a novel control architecture that augments the baseline formation maintenance controller to mitigate transient instabilities. At its heart, the proposed architecture consists of a projection operator based estimator disguised as a reference model that generates collision-free trajectories for the agents to follow. We present numerical simulation results to demonstrate the effectiveness of our proposed approaches.

Quadrelli, Marco B.↗

NASA NTRS2004

Applications for Mission Operations Using Multi-agent Model-based Instructional Systems with Virtual Environments

This viewgraph presentation provides an overview of past and possible future applications for artifical intelligence (AI) in astronaut instruction and training. AI systems have been used in training simulation for the Hubble Space Telescope repair, the International Space Station, and operations simulation for the Mars Exploration Rovers. In the future, robots such as may work as partners with astronauts on missions such as planetary exploration and extravehicular activities.

Clancey, William J.↗