Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

A mesoscopic link-transmission-model able to track individual vehicles

Macroscopic traffic flow is a common choice for large-scale traffic simulations. These models do not provide individual-specific metrics as outputs. However, this treatment is necessary in agent-based-models, as in, for example, assigning routes based on personal characteristics. Here, in this paper, we propose an extension of the link-transmission-model, an efficient and yet accurate discretization of the Lighthill-Whitham-Richards (LWR) model, which allow vehicles to be tracked individually while keeping the main features of the underlying model. The extension comprises modifying the link and node models to ensure that the flow between links is always at discrete levels. Therefore, every unit of flow is associated with one individual vehicle moving from its current to its next link. An upper bound of the discretization error is provided. We show that the proposed model resembles its continuous counterpart on lane drop, merge, and diverge cases. In addition, we apply the model into three different networks to validate its applicability in large networks. Finally, we also confirm the parameter transferability between continuous and discrete models and that both can well reproduce field data.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Zooming in on virtual commutes: Telecommuting impacts on mobility and sustainability

Motivated by a societal shift towards remote work and rapid advancement in information and communication technologies, this study examines the impact of telecommuting on urban mobility across the nine counties of the San Francisco Bay Area, California. Utilizing a behaviorally realistic integrated agent-based transportation model and recent data on telecommuting patterns, we simulate the impact of multiple telecommuting scenarios on transportation system outcomes. This provides a comprehensive picture of the impact of remote work on travel costs and accessibility of all travelers, factoring in changes in mode use and congestion. We analyze how telecommuting influences broader societal factors such as transportation energy consumption. Our findings indicate that increased telecommuting reduces overall person miles traveled and transportation energy consumption. Furthermore, telecommuting results in externality benefits by improving accessibility and reducing commute times for non-telecommuters.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Development of Complexity Science and Technology Tools for NextGen Airspace Research and Applications

The objective of this research by NextGen AeroSciences, LLC is twofold: 1) to deliver an initial "toolbox" of algorithms, agent-based structures, and method descriptions for introducing trajectory agency as a methodology for simulating and analyzing airspace states, including bulk properties of large numbers of heterogeneous 4D aircraft trajectories in a test airspace -- while maintaining or increasing system safety; and 2) to use these tools in a test airspace to identify possible phase transition structure to predict when an airspace will approach the limits of its capacity. These 4D trajectories continuously replan their paths in the presence of noise and uncertainty while optimizing performance measures and performing conflict detection and resolution. In this approach, trajectories are represented as extended objects endowed with pseudopotential, maintaining time and fuel-efficient paths by bending just enough to accommodate separation while remaining inside of performance envelopes. This trajectory-centric approach differs from previous aircraft-centric distributed approaches to deconfliction. The results of this project are the following: 1) we delivered a toolbox of algorithms, agent-based structures and method descriptions as pseudocode; and 2) we corroborated the existence of phase transition structure in simulation with the addition of "early warning" detected prior to "full" airspace. This research suggests that airspace "fullness" can be anticipated and remedied before the airspace becomes unsafe.

Holmes, Bruce J.↗

Atomic resolution tracking of nerve-agent simulant decomposition and host metal–organic framework response in real space

Gas capture and sequestration are valuable properties of metal–organic frameworks (MOFs) driving tremendous interest in their use as filtration materials for chemical warfare agents. Recently, the Zr-based MOF UiO-67 was shown to effectively adsorb and decompose the nerve-agent simulant, dimethyl methylphosphonate (DMMP). Understanding mechanisms of MOF-agent interaction is challenging due to the need to distinguish between the roles of the MOF framework and its particular sites for the activation and sequestration process. Here, we demonstrate the quantitative tracking of both framework and binding component structures using in situ X-ray total scattering measurements of UiO-67 under DMMP exposure, pair distribution function analysis, and theoretical calculations. The sorption and desorption of DMMP within the pores, association with linker-deficient Zr6 cores, and decomposition to irreversibly bound methyl methylphosphonate were directly observed and analyzed with atomic resolution.

36 MATERIALS SCIENCE↗

An Agent-Based Model for Analyzing Control Policies and the Dynamic Service-Time Performance of a Capacity-Constrained Air Traffic Management Facility

Simple agent-based models may be useful for investigating air traffic control strategies as a precursory screening for more costly, higher fidelity simulation. Of concern is the ability of the models to capture the essence of the system and provide insight into system behavior in a timely manner and without breaking the bank. The method is put to the test with the development of a model to address situations where capacity is overburdened and potential for propagation of the resultant delay though later flights is possible via flight dependencies. The resultant model includes primitive representations of principal air traffic system attributes, namely system capacity, demand, airline schedules and strategy, and aircraft capability. It affords a venue to explore their interdependence in a time-dependent, dynamic system simulation. The scope of the research question and the carefully-chosen modeling fidelity did allow for the development of an agent-based model in short order. The model predicted non-linear behavior given certain initial conditions and system control strategies. Additionally, a combination of the model and dimensionless techniques borrowed from fluid systems was demonstrated that can predict the system s dynamic behavior across a wide range of parametric settings.

Conway, Sheila R.↗

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained offline using a historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery. Case studies demonstrated that the proposed method outperforms other policies with static operating reserves.

distribution system↗

Tonal Emergence: An agent-based model of tonal coordination

Humans have a remarkable capacity for coordination. Our ability to interact and act jointly in groups is crucial to our success as a species. Joint Action (JA) research has often concerned itself with simplistic behaviors in highly constrained laboratory tasks. But there has been a growing interest in understanding complex coordination in more open-ended contexts. In this regard, collective music improvisation has emerged as a fascinating model domain for studying basic JA mechanisms in an unconstrained and highly sophisticated setting. A number of empirical studies have begun to elucidate coordination mechanisms underlying joint musical improvisation, but these empirical findings have yet to be cached out in a working computational model. The present work fills this gap by presenting TonalEmergence, an idealized agent-based model of improvised musical coordination. TonalEmergence models the coordination of notes played by improvisers to generate harmony (i.e., tonality), by simulating agents that stochastically generate notes biased towards maximizing harmonic consonance given their partner’s previous notes. Here, the model replicates an interesting empirical result from a previous study of professional jazz pianists: feedback loops of mutual adaptation between interacting agents support the production of consonant harmony. The model is further explored to show how complex tonal dynamics, such as the production and dissolution of stable tonal centers, are supported by agents that are characterized by (i) a tendency to strive toward consonance, (ii) stochasticity, and (iii) a limited memory for previously played notes. TonalEmergence thus provides a grounded computational model to simulate and probe the coordination mechanisms underpinning one of the more remarkable feats of human cognition: collective music improvisation.

60 APPLIED LIFE SCIENCES↗

Inertial Transfer: Concept and Multi-Agent Approach

Research and development of cost saving technologies is vital to the success of NASA’s strategic goal to extend human presence deeper into space and to the moon for sustainable long-term exploration and utilization. Reduction of mass has long been a method of reducing space mission costs. In this submission, Inertial Transfer, a new approach to mass transfer in space, is presented. A Multi-Agent System solution to the problem space is discussed. A scaled base-line simulator is constructed and demonstrated which will enable the development of AI capabilities necessary to perform Inertial Transfer. Finally, future work and key challenges are discussed.

Multi-Agent↗

Brahms Mobile Agents: Architecture and Field Tests

We have developed a model-based, distributed architecture that integrates diverse components in a system designed for lunar and planetary surface operations: an astronaut's space suit, cameras, rover/All-Terrain Vehicle (ATV), robotic assistant, other personnel in a local habitat, and a remote mission support team (with time delay). Software processes, called agents, implemented in the Brahms language, run on multiple, mobile platforms. These mobile agents interpret and transform available data to help people and robotic systems coordinate their actions to make operations more safe and efficient. The Brahms-based mobile agent architecture (MAA) uses a novel combination of agent types so the software agents may understand and facilitate communications between people and between system components. A state-of-the-art spoken dialogue interface is integrated with Brahms models, supporting a speech-driven field observation record and rover command system (e.g., return here later and bring this back to the habitat ). This combination of agents, rover, and model-based spoken dialogue interface constitutes a personal assistant. An important aspect of the methodology involves first simulating the entire system in Brahms, then configuring the agents into a run-time system.

Clancey, William J.↗

Consensus Weighting of a Multi-Agent System for Load Shedding

An agent-based scheme is proposed for distributed underfrequency load shedding (UFLS). The key concept is a consensus weighting protocol (CWP) for agents to reach an agreement. Unlike the well adopted average-consensus protocol (ACP), the proposed CWP enables each agent to converge to its weighted portion of the sum of all initial values. Thus, the proposed CWP is more suitable for the UFLS application, as it allows load buses with a higher level of loading to shed more, rather than reducing by the same average value over all load buses as required by the ACP. Proof of convergence for the proposed CWP is derived and presented in this paper, together with the constraints. For implementation of the multi-agent system (MAS), the monitoring, estimation, and distribution steps are developed. Two study cases and the simulation results are provided to validate the performance of the proposed agent-based UFLS scheme.

Xie, Jing↗

CASTLE: Conflict Analysis Strategy Testing Laboratory Environment v.1.0.0

SAND2024-01743O The Conflict Analysis Strategy Testing Laboratory Environment (CASTLE) is a software framework that enables and simplifies building a novel, turn-based strategy game in which it can define its own rules, maps, pieces, and interactions. The software is for novice to experienced programmers with some knowledge of Unity3D, a tool used in game production. CASTLE includes a library of common game mechanics used for strategic wargames and traditional board games, such as cards, tokens, dice, and grid maps. It follows design principles popularized by the video game industry and uses singletons for managing portions of the code. CASTLE builds on Unity's component-based design and can respond to engine events during execution. Among the numerous user-friendly features: Build games quickly and cost-effectively Network in real-time and apply data to new games developed on the framework Host multiple participants online Connect rule- or machine learning-based agents to a CASTLE game to serve as opponents or to simulate games Collect data collection from players and in-game behaviors Create a survey to gather demographics or opinions from players Store data locally or save it to an external database through Representational State Transfer (REST) functions CASTLE, which was prototyped using Microsoft Azure, is also designed for easily distributing online games using popular cloud services. The multiplayer functionality includes an agent interface, allowing developers to construct AI players that can substitute for humans in any of the games. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Fabian, Nathan↗

Exploring the Effects of Node Topology, Connectivity, and Metal Identity on the Binding of Nerve Agents and Their Hydrolysis Products in Metal–Organic Frameworks

Recent studies have shown that metal–organic frameworks (MOFs) built from hexanuclear M(IV) oxide cluster nodes are effective catalysts for nerve agent hydrolysis, where the properties of the active sites on the nodes can strongly influence the reaction energetics. The connectivity and metal identity of these M6 nodes can be easily tuned, offering extensive opportunities for computational screening to predict promising new materials. Thus, we used density functional theory (DFT) to examine the effects of node topology, connectivity, and metal identity on the binding energies of multiple nerve agents and their corresponding hydrolysis products. By computing an optimization metric based on the relative binding strengths of key hydrolysis reaction species (water, agent, and bidentate-bound products), we predicted optimal M6 nodes for hydrolyzing specific nerve agent and simulant molecules, where our results are in qualitative agreement with observed experimental trends. This analysis highlighted the notion that no single metal or node topology is optimal for all possible organophosphates, suggesting that MOFs should be selected based on the agent of interest. Using the large amount of data generated from our DFT calculations, we then derived quantitative structure–activity relationship (QSAR) models to help explain the complex trends observed in the binding energies. Through linear regression, we identified the most important descriptors for describing the binding of nerve agents and their hydrolysis products to M6 nodes. These results suggested that both molecular and node properties, including both structural and chemical features, collectively contribute to the binding energetics. By performing a thorough statistical analysis, we showed that our QSAR models are capable of making quantitatively accurate binding energy predictions for nerve agents and their hydrolysis products in a wide variety of M(IV)-MOFs. In conclusion, the insights gained herein can be used to guide future experiments for the synthesis of MOFs with enhanced catalytic activity for organophosphate hydrolysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Distributed Detection of Malicious Attacks on Consensus Algorithms with Applications in Power Networks

Consensus-based distributed algorithms are well suited for coordination among agents in a cyber-physical system. These distributed schemes, however, suffer from their vulnerability to cyber attacks that are aimed at manipulating data and control ow. In this article, we present a novel distributed method for detecting the presence of such intrusions for a distributed multi-agent system following ratio consensus. We employ a Max-Min protocol to develop low cost, easy to implement detection strategies where each participating node detects the intrusion independently, eliminating the need for a trusted certifying agent in the network. The effectiveness of the detection method is demonstrated by numerical simulations on a 1000 node network to demonstrate the efficacy and simplicity of implementation.

27 ARPA - Advanced Research Projects Agency-Energy↗

Molecular-Level Insights into the NMR Relaxivity of Gadobutrol Using Quantum and Classical Molecular Simulations

MRI is an indispensable diagnostic tool in modern medicine; however, understanding the molecular-level processes governing NMR relaxation of water in the presence of MRI contrast agents remains a challenge, hindering the molecular-guided development of more effective contrast agents. By using quantum-based polarizable force fields, the first-of-its-kind molecular dynamics (MD) simulations of Gadobutrol are reported where the 1 H NMR longitudinal relaxivity r 1 of the aqueous phase is determined without any adjustable parameters. The MD simulations of r 1 dispersion (i.e., frequency dependence) show good agreement with measurements at frequencies of interest in clinical MRI. Importantly, the simulations reveal key insights into the molecular level processes leading to r 1 dispersion by decomposing the NMR dipole–dipole autocorrelation function G(t) into a discrete set of molecular modes, analogous to the eigenmodes of a quantum harmonic oscillator. The molecular modes reveal important aspects of the underlying mechanisms governing r 1 , such as its multiexponential nature and the importance of the second eigenmodal decay. By simply analyzing the MD trajectories on a parameter-free approach, the Gadobutrol simulations show that the outer-shell water contributes ∼50% of the total relaxivity r 1 compared to the inner-shell water, in contrast to simulations of (nonchelated) gadolinium-aqua where the outer shell contributes only ∼15% of r 1 . The deviation between simulations and measurements of r 1 below clinical MRI frequencies is used to determine the low-frequency electron-spin relaxation time for Gadobutrol, in good agreement with independent studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A 3D Simulation Platform for Decentralized Decision-Making in Advanced Air Mobility

This paper presents a general purpose, plug-and-play simulation platform for the use of future aviation stakeholders, such as urban airspace planners, air vehicle operators, ground operation managers, air traffic controllers and aviation researchers. The presented simulator platform is envisioned to serve as a toolkit to visualize, evaluate, and configure future advanced air mobility (AAM) operations. Highlighting features of this toolkit include a modular architecture that allows multiple smart unmanned aerial systems (UASs) to remotely connect to the simulation server and participate in decentralized decision-making scenario simulations. As an example of the decentralized decision-making scenario, an inter-agent negotiation-based conflict resolution use case is considered in this paper, where the UASs leverage the on-board/on-the-edge artificial intelligence (AI) capability to continually build situational awareness, and use this information to predict future conflicts and resolve them through machine-to-machine negotiation. As such operations are non-existent at scale currently, the presented simulation platform offers a viable and cost-effective alternative for assessing the efficacy of AAM research outcomes and challenges in future shared airspace usage. The simulation platform allows plug-n-play connectivity with AI and non-AI compute modules representing individual UAS’s flight control. Each module can interact with the simulation platform independently to communicate current and desired future states, situational awareness, and conflict resolution utilization costs for inter-agent negotiation. The simulation environment orchestrates realistic operational scenarios with spatiotemporal details, dynamic events, tactical conflict-resolution methods, interfaces for customizing air traffic control parameters, and information exchange uncertainties. In the future, this can serve as a community focused cloud simulation platform, incorporating multi-stakeholder airspace constraints from regulatory, government, city, and local agencies.

Aditya N Das↗

A 3D Simulation Platform for Decentralized Decision-Making in Advanced Air Mobility

This paper presents a general purpose, plug-and-play simulation platform for the use of future aviation stakeholders, such as urban airspace planners, air vehicle operators, ground operation managers, air traffic controllers and aviation researchers. The presented simulator platform is envisioned to serve as a toolkit to visualize, evaluate, and configure future advanced air mobility (AAM) operations. Highlighting features of this toolkit include a modular architecture that allows multiple smart unmanned aerial systems (UASs) to remotely connect to the simulation server and participate in decentralized decision-making scenario simulations. As an example of the decentralized decision-making scenario, an inter-agent negotiation-based conflict resolution use case is considered in this paper, where the UASs leverage the on-board/on-the-edge artificial intelligence (AI) capability to continually build situational awareness, and use this information to predict future conflicts and resolve them through machine-to-machine negotiation. As such operations are non-existent at scale currently, the presented simulation platform offers a viable and cost-effective alternative for assessing the efficacy of AAM research outcomes and challenges in future shared airspace usage. The simulation platform allows plug-n-play connectivity with AI and non-AI compute modules representing individual UAS’s flight control. Each module can interact with the simulation platform independently to communicate current and desired future states, situational awareness, and conflict resolution utilization costs for inter-agent negotiation. The simulation environment orchestrates realistic operational scenarios with spatiotemporal details, dynamic events, tactical conflict-resolution methods, interfaces for customizing air traffic control parameters, and information exchange uncertainties. In the future, this can serve as a community focused cloud simulation platform, incorporating multi-stakeholder airspace constraints from regulatory, government, city, and local agencies.

Aditya Das↗

EVI-EnSitePy (Electric Vehicle Infrastructure – Energy Estimation and Site Optimization Tool in Python) [EVI-X Modeling Suite] [SWR-25-07]

EVI-EnSitePy is a comprehensive agent-based tool designed for the analysis and design of high-power charging sites, encompassing a wide array of site agents including Electric Vehicles (EVs), chargers, energy storage units (ESS), renewable energy resources (DER), and loads. This versatile tool offers diverse functionalities and a modular modeling approach, allowing detailed configuration of agents based on power ratings, port numbers, energy capacities, demand requirements, charger interfaces, and flexibility to customize the tool for project specific goals. By simulating agent interactions and employing various metrics, EVI-EnSitePy enables the assessment of site performance, exploration of energy management systems (EMS), and implementation of innovative EV charging policies. Utilizing EV charge schedules and arrival states, the tool performs thorough charging site simulations, with outputs consisting of agent and site-level power profiles and statistical metrics. Employing a tree graph structure, EVI-EnSitePy supports nested site structures and power distribution modeling. The tool's ability to generate charging schedules deterministically or via stochastic analysis further enhances its versatility. Through its features and capabilities, EVI-EnSitePy offers a powerful platform for informed decision-making in the realm of high-power charging site design and operation.

Jackson, Derek [National Renewable Energy Laborato↗