Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Signal Whisperers: Enhancing Wireless Reception Using DRL-Guided Reflector Arrays

This paper presents a multi-agent reinforcement learning (MARL) approach for controlling adjustable metallic reflector arrays to enhance wireless signal reception in non-line-of-sight (NLOS) scenarios. Unlike conventional reconfigurable intelligent surfaces (RIS) that require complex channel estimation, our system employs a centralized training with decentralized execution (CTDE) paradigm where individual agents corresponding to reflector segments autonomously optimize reflector element orientation in three-dimensional space using spatial intelligence based on user location information. Through extensive ray-tracing simulations with dynamic user mobility, the proposed multi-agent beam-focusing framework demonstrates substantial performance improvements over single-agent reinforcement learning baselines, while maintaining rapid adaptation to user movement within one simulation step. Comprehensive evaluation across varying user densities and reflector configurations validates system scalability and robustness. The results demonstrate the potential of learning-based approaches for adaptive wireless propagation control.

deep reinforcement learning↗
DOE OSTI2021

Characterizing Binding Interactions That Are Essential for Selective Transport through the Nuclear Pore Complex

Specific macromolecules are rapidly transported across the nuclear envelope via the nuclear pore complex (NPC). The selective transport process is facilitated when nuclear transport receptors (NTRs) weakly and transiently bind to intrinsically disordered constituents of the NPC, FG Nups. These two types of proteins help maintain the selective NPC barrier. To interrogate their binding interactions in vitro, we deployed an NPC barrier mimic. We created the stationary phase by covalently attaching fragments of a yeast FG Nup called Nsp1 to glass coverslips. We used a tunable mobile phase containing NTR, nuclear transport factor 2 (NTF2). In the stationary phase, three main factors affected binding: the number of FG repeats, the charge of fragments, and the fragment density. We also identified three main factors affecting binding in the mobile phase: the avidity of the NTF2 variant for Nsp1, the presence of nonspecific proteins, and the presence of additional NTRs. We used both experimentally determined binding parameters and molecular dynamics simulations of Nsp1FG fragments to create an agent-based model. The results suggest that NTF2 binding is negatively cooperative and dependent on the density of Nsp1FG molecules. Our results demonstrate the strengths of combining experimental and physical modeling approaches to study NPC-mediated transport.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Multi-Level Impacts of Extreme Climate-Related Events on Food Supply Chain: Idaho Potato's Case Study

Background: The world is experiencing frequent extreme weather events like droughts, floods, snowstorms, and shifting of seasons due to climate change. Increasing frequencies and severity of these extreme weather events threaten food security because agriculture is extremely vulnerable to climate change. Higher temperature reduces overall yields of the desirable crops but proliferates weeds and harmful pests. Current data shows that every year U.S. farmers spend more than 11 billion USD to fight weeds and this number is expected to rise in the coming years due to climate change. Due to droughts, the water required for irrigation is becoming scarcer. Since many areas are becoming climatically unusable for crop production, the amount of farmland area is shrinking rapidly. In addition, changes in precipitation patterns are causing crop failures and negatively impacting expected yields. In this study, we investigated how different extreme climate events impact different stages of a food supply chain. Approach: As a case study, we chose Idaho’s potato supply chain (SC). Idaho is the top potato producing state in the U.S. and contributes around 30% of the nation’s potato production. Using the agent-based modeling (ABM) approach, we developed a multi-echelon potato supply chain computer simulation model with six types of agents – seed producers, farmers, shippers, processors, retailers, and logistics companies. In addition to the baseline scenario, we developed two additional climate-related disruption events – drought and snowstorm. We investigated how each of these disruption events impacts different stakeholders across the supply chain in terms of revenue and some other key performance metrics such as lead time, food waste, number of delayed orders, and order fulfillment rate. Results: Extreme climate events not only impact the growers but there is also cascading ripple effects downstream of the supply chain. The methodology developed in this study could be applied to other food and agricultural SC to understand the vulnerabilities of the different links. The findings would potentially help to adopt new policies for the well-being of the overall SC.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Parking Strategies and Outcomes for Shared Autonomous Vehicle Fleet Operations

Parking spots are a premium commodity, especially in dense downtown settings, so this study examines the service impacts of shared autonomous vehicles (SAVs) parking in legal on- or off-street locations when idle across Travis County in Austin, Texas. Here, using an agent-based activity-based travel demand model with dynamic traffic simulation, two restricted-parking strategies for SAVs were simulated. SAVs either found the nearest available parking spot or the lowest-cost spot (via a tradeoff of parking fees and distance-based costs). Two comparisons were conducted to analyze the impacts of these strategies. First, two restricted parking strategies were compared, where SAVs park without competition with private human-driven vehicles (HVs) for parking locations. Second, a more realistic analysis compared two SAV parking strategies with a scenario where SAVs remain idle in place. Private HVs in all scenarios and strategies of this comparison park at the closest designated location unless they opt for private parking. Using a supply of 8,400 aggregated parking locations in Austin, this study simulated fleet performance under different trip demands, with SAV fares of $\$0.62$ per kilometer ($\$1$ per mile) plus a $\$1$ fixed pickup fee with dynamic ridesharing permitted. Parking costs were negligible in both SAV parking search strategies applied to the Austin network because of the region’s provision of mostly free parking. Requiring SAVs to park on designated on- and off-street parking locations and parking lots (restricted parking) also increased parking costs for HV drivers by up to 22% since SAVs occupied some free parking spaces, especially in the least-cost parking search strategy.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

Using mixed methods to construct and analyze a participatory agent-based model of a complex Zimbabwean agro-pastoral system

Complex social-ecological systems can be difficult to study and manage. Simulation models can facilitate exploration of system behavior under novel conditions, and participatory modeling can involve stakeholders in developing appropriate management processes. Participatory modeling already typically involves qualitative structural validation of models with stakeholders, but with increased data and more sophisticated models, quantitative behavioral validation may be possible as well. In this study, we created a novel agent-basedmodel applied to a specific context: Zimbabwean non-governmental organization the Muonde Trust has been collecting data on their agro-pastoral system for the last 35 years and had concerns about land-use planning and the effectiveness of management interventions in the face of climate change. We collaboratively created an agent-based model of their system using their data archive, qualitatively calibrating it to the observed behavior of the real system without tuning any parameters to match specific quantitative outputs. We then behaviorally validated the model using quantitative community-based data and conducted a sensitivity analysis to determine the relative impact of underlying parameter assumptions, Indigenous management interventions, and different rainfall variation scenarios. We found that our process resulted in a model which was successfully structurally validated and sufficiently realistic to be useful for Muonde researchers as a discussion tool. The model was inconsistently behaviorally validated, however, with some model variables matching field data better than others. We observed increased model system instability due to increasing variability in underlying drivers (rainfall), and also due to management interventions that broke feedbacks between the components of the system. Interventions that smoothed year-to-year variation rather than exaggerating it tended to improve sustainability. The Muonde trust has used the model to successfully advocate to local leaders for changes in land-use planning policy that will increase the sustainability of their system.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

A mesoscopic link-transmission-model able to track individual vehicles

Macroscopic traffic flow is a common choice for large-scale traffic simulations. These models do not provide individual-specific metrics as outputs. However, this treatment is necessary in agent-based-models, as in, for example, assigning routes based on personal characteristics. Here, in this paper, we propose an extension of the link-transmission-model, an efficient and yet accurate discretization of the Lighthill-Whitham-Richards (LWR) model, which allow vehicles to be tracked individually while keeping the main features of the underlying model. The extension comprises modifying the link and node models to ensure that the flow between links is always at discrete levels. Therefore, every unit of flow is associated with one individual vehicle moving from its current to its next link. An upper bound of the discretization error is provided. We show that the proposed model resembles its continuous counterpart on lane drop, merge, and diverge cases. In addition, we apply the model into three different networks to validate its applicability in large networks. Finally, we also confirm the parameter transferability between continuous and discrete models and that both can well reproduce field data.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Zooming in on virtual commutes: Telecommuting impacts on mobility and sustainability

Motivated by a societal shift towards remote work and rapid advancement in information and communication technologies, this study examines the impact of telecommuting on urban mobility across the nine counties of the San Francisco Bay Area, California. Utilizing a behaviorally realistic integrated agent-based transportation model and recent data on telecommuting patterns, we simulate the impact of multiple telecommuting scenarios on transportation system outcomes. This provides a comprehensive picture of the impact of remote work on travel costs and accessibility of all travelers, factoring in changes in mode use and congestion. We analyze how telecommuting influences broader societal factors such as transportation energy consumption. Our findings indicate that increased telecommuting reduces overall person miles traveled and transportation energy consumption. Furthermore, telecommuting results in externality benefits by improving accessibility and reducing commute times for non-telecommuters.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Atomic resolution tracking of nerve-agent simulant decomposition and host metal–organic framework response in real space

Gas capture and sequestration are valuable properties of metal–organic frameworks (MOFs) driving tremendous interest in their use as filtration materials for chemical warfare agents. Recently, the Zr-based MOF UiO-67 was shown to effectively adsorb and decompose the nerve-agent simulant, dimethyl methylphosphonate (DMMP). Understanding mechanisms of MOF-agent interaction is challenging due to the need to distinguish between the roles of the MOF framework and its particular sites for the activation and sequestration process. Here, we demonstrate the quantitative tracking of both framework and binding component structures using in situ X-ray total scattering measurements of UiO-67 under DMMP exposure, pair distribution function analysis, and theoretical calculations. The sorption and desorption of DMMP within the pores, association with linker-deficient Zr6 cores, and decomposition to irreversibly bound methyl methylphosphonate were directly observed and analyzed with atomic resolution.

36 MATERIALS SCIENCE↗
DOE OSTI2022

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained offline using a historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery. Case studies demonstrated that the proposed method outperforms other policies with static operating reserves.

distribution system↗
DOE OSTI2021

Tonal Emergence: An agent-based model of tonal coordination

Humans have a remarkable capacity for coordination. Our ability to interact and act jointly in groups is crucial to our success as a species. Joint Action (JA) research has often concerned itself with simplistic behaviors in highly constrained laboratory tasks. But there has been a growing interest in understanding complex coordination in more open-ended contexts. In this regard, collective music improvisation has emerged as a fascinating model domain for studying basic JA mechanisms in an unconstrained and highly sophisticated setting. A number of empirical studies have begun to elucidate coordination mechanisms underlying joint musical improvisation, but these empirical findings have yet to be cached out in a working computational model. The present work fills this gap by presenting TonalEmergence, an idealized agent-based model of improvised musical coordination. TonalEmergence models the coordination of notes played by improvisers to generate harmony (i.e., tonality), by simulating agents that stochastically generate notes biased towards maximizing harmonic consonance given their partner’s previous notes. Here, the model replicates an interesting empirical result from a previous study of professional jazz pianists: feedback loops of mutual adaptation between interacting agents support the production of consonant harmony. The model is further explored to show how complex tonal dynamics, such as the production and dissolution of stable tonal centers, are supported by agents that are characterized by (i) a tendency to strive toward consonance, (ii) stochasticity, and (iii) a limited memory for previously played notes. TonalEmergence thus provides a grounded computational model to simulate and probe the coordination mechanisms underpinning one of the more remarkable feats of human cognition: collective music improvisation.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Consensus Weighting of a Multi-Agent System for Load Shedding

An agent-based scheme is proposed for distributed underfrequency load shedding (UFLS). The key concept is a consensus weighting protocol (CWP) for agents to reach an agreement. Unlike the well adopted average-consensus protocol (ACP), the proposed CWP enables each agent to converge to its weighted portion of the sum of all initial values. Thus, the proposed CWP is more suitable for the UFLS application, as it allows load buses with a higher level of loading to shed more, rather than reducing by the same average value over all load buses as required by the ACP. Proof of convergence for the proposed CWP is derived and presented in this paper, together with the constraints. For implementation of the multi-agent system (MAS), the monitoring, estimation, and distribution steps are developed. Two study cases and the simulation results are provided to validate the performance of the proposed agent-based UFLS scheme.

Xie, Jing↗
DOE OSTI2023

CASTLE: Conflict Analysis Strategy Testing Laboratory Environment v.1.0.0

SAND2024-01743O The Conflict Analysis Strategy Testing Laboratory Environment (CASTLE) is a software framework that enables and simplifies building a novel, turn-based strategy game in which it can define its own rules, maps, pieces, and interactions. The software is for novice to experienced programmers with some knowledge of Unity3D, a tool used in game production. CASTLE includes a library of common game mechanics used for strategic wargames and traditional board games, such as cards, tokens, dice, and grid maps. It follows design principles popularized by the video game industry and uses singletons for managing portions of the code. CASTLE builds on Unity's component-based design and can respond to engine events during execution. Among the numerous user-friendly features: Build games quickly and cost-effectively Network in real-time and apply data to new games developed on the framework Host multiple participants online Connect rule- or machine learning-based agents to a CASTLE game to serve as opponents or to simulate games Collect data collection from players and in-game behaviors Create a survey to gather demographics or opinions from players Store data locally or save it to an external database through Representational State Transfer (REST) functions CASTLE, which was prototyped using Microsoft Azure, is also designed for easily distributing online games using popular cloud services. The multiplayer functionality includes an agent interface, allowing developers to construct AI players that can substitute for humans in any of the games. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Fabian, Nathan↗
DOE OSTI2020

Exploring the Effects of Node Topology, Connectivity, and Metal Identity on the Binding of Nerve Agents and Their Hydrolysis Products in Metal–Organic Frameworks

Recent studies have shown that metal–organic frameworks (MOFs) built from hexanuclear M(IV) oxide cluster nodes are effective catalysts for nerve agent hydrolysis, where the properties of the active sites on the nodes can strongly influence the reaction energetics. The connectivity and metal identity of these M6 nodes can be easily tuned, offering extensive opportunities for computational screening to predict promising new materials. Thus, we used density functional theory (DFT) to examine the effects of node topology, connectivity, and metal identity on the binding energies of multiple nerve agents and their corresponding hydrolysis products. By computing an optimization metric based on the relative binding strengths of key hydrolysis reaction species (water, agent, and bidentate-bound products), we predicted optimal M6 nodes for hydrolyzing specific nerve agent and simulant molecules, where our results are in qualitative agreement with observed experimental trends. This analysis highlighted the notion that no single metal or node topology is optimal for all possible organophosphates, suggesting that MOFs should be selected based on the agent of interest. Using the large amount of data generated from our DFT calculations, we then derived quantitative structure–activity relationship (QSAR) models to help explain the complex trends observed in the binding energies. Through linear regression, we identified the most important descriptors for describing the binding of nerve agents and their hydrolysis products to M6 nodes. These results suggested that both molecular and node properties, including both structural and chemical features, collectively contribute to the binding energetics. By performing a thorough statistical analysis, we showed that our QSAR models are capable of making quantitatively accurate binding energy predictions for nerve agents and their hydrolysis products in a wide variety of M(IV)-MOFs. In conclusion, the insights gained herein can be used to guide future experiments for the synthesis of MOFs with enhanced catalytic activity for organophosphate hydrolysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Distributed Detection of Malicious Attacks on Consensus Algorithms with Applications in Power Networks

Consensus-based distributed algorithms are well suited for coordination among agents in a cyber-physical system. These distributed schemes, however, suffer from their vulnerability to cyber attacks that are aimed at manipulating data and control ow. In this article, we present a novel distributed method for detecting the presence of such intrusions for a distributed multi-agent system following ratio consensus. We employ a Max-Min protocol to develop low cost, easy to implement detection strategies where each participating node detects the intrusion independently, eliminating the need for a trusted certifying agent in the network. The effectiveness of the detection method is demonstrated by numerical simulations on a 1000 node network to demonstrate the efficacy and simplicity of implementation.

27 ARPA - Advanced Research Projects Agency-Energy↗
DOE OSTI2025

Molecular-Level Insights into the NMR Relaxivity of Gadobutrol Using Quantum and Classical Molecular Simulations

MRI is an indispensable diagnostic tool in modern medicine; however, understanding the molecular-level processes governing NMR relaxation of water in the presence of MRI contrast agents remains a challenge, hindering the molecular-guided development of more effective contrast agents. By using quantum-based polarizable force fields, the first-of-its-kind molecular dynamics (MD) simulations of Gadobutrol are reported where the 1 H NMR longitudinal relaxivity r 1 of the aqueous phase is determined without any adjustable parameters. The MD simulations of r 1 dispersion (i.e., frequency dependence) show good agreement with measurements at frequencies of interest in clinical MRI. Importantly, the simulations reveal key insights into the molecular level processes leading to r 1 dispersion by decomposing the NMR dipole–dipole autocorrelation function G(t) into a discrete set of molecular modes, analogous to the eigenmodes of a quantum harmonic oscillator. The molecular modes reveal important aspects of the underlying mechanisms governing r 1 , such as its multiexponential nature and the importance of the second eigenmodal decay. By simply analyzing the MD trajectories on a parameter-free approach, the Gadobutrol simulations show that the outer-shell water contributes ∼50% of the total relaxivity r 1 compared to the inner-shell water, in contrast to simulations of (nonchelated) gadolinium-aqua where the outer shell contributes only ∼15% of r 1 . The deviation between simulations and measurements of r 1 below clinical MRI frequencies is used to determine the low-frequency electron-spin relaxation time for Gadobutrol, in good agreement with independent studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

EVI-EnSitePy (Electric Vehicle Infrastructure – Energy Estimation and Site Optimization Tool in Python) [EVI-X Modeling Suite] [SWR-25-07]

EVI-EnSitePy is a comprehensive agent-based tool designed for the analysis and design of high-power charging sites, encompassing a wide array of site agents including Electric Vehicles (EVs), chargers, energy storage units (ESS), renewable energy resources (DER), and loads. This versatile tool offers diverse functionalities and a modular modeling approach, allowing detailed configuration of agents based on power ratings, port numbers, energy capacities, demand requirements, charger interfaces, and flexibility to customize the tool for project specific goals. By simulating agent interactions and employing various metrics, EVI-EnSitePy enables the assessment of site performance, exploration of energy management systems (EMS), and implementation of innovative EV charging policies. Utilizing EV charge schedules and arrival states, the tool performs thorough charging site simulations, with outputs consisting of agent and site-level power profiles and statistical metrics. Employing a tree graph structure, EVI-EnSitePy supports nested site structures and power distribution modeling. The tool's ability to generate charging schedules deterministically or via stochastic analysis further enhances its versatility. Through its features and capabilities, EVI-EnSitePy offers a powerful platform for informed decision-making in the realm of high-power charging site design and operation.

Jackson, Derek [National Renewable Energy Laborato↗
DOE OSTI2022

Expanding Medicaid to Reduce Human Immunodeficiency Virus Transmission in Houston, Texas

Context: Medicaid expansion has been nationally shown to improve engagement in the human immunodeficiency virus (HIV) treatment and prevention continua, which are vital steps to stopping the HIV epidemic. New HIV infections in the United States are disproportionately concentrated among young Black men who have sex with men (YBMSM). Houston, TX, is the most populous city in the Southern United States with a racially/ethnically diverse population that is located in 1 of 11 US states that have not yet expanded Medicaid coverage as of 2021. Methods: An agent-based model that incorporated the sexual networks of YBMSM was used to simulate improved antiretroviral treatment and pre-exposure prophylaxis (PrEP) engagement through Medicaid expansion in Houston, TX. Analyses considered the HIV incidence (number of new infections and as a rate metric) among YBMSM over the next 10 years under Medicaid expansion as the primary outcome. Additional scenarios, involving viral suppression and PrEP uptake above the projected levels achieved under Medicaid expansion, were also simulated. Results: The baseline model projected an HIV incidence rate of 4.96 per 100 person years (py) and about 368 new annual HIV infections in the 10th year. Improved HIV treatment and prevention continua engagement under Medicaid expansion resulted in a 14.9% decline in the number of annual new HIV infections in the 10th year. Increasing viral suppression by an additional 15% and PrEP uptake by 30% resulted in a 44.0% decline in new HIV infections in the 10th year, and a 27.1% decline in cumulative infections across the 10 years of the simulated intervention. Findings: Simulation results indicate that Medicaid expansion has the potential to reduce HIV incidence among YBMSM in Houston. Achieving HIV elimination objectives, however, might require additional effective measures to increase antiretroviral treatment and PrEP uptake beyond the projected improvements under expanded Medicaid.

60 APPLIED LIFE SCIENCES↗