SEARCH · Engineering Papers

Results for “agent based simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Computational methods in solution-based plastics purification

Plastic waste can be recycled into resins with near-virgin properties by solution-based purification processes that selectively dissolve polymers, remove contaminants, or detach printing residues. Here, in this review, we examine computational methods for predicting the behavior governing solution-based plastic purification, motivated by the vast polymer–solvent–contaminant compositional space. We discuss thermodynamic and machine learning methods for predicting polymer–solvent and polymer–contaminant interaction and review physics-based molecular dynamics simulations that resolve molecular-scale phenomena within polymer matrices inaccessible to screening methods. We highlight how these methods have informed experimental design for dissolution-based recycling and solvent-based contaminant removal. Finally, we discuss the prospective role of agentic AI in integrating these computational tools with real-time sorting data to adapt purification conditions to the compositional variability of real post-consumer feedstocks. This review charts a path toward computationally guided solution-based purification workflows that can respond to the complexity inherent in plastic waste streams.

Altamimi, Ali [Univ. of Wisconsin, Madison, WI (Un↗

DOE OSTI2026

Data for Filling the Cellulosic Bio-economy Gap by Utilizing a Wedge Approach Combined with Stakeholder Collaboration

The price gap between the market and breakeven prices of cellulosic biomass for farmers represents a significant barrier to the development of a low-carbon cellulosic bioeconomy. Using a bottom-up, agent-based modeling tool that replicates the behaviors and interactions of key stakeholders, this study analyzes the emergence of a cellulosic bioeconomy at the local scale through a wedge approach that examines an integrated portfolio of multiple policy options, including subsidies for small-scale bioproducts and environmental credits. The role of collaboration among multiple stakeholders, such as biomass producers (farmers), bio-refinery industry, government, and society, is assessed for filling the price gap. Using the Sangamon River Basin as a case study site, we evaluate the effectiveness of the wedge approach by comparing simulation results from multiple scenarios, each incorporating different combinations of bioeconomy wedges, with and without stakeholder collaboration. Results underscore that active collaboration among stakeholders acts as a catalyst enlarging the effectiveness of bioeconomy wedges. Including the carbon credits and environmental value in the policy portfolio is found to bridge the price gap through collective contributions from diverse stakeholders, where the cellulosic biofuel and bioproduct industry plays a pivotal role. Although this study is conducted at the local watershed scale, the methodology and findings offer valuable insights for market development in other watersheds and the potential scaling of local markets to regional and national levels.

Economics↗

DOE OSTI2022

A Framework to Analyze the Requirements of a Multiport Megawatt-Level Charging Station for Heavy-Duty Electric Vehicles

Widespread adoption of heavy-duty (HD) electric vehicles (EVs) will soon necessitate the use of megawatt (MW)-scale charging stations to charge high-capacity HD EV battery packs. Such a station design needs to anticipate possible station traffic, average and peak power demand, and charging/wait time targets to improve throughput and maximize revenue-generating operations. High-power direct current charging is an attractive candidate for MW-scale charging stations at the time of this study, but there are no precedents for such a station design for HD vehicles. We present a modeling and data analysis framework to elucidate the dependencies of a MW-scale station operation on vehicle traffic data and station design parameters and how that impacts vehicle electrification. This framework integrates an agent-based charging station model with vehicle schedules obtained through real-world vehicle telemetry data analysis to explore the station design and operation space. A case study applies this framework to a Class 8 vehicle telemetry dataset and uses Monte Carlo simulations to explore various design considerations for MW-scale charging stations and EV battery technologies. The results show a direct correlation between optimal charging station placement and major traffic corridors such as cities with ports, e.g., Los Angeles and Oakland. Corresponding parametric sweeps reveal that while good quality of service can be achieved with a mix of 1.2-megawatt and 100-kilowatt chargers, the resultant fast charging time of 35–40 min will need higher charging power to reach parity with refueling times.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2021

ADDS-EVS: An agent-based deployment decision-support system for electric vehicle services

Rapid and sustainable development of the electric vehicle (EV) industry places the requirement for the plan of EV deployment. For public EV, existing models mainly focus on the charging facility design and fail to capture the multi-modal scenarios. In this work, we develop an agent-based decision-support system for multi-modal electric transits to locate the optimal combinations of key parameters, including the fleet size, the transit schedule, the charging facility design, and the routing strategy. We demonstrate the utilities of our system by simulating public EV services deployed to serve travel needs related to a transportation hub in New York City. To support the decision of the fleet size, we summarize system-level performances including the total satisfied demand, passengers' waiting time, vehicle idling time. The spatial and temporal patterns are extracted to serve a deeper understanding of system dynamics and service quality. Finally, we investigate the interaction between the fleet size design and the routing strategy. The results suggest a necessity of integrating the operation strategies into the planning phase.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2021

Integrated Water-Power System Resilience Analysis in a Southeastern Idaho Irrigation District: Minidoka Case Study

This study investigates the joint water–power system resilience of an irrigation district in southeastern Idaho. Irrigation districts face difficulties in the delivery of water to farmers under drought conditions, during equipment failures, or unplanned infrastructure disruptions. The resilience of interconnected water and power systems can be better analyzed and understood through an integrated approach, using a model that connects the dependencies between the two halves of the system. Using a multi-agent system model capturing both water and power system components, as well as their linkages, we capture the interdependencies of these systems and highlight opportunities for improvement when faced with disruptions. Through simulation scenarios, we examine the system resilience using system performance, quantified as the percentage of met demand of the power and water system, when subjected to drought water year, an unforeseen water demand increase, power outage and dam failure. Scenario results indicate that the effects of low flow years are mostly felt in the power system; unexpected increases in water demand marginally impact irrigation system performance; dams and pumps present vulnerabilities of the system, causing substantial unmet demand during disruptions. Noting the interdependencies between the water–power system halves while leveraging an integrated simulation allows for an insightful analysis of the system impacts during disruptions.

13 HYDRO ENERGY↗

DOE OSTI2023

A Physics-Based Data-Driven Approach for Modeling of Environmental Degradation in Elastomers

Abstract Elastomers are now commonly used in a number of industries, including aerospace, structure, transportation, shipbuilding, and automotive, due to their excellent workability, formability, and flexibility. During their activity, elastomers are subjected to harsh environmental conditions, which decreases their resilience. False predictions made early in their lives can have major financial and environmental implications. Elastomers’ performance and properties, such as strength, durability, and density, are influenced by chemical changes in these materials, known as degradation, which occurs over time. This process can alter the morphology of a polymer matrix as well as cause chain scission and cross-linking, resulting in different behaviors than that of the unaged material. To demonstrate the effect of thermaloxidative aging on the mechanical behavior of elastomers, several experimental and theoretical models have been proposed. In view of the large volume of experimental data available on micro-structural evolution in the course of aging, we propose a physics-based data-driven approach to overcome the shortcomings of both phenomenological and micro-mechanical models. This work presents a novel thermodynamically consistent, multiagent machine-learned model for predicting the constitutive behavior of cross-linked elastomers during environmental aging, such as thermo-oxidative and hydrolytic aging for various states of deformation. Single mechanism degradation changes the polymer matrix over time where it is causing chain scission, reduction of cross-links, and morphology change. To capture the idealized Mullins effect and permanent set due to the effect of single aging mechanisms on nonlinear mechanical responses of elastomers, we propose a data-driven model for simulating inelastic elements in a polymer matrix. By using a sequential order reduction, we were able to reduce the 3D stress-strain tensor mapping problem to a small number of super-constrained 1D mapping problems. To systematically classify such mapping problems into a few categories, an assembly of multiple replicated conditional neural network learning agents (L-agents) is used based on our recent work. Each category is represented by a different type of agent. The effect of deformation history, aging time, and aging temperature is captured by this model. The model is validated using a broad collection of data, ranging from our experimental results to data from the literature. In addition, thermodynamic consistency and frame independence are investigated. The most significant achievements of this model are its precision, simplicity, and prediction of inelasticity under various states of deformation. The model’s accuracy and simplicity make it a good option for commercial and industrial applications. Conveniently, due to the model modular nature, it can be expanded in the future to include viscoelasticity and non-isotropic formation for better precision.

Ghaderi, Aref↗

DOE OSTI2022

Multirobot Collaborative Pursuit Target Robot by Improved MADDPG

Policy formulation is one of the main problems in multirobot systems, especially in multirobot pursuit-evasion scenarios, where both sparse rewards and random environment changes bring great difficulties to find better strategy. Existing multirobot decision-making methods mostly use environmental rewards to promote robots to complete the target task that cannot achieve good results. This paper proposes a multirobot pursuit method based on improved multiagent deep deterministic policy gradient (MADDPG), which solves the problem of sparse rewards in multirobot pursuit-evasion scenarios by combining the intrinsic reward and the external environment. The state similarity module based on the threshold constraint is as a part of the intrinsic reward signal output by the intrinsic curiosity module, which is used to balance overexploration and insufficient exploration, so that the agent can use the intrinsic reward more effectively to learn better strategies. The simulation experiment results show that the proposed method can improve the reward value of robots and the success rate of the pursuit task significantly. The intuitive change is obviously reflected in the real-time distance between the pursuer and the escapee, the pursuer using the improved algorithm for training can get closer to the escapee more quickly, and the average following distance also decreases.

Zhou, Xiao↗

DOE OSTI2022

A high-fidelity building performance simulation test bed for the development and evaluation of advanced controls

We present an open-source building performance simulation test bed, the Advanced Controls Test Bed (ACTB), that interfaces high-fidelity Spawn of EnergyPlus building models, with advanced controllers implemented in Python. Additionally, the ACTB leverages the Building Optimization Testing and Alfalfa platforms for managing simulations, providing an external clock, a representational state transfer (REST) application programming interface (API), and key performance indicators for evaluating the effectiveness of control strategies. The REST API allows the development of external controllers programmed in languages such as Python, which provides flexibility and a rich choice of scientific libraries for designing control sequences. We present three test cases based on the U.S. Department of Energy's Reference Small Office Building to demonstrate the ACTB's capabilities: (a) rule-based controls compliant with ASHRAE Guideline 36 control sequences; (b) an economic model predictive control implemented using do-mpc; and (c) a deep Q-network reinforcement learning agent implemented using OpenAI Gym.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2023

Evaluation of Distributed Power Apportioning with Net Load Management Engine in Microgrids Using Power Hardware-in-the-Loop Simulation

This article presents the performance evaluation of ratio consensus-based distributed power apportioning engine along with centralized net load management (NLM) engine that ensures viable and stable operation of an islanded microgrid. Managing net load variability in a microgrid with high penetrations of uncertain renewable generation and ever-changing load demands is a crucial need in order to ensure viable and stable operation of the microgrid. Centralized “dispatch-rule”-based and/or multi-agent-based distributed control of distributed energy resources (DERs) in microgrid are well accepted for microgrid by adapting ANSI/ISA-95-based hierarchical control architecture. In the application where microgrid network has large geographical span with multiple DERs dispersed in the network, high penetration of uncertain renewable energy resources, and ever-changing load demands, a judicious selection of techniques/solutions for managing net-load resources for maintaining viability and stability is required. With this motivation, this article proposes a novel solution to mitigate the challenges by incorporating a mixed centralized NLM engine and distributed power apportioning control of DERs and loads. A power-hardware-in-the-loop (PHIL) -based experiment is conducted with the centralized NLM engine and the distributed power apportioning engine along with two commercial inverters. The experimental results validates the efficacy of the proposed method in ensuring viability and stability of a microgrid.

hardware-in-the-loop simulation↗

DOE OSTI2022

Stochastic agent-based model for predicting turbine-scale raptor movements during updraft-subsidized directional flights

Rapid expansion of wind energy development across the world has highlighted the need to better understand turbine-caused avian mortality. The risk to golden eagles (Aquila chrysaetos) is of particular concern due to their small population size and conservation status. Golden eagles subsidize their flight in part by soaring in orographic updrafts, which can place them in conflict with wind turbines utilizing the same low-altitude wind resource. Understanding the behavior of soaring raptors in varying atmospheric conditions can therefore be relevant to predicting and mitigating their risk of collision. We present a predictive movement model that simulates individual paths of golden eagles during directional flight (such as migration) that is subsidized by orographic updraft. We modeled eagles in a 50 km by 50 km study area in Wyoming containing three wind power plants with documented golden eagle collisions with turbines. The movement model is applicable to any region where ground elevation is known at turbine scale (50 m) and wind conditions are known at facility scale (3 km). For a given set of atmospheric conditions, the model simulates movements of thousands of orographic soaring eagles to produce a density map quantifying the relative probability of eagle presence. We validated the simulated tracks with GPS telemetry data showing four directional tracks made by golden eagles transiting through the area in 2019 and 2020. For each eagle track, validation was performed using the ratio of the model-simulated eagle presence likelihood with uniform eagle presence and the presence computed using directed random-walk movements. We found that the predictive performance of the model was significantly better (likelihood ratio 1) for low-altitude movements than high-altitude movements that can involve thermal-soaring. We employed the model to produce seasonal presence maps for migrating golden eagles. We found significant turbine-level variations in eagle presence between northerly and southerly migration routes through the study area. Overall, the proposed model offers a generalizable, probabilistic, and predictive tool to assist wind energy developers, ecologists, wildlife managers, and industry consultants in estimating the potential for conflict between soaring birds and wind turbines, thereby reducing the need for site-specific data on golden eagle movements.

17 WIND ENERGY↗

DOE OSTI2022

The DOE E3SM Model Version 2: Overview of the Physical Model and Initial Model Evaluation

Abstract This work documents version two of the Department of Energy's Energy Exascale Earth System Model (E3SM). E3SMv2 is a significant evolution from its predecessor E3SMv1, resulting in a model that is nearly twice as fast and with a simulated climate that is improved in many metrics. We describe the physical climate model in its lower horizontal resolution configuration consisting of 110 km atmosphere, 165 km land, 0.5° river routing model, and an ocean and sea ice with mesh spacing varying between 60 km in the mid‐latitudes and 30 km at the equator and poles. The model performance is evaluated with Coupled Model Intercomparison Project Phase 6 Diagnosis, Evaluation, and Characterization of Klima simulations augmented with historical simulations as well as simulations to evaluate impacts of different forcing agents. The simulated climate has many realistic features of the climate system, with notable improvements in clouds and precipitation compared to E3SMv1. E3SMv1 suffered from an excessively high equilibrium climate sensitivity (ECS) of 5.3 K. In E3SMv2, ECS is reduced to 4.0 K which is now within the plausible range based on a recent World Climate Research Program assessment. However, a number of important biases remain including a weak Atlantic Meridional Overturning Circulation, deficiencies in the characteristics and spectral distribution of tropical atmospheric variability, and a significant underestimation of the observed warming in the second half of the historical period. An analysis of single‐forcing simulations indicates that correcting the historical temperature bias would require a substantial reduction in the magnitude of the aerosol‐related forcing.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Agent-Supervisor Coordination for Decentralized Event-Triggered Optimization

This letter proposes decentralized resource-aware coordination schemes for solving network optimization problems defined by objective functions that combine locally evaluable costs with network-wide coupling components. These methods are well suited for a group of supervised agents trying to solve an optimization problem under mild coordination requirements. Each agent has information on its local cost and coordinates with the network supervisor for information about the coupling term of the cost. The proposed approach is feedback-based and asynchronous by design, guarantees anytime feasibility, and ensures the asymptotic convergence of the network state to the desired optimizer. Numerical simulations on a power system example illustrate our results.

decentralized algorithms↗

DOE OSTI2024

National Modeling of Geothermal District Energy Systems with Ambient-Temperature Loops Using dGeo: Preprint

Geothermal district energy systems (DES) with ambient-temperature loops, also known as thermal energy networks, are one option for decarbonizing space heating and cooling loads. Geothermal fifth-generation DES include an "ambient" temperature thermal loop that connects heat pumps at each building with thermal balancing sources such as geothermal borehole fields. Heating and cooling are provided via a water-source heat pump at each end-user. This project seeks to analyze the nationwide potential for ambient-temperature loop districts by creating a new module within the Distributed Geothermal Market Demand Model (dGeo). dGeo is an agent-based modeling tool for distributed geothermal resources; it can investigate potential on a nationwide or statewide scale using geospatial data for all 50 states and thermal demands for existing buildings. This process allows for high-level estimates of technical and economic potential for ambient-temperature loop districts across the United States. Using GHEDesigner, a lookup table was created to size borehole fields for different thermal loads and ground conditions experienced across the country. A cost and financing structure, along with incentives, were applied. Cost estimates include costs for the distribution network, borehole field installation and operation, and circulation pump operation, while savings are calculated based on agent energy bills. This newly developed module can be used for assessing which areas of the country have the highest potential for agent benefits from ambient-temperature loop installation and assess the impact of different costing and pricing future scenarios. While the code is still under development and nationwide simulations are ongoing, initial results for two states are provided. Future work includes expanding the module to consider mixed residential and commercial districts and considering multiple costing scenarios.

ambient temperature loop↗

DOE OSTI2025

Replace Human Intelligence with Fast and Smart Geometric Reasoning and Graph Neural Network to Accelerate Next Gen ModSim Workflows

We present an agent-guided approach to CAD geometry decomposition that automates hex/hybrid meshing with graph neural networks (GNNs) to accelerate next-generation ModSim workflows. Our end-to-end pipeline (i) reduces 3D boundary-representation (B-Rep) models to a 2D chordal axis skeleton (CAT) and then to a 1D bipartite graph of surface and curve nodes, (ii) assigns per node labels as Cubit® WebCut actions, (iii) trains a multi-action GNN under supervised learning, and (iv) predicts five surface-node and three curve-node actions on out-of-distribution test geometries. Each graph node carries geometric, topological, and meshing attributes drawn from the B-Rep “skin” and CAT “skeleton,” with two-way mappings across 3D↔2D↔1D representations to maintain traceability back to 3D CAD. The supervised learning model exhibits stable convergence of the binary cross-entropy loss and achieves 98.7% accuracy on unseen lattice models. To operationalize decision-making, we rank predicted commands by geometric significance and prototyped the agent-guided workflow through the Cubit® Meshing PowerTool GUI. As a stretch goal, we explore reinforcement learning (RL) to reduce or remove label requirements and to learn policies for action sequences that maximize total reward (e.g., size of hex-meshable regions and resulting hex mesh quality). When all-hex meshing is not feasible, the agent assists in producing hybrid meshes—prioritizing hex in critical regions and transitioning to tetrahedral elements (tets) elsewhere—maintaining fidelity while ensuring robustness. The overarching objective is to replace manual, heuristics-based decomposition with data-driven, reproducible automation, cutting meshing turnaround time by orders of magnitude. We anticipate direct impact on simulation workflows through intelligent, scalable decomposition of complex CAD models into hex-meshable subdomains.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Closing the Loop between In Situ Stress Complexity and EGS Fracture Complexity

42 ENGINEERING↗

DOE OSTI2026

A Physics-Informed Reinforcement Learning Framework for Economic-Thermal Co-Optimization of Crypto Mining Data Centers: Preprint

The rapid expansion of cryptocurrency mining has created a new class of high-density data centers characterized by extreme thermal flux and high sensitivity to volatile economic markets. Traditional thermal management strategies, typically reliant on rule-based control, maintain static setpoints that fail to account for fluctuating electricity prices and cryptocurrency values - factors critical to mining profitability. To address this, we present a physics-informed reinforcement learning (PIRL) framework for economic-thermal co-optimization in crypto mining data centers. This framework consists of a proximal policy optimization (PPO) agent, a virtual testbed powered by high-fidelity physics-based models, and an interactive frontend dashboard. The PPO agent is trained using the virtual testbed and strict hardware safety limits. This physics-informed approach allows the agent to learn a stochastic policy that dynamically balances mining revenue against operational costs by co-optimizing HVAC cooling setpoints and IT computational hashrate. The simulation results demonstrate that the integrated framework achieved an 8.62% increase in net operational profit compared to traditional baseline strategies while strictly adhering to safety-critical temperature constraints (coolant supply temperature < 32 degrees C). This work provides a scalable template for the deployment of reinforcement learning in mission critical facilities where economic volatility and physical safety must be managed simultaneously.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

Capture and Decomposition of the Nerve Agent Simulant, DMCP, Using the Zeolitic Imidazolate Framework (ZIF-8)

Understanding mechanisms of decontamination of chemical warfare agents (CWA) is an area of intense research aimed at developing new filtration materials to protect soldiers and civilians in case of state-sponsored or terrorist attack. In this study, we employed complementary structural, chemical, and dynamic probes and in situ data collection, to elucidate the complex chemistry, capture, and decomposition of the CWA simulant, dimethyl chlorophosphonate (DMCP). Our work reveals key details of the reactive adsorption of DMCP and demonstrates the versatility of zeolitic imidazolate framework (ZIF-8) as a plausible material for CWA capture and decomposition. Here, the in situ synchrotron-based powder X-ray diffraction (PXRD) and pair distribution function (PDF) studies, combined with Fourier transform infrared (FT-IR) spectroscopy, X-ray photoelectron spectroscopy (XPS), zinc K-edge X-ray absorption near edge structure (XANES), and Raman spectroscopies, showed that the unique structure, chemical state, and topology of ZIF-8 enable accessibility, adsorption, and hydrolysis of DMCP into the pores and revealed the importance of linker chemistry and Zn 2+ sites for nerve agent decomposition. DMCP decontamination and decomposition product(s) formation were observed by thermogravimetric analysis, FT-IR spectroscopy, and phosphorus (P) K-edge XANES studies. Differential PDF analysis indicated that the average structure of ZIF-8 (at the 30 Å scale) remains unchanged after DMCP dosing and provided information on the dynamics of interactions of DMCP with the ZIF-8 framework. Using in situ PXRD and diffuse reflectance infrared Fourier transform spectroscopy (DRIFTS), we showed that nearly 90% regeneration of the ZIF-8 structure and complete liberation of DMCP and decomposition products occur upon heating.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2026

Decentralised Reinforcement Learning for Dynamic Cyberattack Response in Microgrid Networks

Microgrids rely on communication networks for reliable operation, which makes them inherently vulnerable to cyberattacks. Such attacks can destabilise system dynamics and drive states away from their nominal operating trajectories. Although several physics-informed and machine learning-based strategies have been developed to counter these threats, the rapidly evolving cyber landscape enables adversaries to bypass static defences or rules-based mitigation approaches. This paper proposes a dynamic, online-trained and fully decentralised reinforcement learning (RL)-based cyberattack response framework to protect microgrids from evolving cyberattacks. The proposed framework deploys multiple deep Q-networks (DQNs), each associated with a distributed energy resource (DER), to enable localised and adaptive attack mitigation. In this framework, each DQN processes local voltage and frequency measurements—combined with intrusion detection system (IDS) alerts—as observations and rewards to guide decision-making. Extensive simulation studies demonstrate the robustness of the proposed framework under diverse attack scenarios and varying IDS-induced detection delays. Comparative analysis highlights its superiority over existing static or preexisting rules-based mitigation approaches. Finally, we present an analysis that shows the framework's scalability to real-life microgrids with more interacting agents.

24 POWER TRANSMISSION AND DISTRIBUTION↗