Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

The role of geography in the complex diffusion of innovations

The urban–rural divide is increasing in modern societies calling for geographical extensions of social influence modelling. Improved understanding of innovation diffusion across locations and through social connections can provide us with new insights into the spread of information, technological progress and economic development. In this work, we analyze the spatial adoption dynamics of iWiW, an Online Social Network (OSN) in Hungary and uncover empirical features about the spatial adoption in social networks. During its entire life cycle from 2002 to 2012, iWiW reached up to 300 million friendship ties of 3 million users. We find that the number of adopters as a function of town population follows a scaling law that reveals a strongly concentrated early adoption in large towns and a less concentrated late adoption. We also discover a strengthening distance decay of spread over the life-cycle indicating high fraction of distant diffusion in early stages but the dominance of local diffusion in late stages. The spreading process is modelled within the Bass diffusion framework that enables us to compare the differential equation version with an agent-based version of the model run on the empirical network. Although both model versions can capture the macro trend of adoption, they have limited capacity to describe the observed trends of urban scaling and distance decay. We find, however that incorporating adoption thresholds, defined by the fraction of social connections that adopt a technology before the individual adopts, improves the network model fit to the urban scaling of early adopters. Controlling for the threshold distribution enables us to eliminate the bias induced by local network structure on predicting local adoption peaks. Finally, we show that geographical features such as distance from the innovation origin and town size influence prediction of adoption peak at local scales in all model specifications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Utilizing grid–supportive load response to shape resilient frequency control of the power grid

The increasing penetration of renewable energy sources and the retirement of conventional generation units have decreased system inertia, making power systems more vulnerable to resilience and stability issues. To address this problem, this paper proposes a novel approach using grid-supportive loads (GSLs) to provide a fast and concise primary frequency response and a deep deterministic policy gradient agent-based secondary controller to restore the system frequency to the nominal value. The proposed method is evaluated on the single-area and multi-area test systems. The simulation results demonstrate that using GSLs enhances the power system's stability and resilience. Compared to conventional controllers, the frequency nadir is improved with GSLs. Additionally, the proposed method effectively enhances resilience even with high penetration. These findings indicate that the proposed approach can improve the resilience and stability of power systems and provide a promising solution for future power systems. The results of this study underscore the importance of utilizing innovative approaches to enhance the stability and resilience of power systems in the context of high penetration of renewable energy sources and the retirement of conventional generation.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Spatial Impacts of Electric Vehicle Charging on Power Grid Stability: A Downtown Atlanta Case Study

The rapid increase in electric vehicle (EV) charging demand poses a potential risk to power grid stability, particularly as the spatial distribution of this demand remains underexplored. Existing research often focuses on technical optimization models while overlooking the geographic and human dynamics that affect energy consumption. This study addresses this gap by incorporating mobility data to estimate both building energy use and EV charging demand while also considering geographic factors for a better understanding of grid load. Using agent-based simulations and the Open-Source Distribution System Simulator, the study evaluates the effect of various EV penetration scenarios on grid voltage and unbalance. The results show that, although voltage remains within acceptable limits at lower EV penetration rates, significant voltage drop and unbalance occur as EV penetration exceeds 40%, particularly in residential areas with high charging demand. This study offers a framework for integrating spatial analysis and mobility data in power network simulations, providing insights for future EV infrastructure planning.

Pan, Melrose [ORNL] (ORCID:000000031627448X)↗
DOE OSTI2023

Learning effective stochastic differential equations from microscopic simulations: Linking stochastic numerics to deep learning

We identify effective stochastic differential equations (SDEs) for coarse observables of fine-grained particle- or agent-based simulations; these SDEs then provide useful coarse surrogate models of the fine scale dynamics. We approximate the drift and diffusivity functions in these effective SDEs through neural networks, which can be thought of as effective stochastic ResNets. The loss function is inspired by, and embodies, the structure of established stochastic numerical integrators (here, Euler–Maruyama and Milstein); our approximations can thus benefit from backward error analysis of these underlying numerical schemes. They also lend themselves naturally to “physics-informed” gray-box identification when approximate coarse models, such as mean field equations, are available. Existing numerical integration schemes for Langevin-type equations and for stochastic partial differential equations can also be used for training; we demonstrate this on a stochastically forced oscillator and the stochastic wave equation. Our approach does not require long trajectories, works on scattered snapshot data, and is designed to naturally handle different time steps per snapshot. We consider both the case where the coarse collective observables are known in advance, as well as the case where they must be found in a data-driven manner.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Unraveling complex causal processes that affect sustainability requires more integration between empirical and modeling approaches

Scientists seek to understand the causal processes that generate sustainability problems and determine effective solutions. Yet, causal inquiry in nature–society systems is hampered by conceptual and methodological challenges that arise from nature–society interdependencies and the complex dynamics they create. Here, we demonstrate how sustainability scientists can address these challenges and make more robust causal claims through better integration between empirical analyses and process- or agent-based modeling. To illustrate how these different epistemological traditions can be integrated, we present four studies of air pollution regulation, natural resource management, and the spread of COVID-19. The studies show how integration can improve empirical estimates of causal effects, inform future research designs and data collection, enhance understanding of the complex dynamics that underlie observed temporal patterns, and elucidate causal mechanisms and the contexts in which they operate. These advances in causal understanding can help sustainability scientists develop better theories of phenomena where social and ecological processes are dynamically intertwined and prior causal knowledge and data are limited. The improved causal understanding also enhances governance by helping scientists and practitioners choose among potential interventions, decide when and how the timing of an intervention matters, and anticipate unexpected outcomes. Methodological integration, however, requires skills and efforts of all involved to learn how members of the respective other tradition think and analyze nature–society systems.

42 ENGINEERING↗
DOE OSTI2025

CHARGE-MAP: An integrated framework to study the multicriteria EV charging infrastructure expansion problem

The widespread adoption of electric vehicles (EVs) in recent years has necessitated the development of effective charging infrastructures. However, charging infrastructure expansion is a multifaceted problem that requires careful consideration of the existing infrastructure, spatiotemporal distribution of charging demands, power-grid capacity, and budget constraints. Here, to approach this complex problem, we present CHARGE-MAP, a data-driven simulation-optimization framework, focused on ensuring meaningful charging experience for individual EV owners. CHARGE-MAP integrates three modules: an agent-based simulation module that estimates spatiotemporal distribution of charging demands by modeling EV adopter mobility and charging behavior; an optimization module that determines optimal new charging station/charger locations and capacities, while minimizing expected detour distances and wait-times with a limited number of new stations; and a power module that determines how to connect the stations to the power grid while maintaining its stability. Using the state of Virginia (consisting of 95 counties and 38 independent cities) as a case study, our results show that CHARGE-MAP can meet the demand of ~198,600 predicted EVs with 1,305 new public charging stations and 2,164 new chargers. It reduces average detour distances for charging by 66% and wait-times at stations by 72% compared to the existing infrastructure. Furthermore, transformer capacity requirement analysis reveals that only 1.8% of residential transformers require upgrades, while over 80% of commercial charging locations can be supported with modest transformer infrastructure (25 to 50 kVA). This indicates that targeted investments can facilitate cost-effective EV integration. Consequently, CHARGE-MAP provides policymakers and urban planners with crucial data-driven insights for effective EV charging infrastructure expansion. Sign up for PNAS alerts.

charging infrastructure↗
DOE OSTI2026

Used Nuclear Fuel Management Using the Next Generation System Analysis Model

The U.S. Department of Energy (DOE) is leading the National effort to manage the back end of the nuclear fuel cycle, encompassing the safe transportation, storage/staging, and/or eventual disposal of used nuclear fuel (UNF) and high-level radioactive waste. The Next Generation System Analysis Model (NGSAM) is DOE’s discrete-event, agent-based simulation tool designed to model the full life cycle of UNF from reactor discharge to final disposal. NGSAM supports the DOE Office of Spent Fuel and High-Level Waste Disposition by enabling a detailed, scenario-based analysis of logistics, infrastructure, and shipping strategies. NGSAM replaces legacy models with a modern, flexible platform built on Repast Simphony and enhanced by the Process Analysis Tool. NGSAM simulates the movement and interaction of individual fuel assemblies with system components such as canisters, casks, railcars, and facilities. The model integrates with the Java Transportation Operations Model to plan and execute transportation scenarios, supporting both constrained and unconstrained resource allocation. Key features include customizable allocation and acceptance algorithms, detailed facility-level operations, and a Quick Edit tool for rapid scenario adjustments. NGSAM supports multimodal transportation modeling (e.g. rail, road, barge) and provides comprehensive cost, schedule, and infrastructure data. NGSAM utilizes data from sources such as DOE’s STANDARDS UNF database and DOE’s Stakeholder Tool for Assessing Radioactive Transportation, while also allowing user-defined inputs for scenario customization. NGSAM enables stakeholders to evaluate complex UNF management strategies, assess system performance under varying assumptions, and inform decision making for future infrastructure investments. Its modular architecture and integration with other Integrated Waste Management System tools make it a critical asset for planning the safe and efficient disposition of the Nation’s growing UNF inventory.

Craig, Brian [Argonne National Laboratory (ANL)]↗
DOE OSTI2026

Systems Engineering and Analysis in Support of a US Federal Staging Facility for UNF

The US Department of Energy Office of Nuclear Energy (DOE-NE) Office of Spent Fuel and High-Level Waste Disposition is examining a set of system options and conducting supporting analyses to inform the development of an integrated waste management system, which may include one or more federal staging facilities (FSFs) for used nuclear fuel (UNF ) sited using a collaborative siting process. This paper focuses on the ongoing activities in two systems engineering and analysis work areas: (1) data and tools development, validation, and maintenance and (2) systems engineering execution. Within the first work area, the STANDARDS 5.0 UNF data and analysis tool, formerly known as UNF-ST&DARDS, is being developed as a foundational resource to assist in the management of UNF data. It has the key capability to model UNF throughout the entire back end of the fuel cycle. STANDARDS also includes several compatible analysis tools for the time-dependent characterization of UNF and related systems by interfacing with the SCALE code system for nuclear analysis and COBRA-SFS for thermal analysis. Also, within the data and tools area is the Next Generation System Analysis Model (NGSAM), which is an agent-based simulation software tool expressly designed to be capable of modeling the waste management system, including the transportation of UNF to and from a FSF. NGSAM has been developed to enable informed decision-making by providing the capability to analyze various potential system options for the management of UNF and high-level radioactive waste. Finally, in the systems engineering execution area, the team has begun to apply a disciplined systems engineering approach at the system level along with supporting analysis to guide the development of the FSF project requirements (including associated transportation infrastructure). Systems engineering principles and practices and their adaptation/application to design and development activities will ensure that the waste management system is effectively implemented as work proceeds. Other activities include investigating the implications of changes in various assumptions and parameters related to waste management systems, such as UNF acceptance rates, receipt logic, facility capacities and capabilities, use of standardized canisters, and different assumed facility operation start dates. Keywords: federal staging facility (FSF), used nuclear fuel (UNF), integrated waste management (IWM) system, Next Generation System Analysis Model (NGSAM), STANDARDS, systems engineering

Joseph, Robert↗
DOE OSTI2023

Performance assessment of a real water source heat pump within a hardware-in-the-loop (HIL) testing environment

Over the last decade, the global fight against climate change through electrification has led to an increase in research on building heating, ventilation, and air conditioning (HVAC) systems that utilize intelligent control algorithms to provide demand-side grid service while also maintaining the thermal comfort of building occupants. As the pivotal point between building electricity consumption and indoor thermal comfort, high-efficiency electrical vapor-compression heat pumps are at the center of these emerging studies, and various grid-interactive and occupant-comfort control algorithms have been developed for them. The impact of these algorithms on heat pump operation and performance when subjected to different weather conditions, building loads, and grid requests calls for investigation and verification via experimental testing with actual heat pumps integrated with real-time building and grid responses. This study introduces a Water-Source Heat Pump (WSHP) Hardware-in-The-Loop (HIL) Test Facility that is the first of its kind. This testbed utilizes a 2-ton variable speed water-to-air heat pump that is capable of interacting with a virtual environment currently comprised of an EnergyPlus (E+) building simulation, an agent-based occupant behavioral model, and a single U-tube ground-loop heat exchanger (GLHE) model. Detailed descriptions of the testbed’s physical design and operation, virtual environment, as well as their mutual communication is provided. An uncertainty analysis is also performed under manufacturer specified heating and cooling design conditions. This analysis shows that the total load across the WSHP’s demand side heat exchanger, i.e., the sum of its latent and sensible components, can be measured with a relative uncertainty of ± 10.4% and ± 3.6% in cooling and heating mode respectively. The WSHP’s coefficient of performance (COP) can be measured with relative uncertainties of ± 10.4% in cooling mode, and ± 3.7% in heating mode. A preliminary 24-h experimental demonstration is then performed utilizing the DOE prototype small commercial office building model in E+. The simulation takes place in Atlanta, GA on the date of 08/26/15 from 12:00 AM to 11:59 PM using TMY3 weather data. Here, the results from this demonstration show that over the course of this experiment the simulated outputs of zone dry-bulb temperature, zone humidity ratio, and WSHP inlet water temperature can be tracked by testbed emulators up to a root mean squared error (RMSE) of ± 0.27 °C, ± 0.376 g/kg, and ± 0.85 °C respectively. The WSHP’s dynamic behavioral characteristics and performance are also captured, and correspond well with the authors’ previous understanding of heat pump efficiency as a function of evaporator and condenser fluid inlet conditions respectively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Expanding Medicaid to Reduce Human Immunodeficiency Virus Transmission in Houston, Texas

Context: Medicaid expansion has been nationally shown to improve engagement in the human immunodeficiency virus (HIV) treatment and prevention continua, which are vital steps to stopping the HIV epidemic. New HIV infections in the United States are disproportionately concentrated among young Black men who have sex with men (YBMSM). Houston, TX, is the most populous city in the Southern United States with a racially/ethnically diverse population that is located in 1 of 11 US states that have not yet expanded Medicaid coverage as of 2021. Methods: An agent-based model that incorporated the sexual networks of YBMSM was used to simulate improved antiretroviral treatment and pre-exposure prophylaxis (PrEP) engagement through Medicaid expansion in Houston, TX. Analyses considered the HIV incidence (number of new infections and as a rate metric) among YBMSM over the next 10 years under Medicaid expansion as the primary outcome. Additional scenarios, involving viral suppression and PrEP uptake above the projected levels achieved under Medicaid expansion, were also simulated. Results: The baseline model projected an HIV incidence rate of 4.96 per 100 person years (py) and about 368 new annual HIV infections in the 10th year. Improved HIV treatment and prevention continua engagement under Medicaid expansion resulted in a 14.9% decline in the number of annual new HIV infections in the 10th year. Increasing viral suppression by an additional 15% and PrEP uptake by 30% resulted in a 44.0% decline in new HIV infections in the 10th year, and a 27.1% decline in cumulative infections across the 10 years of the simulated intervention. Findings: Simulation results indicate that Medicaid expansion has the potential to reduce HIV incidence among YBMSM in Houston. Achieving HIV elimination objectives, however, might require additional effective measures to increase antiretroviral treatment and PrEP uptake beyond the projected improvements under expanded Medicaid.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

An intelligent energy router for managing behind-the-meter resources and assets

With increase in distributed energy resources (DERs) and smart loads, each energy resource and load need a separate power conversion system leading to complex coordination and interaction, reduced energy conversion efficiency, coordinating compliance to grid standards (IEEE 1547) from multiple sources, reduced security. Also, multiple vendors with legacy system designs and proprietary communications interfaces result in redundancy and increase in cost of power electronics systems. This paper presents an energy router concept for buildings applications which provides autonomous power flow between sources and loads with a novel agent-based software interface.

Chinthavali, Madhu Sudhan↗
DOE OSTI2024

Optimization of Dynamic Ride-Sharing by Considering User Preference Through Discount and Delay Tolerance

Dynamic ride-sharing (DRS) has been projected to be a key solution to lowering system-wide congestion. Despite recent development progress, demand studies for DRS suggest low levels of willingness for travelers to use such services. The disconnect between DRS system designs and user preferences limits the application impacts of DRS in the real world. Therefore, this paper aims to design a new DRS system by considering the user preferences of choices under different levels of services. In this study, an agent-based approach is used to model a fleet of shared vehicles that allows DRS. An optimization model is developed to match riders to vehicles while accounting for traveler delay and delay acceptance. Travelers are also dynamically issued predictive discounts to incentivize them to accept longer trip delays. Results show that the proposed approach can improve system efficiency by increasing average vehicle occupancy by up to 1.0 persons/trip and DRS acceptance up to 38.9% depending on fleet size. Additionally, congestion is eased through the decrease of empty vehicle miles traveled by up to 7.1%.

Paul, Joseph↗
DOE OSTI2025

Design, Preparation, and Execution of the 100-AV Field Test for the CIRCLES Consortium: Methodology and Implementation of the Largest Mobile Traffic Control Experiment to Date

This article presents the comprehensive design, setup, execution, and evaluation of the MegaVanderTest (MVT) experiment conducted by the Congestion Impacts Reduction via CAV-in-the-Loop Lagrangian Energy Smoothing (CIRCLES) Consortium, which aimed to mitigate traffic congestion using partially autonomous vehicles (AVs) (see “Summary”). The experiment involved 100 vehicles on Nashville’s Interstate 24 (I-24) highway, utilizing various control algorithms to smooth stop-and-go traffic waves. The execution of the MVT experiment required a coordinated effort from multiple teams. This article details the meticulous planning process, the coordinated efforts of multiple teams, and the innovative use of a dynamic agent-based simulation framework for traffic evaluation. Here, the contributions of this work include demonstrating and providing a detailed roadmap for large-scale live traffic experiments, illustrating the lessons learned from the MVT experiment, and introducing the other articles in this issue and their complementary relationship in the MVT experiment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Reinforcement Learning for Volt- Var Control: A Novel Two-stage Progressive Training Strategy

This paper develops a reinforcement learning (RL) approach to solve a cooperative, multi-agent Volt-Var Control (VVC) problem for high solar penetration distribution systems. The ingenuity of our RL method lies in a novel two-stage progressive training strategy that can effectively improve training speed and convergence of the machine learning algorithm. In Stage 1 (individual training), while holding all the other agents inactive, we separately train each agent to obtain its own optimal VVC actions in the action space: fconsume, generate, do-nothingg. In Stage 2 (cooperative training), all agents are trained again coordinatively to share VVC responsibility. Rewards and costs in our RL scheme include (i) a system-level reward (for taking an action), (ii) an agent-level reward (for doing-nothing), and (iii) an agent-level action cost function. This new framework allows rewards to be dynamically allocated to each agent based on their contribution while accounting for the trade-off between control effectiveness and action cost. The proposed methodology is tested and validated in a modified IEEE 123-bus system using realistic PV and load profiles. Simulation results confirm that the proposed approach is robust and computationally efficient; and it achieves desirable volt-var control performance under a wide range of operation conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Economic Storage Size Optimization for Electric Vehicle Extreme-Fast Charging Stations

En-route charging infrastructure for electric vehicles is critical to support transportation needs. These charging stations are likely to have high loads and especially sharp peak loads given fast charging capabilities needed to meet transportation schedules. In order to reduce both strain on distribution grid infrastructure and charging station operational costs, many stations are likely to employ behind the meter storage. This paper demonstrates a behind the meter storage sizing optimization that employs an open-source agent-based vehicle behavior model (BEAM) to determine the best sizing across many scenarios. This optimization and analysis is novel in that it examines how storage size impacts not only charging station cost and peak load, but also vehicle queue times. The optimization is also applied across a wide analysis region with sufficient diversity and numbers to provide novel statistical analysis of optimal sizes.

Aka, Julius↗
DOE OSTI2025

A Neural Optimizer With Decision-Focused Learning for Optimal Energy Storage Operation

Here, this article introduces a neural optimizer-based framework for optimizing battery energy storage system (BESS) control for grid services, including demand charge and energy cost reduction. By leveraging decision-focused learning (DFL), the proposed framework ensures seamless integration and adaptation, significantly enhancing control performance. A patch time-series transformer is employed for peak load forecasting, incorporating aleatoric uncertainty quantification to account for forecasting uncertainties within the decision-making process. The framework utilizes a solver-in-the-loop approach to generate optimal BESS actions, which are then used to train the neural optimizer-based agent. By co-optimizing both BESS operational modes and output power within the NN, the system achieves improved performance and robustness. After initial training, the forecasting and control models are jointly fine-tuned to account for forecasting errors, further improving decision precision and efficiency through DFL. Case studies are performed to validate the performance of the framework using multiple real-world datasets, demonstrating superior performance in monthly peak load forecasting compared to state-of-the-art models. In addition, the results are compared against existing decision-making approaches. The results demonstrate a reduction in monthly peak forecasting error by approximately 15% across various performance measures and achieve an optimization gap for BESS operation that is about three times smaller compared to existing methods.

Kim, Hyeonjin [Pacific Northwest National Laborato↗
DOE OSTI2020

Energy Prediction of the Chicago Metropolitan Area Using Distributed Transportation MBSE Framework

Energy consumption impact of vehicle powertrain is traditionally assessed using standard and regulatory drive cycles. In this paper, energy consumption is determined by studying all the trips occurring in the Chicago Metropolitan Area in a 24 hour period. The data is generated by combining Polaris, an agent based traffic flow model with SVTrip, a stochastic model that generates 1 Hz vehicle speed profiles and Autonomie, a detailed vehicle level modeling tool used to predict fuel consumption. Different scenarios are constructed to define trips for different timeframes and assumptions. Vehicle fleet distribution, vehicle technologies and automation levels are applied to represent an appropriate vehicle fleet for each scenario. Analysis of energy consumption is then discussed with a particular emphasis on the impact of powertrain technology and vehicle types.

Autonomie↗
DOE OSTI2021

simcov v0.1

Simcov is an agent-based model of the spread of viral infections and the immune response in human lung at the cellular level. It is designed to scale well on HPC systems. No other software like it currently exists.

Hofmeyr, Steven↗