Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

mosartwmpy sample input data; 1980 - 1985

Sample input data spanning the years 1980-1985 for running the `mosartwmpy` water routing and management model: https://github.com/IMMM-SFA/mosartwmpy. More information is available in the README.md. Changelog: v0.0.7: new reservoir files with corrected locations based on an exhaustive review by Dan Broman for the 9505 project; corresponding long term mean demand and flow files updated based on VIC4 simulations using Daymet forcing. v0.0.6: updates reservoir parameters to indicate which reservoirs should follow generic operating rules and which should follow ISTARF data-driven operating rules. v0.0.5: adds supporting files for running the Farmer Agent Based Model of adaptive water demand.

Rexer, Emily↗
DOE OSTI2026

mosartwmpy sample input data; 1980 - 1985

Sample input data spanning the years 1980-1985 for running the `mosartwmpy` water routing and management model: https://github.com/IMMM-SFA/mosartwmpy. More information is available in the README.md. Changelog: v0.0.8: Update with new CAP_MIN reservoir parameter, corresponds with mosartwmpy v1.0.0 v0.0.7: new reservoir files with corrected locations based on an exhaustive review by Dan Broman for the 9505 project; corresponding long term mean demand and flow files updated based on VIC4 simulations using Daymet forcing. v0.0.6: updates reservoir parameters to indicate which reservoirs should follow generic operating rules and which should follow ISTARF data-driven operating rules. v0.0.5: adds supporting files for running the Farmer Agent Based Model of adaptive water demand.

Bracken, Cameron [Pacific Northwest National Labor↗
DOE OSTI2020

Data analysis and modeling pipelines for controlled networked social science experiments

There is large interest in networked social science experiments for understanding human behavior at-scale. Significant effort is required to perform data analytics on experimental outputs and for computational modeling of custom experiments. Moreover, experiments and modeling are often performed in a cycle, enabling iterative experimental refinement and data modeling to uncover interesting insights and to generate/refute hypotheses about social behaviors. The current practice for social analysts is to develop tailor-made computer programs and analytical scripts for experiments and modeling. This often leads to inefficiencies and duplication of effort. In this work, we propose a pipeline framework to take a significant step towards overcoming these challenges. Our contribution is to describe the design and implementation of a software system to automate many of the steps involved in analyzing social science experimental data, building models to capture the behavior of human subjects, and providing data to test hypotheses. The proposed pipeline framework consists of formal models, formal algorithms, and theoretical models as the basis for the design and implementation. We propose a formal data model, such that if an experiment can be described in terms of this model, then our pipeline software can be used to analyze data efficiently. The merits of the proposed pipeline framework is elaborated by several case studies of networked social science experiments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Calibration verification for stochastic agent-based disease spread models

Accurate disease spread modeling is crucial for identifying the severity of outbreaks and planning effective mitigation efforts. To be reliable when applied to new outbreaks, model calibration techniques must be robust. However, current methods frequently forgo calibration verification (a stand-alone process evaluating the calibration procedure) and instead use overall model validation (a process comparing calibrated model results to data) to check calibration processes, which may conceal errors in calibration. In this work, we develop a stochastic agent-based disease spread model to act as a testing environment as we test two calibration methods using simulation-based calibration, which is a synthetic data calibration verification method. The first calibration method is a Bayesian inference approach using an empirically-constructed likelihood and Markov chain Monte Carlo (MCMC) sampling, while the second method is a likelihood-free approach using approximate Bayesian computation (ABC). Simulation-based calibration suggests that there are challenges with the empirical likelihood calculation used in the first calibration method in this context. These issues are alleviated in the ABC approach. Despite these challenges, we note that the first calibration method performs well in a synthetic data model validation test similar to those common in disease spread modeling literature. We conclude that stand-alone calibration verification using synthetic data may benefit epidemiological researchers in identifying model calibration challenges that may be difficult to identify with other commonly used model validation techniques.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Trust in News as Moderated by Known Truth Assessments and Source

Disinformation has become a problem in various spaces, from social media to organizations. Given the lack of evidence and transparency surrounding organizational disinformation, we aim to understand issue of information exposure effect and source trust from the lens of traditional information consumption online. Using an online experiment and multi-level mixed-effects modeling, we find that the exposure effect exists even over only two exposures to a headline, as long as participants are not shown fact-checking. Fact-checking can be effective in reducing the impact of the exposure effect. Additionally, we find that participants trusted sources significantly more before seeing the headlines. The possible presence of disinformation reduces trust in sources, even when considered highly neutral and reputable. These findings can inform simulations of agent interactions with misinformation as well as future experimental designs focused on evaluations of belief and trust based on recognizability of a source.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Discovering mechanisms for materials microstructure optimization via reinforcement learning of a generative model

Abstract The design of materials structure for optimizing functional properties and potentially, the discovery of novel behaviors is a keystone problem in materials science. In many cases microstructural models underpinning materials functionality are available and well understood. However, optimization of average properties via microstructural engineering often leads to combinatorically intractable problems. Here, we explore the use of the reinforcement learning (RL) for microstructure optimization targeting the discovery of the physical mechanisms behind enhanced functionalities. We illustrate that RL can provide insights into the mechanisms driving properties of interest in a 2D discrete Landau ferroelectrics simulator. Intriguingly, we find that non-trivial phenomena emerge if the rewards are assigned to favor physically impossible tasks, which we illustrate through rewarding RL agents to rotate polarization vectors to energetically unfavorable positions. We further find that strategies to induce polarization curl can be non-intuitive, based on analysis of learned agent policies. This study suggests that RL is a promising machine learning method for material design optimization tasks, and for better understanding the dynamics of microstructural simulations.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Online transfer learning strategy for enhancing the scalability and deployment of deep reinforcement learning control in smart buildings

In recent years, advanced control strategies based on Deep Reinforcement Learning (DRL) proved to be effective in optimizing the management of integrated energy systems in buildings, reducing energy costs and improving indoor comfort conditions when compared to traditional reactive controllers. However, the scalability and implementation of DRL controllers are still limited since they require a considerable amount of time before converging to a near-optimal solution. This issue is currently addressed in literature through the offline pre-training of the DRL agent. However this solution results in two main critical issues: (1) the need to develop a building surrogate model to perform the training task, and (2) the need to perform a fine-tuning process over several training episodes to obtain a near-optimal control policy. In this context, this paper introduces an Online Transfer Learning (OTL) strategy that exploits two knowledge-sharing techniques, weight-initialization and imitation learning, to transfer a DRL control policy from a source office building to various target buildings in a simulation environment coupling EnergyPlus and Python. A DRL controller based on discrete Soft Actor–Critic (SAC) is trained on the source building to manage the operation of a cooling system consisting of a chiller and a thermal storage. Several target buildings are defined to benchmark the performance of the OTL strategy with that of a Rule-Based Controller (RBC) and two DRL-based control strategies, deployed in offline and online fashion. The strategy adopted for OTL emulates the real world implementation with a simulation process by implementing the transferred DRL agent for a single episode in the target buildings. Target buildings have the same geometrical features and are served by the same energy system as the source building, but differ in terms of weather conditions, electricity price schedules, occupancy patterns, and building envelope efficiency levels. The results show that the OTL strategy can reduce the cumulated sum of temperature violations on average by 50% and 80% respectively when compared to RBC and online DRL while enhancing the energy system operation with electricity cost savings ranging between 20% and 40%. Furthermore, the OTL agent performs slightly worse than the offline DRL controller but it does not require any modeling effort and can be implemented directly on target buildings emulating a real-world implementation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Automobile and Technology Lifecycle-Based Assignment (ATLAS) v2.0.12

ATLAS is a comprehensive vehicle transaction and technology adoption microsimulator. ATLAS evolves the fleet mix of individual households by simulating the transaction (vehicle addition, disposal, and replacement) and choice (vehicle type, vintage, powertrain, and tenure) decisions in response to the co-evolving demographics, land use, and vehicle technology simulations. Different from the existing vehicle models that are either static or aggregated (e.g. stock model), ATLAS is fully disaggregated and dynamic following a sequential and circumstantial decision-making trajectory. This fine-grained approach not only enhances the realism of the simulation but also provides a nuanced understanding of the dynamics inherent in vehicle fleet evolution. ATLAS outputs are fully compatible with subsequent agent-based transportation modeling system and can enable distributional effect analysis regarding the fleet turnover among heterogeneous populations. ATLAS expands the typical new sale focused vehicle choice modeling to including used vehicle transactions that are of increasing interests to understanding the vehicle adoption behavior among lower income households.

Jin, Ling↗
DOE OSTI2022

Investigating uncertainties in human adaptation and their impacts on water scarcity in the Colorado river Basin, United States

The Colorado River Basin (CRB) supports the water supply for seven states and forty million people in the Western United States (US) and has been suffering an extensive drought for more than two decades. As climate change continues to reshape water resources distribution in the CRB, its impact can differ in intensity and location, resulting in variations in human adaptation behaviors. The feedback from human systems in response to the environmental changes and the associated uncertainty is critical to water resources management, especially for water-stressed basins. This paper investigates how human adaptation affects water scarcity uncertainty in the CRB and highlights the uncertainties in human behavior modeling. Our focus is on agricultural water consumption, as approximately 80% of the water consumption in the CRB is used in agriculture. We adopted a coupled agent-based and water resources modeling approach for exploring human-water system dynamics, in which an agent is a human behavior model that simulates a farmer’s water consumption decisions. We examined uncertainties at the system, agent, and parameter levels through uncertainty, clustering, and sensitivity analyses. The uncertainty analysis results suggest that the CRB water system may experience 13 to 30 years of water shortage during the 2019–2060 simulation period, depending on the paths of farmers’ adaptation. The clustering analysis identified three decision-making classes: bold, prudent, and forward-looking, and quantified the probabilities of an agent belonging to each class. The sensitivity analysis results indicated agents whose decision-making models require further investigation and the parameters with the higher uncertainty reduction potentials. Here, by conducting numerical experiments with the coupled model, this paper presents quantitative and qualitative information about farmers’ adaptation, water scarcity uncertainties, and future research directions for improving human behavior modeling.

Agent-based modeling↗
DOE OSTI2023

Energy Optimization of Light and Heavy-Duty Vehicle Cohorts of Mixed Connectivity, Automation and Propulsion System Capabilities via Meshed V2V-V2I and Expanded Data Sharing (Final Scientific and Technical Report)

Vehicle connectivity and automated driving technologies individually have the potential to decrease energy consumption and/or increase safety on light, medium or heavy duty vehicles to varying degrees depending on the traffic infrastructure and specific driving scenarios. Due to advances in sensing, perception and computing power, research and development emphasis in the mobility sector has shifted away from connectivity. Prior research has shown that driving automation with the absence of connectivity can in certain circumstances increase energy consumption. The effectiveness of synergizing connectivity and driving automation technologies is the focus of this work, specifically applied to vehicle cohorts of mixed composition, light and heavy duty, and powertrains ranging from all electric to conventional internal combustion engine. The project team is led by Michigan Technological University (MTU) and partnered with AVL Mobility Technologies Inc. (AVL), Borg Warner (BW), Traffic Technology Services (TTS), American Center for Mobility (ACM) and Navistar (NAV). The main thrusts for the team are to develop a micro-traffic simulation environment with specific VD&PT system attributes and CAV capabilities, 2) field a vehicle test fleet of mixed classification, propulsion and CAV capacity, 3) develop artificial intelligence (AI) and machine learning (ML) based multi-agent optimization methods for various traffic infrastructures, 4) integrate the virtual environment and the optimization methods then deploy the system as a CAV hardware in the loop (HiL) for the vehicle test fleet and 5) conduct closed track and public road testing to validate simulation and demonstrated energy and mobility improvements at multiple scales. For a cohort of mixed vehicles, the team will demonstrate a reduction of energy consumption of 10-50% at intersection, arterial roadway and limited access highway scenarios through connectivity and automation in simulation and at a closed test track. The energy reduction objectives of the project are summarized in Table 1, indicating the infrastructure and over what distances are relevant considered. Single scenario energy reductions are not relevant and thus, the research team took the approach to vary parameters associated with the infrastructure, vehicle cohort composition and dynamic behavior to generate energy consumption distributions for both unconnected and connected scenarios.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Uncertainty characterization in a coupled human-natural system: Modeling agricultural adaptation in the Great Lakes Region

The Great Lakes Region's water quality and ecological health are threatened by the export of nutrients from agricultural lands, which causes eutrophication, hypoxia, and destructive algal blooms. The intensification of hydrologic cycles brought about by climate change is expected to exacerbate nutrient loading in the region, and, at the same time, agricultural adaptation to changing conditions is also expected to affect loading through shifting amounts and timing of fertilization. Quantifying these future effects and their interactions necessitates modeling both the human and natural processes as a coupled system, by pairing land use and agricultural management with hydrologic modeling. At the same time, compounding uncertainties arising from the complex interactions in both systems significantly limit our predictive understanding of the region's impacts. This study utilizes the Soil and Water Assessment Tool (SWAT), developed for simulating the impact of various farmer decisions on watershed functions in Western Lake Erie watersheds, and an under-development agent-based model (ABM) for agricultural management decisions. The aim of this study is to use global sensitivity analysis on the coupled ABM and SWAT models to quantify how uncertainty in both models interactively affects nutrient loading. To do so, we will conduct Sobol sensitivity analysis experiments at different levels of coupling assumptions to quantify how various uncertain factors (e.g., soil moisture and crop choice) and their interactions affect our estimates of nutrient loading. The results of this analysis will allow us to quantify how complex interactions and dependencies between both systems amplify the effect of uncertainties. Insights gained from this study will have broader implications for modeling the adaptive co-evolution of human and natural systems under climate change and can inform effective management of nutrient loading in the Great Lakes Region.

Climate Change↗
DOE OSTI2024

Platform for Integrated Land use And Transportation Experiments and Simulation (PILATES) v1.0

PILATES allows for flexibly and at-scale coupling of multiple models to allow for multi-scale and multi-resolution simulation of regional-scale transport networks. In particular, it couples the MATSim-derived transportation modeling framework for Behavior, Energy, Autonomy and Mobility (BEAM) with other models operating at different time scales. Rather than tightly coupling supply and demand models using shared agents and memory within the same software process, PILATES orchestrates different model runs in a containerized framework. This structure requires passing information from the demand models to BEAM in the format of a synthetic population and agent plans, and from BEAM to the demand models in terms or origin/destination tables (also known as "skims"). This allows it to take advantage of the behavioral sophistication of existing activity-based models as well as the reinforcement learning structure of MATSim replanning and adopted by BEAM, in a way that requires minimal changes to existing models. It also takes advantage of the computational performance of BEAM, which allows for simulations with millions of agents to complete in reasonable time as well as allowing for detailed mechanistic simulation of the operation of on-demand modes.

Needell, Zachary↗
DOE OSTI2020

Optimal Renewable Resource Allocation and Load Scheduling of Resilient Communities

This paper presents a methodology for enhancing community resilience through optimal renewable resource allocation and load scheduling in order to minimize unserved load and thermal discomfort. The proposed control architecture distributes the computational effort and is easier to be scaled up than traditional centralized control. The decentralized control architecture consists of two layers: The community operator layer (COL) allocates the limited amount of renewable energy resource according to the power flexibility of each building. The building agent layer (BAL) addresses the optimal load scheduling problem for each building with the allowable load determined by the COL. Both layers are formulated as a model predictive control (MPC) based optimization. Simulation scenarios are designed to compare different combinations of building weighting methods and objective functions to provide guidance for real-world deployment by community and microgrid operators. The results indicate that the impact of power flexibility is more prominent than the weighting factor to the resource allocation process. Allocation based purely on occupancy status could lead to an increase of PV curtailment. Further, it is necessary for the building agent to have multi-objective optimization to minimize unserved load ratio and maximize comfort simultaneously.

model predictive control↗
DOE OSTI2022

Deploying Traffic Smoothing Cruise Controllers Learned from Trajectory Data

Autonomous vehicle-based traffic smoothing con- trollers are often not transferred to real-world use due to challenges in calibrating many-agent traffic simulators. We show a pipeline to sidestep such calibration issues by collecting trajectory data and learning controllers directly from trajectory data that are then deployed zero-shot onto the highway. We construct a dataset of 772.3 kilometers of recorded drives on the I-24. We then construct a simple simulator using the recorded drives as the lead vehicle in front of a simulated platoon consisting of one autonomous vehicle and five human followers. Using policy-gradient methods with an asymmetric critic to learn the controller, we show that we are able to improve average MPG by 11% in simulation on congested trajectories. We deploy this controller to a mixed platoon of 4 autonomous Toyota RAV-4’s and 7 human drivers in a validation experiment and demonstrate that the expected time-gap of the controller is maintained in the real world test. Finally, we release the driving dataset [1], the simulator, and the trained controller at https://github.com/nathanlct/trajectory-training-icra.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

ChemGraph as an agentic framework for computational chemistry workflows

Atomistic simulations are essential in chemistry and materials science but remain challenging to run due to the expert knowledge required for the setup, execution, and validation stages of these calculations. We present ChemGraph, an agentic framework powered by artificial intelligence and state-of-the-art simulation tools to streamline and automate computational chemistry and materials science workflows. ChemGraph leverages graph neural network-based foundation models for accurate yet computationally efficient calculations and large language models (LLMs) for natural language understanding, task planning, and scientific reasoning to provide an intuitive and interactive interface. We evaluate ChemGraph across 13 benchmark tasks and demonstrate that smaller LLMs (GPT-4o-mini, Claude-3.5-haiku, Qwen-2.5-14B) perform well on simple workflows, while more complex tasks benefit from using larger models. Importantly, we show that decomposing complex tasks into smaller subtasks through a multi-agent framework enables GPT-4o to reach perfect accuracy and smaller LLMs to match or exceed single-agent GPT-4o's performance in these benchmarks.

Computational chemistry↗
DOE OSTI2024

A novel digital lifecycle for Material‐Process‐Microstructure‐Performance relationships of thermoplastic olefins foams manufactured via supercritical fluid assisted foam injection molding

Abstract This research significantly enhances the applicability of thermoplastic olefins (TPOs) in the automotive industry using supercritical N 2 as a physical foaming agent, effectively addressing the limitations of traditional chemical agents. It merges experimental results with simulations to establish detailed material‐process‐microstructure‐performance (MP2) relationships, targeting 5–20% weight reductions. This innovative approach labeled digital lifecycle (DLC) helps accurately predict tensile, flexural, and impact properties based on the foam microstructure, along with experimentally demonstrating improved paintability. The study combines process simulations with finite element models to develop a comprehensive digital model for accurately predicting mechanical properties. Our findings demonstrate a strong correlation between simulated and experimental data, with about a 5% error across various weight reduction targets, marking significant improvements over existing analytical models. This research highlights the efficacy of physical foaming agents in TPO enhancement and emphasizes the importance of integrating experimental and simulation methods to capture the underlying foaming mechanism to establish material‐process‐microstructure‐performance (MP2) relationships. Highlights Establishes a material‐process‐microstructure‐performance (MP2) for TPO foams Sustainably produces TPO foams using supercritical (ScF) N 2 with 20% lightweighting Shows enhanced paintability for TPO foam improved surface aesthetics Digital lifecycle (DLC) that predicts both foam microstructure and properties DLC maps process effects & microstructure onto FEA mesh for precise prediction

Engineering↗
DOE OSTI2026

Optimal CO 2 storage management considering safety constraints in multi-stakeholder multi-site GCS projects: A Markov game perspective

Geological carbon storage (GCS) projects could involve a diverse array of stakeholders or players from public, private, and regulatory sectors, each with different objectives and responsibilities. Given the complexity, scale, and long-term nature of GCS operations, determining whether individual stakeholders can independently optimize their interests — or whether collaborative coalition agreements are needed — remains a central question for effective GCS project planning and management. To access large, high-quality storage resources, future GCS deployment may increasingly occur in geologically connected sites, where shared geological features such as pressure space and reservoir pore capacity can lead to competitive behavior among stakeholders. In this work, we propose a paradigm based on Markov games to quantitatively investigate how different coalition structures affect the goals of stakeholders. We frame this multi-stakeholder multi-site problem as a multi-agent reinforcement learning problem with safety constraints. Our approach enables agents to learn optimal strategies while complying with safety regulations. We present an example where multiple operators are injecting CO 2 into their respective project areas in a geologically connected basin. To address the high computational cost of repeated simulations of high fidelity models, a previously developed surrogate model based on the Embed-to-Control (E2C) framework is employed. Our results demonstrate the effectiveness of the proposed framework in addressing optimal management of CO 2 storage when multiple stakeholders with different objectives and goals are involved.

58 GEOSCIENCES↗
DOE OSTI2022

Mucus-Inspired Tribology, a Sticky Yet Flowing Hydrogel

The mucus blanket can trap foreign particles before they enter the lungs, while at the same time, it flows up to remove these particles. This manifests the dual nature of mucus: sticky, on one hand, and fluid, on the other. Inspired by this function of mucus in the lungs, we designed a mucus simulant which emulates this dual nature. While many existing mucus simulants do not target bioadhesion particularly, poly(vinyl alcohol) (PVA)-based simulants make an exception. Despite their bioadhesion tendency, unlike mucus, they do not gelate. In this study, we added a physical cross-linking agent to PVA in order to add the gelation aspect and to better represent mucous properties. We show that the resultant mucus simulant develops into two regions: a highly sticky region near the surface of a foreign object (we used hydrophobized silicon to mimic the foreign object) and a fluid region far away from that surface. We show that the sticky part can slide past the less sticky part, while the foreign object is stuck to it. However, this mechanism changes with time. At short gelation times, this tendency to separate into two parts is enhanced and the foreign object remains stuck, while the rest of the gel flows. With time, the force required to allow the sticky part to slide over the fluid part is further reduced. However, if the gelation is allowed to proceed for even longer times without disturbance, the force required to slide the two parts past each other increases and the separation between the two parts is inhibited. The hydrogel becomes a sticky goo, which requires a higher force to move or unclog if placed in a duct (much like what happens with mucus in the tracheal duct). We explain the physics of our findings in terms of a competition between the tendency of the polymer to form a gel network and the tendency of the polymer to adsorb onto the foreign object.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗