SEARCH · Engineering Papers

Results for “agent based simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Demographic Microsimulator for Integrated Urban Systems: Adapting Panel Survey of Income Dynamics to Capture the Continuum of Life

Agent-based models (ABMs) in transportation modeling simulate activity and travel decisions at the disaggregate level of households and individuals. To do this, ABMs require detailed and realistic information on agents’ socioeconomic and demographic characteristics. Various synthetic population generators have been proposed to address this need. However, most of those currently in practice are cross-sectional in nature and do not account for the dynamics within households and individuals as they progress through life events over time. This is a major shortcoming, as literature has shown that transportation decisions are affected by the transition between and co-occurrence of life cycle events. While some demographic evolution simulators have been proposed to address this issue, they are developed using cross-sectional data and capture only a small set of life cycle events and their interdependence. Addressing these drawbacks, we propose a demographic microsimulator (DEMOS) that captures the “continuum of life” by considering a range of household- and individual-level life cycle events. DEMOS is developed using the Panel Survey of Income Dynamics, one of the world’s longest-running longitudinal surveys. The DEMOS submodels consider key life cycle events that are influenced by agents’ demographic variables. DEMOS is applied to evolve the population of the San Francisco Bay Area over a 9-year horizon. Results demonstrate how DEMOS generates life trajectories and how DEMOS outputs match the observed demographic trends. DEMOS is expected to enable longitudinal analysis in the context of ABMs and expand ABMs analyses relating to dynamic processes such as household-level vehicle transactions.

Demographic evolution↗

DOE OSTI2024

Agent-based modeling to evaluate the effects of harvesting biomass and hunting on ring-necked pheasant ( Phasianus colchicus ) populations

As the US strives to divest from fossil fuels, dedicated energy crops have increased in popularity because of their potential to serve as a renewable source of transportation fuel and biomass-generated electricity. Whereas the impacts of crop agriculture on biodiversity have been well-documented, less is known about the potential impacts that growing bioenergy crops could have on wildlife. Here we look specifically at the ring-necked pheasant (Phasianus colchicus) and how pheasant populations may be influenced by growing and harvesting bioenergy crops. We explored effects of temporal harvest strategies at the field scale on biomass yield and pheasant population size. To investigate, we developed an agent-based model (ABM) that simulates ring-necked pheasants, tractors, hunters, and vegetation classes. One such vegetation class is land that is enrolled in a Conservation Reserve Program (CRP) plan specifically targeting pheasant conservation. Using this ABM, we assessed four different landscapes—corn-dominated, CRP-dominated, grassland-dominated, and mixed landscape—under strategies that varied the time of harvest. We also used ecological valuation to compare scenario outcomes from an economic perspective. We determined that biomass yield and pheasant population size were sensitive to harvesting times. Our scenarios totaled between ~$931,000 (minimum) and $3.8 million (maximum) over all landscapes, though on average harvesting in late spring generated the most value ($2.45 million) and harvesting in fall was a close second in terms of profitability ($2.39 million).

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS2011

Modeling Being "Lost": Imperfect Situation Awareness

Being "lost" is an exemplar of imperfect Situation Awareness/Situation Understanding (SA/SU) -- information/knowledge that is uncertain, incomplete, and/or just wrong. Being "lost" may be a geo-spatial condition - not knowing/being wrong about where to go or how to get there. More broadly, being "lost" can serve as a metaphor for uncertainty and/or inaccuracy - not knowing/being wrong about how one fits into a larger world view, what one wants to do, or how to do it. This paper discusses using agent based modeling (ABM) to explore imperfect SA/SU, simulating geo-spatially "lost" intelligent agents trying to navigate in a virtual world. Each agent has a unique "mental map" -- its idiosyncratic view of its geo-spatial environment. Its decisions are based on this idiosyncratic view, but behavior outcomes are based on ground truth. Consequently, the rate and degree to which an agent's expectations diverge from ground truth provide measures of that agent's SA/SU.

Middleton, Victor E.↗

DOE OSTI2023

Evaluating the incentive for soil organic carbon sequestration from carinata production in the Southeast United States

Soil organic carbon (SOC) can be increased by cultivating bioenergy crops to produce low-carbon fuels, improving soil quality and agricultural productivity. This study evaluates the incentives for farmers to sequester SOC by adopting a bioenergy crop, carinata. Two agricultural management scenarios – business as usual (BaU) and a climate-smart (no-till) practice – were simulated using an agent-based modeling approach to account for farmers’ carinata adoption rates within their context of traditional crop rotations, the associated profitability, influences of neighboring farmers, as well as their individual attitudes. Here, using the state of Georgia, US, as a case study, the results show that farmers allocated 1056 × 10 3 acres (23.8%; 2.47 acres is equivalent to 1 ha) of farmlands by 2050 at a contract price of $\$6.5$ per bushel of carinata seeds and with an incentive of $50Mg -1 CO2e SOC sequestered under the BaU scenario. In contrast, at the same contract price and SOC incentive rate, farmers allocated 1152 × 10 3 acres (25.9%) of land under the no-till scenario, while the SOC sequestration was 483.83 × 10 3 Mg CO2e, which is nearly four times the amount under the BaU scenario. Thus, this study demonstrated combinations of seed prices and SOC incentives that encourage farmers to adopt carinata with climate-smart practices to attain higher SOC sequestration benefits.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Protection against Chemical Warfare Agents and Biological Threats Using Metal–Organic Frameworks as Active Layers

The SARS-CoV-2 pandemic outbreak and the unfortunate misuse of toxic chemical warfare agents (CWAs) highlight the importance of developing functional materials to protect against these chemical and pathogen threats. Metal–organic frameworks (MOFs), which comprise a tunable class of crystalline porous materials built from inorganic nodes and organic linkers, have emerged as a class of heterogeneous catalysts capable of rapid detoxification of multiple classes of these harmful chemical or biological hazards. In particular, zirconium-based MOFs (Zr-MOFs) feature Lewis acidic nodes that serve as active sites for a wide range of catalytic reactions, including the hydrolysis of organophosphorus nerve agents within seconds in basic aqueous solutions. In addition, postsynthetic modification of Zr-MOFs enables the release of active species capable of reacting with and deactivating harmful pathogens. Despite this impressive performance, utilizing Zr- MOFs in powder form is not practical for application in masks or protective uniforms. To address this challenge, our team sought to develop MOF/fiber composite systems that could be adapted for use under realistic operating conditions to protect civilians, military personnel, and first responders from harmful pathogens and chemical warfare agents. Over the last several years, our group has designed and fabricated reactive and biocidal MOF/fiber composites that effectively capture and deactivate these toxic species. In this Account, we describe the evolution of these porous and reactive MOF/fiber composites and focus on key design challenges and considerations. First, we devised a scalable method for the integration of Zr-MOFs onto textile substrates using aqueous precursor solutions and without using pretreated textiles, highlighting the potential scalability of this method. Moving beyond standard textiles, we also developed a microbial synthesis strategy to prepare hierarchically porous MOF/bacterial cellulose nanofiber composite sponges that can both capture and detoxify nerve agents when exposed to contaminated gas flows. The mass loading of the MOF in the nanofibrous composite sponge is up to 90%, affording higher work capacities compared to those of textile-fiber-based composites with relatively lower MOF loadings. Next, we demonstrated that heterogeneous polymeric bases are suitable replacements for volatile liquid bases typically used in solution-phase reactions, and we showed that these composite systems are capable of effectively hydrolyzing nerve agents in the solid state by using only water that is present as humidity. Moreover, incorporating a reactive dye precursor into the composite affords a dual function sensing and detoxifying material that changes color from white to orange upon reaction with the byproduct following nerve agent hydrolysis, demonstrating the versatility of this platform for use in decontamination applications. We then created chlorine-loaded MOF/fiber composites that act as biocidal and reactive textiles that are capable of not only detoxifying sulfur-mustard-based chemical warfare agents and simulants but also deactivating both bacteria and the SARS-CoV-2 virus within minutes of exposure. Lastly, we synthesized a mixed-metal Ti/Zr-MOF coating on cotton fibers to afford a photoactive biocidal cloth that shows fast and broad-spectrum biocidal performance against viruses and Gram-positive and Gram-negative bacteria under visible light irradiation. Given the tunable, multifunctional nature of these MOF/fiber composites, we believe that this Account will offer new insights for the rational design and preparation of functional MOF/fiber composites and pave the way toward the development of next-generation reactive and protective textiles.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Smart Charging for Electric Ride-Hailing Vehicles using Renewables: A San Francisco Case Study

Charging large fleets of electric ride-hailing vehicles (ERVs) is a complex matter that could serve different objectives: lower carbon dioxide emissions, lower monetary expenditures, or maximize solar photovoltaics (PV) energy consumption. Currently, it is unclear how each of those objectives could impact the business and performance of a ride-hailing fleet. In order to fill this gap, this article employs a dynamic transportation model: a smart charging simulation that combines agent-based, discrete-event, and system dynamic modelling by comparing the above-mentioned objectives in separate scenarios. The results show that each scenario successfully manages to shift between 34% and 87% of all load to hours of the day when the objectives of those scenarios are met. Therefore, in comparison to the baseline, smart charging can save between 5% and 26% of monthly emissions and between 4% and 57% of monthly expenditures. The solar PV scenario, however, results in the highest savings, while ensuring profitable economics via net metering in the short- as well as long term. Finally, the sensitivity analysis points to important trade-offs between several fleet performance metrics. The article concludes by giving business and policy recommendations for maximising the economic, energy and environmental efficiency of large ERV fleets.

ADVANCED PROPULSION SYSTEMS,SOLAR ENERGY↗

NASA NTRSDate not supplied

Joint Communication Resource Allocation and Velocity Selection in Urban Air Mobility via Multi-agent Reinforcement Learning

With traffic congestion problems becoming more severe in urban areas, the National Aeronautics and Space Administration promotes the Urban Air Mobility (UAM) concept, which envisages a safe and efficient air transportation system. However, the increased communication demands in UAM can exacerbate the spectrum scarcity. Therefore, a new communication resource allocation solution is necessary. In this paper, we focus on uplink UAM communications, where multiple aerial vehicles (AV) perform cargo/passenger delivery tasks. With predefined flight paths, AVs make decisions on communication resource allocation and velocity selection to complete their missions under safety constraints. Accordingly, we formulate a joint optimization problem to minimize the weighted sum of the total travel time and communication outage time. We first model the optimization problem as a Markov game and propose a multi-agent reinforcement learning based solution. Simulation results corroborate the effectiveness of the proposed solution.

Ruixuan Han↗

DOE OSTI2022

Multi-level impacts of climate change and supply disruption events on a potato supply chain: An agent-based modeling approach

Context: The world is experiencing frequent extreme weather events like droughts, snowstorms, and shifting of seasons due to climate change. Increased frequency and severity of these extreme weather events threaten food security because agriculture depends on climate conditions. Impacts of climate change on the agricultural system not only occur at the grower’s level, but also cascade to other levels along the supply chain. Objective: In this study, we aim to quantify a wide range of economic impacts of different extreme climate events on different stages of a food supply chain. Methods: We chose the potato supply chain in Idaho as a case study. We developed a multi-echelon supply chain simulation model using an agent-based modeling (ABM) approach with five types of agents—farmers, shippers, processors, retailers, and logistics companies. In addition to the business-as-usual (BAU) scenario, we designed two climate-related disruption events—drought and snowstorm. We quantified the heterogeneous impacts at different stages of the supply chain for both fresh and processed potatoes using key performance indicators (KPIs) including revenues, prices, lead times, traded quantities, and food waste quantity. Results and Conclusion: The impacts of the disruption events are different on different agents in the supply chain for different product categories. The price hike of fresh potatoes is far higher than processed potatoes during disruption events. This price hike makes consumers switch to processed potatoes, which require more fresh potatoes as an input that further reinforces the price hike. However, because processed potatoes have an elastic demand, once their prices go up due to higher input cost, their demand drops. Non-contracted farmers gain additional revenues from the disruption events, whereas contracted farmers incur a loss due to lock-in price and lower than usual harvest. Significance: The methodology developed in this study could be applied to other food and agricultural supply chains for understanding the vulnerabilities at agent levels due to climate change disruption events. Furthermore, the findings would help develop mitigation strategies or policies to improve the well-being of the overall supply chain.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRSDate not supplied

Tradeoffs When Considering Deep Reinforcement Learning for Contingency Management in Advanced Air Mobility

Air transportation is undergoing a rapid evolution globally with the introduction of Advanced Air Mobility (AAM) and with it comes novel challenges and opportunities for transforming aviation. As AAM operations introduce increasing heterogeneity in vehicle capabilities and density, increased levels of automation are likely necessary to achieve operational safety and efficiency goals. This paper focuses on one example where increased automation has been suggested. Autonomous operations will need contingency management systems that can monitor evolving risk across a span of interrelated (or interdependent) hazards and, if necessary, execute appropriate control interventions via supervised or automated decision making. Accommodating this complex environment may require automated functions (autonomy) that apply artificial intelligence (AI) techniques that can adapt and respond to a quickly changing environment. This paper explores the use of Deep Reinforcement Learning (DRL) which has shown promising performance in complex and high-dimensional environments where the objective can be constructed as a sequential decision-making problem. An extension of a prior formulation of the contingency management problem as a Markov Decision Process (MDP) is presented and uses a DRL framework to train agents that mitigate hazards present in the simulation environment. A comparison of these learning-based agents and classical techniques is presented in terms of their performance, verification difficulties, and development process.

machine learning↗

DOE OSTI2022

Moving the needle: Employing deep reinforcement learning to push the boundaries of coarse-grained vaccine models

Highly mutable infectious disease pathogens (hm-IDPs) such as HIV and influenza evolve faster than the human immune system can contain them, allowing them to circumvent traditional vaccination approaches and causing over one million deaths annually. Agent-based models can be used to simulate the complex interactions that occur between immune cells and hm-IDP-like proteins (antigens) during affinity maturation—the process by which antibodies evolve. Compared to existing experimental approaches, agent-based models offer a safe, low-cost, and rapid route to study the immune response to vaccines spanning a wide range of design variables. However, the highly stochastic nature of affinity maturation and vast sequence space of hm-IDPs render brute force searches intractable for exploring all pertinent vaccine design variables and the subset of immunization protocols encompassed therein. To address this challenge, we employed deep reinforcement learning to drive a recently developed agent-based model of affinity maturation to focus sampling on immunization protocols with greater potential to improve the chosen metrics of protection, namely the broadly neutralizing antibody (bnAb) titers or fraction of bnAbs produced. Using this approach, we were able to coarse-grain a wide range of vaccine design variables and explore the relevant design space. Our work offers new testable insights into how vaccines should be formulated to maximize protective immune responses to hm-IDPs and how they can be minimally tailored to account for major sources of heterogeneity in human immune responses and various socioeconomic factors. Our results indicate that the first 3 to 5 immunizations, depending on the metric of protection, should be specially tailored to achieve a robust protective immune response, but that beyond this point further immunizations require only subtle changes in formulation to sustain a durable bnAb response.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2020

Reinforcement learning based automated history matching for improved hydrocarbon production forecast

History matching aims to find a numerical reservoir model that can be used to predict the reservoir performance. An engineer and model calibration (data inversion) method are required to adjust various parameters/properties of the numerical model in order to match the reservoir production history. In this study, we develop deep neural networks within the reinforcement learning framework to achieve automated history matching that will reduce engineers’ efforts, human bias, automatically and intelligently explore the parameter space, and remove the need of large set of labeled training data. To that end, a fast-marching-based reservoir simulator is encapsulated as an environment for the proposed reinforcement learning. The deep neural-network-based learning agent interacts with the reservoir simulator within reinforcement learning framework to achieve the automated history matching. Reinforcement learning techniques, such as discrete Deep Q Network and continuous Deep Deterministic Policy Gradients, are used toth, used to train the learning agents. The continuous actions enable the Deep Deterministic Policy Gradients to explore more states at each iteration in a a learning episode; consequently, a better history matching is achieved using this algorithm as compared to Deep Q Network. For simplified dual-target composite reservoir models, the best history-matching performances of the discrete and continuous learning methods in terms of normalized root mean square errors are 0.0447 and 0.0038, respectively. Furthermore, our study shows that continuous action space achieved by the deep deterministic policy gradient drastically outperforms deep Q network.

42 ENGINEERING↗

NASA NTRSDate not supplied

Tradeoffs When Considering Deep Reinforcement Learning for Contingency Management in Advanced Air Mobility

machine learningautonomous systems; flight simulat↗

DOE OSTI2023

plastic-abm [SWR 23-74]

The plastic agent-based model (ABM) built with the MESA python library simulates agents decisions to recycle plastic waste according to an extended version of the theory of planned behavior.

Walzberg, Julien↗

DOE OSTI2025

Autonomous alloy composition optimization using molecular dynamics guided by a large language model

Here, we present an autonomous materials discovery framework that couples a large language model (LLM) with molecular dynamics (MD) simulations to optimize Fe–Cr–Mn alloy compositions for tensile strength. Starting from six distinct compositions, the LLM operated as an intelligent agent, iteratively proposing changes based on prior simulation results and constraints. Over 50 iterations per case, the LLM adaptively explored the composition space, identifying high-strength regions, not easily accessible by conventional methods. The highest strength, 18.7 GPa, was achieved with Fe 71 Cr 25 Mn 4 composition, identified from a Fe 75 Cr 20 Mn 5 starting point. The LLM autonomously adjusted its strategy in real time, demonstrating closed-loop decision-making using commodity hardware. This approach showcases the potential of LLMs as scientific co-pilots, capable of accelerating materials discovery and generalizable to other domains like biology and drug design.

Autonomy↗

DOE OSTI2026

Cascading economic losses from port disruptions under capacity constrained multimodal freight networks

This study quantifies how throughput disruptions at major seaports cascade through capacity-constrained multimodal freight networks and interregional production systems. We couple an agent-based model (ABM) multimodal freight simulation that resolves rerouting, terminal queueing, and inventory drawdown under binding modal and facility capacities with a multiregional output loss input-output (MRIIM) model that propagates realized delivery shortfalls across regions and sectors. The framework is demonstrated for the Port of Los Angeles using Freight Analysis Framework flows and Bureau of Economic Analysis input-output accounts and is evaluated over a 52-week horizon under deterministic sector targeted shocks and stochastic disruption realizations with uncertain severity and duration. Results indicate nonlinear amplification: realized national losses concentrate in manufacturing and transportation/warehousing even when exogenous port shocks are dispersed, suggesting that congestion spillback and limited short-run substitution can dominate the initial shock allocation. We further evaluate a tabular reinforcement-learning (Q-learning) intervention layer that selects among a small set of implementable system level levers (truck-to-rail and truck-to-barge shift settings) without overriding shipper routing, finding that such interventions reduce total losses for moderate disruptions but yield diminishing returns once substitute modes approach capacity. By linking operational freight behavior to system wide impacts under uncertainty, the proposed ABM-MRIIM pipeline provides a reusable workflow for port disruption stress testing, identification of structurally critical sectors/corridors, and evaluation of resilience interventions under realistic capacity limits.

42 ENGINEERING↗

DOE OSTI2024

Metabolic interactions shape emergent biofilm structures in a conceptual model of gut mucosal bacterial communities

Abstract The gut microbiome plays a major role in human health; however, little is known about the structural arrangement of microbes and factors governing their distribution. In this work, we present an in silico agent-based model (ABM) to conceptually simulate the dynamics of gut mucosal bacterial communities. We explored how various types of metabolic interactions, including competition, neutralism, commensalism, and mutualism, affect community structure, through nutrient consumption and metabolite exchange. Results showed that, across scenarios with different initial species abundances, cross-feeding promotes species coexistence. Morphologically, competition and neutralism resulted in segregation, while mutualism and commensalism fostered high intermixing. In addition, cooperative relations resulted in community properties with little sensitivity to the selective uptake of metabolites produced by the host. Moreover, metabolic interactions strongly influenced colonization success following the invasion of newcomer species. These results provide important insights into the utility of ABM in deciphering complex microbiome patterns.

Biotechnology & Applied Microbiology↗

NASA NTRS2012

Understanding Group/Party Affiliation Using Social Networks and Agent-Based Modeling

The dynamics of group affiliation and group dispersion is a concept that is most often studied in order for political candidates to better understand the most efficient way to conduct their campaigns. While political campaigning in the United States is a very hot topic that most politicians analyze and study, the concept of group/party affiliation presents its own area of study that producers very interesting results. One tool for examining party affiliation on a large scale is agent-based modeling (ABM), a paradigm in the modeling and simulation (M&S) field perfectly suited for aggregating individual behaviors to observe large swaths of a population. For this study agent based modeling was used in order to look at a community of agents and determine what factors can affect the group/party affiliation patterns that are present. In the agent-based model that was used for this experiment many factors were present but two main factors were used to determine the results. The results of this study show that it is possible to use agent-based modeling to explore group/party affiliation and construct a model that can mimic real world events. More importantly, the model in the study allows for the results found in a smaller community to be translated into larger experiments to determine if the results will remain present on a much larger scale.

Campbell, Kenyth↗

DOE OSTI2023

Evaluation of 6-OxP-CD, an Oxime-based cyclodextrin as a viable medical countermeasure against nerve agent poisoning: Experimental and molecular dynamic simulation studies on its inclusion complexes with cyclosarin, soman and VX

The ability of the cyclodextrin-oxime construct 6-OxP-CD to bind and degrade the nerve agents Cyclosarin (GF), Soman (GD) and S -[2-[Di(propan-2-yl)amino]ethyl] O -ethyl methylphosphonothioate (VX) has been studied using 31 P-nuclear magnetic resonance (NMR) under physiological conditions. While 6-OxP-CD was found to degrade GF instantaneously under these conditions, it was found to form an inclusion complex with GD and significantly improve its degradation (t 1/2 ~ 2 hrs) relative over background (t 1/2 ~ 22 hrs). Consequently, effective formation of the 6-OxP-CD:GD inclusion complex results in the immediate neutralization of GD and thus preventing it from inhibiting its biological target. In contrast, NMR experiments did not find evidence for an inclusion complex between 6-OxP-CD and VX, and the agent’s degradation profile was identical to that of background degradation (t 1/2 ~ 24 hrs). As a complement to this experimental work, molecular dynamics (MD) simulations coupled with Molecular Mechanics-Generalized Born Surface Area (MM-GBSA) calculations have been applied to the study of inclusion complexes between 6-OxP-CD and the three nerve agents. These studies provide data that informs the understanding of the different degradative interactions exhibited by 6-OxP-CD with each nerve agent as it is introduced in the CD cavity in two different orientations (up and down). For its complex with GF, it was found that the oxime in 6-OxP-CD lies in very close proximity (P GF …O Oxime ~ 4–5 Å) to the phosphorus center of GF in the ‘down GF ’ orientation for most of the simulation accurately describing the ability of 6-OxP-CD to degrade this nerve agent rapidly and efficiently. Further computational studies involving the center of masses (COMs) for both components (GF and 6-OxP-CD) also provided some insight on the nature of this inclusion complex. Distances between the COMs (ΔCOM) lie closer in space in the ‘down GF ’ orientation than in the ‘up GF ’ orientation; a correlation that seems to hold true not only for GF but also for its congener, GD. In the case of GD, calculations for the ‘down GD ’ orientation showed that the oxime functional group in 6-OxP-CD although lying in close proximity (P GD …O Oxime ~ 4–5 Å) to the phosphorus center of the nerve agent for most of the simulation, adopts another stable conformation that increase this distance to ~ 12–14 Å, thus explaining the ability of 6-OxP-CD to bind and degrade GD but with less efficiency as observed experimentally (t 1/2 ~ 4 hr. vs. immediate). Lastly, studies on the VX:6-OxP-CD system demonstrated that VX does not form a stable inclusion complex with the oxime-bearing cyclodextrin and as such does not interact in a way that is conducive to an accelerated degradation scenario. Collectively, these studies serve as a basic platform from which the development of new cyclodextrin scaffolds based on 6-OxP-CD can be designed in the development of medical countermeasures against these highly toxic chemical warfare agents.

60 APPLIED LIFE SCIENCES↗