Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

Simulation and Control Lab Development for Power and Energy Management for NASA Manned Deep Space Missions

The development of distributed hierarchical and agent-based control systems will allow for reliable autonomous energy management and power distribution for on-orbit missions. Power is one of the most critical systems on board a space vehicle, requiring quick response time when a fault or emergency is identified. As NASAs missions with human presence extend beyond low earth orbit autonomous control of vehicle power systems will be necessary and will need to reliably function for long periods of time. In the design of autonomous electrical power control systems there is a need to dynamically simulate and verify the EPS controller functionality prior to use on-orbit. This paper presents the work at NASA Glenn Research Center in Cleveland, Ohio where the development of a controls laboratory is being completed that will be utilized to demonstrate advanced prototype EPS controllers for space, aeronautical and terrestrial applications. The control laboratory hardware, software and application of an autonomous controller for demonstration with the ISS electrical power system is the subject of this paper.

Space Flight↗
NASA NTRS2003

Mobile Agents: A Distributed Voice-Commanded Sensory and Robotic System for Surface EVA Assistance

A model-based, distributed architecture integrates diverse components in a system designed for lunar and planetary surface operations: spacesuit biosensors, cameras, GPS, and a robotic assistant. The system transmits data and assists communication between the extra-vehicular activity (EVA) astronauts, the crew in a local habitat, and a remote mission support team. Software processes ("agents"), implemented in a system called Brahms, run on multiple, mobile platforms, including the spacesuit backpacks, all-terrain vehicles, and robot. These "mobile agents" interpret and transform available data to help people and robotic systems coordinate their actions to make operations more safe and efficient. Different types of agents relate platforms to each other ("proxy agents"), devices to software ("comm agents"), and people to the system ("personal agents"). A state-of-the-art spoken dialogue interface enables people to communicate with their personal agents, supporting a speech-driven navigation and scheduling tool, field observation record, and rover command system. An important aspect of the engineering methodology involves first simulating the entire hardware and software system in Brahms, and then configuring the agents into a runtime system. Design of mobile agent functionality has been based on ethnographic observation of scientists working in Mars analog settings in the High Canadian Arctic on Devon Island and the southeast Utah desert. The Mobile Agents system is developed iteratively in the context of use, with people doing authentic work. This paper provides a brief introduction to the architecture and emphasizes the method of empirical requirements analysis, through which observation, modeling, design, and testing are integrated in simulated EVA operations.

Clancey, William J.↗
DOE OSTI2025

ATEAM4Py: An Efficient and Scalable Python-Based Model for Charging Demand

This report details the development and implementation of ATEAM4Py, a Python-based simulation model that projects demand for battery electric vehicle (BEV) charging based on adoption trends and consumer behavior. With Exelon’s support, Argonne National Laboratory converted the original Java-based Agent-based Transportation Energy Analysis Model (ATEAM) into Python, resulting in a faster and more efficient tool for forecasting the timing, location, and scale of charging demand growth. ATEAM4Py tackles key challenges in simulation efficiency and runtime, supporting the strategic development of cost-effective grid capacity expansion strategies and ensuring reliable service for stakeholders.

33 ADVANCED PROPULSION SYSTEMS↗
NASA NTRS1973

Evaluation of proposed Skylab and SSP soap products.

Four candidate cleansing agents evaluated in terms of potential hazards to crew members included two soaps (Neutrogena bar soap and Olive Leaf Liquid), one nonfoaming surfactant (Miranol JEM), and one laundry detergent (sodium dodecylbenzene sulfonate). None of the four exhibited adverse dermatological effects from skin patch tests or supported growth of potentially pathogenic microorganisms. Aqueous solutions of Neutrogena did support a mold species. Neutrogena and Miranol JEM were used in a simulated Skylab personal hygiene regimen with no adverse effects on skin or skin microflora. Based on our results, each of these agents appear to be a promising candidate material for the use intended.

Durfee, R. L.↗
DOE OSTI2025

DISTRI: Distributed Multi-Facility HPC Simulator (DISTRI) v2.1

DISTRI is an advanced network simulator designed for multi-facility computational infrastructures with agentic behavior. It simulates HPC facilities where computational resources act as autonomous agents, making intelligent decisions about job scheduling, load balancing, and resource allocation. The simulator focuses on developing and testing decentralized algorithms that promote resilience and efficiency in multi-facility environments. Key Features: - Agentic Resource Behavior: Processors and DTNs act as autonomous agents with decision-making capabilities - Pheromone-Based Load Balancing: Decentralized load balancing inspired by ant colony optimization - Dual Topology Support: Mesh (normal operations) and Dumbell (network testing) topologies - Comprehensive TCP Simulation: Realistic TCP implementations with multiple congestion control algorithms - Failure Resilience Testing: Processor failure simulation with automatic job reassignment - Extensive Visualization: Detailed performance analysis and metrics collection - Research-Ready: Designed for algorithm development and benchmarking

Bez, Jean Luca [Lawrence Berkeley National Laborat↗
DOE OSTI2025

Pricing Strategy of Electric Vehicle Aggregators Based on Locational Marginal Price to Minimize Photovoltaic (PV) Curtailment

The global climate crisis demands urgent action to mitigate global warming. Using renewable energy sources, such as solar and wind power, for electricity generation is crucial. This shift from centralized to distributed power systems, however, brings challenges, including voltage fluctuations and renewable energy curtailment. The rapid growth of the electric vehicle (EV) industry adds complexity, increasing overall electricity demand and straining the power supply during peak charging times. This paper proposes a scheduling strategy for EV aggregators to reduce renewable energy curtailment and stabilize grid operation by strategically scheduling EV charging. Using Multi -Agent Transport Simulation (MATSim), a traffic simulation tool, EV driving data in Denver, Colorado, USA, were modeled. The EV aggregator adjusts charging fees based on locational marginal prices, encouraging EVs to charge at different stations according to pricing. Simulations on an IEEE 33-bus system with distributed energy resources and EV charging stations validate the proposed algorithm, demonstrating its effectiveness in reducing curtailment by 12.55% and stabilizing grid operation.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Deep reinforcement learning with online data augmentation to improve sample efficiency for intelligent HVAC control

Deep Reinforcement Learning (DRL) has started showing success in real-world applications such as building energy optimization. Much of the research in this space utilized simulated environments to train RL-agent in an offline mode. Very few research have used DRL-based control in real-world systems due to two main reasons: 1) sample efficiency challenge---DRL approaches need to perform a lot of interactions with the environment to collect sufficient experiences to learn from, which is difficult in real systems, and 2) comfort or safety related constraints---user's comfort must never or at least rarely be violated. In this work, we propose a novel deep Reinforcement Learning framework with online Data Augmentation (RLDA) to address the sample efficiency challenge of real-world RL. We used a time series Generative Adversarial Network (TimeGAN) architecture as a data generator. We further evaluated the proposed RLDA framework using a case study of an intelligent HVAC control. With a ≈28% improvement in the sample efficiency, RLDA framework lays the way towards increased adoption of DRL-based intelligent control in real-world building energy management systems.

Kurte, Kuldeep↗
NASA NTRS2001

Adjustable Autonomy Testbed

The Adjustable Autonomy Testbed (AAT) is a simulation-based testbed located in the Intelligent Systems Laboratory in the Automation, Robotics and Simulation Division at NASA Johnson Space Center. The purpose of the testbed is to support evaluation and validation of prototypes of adjustable autonomous agent software for control and fault management for complex systems. The AA T project has developed prototype adjustable autonomous agent software and human interfaces for cooperative fault management. This software builds on current autonomous agent technology by altering the architecture, components and interfaces for effective teamwork between autonomous systems and human experts. Autonomous agents include a planner, flexible executive, low level control and deductive model-based fault isolation. Adjustable autonomy is intended to increase the flexibility and effectiveness of fault management with an autonomous system. The test domain for this work is control of advanced life support systems for habitats for planetary exploration. The CONFIG hybrid discrete event simulation environment provides flexible and dynamically reconfigurable models of the behavior of components and fluids in the life support systems. Both discrete event and continuous (discrete time) simulation are supported, and flows and pressures are computed globally. This provides fast dynamic simulations of interacting hardware systems in closed loops that can be reconfigured during operations scenarios, producing complex cascading effects of operations and failures. Current object-oriented model libraries support modeling of fluid systems, and models have been developed of physico-chemical and biological subsystems for processing advanced life support gases. In FY01, water recovery system models will be developed.

Malin, Jane T.↗
DOE OSTI2023

Generating Mixed Patterns of Residential Segregation: An Evolutionary Approach

The Schelling model of residential segregation has demonstrated that even the slightest preference for neighbors of the same race can be amplified into community-wide segregation. However, these models are unable to simulate mixed, coexisting patterns of segregation and integration, which have been seen to exist in cities. Using evolutionary model discovery we demonstrate how including social factors beyond racial bias when modeling relocation behavior enables the emergence of strongly mixed patterns. Our results indicate that the emergence of mixed patterns is better explained by multiple factors influencing the decision to relocate; the most important being the interaction of nonlinear, rapidly diminishing racial bias with a recent, historical tendency to move. Additionally, preference for less isolated neighborhoods or preference for neighborhoods with longer residing neighbors may produce weaker mixed patterns. Finally, this work highlights the importance of exploring the influence of multiple hypothesized factors of decision making, and their interactions, within agent rules, when studying emergent outcomes generated by agent-based models of complex social systems.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1990

Pharmacokinetics and Pharmacodynamics in Space

The Pharmacokinetics and Pharmacodynamics Panel met on 29-30 Aug. 1988 at the Lunar and Planetary Institute in Houston, Texas to discuss pharmacokinetic and pharmacodynamic implications of space flight and make recommendations for operational and research strategies. Based on the knowledge available on the physiological changes that occur during space flight, the dependence of pharmacokinetics on physiological factors, and the therapeutic requirements for future space missions, the panel made several recommendations for research. It was suggested that using medications available with a large (wide) therapeutic window will avoid unforeseen therapeutic consequences during flight. The sequence for conducting research was outlined as follows: (1) identify ground-based simulation models (e.g., antiorthostatic bed rest) for conducting pharmacokinetic and pharmacodynamic research; (2) estimate parametric changes in these models using pharmacologic agents that have different pharmacokinetic characteristics and a narrow therapeutic index; (3) verify these findings during flight; and (4) develop and identify appropriate and effective drug delivery systems, dosage forms, and regimens. The panel recommended gaining a thorough understanding of the pharmacokinetic deviations of medications that have a narrow therapeutic index (e.g. cardiovascular drugs and sedative hypnotics) in order to ensure safe and effective treatment during flight with these agents. It was also suggested that basic information on physiological factors such as organ blood flow, protein composition and binding, tissue distribution, and metabolism by hepatic enzymes must be accumulated by conducting ground-based animal and human studies using models of weightlessness. This information will be useful to construct and identify physiologically based pharmacokinetic models that can provide valuable information on the pharmacodynamic consequences of space flight and aid in identifying appropriate therapeutic regimens.

Putcha, Lakshmi↗
DOE OSTI2023

mosartwmpy sample input data; 1980 - 1985

Sample input data spanning the years 1980-1985 for running the `mosartwmpy` water routing and management model: https://github.com/IMMM-SFA/mosartwmpy. More information is available in the README.md. Changelog: v0.0.7: new reservoir files with corrected locations based on an exhaustive review by Dan Broman for the 9505 project; corresponding long term mean demand and flow files updated based on VIC4 simulations using Daymet forcing. v0.0.6: updates reservoir parameters to indicate which reservoirs should follow generic operating rules and which should follow ISTARF data-driven operating rules. v0.0.5: adds supporting files for running the Farmer Agent Based Model of adaptive water demand.

Rexer, Emily↗
DOE OSTI2026

mosartwmpy sample input data; 1980 - 1985

Sample input data spanning the years 1980-1985 for running the `mosartwmpy` water routing and management model: https://github.com/IMMM-SFA/mosartwmpy. More information is available in the README.md. Changelog: v0.0.8: Update with new CAP_MIN reservoir parameter, corresponds with mosartwmpy v1.0.0 v0.0.7: new reservoir files with corrected locations based on an exhaustive review by Dan Broman for the 9505 project; corresponding long term mean demand and flow files updated based on VIC4 simulations using Daymet forcing. v0.0.6: updates reservoir parameters to indicate which reservoirs should follow generic operating rules and which should follow ISTARF data-driven operating rules. v0.0.5: adds supporting files for running the Farmer Agent Based Model of adaptive water demand.

Bracken, Cameron [Pacific Northwest National Labor↗
DOE OSTI2020

Data analysis and modeling pipelines for controlled networked social science experiments

There is large interest in networked social science experiments for understanding human behavior at-scale. Significant effort is required to perform data analytics on experimental outputs and for computational modeling of custom experiments. Moreover, experiments and modeling are often performed in a cycle, enabling iterative experimental refinement and data modeling to uncover interesting insights and to generate/refute hypotheses about social behaviors. The current practice for social analysts is to develop tailor-made computer programs and analytical scripts for experiments and modeling. This often leads to inefficiencies and duplication of effort. In this work, we propose a pipeline framework to take a significant step towards overcoming these challenges. Our contribution is to describe the design and implementation of a software system to automate many of the steps involved in analyzing social science experimental data, building models to capture the behavior of human subjects, and providing data to test hypotheses. The proposed pipeline framework consists of formal models, formal algorithms, and theoretical models as the basis for the design and implementation. We propose a formal data model, such that if an experiment can be described in terms of this model, then our pipeline software can be used to analyze data efficiently. The merits of the proposed pipeline framework is elaborated by several case studies of networked social science experiments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Calibration verification for stochastic agent-based disease spread models

Accurate disease spread modeling is crucial for identifying the severity of outbreaks and planning effective mitigation efforts. To be reliable when applied to new outbreaks, model calibration techniques must be robust. However, current methods frequently forgo calibration verification (a stand-alone process evaluating the calibration procedure) and instead use overall model validation (a process comparing calibrated model results to data) to check calibration processes, which may conceal errors in calibration. In this work, we develop a stochastic agent-based disease spread model to act as a testing environment as we test two calibration methods using simulation-based calibration, which is a synthetic data calibration verification method. The first calibration method is a Bayesian inference approach using an empirically-constructed likelihood and Markov chain Monte Carlo (MCMC) sampling, while the second method is a likelihood-free approach using approximate Bayesian computation (ABC). Simulation-based calibration suggests that there are challenges with the empirical likelihood calculation used in the first calibration method in this context. These issues are alleviated in the ABC approach. Despite these challenges, we note that the first calibration method performs well in a synthetic data model validation test similar to those common in disease spread modeling literature. We conclude that stand-alone calibration verification using synthetic data may benefit epidemiological researchers in identifying model calibration challenges that may be difficult to identify with other commonly used model validation techniques.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Trust in News as Moderated by Known Truth Assessments and Source

Disinformation has become a problem in various spaces, from social media to organizations. Given the lack of evidence and transparency surrounding organizational disinformation, we aim to understand issue of information exposure effect and source trust from the lens of traditional information consumption online. Using an online experiment and multi-level mixed-effects modeling, we find that the exposure effect exists even over only two exposures to a headline, as long as participants are not shown fact-checking. Fact-checking can be effective in reducing the impact of the exposure effect. Additionally, we find that participants trusted sources significantly more before seeing the headlines. The possible presence of disinformation reduces trust in sources, even when considered highly neutral and reputable. These findings can inform simulations of agent interactions with misinformation as well as future experimental designs focused on evaluations of belief and trust based on recognizability of a source.

99 GENERAL AND MISCELLANEOUS↗
NASA NTRS2001

A component based implementation of agents and brokers for design coordination

NASA's mission design coordination has been based on expert opinion of parametric data presented in Excel or Powerpoint. Common access is required to more powerful design tools supporting performance simulation and analysis. Components provide the means for inexpensively adding the desired functionality.

agents components↗
DOE OSTI2022

Discovering mechanisms for materials microstructure optimization via reinforcement learning of a generative model

Abstract The design of materials structure for optimizing functional properties and potentially, the discovery of novel behaviors is a keystone problem in materials science. In many cases microstructural models underpinning materials functionality are available and well understood. However, optimization of average properties via microstructural engineering often leads to combinatorically intractable problems. Here, we explore the use of the reinforcement learning (RL) for microstructure optimization targeting the discovery of the physical mechanisms behind enhanced functionalities. We illustrate that RL can provide insights into the mechanisms driving properties of interest in a 2D discrete Landau ferroelectrics simulator. Intriguingly, we find that non-trivial phenomena emerge if the rewards are assigned to favor physically impossible tasks, which we illustrate through rewarding RL agents to rotate polarization vectors to energetically unfavorable positions. We further find that strategies to induce polarization curl can be non-intuitive, based on analysis of learned agent policies. This study suggests that RL is a promising machine learning method for material design optimization tasks, and for better understanding the dynamics of microstructural simulations.

36 MATERIALS SCIENCE↗