Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

System-of-systems optimization of hydrogen infrastructure for heavy-duty freight corridors: The interstate 10 case study

Medium and heavy-duty freight transportation requires hydrogen energy infrastructure that is cost-effective, operationally reliable, spatially coherent, and resilient to demand variability along major corridors. This paper presents an integrated hydrogen corridor planning framework using Oak Ridge National Laboratory's OR-AGENT that couples freight-driven, route-resolved hydrogen demand modeling with optimized station siting, sizing, and station-level techno-economic analysis. The framework is demonstrated for the Interstate 10 freight corridor and the Houston-to-Los-Angeles region. Hydrogen demand is derived from high-resolution origin–destination freight data, duty-cycle characterization, and physics-based energy consumption modeling. Candidate refueling sites are selected from existing heavy-duty diesel fueling locations and optimized subject to onboard storage and station capacity constraints. Resulting station throughputs are evaluated using established techno-economic models for electrolytic hydrogen production and dispensing infrastructure. Results show that a regional, portfolio-level aggregation, average dispensed electrolytic hydrogen cost of $6.87–$7.26/kg is currently feasible, and is strongly influenced by demand density and utilization.

Sujan, Vivek [ORNL] (ORCID:0000000269882342)↗

Feedback Power Cost Optimization in Power Distribution Networks with Prosumers

Here, we propose a feedback control approach for solving optimal power flow (OPF) problems in power distribution networks (DNs) based on a projected gradient scheme, where the cost is given by the sum of functions of local power injections. This approach does not require detailed knowledge of the grid model and enables real-time tracking of the optimal generation configuration. Moreover, the communication burden is minimal: only a broadcast from a central entity, called the Network Supervisor (NS), to the agents in the network is needed. Hence, agents do not have to share local information that can be sensitive, e.g., their power injections or the value of the local costs. Our approach is then used to solve a particular OPF problem targeting DNs with high penetration of distributed energy resources (DERs) in which the energy cost is given by the remuneration that the DERs owners receive for the service they provide.

24 POWER TRANSMISSION AND DISTRIBUTION↗

CodeScribe Agent

SF-26-086 CodeScribe introduces a structured, multi-stage pipeline that combines deterministic program analysis with LLM-powered translation to enable incremental, testable Fortran-to-C++ migration. First, `code-scribe index` traverses the project directory tree and produces `scribe.yaml` metadata files recording all modules, subroutines, and functions at each level, giving the LLM accurate structural context instead of a hallucinated codebase model. Second, `code-scribe draft` performs the deterministic portion of translation — converting Fortran types to C++ equivalents, replacing `use` statements with `#include` and `using namespace` directives, and detecting constructs requiring special handling — while embedding`scribe-prompt` annotations that guide the LLM through non-trivial cases such as statement-function-to-lambda conversions and `extern "C"` wrapper generation. Third, `code-scribe translate` applies project-specific TOML-based few-shot prompt templates and submits the composed prompt to a pluggable LLM backend (OpenAI, Anthropic, Argonne ARGO, any OpenAI-compatible endpoint, or local Hugging Face checkpoints), producing a C++ source file, a header, and a Fortran-C++ interface file for each translated routine so the codebase compiles and runs correctly throughout the migration. Beyond translation, CodeScribe includes a tool-using coding agent (`code-scribe agent`) with read, bash, edit, and write capabilities, and a bounded loop mode (`code-scribe loop`) that runs repeated stateless agent sessions over a task file with restricted tool access — enabling sustained, auditable software development workflows for broader scientific computing tasks.

Dhruv, Akash [Argonne National Laboratory (ANL), A↗

Race conditions and data partitioning: risks posed by common errors to reproducible parallel simulations

When parallel algorithms for simulation were introduced in the 1970s, their development and use interested only experts in parallel computation. This circumstance changed as multi-core processors became commonplace, putting a parallel computer into the hands of every modeler. A natural outcome is growing interest in parallel simulation among persons not intimately familiar with parallel computing. At the same time, parallel simulation tools continue to be developed with the implicit assumption that the modeler is knowledgeable about parallel programming. The unintended consequence is a rapidly growing number of users of parallel simulation tools that are unlikely to recognize when the interaction of race conditions, partitioning strategies, and simultaneous action in their simulation models make results non-reproducible, thereby calling into question the validity of conclusions drawn from the simulation data. Here, we illustrate the potential dangers of exposing parallel algorithms to users who are not experts in parallel computation with example models constructed using existing parallel simulation tools. By doing so, we hope to refocus tool developers on usability, even if this new focus incurs loss of some performance.

97 MATHEMATICS AND COMPUTING↗

RLC4CLR (Reinforcement Learning Controller for Critical Load Restoration Problems)

RLC4CLR demonstrates using a reinforcement learning controller (RLC) to solve a critical load restoration (CLR) problem, which improves the grid resilience after a substation outage event. RLC4CLR consists of two parts. (1) RL environment: This environment encapsulates the CLR problem to be solved and provides interfacing functions to follow the standard OpenAI Gym format. A power system simulator, i.e., OpenDSS, is included to provide the power flow solution. Controller inputs and outputs (RL state and action) as well as the reward are defined in this environment as well. In summary, the RL environment is the problem formulation from which the RL agent can learn. (2) RL training script: The training script enables the RL agent to learn its control policy by interacting with the RL environment. For RL training, an open-sourced RL library, i.e., RLlib, is leveraged which is based on a distributed computing framework (Ray). The training script is designed to be able to be run on both local machine or the NREL HPC system. Other components of RLC4CLR include input data, e.g., grid model (standard IEEE test feeders), and other files used for results analysis.

Zhang, Xiangyu↗

Intumescent coating modeling

A thermal response mathematical model for an intumescent coating system is developed. The model predicts indepth temperature profiles of the solid as a function of the fundamental kinetic, mass, and heat-transfer properties of the original coating system. In the model, swelling is based on an empirical function of the paint's weight loss. The model is used to describe the effectiveness of the coating for thermal protection. Using the thermal response time at the backface of the material as a criterion, a sensitivity analysis is made with respect to variation in individual properties, such as total expansion, to provide a guide for designing improved intumescing agents. The sensitivity analysis shows that total expansion and rate of expansion, along with other material properties, are important parameters for providing thermal protection. Finally, backface temperature histories are predicted and compared to experimental data obtained from a representative fire environment. Predicted temperatures agree within a maximum error of plus or minus 20%.

Cagliostro, D. E.↗

Adaptive Sensing of Time Series with Application to Remote Exploration

We address the problem of adaptive informationoptimal data collection in time series. Here a remote sensor or explorer agent throttles its sampling rate in order to track anomalous events while obeying constraints on time and power. This problem is challenging because the agent has limited visibility -- all collected datapoints lie in the past, but its resource allocation decisions require predicting far into the future. Our solution is to continually fit a Gaussian process model to the latest data and optimize the sampling plan on line to maximize information gain. We compare the performance characteristics of stationary and nonstationary Gaussian process models. We also describe an application based on geologic analysis during planetary rover exploration. Here adaptive sampling can improve coverage of localized anomalies and potentially benefit mission science yield of long autonomous traverses.

artificial intelligence↗

The DOE E3SM Model Version 2: Overview of the Physical Model and Initial Model Evaluation

Abstract This work documents version two of the Department of Energy's Energy Exascale Earth System Model (E3SM). E3SMv2 is a significant evolution from its predecessor E3SMv1, resulting in a model that is nearly twice as fast and with a simulated climate that is improved in many metrics. We describe the physical climate model in its lower horizontal resolution configuration consisting of 110 km atmosphere, 165 km land, 0.5° river routing model, and an ocean and sea ice with mesh spacing varying between 60 km in the mid‐latitudes and 30 km at the equator and poles. The model performance is evaluated with Coupled Model Intercomparison Project Phase 6 Diagnosis, Evaluation, and Characterization of Klima simulations augmented with historical simulations as well as simulations to evaluate impacts of different forcing agents. The simulated climate has many realistic features of the climate system, with notable improvements in clouds and precipitation compared to E3SMv1. E3SMv1 suffered from an excessively high equilibrium climate sensitivity (ECS) of 5.3 K. In E3SMv2, ECS is reduced to 4.0 K which is now within the plausible range based on a recent World Climate Research Program assessment. However, a number of important biases remain including a weak Atlantic Meridional Overturning Circulation, deficiencies in the characteristics and spectral distribution of tropical atmospheric variability, and a significant underestimation of the observed warming in the second half of the historical period. An analysis of single‐forcing simulations indicates that correcting the historical temperature bias would require a substantial reduction in the magnitude of the aerosol‐related forcing.

54 ENVIRONMENTAL SCIENCES↗

Impacts of anthropogenic gadolinium on the activity of the ammonia oxidizing bacterium Nitrosomonas europaea

Widespread use of gadolinium-based contrast agents in medical imaging has resulted in increased Gd inputs to municipal wastewater treatment plants. Others have reported that typical wastewater treatment does not attenuate Gd, resulting in discharges to natural waters. However, whether elevated Gd impacts the performance of biological treatment has not been investigated. We examined whether gadolinium chloride or Gd chelated with diethylenetriaminepentaacetic acid (DTPA) affected the activity of the model nitrifying bacterium Nitrosomonas europaea. At nominal GdCl 3 additions ranging from 1 to 500 µM, no impact was observed compared to the control. Most (>98%) of the added Gd precipitated, and extracellular GdPO 4 nanoparticles were observed. When chelated with DTPA, Gd remained soluble, but no statistically significant impact on ammonia oxidation was observed until the highest concentrations tested. At 300 and 500 µM Gd-DTPA, a temporary reduction of nitrite production relative to the control (effect size 1.3 mg l -1 and 1.5 mg l -1 , respectively, at 24 h) was seen. By itself, DTPA was highly inhibitory. Modeling suggested that DTPA likely chelated other metals, but adjusting the concentrations of the most abundant metals in the medium, calcium and magnesium, indicated that lowering their free ion activities was probably not the cause of inhibition. Complexation of other essential metals was more likely. Furthermore, our studies indicate that while the low bioavailability of Gd may limit its ecosystem impacts, the role of synthetic ligands used with Gd and other rare earth elements should e considered as the production, use and disposal of these elements increases.

54 ENVIRONMENTAL SCIENCES↗

Optimization-based approaches to control of connected and automated vehicles: Principles, complexities, applications, challenges, and outlook

Safe and optimal motion control for connected and automated vehicles (CAVs) poses a fundamental optimization challenge at the intersection of system complexity, environmental uncertainty, and stringent real-time constraints. Existing surveys address this challenge in isolation – focusing either on specific control techniques or individual uncertainty sources – without providing a unified framework that characterizes the trade-offs among computational tractability, performance verifiability, and adaptive generalization across paradigms. This review addresses that gap by presenting a cohesive analytical framework concentrated on the decision-making and trajectory optimization layers of the CAV autonomy stack. We systematically analyze three major optimization paradigms – first-principles model-based optimization, data-driven methods, and hybrid synergistic architectures – evaluating each against four core complexity axes: problem formulation, constraint handling, optimality guarantees, and robustness. Key applications including platooning, trajectory planning, collision avoidance, and cooperative control are examined to reveal recurring methodological patterns and critical operational constraints that limit real-world performance. Our synthesis identifies verifiable hybrid architectures, incentive-aligned multi-agent cooperation, and hardware-algorithm co-design as the defining research frontiers, and distills a targeted agenda for developing CAV control systems that are simultaneously safe, computationally efficient, and deployable in the full complexity of real-world traffic environments.

Muzahid, Abu Jafar Md [University of Tennessee, Kn↗

Suppression Characteristics of Cup-Burner Flames in Low Gravity

The structure and suppression of laminar methane-air co-flow diffusion flames formed on a cup burner have been studied experimentally and numerically using physically acting fire-extinguishing agents (CO2, N2, He, and Ar) in normal earth (lg) and zero gravity (0g). The computation uses a direct numerical simulation with detailed chemistry and radiative heat-loss models. An initial observation of the flame without agent was also made at the NASA Glenn 2.2-Second Drop Tower. An agent was introduced into a low-speed coflowing oxidizing stream by gradually replacing the air until extinguishment occurred under a fixed minimal fuel velocity. The suppression of cup-burner flames, which resemble real fires, occurred via a blowoff process (in which the flame base drifted downstream) rather than the global extinction phenomenon typical of counterflow diffusion flames. The computation revealed that the peak reactivity spot (the reaction kernel) formed in the flame base was responsible for attachment and blowoff phenomena of the trailing diffusion flame. The thermal and transport properties of the agents affected the flame extinguishment limits.

Takahashi, Fumiaki↗

Large-Scale Traveling Weather Systems in Mars Southern Extratropics

Between late fall and early spring, Mars' middle- and high-latitude atmosphere supports strong mean equator-to-pole temperature contrasts and an accompanying mean westerly polar vortex. Observations from both the MGS Thermal Emission Spectrometer (TES) and the MRO Mars Climate Sounder (MCS) indicate that a mean baroclinicity-barotropicity supports intense, large-scale eastward traveling weather systems (i.e., transient synoptic-period waves). Such extratropical weather disturbances are critical components of the global circulation as they serve as agents in the transport of heat and momentum, and generalized scalar/tracer quantities (e.g., atmospheric dust, water-vapor and ice clouds). The character of such traveling extratropical synoptic disturbances in Mars' southern hemisphere during late winter through early spring is investigated using a moderately high-resolution Mars global climate model (Mars GCM). This Mars GCM imposes interactively-lifted and radiatively-active dust based on a threshold value of the surface stress. The model exhibits a reasonable "dust cycle" (i.e., globally averaged, a dustier atmosphere during southern spring and summer occurs). Compared to the northern-hemisphere counterparts, the southern synoptic-period weather disturbances and accompanying frontal waves have smaller meridional and zonal scales, and are far less intense. Influences of the zonally asymmetric (i.e., east-west varying) topography on southern large-scale weather are investigated, in addition to large-scale up-slope/down-slope flows and the diurnal cycle. A southern storm zone in late winter and early spring presents in the western hemisphere via orographic influences from the Tharsis highlands, and the Argyre and Hellas impact basins. Geographically localized transient-wave activity diagnostics are constructed that illuminate dynamical differences amongst the simulations and these are presented.

Hollingsworth, Jeffery L.↗

Human-Centered Technologies and Procedures for Future Air Traffic Management: A Preliminary Overview of 1996 Studies and Results

In this project, we have been exploring the use of a general methodology to predict the impact of future Air Traffic Management (ATM) concepts and technologies. In applying this methodology, our emphasis has been on the importance of modeling coordination and cooperation among the multiple agents within this system, and on understanding how the interactions among these agents will be influenced as new roles, responsibilities, procedures and technologies are introduced. To accomplish this, we have been collecting data on performance under the current air traffic management system, trying to identify critical problem areas and looking for exemplars suggestive of general approaches for solving such problems. Based on the results of these field studies, we have developed a set of scenarios centered around potential future system designs, and have conducted studies using these scenarios involving a total 40 controllers, dispatchers, pilots and traffic managers. The purpose of this report is to provide NASA with an early summary of the major recommendations that have resulted from our research under the AATT Program thus far. Recommendations 1-3 deal with general approaches that our findings suggest should be incorporated in future AATT Program activities, while Recommendations 4-11 identify some specific topics and technologies that merit research and development activities. Detailed technical reports containing supporting data, as well as the results of our still ongoing analyses, will be provided at a later date. The remainder of this report is organized as follows. Section 1 briefly describes the general design philosophy supported by our empirical studies. Section 2 presents the research methods we have used for identifying requirements for future system designs and for evaluating alternative design solutions. Section 3 discusses preliminary results from an initial set of investigations that we have conducted using these research methods. Section 4 then provides an overall summary. An outline of the rest of this preliminary project summary is provided on the following page.

Smith, Philip↗

Understanding of three different polyvinylpyrrolidone (PVP) based battery binders blends on graphene surfaces from first principles via DFT simulations

Binders play a crucial role in binding electrodes, current collectors, and conductive agents during battery manufacturing. The selection of the binders and their blends considerably affect various properties such as mechanical durability, adhesion performance, ionic/electronic conductivities, and solid electrolyte interface stability for lithium-ion batteries. In this work, polyvinylidene di-fluoride (PVDF), polyacrylic acid (PAA), polyvinylpyrrolidone (PVP), and lithiated polyacrylic acid (Li-PAA) were selected as the model binders, and their blends were studied on graphene surfaces. Further, among them, PVDF is hardly soluble in water unlike the other binders, so in practice, the blend of PVP:PVDF is not thought to be a proper combination. However, the PVP:PVDF binder has also been included because the purpose of this work is to calculate several electronic properties such as binding energies, intermolecular interaction energies, bond critical points, electron density, and the Laplacian of electron density at critical bonding regions of all these blends at the molecular level via density functional theory (DFT) simulations in order to evaluate and compare how is the interaction strength and bonding type of three different lithium-ion batteries (LIBs) binder blends on graphene surfaces. Most stable binder pairs and their binding mechanisms on graphene surfaces were studied. The delocalization of lithium in Li-PAA was studied with the presence of water.

25 ENERGY STORAGE↗

A Real-time Agent Based Optimization and Control Approach for Residential Building Heating Ventilation and Air Conditioning Systems

The prevalence of the loT (Internet of Things) is fostering the development of new control options and decision making that was not previously available. This is creating a wealth of opportunities for real-time control approaches and systems that can optimize for a common goal. This paper presents a smart residential neighborhood with optimization at the residential level utilizing a system of agents. The optimization utilizes information and modeling to optimize variable speed HVAC real-time operation in actual residential buildings. Data is presented showing the performance of the optimization and conclusions are drawn on next steps for development.

Hall, Joni↗

Constrained Deep Reinforcement Learning for Energy Sustainable Multi-UAV Based Random Access IoT Networks With NOMA

In this paper, we apply the Non-Orthogonal Multiple Access (NOMA) technique to improve the massive channel access of a wireless IoT network where solar-powered Unmanned Aerial Vehicles (UAVs) relay data from IoT devices to remote servers. Specifically, IoT devices contend for accessing the shared wireless channel using an adaptive p-persistent slotted Aloha protocol; and the solar-powered UAVs adopt Successive Interference Cancellation (SIC) to decode multiple received data from IoT devices to improve access efficiency. To enable an energy-sustainable capacity-optimal network, we study the joint problem of dynamic multi-UAV altitude control and multi-cell wireless channel access management of IoT devices as a stochastic control problem with multiple energy constraints. We first formulate this problem as a Constrained Markov Decision Process (CMDP), and propose an online model-free Constrained Deep Reinforcement Learning (CDRL) algorithm based on Lagrangian primal-dual policy optimization to solve the CMDP. Extensive simulations demonstrate that our proposed algorithm learns a cooperative policy in which the altitude of UAVs and channel access probability of IoT devices are dynamically controlled to attain the maximal long-term network capacity while ensuring energy sustainability of UAVs, outperforming baseline schemes. The proposed CDRL agent can be trained on a small network, yet the learned policy can efficiently manage networks with a massive number of IoT devices and varying initial states, which can amortize the cost of training the CDRL agent.

42 ENGINEERING↗

Reinforcement Learning for In-Spill Optimization of the Mu2e Resonant Extraction: Compensating Non-Stationarity

We present design considerations and challenges for the fast machine learning component of a third-order resonant beam extraction regulation system being commissioned to deliver steady beam rates to the mu2e experiment at Fermilab. Dedicated quadrupoles drive the tune toward the 29/3 resonance each spill, extracting beam at kV multiwire septa. The overall Spill Regulation System consists of (1) a “slow” process using ~100-spill averages to adjust the base quad ramp infrequently, (2) a feedforward harmonic content compensator, and (3) the “fast” ML agent reacting during each ongoing spill with on-the-fly additive corrections to the sum of (1) and (2). We have demonstrated improved beam-rate steadying for a fast ML agent compared to a PID controller using a quasi-physical spill simulation, and demonstrated distillation of that simulation into a predictive surrogate model. Current work includes a data-and-training pipeline to generate data-aware surrogates with real-world dynamics, even as the dynamics shift unpredictably. The surrogates are to act as RL environments against which to train our fast ML control agents before deploying them on FPGA in the live system. Further current efforts focus on modeling and controlling beam loss around the storage ring, understanding additional available hardware inputs to the model, and the interplay of these with beam-steadying performance.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

High-Resolution Mapping of Lunar Crustal Magnetic Fields: Correlations with Albedo Markings of the Reiner Gamma Class

During the last eight months of the Lunar Prospector mission (December 1999-July 1999), the spacecraft was placed in a relatively low-altitude (15-30-km perapsis), near-polar orbit that allowed high-resolution mapping of crustal magnetic fields. We report here initial studies of the correlation of locally strong magnetic anomalies with unusual, swirl-like albedo markings of the Reiner Gamma class. Based on this correlation, which is known from earlier studies of Apollo subsatellite magnetometer data, it has been proposed that the swirls represent regions whose higher albedos have been preserved via deflection of the solar-wind ion bombardment by strong crustal fields. This model in turn depends on the hypothesis that solar-wind implanted H is at least one component of the process that optically matures exposed silicate surfaces in the inner solar system . Specifically, it is hypothesized that implanted H acts as an effective reducing agent to enhance the rate of production of nanophase metallic Fe particles from preexisting silicates during micrometeoroid impacts. According to the model, the curvilinear shapes of these albedo markings are caused, at least in part, by the geometry of ion deflections in a magnetic field. The improved resolution and coverage of the Prospector data allow more detailed mapping of the fields, especially on the lunar farside. This permits a more quantitative test of whether all albedo markings of this class are associated with strong local magnetic fields.Only if the latter condition is met can the solar-wind deflection hypothesis he valid. The basic procedure for mapping crustal magnetic fields using Lunar Prospector magnetometer data follows that developed for analysis of Apollo subsatellite magnetometer data. The specific mapping steps are (1) selection of mission time intervals suitable for mapping crustal fields; these are limited essentially either to times when the Moon is in a lobe of the geomagnetic tail or to times when the Moon is in the solar wind but the spacecraft is in the lunar wake; the data are transformed to a radial, east, and north coordinate system with measurements given as a function of spacecraft latitude, longitude, and altitude; (2) visual editing of individual orbit segments selected for minimal external field disturbances; (3) minimization of remaining low-frequency external fields for individual orbit data segments by quadratic detrending; and (4) two-dimensional filtering of individual orbit segments to produce a vector field map along the slightly curved surface defined by the spacecraft altitude; maps of the three field components (radial, east, and north), the field magnitude, and the spacecraft altitude are constructed. For data obtained at low to middle latitudes, the horizontal resolution of the field maps is limited by the orbit-track separation (about 30 km at the equator). Maps of the field magnitude have been constructed within limited selenographic regions based mainly on data acquired in March, April, and May of 1999. This was a time period when the orbit plane was nearly aligned with the Sun-Moon line so that field mapping was possible at times when the Moon was in the solar wind as well as when the Moon was in the geomagnetic tail. Most of the coverage is across the lunar farside. However, a shows an example of a field map produced from solar-wind wake data for a region including Reiner Gamm on western Oceanus Procellarum (location: 58.5W, 7.5N). The contour interval is 3 nT and the mean spacecraft altitude is 18 km to within the accuracy allowed by the resolution of the map (30 km or about 1 deg.); strong magnetic anomalies correlate closely with swirl locations. Individual orbit profiles (whose resolution along the orbit track is comparable to the spacecraft altitude of 18 km) also demonstrate a good correlation of field magnitude with surface albedo. In order to investigate the correlation of magnetic fields with the location of swirl features, we have reexamined available lunar imagery (Lunar Orbiter, Apollo, and Clementine) to identify and map swirl locations within regions where swirls have previously been mapped. In these images, swirls were distinguished from other high-albedo features such as crater rays by their curvilinear shapes and increased visibility in forward-scattered light. Digital maps of swirls identified by all available imagery were then superposed on maps of the field magnitude at the spacecraft altitude. Based upon analysis of these composite magnetic/geologic maps, we draw the preliminary conclusion that swirl features are associated with magnetic anomalies revealed by Lunar Prospector. Detailed maps of these swirl features are currently being constructed for the magnetically strong regions antipodal to the Imbrium, Serenitatis, and Crisium Basins. Additional information contained in the original,

Hood, L. L.↗