SEARCH · Engineering Papers

Results for “agent based model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Unbundling Smart Meter Services Through Spatio-Temporal Decomposition Agents in DER-rich Environment

Smart meters and the advanced metering infrastructure (AMI) facilitate distribution system operators (DSOs) to gather information on energy consumption at the customer level. With the increasing penetration of building-level intermittent distributed energy resources (DERs) behind the meter, DER information is not available to DSOs. At the same time, smart meter enables users to participate in grid, with real-time information. Information for behind the meter is needed by user to coordinate building level assets for maximum benefits. The concept of unbundled smart meter (USM) needs agents to decompose smart meter measurements to provide service to DSO as well as customers. In this paper, we propose a Spatio-Temporal Decomposition Agent (STDA) for USM based on Artificial Intelligence (AI). STDA can help users optimize their energy usage, help DSO to utilize building assets for the grid operation. The energy usage strategy developed by STDA is suitable for different users, and can be customized by deep learning (DL) models according to the different energy consumption habits of each user. The power prediction performance results of various DL models and evaluation using a set of data from a Hawaii utility is presented. Furthermore, STDA integration with Home Energy management Systems (HEMS) to manage resources is presented and validated. STDA pre-processes the measurements before model training, and provides the spatio-temporal decomposed forecasting.

42 ENGINEERING↗

DOE OSTI2020

Optimal carbon storage reservoir management through deep reinforcement learning

Model-based optimization plays a central role in energy system design and management. The complexity and high-dimensionality of many process-level models, especially those used for geosystem energy exploration and utilization, often lead to formidable computational costs when the dimension of decision space is also large. This work adopts elements of recently advanced deep learning techniques to solve a sequential decision-making problem in applied geosystem management. Specifically, a deep reinforcement learning framework was formed for optimal multiperiod planning, in which a deep Q-learning network (DQN) agent was trained to maximize rewards by learning from high-dimensional inputs and from exploitation of its past experiences. To expedite computation, deep multitask learning was used to approximate high-dimensional, multistate transition functions. Both DQN and deep multitask learning are pattern based. As a demonstration, the framework was applied to optimal carbon sequestration reservoir planning using two different types of management strategies: monitoring only and brine extraction. Both strategies are designed to mitigate potential risks due to pressure buildup. Results show that the DQN agent can identify the optimal policies to maximize the reward for given risk and cost constraints. Finally, experiments also show that knowledge the agent gained from interacting with one environment is largely preserved when deploying the same agent in other similar environments.

15 GEOTHERMAL ENERGY↗

DOE OSTI2026

From Rules to Reasoning: A Survey of Large Language Model-Based Approaches to Scientific Hypothesis and Idea Generation

Scientific hypothesis generation represents a fundamental challenge in contemporary research due to exponentially expanding literature volumes and increasing disciplinary specialization. Large language models (LLMs) have emerged as transformative tools for automated scientific discovery, moving beyond traditional rule-based and literature-mining approaches. Four paradigmatic approaches define current LLM-driven hypothesis generation: direct prompting and fine-tuning methods, knowledge-enhanced frameworks integrating retrieval-augmented generation (RAG), multi-agent collaborative systems simulating research teams, and reasoning-focused approaches implementing cognitive architectures. Domain-specific applications demonstrate statistical equivalence to human expert performance in social psychology, experimental validation in biomedical research, and near-expert quality in astronomy. Evaluation methodologies encompass human expert assessment, LLM-as-judge frameworks, and comprehensive benchmarking systems. Technical challenges include hallucination management, knowledge integration limitations, and balancing novelty with feasibility. Future directions emphasize hybrid neural-symbolic architectures and sophisticated human-AI collaboration models for responsible scientific discovery acceleration.

AI-driven discovery↗

DOE OSTI2022

Generalized Analysis of Dynamic Flow Fouling on Heat Transfer Surfaces

Several energy applications involve flow of untreated heat transfer fluids that contain trace amounts of mineral salts, such as calcium carbonate and calcium sulfate, which show reverse solubility with temperature. The gradual accretion of these salts onto the heat transfer surfaces causes fouling that degrades thermal performance over time. While fouling of bare surfaces has been extensively studied, fouling of nonwetting superhydrophobic or liquid-infused surfaces is less understood, especially under dynamic flow conditions. This study presents a systematic experimental analysis to elucidate dynamic flow fouling of calcium carbonate and calcium sulfate on smooth, superhydrophobic and liquid-infused surfaces in a generalized manner. Here, copper tubes with modified inner surface wettability are fabricated and subjected to forced convection at different flow rates and fouling salt concentrations. Fouling characteristics of the two salts on the different surfaces are examined through microstructural analysis, and quantified in terms of asymptotic fouling resistance that measures the total extent of fouling, and a threshold time, which correlates to the onset of significant fouling. Using Taguchi design of experiments, the study reports, for the first time, closed-form analytical relationships for the asymptotic fouling thermal resistance and threshold time on the Reynolds number, dimensionless concentration of fouling agent and dimensionless infused liquid viscosity that represents the different surface types in a unified manner. It is shown that the analytical model accurately predicts the fouling characteristics in up to about 97% of the data, based on which contour maps of optimum surface designs for minimizing fouling resistance are presented. The results provide information on designing surfaces for reduced fouling or for estimating the fouling characteristics for a given surface in applications.

36 MATERIALS SCIENCE↗

DOE OSTI2020

A multi-physics constitutive model to predict hydrolytic aging in quasi-static behaviour of thin cross-linked polymers

The effect of hydrolytic aging on mechanical quasi-static responses of rubber-like materials, in particular, the idealized Mullins effect and permanent set have been modeled. The effect of hydrolytic damage on the mechanical integrity of the polymer matrix is modeled as the direct competition of two micro-structural phenomena (i) chain scission and (ii) reduction of cross-links. Both phenomena and their correlation were modeled and thus, the strain energy of the polymer matrix is written with respect to three independent mechanisms; i) the shrinking original matrix that has not been attacked by water, ii) conversion of the first network to a new network due to the reduction of the cross-links, and iii) energy loss from network degradation due to water attacks to polymer active agents. The proposed model satisfies the Clausius-Duhem inequality and is thus physically feasible. The model is validated with respect to sets of our experimental data and other sets available in the literature. The proposed model is based on the assumption of homogeneous diffusion and mainly relevant for thin samples. In view of its accuracy, interpret-ability, and deep insight it provides into the nature of damage accumulation, the model is a good choice for further implementation in FE applications.

42 ENGINEERING↗

DOE OSTI2020

Optimal Equilibrium Selection of Price-Maker Agents in Performance-Based Regulation Market

This paper analyzes the oligopolistic equilibrium of multiple price-maker agents in performance-based regulation (PBR) markets. In these markets, there are price-maker agents representing some frequency regulation (FR) providers and a number of independent price-taker FR providers. An equilibrium problem with equilibrium constraints (EPEC) model is employed in this paper to study the equilibria of a PBR market in the presence of price-maker agents and pricetaker FR providers. Due to the incorporation of the FR providers' dynamics, the proposed model is reformulated as a mixed-integer linear programming (MILP) problem over innovative mathematical techniques. An optimal equilibrium point is also selected for the market, where none of the agents is unique deviator and the dynamic performance of power system is improved simultaneously. The effectiveness of proposed optimal equilibrium point is evaluated in the numerical results section by comparing the outputs with conventional optimal dispatches of the FR providers.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2025

Privacy-Aware RAG-Enabled LLMs for Collaborative AI in Organizations

Recent advancements in Large Language Models (LLMs) based on Transformer architectures have significantly improved capabilities in natural language processing and generation. However, deploying LLMs for inter-organizational communication poses challenges, in ensuring privacy and facilitating effective collaboration. This paper introduces a novel decentralized inference meta-agent chatbot that leverages privacy-aware Retrieval-Augmented Generation (RAG)-enabled LLMs for collaborative AI communication across organizations. Built on Microsoft’s Autogen, the platform enables LLMs to autonomously refine responses, enhancing accuracy and relevance. It incorporates advanced hallucination mitigation techniques using Uptrain and a privacy-focused RAG framework that employs synthetic document generation to protect sensitive information. Comprehensive evaluations demonstrate the platform’s effectiveness in maintaining contextual relevance and stringent privacy standards, effectively addressing critical challenges in LLM-enhanced collaborative AI communication. This work represents a significant step toward secure and efficient inter-organizational collaboration using advanced generative AI technologies.

97 - MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Volt-VAR Optimization in Distribution Networks Using Twin Delayed Deep Reinforcement Learning

Modern distribution grids are undergoing new challenges due to the stochastic nature of distributed energy resources (DERs). High penetration of DERs has a significant impact on Volt-VAR profile and system power losses. This work proposes a deep reinforcement learning (DRL)-based Volt-VAR optimization approach for improving voltage profile and reducing system power loss under high penetration of distributed energy resources, such as battery energy storage and solar photovoltaic units in distribution grids. The twin delayed deep deterministic policy gradient (TD3) method-based DRL agent is proposed to configure optimal set-points of reactive power outputs of fast responding smart inverters. The agent schedules the reactive power of inverters according to their physical capabilities, such as minimum allowed power factor, e.g., 0.9 leading/lagging. The reward function of the proposed DRL scheme is designed carefully to ensure a proper voltage profile of the grids with effective scheduling of reactive power outputs from inverters. The performance of the proposed model is verified on modified IEEE 34- and 123-bus systems and compared with base case with no reactive supply by inverters, and local droop Volt-VAR control approach. The results show that the proposed method performs better than the local droop control and deep deterministic policy gradient (DDPG)-based DRL method for reducing voltage fluctuation and minimizing power loss.

Hossain, Rakib↗

DOE OSTI2026

Powertrain Autoresearch (TETA Autoresearch: RouteE Powertrain Experiments) [SWR-26-090]

Powertrain Autoresearch is an experiment repository based on the template set in teta-autoresearch containing branch history of LLM workers investigating powertrain ML model improvements. This repository contains an instance of teta-autoresearch applied to ML model exploration for RouteE Powertrain. An AI agent and human-in-the-loop iteratively explored feature space, ML model type, and hyperparameter spaces in an attempt to improve over existing models. The repo catalogs the result for review at USRSE 2026 Conference. Related: https://github.com/NatLabRockies/teta-autoresearch.

Reinicke, Nicholas [National Laboratory of the Roc↗

DOE OSTI2024

"Designing, simulating, and performing the 100-AV field test for the CIRCLES consortium: Methodology and Implementation of the Largest mobile traffic control experiment to date"

Previous controlled experiments on single-lane ring roads have shown that a single partially autonomous vehicle (AV) can effectively mitigate traffic waves. This naturally prompts the question of how these findings can be generalized to field operational, high-density traffic conditions. To address this question, the Congestion Impacts Reduction via CAV-in-the-loop Lagrangian Energy Smoothing (CIRCLES) Consortium conducted MegaVanderTest (MVT), a live traffic control experiment involving 100 vehicles near Nashville, TN, USA. This article is a tutorial for developing analytical and simulation-based tools essential for designing and executing a live traffic control experiment like the MVT. It presents an overview of the proposed roadmap and various procedures used in designing, monitoring, and conducting the MVT, which is the largest mobile traffic control experiment at the time. The design process is aimed at evaluating the impact of the CIRCLES AVs on surrounding traffic. The article discusses the agent-based traffic simulation framework created for this evaluation. A novel methodological framework is introduced to calibrate this microsimulation, aiming to accurately capture traffic dynamics and assess the impact of adding 100 vehicles to existing traffic. The calibration model's effectiveness is verified using data from a six-mile section of Nashville's I-24 highway. The results indicate that the proposed model establishes an effective feedback loop between the optimizer and the simulator, thereby calibrating flow and speed with different spatiotemporal characteristics to minimize the error between simulated and real-world data. Finally, We simulate AVs in multiple scenarios to assess their effect on traffic congestion. This evaluation validates the AV routes, thereby contributing to the execution of a safe and successful live traffic control experiment via AVs.

Ameli, Mostafa↗

DOE OSTI2020

A non-cooperative meta-modeling game for automated third-party calibrating, validating and falsifying constitutive laws with parallelized adversarial attacks

The evaluation of constitutive models, especially for high-risk and high-regret engineering applications, requires efficient and rigorous third-party calibration, validation and falsification. While there are numerous efforts to develop paradigms and standard procedures to validate models, difficulties may arise due to the sequential, manual, and often biased nature of the commonly adopted calibration and validation processes, thus slowing down data collections, hampering the progress towards discovering new physics, increasing expenses and possibly leading to misinterpretations of the credibility and application ranges of proposed models. This work attempts to introduce concepts from game theory and machine learning techniques to overcome many of these existing difficulties. Here, we introduce an automated meta-modeling game where two competing AI agents systematically generate experimental data to calibrate a given constitutive model and to explore its weakness such that the experiment design and model robustness can be improved through competitions. The two agents automatically search for the Nash equilibrium of the meta-modeling game in an adversarial reinforcement learning framework without human intervention. In particular, a protagonist agent seeks to find the more effective ways to generate data for model calibrations, while an adversary agent tries to find the most devastating test scenarios that expose the weaknesses of the constitutive model calibrated by the protagonist. By capturing all possible design options of the laboratory experiments into a single decision tree, we recast the design of experiments as a game of combinatorial moves that can be resolved through deep reinforcement learning by the two competing players. Our adversarial framework emulates idealized scientific collaborations and competitions among researchers to achieve a better understanding of the application range of the learned material laws and prevent misinterpretations caused by conventional AI-based third-party validation. Numerical examples are given to demonstrate the wide applicability of the proposed meta-modeling game with adversarial attacks on both human-crafted constitutive models and machine learning models.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

A Secure Learning Control Strategy via Dynamic Camouflaging for Unknown Dynamical Systems under Attacks

This paper presents a secure reinforcement learning (RL) based control method for unknown linear time-invariant cyber-physical systems (CPSs) that are subjected to compositional attacks such as eavesdropping and covert attack. We consider the attack scenario where the attacker learns about the dynamic model during the exploration phase of the learning conducted by the designer to learn a linear quadratic regulator (LQR), and thereafter, use such information to conduct a covert attack on the dynamic system, which we refer to as doubly learning-based control and attack (DLCA) framework. We propose a dynamic camouflaging based attack-resilient reinforcement learning (ARRL) algorithm which can learn the desired optimal controller for the dynamic system, and at the same time, can inject sufficient misinformation in the estimation of system dynamics by the attacker. The algorithm is accompanied by theoretical guarantees and extensive numerical experiments on a consensus multi-agent system and on a benchmark power grid model.

Mukherjee, Sayak↗

DOE OSTI2020

Optically tunable mesoscale CdSe morphologies via inorganic phototropic growth

Inorganic phototropic growth using only spatially conformal illumination generated Se–Cd films that exhibited precise light-defined mesoscale morphologies including highly ordered, anisotropic, and periodic ridge and trench nanotextures over entire macroscopic substrates. Growth was accomplished via a light-induced electrochemical method using an optically and chemically isotropic solution, an unpatterned substrate, and unstructured, incoherent, low-intensity illumination in the absence of chemical directing agents or physical templates and masks. The morphologies were defined by the illumination inputs: the nanotexture long axes aligned parallel to the optical E-field vector, and the feature sizes and periods scaled with the wavelength. Optically based modeling of the growth closely reproduced the experimental results, confirming the film morphologies were fully determined by the light–matter interactions during growth. Solution processing of the Se–Cd films resulted in stoichiometric, crystalline CdSe films that also exhibited ordered nanotextures, demonstrating that inorganic phototropic growth can effect tunable, template-free generation of ordered CdSe nanostructures over macroscopic length scales.

36 MATERIALS SCIENCE↗

DOE OSTI2023

AI-Based Faster-Than-Real-Time Stability Assessment of Large Power Systems with Applications on WECC System

Achieving clean energy goals will require significant advances in regard to addressing the computational needs for next-generation renewable-dominated power grids. One critical obstacle that lies in the way of transitioning today’s power grid to a renewable-dominated power grid is the lack of a faster-than-real-time stability assessment technology for operating a fast-changing power grid. This paper proposes an artificial intelligence (AI) -based method that predicts the system’s stability margin information (e.g., the frequency nadir in the frequency stability assessment and the critical clearing time (CCT) value in the transient stability assessment) directly from the system operating conditions without performing the conventional time-consuming time-domain simulations over detailed dynamic models. Since the AI method shifts the majority of the computational burden to offline training, the online evaluation is extremely fast. This paper has tested the AI-based stability assessment method using multiple dispatch cases that are converted and tuned from actual dispatch cases of the Western Electricity Coordinating Council (WECC) system model with more than 20,000 buses. The results show that the AI-based method could accurately predict the stability margin of such a large power system in less than 0.2 milliseconds using the offline-trained AI agent. Therefore, the proposed method has great potential to achieve faster-than-real-time stability assessment for practical large power systems while preserving sufficient accuracy.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

A diffusion–deformation model with damage for polymer undergoing rapid decompression failure

Green hydrogen is emerging as one of the most promising alternatives to replace fossil fuels. While hydrogen gas has a good energy density by weight, its poor energy density by volume requires it to be stored under high pressure for commercial use. The hydrogen infrastructure developed to handle this high pressure hydrogen contains multiple components made of polymers as sealing agents. Although polymers do not react chemically with hydrogen gas, they undergo a mechanical failure when high pressure hydrogen gas is suddenly depressurized. This phenomenon known as 'rapid decompression failure' occurs due to the diffusion of hydrogen through polymer and getting trapped inside pre-existing cavities or voids. Here, in this paper, a continuum mechanics-based coupled diffusion-deformation-damage model was developed to predict the hydrogen distribution, stress distribution, and damage propagation inside the polymer while it undergoes rapid decompression failure. The polymer was modeled as a hyperelastic material because it represents the nonlinear material response observed in uniaxial tensile tests perfectly. The effects of hydrogen diffusivity, pre-existing cavity size, cavity location, applied hydrogen pressure, and depressurization rate on damage initiation were studied. It was found that the coefficient of diffusion plays an important role in damage initiation and damage was mostly concentrated in the inside areas rather than near the surface. Experiments were conducted with EPDM polymer which agreed well with the predicted trends using the given model. The effect of adding carbon black and silica filler particles and plasticizer to the pure EPDM polymer was also studied. It was found that damage during RDF decreases with the addition of fillers, but increases with the addition of the plasticizer. Finally, the damage evolution in the presence of two cavities was also studied, and was found that the interaction of stress fields around the cavities alters the damage occurring during RDF.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Replace Human Intelligence with Fast and Smart Geometric Reasoning and Graph Neural Network to Accelerate Next Gen ModSim Workflows

We present an agent-guided approach to CAD geometry decomposition that automates hex/hybrid meshing with graph neural networks (GNNs) to accelerate next-generation ModSim workflows. Our end-to-end pipeline (i) reduces 3D boundary-representation (B-Rep) models to a 2D chordal axis skeleton (CAT) and then to a 1D bipartite graph of surface and curve nodes, (ii) assigns per node labels as Cubit® WebCut actions, (iii) trains a multi-action GNN under supervised learning, and (iv) predicts five surface-node and three curve-node actions on out-of-distribution test geometries. Each graph node carries geometric, topological, and meshing attributes drawn from the B-Rep “skin” and CAT “skeleton,” with two-way mappings across 3D↔2D↔1D representations to maintain traceability back to 3D CAD. The supervised learning model exhibits stable convergence of the binary cross-entropy loss and achieves 98.7% accuracy on unseen lattice models. To operationalize decision-making, we rank predicted commands by geometric significance and prototyped the agent-guided workflow through the Cubit® Meshing PowerTool GUI. As a stretch goal, we explore reinforcement learning (RL) to reduce or remove label requirements and to learn policies for action sequences that maximize total reward (e.g., size of hex-meshable regions and resulting hex mesh quality). When all-hex meshing is not feasible, the agent assists in producing hybrid meshes—prioritizing hex in critical regions and transitioning to tetrahedral elements (tets) elsewhere—maintaining fidelity while ensuring robustness. The overarching objective is to replace manual, heuristics-based decomposition with data-driven, reproducible automation, cutting meshing turnaround time by orders of magnitude. We anticipate direct impact on simulation workflows through intelligent, scalable decomposition of complex CAD models into hex-meshable subdomains.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Closing the Loop between In Situ Stress Complexity and EGS Fracture Complexity

42 ENGINEERING↗

DOE OSTI2020

Evaluating the Adaptability of Reinforcement Learning Based HVAC Control for Residential Houses

Intelligent Heating, Ventilation, and Air Conditioning (HVAC) control using deep reinforcement learning (DRL) has recently gained a lot of attention due to its ability to optimally control the complex behavior of the HVAC system. However, more exploration is needed on understanding the adaptability challenges that the DRL agent could face during the deployment phase. Using online learning for such applications is not realistic due to the long learning period and likely poor comfort control during the learning process. Alternatively, DRL can be pre-trained using a building model prior to deployment. However, developing an accurate building model for every house and deploying a pre-trained DRL model for HVAC control would not be cost-effective. In this study, we focus on evaluating the ability of DRL-based HVAC control to provide cost savings when pre-trained on one building model and deployed on different house models with varying user comforts. We observed around 30% of cost reduction by pre-trained model over baseline when validated in a simulation environment and achieved up to 21% cost reduction when deployed in the real house. This finding provides experimental evidence that the pre-trained DRL has the potential to adapt to different house environments and comfort settings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗