Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Unbundling Smart Meter Services Through Spatio-Temporal Decomposition Agents in DER-rich Environment

Smart meters and the advanced metering infrastructure (AMI) facilitate distribution system operators (DSOs) to gather information on energy consumption at the customer level. With the increasing penetration of building-level intermittent distributed energy resources (DERs) behind the meter, DER information is not available to DSOs. At the same time, smart meter enables users to participate in grid, with real-time information. Information for behind the meter is needed by user to coordinate building level assets for maximum benefits. The concept of unbundled smart meter (USM) needs agents to decompose smart meter measurements to provide service to DSO as well as customers. In this paper, we propose a Spatio-Temporal Decomposition Agent (STDA) for USM based on Artificial Intelligence (AI). STDA can help users optimize their energy usage, help DSO to utilize building assets for the grid operation. The energy usage strategy developed by STDA is suitable for different users, and can be customized by deep learning (DL) models according to the different energy consumption habits of each user. The power prediction performance results of various DL models and evaluation using a set of data from a Hawaii utility is presented. Furthermore, STDA integration with Home Energy management Systems (HEMS) to manage resources is presented and validated. STDA pre-processes the measurements before model training, and provides the spatio-temporal decomposed forecasting.

42 ENGINEERING↗

Web-Based Toxic Gas Dispersion Model for Shuttle Launch Operations

During the launch of the Space Shuttle vehicle, the burning of liquid hydrogen fuel with liquid oxygen at extreme high temperatures inside the three space shuttle main engines, and the burning of the solid propellant mixture of ammonium perchlorate oxidizer, aluminum fuel, iron oxide catalyst, polymer binder, and epoxy curing agent in the two solid rocket boosters result in the formation of a large cloud of hot, buoyant toxic exhaust gases near the ground level which subsequently rises and entrains into ambient air until the temperature and density of the cloud reaches an approximate equilibrium with ambient conditions. In this paper, toxic gas dispersion for various gases are simulated over the web for varying environmental conditions which is provided by rawinsonde data. The model simulates chemical concentration at ground level up to 10 miles (1 KM grids) in downrange up to an hour after launch. The ambient concentration of the gas dispersion and the deposition of toxic particles are used as inputs for a human health risk assessment model. The advantage of the present model is the accessibility and dissemination of model results to other NASA centers over the web. The model can be remotely operated and various scenarios can be analyzed.

Bardina, Jorge↗

Optimal carbon storage reservoir management through deep reinforcement learning

Model-based optimization plays a central role in energy system design and management. The complexity and high-dimensionality of many process-level models, especially those used for geosystem energy exploration and utilization, often lead to formidable computational costs when the dimension of decision space is also large. This work adopts elements of recently advanced deep learning techniques to solve a sequential decision-making problem in applied geosystem management. Specifically, a deep reinforcement learning framework was formed for optimal multiperiod planning, in which a deep Q-learning network (DQN) agent was trained to maximize rewards by learning from high-dimensional inputs and from exploitation of its past experiences. To expedite computation, deep multitask learning was used to approximate high-dimensional, multistate transition functions. Both DQN and deep multitask learning are pattern based. As a demonstration, the framework was applied to optimal carbon sequestration reservoir planning using two different types of management strategies: monitoring only and brine extraction. Both strategies are designed to mitigate potential risks due to pressure buildup. Results show that the DQN agent can identify the optimal policies to maximize the reward for given risk and cost constraints. Finally, experiments also show that knowledge the agent gained from interacting with one environment is largely preserved when deploying the same agent in other similar environments.

15 GEOTHERMAL ENERGY↗

From Rules to Reasoning: A Survey of Large Language Model-Based Approaches to Scientific Hypothesis and Idea Generation

Scientific hypothesis generation represents a fundamental challenge in contemporary research due to exponentially expanding literature volumes and increasing disciplinary specialization. Large language models (LLMs) have emerged as transformative tools for automated scientific discovery, moving beyond traditional rule-based and literature-mining approaches. Four paradigmatic approaches define current LLM-driven hypothesis generation: direct prompting and fine-tuning methods, knowledge-enhanced frameworks integrating retrieval-augmented generation (RAG), multi-agent collaborative systems simulating research teams, and reasoning-focused approaches implementing cognitive architectures. Domain-specific applications demonstrate statistical equivalence to human expert performance in social psychology, experimental validation in biomedical research, and near-expert quality in astronomy. Evaluation methodologies encompass human expert assessment, LLM-as-judge frameworks, and comprehensive benchmarking systems. Technical challenges include hallucination management, knowledge integration limitations, and balancing novelty with feasibility. Future directions emphasize hybrid neural-symbolic architectures and sophisticated human-AI collaboration models for responsible scientific discovery acceleration.

AI-driven discovery↗

Generalized Analysis of Dynamic Flow Fouling on Heat Transfer Surfaces

Several energy applications involve flow of untreated heat transfer fluids that contain trace amounts of mineral salts, such as calcium carbonate and calcium sulfate, which show reverse solubility with temperature. The gradual accretion of these salts onto the heat transfer surfaces causes fouling that degrades thermal performance over time. While fouling of bare surfaces has been extensively studied, fouling of nonwetting superhydrophobic or liquid-infused surfaces is less understood, especially under dynamic flow conditions. This study presents a systematic experimental analysis to elucidate dynamic flow fouling of calcium carbonate and calcium sulfate on smooth, superhydrophobic and liquid-infused surfaces in a generalized manner. Here, copper tubes with modified inner surface wettability are fabricated and subjected to forced convection at different flow rates and fouling salt concentrations. Fouling characteristics of the two salts on the different surfaces are examined through microstructural analysis, and quantified in terms of asymptotic fouling resistance that measures the total extent of fouling, and a threshold time, which correlates to the onset of significant fouling. Using Taguchi design of experiments, the study reports, for the first time, closed-form analytical relationships for the asymptotic fouling thermal resistance and threshold time on the Reynolds number, dimensionless concentration of fouling agent and dimensionless infused liquid viscosity that represents the different surface types in a unified manner. It is shown that the analytical model accurately predicts the fouling characteristics in up to about 97% of the data, based on which contour maps of optimum surface designs for minimizing fouling resistance are presented. The results provide information on designing surfaces for reduced fouling or for estimating the fouling characteristics for a given surface in applications.

36 MATERIALS SCIENCE↗

A multi-physics constitutive model to predict hydrolytic aging in quasi-static behaviour of thin cross-linked polymers

The effect of hydrolytic aging on mechanical quasi-static responses of rubber-like materials, in particular, the idealized Mullins effect and permanent set have been modeled. The effect of hydrolytic damage on the mechanical integrity of the polymer matrix is modeled as the direct competition of two micro-structural phenomena (i) chain scission and (ii) reduction of cross-links. Both phenomena and their correlation were modeled and thus, the strain energy of the polymer matrix is written with respect to three independent mechanisms; i) the shrinking original matrix that has not been attacked by water, ii) conversion of the first network to a new network due to the reduction of the cross-links, and iii) energy loss from network degradation due to water attacks to polymer active agents. The proposed model satisfies the Clausius-Duhem inequality and is thus physically feasible. The model is validated with respect to sets of our experimental data and other sets available in the literature. The proposed model is based on the assumption of homogeneous diffusion and mainly relevant for thin samples. In view of its accuracy, interpret-ability, and deep insight it provides into the nature of damage accumulation, the model is a good choice for further implementation in FE applications.

42 ENGINEERING↗

Optimal Equilibrium Selection of Price-Maker Agents in Performance-Based Regulation Market

This paper analyzes the oligopolistic equilibrium of multiple price-maker agents in performance-based regulation (PBR) markets. In these markets, there are price-maker agents representing some frequency regulation (FR) providers and a number of independent price-taker FR providers. An equilibrium problem with equilibrium constraints (EPEC) model is employed in this paper to study the equilibria of a PBR market in the presence of price-maker agents and pricetaker FR providers. Due to the incorporation of the FR providers' dynamics, the proposed model is reformulated as a mixed-integer linear programming (MILP) problem over innovative mathematical techniques. An optimal equilibrium point is also selected for the market, where none of the agents is unique deviator and the dynamic performance of power system is improved simultaneously. The effectiveness of proposed optimal equilibrium point is evaluated in the numerical results section by comparing the outputs with conventional optimal dispatches of the FR providers.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Extension of Ostwald Ripening Theory

The objective is to develop models based on the mean field approximation of Ostwald ripening to describe the growth of second phase droplets or crystallites. The models will include time variations in nucleation rate, control of saturation through addition of solute, precipitating agents, changes in temperature, and various surface kinetic effects. Numerical integration schemes have been developed and tested against the asymptotic solution of Liftshitz, Slyozov and Wagner (LSW). A second attractor (in addition to the LSW distribution) has been found and, contrary to the LSW theory, the final distribution is dependent on the initial distribution. A series of microgravity experiments is being planned to test this and other results from this work.

Baird, J.↗

Use of agents to implement an integrated computing environment

Integrated Product and Process Development (IPPD) embodies the simultaneous application to both system and quality engineering methods throughout an iterative design process. The use of IPPD results in the time-conscious, cost-saving development of engineering systems. To implement IPPD, a Decision-Based Design perspective is encapsulated in an approach that focuses on the role of the human designer in product development. The approach has two parts and is outlined in this paper. First, an architecture, called DREAMS, is being developed that facilitates design from a decision-based perspective. Second, a supporting computing infrastructure, called IMAGE, is being designed. Agents are used to implement the overall infrastructure on the computer. Successful agent utilization requires that they be made of three components: the resource, the model, and the wrap. Current work is focused on the development of generalized agent schemes and associated demonstration projects. When in place, the technology independent computing infrastructure will aid the designer in systematically generating knowledge used to facilitate decision-making.

Hale, Mark A.↗

The Extinction of Low Strain Rate Diffusion Flames by a Suppressant

This paper describes plans for an experimental and computational study on the structure and extinction of low strain rate diffusion flames by a suppressant added to the oxidizer stream. Stable low strain rate flames will be established through ground based reduced gravity experiments using the 2.2 s drop tower. A variety of agents will be investigated, including both physically and chemically acting agents (He, N2, CO2, and CF3Br) for flames burning methane and propane. A computational model of flame structure and extinction will be modified to include radiative losses, which is thought to be a significant heat loss mechanism at low strain rates.

Hamins, A.↗

An Approach to Quantify Workload in a System of Agents

The role of humans in aviation and other domains continues to shift from manual control to automation monitoring. Studies have found that humans are often poorly suited for monitoring roles, and workload can easily spike in off-nominal situations. Current workload measurement tools, like NASA TLX, use human operators to assess their own workload after using a prototype system. Such measures are used late in the design process and can result in ex- pensive alterations when problems are discovered. Our goal in this work is to provide a quantitative workload measure for use early in the design process. We leverage research in human cognition to de ne metrics that can measure workload on belief-desire-intentions based multi-agent systems. These measures can alert designers to potential workload issues early in design. We demonstrate the utility of our approach by characterizing quantitative differences in the workload for a single pilot operations model compared to a traditional two pilot model.

Single Pilot Operations↗

A Unified Approach to Model-Based Planning and Execution

Writing autonomous software is complex, requiring the coordination of functionally and technologically diverse software modules. System and mission engineers must rely on specialists familiar with the different software modules to translate requirements into application software. Also, each module often encodes the same requirement in different forms. The results are high costs and reduced reliability due to the difficulty of tracking discrepancies in these encodings. In this paper we describe a unified approach to planning and execution that we believe provides a unified representational and computational framework for an autonomous agent. We identify the four main components whose interplay provides the basis for the agent's autonomous behavior: the domain model, the plan database, the plan running module, and the planner modules. This representational and problem solving approach can be applied at all levels of the architecture of a complex agent, such as Remote Agent. In the rest of the paper we briefly describe the Remote Agent architecture. The new agent architecture proposed here aims at achieving the full Remote Agent functionality. We then give the fundamental ideas behind the new agent architecture and point out some implication of the structure of the architecture, mainly in the area of reactivity and interaction between reactive and deliberative decision making. We conclude with related work and current status.

Muscettola, Nicola↗

Privacy-Aware RAG-Enabled LLMs for Collaborative AI in Organizations

Recent advancements in Large Language Models (LLMs) based on Transformer architectures have significantly improved capabilities in natural language processing and generation. However, deploying LLMs for inter-organizational communication poses challenges, in ensuring privacy and facilitating effective collaboration. This paper introduces a novel decentralized inference meta-agent chatbot that leverages privacy-aware Retrieval-Augmented Generation (RAG)-enabled LLMs for collaborative AI communication across organizations. Built on Microsoft’s Autogen, the platform enables LLMs to autonomously refine responses, enhancing accuracy and relevance. It incorporates advanced hallucination mitigation techniques using Uptrain and a privacy-focused RAG framework that employs synthetic document generation to protect sensitive information. Comprehensive evaluations demonstrate the platform’s effectiveness in maintaining contextual relevance and stringent privacy standards, effectively addressing critical challenges in LLM-enhanced collaborative AI communication. This work represents a significant step toward secure and efficient inter-organizational collaboration using advanced generative AI technologies.

97 - MATHEMATICS AND COMPUTING↗

Volt-VAR Optimization in Distribution Networks Using Twin Delayed Deep Reinforcement Learning

Modern distribution grids are undergoing new challenges due to the stochastic nature of distributed energy resources (DERs). High penetration of DERs has a significant impact on Volt-VAR profile and system power losses. This work proposes a deep reinforcement learning (DRL)-based Volt-VAR optimization approach for improving voltage profile and reducing system power loss under high penetration of distributed energy resources, such as battery energy storage and solar photovoltaic units in distribution grids. The twin delayed deep deterministic policy gradient (TD3) method-based DRL agent is proposed to configure optimal set-points of reactive power outputs of fast responding smart inverters. The agent schedules the reactive power of inverters according to their physical capabilities, such as minimum allowed power factor, e.g., 0.9 leading/lagging. The reward function of the proposed DRL scheme is designed carefully to ensure a proper voltage profile of the grids with effective scheduling of reactive power outputs from inverters. The performance of the proposed model is verified on modified IEEE 34- and 123-bus systems and compared with base case with no reactive supply by inverters, and local droop Volt-VAR control approach. The results show that the proposed method performs better than the local droop control and deep deterministic policy gradient (DDPG)-based DRL method for reducing voltage fluctuation and minimizing power loss.

Hossain, Rakib↗

Agent-Based Simulations of Malaria Transmissions with Applications to a Study Site in Thailand

The dynamics of malaria transmission are driven by environmental, biotic and socioeconomic factors. Because of the geographic dependency of these factors and the complex interactions among them, it is difficult to generalize the key factors that perpetuate or intensify malaria transmission. Methods: Discrete event simulations were used for modeling the detailed interactions among the vector life cycle, sporogonic cycle and human infection cycle, under the explicit influences of selected extrinsic and intrinsic factors. Meteorological and environmental parameters may be derived from satellite data. The output of the model includes the individual infection status and the quantities normally observed in field studies, such as mosquito biting rates, sporozoite infection rates, gametocyte prevalence and incidence. Results were compared with mosquito vector and human malaria data acquired over 4.5 years (June 1999 - January 2004) in Kong Mong Tha, a remote village in Kanchanaburi Province, western Thailand. Results: Three years of transmissions of vivax and falciparum malaria were simulated for a hypothetical hamlet with approximately 1/7 of the study site population. The model generated results for a number of scenarios, including applications of larvicide and insecticide, asymptomatic cases receiving or not receiving treatment, blocking malaria transmission in mosquito vectors, and increasing the density of farm (host) animals in the hamlet. Transmission characteristics and trends in the simulated results are comparable to actual data collected at the study site.

Kiang, Richard K.↗

Powertrain Autoresearch (TETA Autoresearch: RouteE Powertrain Experiments) [SWR-26-090]

Powertrain Autoresearch is an experiment repository based on the template set in teta-autoresearch containing branch history of LLM workers investigating powertrain ML model improvements. This repository contains an instance of teta-autoresearch applied to ML model exploration for RouteE Powertrain. An AI agent and human-in-the-loop iteratively explored feature space, ML model type, and hyperparameter spaces in an attempt to improve over existing models. The repo catalogs the result for review at USRSE 2026 Conference. Related: https://github.com/NatLabRockies/teta-autoresearch.

Reinicke, Nicholas [National Laboratory of the Roc↗

APIS: Honeybee Foraging Task Assignment for Use in Uncertain and Unreliable Environments

Multiagent Cyber-Physical-Human (CPH) systems in realistic environments operate under uncertain conditions. Communication among agents, aimed at reducing the uncertainty, is itself subject to uncertainty. We propose to manage uncertainties in autonomous, long-duration operations of multiagent systems via a modified Honeybee Foraging (HBF) behavioral scheme. The resulting system, Autonomous Persistent Intelligent Swarm (APIS),incorporates two new behaviors to ameliorate informational uncertainty. When “scouting”, agents are tasked based on informational quality and reliability rather than solely on priorities. When “dancing”, agents are tasked to rendezvous with other dancing agents to exchange information at close range, where successful communication is guaranteed. When coupled with uncertainty-aware modeling across agents, these behaviors improve situational awareness and resilience of the system, enabling it to function under more uncertain conditions arising during long-duration missions.

Autonomous systems↗

APIS: Honeybee Foraging Task Assignment for Use in Uncertain and Unreliable Environments

Multiagent Cyber-Physical-Human (CPH) systems in realistic environments operate under uncertain conditions. Communication among agents, aimed at reducing the uncertainty, is itself subject to uncertainty. We propose to manage uncertainties in autonomous, long-duration operations of multiagent systems via a modified Honeybee Foraging (HBF) behavioral scheme. The resulting system, Autonomous Persistent Intelligent Swarm (APIS),incorporates two new behaviors to ameliorate informational uncertainty. When “scouting”, agents are tasked based on informational quality and reliability rather than solely on priorities. When “dancing”, agents are tasked to rendezvous with other dancing agents to exchange information at close range, where successful communication is guaranteed. When coupled with uncertainty-aware modeling across agents, these behaviors improve situational awareness and resilience of the system, enabling it to function under more uncertain conditions arising during long-duration missions.

Autonomous systems↗