Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Agents”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

HURON (HUman and Robotic Optimization Network) Multi-Agent Temporal Activity Planner/Scheduler

HURON solves the problem of how to optimize a plan and schedule for assigning multiple agents to a temporal sequence of actions (e.g., science tasks). Developed as a generic planning and scheduling tool, HURON has been used to optimize space mission surface operations. The tool has also been used to analyze lunar architectures for a variety of surface operational scenarios in order to maximize return on investment and productivity. These scenarios include numerous science activities performed by a diverse set of agents: humans, teleoperated rovers, and autonomous rovers. Once given a set of agents, activities, resources, resource constraints, temporal constraints, and de pendencies, HURON computes an optimal schedule that meets a specified goal (e.g., maximum productivity or minimum time), subject to the constraints. HURON performs planning and scheduling optimization as a graph search in state-space with forward progression. Each node in the graph contains a state instance. Starting with the initial node, a graph is automatically constructed with new successive nodes of each new state to explore. The optimization uses a set of pre-conditions and post-conditions to create the children states. The Python language was adopted to not only enable more agile development, but to also allow the domain experts to easily define their optimization models. A graphical user interface was also developed to facilitate real-time search information feedback and interaction by the operator in the search optimization process. The HURON package has many potential uses in the fields of Operations Research and Management Science where this technology applies to many commercial domains requiring optimization to reduce costs. For example, optimizing a fleet of transportation truck routes, aircraft flight scheduling, and other route-planning scenarios involving multiple agent task optimization would all benefit by using HURON.

Hua, Hook↗
NASA NTRS2014

Potential of Pest and Host Phenological Data in the Attribution of Regional Forest Disturbance Detection Maps According to Causal Agent

Near real time forest disturbance detection maps from MODIS NDVI phenology data have been produced since 2010 for the conterminous U.S., as part of the on-line ForWarn national forest threat early warning system. The latter has been used by the forest health community to identify and track many regional forest disturbances caused by multiple biotic and abiotic damage agents. Attribution of causal agents for detected disturbances has been a goal since project initiation in 2006. Combined with detailed cover type maps, geospatial pest phenology data offer a potential means for narrowing the candidate causal agents responsible for a given biotic disturbance. U.S. Aerial Detection Surveys (ADS) employ such phenology data. Historic ADS products provide general locational data on recent insect-induced forest type specific disturbances that may help in determining candidate causal agents for MODIS-based disturbance maps, especially when combined with other historic geospatial disturbance data (e.g., wildfire burn scars and drought maps). Historic ADS disturbance detection polygons can show severe and extensive regional forest disturbances, though they also can show polygons with sparsely scattered or infrequent disturbances. Examples will be discussed that use various historic disturbance data to help determine potential causes of MODIS-detected regional forest disturbance anomalies.

Spruce, Joseph↗
NASA NTRS2014

pH-Sensitive Microparticles with Matrix-Dispersed Active Agent

Methods to produce pH-sensitive microparticles that have an active agent dispersed in a polymer matrix have certain advantages over microcapsules with an active agent encapsulated in an interior compartment/core inside of a polymer wall. The current invention relates to pH-sensitive microparticles that have a corrosion-detecting or corrosion-inhibiting active agent or active agents dispersed within a polymer matrix of the microparticles. The pH-sensitive microparticles can be used in various coating compositions on metal objects for corrosion detecting and/or inhibiting.

Li, Wenyan↗
NASA NTRS2020

Detection and Mitigation of Transient Instabilities in Multi-Agent Systems and Swarms

We first introduce the novel concept of transient instabilities in multi-agent systems and swarms, i.e., a small disturbance leads to increasing-amplitude oscillations throughout the swarm, which results in a large number of inter-agent collisions. This instability is dominant in the transient phase of the system and it does not appear in the steady-state behavior of the system, as each agent uses Lyapunov-stable feedback control laws. We present a rigorous definition of transient instability in swarms, and discuss its key properties. We also present a sufficient condition to check if a swarm will be transient stable. We study the behaviour of different control laws under this condition. We also show how transient instability phenomenon could impact the dynamics of deployable structures. Next, we present a novel control architecture that augments the baseline formation maintenance controller to mitigate transient instabilities. At its heart, the proposed architecture consists of a projection operator based estimator disguised as a reference model that generates collision-free trajectories for the agents to follow. We present numerical simulation results to demonstrate the effectiveness of our proposed approaches.

Quadrelli, Marco B.↗
DOE OSTI2020

Method for generating and dispensing a powdered release agent

A method for generating and dispensing a powdered release agent during an additive manufacturing build is disclosed. A solid body of release agent material is ground insitu by a grinder and dispensed on a surface of the part to prevent adhesion of an adjacent layer of a base material. With the addition of the powdered release agent, a support structure is easily separated from the base material when the part is complete, saving time and preventing the part from sustaining unintentional damage. Since no powdered release agent is actually loaded or stored in the apparatus, the potential for spillage, waste, inconsistent dispensing, inadvertent dispensing, and clumping due to humidity is eliminated.

42 ENGINEERING↗
DOE OSTI2021

Multi-sensor agent devices

Apparatus, methods, and systems implementing multi-sensor agent devices are described herein. The agent devices can each include a plurality of sensors for measuring parameters of interest to an entity such as an electric power utility. The sensors can be organized in individually-IP-addressable sensor clusters, with each sensor cluster including an associated microcontroller. The agent devices can be controlled by a control center of the entity to operate in a coordinated manner, such as to gather and transmit data regarding parameters of interest. The agent devices can be transported to desired areas for data collection by unmanned aerial systems such as drones, and the collected data can be stored in a distributed blockchain ledger.

Fuhr, Peter L.↗
DOE OSTI2023

Distributed Power Allocation for 6-GHz Unlicensed Spectrum Sharing via Multi-agent Deep Reinforcement Learning

We consider the problem of power allocation over the 6 GHz Unlicensed National Information Infrastructure (UNII)- 5 spectrum. We propose a novel deep Reinforcement Learning (DRL)-based distributed power allocation scheme which utilizes the multi-agent Deep Deterministic Policy Gradient (MADDPG) algorithm. In particular, we model the base stations (BSs) as DRL agents that simultaneously determine the transmit powers to their scheduled user equipment (UE) in a synchronized manner. The power decision of each BS is based on its own observation of the radio environment, which consists of several local interference measurements and a limited amount of information obtained from other BSs. One advantage of the proposed scheme is that it addresses the single-agent non-stationarity problem of RL in the multi-agent scenario by incorporating the actions and observations of other BSs into each BS’s own critic which helps it to gain a more accurate perception of the overall radio environment. A centralized-training-distributed execution framework is used to train the policies where the critics are trained over the joint actions and observations of all BSs while the actor of each BS only takes the local observation as input in order to produce the transmit power. Simulation shows that the proposed power allocation scheme can achieve better throughput performance than several state-of-the-art approaches.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2026

Enhancing Operational Safety via Agentic Dialogue Hazard Identification Analysis

Operational safety in high-stakes domains such as industrial process control, autonomous, and safety-critical systems demand reliable hazard identification. While large language models (LLMs) have shown promise in automating safety analysis tasks, single-turn, monolithic inference is brittle: it lacks the self-correction, deliberation, and contextual refinement that safety engineers apply iteratively. In this paper, we introduce HAZDIAL, a framework that investigates whether structured agentic dialogue (multi-agent, multi-turn interactions) improves the quality of NLP-based hazard identification over single-pass baselines. We systematically compare two dialogue modalities: adversarial debate and constructive discussion, and propose an genetic algorithm-based agentic interaction optimization. We evaluate all configurations against a curated golden dataset using standard classification metrics (accuracy, precision, recall, F1) and a novel dialogue metrics. This work advances the intersection of dialogue systems, multi-agent reasoning, and AI safety, providing empirical evidence for dialogue-driven hazard analysis.

Das, Sanjay [ORNL] (ORCID:0009000542591915)↗
DOE OSTI2024

Multi-agent voltage control in distribution systems using GAN-DRL-based approach

Active distribution grids can experience voltage fluctuations and violations due to the high penetration of variable distributed energy resources (DERs). These problems might occur because of the uncertain and variable generation natures of these resources, especially solar photovoltaic resources, during panel shadowing scenarios. Volt-VAR control (VVC) is an efficient method that controls the reactive power set-points of the inverters to regulate the voltage of distribution grids. Although several VVC approaches have been proposed recently, the performance of these approaches degrades significantly if behind-the-meter solar generation data are unobservable/missing. Therefore, it is necessary to impute missing/unobservable PV data accurately to be utilized in VVC approaches. Further, this paper proposes a model-free, data-driven, centrally trained, and decentrally executed multi-agent deep reinforcement learning-based VVC architecture to regulate the voltage of distribution networks. A generative adversarial network (GAN) is incorporated to impute the unobservable PV data accurately, which improves the performance of the proposed control architecture. The proposed multi-agent-soft-actor–critic algorithm (MASAC)-based VVC technique utilizes the actual PV dataset as well as the imputed dataset from the GAN framework to learn the optimal coordinated control policy for controlling the optimal reactive power set-points of PV inverters. The effectiveness of the proposed approach is analyzed on a modified IEEE 34-bus test case with added PV inverters. The results are compared and analyzed with a base case model with no VVC and VVC with a local droop control approach, genetic algorithm optimization, and a centralized soft actor–critic-based approach. Moreover, the performance of the proposed approach is compared with that of a multi-agent VVC framework without using the PV generation data and load information as the system state. The results illustrate that the proposed method with more state input improves the voltage profile and reduces the power loss of the network across various loading and PV generation scenarios.

14 SOLAR ENERGY↗
DOE OSTI2026

MCP-enabled agentic AI workflow for building energy modelling: framework and use cases

Traditional building energy modelling workflows remain labor-intensive and error-prone, requiring specialized expertise that limits broader adoption. This paper introduces a novel Model Context Protocol (MCP)-enabled framework that connects AI assistants to EnergyPlus through MCP, a standardized interface for tool invocation and context management. Two complementary integration paradigms are presented and compared: conversational integration, where users interact through natural language while an AI assistant orchestrates MCP tools on demand, and agentic workflow integration, where specialized agents coordinate autonomously to complete multi-step tasks. Using an experimental testbed for residential buildings, the end-to-end workflows are demonstrated. The conversational approach reduced typical inspection and modification tasks from 1-2 h to under 15 min, while maintaining full transparency through visible tool invocations. The agentic approach automated parametric analysis. These demonstrations establish MCP as a foundational layer for AI-assisted building energy modelling, enabling natural language interactions with simulation tools while preserving professional oversight and decision-making authority.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Agent-Based Distributed Energy Resources for Supporting Intelligence at the Grid Edge

This article proposes a novel multi-agent framework that can link various forms of resources and power electronic systems into distributed energy resources (DER). The proposed multiagent architecture can also integrate DERs to a central controller for optimization and control to support the grid. To demonstrate the flexibility of this novel framework, the developed agent system is applied to a set of end-use systems. Furthermore, the agent framework is validated in hardware using controller-hardware-in-the-loop simulation platform.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Buyers Collusion in Incentivized Forwarding Networks: A Multi-Agent Reinforcement Learning Study

We present the issue of monetarily incentivized forwarding in a multi-hop mesh network architecture from an economic perspective. It is anticipated that credit-incentivized forwarding and relaying will be a simple method of exchanging transmission power and spectrum for connectivity. However, gateways and forwarding nodes, like any other free market, may create an oligopolistic market for the users they serve. In this study, a coalition scheme between buyers aims to address price control by gateways or nodes closer to gateways. In a Stackelberg competition game, buyer agents (users) and sellers (gateways) make decisions using reinforcement learning (RL), with decentralized Deep Q-Networks to buy and sell forwarding resources. We allow communication links between the buyers with a limited messaging space, without defining a collusion mechanism. The idea is to demonstrate that through messaging, and RL tacit collusion can emerge between agents in a decentralized setup. The multi-agent reinforcement learning (MARL) system is presented and analyzed from a machine-learning perspective. Moreover, MARL dynamics are discussed via mean field analysis to better understand divergence causes and make implementation recommendations for such systems. Finally, the simulation results show the results of coordination among the users.

42 ENGINEERING↗
DOE OSTI2021

Data-Driven Multi-agent Deep Reinforcement Learning for Distribution System Decentralized Voltage Control with High Penetration of PVs

This paper proposes a novel model-free/data-driven centralized training and decentralized execution multi-agent deep reinforcement learning (MADRL) framework for distribution system voltage control with high penetration of PVs. The proposed MADRL can coordinate both the real and reactive power control of PVs with existing static var compensators and battery storage systems. Unlike the existing DRL-based voltage control methods, our proposed method does not rely on a system model during both the training and execution stages. This is achieved by developing a new interaction scheme between the surrogate modeling of the original system and the multi-agent soft actor critic (MASAC) MADRL algorithm. In particular, the sparse pseudo-Gaussian process with a few-shots of measurements is utilized to construct the surrogate model of the original environment, i.e., power flow model. This is a data-driven process and no model parameters are needed. Furthermore, the MASAC enabled MADRL allows to achieve better scalability by dividing the original system into different voltage control regions with the aid of real and reactive power sensitivities to voltage, where each region is treated as an agent. This also serves as the foundation for the centralized training and decentralized execution, thus significantly reducing the communication requirements as only local measurements are required for control. Comparative results with other alternatives on the IEEE 123-nodes and 342-nodes systems demonstrate the superiority of the proposed method.

14 SOLAR ENERGY↗
DOE OSTI2022

The development and use of decision support framework for informing selection of select agent toxins with modelling studies to inform permissible toxin amounts

Many countries have worked diligently to establish and implement policies and processes to regulate high consequence pathogens and toxins that could have a significant public health impact if misused. In the United States, the Antiterrorism and Effective Death Penalty Act of 1996 (Public Law 104-132, 1996), as amended by the Bioterrorism Preparedness and Response Act of 2002 (Public Law 107-188, 2002) requires that the Department of Health and Human Services (HHS) [through the Centers for Disease Control and Prevention (CDC)] establish a list of bacteria, viruses, and toxins that have the potential to pose a severe threat to public health and safety. Currently, this list is reviewed and updated on a biennial basis using input from subject matter experts (SMEs). We have developed decision support framework (DSF) approaches to facilitate selection of select toxins and, where toxicity data are known, conducted modelling studies to inform selection of toxin amounts that should be excluded from select agent regulations. Exclusion limits allow laboratories to possess toxins under an established limit to support their research or teaching activities without the requirement to register with the Federal Select Agent Program. Fact sheets capturing data from a previously vetted SME workshop convened by CDC, literature review and SME input were developed to assist in evaluating toxins using the DSF approach. The output of the DSF analysis agrees with the current select toxin designations, and no other toxins evaluated in this study were recommended for inclusion on the select agent and toxin list. To inform the selection of exclusion limits, attack scenarios were developed to estimate the amount of toxin needed to impact public health. Scenarios consisted of simulated aerosol releases of a toxin in high-population-density public facilities and the introduction of a toxin into a daily consumable product supply chain. Using published inhalation and ingestion median toxic dose (TD 50 ) and median lethal dose (LD 50 ) values, where available, a range of toxin amounts was examined to estimate the number of people exposed to these amounts in these scenarios. Based on data generated by these models, we proposed toxin exclusion values corresponding to levels below those that would trigger a significant public health response (i.e., amounts estimated to expose up to ten people by inhalation or one hundred people by ingestion to LD 50 or TD 50 levels of toxin in the modeled scenarios).

60 APPLIED LIFE SCIENCES↗
NASA NTRS2004

The EO-1 Autonomous Science Agent Architecture

An Autonomous Science Agent is currently flying onboard the Earth Observing One Spacecraft. This software enables the spacecraft to autonomously detect and respond to science events occurring on the Earth. The package includes software systems that perform science data analysis, deliberative planning, and run-time robust execution. Because of the deployment to a remote spacecraft, this Autonomous Science Agent has stringent constraints of autonomy, reliability, and limited computing resources. We describe these constraints and how they are reflected in our agent architecture.

Earth Observing One (EO-1)↗
NASA NTRSDate not supplied

Clutter Assessment for an Autonomous Multi-Agent Search Mission

This paper presents a method for evaluating the amount of clutter in a region where autonomous vehicles in a multi-agent system must operate based on LIDAR point cloud measurements. The point cloud is used to generate an occupancy grid which is then projected onto a 2D plane of vehicle motion, constituting an image. A series of Gaussian radial basis functions (GRBFs) is created, each centered at an occupied pixel in a 2D image, and summed together to form the clutter field. The clutter field is a representation of the density and permeability of the space at each coordinate. The clutter field is then approximated such that iso-clutter contours are simple geometric objects so that intelligent machine assets can easily query the distance between them and any given point in an environment. In this way, agents are able to determine whether to enter into or steer away from areas of interest. Each vehicle has a clutter threshold representing the clutter value of the space in which it can safely maneuver. The iso-clutter contour corresponding to a vehicle’s clutter threshold is treated as the boundary of an obstacle to be avoided. A simulation is presented where a multi-agent system is tasked with persistent observation of a cluttered area. Each vehicle in the simulation has a different clutter threshold. The vehicles use a potential field-based guidance algorithm, and an allocation of vehicles to specific regions of the space emerges.

multi-agent↗
DOE OSTI2022

Agent-Based Modeling for the Circular Economy: Lessons Learned From Three Case Studies

The circular economy (CE) aims at decoupling human activities from resource use, creating wealth in the process. Recently, many scholars have questioned the link between increased circularity and sustainability, resulting in many methodological approaches being developed for that purpose. This presentation summarizes the insights gained from the application of agent-based modeling (ABM) to study the techno-economic and social conditions promoting circularity and sustainability of three technologies: photovoltaic (PV) modules, hard disk drives (HDDs), and wind blades. Four main categories of agents are defined in the ABM: asset owners, service providers (e.g., refurbishers), recyclers, and manufacturers. Two main CE strategies are represented: lifetime extension (through repair or reuse) and recycling. The developed models start by projecting installed capacities and end-of-life (EOL) quantities. Then the theory of planned behavior - a social psychology model explaining behavior adoption based on attitude, peer influence, and costs - is used to model the asset owners' EOL decision (i.e., landfill, recycle or extend the lifetime of the asset). Then, the quantities of assets flowing to the recycler and service provider agents and quantities of materials flowing to manufacturers are computed. Recyclers' economies of scale are dynamically modeled, and the value generated by the CE strategies for the recyclers, service providers, and manufacturers is computed within the model. When data are available, avoided greenhouse gas emissions resulting from the CE strategies adoption are calculated exogenously from the ABM simulations. Results show that with improved used PV modules warranties, the reuse CE strategy adoption increases from 1% to 23% between 2020 and 2050. Similarly, improved standards could enhance HDDs end-users trust in data-wiping - a prerequisite to reuse - leading to a 3-fold increase in the reuse rate and avoid about 5 million tons of CO2 eq by 2050. Regarding wind blades, 5-15 years lifetime extension could reduce EOL blade quantities by 13%. High costs and logistic issues prevent blades from being recycled in greater quantities. One insight from the case studies is the necessity to have mature secondary markets for reuse to be a viable option. Interestingly, PV reuse is limited by the willingness of PV owners to purchase used modules (on the demand side), while HDDs reuse is constrained by the lack of trust toward data-wiping (limiting the supply of used HDDs). The six limits of the CE concepts presented by Korhonen et al. (2018) are finally used to interpret the results. The HDD case study is an exemplary lock-in, where the first accepted practice (shredding) retains most of the market. The PV results illustrate the technical limitation to reuse, as the growing demand cannot be supplied entirely with used PV modules. The wind case study shows the relevance of clearly defining physical flows - what type of waste should wind blades be considered, how should they be transported and landfilled? - a crucial consideration that also applies to PV modules. Finally, the three case studies highlight the relevance of studying a technology's technical, economic, and market material efficiency potentials altogether and the potential benefit of coupling ABM to life cycle assessment.

agent-based modeling↗
DOE OSTI2023

Multi-Agent Reinforcement Learning for Distribution System Critical Load Restoration: Preprint

Grid resilience has become a critical topic recently because of the increasing occurrence of extreme events and the growing integration of intermittent renewable energy sources. To build a resilient distribution system, this paper develops a multi-agent reinforcement learning-based (MARL) method to coordinate distribution energy resources (DERs) dispatch, load pickup, and network reconfiguration for load restoration after a system outage. With the help of two types of control agents, namely critical load restoration (CLR) and coordination (COR) agents, system loads can be restored efficiently, given available resources. The effectiveness and superiority of the proposed algorithm are demonstrated through simulations and comparative studies on a real distribution feeder in Western Colorado.

distribution system↗