SEARCH · Engineering Papers

Results for “agent based”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

All sources NASA NTRS DOE OSTI

DOE OSTI2025

El Agente: An autonomous agent for quantum chemistry

Computational chemistry tools are widely used to study the behavior of chemical phenomena. Yet, the complexity of these tools can make them inaccessible to non-specialists and challenging even for experts. In this work, we introduce El Agente Q, an LLM-based multi-agent system that dynamically generates and executes quantum chemistry workflows from natural language user prompts. The system is built on a novel cognitive architecture featuring a hierarchical memory framework that enables flexible task decomposition, adaptive tool selection, post-analysis, and autonomous file handling and submission. El Agente Q is benchmarked on six university-level course exercises and two case studies, demonstrating robust problem-solving performance (averaging >87% task success) and adaptive error handling through in situ debugging. It also supports longer-term, multi-step task execution for more complex workflows, while maintaining transparency through detailed action trace logs. Together, these capabilities lay the foundation for increasingly autonomous and accessible quantum chemistry.

agentic systems↗

DOE OSTI2021

Object discrimination based on a swarm of agents

A configuration system for identifying a target configuration of agents for acquiring data is provided. In some embodiments, the configuration system generates sample configurations, each of which has a location within the space for each agent. The configuration system selects as the target configuration a sample configuration that is suitable to acquire data. The configuration system selects the target configuration by, for at least one or more sample configurations, directing that the agents assume the sample configuration and then acquire data when in the sample configuration. The configuration system then stores, for each sample configuration, an indication of suitability for acquiring data based on the sample configuration. The configuration system selects a sample configuration that is deemed to be suitable as the target configuration.

Beer, Neil Reginald↗

DOE OSTI2021

Evaluating Material Circular Efficacy of Waste-Management Scenarios Using PV ICE (PV in the Circular Economy) Tool

To meet the nation’s clean energy needs, it is projected that at least 1 TW of solar photovoltaics (PV) will be installed by 2050. To make this transition to solar energy sustainable, planning for a circular economy that maximizes reuse, repair, and recycle is crucial. The objective of this poster is to evaluate the circular efficacy of waste-management interventions, while considering social factors, using PV ICE, a modeling tool that quantifies future mass flows of PV based on dynamic, real-world data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NASA NTRS2006

Agent Reward Shaping for Alleviating Traffic Congestion

Traffic congestion problems provide a unique environment to study how multi-agent systems promote desired system level behavior. What is particularly interesting in this class of problems is that no individual action is intrinsically "bad" for the system but that combinations of actions among agents lead to undesirable outcomes, As a consequence, agents need to learn how to coordinate their actions with those of other agents, rather than learn a particular set of "good" actions. This problem is ubiquitous in various traffic problems, including selecting departure times for commuters, routes for airlines, and paths for data routers. In this paper we present a multi-agent approach to two traffic problems, where far each driver, an agent selects the most suitable action using reinforcement learning. The agent rewards are based on concepts from collectives and aim to provide the agents with rewards that are both easy to learn and that if learned, lead to good system level behavior. In the first problem, we study how agents learn the best departure times of drivers in a daily commuting environment and how following those departure times alleviates congestion. In the second problem, we study how agents learn to select desirable routes to improve traffic flow and minimize delays for. all drivers.. In both sets of experiments,. agents using collective-based rewards produced near optimal performance (93-96% of optimal) whereas agents using system rewards (63-68%) barely outperformed random action selection (62-64%) and agents using local rewards (48-72%) performed worse than random in some instances.

Tumer, Kagan↗

DOE OSTI2022

Volt-VAR Optimization in Distribution Networks Using Twin Delayed Deep Reinforcement Learning

Modern distribution grids are undergoing new challenges due to the stochastic nature of distributed energy resources (DERs). High penetration of DERs has a significant impact on Volt-VAR profile and system power losses. This work proposes a deep reinforcement learning (DRL)-based Volt-VAR optimization approach for improving voltage profile and reducing system power loss under high penetration of distributed energy resources, such as battery energy storage and solar photovoltaic units in distribution grids. The twin delayed deep deterministic policy gradient (TD3) method-based DRL agent is proposed to configure optimal set-points of reactive power outputs of fast responding smart inverters. The agent schedules the reactive power of inverters according to their physical capabilities, such as minimum allowed power factor, e.g., 0.9 leading/lagging. The reward function of the proposed DRL scheme is designed carefully to ensure a proper voltage profile of the grids with effective scheduling of reactive power outputs from inverters. The performance of the proposed model is verified on modified IEEE 34- and 123-bus systems and compared with base case with no reactive supply by inverters, and local droop Volt-VAR control approach. The results show that the proposed method performs better than the local droop control and deep deterministic policy gradient (DDPG)-based DRL method for reducing voltage fluctuation and minimizing power loss.

Hossain, Rakib↗

NASA NTRS2011

Entanglement in Self-Supervised Dynamics

A new type of correlation has been developed similar to quantum entanglement in self-supervised dynamics (SSD). SSDs have been introduced as a quantum-classical hybrid based upon the Madelung equation in which the quantum potential is replaced by an information potential. As a result, SSD preserves the quantum topology along with superposition, entanglement, and wave-particle duality. At the same time, it can be implemented in any scale including the Newtonian scale. The main properties of SSD associated with simulating intelligence have been formulated. The attention with this innovation is focused on intelligent agents interaction based upon the new fundamental non-New tonian effect; namely, entanglement.

Zak, Michail↗

DOE OSTI2022

Simulation-Based Model for Facility-Scale Eagle Presence Mapping

This talk presents the recent progress in building a predictive movement model for predicting conflict between soaring raptors and wind turbines. In particular, it details the recently developed numerical tool called Stochastic Soaring Raptor Simulator for simulating updraft-subsidized paths for soaring raptors through variety of wind conditions and the associated directional intent.

agent-based model↗

DOE OSTI2025

Tunable structure and reinforcement of polyvinyl alcohol (PVA) hydrogels using fungal chitin particles

Polysaccharides, including chitin, are one of the most abundant biopolymers in nature and are increasingly recognized as a sustainable alternative to petroleum-derived plastics and synthetic fillers in polymer composites. Traditionally sourced from crustacean shells, chitin offers mechanical strength and biocompatibility with limitations also in processability and functionality. Fungal-derived chitin material represents a promising alternative, with advantages including scalable fermentation on low-cost substrates, absence of shellfish allergens, and tunable molecular architectures that vary by species, developmental stage, and growth environment. Here, in this study, we systematically examined chitinous materials obtained from taxonomically and functionally distinct fungi, Laccaria bicolor, Trichoderma reesei and Rhizopus oryzae, to assess their structural, chemical, and morphological properties as reinforcement agents in polymer composites. Mild alkaline pretreatment was employed to obtain mycelium chitin particles, thereby improving accessibility to chitin and co-occurring β-D-glucans while maintaining microparticle integrity. Comprehensive FTIR and solid-state NMR analyses revealed species-specific differences in chemical composition and microstructure, with R. oryzae exhibiting a unique spectral signature. These fungal-derived chitin were then incorporated into poly(vinyl alcohol) (PVA) hydrogels, where they acted as reinforcing fillers without the need for additional chemical crosslinkers. Comparative evaluation of hydrogel properties demonstrated that fungal chitin significantly enhanced mechanical performance, with all mycelium fillers mitigating the water weakening in PVA hydrogels. R. oryzae-derived composites tripled the hydrogel tensile strength while the submicron fibrous morphology in L. bicolor contributes to over 45 % tensile improvement in dry PVA composites. Our findings highlight the potential of fungal biomass as a tunable, sustainable platform for producing chitin-based reinforcing agents.

Chitin↗

DOE OSTI2026

Enzymatic Biocontrol of Fire Blight ( Erwinia amylovora ) Using an Engineered Glycosyl Hydrolase

Current management of fire blight, caused by Erwinia amylovora , relies heavily on streptomycin a practice that has contributed to the emergence of antibiotic-resistant strains and raised environmental and regulatory concerns. Enzyme-based biocontrol agents offer a promising antibiotic-free approach that combines target specificity with environmental compatibility. This study evaluates CAase, a bacteriophage-derived glycosyl hydrolase, for its ability to disrupt E. amylovora biofilms and reduce disease severity. Biochemical assays and scanning electron microscopy confirmed that CAase efficiently degraded the extracellular polysaccharide (EPS) matrix, releasing cells from biofilms. Gas chromatography–mass spectrometry (GC–MS) linkage analysis of EPS isolated from two Erwinia amylovora strains demonstrated that CAase preferentially cleaves galactan-rich amylovoran produced by strain EA273, while exhibiting only limited activity toward the levan-rich EPS from strain EA1430. Functional assays revealed that CAase reduced bacterial viability by nearly 2 orders of magnitude at higher enzyme concentrations, strongly suppressed surface motility, and induced ultrastructural damage visible by transmission electron microscopy. Importantly, field trials showed that CAase significantly lowered blossom and shoot blight incidence under orchard conditions. These results highlight CAase as a potent enzyme-based strategy for reducing the virulence of E. amylovora and demonstrate its potential as a sustainable alternative to antibiotics in fire blight management.

antibiotic resistance↗

NASA NTRS1994

An agent-oriented approach to automated mission operations

As we plan for the next generation of Mission Operations Control Center (MOCC) systems, there are many opportunities for the increased utilization of innovative knowledge-based technologies. The innovative technology discussed is an advanced use of agent-oriented approaches to the automation of mission operations. The paper presents an overview of this technology and discusses applied operational scenarios currently being investigated and prototyped. A major focus of the current work is the development of a simple user mechanism that would empower operations staff members to create, in real time, software agents to assist them in common, labor intensive operations tasks. These operational tasks would include: handling routine data and information management functions; amplifying the capabilities of a spacecraft analyst/operator to rapidly identify, analyze, and correct spacecraft anomalies by correlating complex data/information sets and filtering error messages; improving routine monitoring and trend analysis by detecting common failure signatures; and serving as a sentinel for spacecraft changes during critical maneuvers enhancing the system's capabilities to support nonroutine operational conditions with minimum additional staff. An agent-based testbed is under development. This testbed will allow us to: (1) more clearly understand the intricacies of applying agent-based technology in support of the advanced automation of mission operations and (2) access the full set of benefits that can be realized by the proper application of agent-oriented technology in a mission operations environment. The testbed under development addresses some of the data management and report generation functions for the Explorer Platform (EP)/Extreme UltraViolet Explorer (EUVE) Flight Operations Team (FOT). We present an overview of agent-oriented technology and a detailed report on the operation's concept for the testbed.

Truszkowski, Walt↗

DOE OSTI2021

Dynamic Ride-Matching for Large-Scale Transportation Systems

Efficient dynamic ride-matching (DRM) in large-scale transportation systems is a key driver in transport simulations to yield answers to challenging problems. Although the DRM problem is simple to solve, it quickly becomes a computationally challenging problem in large-scale transportation system simulations. Therefore, this study thoroughly examines the DRM problem dynamics and proposes an optimization-based solution framework to solve the problem efficiently. To benefit from parallel computing and reduce computational times, the problem’s network is divided into clusters utilizing a commonly used unsupervised machine learning algorithm along with a linear programming model. Then, these sub-problems are solved using another linear program to finalize the ride-matching. At the clustering level, the framework allows users adjusting cluster sizes to balance the trade-off between the computational time savings and the solution quality deviation. A case study in the Chicago Metropolitan Area, U.S., illustrates that the framework can reduce the average computational time by 58% at the cost of increasing the average pick up time by 26% compared with a system optimum, that is, non-clustered, approach. Another case study in a relatively small city, Bloomington, Illinois, U.S., shows that the framework provides quite similar results to the system-optimum approach in approximately 62% less computational time.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2024

Technology progress and clean vehicle policies on fleet turnover and equity: insights from household vehicle fleet micro-simulations with $\text{ATLAS}$

This paper documents the design and application of ATLAS (Automobile and Technology Lifecycle-Based ASsignment), a comprehensive household vehicle transaction and technology adoption micro-simulator in the San Francisco Bay Area. ATLAS evolves the fleet mix of individual households by simulating the vehicle transaction and choice decisions in response to co-evolving demographics, land use, and vehicle technology simulations. While most existing literature has focused on the aggregate clean vehicle uptake, this paper differentiates distributional effects and decomposes the underlying mechanisms across heterogeneous sub-populations of households. Using scenarios and sensitivity simulations that vary vehicle technology and policy assumptions, we find that Zero Emission Vehicles (ZEVs) penetrate into higher income groups at a faster rate than into lower income groups, which is intuitive and aligns with expectations. Interestingly, the relative income disparity in ZEV ownership shrinks over time across all scenarios, with a ZEV mandate coupled with declining battery cost leading to the greatest reduction in disparity of ZEV ownership by 2050. Federal, state, and local financial incentives influence the redistribution of ZEV uptake across income groups and contribute to narrowing income disparity. Vehicle transaction frequency and new versus used market dynamics are found to be important factors contributing to the income disparity.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

Behavioral responses of fish to a current-based hydrokinetic turbine under mutliple operational conditions

There is significant international interest in developing current-based marine and hydrokinetic (MHK) technologies to capture the power of tidal energy. However, concerns have been raised regarding the ecological effects of these projects on fish, including the risk of blade collision and behavioral impacts such as the disruption of migratory behavior and food acquisition and displacement from preferred habitats. In this study, we conducted mobile hydroacoustic surveys to track fish as they approached a tidal turbine deployed in Cobscook Bay, Maine. There was a significant decline in fish numbers with decreasing distance to the turbine, beginning approximately 140 m from the turbine. Similar declines were not observed at control transects or when the turbine was not spinning. The decline in fish numbers appeared to be the result of horizontal displacement, not vertical, movements to avoid the turbine. Noise rather than visual cues or flow field disturbance seemed to be a likely explanation for the reduced number of fish near the turbine. This finding, combined with near-field blade collision studies indicating a low probability of encounter, suggests that a single turbine poses a low collision risk to pelagic fish and that a single turbine is likely to result in minimal behavioral responses by fish. However, the risk may be different with additional devices, which will become more relevant as commercial-scale MHK arrays come under consideration. Therefore, the risks associated with commercial-scale operations will ultimately have to be evaluated to fully understand the ecological impacts of MHK devices.

42 ENGINEERING↗

DOE OSTI2022

Progress Towards a Predictive Eagle Behavior and Risk Modeling Framework: Overview and Recent Validation Efforts

This presentation summarizes progress to date of the U.S. Department of Energy project, "Development of a computational framework for modeling golden eagles (Aquila chrysaetos) near wind farms," which focuses on stochastic behavioral modeling of soaring raptors across landscape, facility, and turbine spatiotemporal scales. This publicly available, open-source modeling framework includes behavioral models based on three different underlying principles: energy minimization at landscape scale, behavioral heuristics at landscape-facility scale, and data-driven behaviors at the facility-micro-scale. We will briefly overview the key advancements in the behavioral modeling state of the art, which leverages multiple high-resolution telemetry data sources combined with high-fidelity atmospheric flow modeling insights. We then present preliminary results from a validation study in Altamont, California. This new study involves a novel application of the Stochastic Soaring Raptor Simulator (SSRS), in a new geographic locale, to understand facility scale eagle movement patterns over time scales representative of a wind project's lifetime. For this desktop analysis (that does not depend on any high-performance computing resources), SSRS simultaneously considers a variety of wind conditions and eagle approach vectors toward a project site of interest. This work demonstrates the integration of publicly available landscape-scale atmospheric datasets, our recently improved engineering updraft models (see presentation from Thedin et al.), and our energy minimization behavioral models within the SSRS framework. While we only present results from a single behavioral model, the integration of these three modeling components forms the foundation for our more sophisticated behavioral models (see presentations from Brandes et al., Sandhu et al.) that are under active development. Results are presented in the form of presence maps, which may be applied to estimate risk to wildlife, augment ground survey data, inform wind-plant operations, or incorporated into wind-plant designs.

agent-based modeling↗

DOE OSTI2023

Sostdc1 Suppression in the Absence of Sclerostin Potentiates Anabolic Action of Cortical Bone in Mice

ABSTRACT The development of Wnt-based osteoanabolic agents has progressed rapidly in recent years, given the potent effects of Wnt modulation on bone homeostasis. Simultaneous pharmacologic inhibition of the Wnt antagonists sclerostin and Dkk1 can be optimized to create potentiated effects in the cancellous bone compartment. We looked for other candidates that might be co-inhibited along with sclerostin to potentiate the effects in the cortical compartment. Sostdc1 (Wise), like sclerostin and Dkk1, also binds and inhibits Lrp5/6 coreceptors to impair canonical Wnt signaling, but Sostdc1 has greater effects in the cortical bone. To test this concept, we deleted Sostdc1 and Sost from mice and measured the skeletal effects in cortical and cancellous compartments individually. Sost deletion alone produced high bone mass in all compartments, whereas Sostdc1 deletion alone had no measurable effects on either envelope. Mice with codeletion of Sostdc1 and Sost had high bone mass and increased cortical properties (bone mass, formation rates, mechanical properties), but only among males. Combined administration of sclerostin antibody and Sostdc1 antibody in wild-type female mice produced potentiation of cortical bone gain despite no effect of Sostdc1 antibody alone. In conclusion, Sostdc1 inhibition/deletion can work in concert with sclerostin deficiency to improve cortical bone properties. © 2023 The Authors. Journal of Bone and Mineral Research published by Wiley Periodicals LLC on behalf of American Society for Bone and Mineral Research (ASBMR).

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

On the applicability of various levels of detail for occupant behavior representation and modeling in building performance simulation

Occupant behavior (OB) is one of the significant sources of uncertainty in building performance simulation. While OB modeling has received increased attention in the past decade, research on the degree of granularity or level of detail (LoD) required for representing occupants is still in the nascent stages. This paper analyzes the modeling and applicability of three LoDs to represent occupants in building performance assessment. A medium-sized prototype office building located in Chicago, Illinois is used as the simulation case study. Ten occupant-centric attributes are adopted to develop the LoDs for OB representation. We first demonstrate the different modeling approaches required for simulating the three fidelity levels. Later, we illustrate the suitability of the developed LoDs in supporting six building performance use cases across different lifecycle stages. Furthermore, this study intends to provide guidance for the building simulation community on appropriate OB representation to support various use cases.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

Reinforcement learning based automated history matching for improved hydrocarbon production forecast

History matching aims to find a numerical reservoir model that can be used to predict the reservoir performance. An engineer and model calibration (data inversion) method are required to adjust various parameters/properties of the numerical model in order to match the reservoir production history. In this study, we develop deep neural networks within the reinforcement learning framework to achieve automated history matching that will reduce engineers’ efforts, human bias, automatically and intelligently explore the parameter space, and remove the need of large set of labeled training data. To that end, a fast-marching-based reservoir simulator is encapsulated as an environment for the proposed reinforcement learning. The deep neural-network-based learning agent interacts with the reservoir simulator within reinforcement learning framework to achieve the automated history matching. Reinforcement learning techniques, such as discrete Deep Q Network and continuous Deep Deterministic Policy Gradients, are used toth, used to train the learning agents. The continuous actions enable the Deep Deterministic Policy Gradients to explore more states at each iteration in a a learning episode; consequently, a better history matching is achieved using this algorithm as compared to Deep Q Network. For simplified dual-target composite reservoir models, the best history-matching performances of the discrete and continuous learning methods in terms of normalized root mean square errors are 0.0447 and 0.0038, respectively. Furthermore, our study shows that continuous action space achieved by the deep deterministic policy gradient drastically outperforms deep Q network.

42 ENGINEERING↗

DOE OSTI2022

Stochastic simulation of occupant-driven energy use in a bottom-up residential building stock model

The residential buildings sector is one of the largest electricity consumers worldwide and contributes disproportionally to peak electricity demand in many regions. Strongly driven by occupant activities, household energy consumption is stochastic and heterogeneous in nature. However, most residential energy models applied by industry use homogeneous, deterministic activity schedules, which work well for predictions of annual energy consumption, but can result in unrealistic hourly or sub-hourly electric load profiles, with exaggerated or muted peaks. The increasing proportion of variable renewable energy generators means that representing the heterogeneity and stochasticity of occupant behavior is now crucial for reliable planning at both bulk-power and distribution-system scales. This work presents a novel and open-source occupancy simulation approach that can simulate a diverse set of individual occupant and household event schedules for all major electricity, fuel, and hot water end uses. To accomplish this, we evaluated three alternative occupant activity simulation approaches before selecting a hybrid combining time-inhomogeneous Markov chains and probability-sampling of event durations and magnitudes. Further, we integrated the stochastic occupancy simulation with an open-source bottom-up physics-simulation building stock model and published a set of 550,000 diverse household end-use activity schedules representing a national housing stock. The simulator was verified against time-use survey data, and simulation results were validated against measured end-use electricity data for accuracy and reliability. While we use data for the United States, our application demonstrates how similar approaches could be applied using the time-use survey data collected in many countries around the world.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗