Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Exploring the Effects of Node Topology, Connectivity, and Metal Identity on the Binding of Nerve Agents and Their Hydrolysis Products in Metal–Organic Frameworks

Recent studies have shown that metal–organic frameworks (MOFs) built from hexanuclear M(IV) oxide cluster nodes are effective catalysts for nerve agent hydrolysis, where the properties of the active sites on the nodes can strongly influence the reaction energetics. The connectivity and metal identity of these M6 nodes can be easily tuned, offering extensive opportunities for computational screening to predict promising new materials. Thus, we used density functional theory (DFT) to examine the effects of node topology, connectivity, and metal identity on the binding energies of multiple nerve agents and their corresponding hydrolysis products. By computing an optimization metric based on the relative binding strengths of key hydrolysis reaction species (water, agent, and bidentate-bound products), we predicted optimal M6 nodes for hydrolyzing specific nerve agent and simulant molecules, where our results are in qualitative agreement with observed experimental trends. This analysis highlighted the notion that no single metal or node topology is optimal for all possible organophosphates, suggesting that MOFs should be selected based on the agent of interest. Using the large amount of data generated from our DFT calculations, we then derived quantitative structure–activity relationship (QSAR) models to help explain the complex trends observed in the binding energies. Through linear regression, we identified the most important descriptors for describing the binding of nerve agents and their hydrolysis products to M6 nodes. These results suggested that both molecular and node properties, including both structural and chemical features, collectively contribute to the binding energetics. By performing a thorough statistical analysis, we showed that our QSAR models are capable of making quantitatively accurate binding energy predictions for nerve agents and their hydrolysis products in a wide variety of M(IV)-MOFs. In conclusion, the insights gained herein can be used to guide future experiments for the synthesis of MOFs with enhanced catalytic activity for organophosphate hydrolysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Variational multiscale reinforcement learning for discovering reduced order closure models of nonlinear spatiotemporal transport systems

Abstract A central challenge in the computational modeling and simulation of a multitude of science applications is to achieve robust and accurate closures for their coarse-grained representations due to underlying highly nonlinear multiscale interactions. These closure models are common in many nonlinear spatiotemporal systems to account for losses due to reduced order representations, including many transport phenomena in fluids. Previous data-driven closure modeling efforts have mostly focused on supervised learning approaches using high fidelity simulation data. On the other hand, reinforcement learning (RL) is a powerful yet relatively uncharted method in spatiotemporally extended systems. In this study, we put forth a modular dynamic closure modeling and discovery framework to stabilize the Galerkin projection based reduced order models that may arise in many nonlinear spatiotemporal dynamical systems with quadratic nonlinearity. However, a key element in creating a robust RL agent is to introduce a feasible reward function, which can be constituted of any difference metrics between the RL model and high fidelity simulation data. First, we introduce a multi-modal RL to discover mode-dependant closure policies that utilize the high fidelity data in rewarding our RL agent. We then formulate a variational multiscale RL (VMRL) approach to discover closure models without requiring access to the high fidelity data in designing the reward function. Specifically, our chief innovation is to leverage variational multiscale formalism to quantify the difference between modal interactions in Galerkin systems. Our results in simulating the viscous Burgers equation indicate that the proposed VMRL method leads to robust and accurate closure parameterizations, and it may potentially be used to discover scale-aware closure models for complex dynamical systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

High reactivity of mesoporous CeO 2 to dissociate chemical warfare agent sarin

We perform spectroscopic surface characterization on mesoporous ceria (CeO 2 ) under exposure of sarin gas, also known as GB. We find mesoporous CeO 2 displays extraordinary reactivity towards GB dissociation under high vacuum. The spectroscopic results combined with density functional theory (DFT) calculations suggest that the cleavage of the P–F and P–OR bonds are both possible pathways for GB to dissociate on the CeO 2 surfaces. The modeling reveals differences in dissociation pathways of GB on the crystallographic (111)- and (110)-surfaces of ceria. Here we also report some dissociation of GB on mesoporous CeO 2 under ambient conditions. The finding that mesoporous CeO 2 can degrade GB under mild conditions is encouraging and implies the strong potential of ceria-based materials to be applied in combating chemical warfare agents related to the GB series.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Treatment of Prostate Cancer with CD46-targeted 225 Ac Alpha Particle Radioimmunotherapy

Radiopharmaceutical therapy is changing the standard of care in prostate cancer and other malignancies. We previously reported high CD46 expression in prostate cancer and developed an antibody–drug conjugate and immunoPET agent based on the YS5 antibody, which targets a tumor-selective CD46 epitope. Here, we present the preparation, preclinical efficacy, and toxicity evaluation of [ 225 Ac]DOTA-YS5, a radioimmunotherapy agent based on the YS5 antibody. [ 225 Ac]DOTA-YS5 was developed, and its therapeutic efficiency was tested on cell-derived (22Rv1, DU145), and patient-derived (LTL-545, LTL484) prostate cancer xenograft models. Biodistribution studies were carried out on 22Rv1 tumor xenograft models to confirm the targeting efficacy. Toxicity analysis of the [ 225 Ac]DOTA-YS5 was carried out on nu/nu mice to study short-term (acute) and long-term (chronic) toxicity. Biodistribution study shows that [ 225 Ac]DOTA-YS5 agent delivers high levels of radiation to the tumor tissue (11.64% ± 1.37%ID/g, 28.58% ± 10.88%ID/g, 29.35% ± 7.76%ID/g, and 31.78% ± 5.89%ID/g at 24, 96, 168, and 408 hours, respectively), compared with the healthy organs. [ 225 Ac]DOTA-YS5 suppressed tumor size and prolonged survival in cell line–derived and patient-derived xenograft models. Toxicity analysis revealed that the 0.5 μCi activity levels showed toxicity to the kidneys, likely due to redistribution of daughter isotope 213 Bi. [ 225 Ac]DOTA-YS5 suppressed the growth of cell-derived and patient-derived xenografts, including prostate-specific membrane antigen–positive and prostate-specific membrane antigen–deficient models. Overall, this preclinical study confirms that [ 225 Ac]DOTA-YS5 is a highly effective treatment and suggests feasibility for clinical translation of CD46-targeted radioligand therapy in prostate cancer.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2026

A transfer learning approach to energy-efficient control of small and medium-sized commercial buildings

Model-free reinforcement learning (RL) provides a data-driven and adaptive approach to optimize building energy use while satisfying occupant comfort. This powerful tool does not need any prior knowledge about the environment and system it is optimizing and can adapt its policy based on the changes in captures. Like any other data-driven tool, it faces high training costs due to the extensive agent-environment interactions required to capture long-term building dynamics and user comfort. Transfer learning, particularly policy distillation, offers a promising way to accelerate training by leveraging pretrained RL agents in different building and system types. Here, this study investigates online student distillation, in which the student model updates its neural network weights using outputs from teacher models. The work introduces a student distillation strategy designed for efficient knowledge transfer, along with a teacher selection method that ensures high-quality guidance. The approach is validated using a highly calibrated whole building energy model for a small/medium commercial building test facility. Results show substantial reductions in training time and data requirements while surpassing the performance of ASHRAE Guideline 36, an advanced rule-based control strategy. The distilled RL model required 45% less data and achieved 20% higher cumulative rewards than a state-of-the-art RL model, with faster convergence and lower energy consumption. These outcomes demonstrate that effective transfer learning enables a scalable and data-efficient energy management solution for commercial buildings.

ASHRAE guideline 36↗
DOE OSTI2022

Structure-based discovery of potent WD repeat domain 5 inhibitors that demonstrate efficacy and safety in preclinical animal models

WD repeat domain 5 (WDR5) is a core scaffolding component of many multiprotein complexes that perform a variety of critical chromatin-centric processes in the nucleus. WDR5 is a component of the mixed lineage leukemia MLL/SET complex and localizes MYC to chromatin at tumor-critical target genes. As a part of these complexes, WDR5 plays a role in sustaining oncogenesis in a variety of human cancers that are often associated with poor prognoses. Thus, WDR5 has been recognized as an attractive therapeutic target for treating both solid and hematological tumors. Previously, small-molecule inhibitors of the WDR5-interaction (WIN) site and WDR5 degraders have demonstrated robust in vitro cellular efficacy in cancer cell lines and established the therapeutic potential of WDR5. However, these agents have not demonstrated significant in vivo efficacy at pharmacologically relevant doses by oral administration in animal disease models. We have discovered WDR5 WIN-site inhibitors that feature bicyclic heteroaryl P 7 units through structure-based design and address the limitations of our previous series of small-molecule inhibitors. Importantly, our lead compounds exhibit enhanced on-target potency, excellent oral pharmacokinetic (PK) profiles, and potent dose-dependent in vivo efficacy in a mouse MV4:11 subcutaneous xenograft model by oral dosing. Furthermore, these in vivo probes show excellent tolerability under a repeated high-dose regimen in rodents to demonstrate the safety of the WDR5 WIN-site inhibition mechanism. Collectively, our results provide strong support for WDR5 WIN-site inhibitors to be utilized as potential anticancer therapeutics.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

DEMographic MicrOSimulation (DEMOS) v2.0

DEMOS is an agent-based simulation framework used to evolve population demographic characteristics or lifecycle events such as education, marital status etc. DEMOS modules are designed to capture the interdependencies of short-term and long-term lifecycle events often influential in downstream transportation and land use modeling. An important facet of DEMOS is that it is dynamic, meaning it captures the impact of an agent's demographic characteristics in year 't' on their demographic status in year 't+1'. This has important consequences on medium- and long-term downstream modeling in different domains, such as transportation where decisions such as household vehicle transactions (i.e., buying, selling, or replacing a vehicle) depend current or past household vehicle holdings as well as household transitions. Other downstream modeling that can be enabled by DEMOS include building technology adoption or retrofit decisions, and more. DEMOS modules include: individual age progression year by year, individual mortality events, household restructuring events including marriage match-making; household birth events; individual education participation; individual labor force participation; child leaving household; household in-migration and out-migration for the region; household residence location choice and household mandatory destination choice (work and school). This version of DEMOS is tailored to be integrated with the land use simulation software UrbanSim.

Caicedo, Juan [UrbanSim, Inc.]↗
DOE OSTI2026

ORCHID: Orchestrated Retrieval-Augmented Classification of High-Risk Property with Intelligent Decision-Making

High-Risk Property (HRP) classification is critical at U.S. Department of Energy (DOE) sites, where inventories include sensitive and often dual-use equipment. Compliance must track evolving rules designated by various export control policies to make transparent and auditable decisions. Traditional expert-only workflows are time-consuming, backlog-prone, and struggle to keep pace with shifting regulatory boundaries. We propose ORCHID, a modular agentic framework for HRP classification that pairs retrieval-augmented generation (RAG) with human oversight to produce policy based outputs that can be audited. Small cooperating agents—retrieval, description refiner, classifier, validator, and feedback logger—coordinate via agent-to-agent messaging and invoke tools through the Model Context Protocol (MCP) for model-agnostic on-premise operation. The interface follows an "Item to Evidence to Decision" loop with step-by-step reasoning, on-policy citations, and append-only audit bundles (run-cards, prompts, evidence). In preliminary tests on real HRP cases, ORCHID improves accuracy and traceability over a non-agentic baseline while deferring uncertain items to Subject Matter Experts (SMEs). The demonstration shows single item submission, grounded citations, SME feedback capture, and exportable audit artifacts—illustrating a practical path to trustworthy LLM assistance in sensitive DOE compliance workflows.

Das, Sanjay [ORNL] (ORCID:0009000542591915)↗
DOE OSTI2025

Multi-agent AI collaboration for digital twin development and assessment

Developing a digital twin (DT) model involves different steps that encompass formulating requirements, model development, implementation, and assessment with respect to real applications. Human expertise is required to coordinate and implement different steps in the DT development and assessment process. However, certain parts of this process can be automated using artificial intelligence (AI) agents for efficient workflow development. In this work, we test and analyze a multiagent AI collaboration with humans in the loop to automate different elements of the DT development and assessment process. To implement the workflow for multiagent AI DT development and assessment, we use Autogen, a multiagent framework developed by Microsoft. Autogen offers a modular and flexible framework for configuring and designing task-specific multiagent workflows. In this framework, large language models (LLMs) form the core intelligence of the AI agents where the quality and performance of the automated element is governed by the inherent capabilities and knowledge base of the LLM. We use retrieval augmented generation to supplement the LLM with relevant domain-specific information for DT requirement formulation. We illustrate this multiagent workflow using a case study on a thermal energy storage system, focusing on how AI agents can collaborate with humans to expedite and optimize different elements of DT development and assessment process.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Autonomous alloy composition optimization using molecular dynamics guided by a large language model

Here, we present an autonomous materials discovery framework that couples a large language model (LLM) with molecular dynamics (MD) simulations to optimize Fe–Cr–Mn alloy compositions for tensile strength. Starting from six distinct compositions, the LLM operated as an intelligent agent, iteratively proposing changes based on prior simulation results and constraints. Over 50 iterations per case, the LLM adaptively explored the composition space, identifying high-strength regions, not easily accessible by conventional methods. The highest strength, 18.7 GPa, was achieved with Fe 71 Cr 25 Mn 4 composition, identified from a Fe 75 Cr 20 Mn 5 starting point. The LLM autonomously adjusted its strategy in real time, demonstrating closed-loop decision-making using commodity hardware. This approach showcases the potential of LLMs as scientific co-pilots, capable of accelerating materials discovery and generalizable to other domains like biology and drug design.

Autonomy↗
DOE OSTI2024

CACTUS: Chemistry Agent Connecting Tool Usage to Science

Large language models (LLMs) have shown remarkable potential in various domains but often lack the ability to access and reason over domain-specific knowledge and tools. In this article, we introduce Chemistry Agent Connecting Tool-Usage to Science (CACTUS), an LLM-based agent that integrates existing cheminformatics tools to enable accurate and advanced reasoning and problem-solving in chemistry and molecular discovery. We evaluate the performance of CACTUS using a diverse set of open-source LLMs, including Gemma-7b, Falcon-7b, MPT-7b, Llama3-8b, and Mistral-7b, on a benchmark of thousands of chemistry questions. Our results demonstrate that CACTUS significantly outperforms baseline LLMs, with the Gemma-7b, Mistral-7b, and Llama3-8b models achieving the highest accuracy regardless of the prompting strategy used. Moreover, we explore the impact of domain-specific prompting and hardware configurations on model performance, highlighting the importance of prompt engineering and the potential for deploying smaller models on consumer-grade hardware without a significant loss in accuracy. By combining the cognitive capabilities of open-source LLMs with widely used domain-specific tools provided by RDKit, CACTUS can assist researchers in tasks such as molecular property prediction, similarity searching, and drug-likeness assessment.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Attention Enabled Multi-Agent DRL for Decentralized Volt-VAR Control of Active Distribution System Using PV Inverters and SVCs

This paper proposes attention enabled multi-agent deep reinforcement learning (MADRL) framework for active distribution network decentralized Volt-VAR control. Using the unsupervised clustering, the whole distribution system can be decomposed into several sub-networks according to the voltage and reactive power sensitivity relationships. Then, the distributed control problem of each sub-network is modeled as Markov games and solved by the improved MADRL algorithm, where each sub-network is modeled as an adaptive agent. An attention mechanism is developed to help each agent focus on specific information that is mostly related to the reward. All agents are centrally trained offline to learn the optimal coordinated Volt-VAR control strategy and executed in a decentralized manner to make online decisions with only local information. Compared with other distributed control approaches, the proposed method can effectively deal with uncertainties, achieve fast decision makings, and significantly reduce the communication requirements. Comparison results with model-based and other data-driven methods on IEEE 33-bus and 123-bus systems demonstrate the benefits of the proposed approach.

distribution network↗
DOE OSTI2023

Microgrid energy scheduling under uncertain extreme weather: Adaptation from parallelized reinforcement learning agents

Microgrids are useful solutions for integrating renewable energy resources and providing seamless green electricity to minimize carbon footprint. In recent years, extreme weather events happened often worldwide and caused significant economic and societal losses. Such events bring uncertainties to the microgrid energy scheduling problems and increase the challenges of microgrid operation. Traditional optimization approaches suffer from the inaccuracy of the uncertain microgrid model and the unseen events. Existing reinforcement learning (RL) - based approaches are also hampered by the limited generalization and the increasing computational burden when stochastic formulations are required to accommodate the uncertainties. This paper proposes a new parallelized reinforcement learning (PRL) method based on the probabilistic events to handle the microgrid energy uncertainties. Specifically, several local learning agents are employed to interact with pertinent microgrid environments in a distributed manner and report outcomes to the global agent, which will optimize microgrid energy resources online during extreme events. The stochastic microgrid energy optimization problem is reformulated to include all possible scenarios with probabilities. The advantage estimate functions of learning agents are designed with a backward sweep to transfer the outcomes to the value function updating process. Two simulation studies, stochastic optimization and online testing, are performed to compare with several existing RL approaches. Results substantiate that the proposed PRL method can achieve up to 20% optimization performance improvement with 4 and 28 times less computation cost than Q-learning with experience replay and multi-agent Q-learning approaches, respectively.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Extending the Near-Infrared Emission Range of Indium Phosphide Quantum Dots for Multiplexed In Vivo Imaging

This report of the reddest emitting indium phosphide quantum dots (InP QDs) to date demonstrates tunable, near-infrared (NIR) photoluminescence (PL) as well as PL multiplexing in the first optical tissue window while avoiding toxic constituents. This synthesis overcomes the InP “growth bottleneck” and extends the emission peak of InP QDs deeper into the first optical tissue window using an inverted QD heterostructure, specifically ZnSe/InP/ZnS core/shell/shell nanoparticles. The QDs exhibit InP shell thickness-dependent tunable emission with peaks ranging from 515–845 nm. The high absorptivity of InP yields effective photoexcitation of the QDs with UV, visible, and NIR wavelengths. These nanoparticles extend the range of tunable direct-bandgap emission from InP-based nanostructures, effectively overcoming a synthetic barrier that has prevented InPbased QDs from reaching their full potential as NIR imaging agents. Further, multiplexed lymph node imaging in a mouse model demonstrates the potential of the NIR-emitting InP particles for in vivo imaging.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2022

A high-fidelity building performance simulation test bed for the development and evaluation of advanced controls

We present an open-source building performance simulation test bed, the Advanced Controls Test Bed (ACTB), that interfaces high-fidelity Spawn of EnergyPlus building models, with advanced controllers implemented in Python. Additionally, the ACTB leverages the Building Optimization Testing and Alfalfa platforms for managing simulations, providing an external clock, a representational state transfer (REST) application programming interface (API), and key performance indicators for evaluating the effectiveness of control strategies. The REST API allows the development of external controllers programmed in languages such as Python, which provides flexibility and a rich choice of scientific libraries for designing control sequences. We present three test cases based on the U.S. Department of Energy's Reference Small Office Building to demonstrate the ACTB's capabilities: (a) rule-based controls compliant with ASHRAE Guideline 36 control sequences; (b) an economic model predictive control implemented using do-mpc; and (c) a deep Q-network reinforcement learning agent implemented using OpenAI Gym.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Load Shedding for Voltage Regulation With Probabilistic Agent Compliance

With the increased observability and controllability of distribution systems, the share of behind-the-meter systems is trending upwards rapidly. As a consequence, the impact of human behaviors on system performance can no longer be ignored and should be reflected in the energy management system models. In this paper, we discuss the problem of distribution system voltage control by active power curtailment where the agent compliance of the load curtailment signal is probabilistic. We discuss the modeling of the optimal voltage control problem with probabilistic agent compliance as a chance-constrained optimization problem, its tractable safe approximation using convex restriction, and a scenario-based mixed-integer reformulation as well as the associated solution method based on augmented Lagrangian method. The numerical simulation on IEEE test system validates the effectiveness of the proposed approach in obtaining high-quality feasible load curtailment signal with low computational cost, which makes it a viable tool for real time decision making.

augmented Lagrangian method↗
DOE OSTI2025

A Neural Optimizer With Decision-Focused Learning for Optimal Energy Storage Operation

Here, this article introduces a neural optimizer-based framework for optimizing battery energy storage system (BESS) control for grid services, including demand charge and energy cost reduction. By leveraging decision-focused learning (DFL), the proposed framework ensures seamless integration and adaptation, significantly enhancing control performance. A patch time-series transformer is employed for peak load forecasting, incorporating aleatoric uncertainty quantification to account for forecasting uncertainties within the decision-making process. The framework utilizes a solver-in-the-loop approach to generate optimal BESS actions, which are then used to train the neural optimizer-based agent. By co-optimizing both BESS operational modes and output power within the NN, the system achieves improved performance and robustness. After initial training, the forecasting and control models are jointly fine-tuned to account for forecasting errors, further improving decision precision and efficiency through DFL. Case studies are performed to validate the performance of the framework using multiple real-world datasets, demonstrating superior performance in monthly peak load forecasting compared to state-of-the-art models. In addition, the results are compared against existing decision-making approaches. The results demonstrate a reduction in monthly peak forecasting error by approximately 15% across various performance measures and achieve an optimization gap for BESS operation that is about three times smaller compared to existing methods.

Kim, Hyeonjin [Pacific Northwest National Laborato↗
DOE OSTI2024

A novel digital lifecycle for Material‐Process‐Microstructure‐Performance relationships of thermoplastic olefins foams manufactured via supercritical fluid assisted foam injection molding

Abstract This research significantly enhances the applicability of thermoplastic olefins (TPOs) in the automotive industry using supercritical N 2 as a physical foaming agent, effectively addressing the limitations of traditional chemical agents. It merges experimental results with simulations to establish detailed material‐process‐microstructure‐performance (MP2) relationships, targeting 5–20% weight reductions. This innovative approach labeled digital lifecycle (DLC) helps accurately predict tensile, flexural, and impact properties based on the foam microstructure, along with experimentally demonstrating improved paintability. The study combines process simulations with finite element models to develop a comprehensive digital model for accurately predicting mechanical properties. Our findings demonstrate a strong correlation between simulated and experimental data, with about a 5% error across various weight reduction targets, marking significant improvements over existing analytical models. This research highlights the efficacy of physical foaming agents in TPO enhancement and emphasizes the importance of integrating experimental and simulation methods to capture the underlying foaming mechanism to establish material‐process‐microstructure‐performance (MP2) relationships. Highlights Establishes a material‐process‐microstructure‐performance (MP2) for TPO foams Sustainably produces TPO foams using supercritical (ScF) N 2 with 20% lightweighting Shows enhanced paintability for TPO foam improved surface aesthetics Digital lifecycle (DLC) that predicts both foam microstructure and properties DLC maps process effects & microstructure onto FEA mesh for precise prediction

Engineering↗