Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A high-fidelity building performance simulation test bed for the development and evaluation of advanced controls

We present an open-source building performance simulation test bed, the Advanced Controls Test Bed (ACTB), that interfaces high-fidelity Spawn of EnergyPlus building models, with advanced controllers implemented in Python. Additionally, the ACTB leverages the Building Optimization Testing and Alfalfa platforms for managing simulations, providing an external clock, a representational state transfer (REST) application programming interface (API), and key performance indicators for evaluating the effectiveness of control strategies. The REST API allows the development of external controllers programmed in languages such as Python, which provides flexibility and a rich choice of scientific libraries for designing control sequences. We present three test cases based on the U.S. Department of Energy's Reference Small Office Building to demonstrate the ACTB's capabilities: (a) rule-based controls compliant with ASHRAE Guideline 36 control sequences; (b) an economic model predictive control implemented using do-mpc; and (c) a deep Q-network reinforcement learning agent implemented using OpenAI Gym.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Load Shedding for Voltage Regulation With Probabilistic Agent Compliance

With the increased observability and controllability of distribution systems, the share of behind-the-meter systems is trending upwards rapidly. As a consequence, the impact of human behaviors on system performance can no longer be ignored and should be reflected in the energy management system models. In this paper, we discuss the problem of distribution system voltage control by active power curtailment where the agent compliance of the load curtailment signal is probabilistic. We discuss the modeling of the optimal voltage control problem with probabilistic agent compliance as a chance-constrained optimization problem, its tractable safe approximation using convex restriction, and a scenario-based mixed-integer reformulation as well as the associated solution method based on augmented Lagrangian method. The numerical simulation on IEEE test system validates the effectiveness of the proposed approach in obtaining high-quality feasible load curtailment signal with low computational cost, which makes it a viable tool for real time decision making.

augmented Lagrangian method↗
NASA NTRS2005

Temporal and Resource Reasoning for Planning, Scheduling and Execution in Autonomous Agents

This viewgraph slide tutorial reviews methods for planning and scheduling events. The presentation reviews several methods and uses several examples of scheduling events for the successful and timely completion of the overall plan. Using constraint based models the presentation reviews planning with time, time representations in problem solving and resource reasoning.

Muscettola, Nicola↗
DOE OSTI2025

A Neural Optimizer With Decision-Focused Learning for Optimal Energy Storage Operation

Here, this article introduces a neural optimizer-based framework for optimizing battery energy storage system (BESS) control for grid services, including demand charge and energy cost reduction. By leveraging decision-focused learning (DFL), the proposed framework ensures seamless integration and adaptation, significantly enhancing control performance. A patch time-series transformer is employed for peak load forecasting, incorporating aleatoric uncertainty quantification to account for forecasting uncertainties within the decision-making process. The framework utilizes a solver-in-the-loop approach to generate optimal BESS actions, which are then used to train the neural optimizer-based agent. By co-optimizing both BESS operational modes and output power within the NN, the system achieves improved performance and robustness. After initial training, the forecasting and control models are jointly fine-tuned to account for forecasting errors, further improving decision precision and efficiency through DFL. Case studies are performed to validate the performance of the framework using multiple real-world datasets, demonstrating superior performance in monthly peak load forecasting compared to state-of-the-art models. In addition, the results are compared against existing decision-making approaches. The results demonstrate a reduction in monthly peak forecasting error by approximately 15% across various performance measures and achieve an optimization gap for BESS operation that is about three times smaller compared to existing methods.

Kim, Hyeonjin [Pacific Northwest National Laborato↗
NASA NTRS1992

On the rat model of human osteopenias and osteoporoses

The idea that rats cannot model human osteopenias errs. The same mechanisms control gains in bone mass (longitudinal bone growth and modeling drifts) and losses (BMU-based remodeling), in young and aged rats and humans. Furthermore, they respond similarly in rats and man to mechanical influences, hormones, drugs and other agents.

Frost, Harold M.↗
DOE OSTI2024

A novel digital lifecycle for Material‐Process‐Microstructure‐Performance relationships of thermoplastic olefins foams manufactured via supercritical fluid assisted foam injection molding

Abstract This research significantly enhances the applicability of thermoplastic olefins (TPOs) in the automotive industry using supercritical N 2 as a physical foaming agent, effectively addressing the limitations of traditional chemical agents. It merges experimental results with simulations to establish detailed material‐process‐microstructure‐performance (MP2) relationships, targeting 5–20% weight reductions. This innovative approach labeled digital lifecycle (DLC) helps accurately predict tensile, flexural, and impact properties based on the foam microstructure, along with experimentally demonstrating improved paintability. The study combines process simulations with finite element models to develop a comprehensive digital model for accurately predicting mechanical properties. Our findings demonstrate a strong correlation between simulated and experimental data, with about a 5% error across various weight reduction targets, marking significant improvements over existing analytical models. This research highlights the efficacy of physical foaming agents in TPO enhancement and emphasizes the importance of integrating experimental and simulation methods to capture the underlying foaming mechanism to establish material‐process‐microstructure‐performance (MP2) relationships. Highlights Establishes a material‐process‐microstructure‐performance (MP2) for TPO foams Sustainably produces TPO foams using supercritical (ScF) N 2 with 20% lightweighting Shows enhanced paintability for TPO foam improved surface aesthetics Digital lifecycle (DLC) that predicts both foam microstructure and properties DLC maps process effects & microstructure onto FEA mesh for precise prediction

Engineering↗
DOE OSTI2025

Towards philosophical reasoning with agentic LLMs: Socratic method for scientific assistance

As large language models (LLMs) become central tools in science, improving their reasoning capabilities is critical for meaningful and trustworthy applications. We introduce a Socratic agent for scientific reasoning, implemented through a structured system prompt that guides LLMs via classical principles of inquiry. Unlike typical prompt engineering or retrieval-based methods, our approach leverages definition, analogy, hypothesis elimination, and other Socratic techniques to generate more coherent, critical, and domain-aware responses. We evaluate the agent across diverse scientific domains and benchmark it on the abstraction and reasoning corpus challenge dataset, achieving 97.15% under a fixed prompting protocol and without fine-tuning or external tools. Expert evaluation shows improved reasoning depth, clarity, and adaptability over conventional LLM outputs, suggesting that structured prompting rooted in philosophical reasoning can improve the scientific utility of language models.

LLM reasoning↗
DOE OSTI2020

Mechanisms of Degradation of Toxic Nerve Agents: Quantum-chemical Insight into Interactions of Sarin and Soman with Molybdenum Dioxide

With the urgent need to provide an efficient and reliable protection for people from fatal chemical and biological weapons, our fundamental understanding of how toxins interact with filters is far from complete. The situation is further complicated by natural difficulties of performing experimental measurements with lethal toxins. Unlike experiments, computational modeling offers an attractive and safe yet reliable way of studying behavior of toxic agents on a variety of substrates at a great level of detail. Here, we report DFT-based quantum-chemical calculations of adsorption and decomposition of DMMP, sarin and soman on MoO 2 (011) surface. Our calculations show that MoO 2 strongly adsorbs toxic nerve agents and quickly decomposes them. Decomposition of DMMP on the MoO 2 (011) surface proceeds via the PO-CH 3 bond breaking and a formation of a surface methoxy group. The calculated activation barrier for this reaction is 131.5 kJ mol -1 . Unlike DMMP, decomposition of sarin and soman proceeds via the dealkylation reaction yielding propene and 3,3-dimethyl-1-butene, respectively. Decomposition of sarin requires a remarkably low energy (53.7 kJ mol- 1 ), whereas the similar reaction in soman requires 50 kJ mol -1 more energy. We also make specific predictions to guide Ambient-Pressure X-ray Photoelectron Spectroscopy (APXPS) experiments on sarin interaction with MoO 2 samples. We conclude that MoO 2 serves as an efficient substrate able of degrading toxins.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1993

IMAGE: A Design Integration Framework Applied to the High Speed Civil Transport

Effective design of the High Speed Civil Transport requires the systematic application of design resources throughout a product's life-cycle. Information obtained from the use of these resources is used for the decision-making processes of Concurrent Engineering. Integrated computing environments facilitate the acquisition, organization, and use of required information. State-of-the-art computing technologies provide the basis for the Intelligent Multi-disciplinary Aircraft Generation Environment (IMAGE) described in this paper. IMAGE builds upon existing agent technologies by adding a new component called a model. With the addition of a model, the agent can provide accountable resource utilization in the presence of increasing design fidelity. The development of a zeroth-order agent is used to illustrate agent fundamentals. Using a CATIA(TM)-based agent from previous work, a High Speed Civil Transport visualization system linking CATIA, FLOPS, and ASTROS will be shown. These examples illustrate the important role of the agent technologies used to implement IMAGE, and together they demonstrate that IMAGE can provide an integrated computing environment for the design of the High Speed Civil Transport.

Hale, Mark A.↗
NASA NTRS2003

Agent Based Software for the Autonomous Control of Formation Flying Spacecraft

Distributed satellite systems is an enabling technology for many future NASA/DoD earth and space science missions, such as MMS, MAXIM, Leonardo, and LISA [1, 2, 3]. While formation flying offers significant science benefits, to reduce the operating costs for these missions it will be essential that these multiple vehicles effectively act as a single spacecraft by performing coordinated observations. Autonomous guidance, navigation, and control as part of a coordinated fleet-autonomy is a key technology that will help accomplish this complex goal. This is no small task, as most current space missions require significant input from the ground for even relatively simple decisions such as thruster burns. Work for the NMP DS1 mission focused on the development of the New Millennium Remote Agent (NMRA) architecture for autonomous spacecraft control systems. NMRA integrates traditional real-time monitoring and control with components for constraint-based planning, robust multi-threaded execution, and model-based diagnosis and reconfiguration. The complexity of using an autonomous approach for space flight software was evident when most of its capabilities were stripped off prior to launch (although more capability was uplinked subsequently, and the resulting demonstration was very successful).

How, Jonathan P.↗
NASA NTRS2004

Towards Symbolic Model Checking for Multi-Agent Systems via OBDDs

We present an algorithm for model checking temporal-epistemic properties of multi-agent systems, expressed in the formalism of interpreted systems. We first introduce a technique for the translation of interpreted systems into boolean formulae, and then present a model-checking algorithm based on this translation. The algorithm is based on OBDD's, as they offer a compact and efficient representation for boolean formulae.

Raimondi, Franco↗
NASA NTRS2006

Security Verification Techniques Applied to PatchLink COTS Software

Verification of the security of software artifacts is a challenging task. An integrated approach that combines verification techniques can increase the confidence in the security of software artifacts. Such an approach has been developed by the Jet Propulsion Laboratory (JPL) and the University of California at Davis (UC Davis). Two security verification instruments were developed and then piloted on PatchLink's UNIX Agent, a Commercial-Off-The-Shelf (COTS) software product, to assess the value of the instruments and the approach. The two instruments are the Flexible Modeling Framework (FMF) -- a model-based verification instrument (JPL), and a Property-Based Tester (UC Davis). Security properties were formally specified for the COTS artifact and then verified using these instruments. The results were then reviewed to determine the effectiveness of the approach and the security of the COTS product.

patch↗
NASA NTRS2003

A Real-Time Rover Executive based On Model-Based Reactive Planning

This paper reports on the experimental verification of the ability of IDEA (Intelligent Distributed Execution Architecture) effectively operate at multiple levels of abstraction in an autonomous control system. The basic hypothesis of IDEA is that a large control system can be structured as a collection of interacting control agents, each organized around the same fundamental structure. Two IDEA agents, a system-level agent and a mission-level agent, are designed and implemented to autonomously control the K9 rover in real-time. The system is evaluated in the scenario where the rover must acquire images from a specified set of locations. The IDEA agents are responsible for enabling the rover to achieve its goals while monitoring the execution and safety of the rover and recovering from dangerous states when necessary. Experiments carried out both in simulation and on the physical rover, produced highly promising results.

Bias, M. Bernardine↗
DOE OSTI2023

Using SWMM for emergency response planning: A case study evaluating biological agent transport under various rainfall scenarios and urban surfaces

To assist in emergency preparedness for a biological agent terrorist attack or accidental pathogen release, potential contaminant levels and migration pathways of spores spread by urban stormwater were evaluated using a Storm Water Management Model (SWMM) of U.S. Coast Guard Base Elizabeth City, North Carolina. The high temporal-spatial resolution SWMM model was built using spore concentrations in stormwater runoff from asphalt, grass, and concrete collected from a point-scale field study. The subsequent modeled contamination scenarios included a notional plume release and point releases mimicking the field study under three rainfall conditions. The rainfall scenarios included a 6-hour natural rainfall event on Dec. 8, 2021 and two design storms (2-year and 100-year events). The observed spore concentrations from asphalt and concrete from the actual field experiment were applied to calibrate the washoff parameters in the SWMM model, using an exponential washoff function. The calibrated washoff coefficient (c 1 ) and exponent (c 2 ) were 0.01 and 1.00 for asphalt, 0.05 and 1.45 for grass, and 2.45 and 1.00 for concrete, respectively. The calibrated SWMM model simulated spore concentrations in runoff at times and magnitudes similar to the field study data. In the point release modeled scenario, the concrete surface generated 55.6% higher average spore concentrations than asphalt. Similarly, in the field experiment, a 175% (p < 0.05) higher average spore concentration in surface runoff was observed from concrete than from asphalt. Here, this study demonstrates how SWMM may be used to evaluate spore washoff from urban surfaces under different precipitation amounts, intensities, and durations, and how visualized spatial migration pathways in stormwater runoff may be used for emergency planning and remediation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Reaction–Diffusion Coupling Facilitates the Sequential Precipitation of Metal Ions from Battery Feedstock Solutions

Here, the development of new technologies for chemical separations is urgently needed to meet the surging demand for critical materials that has strained resources and caused environmental challenges. Inspired by the classic Liesegang experiment, we demonstrated the separation of critical metal ions based on the coupling of ion diffusion and precipitation kinetics. For this purpose, a model feedstock solution simulating dissolved battery electrodes was placed on top of a hydrogel loaded with a precipitating agent, namely sodium hydroxide. As the lithium, manganese, cobalt, and nickel ions diffused into the gel, a gradient of precipitates formed along the length of the reactor. Elemental analysis of the spatially distributed precipitates showed the enrichment of nickel near the gel-solution interface, followed by the formation of an almost pure (>96%) manganese product further along the reactor. Optimization experiments revealed that a sodium hydroxide concentration of 10 mM and a gel/solution volume ratio of 2:1 favored efficient separations. The robustness of the method was demonstrated in four out of five feedstock compositions of typically used battery cathodes. Our proof-of-concept experiments present a paradigm for critical materials separations that does not require specialty chemicals, binding agents, membranes, or toxic solvents.

25 ENERGY STORAGE↗
DOE OSTI2021

A Modular and Transferable Reinforcement Learning Framework for the Fleet Rebalancing Problem

Mobility on demand (MoD) systems show great promise in realizing flexible and efficient urban transportation. However, significant technical challenges arise from operational decision making associated with MoD vehicle dispatch and fleet rebalancing. For this reason, operators tend to employ simplified algorithms that have been demonstrated to work well in a particular setting. To help bridge the gap between novel and existing methods, we propose a modular framework for fleet rebalancing based on model-free reinforcement learning (RL) that can leverage an existing dispatch method to minimize system cost. In particular, by treating dispatch as part of the environment dynamics, a centralized agent can learn to intermittently direct the dispatcher to reposition free vehicles and mitigate against fleet imbalance. We formulate RL state and action spaces as distributions over a grid partitioning of the operating area, making the framework scalable and avoiding the complexities associated with multiagent RL. Numerical experiments, using real-world trip and network data, demonstrate that RL reduces waiting time by 28% to 38% for the same-day evaluation, 17% to 44% for cross-day evaluation, and 22% to 25% for cross-season evaluation compared with no rebalancing scenarios. This approach has several distinct advantages over baseline methods including: improved system cost; high degree of adaptability to the selected dispatch method; and the ability to perform scale-invariant transfer learning between problem instances with similar vehicle and request distributions.

33 ADVANCED PROPULSION SYSTEMS↗
NASA NTRS2004

Model-based Executive Control through Reactive Planning for Autonomous Rovers

This paper reports on the design and implementation of a real-time executive for a mobile rover that uses a model-based, declarative approach. The control system is based on the Intelligent Distributed Execution Architecture (IDEA), an approach to planning and execution that provides a unified representational and computational framework for an autonomous agent. The basic hypothesis of IDEA is that a large control system can be structured as a collection of interacting agents, each with the same fundamental structure. We show that planning and real-time response are compatible if the executive minimizes the size of the planning problem. We detail the implementation of this approach on an exploration rover (Gromit an RWI ATRV Junior at NASA Ames) presenting different IDEA controllers of the same domain and comparing them with more classical approaches. We demonstrate that the approach is scalable to complex coordination of functional modules needed for autonomous navigation and exploration.

Finzi, Alberto↗