Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Distributed Optimal Power Management for Battery Energy Storage Systems: A Novel Accelerated Tracking ADMM Approach

Optimal power management (OPM) is critical for large-scale battery energy storage systems. Today’s methods often require formidable computational effort due to the design based on centralized numerical optimization. Thus, this paper investigates computationally distributed OPM where the agents based on the cells communicate over a network to cooperatively solve the OPM problem. We propose an accelerated tracking alternating direction method of multipliers (ADMM) algorithm to solve the distributed OPM. The proposed algorithm embeds dynamic average consensus and Nesterov’s acceleration technique in the ADMM algorithm. Not only is the proposed algorithm fully distributed without a need for fusion or aggregating nodes, but it also accelerates convergence. The paper formulates the OPM in a model predictive control framework where it seeks to regulate the charging/discharging power of each battery cell to minimize the total power losses and promote balanced use of the constituent cells while complying with the safety constraints. The paper provides ample simulation results to demonstrate the effectiveness and advantages of the proposed distributed OPM in terms of computation and convergence.

Farakhor, Amir↗
DOE OSTI2022

Adsorption and exchange reactions of iodine molecules at the alumina surface: modelling alumina-iodine reaction mechanisms

Harnessing aluminum oxidation energy requires navigating the particle's passivation shell composed of alumina. The shell is a barrier to aluminum oxidation but can also exothermically react with halogenated species and therefore contribute to the overall energy generated during aluminum particle combustion. Fluorination reactions with alumina have been studied because fluorine is abundant in binder formulations that commonly surround aluminum particles in an energetic mixture. However, iodine has emerged as an alternative halogenated-based binder or oxidizer because iodine gas provides ancillary benefits such as chemical neutralization of biological agents or sterilization of contaminated environments. Furthermore, this study used density functional theory (DFT) calculations to evaluate potential reaction pathways for aluminum–iodine combustion. Relative to fluorinated fragments such as HF and F – , the adsorption energies associated with HI and I– are nearly triple the exchange reaction energy available from fluorination reactions with alumina (–189 and –278 kJ mol –1 for HI and I – , respectively). However, exchange reactions between iodinated species and the alumina surface are energetically unfavorable. These results explain that through adsorption, alumina surface exothermic reactions with iodine are more energetic than with fluorine fragments. Experiments performed with differential scanning calorimetry (DSC) confirm the higher magnitude of energy generated for iodination compared with fluorination reactions with alumina. Additionally, strong adsorption energies can promote synthesis of new shell chemistries. Adsorption in solution will promote alumina dissolution and iodine precipitation reactions to produce hydroxyl complexes and iodinated species synthesized on the surface of the particle, thereby replacing alumina with alternative passivation shell chemistry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Pedestrian-Involved Traffic Signal Optimization Using Decentralized Graph-based Multi-Agent Reinforcement Learning

Incorporating pedestrian movements in traffic signal timing optimization is essential for ensuring smooth and safe urban transportation systems. To develop an effective signal timing plan, it is crucial to comprehend how various pedestrian accommodation strategies impact both vehicle and pedestrian flow. This study explores the application of the Decentralized Graph-based Multi-Agent Reinforcement Learning (DGMARL) method for signal timing optimization. It considers both pedestrian and vehicle traffic state and assesses the effects of fixed and adaptive pedestrian request response on traffic and signal timing. The evaluation of DGMARL encompasses vehicles Eco_PI which is fuel consumption impact related to vehicle stops and stop delay, and pedestrian waiting time to ensure overall system efficiency. The proposed approach was evaluated using a Digital Twin microscopic traffic simulation model of MLK Smart Corridor in Chattanooga, Tennessee. The evaluation outcomes of vehicles Eco_PI, pedestrian waiting time and serving time are compared with the actuated and DGMARL signal timing with fixed pedestrian recall and minimum recall to determine the most suitable approaches for various traffic conditions. The results indicated that, on average, the strategy of Signal timing optimization with adaptive pedestrian request response improved the Eco_PI by 32.43%, and Signal timing optimization with both automated pedestrian traffic demand and adaptive pedestrian request response improved the Eco_PI by 31.62% compared to the actuated and DGMARL signal timing with fixed pedestrian recall and minimum recall.

K Kumarasamy, Vijayalakshmi↗
DOE OSTI2025

Nanolipoprotein particle (NLP) vaccine confers protection against Yersinia pestis aerosol challenge in a BALB/c mouse model

Introduction: Yersinia pestis is the etiological agent of plague, a disease that remains a concern as demonstrated by recent outbreaks in Madagascar. Infection with Y. pestis results in a rapidly progressing illness that can only be successfully treated with antibiotics given shortly after symptom onset. Live attenuated or whole cell inactivated vaccines confer protection against bubonic plague, but pneumonic plague has been more difficult to prevent. Novel effective subunit vaccine formulations may circumvent some of these shortfalls. Here, we compare the immunogenicity generated by an advanced subunit vaccine (F1V fusion protein) and a nanolipoprotein particle (NLP)-based vaccine. Methods: The NLP, a high-density lipoprotein mimetic, provides a nanoscale delivery platform for recombinant Y. pestis antigens LcrV (V) and F1. BALB/c mice were immunized via subcutaneous injection twice, three or four weeks apart. Four weeks later, splenocytes and sera were collected for immune profiling, and mice were challenged with aerosolized Y. pestis CO92. Results: Both formulations induced a strong IgG response against the F1 and V proteins, along with a robust memory B cell response and a balanced cell-mediated immune response as evidenced by both Th1- and Th2-related cytokines. The NLP-based vaccine induced a stronger cytokine response against F1, V, and F1V proteins relative to the F1V vaccine. As with F1V, the inclusion of Alhydrogel (Alu) in NLP vaccine formulations was critical for enhanced immunogenicity and protective efficacy. Mice that received two doses of F1:V:NLP + Alu and CpG were completely protected from a challenge with approximately eight median lethal doses of aerosolized Y. pestis CO92 and this protection confirmed the well-documented synergy between the F1 and V antigens in context of pneumonic plague. The NLPs have defined regions of polarity that facilitates the incorporation of a wide range of adjuvants and antigens with distinct physicochemical properties and are an excellent candidate platform for the development of multi-antigen vaccines.

F1↗
DOE OSTI2020

Mechanism of Catalysis by L -Asparaginase

Two bacterial type II L -asparaginases, from Escherichia coli and Dickeya chrysanthemi, have played a critical role for more than 40 years as therapeutic agents against juvenile leukemias and lymphomas. Despite a long history of successful pharmacological applications and the apparent simplicity of the catalytic reaction, controversies still exist regarding major steps of the mechanism. In this report, we provide a detailed description of the reaction catalyzed by E. coli type II L -asparaginase (EcAII). Our model was developed on the basis of new structural and biochemical experiments combined with previously published data. The proposed mechanism is supported by quantum chemistry calculations based on density functional theory. In this work, we provide strong evidence that EcAII catalyzes the reaction according to the double-displacement (ping-pong) mechanism, with formation of a covalent intermediate. Several steps of catalysis by EcAII are unique when compared to reactions catalyzed by other known hydrolytic enzymes. Here, the reaction is initiated by a weak nucleophile, threonine, without direct assistance of a general base, although a distant general base is identified. Furthermore, tetrahedral intermediates formed during the catalytic process are stabilized by a never previously described motif. Although the scheme of the catalytic mechanism was developed only on the basis of data obtained from EcAII and its variants, this novel mechanism of enzymatic hydrolysis could potentially apply to most (and possibly all) L -asparaginases.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Evaluating disease surveillance strategies for early outbreak detection in contact networks with varying community structure

Disease surveillance systems allow public health agencies to respond to emerging diseases before they become widespread. Developing such systems requires identifying optimal ways to monitor in the context of an epidemic outbreak; this problem is known as sensor selection. Contact networks represent the dynamics of interaction in a population and are used to model how a disease spreads in a population and to explore strategies of sensor selection. We evaluated five sensor selection strategies on their ability to provide an early warning of a COVID-like outbreak in synthetic contact networks encapsulated in four network scenarios. Three of these scenarios assessed different aspects of community structure. The fourth scenario employed a contact network representing the population and interactions of 6.8 million people in New York City, constructed from an agent-based simulation using census and transportation data. This scenario exemplifies how sensor selection strategies may perform in a real-world, urban context. Our findings suggest that the choice of the optimal strategy depends heavily on the community structure of the network. Strategies that select highly connected nodes or maximize network coverage are the optimal surveillance strategy for outbreak detection in many network community structures. However, a naive implementation of these strategies may fail to provide an early warning at all—including in the New York City scenario. Moreover, these methods are impractical for real-world use as they require knowledge of the underlying contact network. Instead, a selection strategy that starts with a set of random nodes and then performs a random walk through a chain of neighbors reliably provides early warnings without requiring prior knowledge of the network. We find this method, called “random chain”, to be the most pragmatic for implementation in a real-world disease surveillance context.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

Surrogates for Valve-Controlled Pipe Flow: Accelerating Nuclear Reactor Design

Neural surrogate models are developed to replace expensive steady-state RANS CFD simulations for valve-controlled pipe flow in nuclear reactor design. Using parametric CFD data generated with MOOSE Pronghorn across a range of valve geometry and flow conditions, three approaches are compared: a POD-based reduced-order model, a structured UNet on a cylindrical grid, and unstructured models (DeepONet and BiStride MeshGraphNet) on nondimensionalized point clouds. POD achieves the highest accuracy (99%) with fast inference but requires storing all solution snapshots, while the DeepONet and BSMS-GNN both achieve ~89% accuracy at sub-second inference, with the BSMS-GNN offering superior geometric generalizability. These surrogates enable rapid ranking of candidate valve designs and can warm-start CFD solvers to accelerate convergence, supporting agentic design iteration on the Prometheus platform.

42 - ENGINEERING↗
DOE OSTI2020

Estimation of Large-Scale Wind Field Characteristics Using Supervisory Control and Data: Preprint

As the wind energy industry continues to pushfor increased power production and lower cost of energy, thefocus of research has expanded from individual turbines toentire wind farms. Among a host of interesting problems to besolved when considering the wind farm as a whole, we considerthe challenge of scalar field estimation, based on informationalready collected at the individual turbine level. We aim toestimate the large-scale, low-frequency characteristics of thewind field, such as the mean wind direction and the overalldecrease in wind speed across the farm, and employ a Kalmanfilter that models the wind field using a polynomial function.We compare the proposed method’s performance to both asimple averaging technique and filtering of individual turbinemeasurements. The method presented is not limited to windturbines and is applicable in other situations where multipleremote agents are used to estimate a scalar field.

large scale↗
DOE OSTI2020

Localization of fluorescent targets in deep tissue with expanded beam illumination for studies of cancer and the brain

Imaging fluorescence through millimeters or centimeters of tissue has important in vivo applications, such as guiding surgery and studying the brain. Often, the important information is the location of one of more optical reporters, rather than the specifics of the local geometry, motivating the need for a localization method that provides this information. We present an optimization approach based on a diffusion model for the fast localization of fluorescent inhomogeneities in deep tissue with expanded beam illumination that simplifies the experiment and the reconstruction. We show that the position of a fluorescent inhomogeneity can be estimated while assuming homogeneous tissue parameters and without having to model the excitation profile, reducing the computational burden and improving the utility of the method. We perform two experiments as a demonstration. First, a tumor in a mouse is localized using a near infrared folate-targeted fluorescent agent (OTL38). This result shows that localization can quickly provide tumor depth information, which could reduce damage to healthy tissue during fluorescence-guided surgery. Second, another near infrared fluorescent agent (ATTO647N) is injected into the brain of a rat, and localized through the intact skull and surface tissue. This result will enable studies of protein aggregation and neuron signaling.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

In Situ EXAFS-Based Nanothermometry of Heterodimer Nanocrystals under Induction Heating

The ability to heat nanocrystalline materials through magnetic induction has been used in the fields of catalysis, biomedical sciences, and polymer degradation. However, the working temperature to which the inductively coupled material rises is still poorly understood. Herein, we use extended X-ray absorption fine structure spectroscopy in conjunction with thermal imaging to improve the understanding of heating in inductively coupled systems. After extraction of the Debye–Waller factor from the spectroscopy, we obtain the temperature of inductively heated nanocrystals from the correlated Debye model. We combine carbon-supported iron oxide nanocrystals as induction heating agents with platinum nanocrystals as thermal probes. By testing these nanocrystal species as both unattached nanocrystals and heterodimers, we report that nanostructured systems show a significant temperature difference of up to 73.60 °C when compared to their local support environment. Furthermore, this result has implications for inductively heated catalysis, magnetic hyperthermia for targeted cell death, and polymer synthesis.

09 BIOMASS FUELS↗
DOE OSTI2024

Co-orchestration of multiple instruments to uncover structure–property relationships in combinatorial libraries

The rapid growth of automated and autonomous instrumentation brings forth opportunities for the co-orchestration of multimodal tools that are equipped with multiple sequential detection methods or several characterization techniques to explore identical samples. This is exemplified by combinatorial libraries that can be explored in multiple locations via multiple tools simultaneously or downstream characterization in automated synthesis systems. In co-orchestration approaches, information gained in one modality should accelerate the discovery of other modalities. Correspondingly, an orchestrating agent should select the measurement modality based on the anticipated knowledge gain and measurement cost. Herein, we propose and implement a co-orchestration approach for conducting measurements with complex observables, such as spectra or images. The method relies on combining dimensionality reduction by variational autoencoders with representation learning for control over the latent space structure and integration into an iterative workflow via multi-task Gaussian Processes (GPs). This approach further allows for the native incorporation of the system's physics via a probabilistic model as a mean function of the GPs. We illustrate this method for different modes of piezoresponse force microscopy and micro-Raman spectroscopy on a combinatorial Sm-BiFeO3 library. However, the proposed framework is general and can be extended to multiple measurement modalities and arbitrary dimensionality of the measured signals.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Indium and thallium extraction into betainium bis(trifluoromethylsulfonyl)imide ionic liquid from aqueous hydrochloric acid media

The partitioning behavior of indium and thallium ions between aqueous hydrochloric acid solutions and hydrophobic betainium bis(trifluoromethylsulfonyl)imide ionic liquid was studied using a standard liquid–liquid extraction technique. The experiments were mainly carried out by means of a radiochemical method, using 111 In and 201 Tl medical radionuclides at an ultra-trace concentration. Both mono- and trivalent thallium were utilized and the highest oxidation state (3+) was produced by adding either chlorine or bromine water to the aqueous phase prior to extraction. The metal ion transfer was optimized by varying the aqueous concentration of hydrochloric acid and by introducing zwitterionic betaine as an extracting agent into the aqueous phase. It was found that the highest D values of In(III), Tl(III) and Tl(I) in the investigated chemical systems were up to 200, 70, and 1, respectively. The influence of the addition of lithium salt, having common with the ionic liquid counterion, and the variation of mixing time on the distribution ratio of the metal ions were also studied. Finally, to understand the underlying extraction mechanism of the metal ions and to propose the predominant extracted species, mathematical models based on ion pair formation and ion exchange were developed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Distributed optimization for multi-commodity urban traffic control

A distributed method for concurrent traffic signal and routing control of traffic networks is proposed. The method is based on the multi-commodity store-and-forward model, in which the destinations are the commodities. The system benefits from the communication between vehicles and infrastructure, providing optimal signal timings to intersections and routes to vehicles on a link-by-link basis. Using the augmented Lagrangian to model the constraints into the objective, the baseline centralized problem is decomposed into a set of objective-coupled subproblems, one for each intersection, enabling the solution to be computed by a distributed- gradient projection algorithm. Further, the intersection agents only need to communicate and coordinate with neighboring intersections to ensure convergence to the optimal solution while tolerating suboptimal iterations that offer more flexibility, unlike other distributed approaches. Through microsimulation, we demonstrate the effectiveness of the proposed algorithm in traffic networks with time-varying demand. Computational analysis shows that the distributed problem is suitable for real-time applications. A robustness analysis show that the distributed formulation enables a graceful degradation of the system in case of failure.

Augmented Lagrangian↗
DOE OSTI2021

Distributional Deep Reinforcement Learning-Based Emergency Frequency Control

Emergency frequency control is one of the most critical approaches to maintain power system stability after major disturbances. With the increasing number of grid-connected renewable energy sources, existing model-based methods of frequency control are facing up with challenges of computational speed and scalability for large-scale systems. In this paper, the emergency frequency control problem is formulated as a Markov Decision Process (MDP) and solved through a novel Distributional Deep Reinforcement Learning (DDRL) method, namely the distributional soft actor critic (DSAC) method. Compared with other RL methods that only estimate the mean value, the proposed DSAC model estimates the distribution of value function over returns. This advancement can lead to more insights and knowledge for the agent, with the benefit of a much faster and more stable learning process, and the improved frequency control performance. Here, the simulation results on IEEE 39-bus and IEEE 118-bus systems demonstrate the effectiveness and robustness of proposed models, as well as the advantage compared to other state-of-the-art DRL algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

An Edge-Cloud Integrated Solution for Buildings Demand Response Using Reinforcement Learning

Buildings, as major energy consumers, can provide great untapped demand response (DR) resources for grid services. However, their participation remains low in real-life. One major impediment for popularizing DR in buildings is the lack of cost-effective automation systems that can be widely adopted. Existing optimization-based smart building control algorithms suffer from high costs on both building-specific modeling and on-demand computing resources. To tackle these issues, this paper proposes a cost-effective edge-cloud integrated solution using reinforcement learning (RL). Beside RL’s ability to solve sequential optimal decision-making problems, its adaptability to easy-to-obtain building models and the off-line learning feature are likely to reduce the controller’s implementation cost. Using a surrogate building model learned automatically from building operation data, an RL agent learns an optimal control policy on cloud infrastructure, and the policy is then distributed to edge devices for execution. Simulation results demonstrate the control efficacy and the learning efficiency in buildings of different sizes. A preliminary cost analysis on a 4-zone commercial building shows the annual cost for optimal policy training is only 2.25% of the DR incentive received. Results of this study show a possible approach with higher return on investment for buildings to participate in DR programs.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

The role of information structures in game-theoretic multi-agent learning

Multi-agent learning (MAL) studies how agents learn to behave optimally and adaptively from their experience when interacting with other agents in dynamic environments. The outcome of a MAL process is jointly determined by all agents’ decision-making. Hence, each agent needs to think strategically about others’ sequential moves, when planning future actions. The strategic interactions among agents makes MAL go beyond the direct extension of single-agent learning to multiple agents. With the strategic thinking, each agent aims to build a subjective model of others decision-making using its observations. Such modeling is directly influenced by agents’ perception during the learning process, which is called the information structure of the agent’s learning. As it determines the input to MAL processes, information structures play a significant role in the learning mechanisms of the agents. This review creates a taxonomy of MAL and establishes a unified and systematic way to understand MAL from the perspective of information structures. Here we define three fundamental components of MAL: the information structure (i.e., what the agent can observe), the belief generation (i.e., how the agent forms a belief about others based on the observations), as well as the policy generation (i.e., how the agent generates its policy based on its belief). In addition, this taxonomy enables the classification of a wide range of state-of-the-art algorithms into four categories based on the belief-generation mechanisms of the opponents, including stationary, conjectured, calibrated, and sophisticated opponents. We introduce Value of Information (VoI) as a metric to quantify the impact of different information structures on MAL. Finally, we discuss the strengths and limitations of algorithms from different categories and point to promising avenues of future research.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Reduced Order Model of Transactive Bidding Loads

Transactive energy (TE) has been identified to provide better grid efficiency and reliability by market-based transactive exchanges between energy producers and energy consumers. Simulations of TE systems are crucial to evaluate the benefits and impacts of different transactive mechanisms. However, such simulations can be time consuming due to the information exchange between various participants and complex co-simulation environments. In this paper, we develop a reduced order model to speed up the simulation of transactive systems in TE simulation platform (TESP) while achieving very low error between the reduced order and full model results. Specifically, the developed reduced order model consists of an aggregate responsive load agent which utilizes two Recurrent Neural Networks (RNNs) with Long Short-Term Memory units (LSTMs) to enable transactive elements to collectively participate in the TE system. The proposed aggregate responsive load (ARL) agent is able to produce similar transactive behaviors to the full simulation model while achieving significant simulation time reduction. Finally, we also show that the developed model enables generalization of simulation results across different dates and across different number of loads included in the simulations.

24 POWER TRANSMISSION AND DISTRIBUTION↗