Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration: Preprint

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions, i.e., the reserve requirement, renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained off-line using historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine and battery. Case studies demonstrated that the proposed method outperforms other operating reserve determination methods.

distribution system↗
DOE OSTI2022

Vanadium metal-organic framework for selective adsorption

A permanently porous vanadium(II)-containing metal-organic framework (MOF) with vanadium(II) centers and methods for synthesis of such MOF frameworks are provided. Methods for using such compounds to selectively react with N2 over CH4 are provided. In the synthetic methods, a vanadium source, such as VY2(tmeda)2, where Y is a halogen and tmeda is N,N,N′,N′-tetramethylethane-1,2-diamine and a H2(ligand) are reacted in the presence of acid in a solvent at between 110° C. and 130° C. to form an intermediate product. The intermediate product is collected and washed with a washing agent, such as DMF and acetonitrile, and the vanadium(II) based MOF is activated by heating the washed intermediate product to at least 160° C. under dynamic vacuum.

Long, Jeffrey R.↗
DOE OSTI2022

Tangent gradient concentration material for battery, digital gradient concentration material for battery

The invention provides a cathode active material having a discrete change in concentrations of a first base region and a second pulse region. Also provided is a method for preparing a cathode active material, the method having the steps: supplying chelating agent, aqueous basic solution and a first aqueous metal salt solution to a reactor to create a base region; supplying a second aqueous metal-salt solution to a reactor to form a pulse region, wherein the second aqueous metal-salt solution is intermittently or continuously added during or after the creation of the base region; thermally treating the base region and the pulse region to create active metal precursors; mixing the precursors with lithium salt to produce a mixture; and thermally treating the mixture.

Shin, YoungHo↗
DOE OSTI2023

Effect of Dual Environment Aging on Flexible Polyurethane Based Adhesive

Abstract Environmental degradation of adhesives naturally increases with the intensity of the ambient weathering agents involved. During service life, these materials are never subjected to a constant environmental loading. Real-time applications expose the material to multiple weather conditions, ranging from dry to humid or fully wet conditions. While some understanding exists about aging environments in isolation, we intend to investigate the effect of multiple environments on the constitutive behavior of the materials in question. The extent of damage can be accessed by analyzing the changes in constitutive behavior and toughness of aged material. Therefore, this aging experiment was designed around two-way aging regimes involving combinations of thermo-oxidation, hydrolytic and hygrothermal aging environments. We selected a polyurethane based flexible adhesive which is commonly used in the automotive industry as a glass sealant. The aged specimens were subjected to uniaxial tensile tests, and variation in material toughness and constitutive behavior was analyzed to ascertain the mechanics involved in the case of each environmental exposure. We outlined how different environments affect the material in isolation and how they interact with other weathering conditions. This study will help better understand and model the damage mechanics involved in exposure to multiple environmental conditions.

Shaafaey, Mamoon↗
DOE OSTI2024

Deep Multi-Agent Reinforcement Learning for Real-World Signalized Traffic Corridor Control

Signalized traffic control problem has been addressed recently with deep Reinforcement Learning (RL) approaches involving diverse state, action, and reward structures. While significant progress has been noted in the literature, open challenges still remain in the areas of adaptive signal phase timing, coordination in a multi-intersection corridor setting, and consideration of real-world traffic conditions. In the context of deep RL-based problem framing, extensions are needed that enable adaptive signal phase timings in an intersection agent's action space, computationally efficient information sharing among neighboring signalized intersection agents along a corridor, and experimentation in realistic simulation environments. In this paper, we develop a deep Advantage Actor Critic (A2C) multi-agent RL (MARL) approach capturing the research extensions above and apply it within a real-world calibrated Aimsun Next traffic corridor simulation model based on traffic data from the City of Coral Gables, Florida. For a multi-intersection corridor control setting, our numerical simulation experiments with a decentralized A2C MARL algorithm applied at different time periods led to a total average corridor travel delay reduction (expressed in seconds/mile averaged over vehicles) from 4.9% to 19.9% compared to state-of-the-art actuated control.

Shuvo, Salman S. [BATTELLE (PACIFIC NW LAB)]↗
DOE OSTI2022

Development of a Lateral Flow Strip-Based Recombinase-Aided Amplification for Active Chlamydia psittaci Infection

Chlamydia psittaci is the causative agent of psittacosis, a worldwide zoonotic disease. A rapid, specific, and sensitive diagnostic assay would be benefit for C. psittaci infection control. In this study, an assay combining recombinase-aided amplification and a lateral flow strip (RAA-LF) for the detection of active C. psittaci infection was developed. The RAA-LF assay targeted the CPSIT_RS02830 gene of C. psittaci and could be accomplished in 15 min at a single temperature (39°C). The analytical sensitivity of the assay was as low as 1 × 10 0 copies/μl and no cross-reaction with some other intracellular pathogens was observed. Moreover, all feces samples from mice infected with C. psittaci at day-1 post-infection were positive in the RAA-LF assay. In conclusion, the RAA-LF assay provides a convenient, rapid, specific and sensitive method for detection of active C. psittaci infection and it is also suitable for C. psittaci detection in field.

Jiao, Jun↗
DOE OSTI2020

Mechanisms of Degradation of Toxic Nerve Agents: Quantum-chemical Insight into Interactions of Sarin and Soman with Molybdenum Dioxide

With the urgent need to provide an efficient and reliable protection for people from fatal chemical and biological weapons, our fundamental understanding of how toxins interact with filters is far from complete. The situation is further complicated by natural difficulties of performing experimental measurements with lethal toxins. Unlike experiments, computational modeling offers an attractive and safe yet reliable way of studying behavior of toxic agents on a variety of substrates at a great level of detail. Here, we report DFT-based quantum-chemical calculations of adsorption and decomposition of DMMP, sarin and soman on MoO 2 (011) surface. Our calculations show that MoO 2 strongly adsorbs toxic nerve agents and quickly decomposes them. Decomposition of DMMP on the MoO 2 (011) surface proceeds via the PO-CH 3 bond breaking and a formation of a surface methoxy group. The calculated activation barrier for this reaction is 131.5 kJ mol -1 . Unlike DMMP, decomposition of sarin and soman proceeds via the dealkylation reaction yielding propene and 3,3-dimethyl-1-butene, respectively. Decomposition of sarin requires a remarkably low energy (53.7 kJ mol- 1 ), whereas the similar reaction in soman requires 50 kJ mol -1 more energy. We also make specific predictions to guide Ambient-Pressure X-ray Photoelectron Spectroscopy (APXPS) experiments on sarin interaction with MoO 2 samples. We conclude that MoO 2 serves as an efficient substrate able of degrading toxins.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Synthesis of PHI-type zeolite harmotome using barium as an inorganic structure-directing agent inspired from natural mineral compositions

Zeolites are nanoporous aluminosilicates widely used as commercial adsorbents, heterogeneous catalysts, and ion-exchange materials due to their unique porosity, acidity, and thermal stability. The vast majority of synthetically-realized zeolite structures are prepared under hydrothermal conditions in alkaline media, and often in the presence of an organic structure-directing agent that facilitates the crystallization of diverse porous networks. Due to economic and environmental disadvantages of organic-based syntheses, it is often desirable to produce zeolites in organic-free media using alkali metal ions as the most commonly employed inorganic structure-directing agents (ISDAs). Here, in this study, we were inspired by the elemental compositions of natural zeolite minerals to examine the use of an alkaline earth metal ion as the ISDA to prepare zeolites with the PHI framework type. Two natural minerals exhibiting this crystal structure are phillipsite and harmotome. Both structures contain sodium and potassium as extra-framework cations, but only harmotome contains barium cations. Here we examined how the combination of alkali and alkaline earth ISDAs promote the formation of PHI-type zeolites. Our findings reveal that each isostructure is prepared under different synthesis conditions where simply adding barium to a growth mixture does not always lead to harmotome formation. Harmotome is formed in more dilute and alkaline growth media; however, time-resolved analyses of zeolite crystallization reveal that harmotome can be synthesized at low temperatures (ca. 65 °C) with rates that are 5-times faster than syntheses of phillipsite. This seemingly indicates that barium reduces the energetic barrier for PHI-type zeolite nucleation in ways that are not fully understood. Moreover, harmotome crystals exhibit an average particle size of ca. 60 nm, which is nearly 40-fold smaller than phillipsite crystals prepared under similar conditions. Collectively, these findings identify routes to control crystallization of PHI-type zeolites and may provide a broader strategy for using the composition of natural zeolite minerals to optimize the preparation of synthetic analogues.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Enhanced detection of volatile organic compounds (VOCs) by caffeine modified carbon nanotube junctions

Detection of vapor phase analytes and gas molecules is primarily essential for numerous applications including medical diagnostic, environmental monitoring, chemical threat detection, food quality control, and chemical warfare agents. Here, we developed Caffeine functionalized carbon nanotubes (CNTs) random network based vapor quantum resistive sensors (vQRSs) for volatile organic compounds (VOCs) detection. The localized transmission electron microscopy (TEM) image and energy dispersive X-ray spectroscopy (EDS) confirm migration of caffeine to CNT–CNT junction (CNTj). We have recorded more than one order of magnitude higher sensitivity and unique selectivity towards selective VOCs (e.g., acetone, toluene, ethanol, methanol, etc.) with short response time (few seconds) for caffeine modified CNT junction (Caf-CNTj) vQRSs. Molecular dynamics (MD) calculations suggest that the sensitivity of the sensor is diffusion limited, with an advective contribution for ethanol. Furthermore, the designed Caf-CNTj sensors can potentially be important candidate to be a part of electronic nose used for various application such as breath analysis and food quality monitoring.

36 MATERIALS SCIENCE↗
DOE OSTI2024

HSQC spectra of lignin isolated from poplar roots

Here we present a curated dataset of two-dimensional heteronuclear single quantum coherence (HSQC) nuclear magnetic resonance (NMR) spectra of lignin isolated from roots of a greenhouse grown natural population of an energy crop poplar (Populus trichocarpa). Dormant cuttings of field-grown poplar were grown in 6-liter pots in a peat-based media containing bark, perlite, vermiculite, dolomite lime and a wetting agent in an environmentally controlled greenhouse. Temperatures were between 21 and 23 °C, with supplemental lighting to support a 16-h day length using 1000-watt high-pressure sodium lights in greenhouse. Once established, all plants were cut-back, allowed to regrow and harvested at the same time following an eight-month long growth period. Plants were harvested and the belowground roots were washed off soils, blotted, dried in an oven at 70 °C for 3 days, and Wiley milled (mesh size 20). The roots were Soxhlet-extracted with toluene/ethanol for 24 h to remove extractives. The extracted roots were ball-milled in a Retsch PM100 planetary ball mill using a porcelain jar with ceramic balls at 600 rpm for 2 h (in 5 min on and 5 min off cycles to avoid excessive sample heating). The ball-milled materials were then subjected to enzymatic hydrolysis for 48 h followed by centrifugation and washing with deionized water. The solid residue was extracted twice with 96% (v/v) 1,4-dioxane/water mixture at room temperature overnight. The extracts were combined, rotary evaporated, and freeze-dried to recover lignin. The dry lignin samples were dissolved in deuterated dimethyl sulfoxide (d6) and transferred into a 5 mm tube. 13C–1H HSQC experiments were performed in a Bruker Avance III HD 500 MHz NMR spectrometer operating at a frequency of 125.12 MHz for the 13C nucleus using a standard Bruker pulse sequence on a Prodigy platform cryoprobe. The NMR spectra were acquired under the following acquisition conditions: 220 ppm spectral width in F1 (13C) dimension with 256 data points and 12 ppm spectral width in F2 (1H) dimension with 1024 data points, a 90° pulse, a one bond C–H coupling constant of 145 Hz, a 1.0 s pulse delay, and 64 scans. Spectra were processed using the Bruker TopSpin software. Additional meta data is embedded in the raw spectra figures.

HSQC, lignin, poplar, roots, CBI↗
DOE OSTI2022

Silver Nanoparticles Functionalized Nanosilica Grown over Graphene Oxide for Enhancing Antibacterial Effect

The continuous growth of multidrug-resistant bacteria due to the overuse of antibiotics and antibacterial agents poses a threat to human health. Silver nanoparticles, silica-based materials, and graphene-based materials have become potential antibacterial candidates. In this study, we developed an effective method of enhancing the antibacterial property of graphene oxide (GO) by growing nanosilica (NS) of approximately 50 nm on the graphene oxide (GO) surface. The structures and compositions of the materials were characterized through powdered X-ray diffraction (P-XRD), transmission electron microscopy (TEM), scanning electron microscopy coupled with energy dispersive X-ray spectroscopy (SEM-EDS), ultraviolet–visible spectroscopy (UV–VIS), dynamic light scattering (DLS), Raman spectroscopy (RM), Fourier-transform infrared spectroscopy (FTIR), Brunauer–Emmet–Teller (BET) surface area, and pore size determination. The silver nanoparticles (AgNPs) with an average diameter of 26 nm were functionalized on the nanosilica (NS) surface. The composite contained approximately 3% of silver nanoparticles. The silver nanoparticles on nanosilica supported over graphene oxide (GO/NS/AgNPs) exhibited a 7-log reduction of Escherichia coli and a 5.2-log reduction of Bacillus subtilis within one hour of exposure. Both GO/NS and GO/NS/AgNPs exhibited substantial antimicrobial effects against E. coli and B. subtilis.

36 MATERIALS SCIENCE↗
DOE OSTI2022

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained offline using a historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery. Case studies demonstrated that the proposed method outperforms other policies with static operating reserves.

distribution system↗
DOE OSTI2024

Planar slicing for nonextrusion AM processes

Extrusion-based AM processes, including material extrusion and directed energy deposition, construct objects by continuously depositing a relatively small amount of molten feedstock to a specific location. Nonextrusion AM processes, on the other hand, tend to form each layer by linearly or areally projecting either energy onto a vat of photocurable liquid or a binding agent into a bed of loose powder. Such systems vary significantly from extrusion-based AM processes but do share similarities. The general approach to path planning is the same, but nonextrusion processes typically favor the use of bitmap representations, instead of polygons, for pathing computation and do not use a g-code file to command the printer. In this chapter, a high-level discussion of these differences will be covered.

Macdonald, Eric↗
DOE OSTI2025

CHEMREASONER: Heuristic Search over a Large Language Model’s Knowledge Space using Quantum-Chemical Feedback

The discovery of new catalysts is essential for the design of new and more efficient chemical processes in order to transition to a sustainable future. We introduce an AI-guided computational screening framework unifying linguistic reasoning with quantum-chemistry based feedback from 3D atomistic representations. Our approach formulates catalyst discovery as an uncertain environment where an agent actively searches for highly effective catalysts via the iterative combination of large language model (LLM)-derived hypotheses and atomistic graph neural network (GNN)-derived feedback. Identified catalysts in intermediate search steps undergo structural evaluation based on spatial orientation, reaction pathways, and stability. Scoring functions based on adsorption energies and barriers steer the exploration in the LLM's knowledge space toward energetically favorable, high-efficiency catalysts. We introduce planning methods that automatically guide the exploration without human input, providing competitive performance against expert-enumerated chemical descriptor-based implementations. By integrating language-guided reasoning with computational chemistry feedback, our work pioneers AI-accelerated, trustworthy catalyst discovery.

artificial intelligence↗
DOE OSTI2023

Microgrid energy scheduling under uncertain extreme weather: Adaptation from parallelized reinforcement learning agents

Microgrids are useful solutions for integrating renewable energy resources and providing seamless green electricity to minimize carbon footprint. In recent years, extreme weather events happened often worldwide and caused significant economic and societal losses. Such events bring uncertainties to the microgrid energy scheduling problems and increase the challenges of microgrid operation. Traditional optimization approaches suffer from the inaccuracy of the uncertain microgrid model and the unseen events. Existing reinforcement learning (RL) - based approaches are also hampered by the limited generalization and the increasing computational burden when stochastic formulations are required to accommodate the uncertainties. This paper proposes a new parallelized reinforcement learning (PRL) method based on the probabilistic events to handle the microgrid energy uncertainties. Specifically, several local learning agents are employed to interact with pertinent microgrid environments in a distributed manner and report outcomes to the global agent, which will optimize microgrid energy resources online during extreme events. The stochastic microgrid energy optimization problem is reformulated to include all possible scenarios with probabilities. The advantage estimate functions of learning agents are designed with a backward sweep to transfer the outcomes to the value function updating process. Two simulation studies, stochastic optimization and online testing, are performed to compare with several existing RL approaches. Results substantiate that the proposed PRL method can achieve up to 20% optimization performance improvement with 4 and 28 times less computation cost than Q-learning with experience replay and multi-agent Q-learning approaches, respectively.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Modulating Ce 3+ Sites in Ce-Zr Oxide Nanocatalysts through Protamine Biomineralization for Organophosphate Dephosphorylation

Catalytic is a crucial reaction for environmental detoxication of pesticides and neutralization of various molecules classified as chemical warfare agents. Herein, we report on a series of tunable Ce-Zr-based metal oxides, (Zr a Ce 1–a O x ) prepared using a facile biomineralization technique, as catalysts for organophosphates dephosphorylation. Synchrotron scattering and spectroscopy methods showcase that Zr a Ce 1–a O x catalysts are highly defective and exhibit an abundance of Ce 3+ sites that promote oxygen vacancies needed for enhanced dephosphorylation reactions. The catalytic performance was assessed using a model para-nitrophenyl phosphate reaction and showcases a strong dependence on Zr dopant concentration and subsequent tuning of the Ce 3+ /Ce 4+ ratio. Analysis of synchrotron datasets allowed structure-performance correlations between the Ce 3+ concentration and associated oxygen vacancies, the dephosphorylation rate constant, and Zr concentration to be established, confirming that Ce 3+ as active sites is positively correlated with the rate constant. We envision that similar biomineralization approaches can be used to fabricate Ce 3+ -rich Ce-Zr oxide for environmental application in dephosphorylation and other hydrolysis reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Distributed deep reinforcement learning for simulation control

Abstract Several applications in the scientific simulation of physical systems can be formulated as control/optimization problems. The computational models for such systems generally contain hyperparameters, which control solution fidelity and computational expense. The tuning of these parameters is non-trivial and the general approach is to manually ‘spot-check’ for good combinations. This is because optimal hyperparameter configuration search becomes intractable when the parameter space is large and when they may vary dynamically. To address this issue, we present a framework based on deep reinforcement learning (RL) to train a deep neural network agent that controls a model solve by varying parameters dynamically. First, we validate our RL framework for the problem of controlling chaos in chaotic systems by dynamically changing the parameters of the system. Subsequently, we illustrate the capabilities of our framework for accelerating the convergence of a steady-state computational fluid dynamics solver by automatically adjusting the relaxation factors of the discretized Navier–Stokes equations during run-time. The results indicate that the run-time control of the relaxation factors by the learned policy leads to a significant reduction in the number of iterations for convergence compared to the random selection of the relaxation factors. Our results point to potential benefits for learning adaptive hyperparameter learning strategies across different geometries and boundary conditions with implications for reduced computational campaign expenses 4 4 Data and codes available at https://github.com/Romit-Maulik/PAR-RL . .

42 ENGINEERING↗