Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Organoammonium-Ion-based Perovskites Can Degrade to Pb 0 via Amine–Pb(II) Coordination

The degradation of alkylammonium Pb II halide perovskites, in the dark and upon irradiation near room temperature, involves coordinated amine as the dominant reducing agent to yield Pb o near room temperature, as determined by X-ray photoelectron spectroscopy (XPS). The reduction of Pb II first involves amine coordination, supported by 207 Pb nuclear magnetic resonance (NMR) analysis. It is shown that a Pb II –amide complex is the immediate precursor of Pb II reduction. Its oxidized counterpart, the imine, is formed and is characterized by NMR and gas chromatography–mass spectrometry. Here, the “redox” process requires a β-C–H bond of the alkylamine. Amine species devoid of this moiety do not similarly reduce Pb II to Pb o . The conversion of an alkylammonium moiety to the Pb II –amide is proposed to occur through a sequence of photoassisted proton-transfer reactions to a lead-coordinated ligand, which is substantiated through XPS-observed Pb II reduction in a family of lead bromide/iodide 2D perovskites.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Optimal carbon storage reservoir management through deep reinforcement learning

Model-based optimization plays a central role in energy system design and management. The complexity and high-dimensionality of many process-level models, especially those used for geosystem energy exploration and utilization, often lead to formidable computational costs when the dimension of decision space is also large. This work adopts elements of recently advanced deep learning techniques to solve a sequential decision-making problem in applied geosystem management. Specifically, a deep reinforcement learning framework was formed for optimal multiperiod planning, in which a deep Q-learning network (DQN) agent was trained to maximize rewards by learning from high-dimensional inputs and from exploitation of its past experiences. To expedite computation, deep multitask learning was used to approximate high-dimensional, multistate transition functions. Both DQN and deep multitask learning are pattern based. As a demonstration, the framework was applied to optimal carbon sequestration reservoir planning using two different types of management strategies: monitoring only and brine extraction. Both strategies are designed to mitigate potential risks due to pressure buildup. Results show that the DQN agent can identify the optimal policies to maximize the reward for given risk and cost constraints. Finally, experiments also show that knowledge the agent gained from interacting with one environment is largely preserved when deploying the same agent in other similar environments.

15 GEOTHERMAL ENERGY↗
DOE OSTI2020

Sorption and Desorption Study of a Nerve-Agent Simulant from Office Materials for Forensic Applications

Dimethyl methylphosphonate (DMMP) was used as a simulant to investigate the sorption and desorption of G-series nerve agents such as sarin (GB) released into an office space. DMMP was disseminated systematically as an aerosol and vapor on three common office materials, cardboard, polyurethane foam, and cured acrylic-based paint. The amount of DMMP initially captured on the office materials and the amount retained over a period of 10 hours was tracked gravimetrically and by solvent extraction and gas chromatography/mass spectrometry (GC/MS). Physicochemical properties of the office media including the specific surface area per mass, polarity, and Henry’s constants were determined to help explain the capture and release of DMMP that was observed. Polyurethane foam was found to have the largest sorption capacity for DMMP in a low-humidity setting, however, cardboard was found to have the largest sorption capacity at higher humidity. A fraction of the DMMP collected desorbed with first-order kinetics from all of the office materials in an open-air atmosphere over 8 hours. However, importantly for forensic purposes relevant to an indoor attack, a significant quantity (most notably on cardboard) of the nerve agent simulant was retained after 6 weeks and could be analyzed efficiently using solvent extraction followed by GC/MS.

chemical forensics↗
DOE OSTI2021

Carbon-Based Multi-Phase Rotating Detonation Engine

Abstract This article focuses on extending an H2/air rotating detonation engine's detonability limits by introducing solid carbon particles into the combustor. Carbon black particles consisting of 1% volatility and a carbon concentration of 99% were used as a solid-phase mixing agent for enhanced reaction wave dynamics. Carbon black was found to sustain detonations over multiple operational regimes formerly unattainable without carbon particles. The experiments confirm that detonations were attainable over a wide range of operational parameters, including the total mass flux flowing through the annulus (≅120–270 kg/s m2), the hydrogen/air equivalence ratios (0.65–1.0), and carbon additions (0–20 g). Chemiluminescence imaging was used to visualize the detonation wave within the annulus, quantify detonation wave velocities, and define a detonability map. The detonability map demonstrates the advantage of carbon addition, shows that detonation-based combustion can be sustained at leaner equivalence ratios, reduces hydrogen consumption dependency. The detonation wave velocities decreased as the H2/air equivalence ratio was reduced, where, in general, the detonation wave velocities decreased with respect to the Chapman–Jouguet velocity, suggesting a decrease in the detonation waves efficiency with reduced H2 concentrations. However, an extraordinary phenomenon was witnessed at very lean H2/air equivalence ratios and low mass flux conditions, where the detonation wave velocity increased upward of 100 m/s. This variation is a direct effect of the carbon particles, which drive the detonation wave. Thus, the results demonstrate that carbon particles’ addition provides an economically feasible solution to sustain high-efficiency energy production.

Energy & Fuels↗
DOE OSTI2020

Evaluating the Adaptability of Reinforcement Learning Based HVAC Control for Residential Houses

Intelligent Heating, Ventilation, and Air Conditioning (HVAC) control using deep reinforcement learning (DRL) has recently gained a lot of attention due to its ability to optimally control the complex behavior of the HVAC system. However, more exploration is needed on understanding the adaptability challenges that the DRL agent could face during the deployment phase. Using online learning for such applications is not realistic due to the long learning period and likely poor comfort control during the learning process. Alternatively, DRL can be pre-trained using a building model prior to deployment. However, developing an accurate building model for every house and deploying a pre-trained DRL model for HVAC control would not be cost-effective. In this study, we focus on evaluating the ability of DRL-based HVAC control to provide cost savings when pre-trained on one building model and deployed on different house models with varying user comforts. We observed around 30% of cost reduction by pre-trained model over baseline when validated in a simulation environment and achieved up to 21% cost reduction when deployed in the real house. This finding provides experimental evidence that the pre-trained DRL has the potential to adapt to different house environments and comfort settings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2019

Effect of Al{sub 2}O{sub 3}/(B{sub 2}O{sub 3 }+ Na{sub 2}O) Ratio on CaO-Al{sub 2}O{sub 3}-Based Mold Fluxes: Melting Property, Viscosity, Heat Transfer, and Structure

CaO-Al{sub 2}O{sub 3}-based mold fluxes, which are under development for the continuous casting of high-Al steel, contain fluxing compounds, such as Na{sub 2}O and B{sub 2}O{sub 3}. The reaction between [Al] and the fluxing agents in mold fluxes leads to an increase in Al{sub 2}O{sub 3} and a decrease in B{sub 2}O{sub 3} and Na{sub 2}O concentrations, changing the properties of mold fluxes. The effect of the Al{sub 2}O{sub 3}/(B{sub 2}O{sub 3 }+ Na{sub 2}O) ratio on the melting properties, viscosity, heat transfer, and structure of the CaO-Al{sub 2}O{sub 3}-based mold fluxes is presented in this work. The increase of the Al{sub 2}O{sub 3}/(B{sub 2}O{sub 3 }+ Na{sub 2}O) ratio in the fluxes raised the melting temperature and high-temperature viscosity of mold fluxes but decreased the heat transfer rate across the flux disks. It also enhanced the degree of polymerization by promoting the formation of 3-D aluminate structure, which accounted for the change of the viscous behavior.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Decomposition Kinetics of H 2 O 2 on Pd Nanocrystals with Different Shapes and Surface Strains

Direct synthesis of hydrogen peroxide (H 2 O 2 ) from H 2 and O 2 on a Pd-based catalyst has emerged as a promising route to replace the energy-consuming, highly inefficient anthraquinone process. However, Pd is also a good catalyst for the decomposition of H 2 O 2 , thereby compromising the selectivity toward the desired product. The coupling between the formation and decomposition reactions makes it difficult to single out the most important parameter that controls the selectivity toward direct synthesis of H 2 O 2 . Herein, support-free monometallic Pd nanocrystals with different shapes and surface strains are used to investigate their impacts on the decomposition kinetics of H 2 O 2 . The kinetics are analyzed by tracking the concentration of the remaining H 2 O 2 using infrared spectroscopy. The data indicates that both surface structure and strain affect the decomposition kinetics of H 2 O 2 , but their impacts are inferior to that caused by Br – , a surface capping agent for the Pd{100} facets. The experimental results are consistent with the trend obtained through density functional theory calculations. Furthermore, this work helps shed light on the development of Pd-based catalysts for the direct synthesis of H 2 O 2 by offering strategies to mitigate the decomposition of the desired product.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Creation of discrete active site domains via mesoporous silica poly(styrene) composite materials for incompatible acid–base cascade reactions

This work highlights the design and synthesis of bifunctional mesoporous silicate – polymer composite dual acid–base supported cascade catalysts. Compartmentalization of the two incompatible active sites is sought by segregating acid sites on the silica surface, and base sites within polymer chains and/or polymer domains. The ability to isolate and segregate active sites via control of the mesoporous silica pore size and polymer molecular weight is probed with silica samples functionalized by a grafting-to process. Supplemental activator and reducing agent (SARA) atom transfer radical polymerization is used to synthesize random copolymers containing protected primary amines. Thiol–ene ‘click’ chemistry facilitates silica functionalization via a convergent approach, with the ene-functionalized polymer end group and silica-grafted thiols forming SBA/MCM-SH-poly(styrene-co-2-(4-vinylbenzyl)isoindoline-1,3-dione). Polymer deprotection and thiol oxidation produces primary amine/sulfonic acid containing composite catalysts. With the polymer supported Lewis base and silica grafted Brønsted acid, the two-step deacetalization – Knoevenagel condensation cascade is explored to assess the ability of these polymer/silica hybrids to segregate active sites, allowing both acid and base site accessibility. Six composite catalysts are synthesized and tested in individual and cascade reactions with kinetic results demonstrating that lower molecular weight SBA-15-P1 and MCM-41-P1 catalysts outperform (higher turnover frequencies and initial rates) their higher molecular weight analogues, as well as a polymer-free system containing molecular active sites dispersed on the silica surface. Higher molecular weight composite catalysts perform more poorly due to limited chain solubility, mass transfer limitations, and poor catalyst accessibility. In many cases, the polymer chains effectively thread into the mesopores, with higher molecular weight polymers leading to pore blockage and inhibited mass transfer.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Metabolomics Analysis of Bacterial Pathogen Burkholderia thailandensis and Mammalian Host Cells in Co-culture

The Tier 1 HHS/USDA Select Agent Burkholderia pseudomallei is a bacterial pathogen that is highly virulent when introduced into the respiratory tract and intrinsically resistant to many antibiotics. Transcriptomic- and proteomic-based methodologies have been used to investigate mechanisms of virulence employed by B. pseudomallei and Burkholderia thailandensis, a convenient surrogate; however, analysis of the pathogen and host metabolomes during infection is lacking. Changes in the metabolites produced can be a result of altered gene expression and/or post-transcriptional processes. Thus, metabolomics complements transcriptomics and proteomics by providing a chemical readout of a biological phenotype, which serves as a snapshot of an organism’s physiological state. However, the poor signal from bacterial metabolites in the context of infection poses a challenge in their detection and robust annotation. In this work, we coupled mammalian cell culture-based metabolomics with feature-based molecular networking of mono- and co-cultures to annotate the pathogen’s secondary metabolome during infection of mammalian cells. These methods enabled us to identify several key secondary metabolites produced by B. thailandensis during infection of airway epithelial and macrophage cell lines. Additionally, the use of in silico approaches provided insights into shifts in host biochemical pathways relevant to defense against infection. Using chemical class enrichment analysis, for example, we identified changes in a number of host-derived compounds including immune lipids such as prostaglandins, which were detected exclusively upon pathogen challenge. Taken together, our findings indicate that co-culture of B. thailandensis with mammalian cells alters the metabolome of both pathogen and host and provides a new dimension of information for in-depth analysis of the host–pathogen interactions underlying Burkholderia infection.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

RLC4CLR (Reinforcement Learning Controller for Critical Load Restoration Problems)

RLC4CLR demonstrates using a reinforcement learning controller (RLC) to solve a critical load restoration (CLR) problem, which improves the grid resilience after a substation outage event. RLC4CLR consists of two parts. (1) RL environment: This environment encapsulates the CLR problem to be solved and provides interfacing functions to follow the standard OpenAI Gym format. A power system simulator, i.e., OpenDSS, is included to provide the power flow solution. Controller inputs and outputs (RL state and action) as well as the reward are defined in this environment as well. In summary, the RL environment is the problem formulation from which the RL agent can learn. (2) RL training script: The training script enables the RL agent to learn its control policy by interacting with the RL environment. For RL training, an open-sourced RL library, i.e., RLlib, is leveraged which is based on a distributed computing framework (Ray). The training script is designed to be able to be run on both local machine or the NREL HPC system. Other components of RLC4CLR include input data, e.g., grid model (standard IEEE test feeders), and other files used for results analysis.

Zhang, Xiangyu↗
DOE OSTI2022

Structure-based discovery of potent WD repeat domain 5 inhibitors that demonstrate efficacy and safety in preclinical animal models

WD repeat domain 5 (WDR5) is a core scaffolding component of many multiprotein complexes that perform a variety of critical chromatin-centric processes in the nucleus. WDR5 is a component of the mixed lineage leukemia MLL/SET complex and localizes MYC to chromatin at tumor-critical target genes. As a part of these complexes, WDR5 plays a role in sustaining oncogenesis in a variety of human cancers that are often associated with poor prognoses. Thus, WDR5 has been recognized as an attractive therapeutic target for treating both solid and hematological tumors. Previously, small-molecule inhibitors of the WDR5-interaction (WIN) site and WDR5 degraders have demonstrated robust in vitro cellular efficacy in cancer cell lines and established the therapeutic potential of WDR5. However, these agents have not demonstrated significant in vivo efficacy at pharmacologically relevant doses by oral administration in animal disease models. We have discovered WDR5 WIN-site inhibitors that feature bicyclic heteroaryl P 7 units through structure-based design and address the limitations of our previous series of small-molecule inhibitors. Importantly, our lead compounds exhibit enhanced on-target potency, excellent oral pharmacokinetic (PK) profiles, and potent dose-dependent in vivo efficacy in a mouse MV4:11 subcutaneous xenograft model by oral dosing. Furthermore, these in vivo probes show excellent tolerability under a repeated high-dose regimen in rodents to demonstrate the safety of the WDR5 WIN-site inhibition mechanism. Collectively, our results provide strong support for WDR5 WIN-site inhibitors to be utilized as potential anticancer therapeutics.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Privacy-Preserving Average Consensus With Beaver Triple and Communication Obfuscation

A privacy-preserving average consensus algorithm is proposed that synergizes the Beaver triple in secret sharing theory and noise obfuscation. The algorithm safeguards the initial values of agents against passive adversaries in a multiagent system. It is proved that the proposed algorithm can concurrently ensure average consensus and privacy, while also reducing the online computation and communication overhead compared to encryption-based ones. In addition, it imposes a less stringent condition for privacy preservation compared to certain noise-obfuscation techniques.

Beaver triple↗
DOE OSTI2023

Aligning theoretical and empirical representations of soil carbon-to-nitrogen stoichiometry with process-based terrestrial biogeochemistry models

Soil carbon-nitrogen (C:N) stoichiometry acts as a control over decomposition and soil organic matter formation and loss, making it a key soil property for understanding ecosystem dynamics and projected ecosystems responses to global environmental change. However, the controls of soil C:N and how they respond to increasing pressures from global change agents are not fully understood. The “foundational” controls on soil C:N, namely plant and microbial C:N, have been used to predict soil C:N, but fail to accurately simulate all ecosystems and may be insufficient for predictions under global environmental change. Here we present an “emerging” representation of controls of soil C:N that includes plant-microbe-mineral feedbacks that have been shown to regulate soil C:N. We argue that including representation of these emerging drivers in process-based terrestrial biogeochemistry models, which include biological N fixation, mycorrhizae, priming, root exudation of organic acids, and mineralogy (including soil texture, mineral composition, and aggregation), will improve mechanistic representation of soil C:N and associated processes. Such improvements will produce models that will better simulate a variety of ecological states and predict soil C:N when global changes modify plant-microbe-mineral interactions. Here, we align our empirical understanding of controls of soil C:N with those controls represented in models, identifying contexts where emerging drivers might be particularly important to represent (e.g., priming and root exudation in nutrient-limited conditions) and areas of future work. Additionally, we show that implementing emerging drivers of soil C:N results in different simulated outcomes at steady state and in response to elevated atmospheric CO2. Our review and preliminary simulations support the need to incorporate emerging drivers of soil C:N into process-based terrestrial biogeochemistry models, allowing for both theoretical exploration of mechanisms and potentially more accurate predictions of land biogeochemical responses to global change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Conclusions from 3 years of continuous capture plant operation without exchange of the AMP/PZ-based solvent at Niederaussem – insights into solvent degradation management

A many times heard mantra of solvent degradation management in amine-based post combustion capture is “keep the solvent clean” to minimize solvent consumption. It is assumed that the amine losses would decrease by the removal of metals, degradation products, and reactive trace components which are captured from the flue gas, like NO 2 (as potentially driving components of the amine degradation besides dissolved O 2 ). However, this theoretical hypothesis – based on results from laboratory experiments typically generated with fresh amines – disregards the complexity of the solvent matrix, interaction of potential metal catalysts with degradation products and oxidizing agents, and specific chemical requirements which must be fulfilled before a degradation mechanism can proceed. Degradation of the solvent CESAR1 (aqueous solution of 3.0 molar 2-amino-2-methylpropan-1-ol (AMP) and 1.5 molar piperazine (PZ)) is investigated in a unique long-time test campaign (testing time up to now 40 months; 24/7 operation) without replacement of the solvent inventory at the capture pilot plant at the lignite-fired power plant in Niederaussem. Three solvent management strategies with different effect mechanisms are investigated and evaluated: (a) removal of only anionic compounds and trace elements (within 75 days solvent inventory treated two times) and anionic as well as cationic compounds and trace elements (114 days, inventory treated four times) from the solvent by ion exchange, (b) adsorptive removal of trace elements from the solvent by active carbon in 35% of the operating time, and (c) removal of >80% NO 2 by flue gas pretreatment with thiosulfate/sulfite solution (dosing for 2,000 h). The results of the testing program clearly show that “solvent cleanliness” is not a well-defined parameter and that results from laboratory tests, tests without fully representative industrial flue gasses, and short-term testing of monoethanolamine cannot be generalized for other solvents and industrial application. Furthermore, these results showcase that specific degradation management considering solvent, capture plant and flue gas quality is reasonable. Overshooting efforts for solvent management are contra-productive and produce unnecessary waste streams, efficiency losses and costs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Adaptive Reinforcement Learning Control for Power Distribution in Multi-Output Resonant Converters

This paper presents an adaptive reinforcement learning (ARL)-based control framework for efficient power distribution in a multi-output resonant converter for UAV applications. The proposed system is based on a high-frequency isolated resonant architecture, where a single energy source supplies multiple propulsion loads through independently controlled output rectifiers, addressing the need for coordinated multi-motor power management. The ARL framework dynamically allocates output power by learning optimal phase-shift control actions under varying load demands and operating conditions. The agent autonomously determines control parameters that maximize conversion efficiency while ensuring accurate power sharing among multiple outputs. In addition, the proposed approach enables adaptive operation without requiring detailed system modeling or manual tuning. Experimental results demonstrate stable and efficient performance over a wide range of operating conditions, confirming the effectiveness and robustness of the learning-based control strategy for multi-output resonant converter system.

Asa, Erdem [ORNL] (ORCID:0000000190884812)↗
DOE OSTI2021

Agent-Supervisor Coordination for Decentralized Event-Triggered Optimization

This letter proposes decentralized resource-aware coordination schemes for solving network optimization problems defined by objective functions that combine locally evaluable costs with network-wide coupling components. These methods are well suited for a group of supervised agents trying to solve an optimization problem under mild coordination requirements. Each agent has information on its local cost and coordinates with the network supervisor for information about the coupling term of the cost. The proposed approach is feedback-based and asynchronous by design, guarantees anytime feasibility, and ensures the asymptotic convergence of the network state to the desired optimizer. Numerical simulations on a power system example illustrate our results.

decentralized algorithms↗
DOE OSTI2024

Investigation of the Potential of Repurposing Medium-Density Fiberboard Waste as an Adsorbent for Heavy Metal Ion Removal

Medium-density fiberboard (MDF) waste generation has increased steadily over the past decades, and therefore, the investigation of novel methods to recycle this waste is very important. The potential of repurposing MDF waste as an adsorbent for the treatment of Cd(II), Cu(II), Pb(II), and Zn(II) ions in water was investigated using MDF offcuts. The highest adsorption potential in single-metal ion solution systems was observed for Pb(II) ions. The experimental data of Pb(II) ions fit well with the Freundlich isotherm and pseudo-second-order kinetic models. Complexation and electrostatic interactions were identified as the adsorption mechanisms. The adsorption behavior of multi-metal ion adsorption systems was investigated by introducing Cd(II) ions as a competitive metal ion. The presence of the Cd(II) ions reduced the adsorption potential of Pb(II) ions, yet the preference for the Pb(II) ions remained. Regeneration studies were performed by using 0.1 M HCl as a regeneration agent for both systems. Even though a significant amount of adsorbed metal ions were recovered, the adsorption potential of the MDF was reduced in the subsequent adsorption cycles. Based on these results, MDF fines have the potential to be used as an economical adsorbent for remediation of wastewater containing heavy metal ions.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Metal-organic frameworks for the adsorption and catalytic transformations of carbon dioxide

Novel crystalline porous materials known as metal-organic frameworks (MOFs) and methods for their synthesis are provided herein. The MOFs include a M6(μ3-OH)8(OH)8(μ2,η2-(O2C)2cyclam)8 cluster, and a metal atom coordinated to the one or more cyclam of the cluster, wherein M is Zr or Hf, and the metal atom is any one of Cu, Ni, Cr, Ru, Co, and Gd. The MOFs can be used as an adsorbent, alone or in a medium with other components, of CO2. The MOFs can also be used as a catalyst for the transformation of CO2 and epoxides to cyclic carbonates. The MOFs can also be used in the electrochemical catalytic reduction of CO2. The MOFs can also be used for photocatalytic CO2 reduction for the production of carbon-based fossil fuels. The MOFs can also be used for light-induced nitric oxide (NO) release. The MOFs can also be used as magnetic resonance imaging (MRI) agents.

Morris, Amanda Jean↗