Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Antioxidant-induced transformations of a metal-acid hydrocracking catalyst in the deconstruction of polyethylene waste

Plastics are ideal for numerous applications, as driven by the development of complex formulations containing various additives to improve performance and processability. Unfortunately, chemical valorization strategies (e.g., catalytic deconstruction) often can be challenged by the presence of small-molecule additives, and quantification of the impact of these molecular constituents on upcycling processes remains elusive. Here, this dearth of information restricts catalyst design efforts to combine the robustness and performance necessary to improve plastics circularity. In this communication, we describe a systematic study of common plastics additives—phenolic antioxidants, and we quantify the relationship between additive content and deconstruction yields of high-density polyethylene (HDPE) over a platinum on tungstated zirconium (Pt/WO 3 /ZrO 2 ) hydrocracking catalyst. In the simplest case of a base (antioxidant- and slip agent-containing) HDPE resin versus a pure (additive-stripped) HDPE polymer, a two-fold decrease in the yield of gas and liquid products is noted for base HDPE resin. Furthermore, both antioxidant chemistry and concentration strongly impact conversion and individual product selectivities. Using infrared spectroscopy, we determine that antioxidants change the effective ratio of metal to acid sites (i.e., metal-acid balance) through reactions of phenols and/or other functional groups (e.g., acids, esters) with catalyst active sites. Overall, this work demonstrates the impact of one common set of additives on plastics deconstruction, and the analysis herein provides a blueprint for quantitatively assessing the effects of additives on plastics deconstruction processes and for evaluating the development of more robust catalytic strategies or more tolerable additive formulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Sorption agent, method of making a sorption agent and barrier system

An anionic sorption agent, method for forming the anionic sorption agent and a barrier system are disclosed. The anionic sorption agent including a modified pseudo or glycol-boehmite base comprising a structure having cationic metal ion sites. The method for forming the anionic sorption agent includes providing a pseudo or glycol-boehmite base and contacting the pseudo or glycol-boehmite base a modifying composition comprising a metallic ion to form the modified pseudo or glycol-boehmite base comprising a structure having cationic metal ion sites. The barrier system includes the anionic sorption agent comprising a first barrier component comprising a modified pseudo or glycol-boehmite base comprising a structure having cationic metal ion sites and a second barrier component comprising a cationic sorption agent.

Matteo, Edward N.↗
DOE OSTI2023

Two-Stage Deep Reinforcement Learning for Distribution System Voltage Regulation and Peak Load Management

The growing integration of distributed solar photovoltaic (PV) in distribution systems could result in adverse effects during grid operation. This paper develops a two-agent soft actor critic-based deep reinforcement learning (SAC-DRL) solution to simultaneously control PV inverters and battery energy storage systems for voltage regulation and peak demand reduction. The novel two-stage framework, featured with two different control agents, is applied for daytime and nighttime operations to enhance control performance. Comparison results with other control methods on a real feeder in Western Colorado demonstrate that the proposed method can provide advanced voltage regulation with modest active power curtailment and reduce peak load demand from feeder's head.

deep reinforcement learning↗
DOE OSTI2023

Distributed Power Allocation for 6-GHz Unlicensed Spectrum Sharing via Multi-agent Deep Reinforcement Learning

We consider the problem of power allocation over the 6 GHz Unlicensed National Information Infrastructure (UNII)- 5 spectrum. We propose a novel deep Reinforcement Learning (DRL)-based distributed power allocation scheme which utilizes the multi-agent Deep Deterministic Policy Gradient (MADDPG) algorithm. In particular, we model the base stations (BSs) as DRL agents that simultaneously determine the transmit powers to their scheduled user equipment (UE) in a synchronized manner. The power decision of each BS is based on its own observation of the radio environment, which consists of several local interference measurements and a limited amount of information obtained from other BSs. One advantage of the proposed scheme is that it addresses the single-agent non-stationarity problem of RL in the multi-agent scenario by incorporating the actions and observations of other BSs into each BS’s own critic which helps it to gain a more accurate perception of the overall radio environment. A centralized-training-distributed execution framework is used to train the policies where the critics are trained over the joint actions and observations of all BSs while the actor of each BS only takes the local observation as input in order to produce the transmit power. Simulation shows that the proposed power allocation scheme can achieve better throughput performance than several state-of-the-art approaches.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Soft Actor Critic Based Volt-VAR Co-optimization in Active Distribution Grids

Modern distribution networks are undergoing several technical challenges, such as voltage fluctuations, because of high penetration of distributed energy resources (DERs). This paper proposes a deep reinforcement learning (DRL)-based Volt VAR co-optimization technique for reducing voltage fluctuations as well as power loss under high penetration of DERs. In addition, the proposed approach minimizes the operational cost of the grid. A stochastic policy optimization based soft actor critic (SAC) agent is proposed to configure the optimal set-points of the reactive power outputs of the inverters. The performance of the proposed model is verified on the modified IEEE 34- and 123-bus systems and compared with a base case scenario with no reactive supply by inverters, and a local droop control approach. The results demonstrate that the proposed framework outperforms the conventional droop control method in improving the voltage profile, minimizing the network power loss, and reducing grid operational cost.

—Distribution grids, deep reinforcement learning, ↗
DOE OSTI2022

A P-61 Black Widow Inspired Palladium Biladiene Complex for Efficient Sensitization of Singlet Oxygen Using Visible Light

Photodynamic therapy (PDT) is a promising treatment option that ablates cancerous cells and tumors via photoinduced sensitization of singlet oxygen. Over the last few decades, much work has been devoted to the development of new photochemotherapeutic agents for PDT. A wide variety of macrocyclic tetrapyrrole based photosensitizers have been designed, synthesized and characterized as PDT agents. Many of these complexes have a variety of issues that pose a barrier to their use in humans, including biocompatibility, inherent toxicity, and synthetic hurdles. We have developed a non-traditional, non-cyclic, and non-aromatic tetrapyrrole ligand scaffold, called the biladiene (DMBil1), as an alternative to these traditional photosensitizer complexes. Upon insertion of a heavy atom such as Pd 2+ center, Pd[DMBil1] generates singlet oxygen in substantial yields (Φ Δ = 0.54, λ exc = 500 nm) when irradiated with visible light. To extend the absorption profile for Pd[DMBil1] deeper into the phototherapeutic window, the tetrapyrrole was conjugated with alkynyl phenyl groups at the 2- and 18-positions (Pd[DMBil2-PE]) resulting in a significant redshift while also increasing singlet oxygen generation (Φ Δ = 0.59, 600 nm). To further modify the dialkynyl-biladiene scaffold, we conjugated a 1,8-diethynylanthracene with to the Pd[DMBil1] tetrapyrrole in order to further extend the compound’s π-conjugation in a cyclic loop that spans the entire tetrapyrrole unit. This new compound (Pd[DMBil2-P61]) is structurally reminiscent of the P61 Black Widow aircraft and absorbs light into the phototherapeutic window (600–900 nm). In addition to detailing the solid-state structure and steady-state spectroscopic properties for this new biladiene, photochemical sensitization studies demonstrated that Pd[DMBil2-P61] can sensitize the formation of 1 O 2 with quantum yields of Φ Δ = 0.84 upon irradiation with light λ = 600 nm. These results distinguish the Pd[DMBil2-P61] platform as the most efficient biladiene-based singlet oxygen photosensitizer developed to date. When taken together, the improved absorption in the phototherapeutic window and high singlet oxygen sensitization efficiency of Pd[DMBil2-P61] mark this compound as a promising candidate for future study as an agent of photodynamic cancer therapy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Data exchange and processing synchronization in distributed systems

Systems, methods, techniques and apparatuses of asynchronous communication is distributed systems are disclosed. One exemplary embodiment is a method determining, with a plurality of agent nodes structured to communicate asynchronously in a distributed system, a first set of iterations including an iteration determined by each of the plurality of agent nodes; determining, with a first agent node of the plurality of agent nodes, a local vector clock; receiving, with the first agent node, a first iteration of the first set of iterations and a remote vector clock determined based on the first iteration; updating, with the first agent node, the local vector clock based on the received remote vector clock; and determining a first iteration of a second set of iterations based on the first set of iterations after determining all iterations of the first set of iterations have been received based on the local vector clock.

Cintuglu, Mehmet H.↗
DOE OSTI2023

Reinforcement Learning for Load-balanced Parallel Particle Tracing

We explore an online reinforcement learning (RL) paradigm to dynamically optimize parallel particle tracing performance in distributed-memory systems. Our method combines three novel components: (1) a work donation algorithm, (2) a high-order workload estimation model, and (3) a communication cost model. First, we design an RL-based work donation algorithm. Our algorithm monitors workloads of processes and creates RL agents to donate data blocks and particles from high-workload processes to low-workload processes to minimize program execution time. The agents learn the donation strategy on the fly based on reward and cost functions designed to consider processes' workload changes and data transfer costs of donation actions. Second, we propose a workload estimation model, helping RL agents estimate the workload distribution of processes in future computations. Third, we design a communication cost model that considers both block and particle data exchange costs, helping RL agents make effective decisions with minimized communication costs. We demonstrate that our algorithm adapts to different flow behaviors in large-scale fluid dynamics, ocean, and weather simulation data. Our algorithm improves parallel particle tracing performance in terms of parallel efficiency, load balance, and costs of I/O and communication for evaluations with up to 16,384 processors.

Distributed and parallel particle tracing↗
DOE OSTI2025

Molecular-Level Insights into the NMR Relaxivity of Gadobutrol Using Quantum and Classical Molecular Simulations

MRI is an indispensable diagnostic tool in modern medicine; however, understanding the molecular-level processes governing NMR relaxation of water in the presence of MRI contrast agents remains a challenge, hindering the molecular-guided development of more effective contrast agents. By using quantum-based polarizable force fields, the first-of-its-kind molecular dynamics (MD) simulations of Gadobutrol are reported where the 1 H NMR longitudinal relaxivity r 1 of the aqueous phase is determined without any adjustable parameters. The MD simulations of r 1 dispersion (i.e., frequency dependence) show good agreement with measurements at frequencies of interest in clinical MRI. Importantly, the simulations reveal key insights into the molecular level processes leading to r 1 dispersion by decomposing the NMR dipole–dipole autocorrelation function G(t) into a discrete set of molecular modes, analogous to the eigenmodes of a quantum harmonic oscillator. The molecular modes reveal important aspects of the underlying mechanisms governing r 1 , such as its multiexponential nature and the importance of the second eigenmodal decay. By simply analyzing the MD trajectories on a parameter-free approach, the Gadobutrol simulations show that the outer-shell water contributes ∼50% of the total relaxivity r 1 compared to the inner-shell water, in contrast to simulations of (nonchelated) gadolinium-aqua where the outer shell contributes only ∼15% of r 1 . The deviation between simulations and measurements of r 1 below clinical MRI frequencies is used to determine the low-frequency electron-spin relaxation time for Gadobutrol, in good agreement with independent studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

A Novel Multiagent Resource Sharing Algorithm for Control of Advanced Energy Systems

This paper implements a novel resource sharing control strategy on a fuel cell–gas turbine hybrid power system at the National Energy Technology Laboratory’s Hybrid Performance Facility (Hyper). In a fuel cell–gas turbine hybrid power system, the simultaneous interaction of the gas turbine and the fuel cell creates a tightly coupled environment characterized by conflicting dynamics. In this paper, a model-free control approach is applied to solve the tightly coupled control problem posed by this challenging environment. Specifically, this control problem is presented as a resource sharing problem that can be solved using a resource sharing algorithm that is defined based on the distribution construction concept. This algorithm creates computational agents and solves the problem through the distribution and redistribution of shared resources defined as blocks. Furthermore, two agents were created; the first agent (agent 1) controls the gas turbine speed by adjusting the electric load, and the second agent (agent 2) controls the cathode mass flow through the fuel cell using the cold-air bypass valve. A parametric study was performed over the course of 15 experimental tests for both agents 1 and 2 through an evaluation of the responses based on setpoint changes. The algorithm was shown to have behavior comparable to a previously implemented multi-input multioutput state-space controller, which was designed through a model-based control approach. The resource sharing algorithm was able to find stable performance during run-time operations without any prior system knowledge identification on the power plant and without creating models used in traditional control strategies.

25 ENERGY STORAGE↗
DOE OSTI2022

A Self-Organizing Nano Grid (SONG) for Energy Access Clusters

In this paper, a bottom-up dc Self-Organizing Nano Grid (SONG) for rural electrification at ultra-low-cost through a flexible and scalable topology is presented. The proposed nano grid requires no communication and uses dc-bus signaling to convey excess energy in the system through the bus voltage, allowing independent agents to conduct energy transactions based on their needs in a decentralized manner. Moreover, this article proposes a concept that uses a novel multi-source, multi-segment droop control strategy with demand coordination, allowing for dynamic self-balancing of the system under fluctuating operating conditions. The unique use of a surplus photovoltaic (PV) power droop mode precisely estimates energy availability to minimize load chattering that helps in stabilizing the dc-bus. In addition, this architecture uses standard dc/dc converters for a low-cost, modular, Plug and Play ( PnP ) solution with highly automated operation, enabling local assembly, operation, and maintenance by non-technical personnel. The proposed SONG concept was validated in simulation and with a 700W, laboratory-scale, custom made nano grid system. The simulation and experimental test cases show the feasibility of the SONG system by demonstrating the proposed multi-source, multi-segment droop control strategy without load chattering under varying operating conditions.

dc-dc converter↗
DOE OSTI2025

Datum: A Scientific Metadata Catalog

The data catalog market is currently flooded with a myriad of different products, but none serve the scientific community well. There are cloud-native tools like Databricks, Snowflake,to on-premise solutions like Collibra and Datahub. The common failing of all these tools however, is their inability to serve the scientific data community directly. Most catalogs are targeted towards financial, health, or user data - not sensor or scientific domain data. They also prioritize integrations that often don’t exist or are just starting to be used in the scientific realm - all while ignoring common scientific tools and file types. Datum is a catalog which targets the scientific data directly, including the tools and networks in which those tools are used. We work with the producers and consumers of the data where they are, targeting cloud and on-premise with a focus on classified networks. Datum is an Erlang/Elixir application. Technical Features Note: The features listed below are still under development and may change, slightly, upon final delivery of the product. File Formats - Datum has the ability to read additional metadata and provides processing pipelines for the following file formats: Plain Text, PDF, LaTeX, HTML, Open Document Format (.odt), XML, CSV/TSV (and other standard delimiters), OpenDocument Database and Spreadsheets, Geo-Referenced TIFF, Common Data Format, HDF/HDF5, LabView TDMS, Excel, DeltaTables, Parquet, Apache Iceberg, Apache Hudi and many others. Metadata Collection - Scanners for the local and networked file systems and cloud storage providers. Network integration with common databases such as MSSQL and MySQL. User Plugin System - Users are able to provide either file processing, metadata extraction, or sampling plugins in the programming language of their choice. Authentication/Authorization -: OIDC integration, SCIM provisioning and EntraID integration out of the box. Full user and group management system with a “least privilege” operating mode. Governance - Customizable data governance platform; dictate and enforce required metadata, enforce data embargos, and enforce user agreements and NDAs before data access. Ability to create health checks on data, rejecting abandoned or poorly curated data and automatically removing it from the search index. Ability for users to submit corrections. Search - Semantic search is a first class citizen. No licenses to expensive, external software required. Integrated use of vectors and vector-based search allows for AI agent integration at all levels of operation. Metadata Model - Display and control data’s lineage and connections to other data and data directories. Data is modeled after a filesystem - an organization instantly recognizable and navigable by most any user. CLI and SDK - Ships with a Command Line Interface (CLI) tool and with a fully-featured Python SDK. This allows for rapid and programmatic use of Datum by every level of user. Minimal Infrastructure - Datum ships as a single executable file and can be run on any operating system and most CPU architectures. Datum has no reliance on external databases, search indexing tools, or other outside services - and it runs equally well on edge computing devices, cloud services, or in a clustered HPC environment.

darrington, john↗
DOE OSTI2020

Passivated Interfaces and Surface Recombination Velocities in Halide Perovskites

Surfaces and charge-extracting contacts remain major sources of non-radiative recombination loss; limiting the performance of perovskite PV compared to theoretical limits. We investigate mixed-cation mixed-halide perovskites and demonstrate that, with chemical surface passivation, they can achieve >4 μs minority carrier lifetimes, and >20% external PL quantum yields (PLQY), and nearly single-exponential decay kinetics. This high PLQY observed corresponds to ~97% of the Shockley-Queisser theoretical quasi-fermi level splitting, a first for MA-free mixed-cation mixed-halide compositions. The high PLQY and long PL lifetimes allow us to measure average surface recombination velocities (SRV) <10cm/s, with a champion low of ~1cm/s (a conservative estimate). We show how such improvements in SRV should lead to an absolute improvement in PCE of >4% even with the best of contact alignments. We investigate different MA-free high bandgap compositions, including bandgaps relevant for tandem applications (1.7-1.8eV), and demonstrate performance improvements across all these compositions with our surface passivation strategy. Lastly, using a combination of surface characterization techniques, we show Lewis base interactions of the passivating agent with the perovskite surfaces.

14 SOLAR ENERGY↗
DOE OSTI2020

Passivated Interfaces and Surface Recombination Velocities in Halide Perovskites

Surfaces and charge-extracting contacts remain major sources of non-radiative recombination loss; limiting the performance of perovskite PV compared to theoretical limits. We investigate mixed-cation mixed-halide perovskites and demonstrate that, with chemical surface passivation, they can achieve >4 μs minority carrier lifetimes, and >20% external PL quantum yields (PLQY), and nearly single-exponential decay kinetics. This high PLQY observed corresponds to ~97% of the Shockley-Queisser theoretical quasi-fermi level splitting, a first for MA-free mixed-cation mixed-halide compositions. The high PLQY and long PL lifetimes allow us to measure average surface recombination velocities (SRV) <10cm/s, with a champion low of ~1cm/s (a conservative estimate). We show how such improvements in SRV should lead to an absolute improvement in PCE of >4% even with the best of contact alignments. We investigate different MA-free high bandgap compositions, including bandgaps relevant for tandem applications (1.7-1.8eV), and demonstrate performance improvements across all these compositions with our surface passivation strategy. Lastly, using a combination of surface characterization techniques, we show Lewis base interactions of the passivating agent with the perovskite surfaces.

passivation↗
DOE OSTI2023

Optimized purification methods for metallic contaminant removal from directly recycled Li-ion battery cathodes

Metallic contaminants pose a significant challenge to the viability of directly recycling Li-ion batteries. To date, few strategies exist to selectively remove metallic impurities from mixtures of shredded end-of-life material (black mass; BM) without concurrently damaging the structure and electrochemical performance of the target active material. We herein present tailored methods to selectively ionize two major contaminants—Al and Cu—while retaining a representative cathode (LiNi 0.33 Mn 0.33 Co 0.33 O 2 ; NMC-111) intact. This BM purification process is conducted at moderate temperatures in a KOH-based solution matrix. We rationally evaluate approaches to increase both the kinetic corrosion rate and the thermodynamic solubility of Al 0 and Cu 0 , and evaluate the impact of these treatment conditions on the structure, chemistry, and electrochemical performance of NMC. Specifically, we explore the impacts of chloride-based salts, a strong chelating agent, elevated temperature, and sonication on the rate and extent of contaminant corrosion, while concurrently evaluating the effects on NMC. The reported BM purification process is then demonstrated on samples of “simulated BM” containing a practically relevant 1 wt% concentration of Al or Cu. Increasing the kinetic energy of the purifying solution matrix through elevated temperature and sonication accelerates the corrosion of metallic Al and Cu, such that ∼100% corrosion of 75 μm Al and Cu particles is achieved within 2.5 hr. Further, we determine that effective mass transport of ionized species critically impacts the efficacy of Cu corrosion, and that saturated Cl – hinders rather than accelerates Cu corrosion by increasing solution viscosity and introducing competitive pathways for Cu surface passivation. The purification conditions do not induce bulk structural damage to NMC, and electrochemical capacity is maintained in half-cell format. Testing in full cells suggests that a limited quantity of residual surface species are present after treatment, which initially disrupt electrochemical behavior at the graphite anode but are subsequently consumed. Process demonstration on simulated BM suggests that contaminated samples—which prior to treatment show catastrophic electrochemical performance—can be recovered to pristine electrochemical capacity. The reported BM purification method offers a compelling and commercially viable solution to address contamination, particularly in the “fine” fraction of BM where contaminant sizes are on the same order of magnitude as NMC and where traditional separation approaches are unfeasible. Thus, this optimized BM purification technique offers a pathway towards viable direct recycling of BM feedstocks that would otherwise be unusable.

25 ENERGY STORAGE↗
DOE OSTI2022

Methods of recovering lignin and other products from biomass

Methods of recovering lignin products and other products from biomass. The method comprises adding a chemical agent to a stored biomass comprising lignin to form a chemically-treated biomass. The chemical agent comprises an acid, a base, an inorganic salt, or a combination of the inorganic salt and one of the acid or the base. The chemically-treated biomass is stored under anaerobic conditions. Lignin products, such as high molecular weight lignin, medium molecular weight lignin, or low molecular weight lignin, are recovered from the chemically-treated biomass. Additional methods of recovering lignin products and other products from biomass are disclosed.

09 BIOMASS FUELS↗
DOE OSTI2022

PowerNet: Multi-agent Deep Reinforcement Learning for Scalable Powergrid Control

This paper develops an efficient multi-agent deep reinforcement learning algorithm for cooperative controls in powergrids. Specifically, we consider the decentralized inverter-based secondary voltage control problem in distributed generators (DGs), which is first formulated as a cooperative multi-agent reinforcement learning (MARL) problem. We then propose a novel on-policy MARL algorithm, PowerNet, in which each agent (DG) learns a control policy based on (sub-)global reward but local states and encoded communication messages from its neighbors. Motivated by the fact that a local control from one agent has limited impact on agents distant from it, we exploit a novel spatial discount factor to reduce the effect from remote agents, to expedite the training process and improve scalability. Furthermore, a differentiable, learning-based communication protocol is employed to foster the collaborations among neighboring agents. In addition, to mitigate the effects of system uncertainty and random noise introduced during on-policy learning, we utilize an action smoothing factor to stabilize the policy execution. To facilitate training and evaluation, we develop PGSim, an efficient, high-fidelity powergrid simulation platform. Here, experimental results in two microgrid setups show that the developed PowerNet outperforms the conventional model-based control method, as well as several state-of-the-art MARL algorithms. The decentralized learning scheme and high sample efficiency also make it viable to large-scale power grids.

24 POWER TRANSMISSION AND DISTRIBUTION↗