Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Agents”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,621 records · Page 90
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Two disulfide-reducing pathways are required for the maturation of plastid c -type cytochromes in Chlamydomonas reinhardtii

Abstract In plastids, conversion of light energy into ATP relies on cytochrome f, a key electron carrier with a heme covalently attached to a CXXCH motif. Covalent heme attachment requires reduction of the disulfide-bonded CXXCH by CCS5 and CCS4. CCS5 receives electrons from the oxidoreductase CCDA, while CCS4 is a protein of unknown function. In Chlamydomonas reinhardtii, loss of CCS4 or CCS5 yields a partial cytochrome f assembly defect. Here, we report that the ccs4ccs5 double mutant displays a synthetic photosynthetic defect characterized by a complete loss of holocytochrome f assembly. This defect is chemically corrected by reducing agents, confirming the placement of CCS4 and CCS5 in a reducing pathway. CCS4-like proteins occur in the green lineage, and we show that HCF153, a distant ortholog from Arabidopsis thaliana, can substitute for Chlamydomonas CCS4. Dominant suppressor mutations mapping to the CCS4 gene were identified in photosynthetic revertants of the ccs4ccs5 mutants. The suppressor mutations yield changes in the stroma-facing domain of CCS4 that restore holocytochrome f assembly above the residual levels detected in ccs5. Because the CCDA protein accumulation is decreased specifically in the ccs4 mutant, we hypothesize the suppressor mutations enhance the supply of reducing power through CCDA in the absence of CCS5. We discuss the operation of a CCS5-dependent and a CCS5-independent pathway controlling the redox status of the heme-binding cysteines of apocytochrome f.

Genetics & Heredity↗
DOE OSTI2024

Human-in-the-Loop: The Future of Machine Learning in Automated Electron Microscopy

Machine learning (ML) methods are progressively gaining acceptance in the electron microscopy community for de-noising, semantic segmentation, and dimensionality reduction of data post-acquisition. The introduction of the application programming interfaces (APIs) by major instrument manufacturers now allows the deployment of ML workflows in microscopes, not only for data analytics but also for real-time decision-making and feedback for microscope operation. However, the number of use cases for real-time ML remains remarkably small. Furthermore, we discuss some considerations in designing ML-based active experiments and pose that the likely strategy for the next several years will be human-in-the-loop automated experiments (hAE). In this paradigm, the ML learning agent directly controls beam position and image and spectroscopy acquisition functions, and a human operator monitors experiment progression in real and feature space of the system and tunes the policies of the ML agent to steer the experiment toward specific objectives.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Regeneration of critical-sized defects, in a goat model, using a dextrin-based hydrogel associated with granular synthetic bone substitute

Abstract The development of injectable bone substitutes (IBS) have obtained great importance in the bone regeneration field, as a strategy to reach hardly accessible defects using minimally invasive techniques and able to fit to irregular topographies. In this scenario, the association of injectable hydrogels and bone graft granules is emerging as a well-established trend. Particularly, in situ forming hydrogels have arisen as a new IBS generation. An in situ forming and injectable dextrin-based hydrogel (HG) was developed, aiming to act as a carrier of granular bone substitutes and bioactive agents. In this work, the HG was associated to a granular bone substitute (Bonelike®) and implanted in goat critical-sized calvarial defects (14 mm) for 3, 6 and 12 weeks. The results showed that HG improved the handling properties of the Bonelike® granules and did not affect its osteoconductive features, neither impairing the bone regeneration process. Human multipotent mesenchymal stromal cells from the umbilical cord, extracellular matrix hydrolysates and the pro-angiogenic peptide LLKKK18 were also combined with the IBS. These bioactive agents did not enhance the new bone formation significantly under the conditions tested, according to micro-computed tomography and histological analysis.

Pereira, Isabel↗
DOE OSTI2022

DNA Sequence-Based Identification of Fusarium : A Work in Progress

Accurate species-level identification of an etiological agent is crucial for disease diagnosis and management because knowing the agent’s identity connects it with what is known about its host range, geographic distribution, and toxin production potential. This is particularly true in publishing peer-reviewed disease reports, where imprecise and/or incorrect identifications weaken the public knowledge base. This can be a daunting task for phytopathologists and other applied biologists that need to identify Fusarium in particular, because published and ongoing multilocus molecular systematic studies have highlighted several confounding issues. Paramount among these are: (i) this agriculturally and clinically important genus is currently estimated to comprise more than 400 phylogenetically distinct species (i.e., phylospecies), with more than 80% of these discovered within the past 25 years; (ii) approximately one-third of the phylospecies have not been formally described; (iii) morphology alone is inadequate to distinguish most of these species from one another; and (iv) the current rapid discovery of novel fusaria from pathogen surveys and accompanying impact on the taxonomic landscape is expected to continue well into the foreseeable future. To address the critical need for accurate pathogen identification, our research groups are focused on populating two web-accessible databases (FUSARIUM-ID v.3.0 and the nonredundant National Center for Biotechnology Information nucleotide collection that includes GenBank) with portions of three phylogenetically informative genes (i.e., TEF1, RPB1, and RPB2) that resolve at or near the species level in every Fusarium species. The objectives of this Special Report, and its companion in this issue ( Torres-Cruz et al. 2022 ), are to provide a progress report on our efforts to populate these databases and to outline a set of best practices for DNA sequence-based identification of fusaria.

Plant Sciences↗
DOE OSTI2020

Elucidating Anthracnose Resistance Mechanisms in Sorghum—A Review

Sorghum (Sorghum bicolor) is the fifth most cultivated cereal crop in the world, traditionally providing food, feed, and fodder, but more recently also fermentable sugars for the production of renewable fuels and chemicals. The hemibiotrophic fungal pathogen Colletotrichum sublineola, the causal agent of anthracnose disease in sorghum, is prevalent in the warm and humid climates where much of the sorghum is cultivated and poses a serious threat to sorghum production. The use of anthracnose-resistant sorghum germplasm is the most environmentally and economically sustainable way to protect sorghum against this pathogen. Even though multiple anthracnose resistance loci have been mapped in diverse sorghum germplasm in recent years, the diversity in C. sublineola pathotypes at the local and regional levels means that these resistance genes are not equally effective in different areas of cultivation. This review summarizes the genetic and cytological data underlying sorghum’s defense response and describes recent developments that will enable a better understanding of the interactions between sorghum and C. sublineola at the molecular level. This includes releases of the sorghum genome and the draft genome of C. sublineola, the use of next-generation sequencing technologies to identify gene expression networks activated in response to infection, and improvements in methodologies to validate resistance genes, notably virus-induced and transgenic gene silencing approaches.

Plant Sciences↗
DOE OSTI2020

Chelation Modeling: The Use of Ad Hoc Models and Approaches to Overcome a Dose Assessment Challenge

Here, chelating agents are administered to treat significant intakes of radioactive elements such as plutonium, americium, and curium. These drugs may be used as a medical countermeasure after radiological accidents and terrorist acts. The administration of a chelating agent, such as Ca-DTPA or Zn-DTPA, affects the actinide's normal biokinetics. It enhances the actinide's rate of excretion, posing a dose assessment challenge. Thus, the standard biokinetic models cannot be directly applied to the chelation-affected bioassay data in order to assess the radiation dose. The present study reviews the scientific literature, from the early 1970s until the present, on the different studies that focused on developing new chelation models and/or modeling of bioassay data affected by chelation treatment. Although scientific progress has been achieved, there is currently no consensus chelation model available, even after almost 50 y of research. This review acknowledges the efforts made by different research groups, highlighting the different methodology used in some of these studies. Finally, this study puts into perspective where we were, where we are, and where we are heading in regards to chelation modeling.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2020

Compromise of Personal Protective Clothing from Liquid Exposure

Following critiques of multiple personal contamination events from entries into the Oak Ridge National Laboratory’s Spallation Neutron Source transfer bay, it was considered that the most likely causes for contamination were personal protective clothing doffing errors or that moisture (sweat) allowed contamination to wick through the protective clothing. To pursue this issue, radiological protection staff looked more closely, however, at the specific area of the clothing where contamination was highest; under enhanced lighting and photochromic manipulation, there appeared to have been some type of moisture in the area. Recognizing the possibility that moisture may have allowed for migration of contamination through the clothing, further experiments were undertaken to determine under which conditions this transport might have occurred. The objective for this work was to identify the susceptibility of different types of personal protective clothing to various liquids encountered in the workplace.Method: Several tests were performed to determine if perspiration had enabled migration of contamination, and to identify what other liquids might have affected contamination transport. Two layers of personal protective clothing were subjected to static conditions and dynamic conditions, to include active rubbing of the materials while wet. Food dye added to each of the liquids tested enabled visual indications of liquid breakthrough. Additional tests were conducted to see if solid contamination could be transported through the materials along with the liquids. As a result, it was found that all but one type of non-rubberized personal protective clothing in use at Oak Ridge National Laboratory were permanently compromised to some extent by the solvents used for decontamination. It was determined that most common cleaning agents immediately and permanently destroyed the hydrophobic nature of several of the splash-resistant protective clothing materials, allowing for radioactive contamination to penetrate through the material to the worker. Work around wet surfaces or performing wet decontamination will only be performed in protective clothing known to prevent transport of the wetting agent.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2025

Graph reinforcement learning for exploring model spaces beyond the standard model

We present a methodology for performing scans of beyond the standard model (BSM) parameter spaces with reinforcement learning. We identify a novel procedure using graph neural networks that is capable of exploring spaces of models without the user specifying a fixed particle content, allowing broad classes of BSM models to be explored—in theory, the technique is applicable to nearly any model space with a prespecified gauge group. We provide a generic procedure by which a suitable graph grammar can be developed for any BSM model that features user-specified symmetry groups and a finite number of different possible particle species, the use of which is applicable to a variety of machine learning tasks over the actions of BSM theories beyond our particular reinforcement learning use case. As a proof of concept, we construct the graph grammar for theories with vectorlike leptons that may or may not be charged under a dark U ( 1 ) group, inspired by portal matter extensions of the sub-GeV vector portal/kinetic mixing simplified dark matter models. We then use this graph grammar to create a reinforcement learning environment tasked with creating models with these vectorlike leptons that are consistent with a list of a variety of precision observables. The reinforcement learning agent succeeds in developing models that can address the observed muon anomalous magnetic moment discrepancy while remaining consistent with flavor violation and electroweak precision observables, including both constructions that have previously been studied as well as new models that have not, to our knowledge, previously been identified. By inspecting the resulting ensembles of models that the agent produces and experimenting with different configurations for our reinforcement learning environment and graph grammar, we also infer various lessons about the development of these environments that can be transferable to reinforcement learning scans of more complicated model spaces and comment on future directions for the development of this technique into a more mature tool. Published by the American Physical Society 2025

Wojcik, George N.↗
DOE OSTI2020

Deep reinforcement learning for complex evaluation of one-loop diagrams in quantum field theory

In this paper we present a technique based on deep reinforcement learning that allows for numerical analytic continuation of integrals that are often encountered in one-loop diagrams in quantum field theory. To extract certain quantities of two-point functions, such as spectral densities, mass poles or multiparticle thresholds, it is necessary to perform an analytic continuation of the correlator in question. At one-loop level in Euclidean space, this results in the necessity to deform the integration contour of the loop integral in the complex plane of the square of the loop momentum, to avoid nonanalyticities in the integration plane. Using a toy model for which an exact solution is known, we train a reinforcement learning agent to perform the required contour deformations. We report our study shows great promise for an agent to be deployed in iterative numerical approaches used to compute nonperturbative two-point functions, such as the quark propagator Dyson-Schwinger equation, or more generally, Fredholm equations of the second kind, in the complex domain.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Microwave-Free Dynamic Nuclear Polarization via Sudden Thermal Jumps

Dynamic nuclear polarization (DNP) presently stands as the preferred strategy to enhance the sensitivity of nuclear magnetic resonance measurements, but its application relies on the use of high-frequency microwave to manipulate electron spins, an increasingly demanding task as the applied magnetic field grows. Here we investigate the dynamics of a system hosting a polarizing agent formed by two distinct paramagnetic centers near a level anticrossing. We theoretically show that nuclear spins polarize efficiently under a cyclic protocol that combines alternating thermal jumps and radio-frequency pulses connecting hybrid states with opposite nuclear and electronic spin alignment. Central to this process is the difference between the spin-lattice relaxation times of either electron spin species, transiently driving the electronic spin bath out of equilibrium after each thermal jump. Without the need for microwave excitation, this route to enhanced nuclear polarization may prove convenient, particularly if the polarizing agent is designed to feature electronic level anticrossings at high magnetic fields.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Redundantly Amplified Information Suppresses Quantum Correlations in Many-Body Systems

We establish bounds on quantum correlations in many-body systems. They reveal what sort of information about a quantum system can be simultaneously recorded in different parts of its environment. Specifically, independent agents who monitor environment fragments can eavesdrop only on amplified and redundantly disseminated—hence, effectively classical—information about the decoherence-resistant pointer observable. We also show that the emergence of classical objectivity is signaled by a distinctive scaling of the conditional mutual information, bypassing hard numerical optimizations. Our results validate the core idea of quantum Darwinism: objective classical reality does not need to be postulated and is not accidental, but rather a compelling emergent feature of quantum theory that otherwise—in the absence of decoherence and amplification—leads to “quantum weirdness.” In particular, a lack of consensus between agents that access environment fragments is bounded by the information deficit, a measure of the incompleteness of the information about the system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Power-Law Entanglement and Hilbert Space Fragmentation in Nonreciprocal Quantum Circuits

Quantum circuits utilizing measurement to evolve a quantum wave function offer a new and rich playground to engineer unconventional entanglement dynamics. Here, in this work, we introduce a hybrid, nonreciprocal setup featuring a quantum circuit, whose updates are conditioned on the state of a classical dynamical agent. In our example the circuit is represented by a Majorana quantum chain controlled by a classical N-state Potts chain undergoing pair flips. The local orientation of the classical spins controls whether randomly drawn local measurements on the quantum chain are allowed or not. This imposes a dynamical kinetic constraint on the entanglement growth, described by the transfer matrix of an N-colored loop model. It yields an equivalent description of the circuit by an SU(N)-symmetric Temperley-Lieb Hamiltonian or by a kinetically constrained surface growth model for an N-component height field. For N = 2, we find a diffusive growth of the half-chain entanglement toward a stationary profile S(L) ~ L 1/2 for L sites. For N ≥ 3, the kinetic constraints impose Hilbert space fragmentation, yielding subdiffusive growth toward S(L) ~ L 0.57 . This showcases how the control by a classical dynamical agent can enrich the entanglement dynamics in quantum circuits, paving a route toward novel entanglement dynamics in nonreciprocal hybrid circuit architectures.

1-dimensional spin chains↗
DOE OSTI2024

Cyber-Secure and Safe Operation of Solar Photovoltaic Power Distribution Systems

Solar photovoltaic (PV)-rich power distribution systems are networked Cyber-Physical Systems (CPS). These are control systems where multiple computing nodes and diverse intelligent agents interact with the physical world in real-time. However, the presence of networked components renders them vulnerable to potential cyber-attacks, cyber-intrusions, and other malicious events. This is because these systems depend on the measurements reported from their heterogeneous sensors. This makes them vulnerable to potential cyber-attacks where malicious agents can compromise the sensors or the communication networks carrying the sensor measurements. This paper proposes a novel methodology for enhancing the cyber-security and cyber-resilient post-attack safe operation of solar PV-rich power distribution systems against potential cyber-attacks through the Dynamic Watermarking (DW), using online system identification. The resiliency of the proposed technique is tested and validated with several attack scenarios on both a lab-scale 3kW grid-connected PV inverter and a Hardware-in-the-Loop (HiL) system. The proposed approach can be applied to other types of power distribution systems to enhance their cyber-secure and cyber-resilient safe operation. This paper thereby contributes to the field of cyber-security of Cyber-Physical Energy Systems (CPES).

Kim, Jaewon↗
DOE OSTI2024

A Privacy Preserving Distributed Model Identification Algorithm for Power Distribution Systems

Distributed control/optimization is a promising approach for network systems due to its advantages over centralized schemes, such as robustness, cost-effectiveness, and improved privacy. However, distributed methods can have drawbacks, such as slower convergence rates due to limited knowledge of the overall network model. Additionally, ensuring privacy in the communication of sensitive information can pose implementation challenges. To address this issue, we propose a distributed model identification algorithm that enables each agent to identify the sub-model that characterizes the relationship between its local control and the overall system outputs. The proposed algorithm maintains the privacy of local agents by only communicating through dummy variables. We demonstrate the efficacy of our algorithm in the context of power distribution systems by applying it to the voltage regulation of a modified IEEE distribution system. The proposed algorithm is well-suited to the needs of power distribution controls and offers an effective solution to the challenges of distributed model identification in network systems.

data-driven modeling↗
DOE OSTI2022

Volt-VAR Optimization in Distribution Networks Using Twin Delayed Deep Reinforcement Learning

Modern distribution grids are undergoing new challenges due to the stochastic nature of distributed energy resources (DERs). High penetration of DERs has a significant impact on Volt-VAR profile and system power losses. This work proposes a deep reinforcement learning (DRL)-based Volt-VAR optimization approach for improving voltage profile and reducing system power loss under high penetration of distributed energy resources, such as battery energy storage and solar photovoltaic units in distribution grids. The twin delayed deep deterministic policy gradient (TD3) method-based DRL agent is proposed to configure optimal set-points of reactive power outputs of fast responding smart inverters. The agent schedules the reactive power of inverters according to their physical capabilities, such as minimum allowed power factor, e.g., 0.9 leading/lagging. The reward function of the proposed DRL scheme is designed carefully to ensure a proper voltage profile of the grids with effective scheduling of reactive power outputs from inverters. The performance of the proposed model is verified on modified IEEE 34- and 123-bus systems and compared with base case with no reactive supply by inverters, and local droop Volt-VAR control approach. The results show that the proposed method performs better than the local droop control and deep deterministic policy gradient (DDPG)-based DRL method for reducing voltage fluctuation and minimizing power loss.

Hossain, Rakib↗
DOE OSTI2021

A Cyber-Physical System for Freeway Ramp Meter Signal Control Using Deep Reinforcement Learning in a Connected Environment

Freeway bottlenecks such as on-ramp merging areas account for about 40% of recurring freeway congestion. It is generally agreed that building more roads and adding more lanes to existing infrastructure does not solve the congestion problem, and so dynamic traffic control measures offer a more cost-effective alternative. Ramp meters, traffic signal devices that regulate traffic flow entering freeways, are among the most effective measures to mitigate congestion at on-ramp merging areas on freeways. The confluence of deep reinforcement learning (RL) and connectivity provides a possible solution to advance ramp meter signal control. Deep RL is a group of machine-learning methods that enables an agent learning from the environment to improve its performance. In this study, three deep RL methods-proximal policy optimization (PPO), Ape-X deep Q-network (DQN), and asynchronous advantage actor-critic agents (A3C)-are explored for ramp meter signal control to maximize vehicle speed and traffic throughput, as well as to minimize energy consumption and emissions at freeway on-ramp merging areas in a connected environment. The low computational requirement and scalability of deep RL for deployment make it a powerful optimization tool for time-sensitive applications such as ramp meter signal control. The results of this study show that deep RL methods yield superior performance to both a fixed-time controller and ALINE A, a state-of-the-art feedback controller.

ADVANCED PROPULSION SYSTEMS,MATHEMATICS AND COMPUT↗
DOE OSTI2025

Optimizing Traffic Signal Control to Enhance Transportation Efficiency and Maximize Pedestrian Benefits in the Road Network

Increasing urban mobility requirements demand efficient transportation system strategies for both vehicular and pedestrian movement. This study enhances the Decentralized Graph-based Multi-Agent Reinforcement Learning (DGMARL) approach, originally tailored for vehicular traffic signal timing, to incorporate pedestrian traffic dynamics. The improved algorithm considers crucial metrics such as Eco_PI, assesses vehicle fuel consumption by factoring in stops and delays, and addresses pedestrian waiting time, crucial for system efficiency while acknowledging driver waiting time impact. Utilizing Digital Twin simulation along the MLK Smart Corridor in Chattanooga, Tennessee, the algorithm's performance is compared for various pedestrian control scenarios. To evaluate the effectiveness of DGMARL, this study compared DGMARL-enabled signal management with automated pedestrian traffic detection and an actuated signal management system (real-word baseline) with pedestrian recall, which predetermingly enforces a pedestrian phase every cycle. Findings indicate substantial improvements with DGMARL, showing a 28.29% enhancement in vehicle Eco_PI, a 60.55 % reduction in pedestrian waiting time, and a 55.74% decrease in driver stop delay, on average, compared to the baseline actuated signal timing plan.

Kumarasamy, Vijayalakshmi K [The University of Ten↗
DOE OSTI2021

Quantitative Evaluation of Autonomous Driving in CARLA

There has been a great deal of recent advancements in end-to-end imitation and reinforcement learning for self-driving vehicles. Despite this, there is a severe lack of standardized metrics for evaluating the performance of autonomous self-driving agents. Existing metrics are generally lacking in their ability to capture a wide range of driving behaviors and compare the severity of different failure cases. In this work, we introduce the Quantitative Evaluation for Driving metric, or QED, which assigns a quantitative score from 0-100 that captures the quality of driving for any driving agent. Our QED metric assesses different aspects of driving behavior including the ability to stay in the center of the lane, avoid weaving and erratic behavior, follow the speed limit, and avoid collisions, and it can be used under a wide range of driving scenarios. To show the effectiveness of our QED metric, we compare the scores generated by QED against scores assigned by human evaluators on a total of 30 different drivers and 6 different towns in the CARLA driving simulator. In ``easy'' evaluation scenarios, where it is relatively straightforward to distinguish better drivers from worse drivers, QED attains an average Pearson correlation of 0.96 and average Spearman correlation of 0.97 when compared against human evaluators. In ``hard'' evaluation scenarios, where it is far more ambiguous how to rank/score different types of bad driving behavior, QED attains an average Pearson correlation of 0.82 and average Spearman correlation of 0.75 when compared against human evaluators, which are both slighter higher than when we compare human evaluators against each other. While QED may not capture every characteristic that defines good driving, we consider it an important foundation for reproducibility and standardization in the community.

Gao, Shang↗