Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Combatting melioidosis with chemical synthetic lethality

Burkholderia thailandensishas emerged as a nonpathogenic surrogate forBurkholderia pseudomallei, the causative agent of melioidosis, and an important Gram-negative model bacterium for studying the biosynthesis and regulation of secondary metabolism. We recently reported that subinhibitory concentrations of trimethoprim induce vast changes in both the primary and secondary metabolome ofB. thailandensis. In the current work, we show that the folate biosynthetic enzyme FolE2 is permissive under standard growth conditions but essential forB. thailandensisin the presence of subinhibitory doses of trimethoprim. Reasoning that FolE2 may serve as an attractive drug target, we screened for and identified ten inhibitors, including dehydrocostus lactone (DHL), parthenolide, and β-lapachone, all of which are innocuous individually but form a chemical-synthetic lethal combination with subinhibitory doses of trimethoprim. We show that DHL is a mechanism-based inhibitor of FolE2 and capture the structure of the covalently inhibited enzyme using X-ray crystallography. In vitro, the combination of subinhibitory trimethoprim and DHL is more potent than Bactrim, the current standard of care against melioidosis. Moreover, unlike Bactrim, this combination does not affect the growth of most commensal and beneficial gut bacteria tested, thereby providing a degree of specificity againstB. pseudomallei. Our work provides a path for identifying antimicrobial drug targets and for utilizing binary combinations of molecules that form a toxic cocktail based on metabolic idiosyncrasies of specific pathogens.

Science & Technology - Other Topics↗
DOE OSTI2024

Linking Threat Agents to Targeted Organizations: A Pipeline for Enhanced Cybersecurity Risk Metrics

In this study, we present a methodology leveraging Large Language Models (LLMs) to transform Cybersecurity Threat Intelligence (CTI) narratives into actionable insights for individual organizations. Our approach automates the extraction of machine-readable adversary SKRAM (Skills, Knowledge, Resources, Authorities, and Motivation) attributes from open-source reports, extending LLM utility beyond typical interactions. This innovation enables precise, automated assessments of cybersecurity risks posed by various adversaries. Using a chain-of-thought and multi-shot prompting strategy, our methodology advances the automation of cybersecurity feature extraction for new machine-learning models that predict the risk of adversary targeting. This approach is refined using a substantial dataset of over 150 analyst-validated threat reports and synthetic organizational data from 900 companies. Here, by bootstrapping the training data with a rule-based heuristic over synthetic data, we have developed a high-accuracy machine-learning model that allows entities to dynamically prioritize threats and defensive actions.

Cyber Threat Intelligence↗
DOE OSTI2024

Extreme Risk Mitigation in Reinforcement Learning using Extreme Value Theory

Risk-sensitive reinforcement learning (RL) has garnered significant attention in recent years due to the growing interest in deploying RL agents in real-world scenarios. A critical aspect of risk awareness involves modelling highly rare risk events (rewards) that could potentially lead to catastrophic outcomes. These infrequent occurrences present a formidable challenge for data-driven methods aiming to capture such risky events accurately. While risk-aware RL techniques do exist, they suffer from high variance estimation due to the inherent data scarcity. Our work proposes to enhance the resilience of RL agents when faced with very rare and risky events by focusing on refining the predictions of the extreme values predicted by the state-action value distribution. To achieve this, we formulate the extreme values of the state-action value function distribution as parameterized distributions, drawing inspiration from the principles of extreme value theory (EVT). We propose an extreme value theory based actor-critic approach, namely, Extreme Valued Actor-Critic (EVAC) which effectively addresses the issue of infrequent occurrence by leveraging EVT-based parameterization. Importantly, we theoretically demonstrate the advantages of employing these parameterized distributions in contrast to other risk-averse algorithms. Our evaluations show that the proposed method outperforms other risk averse RL algorithms on a diverse range of benchmark tasks, each encompassing distinct risk scenarios.

Wang, Yu↗
DOE OSTI2022

Quantum model learning agent: characterisation of quantum systems through machine learning

Accurate models of real quantum systems are important for investigating their behaviour, yet are difficult to distil empirically. Here, we report an algorithm—the quantum model learning agent (QMLA)—to reverse engineer Hamiltonian descriptions of a target system. We test the performance of QMLA on a number of simulated experiments, demonstrating several mechanisms for the design of candidate Hamiltonian models and simultaneously entertaining numerous hypotheses about the nature of the physical interactions governing the system under study. QMLA is shown to identify the true model in the majority of instances, when provided with limited a priori information, and control of the experimental setup. Our protocol can explore Ising, Heisenberg and Hubbard families of models in parallel, reliably identifying the family which best describes the system dynamics. We demonstrate QMLA operating on large model spaces by incorporating a genetic algorithm to formulate new hypothetical models. The selection of models whose features propagate to the next generation is based upon an objective function inspired by the Elo rating scheme, typically used to rate competitors in games such as chess and football. In all instances, our protocol finds models that exhibit F 1 score ≥ 0.88 when compared with the true model, and it precisely identifies the true model in 72% of cases, whilst exploring a space of over 250 000 potential models. By testing which interactions actually occur in the target system, QMLA is a viable tool for both the exploration of fundamental physics and the characterisation and calibration of quantum devices.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Curriculum-based Reinforcement Learning for Distribution System Critical Load Restoration

This paper focuses on the critical load restoration problem in distribution systems following major outages. To provide fast online response and optimal sequential decision-making support, a reinforcement learning (RL) based approach is proposed to optimize the restoration. Due to the complexities stemming from the large policy search space, renewable uncertainty, and nonlinearity in a complex grid control problem, directly applying RL algorithms to train a satisfactory policy requires extensive tuning to be successful. To address this challenge, this paper leverages the curriculum learning (CL) technique to design a training curriculum involving a simpler steppingstone problem that guides the RL agent to learn to solve the original hard problem in a progressive and more effective manner. We demonstrate that compared with direct learning, CL facilitates controller training to achieve better performance. To study realistic scenarios where renewable forecasts used for decision-making are in general imperfect, the experiments compare the trained RL controllers against two model predictive controllers (MPCs) using renewable forecasts with different error levels and observe how these controllers can hedge against the uncertainty. Results show that RL controllers are less susceptible to forecast errors than the baseline MPCs and can provide a more reliable restoration process.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Robustness of cement-based materials: From dosage variations to yield stress fluctuations

The idea behind the present work is to assess robustness of fresh cement-based materials (i.e. their ability to display the same properties when submitted to variations in the way they are produced) from a generic and analytical point of view. First, analytical models from literature relating components proportions and yield stress are combined into a multi-scale and physical approach and compared to our experimental yield stress measurements. In the second part, the derivation of these analytical relationships is used to assess robustness as a function of components proportions, which allows for the most sensitive variations to be mapped onto component dosage from a yield stress point of view. In the case of fluid concretes, this approach showcases the interest of working at slightly higher water content and slightly lower aggregates fraction along with benefits of viscosity modifying agents / plasticizers combination.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Genome Sequence of the Chestnut Blight Fungus Cryphonectria parasitica EP155: A Fundamental Resource for an Archetypical Invasive Plant Pathogen

Cryphonectria parasitica is the causal agent of chestnut blight, a fungal disease that almost entirely eliminated mature American chestnut from North America over a 50-year period. Here, we formally report the genome of C. parasitica EP155 using a Sanger shotgun sequencing approach. After finishing and integration with simple-sequence repeat markers, the assembly was 43.8 Mb in 26 scaffolds (L 50 = 5; N 50 = 4.0Mb). Eight chromosomes are predicted: five scaffolds have two telomeres and six scaffolds have one telomere sequence. In total, 11,609 gene models were predicted, of which 85% show similarities to other proteins. Finally, this genome resource has already increased the utility of a fundamental plant pathogen experimental system through new understanding of the fungal vegetative incompatibility system, with significant implications for enhancing mycovirus-based biological control.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Blockchain for Fault-Tolerant Grid Operations Version 2.0

This report explores the potential of distributed ledger technology (DLT) as a transformative tool to enhance fault-tolerant operations in electrical distribution systems. Leveraging DLT's core attributes, including an immutable decentralized ledger, distributed consensus mechanisms, and state replication capabilities, this study focuses on three critical use cases. A central aspect of this research centers on the utilization of a consensus-driven ledger, providing actors within the system, such as distributed resources, with access to a reliable data repository. This empowers these actors to collaborate effectively and make informed decisions, all securely recorded on the blockchain. The first use case concentrates on data configuration, utilizing mathematical criteria---particularly, the chi-squared test for gross error detection---to identify trustworthy sensors for advanced decision-making. Building upon this foundation of trust, the second use case, topology identification, accurately determines circuit breaker states, unveiling the distribution network's topology. Ultimately, the third use case leverages this trust to execute switching actions, reconfiguring feeders and restoring power to disconnected customers after fault events. The concept of trust serves as a cornerstone in this approach, marking a departure from traditional fault location, isolation, and service restoration (FLISR) methods. Additionally, the blockchain-based architecture introduces decentralization, empowering disconnected areas to make autonomous decisions, even when communication with a central control center is disrupted. The primary contributions of this report are twofold: (1) a novel approach for evaluating distribution system voltage areas while preserving data ownership and (2) the implementation of interactions between distribution network areas using the actor model. Unlike the previous sequential approach for evaluating the area connection voltages, which required a radial network topology, this study's area model reduction enables a more versatile approach. The area model reduction addresses issues of prolonged data waiting times and multiple points of failure within the previous approach. Notably, the presented evaluation for the reduced network model area connection reveals a significant increase in the differences in voltage magnitudes. Simulation and evaluation of area agents across four distinct cases elucidate the area-level interaction behavior during a fault event. Simulations demonstrate that the proposed distributed FLISR (DFLISR) approach can successfully restore service to an affected area. Varying message delays and message loss probabilities in each simulation case underscore their impacts on restoration times, ranging from 3 min and 32 s to 6 min and 19 s. In contrast, power is not restored in an area in one of our simulation cases.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Resilient Control of Networked Microgrids Using Vertical Federated Reinforcement Learning: Designs and Real-Time Test-Bed Validations

Improving system-level resiliency of networked microgrids against adversarial cyber-attacks is an important aspect in the current regime of increased inverter-based resources (IBRs). To achieve that, this paper contributes in designing a hierarchical control layer, in conjunction with the existing control layers, resilient to adversarial attack signals. Considering model complexities, unknown dynamical behaviors of IBRs, and privacy issues regarding data sharing in multi-party-owned microgrids, designing such a control layer is non-trivial. Here, to tackle these issues, a novel federated reinforcement learning (Fed-RL) method is proposed. To grasp the interconnected dynamics of networked microgrids, the paper develops Federated Soft Actor-Critic (FedSAC) algorithm following the vertical structure of implementing Fed-RL. Next, utilizing the OpenAI Gym interface, we built a custom set-up in GridLAB-D/HELICS co-simulation platform, named Resilient RL Co-simulation (ResRLCoSIM), to train the RL agents with IEEE 123-bus benchmark comprising 3 interconnected microgrids. Finally, the learned policies in the simulation are transferred to the real-time hardware-in-the-loop (HIL) test-bed developed using the high-fidelity Hypersim platform. Finally, experiments show that the simulator-trained RL controllers achieve desirable performance with the test-bed platform, validating the minimization of the sim-to-real gap.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Sensor Development for Liquid Water Detection in Dry Storage Casks: FY 2023 Status

Modeling efforts were undertaken in fiscal year (FY) 2023 to evaluate the feasibility and capability for sensing of liquid water inside canister-based dry cask storage systems (DCSSs). The focus was on the development of full-scale finite element models (FEMs) of ultrasound propagation through DCSS canister components. For these initial investigations, simulation of the baseplate component was targeted, envisioning water collection at the bottom of a vertically oriented canister. The effects of internal canister components (i.e., fuel basket, fuel assemblies) on ultrasound propagation in the baseplate component were evaluated in these efforts. The environment inside a DCSS confinement is intended to be inert and free of water to prevent potential corrosion of used fuel cladding or other internal hardware. Spent fuel assemblies are dried, after storage in water pools, to make sure water has been removed from assembly cavities. However, there is some uncertainty about the amount of residual water potentially left behind in a DCSS after drying processes, because water can become trapped in cavities or other small crevices in the surfaces formed by the fuel cladding, fuel assemblies, and other internal hardware components. Considering the complex space- and time-dependent temperature profiles in DCSSs, water may be in a liquid or gas phase depending on its location in the cask and how long the cask has been in storage. Evacuating most water and oxidizing agents contained within a canister is recommended by NUREG-1536 (NRC 2010), which covers DCSSs. As summarized by Salazar et al. (2020), existing guidance typically relies on achievable vacuum pumping pressures sustained over a hold period as a signal of dryness and water removal. However, time series data about water removal from full-scale commercial drying procedures are lacking (Hanson and Alsaed 2019). A review of drying specifications from several vendors led to the conclusion that if the specifications are followed correctly, the residual moisture in DCSSs should present an insignificant risk of cladding degradation (Knoll and Gilbert 1987). A more recent analysis concluded that much larger quantities of residual water could remain in DCSSs, but the amount would still not be expected to lead to significant corrosion of fuel cladding or other internal components (Jung et al. 2013). Industry drying procedures are mostly prescriptive in nature, and operational issues arising during the process could result in incomplete drying. A summary of operational issues and potential negative effects of residual water is provided by Salazar et al. (2019). Experimental efforts are ongoing to validate the extent of water removal in a DCSS based on drying procedures used at nuclear power plants through well-designed investigations of drying process efficacy and water retention (Durbin et al. 2021; Pulido et al. 2022a, Pulido et al. 2022b). This has been approached by simulating limited portions of a DCSS internal volume and fuel assemblies. So far, these efforts have focused on the effects of potential water trapping in the dashpot region of control rod guide tubes but are expected to be expanded to include the effects of other internal hardware features and failed fuel rod cladding. A method for detection and measurement of liquid water (Meyer et al. 2022; Meyer et al. 2021), in tandem with the drying information gained through experimental investigations, provides comprehensive bases for understanding the internal conditions of DCSSs and provides technical information to support licensing decisions.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

A TOPAS model for lens-based proton radiography

Abstract Objective. Proton Radiography can be used in conjunction with proton therapy for patient positioning, real-time estimates of stopping power, and adaptive therapy in regions with motion. The modeling capability shown here can be used to evaluate lens-based radiography as an instantaneous proton-based radiographic technique. The utilization of user-friendly Monte Carlo program TOPAS enables collaborators and other users to easily conduct medical- and therapy- based simulations of the Los Alamos Neutron Science Center (LANSCE). The resulting transport model is an open-source Monte Carlo package for simulations of proton and heavy ion therapy treatments and concurrent particle imaging. Approach. The four-quadrupole, magnetic lens system of the 800-MeV proton beamline at LANSCE is modeled in TOPAS. Several imaging and contrast objects were modelled to assess transmission at energies from 230–930 MeV and different levels of particle collimation. At different proton energies, the strength of the magnetic field was scaled according to βγ, the inverse product of particle relativistic velocity and particle momentum. Main results. Materials with high atomic number, Z, (gold, gallium, bone-equivalent) generated more contrast than materials with low-Z (water, lung-equivalent, adipose-equivalent). A 5-mrad collimator was beneficial for tissue-to-contrast agent contrast, while a 10-mrad collimator was best to distinguish between different high-Z materials. Assessment with a step-wedge phantom showed water-equivalent path length did not scale directly according to predicted values but could be mapped more accurately with calibration. Poor image quality was observed at low energies (230 MeV), but improved as proton energy increased, with sub-mm resolution at 630 MeV. Significance. Proton radiography becomes viable for shallow bone structures at 330 MeV, and for deeper structures at 630 MeV. Visibility improves with use of high-Z contrast agents. This modality may be particularly viable at carbon therapy centers with accelerators capable of delivering high energy protons and could be performed with carbon therapy.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Reinforcement learning pulses for transmon qubit entangling gates

The utility of a quantum computer is highly dependent on the ability to reliably perform accurate quantum logic operations. For finding optimal control solutions, it is of particular interest to explore model-free approaches, since their quality is not constrained by the limited accuracy of theoretical models for the quantum processor—in contrast to many established gate implementation strategies. In this work, we utilize a continuous control reinforcement learning algorithm to design entangling two-qubit gates for superconducting qubits; specifically, our agent constructs cross-resonance and CNOT gates without any prior information about the physical system. Using a simulated environment of fixed-frequency fixed-coupling transmon qubits, we demonstrate the capability to generate novel pulse sequences that outperform the standard cross-resonance gates in both fidelity and gate duration, while maintaining a comparable susceptibility to stochastic unitary noise. We further showcase an augmentation in training and input information that allows our agent to adapt its pulse design abilities to drifting hardware characteristics, importantly, with little to no additional optimization. Our results exhibit clearly the advantages of unbiased adaptive-feedback learning-based optimization methods for transmon gate design.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

The safety of magnetic resonance imaging contrast agents

Gadolinium-based contrast agents are increasingly used in clinical practice. While these pharmaceuticals are verified causal agents in nephrogenic systemic fibrosis, there is a growing body of literature supporting their role as causal agents in symptoms associated with gadolinium exposure after intravenous use and encephalopathy following intrathecal administration. Gadolinium-based contrast agents are multidentate organic ligands that strongly bind the metal ion to reduce the toxicity of the metal. The notion that cationic gadolinium dissociates from these chelates and causes the disease is prevalent among patients and providers. We hypothesize that non-ligand-bound (soluble) gadolinium will be exceedingly low in patients. Soluble, ionic gadolinium is not likely to be the initial step in mediating any disease. The Kidney Institute of New Mexico was the first to identify gadolinium-rich nanoparticles in skin and kidney tissues from magnetic resonance imaging contrast agents in rodents. In 2023, they found similar nanoparticles in the kidney cells of humans with normal renal function, likely from contrast agents. We suspect these nanoparticles are the mediators of chronic toxicity from magnetic resonance imaging contrast agents. This article explores associations between gadolinium contrast and adverse health outcomes supported by clinical reports and rodent models.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Characterization of two affinity matured Anti-Yersinia pestis F1 human antibodies with medical countermeasure potential

Yersinia pestis , the causative agent of plague and a biological threat agent, presents an urgent need for novel medical countermeasures due to documented cases of naturally acquired antibiotic resistance and potential person-to-person spread during a pneumonic infection. Immunotherapy has been proposed as a way to circumvent current and future antibiotic resistance. Here, we describe the development and characterization of two affinity matured human antibodies (αF1Ig AM2 and αF1Ig AM8) that promote survival of mice after exposure to aerosolized Y . pestis . We share details of the error prone PCR and yeast display technology-based affinity maturation process that we used. The resultant matured antibodies have nanomolar affinity for Y . pestis F1 antigen, are produced in high yield, and are resilient to 37°C stress for up to 6 months. Importantly, in vitro assays using a murine macrophage cell line demonstrated that αF1Ig AM2 and αF1Ig AM8 are opsonic. Even more importantly, in vivo studies using pneumonic plague mouse models showed that 100% of the mice receiving 500 μg of IgGs αF1Ig AM2 and αF1Ig AM8 survived lethal challenge with aerosolized Y . pestis CO92. Combined, these results provide evidence of the quality and robustness of αF1Ig AM2 and αF1Ig AM8 and support their development as potential medical countermeasures against plague.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Tensorized Interior Radiative Heat Transfer for a Scalable and Calibrated Building Energy Simulator

Building energy simulation is a critical tool for developing and testing advanced control strategies, such as Reinforcement Learning (RL), to provide demand flexibility and affordable energy costs. The recently introduced Smart Buildings Control Suite (sbsim) provides a lightweight, scalable, and data-calibrated simulation environment based on a 2D finite-difference model. However, the initial model primarily focused on conductive and convective heat transfer, neglecting the significant impact of long-wave radiative heat exchange between interior surfaces. This paper presents a significant extension to the sbsim framework by incorporating a physically-grounded model for interior radiative heat transfer. Our primary contribution is the development and integration of a fully tensorized radiative heat transfer module, which preserves the computational efficiency and scalability of the original simulator. This was achieved by developing a pipeline for view factor calculation, including an algorithm to identify directly seeing surfaces within complex floor plans, and formulating the net radiation equations for efficient execution on modern hardware accelerators. We validate the numerical accuracy of our tensorized implementation by comparing its results against a traditional iterative approach, demonstrating identical outcomes. This enhancement increases the physical fidelity of sbsim, enabling more accurate training of RL agents for building energy optimization.

Ham, Sang woo↗
DOE OSTI2022

High-throughput platform for yeast morphological profiling predicts the targets of bioactive compounds

Abstract Morphological profiling is an omics-based approach for predicting intracellular targets of chemical compounds in which the dose-dependent morphological changes induced by the compound are systematically compared to the morphological changes in gene-deleted cells. In this study, we developed a reliable high-throughput (HT) platform for yeast morphological profiling using drug-hypersensitive strains to minimize compound use, HT microscopy to speed up data generation and analysis, and a generalized linear model to predict targets with high reliability. We first conducted a proof-of-concept study using six compounds with known targets: bortezomib, hydroxyurea, methyl methanesulfonate, benomyl, tunicamycin, and echinocandin B. Then we applied our platform to predict the mechanism of action of a novel diferulate-derived compound, poacidiene. Morphological profiling of poacidiene implied that it affects the DNA damage response, which genetic analysis confirmed. Furthermore, we found that poacidiene inhibits the growth of phytopathogenic fungi, implying applications as an effective antifungal agent. Thus, our platform is a new whole-cell target prediction tool for drug discovery.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Gating interactions steer loop conformational changes in the active site of the L1 metallo-β-lactamase

β-Lactam antibiotics are the most important and widely used antibacterial agents across the world. However, the widespread dissemination of β-lactamases among pathogenic bacteria limits the efficacy of β-lactam antibiotics. This has created a major public health crisis. The use of β-lactamase inhibitors has proven useful in restoring the activity of β-lactam antibiotics, yet, effective clinically approved inhibitors against class B metallo-β-lactamases are not available. L1, a class B3 enzyme expressed by Stenotrophomonas maltophilia , is a significant contributor to the β-lactam resistance displayed by this opportunistic pathogen. Structurally, L1 is a tetramer with two elongated loops, α3-β7 and β12-α5, present around the active site of each monomer. Residues in these two loops influence substrate/inhibitor binding. To study how the conformational changes of the elongated loops affect the active site in each monomer, enhanced sampling molecular dynamics simulations were performed, Markov State Models were built, and convolutional variational autoencoder-based deep learning was applied. The key identified residues (D150a, H151, P225, Y227, and R236) were mutated and the activity of the generated L1 variants was evaluated in cell-based experiments. The results demonstrate that there are extremely significant gating interactions between α3-β7 and β12-α5 loops. Taken together, the gating interactions with the conformational changes of the key residues play an important role in the structural remodeling of the active site. These observations offer insights into the potential for novel drug development exploiting these gating interactions.

59 BASIC BIOLOGICAL SCIENCES↗