Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Combatting melioidosis with chemical synthetic lethality

Burkholderia thailandensishas emerged as a nonpathogenic surrogate forBurkholderia pseudomallei, the causative agent of melioidosis, and an important Gram-negative model bacterium for studying the biosynthesis and regulation of secondary metabolism. We recently reported that subinhibitory concentrations of trimethoprim induce vast changes in both the primary and secondary metabolome ofB. thailandensis. In the current work, we show that the folate biosynthetic enzyme FolE2 is permissive under standard growth conditions but essential forB. thailandensisin the presence of subinhibitory doses of trimethoprim. Reasoning that FolE2 may serve as an attractive drug target, we screened for and identified ten inhibitors, including dehydrocostus lactone (DHL), parthenolide, and β-lapachone, all of which are innocuous individually but form a chemical-synthetic lethal combination with subinhibitory doses of trimethoprim. We show that DHL is a mechanism-based inhibitor of FolE2 and capture the structure of the covalently inhibited enzyme using X-ray crystallography. In vitro, the combination of subinhibitory trimethoprim and DHL is more potent than Bactrim, the current standard of care against melioidosis. Moreover, unlike Bactrim, this combination does not affect the growth of most commensal and beneficial gut bacteria tested, thereby providing a degree of specificity againstB. pseudomallei. Our work provides a path for identifying antimicrobial drug targets and for utilizing binary combinations of molecules that form a toxic cocktail based on metabolic idiosyncrasies of specific pathogens.

Science & Technology - Other Topics↗

Linking Threat Agents to Targeted Organizations: A Pipeline for Enhanced Cybersecurity Risk Metrics

In this study, we present a methodology leveraging Large Language Models (LLMs) to transform Cybersecurity Threat Intelligence (CTI) narratives into actionable insights for individual organizations. Our approach automates the extraction of machine-readable adversary SKRAM (Skills, Knowledge, Resources, Authorities, and Motivation) attributes from open-source reports, extending LLM utility beyond typical interactions. This innovation enables precise, automated assessments of cybersecurity risks posed by various adversaries. Using a chain-of-thought and multi-shot prompting strategy, our methodology advances the automation of cybersecurity feature extraction for new machine-learning models that predict the risk of adversary targeting. This approach is refined using a substantial dataset of over 150 analyst-validated threat reports and synthetic organizational data from 900 companies. Here, by bootstrapping the training data with a rule-based heuristic over synthetic data, we have developed a high-accuracy machine-learning model that allows entities to dynamically prioritize threats and defensive actions.

Cyber Threat Intelligence↗

Extreme Risk Mitigation in Reinforcement Learning using Extreme Value Theory

Risk-sensitive reinforcement learning (RL) has garnered significant attention in recent years due to the growing interest in deploying RL agents in real-world scenarios. A critical aspect of risk awareness involves modelling highly rare risk events (rewards) that could potentially lead to catastrophic outcomes. These infrequent occurrences present a formidable challenge for data-driven methods aiming to capture such risky events accurately. While risk-aware RL techniques do exist, they suffer from high variance estimation due to the inherent data scarcity. Our work proposes to enhance the resilience of RL agents when faced with very rare and risky events by focusing on refining the predictions of the extreme values predicted by the state-action value distribution. To achieve this, we formulate the extreme values of the state-action value function distribution as parameterized distributions, drawing inspiration from the principles of extreme value theory (EVT). We propose an extreme value theory based actor-critic approach, namely, Extreme Valued Actor-Critic (EVAC) which effectively addresses the issue of infrequent occurrence by leveraging EVT-based parameterization. Importantly, we theoretically demonstrate the advantages of employing these parameterized distributions in contrast to other risk-averse algorithms. Our evaluations show that the proposed method outperforms other risk averse RL algorithms on a diverse range of benchmark tasks, each encompassing distinct risk scenarios.

Wang, Yu↗

Aerosol Direct, Indirect, Semidirect, and Surface Albedo Effects from Sector Contributions Based on the IPCC AR5 Emissions for Preindustrial and Present-day Conditions

The anthropogenic increase in aerosol concentrations since preindustrial times and its net cooling effect on the atmosphere is thought to mask some of the greenhouse gas-induced warming. Although the overall effect of aerosols on solar radiation and clouds is most certainly negative, some individual forcing agents and feedbacks have positive forcing effects. Recent studies have tried to identify some of those positive forcing agents and their individual emission sectors, with the hope that mitigation policies could be developed to target those emitters. Understanding the net effect of multisource emitting sectors and the involved cloud feedbacks is very challenging, and this paper will clarify forcing and feedback effects by separating direct, indirect, semidirect and surface albedo effects due to aerosols. To this end, we apply the Goddard Institute for Space Studies climate model including detailed aerosol microphysics to examine aerosol impacts on climate by isolating single emission sector contributions as given by the Coupled Model Intercomparison Project Phase 5 (CMIP5) emission data sets developed for Intergovernmental Panel on Climate Change (IPCC) AR5. For the modeled past 150 years, using the climate model and emissions from preindustrial times to present-day, the total global annual mean aerosol radiative forcing is -0.6 W/m(exp 2), with the largest contribution from the direct effect (-0.5 W/m(exp 2)). Aerosol-induced changes on cloud cover often depends on cloud type and geographical region. The indirect (includes only the cloud albedo effect with -0.17 W/m(exp 2)) and semidirect effects (-0.10 W/m(exp 2)) can be isolated on a regional scale, and they often have opposing forcing effects, leading to overall small forcing effects on a global scale. Although the surface albedo effects from aerosols are small (0.016 W/m(exp 2)), triggered feedbacks on top of the atmosphere (TOA) radiative forcing can be 10 times larger. Our results point out that each emission sector has varying impacts by geographical region. For example, the single sector most responsible for a net positive radiative forcing is the transportation sector in the United States, agricultural burning and transportation in Europe, and the domestic emission sector in Asia. These sectors are attractive mitigation targets.

Bauer, Susanne E.↗

Quantum model learning agent: characterisation of quantum systems through machine learning

Accurate models of real quantum systems are important for investigating their behaviour, yet are difficult to distil empirically. Here, we report an algorithm—the quantum model learning agent (QMLA)—to reverse engineer Hamiltonian descriptions of a target system. We test the performance of QMLA on a number of simulated experiments, demonstrating several mechanisms for the design of candidate Hamiltonian models and simultaneously entertaining numerous hypotheses about the nature of the physical interactions governing the system under study. QMLA is shown to identify the true model in the majority of instances, when provided with limited a priori information, and control of the experimental setup. Our protocol can explore Ising, Heisenberg and Hubbard families of models in parallel, reliably identifying the family which best describes the system dynamics. We demonstrate QMLA operating on large model spaces by incorporating a genetic algorithm to formulate new hypothetical models. The selection of models whose features propagate to the next generation is based upon an objective function inspired by the Elo rating scheme, typically used to rate competitors in games such as chess and football. In all instances, our protocol finds models that exhibit F 1 score ≥ 0.88 when compared with the true model, and it precisely identifies the true model in 72% of cases, whilst exploring a space of over 250 000 potential models. By testing which interactions actually occur in the target system, QMLA is a viable tool for both the exploration of fundamental physics and the characterisation and calibration of quantum devices.

97 MATHEMATICS AND COMPUTING↗

Sensitivity Studies for Space-Based Global Measurements of Atmospheric Carbon Dioxide

Carbon dioxide (CO2) is well known as the primary forcing agent of global warming. Although the climate forcing due to CO2 is well known, the sources and sinks of CO2 are not well understood. Currently the lack of global atmospheric CO2 observations limits our ability to diagnose the global carbon budget (e.g., finding the so-called "missing sink") and thus limits our ability to understand past climate change and predict future climate response. Space-based techniques are being developed to make high-resolution and high-precision global column CO2 measurements. One of the proposed techniques utilizes the passive remote sensing of Earth's reflected solar radiation at the weaker vibration-rotation band of CO2 in the near infrared (approx. 1.57 micron). We use a line-by-line radiative transfer model to explore the potential of this method. Results of sensitivity studies for CO2 concentration variation and geophysical conditions (i.e., atmospheric temperature, surface reflectivity, solar zenith angle, aerosol, and cirrus cloud) will be presented. We will also present sensitivity results for an O2 A-band (approx. 0.76 micron) sensor that will be needed along with CO2 to make surface pressure and cloud height measurements.

Mao, Jian-Ping↗

Curriculum-based Reinforcement Learning for Distribution System Critical Load Restoration

This paper focuses on the critical load restoration problem in distribution systems following major outages. To provide fast online response and optimal sequential decision-making support, a reinforcement learning (RL) based approach is proposed to optimize the restoration. Due to the complexities stemming from the large policy search space, renewable uncertainty, and nonlinearity in a complex grid control problem, directly applying RL algorithms to train a satisfactory policy requires extensive tuning to be successful. To address this challenge, this paper leverages the curriculum learning (CL) technique to design a training curriculum involving a simpler steppingstone problem that guides the RL agent to learn to solve the original hard problem in a progressive and more effective manner. We demonstrate that compared with direct learning, CL facilitates controller training to achieve better performance. To study realistic scenarios where renewable forecasts used for decision-making are in general imperfect, the experiments compare the trained RL controllers against two model predictive controllers (MPCs) using renewable forecasts with different error levels and observe how these controllers can hedge against the uncertainty. Results show that RL controllers are less susceptible to forecast errors than the baseline MPCs and can provide a more reliable restoration process.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Robustness of cement-based materials: From dosage variations to yield stress fluctuations

The idea behind the present work is to assess robustness of fresh cement-based materials (i.e. their ability to display the same properties when submitted to variations in the way they are produced) from a generic and analytical point of view. First, analytical models from literature relating components proportions and yield stress are combined into a multi-scale and physical approach and compared to our experimental yield stress measurements. In the second part, the derivation of these analytical relationships is used to assess robustness as a function of components proportions, which allows for the most sensitive variations to be mapped onto component dosage from a yield stress point of view. In the case of fluid concretes, this approach showcases the interest of working at slightly higher water content and slightly lower aggregates fraction along with benefits of viscosity modifying agents / plasticizers combination.

36 MATERIALS SCIENCE↗

Genome Sequence of the Chestnut Blight Fungus Cryphonectria parasitica EP155: A Fundamental Resource for an Archetypical Invasive Plant Pathogen

Cryphonectria parasitica is the causal agent of chestnut blight, a fungal disease that almost entirely eliminated mature American chestnut from North America over a 50-year period. Here, we formally report the genome of C. parasitica EP155 using a Sanger shotgun sequencing approach. After finishing and integration with simple-sequence repeat markers, the assembly was 43.8 Mb in 26 scaffolds (L 50 = 5; N 50 = 4.0Mb). Eight chromosomes are predicted: five scaffolds have two telomeres and six scaffolds have one telomere sequence. In total, 11,609 gene models were predicted, of which 85% show similarities to other proteins. Finally, this genome resource has already increased the utility of a fundamental plant pathogen experimental system through new understanding of the fungal vegetative incompatibility system, with significant implications for enhancing mycovirus-based biological control.

59 BASIC BIOLOGICAL SCIENCES↗

Blockchain for Fault-Tolerant Grid Operations Version 2.0

This report explores the potential of distributed ledger technology (DLT) as a transformative tool to enhance fault-tolerant operations in electrical distribution systems. Leveraging DLT's core attributes, including an immutable decentralized ledger, distributed consensus mechanisms, and state replication capabilities, this study focuses on three critical use cases. A central aspect of this research centers on the utilization of a consensus-driven ledger, providing actors within the system, such as distributed resources, with access to a reliable data repository. This empowers these actors to collaborate effectively and make informed decisions, all securely recorded on the blockchain. The first use case concentrates on data configuration, utilizing mathematical criteria---particularly, the chi-squared test for gross error detection---to identify trustworthy sensors for advanced decision-making. Building upon this foundation of trust, the second use case, topology identification, accurately determines circuit breaker states, unveiling the distribution network's topology. Ultimately, the third use case leverages this trust to execute switching actions, reconfiguring feeders and restoring power to disconnected customers after fault events. The concept of trust serves as a cornerstone in this approach, marking a departure from traditional fault location, isolation, and service restoration (FLISR) methods. Additionally, the blockchain-based architecture introduces decentralization, empowering disconnected areas to make autonomous decisions, even when communication with a central control center is disrupted. The primary contributions of this report are twofold: (1) a novel approach for evaluating distribution system voltage areas while preserving data ownership and (2) the implementation of interactions between distribution network areas using the actor model. Unlike the previous sequential approach for evaluating the area connection voltages, which required a radial network topology, this study's area model reduction enables a more versatile approach. The area model reduction addresses issues of prolonged data waiting times and multiple points of failure within the previous approach. Notably, the presented evaluation for the reduced network model area connection reveals a significant increase in the differences in voltage magnitudes. Simulation and evaluation of area agents across four distinct cases elucidate the area-level interaction behavior during a fault event. Simulations demonstrate that the proposed distributed FLISR (DFLISR) approach can successfully restore service to an affected area. Varying message delays and message loss probabilities in each simulation case underscore their impacts on restoration times, ranging from 3 min and 32 s to 6 min and 19 s. In contrast, power is not restored in an area in one of our simulation cases.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Towards On-Line Services Based on a Holistic Analysis of Human Activities

Very often computer scientists view computerization of services in terms of the logistics of human-machine interaction, including establishing a contract, accessing records, and of course designing an interface. But this analysis often moves too quickly to tactical details, failing to frame the entire service in human terms, and not recognizing the mutual learning required to define and relate goals, constraints, and the personalized value of available services. In particular, on-line services that "computerize communication" can be improved by constructing an activity model of what the person is trying to do, not just filtering, comparing, and selling piece-meal services. For example, from the customer s perspective the task of an on-line travel service is not merely to establish confirmed reservations, but to have a complete travel plan, usually integrating many days of transportation, lodging, and recreation into a happy experience. The task of the travel agent is not merely "ticketing", but helping the customer understand what they want and providing services that will connect everything together in an enjoyable way.

Clancey, William J.↗

Distributed network scheduling

Distributed Network Scheduling is the scheduling of future communications of a network by nodes in the network. This report details software for doing this onboard spacecraft in a remote network. While prior work on distributed scheduling has been applied to remote spacecraft networks, the software reported here focuses on modeling communication activities in greater detail and including quality of service constraints. Our main results are based on a Mars network of spacecraft and include identifying a maximum opportunity of improving traverse exploration rate a factor of three; a simulation showing reduction in one-way delivery times from a rover to Earth from as much as 5 to 1.5 hours; simulated response to unexpected events averaging under an hour onboard; and ground schedule generation ranging from seconds to 50 minutes for 15 to 100 communication goals.

planning↗

Control Architecture for Robotic Agent Command and Sensing

Control Architecture for Robotic Agent Command and Sensing (CARACaS) is a recent product of a continuing effort to develop architectures for controlling either a single autonomous robotic vehicle or multiple cooperating but otherwise autonomous robotic vehicles. CARACaS is potentially applicable to diverse robotic systems that could include aircraft, spacecraft, ground vehicles, surface water vessels, and/or underwater vessels. CARACaS incudes an integral combination of three coupled agents: a dynamic planning engine, a behavior engine, and a perception engine. The perception and dynamic planning en - gines are also coupled with a memory in the form of a world model. CARACaS is intended to satisfy the need for two major capabilities essential for proper functioning of an autonomous robotic system: a capability for deterministic reaction to unanticipated occurrences and a capability for re-planning in the face of changing goals, conditions, or resources. The behavior engine incorporates the multi-agent control architecture, called CAMPOUT, described in An Architecture for Controlling Multiple Robots (NPO-30345), NASA Tech Briefs, Vol. 28, No. 11 (November 2004), page 65. CAMPOUT is used to develop behavior-composition and -coordination mechanisms. Real-time process algebra operators are used to compose a behavior network for any given mission scenario. These operators afford a capability for producing a formally correct kernel of behaviors that guarantee predictable performance. By use of a method based on multi-objective decision theory (MODT), recommendations from multiple behaviors are combined to form a set of control actions that represents their consensus. In this approach, all behaviors contribute simultaneously to the control of the robotic system in a cooperative rather than a competitive manner. This approach guarantees a solution that is good enough with respect to resolution of complex, possibly conflicting goals within the constraints of the mission to be accomplished by the vehicle(s).

Huntsberger, Terrance↗

Envisioning Cognitive Robots for Future Space Exploration

Cognitive robots in the context of space exploration are envisioned with advanced capabilities of model building, continuous planning/re-planning, self-diagnosis, as well as the ability to exhibit a level of 'understanding' of new situations. An overview of some JPL components (e.g. CASPER, CAMPOUT) and a description of the architecture CARACaS (Control Architecture for Robotic Agent Command and Sensing) that combines these in the context of a cognitive robotic system operating in a various scenarios are presented. Finally, two examples of typical scenarios of a multi-robot construction mission and a human-robot mission, involving direct collaboration with humans is given.

robot consciousness↗

Resilient Control of Networked Microgrids Using Vertical Federated Reinforcement Learning: Designs and Real-Time Test-Bed Validations

Improving system-level resiliency of networked microgrids against adversarial cyber-attacks is an important aspect in the current regime of increased inverter-based resources (IBRs). To achieve that, this paper contributes in designing a hierarchical control layer, in conjunction with the existing control layers, resilient to adversarial attack signals. Considering model complexities, unknown dynamical behaviors of IBRs, and privacy issues regarding data sharing in multi-party-owned microgrids, designing such a control layer is non-trivial. Here, to tackle these issues, a novel federated reinforcement learning (Fed-RL) method is proposed. To grasp the interconnected dynamics of networked microgrids, the paper develops Federated Soft Actor-Critic (FedSAC) algorithm following the vertical structure of implementing Fed-RL. Next, utilizing the OpenAI Gym interface, we built a custom set-up in GridLAB-D/HELICS co-simulation platform, named Resilient RL Co-simulation (ResRLCoSIM), to train the RL agents with IEEE 123-bus benchmark comprising 3 interconnected microgrids. Finally, the learned policies in the simulation are transferred to the real-time hardware-in-the-loop (HIL) test-bed developed using the high-fidelity Hypersim platform. Finally, experiments show that the simulator-trained RL controllers achieve desirable performance with the test-bed platform, validating the minimization of the sim-to-real gap.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Loggers and Forest Fragmentation: Behavioral Models of Road Building in the Amazon Basin

Although a large literature now exists on the drivers of tropical deforestation, less is known about its spatial manifestation. This is a critical shortcoming in our knowledge base since the spatial pattern of land-cover change and forest fragmentation, in particular, strongly affect biodiversity. The purpose of this article is to consider emergent patterns of road networks, the initial proximate cause of fragmentation in tropical forest frontiers. Specifically, we address the road-building processes of loggers who are very active in the Amazon landscape. To this end, we develop an explanation of road expansions, using a positive approach combining a theoretical model of economic behavior with geographic information systems (GIs) software in order to mimic the spatial decisions of road builders. We simulate two types of road extensions commonly found in the Amazon basin in a region: showing the fishbone pattern of fragmentation. Although our simulation results are only partially successful, they call attention to the role of multiple agents in the landscape, the importance of legal and institutional constraints on economic behavior, and the power of GIs as a research tool.

Arima, Eugenio Y.↗

Sensor Development for Liquid Water Detection in Dry Storage Casks: FY 2023 Status

Modeling efforts were undertaken in fiscal year (FY) 2023 to evaluate the feasibility and capability for sensing of liquid water inside canister-based dry cask storage systems (DCSSs). The focus was on the development of full-scale finite element models (FEMs) of ultrasound propagation through DCSS canister components. For these initial investigations, simulation of the baseplate component was targeted, envisioning water collection at the bottom of a vertically oriented canister. The effects of internal canister components (i.e., fuel basket, fuel assemblies) on ultrasound propagation in the baseplate component were evaluated in these efforts. The environment inside a DCSS confinement is intended to be inert and free of water to prevent potential corrosion of used fuel cladding or other internal hardware. Spent fuel assemblies are dried, after storage in water pools, to make sure water has been removed from assembly cavities. However, there is some uncertainty about the amount of residual water potentially left behind in a DCSS after drying processes, because water can become trapped in cavities or other small crevices in the surfaces formed by the fuel cladding, fuel assemblies, and other internal hardware components. Considering the complex space- and time-dependent temperature profiles in DCSSs, water may be in a liquid or gas phase depending on its location in the cask and how long the cask has been in storage. Evacuating most water and oxidizing agents contained within a canister is recommended by NUREG-1536 (NRC 2010), which covers DCSSs. As summarized by Salazar et al. (2020), existing guidance typically relies on achievable vacuum pumping pressures sustained over a hold period as a signal of dryness and water removal. However, time series data about water removal from full-scale commercial drying procedures are lacking (Hanson and Alsaed 2019). A review of drying specifications from several vendors led to the conclusion that if the specifications are followed correctly, the residual moisture in DCSSs should present an insignificant risk of cladding degradation (Knoll and Gilbert 1987). A more recent analysis concluded that much larger quantities of residual water could remain in DCSSs, but the amount would still not be expected to lead to significant corrosion of fuel cladding or other internal components (Jung et al. 2013). Industry drying procedures are mostly prescriptive in nature, and operational issues arising during the process could result in incomplete drying. A summary of operational issues and potential negative effects of residual water is provided by Salazar et al. (2019). Experimental efforts are ongoing to validate the extent of water removal in a DCSS based on drying procedures used at nuclear power plants through well-designed investigations of drying process efficacy and water retention (Durbin et al. 2021; Pulido et al. 2022a, Pulido et al. 2022b). This has been approached by simulating limited portions of a DCSS internal volume and fuel assemblies. So far, these efforts have focused on the effects of potential water trapping in the dashpot region of control rod guide tubes but are expected to be expanded to include the effects of other internal hardware features and failed fuel rod cladding. A method for detection and measurement of liquid water (Meyer et al. 2022; Meyer et al. 2021), in tandem with the drying information gained through experimental investigations, provides comprehensive bases for understanding the internal conditions of DCSSs and provides technical information to support licensing decisions.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A TOPAS model for lens-based proton radiography

Abstract Objective. Proton Radiography can be used in conjunction with proton therapy for patient positioning, real-time estimates of stopping power, and adaptive therapy in regions with motion. The modeling capability shown here can be used to evaluate lens-based radiography as an instantaneous proton-based radiographic technique. The utilization of user-friendly Monte Carlo program TOPAS enables collaborators and other users to easily conduct medical- and therapy- based simulations of the Los Alamos Neutron Science Center (LANSCE). The resulting transport model is an open-source Monte Carlo package for simulations of proton and heavy ion therapy treatments and concurrent particle imaging. Approach. The four-quadrupole, magnetic lens system of the 800-MeV proton beamline at LANSCE is modeled in TOPAS. Several imaging and contrast objects were modelled to assess transmission at energies from 230–930 MeV and different levels of particle collimation. At different proton energies, the strength of the magnetic field was scaled according to βγ, the inverse product of particle relativistic velocity and particle momentum. Main results. Materials with high atomic number, Z, (gold, gallium, bone-equivalent) generated more contrast than materials with low-Z (water, lung-equivalent, adipose-equivalent). A 5-mrad collimator was beneficial for tissue-to-contrast agent contrast, while a 10-mrad collimator was best to distinguish between different high-Z materials. Assessment with a step-wedge phantom showed water-equivalent path length did not scale directly according to predicted values but could be mapped more accurately with calibration. Poor image quality was observed at low energies (230 MeV), but improved as proton energy increased, with sub-mm resolution at 630 MeV. Significance. Proton radiography becomes viable for shallow bone structures at 330 MeV, and for deeper structures at 630 MeV. Visibility improves with use of high-Z contrast agents. This modality may be particularly viable at carbon therapy centers with accelerators capable of delivering high energy protons and could be performed with carbon therapy.

60 APPLIED LIFE SCIENCES↗