Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Actors”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2012

CMS Workflow Execution using Intelligent Job Scheduling and Data Access Strategies

Complex scientific workflows can process large amounts of data using thousands of tasks. The turnaround times of these workflows are often affected by various latencies such as the resource discovery, scheduling and data access latencies for the individual workflow processes or actors. Minimizing these latencies will improve the overall execution time of a workflow and thus lead to a more efficient and robust processing environment. In this paper, we propose a pilot job based infrastructure that has intelligent data reuse and job execution strategies to minimize the scheduling, queuing, execution and data access latencies. The results have shown that significant improvements in the overall turnaround time of a workflow can be achieved with this approach. The proposed approach has been evaluated, first using the CMS Tier0 data processing workflow, and then simulating the workflows to evaluate its effectiveness in a controlled environment.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Reinforcement Learning for Intentional Islanding in Resilient Power Transmission Systems

Intentional islanding is the process of identifying and deliberately decomposing the transmission network to form self-sustained islands from an endangered network during disruptions to improve resilience and security. Most existing intentional islanding models are offline resilience decision tools and hence do not provide outage responses in a timely manner. In this paper, a reinforcement learning (RL) based model for intentional islanding is developed, which offers real-time switching control, online deployability, and adaptability to varying system conditions. The intentional islanding process is formulated as a Markov decision process, where the optimal transmission switching policy is learned using the RL approach. The control policy is learned over an environment that encompasses a Power System Simulator for Engineering (PSS/E) model of the transmission network, facilitated by an interface to the standard openAI Gym framework. The proposed RL-based methodology aims to form stable and self-sustainable islands by ensuring voltage stability while reducing the power mismatch in the formed islands. A proximal policy optimization algorithm is designed, which is suitable for controlling the on/off status of the switches with multi-layer perceptron as value and actor networks. The effectiveness of the proposed framework in the self-recovery of the grid by island formation is applied on the modified IEEE 39-bus test network and validated by dynamic simulations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

FIRE: A Failure-Adaptive RL Framework for Edge Computing Migrations

In edge computing, users' service profiles are migrated between edge servers due to user mobility. Reinforcement Learning (RL) frameworks have been proposed to do so, often trained on simulated data. However, existing RL frameworks overlook occasional server failures, which although rare, impact latency-sensitive applications like AR/VR and real- time obstacle detection. These rare failures, being not adequately represented in historical training data, pose a challenge for data-driven RL algorithms. We introduce FIRE, a framework that adapts to rare events by training a RL policy in an edge computing digital twin environment. We propose FIRE-ImRE, an importance sampling-based Q-learning algorithm, which samples rare events proportionally to their impact on the value function. FIRE considers delay, migration, failure, and backup placement costs across individual and shared service profiles. We prove FIRE-ImRE's boundedness and convergence to optimality. Next, we introduce novel deep Q-learning (FIRE-ImDQL) and actor critic (FIRE-ImACRE) versions of our algorithm to enhance scalability. Here, we extend our framework to accommodate users with varying risk tolerances of rare failure events. Through trace-driven experiments, we show that FIRE reduces edge computing costs compared to vanilla RL and the greedy baseline in the event of failures.

Edge computing↗
DOE OSTI2021

Data-Driven Multi-agent Deep Reinforcement Learning for Distribution System Decentralized Voltage Control with High Penetration of PVs

This paper proposes a novel model-free/data-driven centralized training and decentralized execution multi-agent deep reinforcement learning (MADRL) framework for distribution system voltage control with high penetration of PVs. The proposed MADRL can coordinate both the real and reactive power control of PVs with existing static var compensators and battery storage systems. Unlike the existing DRL-based voltage control methods, our proposed method does not rely on a system model during both the training and execution stages. This is achieved by developing a new interaction scheme between the surrogate modeling of the original system and the multi-agent soft actor critic (MASAC) MADRL algorithm. In particular, the sparse pseudo-Gaussian process with a few-shots of measurements is utilized to construct the surrogate model of the original environment, i.e., power flow model. This is a data-driven process and no model parameters are needed. Furthermore, the MASAC enabled MADRL allows to achieve better scalability by dividing the original system into different voltage control regions with the aid of real and reactive power sensitivities to voltage, where each region is treated as an agent. This also serves as the foundation for the centralized training and decentralized execution, thus significantly reducing the communication requirements as only local measurements are required for control. Comparative results with other alternatives on the IEEE 123-nodes and 342-nodes systems demonstrate the superiority of the proposed method.

14 SOLAR ENERGY↗
DOE OSTI2021

Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems

Active distribution networks are being challenged by frequent and rapid voltage violations due to renewable energy integration. Conventional model-based voltage control methods rely on accurate parameters of the distribution networks, which are difficult to achieve in practice. This paper proposes a novel physical-model-free two-timescale voltage control framework for active distribution systems. To achieve fast control of PV inverters, the whole network is first partitioned into several subnetworks using voltage-reactive power sensitivity. Then, the scheduling of PV inverters in the multiple sub-networks is formulated as Markov games and solved by a multi-agent soft actor-critic (MASAC) algorithm, where each subnetwork is modeled as an intelligent agent. All agents are trained in a centralized manner to learn a coordinated strategy while being executed based on only local information for fast response. For the slower time-scale control, OLTCs and switched capacitors are coordinated by a single agent-based SAC algorithm using the global information with considering control behaviors of the inverters. Particularly, the two-level agents are trained concurrently with information exchange according to the reward signal calculated from the data-driven surrogate model. Comparative tests with different benchmark methods on IEEE 33-and 123-bus systems and 342-node low voltage distribution system demonstrate that the proposed method can effectively mitigate the fast voltage violations and achieve systematical coordination of different voltage regulation assets without the knowledge of accurate system model.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Adaptive Deep Reinforcement Learning Algorithm for Distribution System Cyber Attack Defense With High Penetration of DERs

With grid modernization, smart inverters are increasingly used to execute advanced controls for distribution network reliability. However, this also increases the cyber-attack space. Here this paper focuses on the defense approaches to restore the system to normal operation circumstances in the presence of cyber-attacks. A unique deep reinforcement learning (DRL) method is developed to minimize voltage violations and reduce power losses for impacted feeders. The defense problem is reformulated as a Markov decision-making process to dynamically control DERs while minimizing load shedding. This is achieved via an improved soft actor-critic (SAC)-based DRL algorithm, which can govern DER set points and load-shedding scenarios in discrete and continuous modes via the auto-tune entropy and Gaussian policy features. Numerical comparison results on the modified IEEE 123-node system with other control approaches, such as Volt-VAR (VV), Volt-Watt (VW), and model predictive control (MPC) show that the proposed method can eliminate voltage violations and provide feasible control actions that perform complete mitigation of cyber-threats.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Resilient Control of Networked Microgrids Using Vertical Federated Reinforcement Learning: Designs and Real-Time Test-Bed Validations

Improving system-level resiliency of networked microgrids against adversarial cyber-attacks is an important aspect in the current regime of increased inverter-based resources (IBRs). To achieve that, this paper contributes in designing a hierarchical control layer, in conjunction with the existing control layers, resilient to adversarial attack signals. Considering model complexities, unknown dynamical behaviors of IBRs, and privacy issues regarding data sharing in multi-party-owned microgrids, designing such a control layer is non-trivial. Here, to tackle these issues, a novel federated reinforcement learning (Fed-RL) method is proposed. To grasp the interconnected dynamics of networked microgrids, the paper develops Federated Soft Actor-Critic (FedSAC) algorithm following the vertical structure of implementing Fed-RL. Next, utilizing the OpenAI Gym interface, we built a custom set-up in GridLAB-D/HELICS co-simulation platform, named Resilient RL Co-simulation (ResRLCoSIM), to train the RL agents with IEEE 123-bus benchmark comprising 3 interconnected microgrids. Finally, the learned policies in the simulation are transferred to the real-time hardware-in-the-loop (HIL) test-bed developed using the high-fidelity Hypersim platform. Finally, experiments show that the simulator-trained RL controllers achieve desirable performance with the test-bed platform, validating the minimization of the sim-to-real gap.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Comparative genomics of pyrophilous fungi reveals a link between fire events and developmental genes

Forest fires generate a large amount of carbon that remains resident on the site as dead and partially ‘pyrolysed’ (i.e. burnt) material that has long residency times and constitutes a significant pool in fire–prone ecosystems. In addition, fire–induced hydrophobic soil layers, caused by condensation of pyrolysed waxes and lipids, increase post–fire erosion and can lead to long–term productivity losses. A small set of pyrophilous fungi dominate post–fire soils and are likely to be involved with the degradation of all these compounds, yet almost nothing is currently known about what these fungi do or the metabolic processes they employ. In this study, we sequenced and analyzed genomes from fungi isolated after Rim fire near Yosemite National Park in 2013 and showed the enrichment/expansion of CAZymes and families known to be involved in fruiting body initiation when compared to other basidiomycete fungi. We found gene families potentially involved in the degradation of the hydrophobic layer and pyrolysed organic matter, such as hydrophobic surface binding proteins, laccases (AA1_1), xylanases (GH10, GH11), fatty acid desaturases and tannases. Furthermore, pyrophilous fungi are important actors to restate the soil's functional capabilities.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2015

The theory behind, and the challenges of, conserving nature's stage in a time of rapid change

Most conservation planning to date has focused on protecting today's biodiversity with the assumption that it will be tomorrow's biodiversity. However, modern climate change has already resulted in distributional shifts of some species and is projected to result in many more shifts in the coming decades. As species redistribute and biotic communities reorganize, conservation plans based on current patterns of biodiversity may fail to adequately protect species in the future. One approach for addressing this issue is to focus on conserving a range of abiotic conditions in the conservation-planning process. By doing so, it may be possible to conserve an abiotically diverse "stage" upon which evolution will play out and support many actors (biodiversity). We reviewed the fundamental underpinnings of the concept of conserving the abiotic stage, starting with the early observations of von Humboldt, who mapped the concordance of abiotic conditions and vegetation, and progressing to the concept of the ecological niche. We discuss challenges posed by issues of spatial and temporal scale, the role of biotic drivers of species distributions, and latitudinal and topographic variation in relationships between climate and landform. For example, abiotic conditions are not static, but change through time-albeit at different and often relatively slow rates. In some places, biotic interactions play a substantial role in structuring patterns of biodiversity, meaning that patterns of biodiversity may be less tightly linked to the abiotic stage. Furthermore, abiotic drivers of biodiversity can change with latitude and topographic position, meaning that the abiotic stage may need to be defined differently in different places. Lastly, we conclude that protecting a diversity of abiotic conditions will likely best conserve biodiversity into the future in places where abiotic drivers of species distributions are strong relative to biotic drivers, where the diversity of abiotic settings will be conserved through time, and where connectivity allows for movement among areas providing different abiotic conditions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Tigers at a crossroads: Shedding light on the role of Bangladesh in the illegal trade of this iconic big cat

Abstract Unsustainable wildlife trade is a major threat to many species, but quantifying trade remains challenging, as seizure data provides an incomplete understanding. For this reason, integrating multiple types of information, including interviews with actors involved in trade, is crucial if we are to understand the problem better. Hence, in this study, we digitized Bangladesh Forest Department tiger seizure records to identify trade routes and interviewed 163 individuals involved in trafficking tigers through Bangladesh's air, sea and land ports, including poachers, smugglers, and traders. We identified six ports used to import tigers, 14 ports used for tiger export and three ports showing bi‐directional trade. Elite Bangladeshis were the most important consumer group, and tigers were sourced from populations in NE India, Myanmar and Bangladesh Sundarbans to supply domestic demand. Tiger products were exported to 14 countries, including seven G20 nations, with Bangladeshi expatriates as the consumer group in three countries (United Kingdom, Germany and Qatar). Rising economic development in Bangladesh over the last decade, combined with deep‐rooted cultural ties to tiger consumption, has led to a rise in domestic demand. Additionally, rapid growth in international transport links has increased smuggling and connected local traders with global markets, increasing the complexity of global trade. These findings suggest Bangladesh is poised to play a pivotal role in tiger conservation over the next decade, requiring strong national strategies to reduce trade opportunities, disrupt networks and weaken demand.

Uddin, Nasir↗
DOE OSTI2013

Potential scenarios for broadening stakeholder involvement in the implementing geological disposal technology platform

This paper analyses the potential for the involvement of different types of stakeholders in the Implementing Geological Disposal Technology Platform (IGD-TP). This analysis was conducted as part of the InSOTEC project, a three-year (2011- 2014) collaborative research project funded under the 7. Euratom Framework Programme (Grant Agreement nr. 269906). In our analysis, we consider the extent to which the IGDTP's practice as regards to stakeholder involvement matches its discourse, and what potential for improvement exists given its structural organisation as a European Technology Platform (ETPs). Technology Platforms (TPs) can be understood as knowledge networks, deliberately set up to influence (research) policy in a specific domain. We therefore use knowledge networks as a conceptual approach and look at the IGD-TP as a complex network which includes actors, knowledge and practices across different countries, focusing on a very specific topic (i.e. implementing geological disposal). We compare the way different stakeholders are involved in the IGD-TP to the practice of other ETPs, and explore how the IGD-TP is viewed by its members and by outsiders to the platform Applying Callon's framework of knowledge co-production (1999) we come to define different degrees of interaction between science, society and policy in view of defining research and development (R and D) priorities [1]. Subsequently we describe how these interactions could be conceptualised and interpreted for the IGD-TP. The current approach of the IGDTP can be mainly understood as classical model involving mainly expert stakeholders and scientists. Where there seems to be a good representation among IGD-TP members of industry, research institutes, and some members of the academic community this is not the case for other types of stakeholders, such as public authorities or civil society. At this stage, the overall approach of the IGD-TP would seem to restrict the scope of stakeholder involvement, as it narrows participation down to uniquely technology experts, hindering socio-technical manifestations. Our analysis nevertheless shows that there is room for engaging with a broader range of stakeholders in the field of radioactive waste management, if this is the intention of the IGD-TP. However, this would require a commitment to developing a common knowledge base including other stakeholders through a process of mutual adjustment and negotiation. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2016

Ubiquitous signatures of nematic quantum criticality in optimally doped Fe-based superconductors

A key actor in the conventional theory of superconductivity is the induced interaction between electrons mediated by the exchange of virtual collective fluctuations (phonons in the case of conventional s-wave superconductors). Other collective modes that can play the same role, especially spin fluctuations, have been widely discussed in the context of high-temperature and heavy Fermion superconductors. The strength of such collective fluctuations is measured by the associated susceptibility. Here we use differential elastoresistance measurements from five optimally doped iron-based superconductors to show that divergent nematic susceptibility appears to be a generic feature in the optimal doping regime of these materials. This observation motivates consideration of the effects of nematic fluctuations on the superconducting pairing interaction in this family of compounds and possibly beyond.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Leverage demand-side policies for energy security

Energy security is a top priority for governments, companies, and households because energy systems and the critical functions that they support are threatened by disruptions from wars, pandemics, climate change, and other shocks (1). More often than not, governments rely on policies focused on energy supply to enhance energy security while generally ignoring demand-side possibilities. Further, the indicators traditionally used to measure energy security are also tilted toward the supply side; this fails to capture the full spectrum of vulnerability to energy crises. Energy security assessments need to reflect the wider benefits of security related interventions more accurately. To that end, we develop a systematic approach to measuring the energy security impacts of policy interventions that explicitly considers energy demand (buildings, transport, and industry). Here, we determine that demand-side actions outperform conventional supply-side approaches at making countries more resilient. Energy demand links more directly than supply to the satisfaction of critical social functions and human well-being that are at the core of energy security. Yet, demand-side perspectives tend to be neglected or underrepresented in analysis and policy debates on energy security. Factors that contribute to this supply-side bias include the traditional sectoral organization of industries and policy institutions along fuels (coal, oil, and gas) and energy forms (electric utilities) as well as the decentralized and multivaried activities characteristic of energy demand (from vehicles to household appliances to manufacturing and more), which leads to a multitude of actors and institutional fragmentation. The basic fundamentals of energy systems and markets, where demand and supply are intricately linked, have also not yet risen from vague awareness to a central organizing principle among policy-makers for structuring the energy security discourse.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Deciphering Microbial Metal Toxicity Responses using RB-TnSeq and Activity-Based Metabolomics

To uncover metal toxicity targets and defense mechanisms of the facultative anaerobe Pantoea sp. strain MT58 (MT58), we used a multiomic strategy combining two global techniques, random bar code transposon site sequencing (RB-TnSeq) and activity-based metabolomics. MT58 is a metal-tolerant Oak Ridge Reservation (ORR) environmental isolate that was enriched in the presence of metals at concentrations measured in contaminated groundwater at an ORR nuclear waste site. The effects of three chemically different metals found at elevated concentrations in the ORR contaminated environment were investigated: the cation Al 3+ , the oxyanion CrO 4 2- , and the oxycation UO 2 2+ . Both global techniques were applied using all three metals under both aerobic and anaerobic conditions to elucidate metal interactions mediated through the activity of metabolites and key genes/proteins. These revealed that Al 3+ binds intracellular arginine, CrO 4 2- enters the cell through sulfate transporters and oxidizes intracellular reduced thiols, and membrane-bound lipopolysaccharides protect the cell from UO 2 2+ toxicity. In addition, the Tol outer membrane system contributed to the protection of cellular integrity from the toxic effects of all three metals. Likewise, we found evidence of regulation of lipid content in membranes under metal stress. Individually, RB-TnSeq and metabolomics are powerful tools to explore the impact various stresses have on biological systems. In this work, we show that together they can be used synergistically to identify the molecular actors and mechanisms of these pertubations to an organism, furthering our understanding of how living systems interact with their environment.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Global Market and Economic Welfare Implications of Changes in Agricultural Yields Due to Climate Change

The economic welfare effects of climate change on global agriculture will be mediated by several complex biophysical and economic processes. For a given emissions scenario, these include: (1) the response of the climate system to anthropogenic forcing, (2) the response of crop yields to climate system and carbon dioxide changes, given baseline improvements in crop yields, (3) the response of agricultural markets to crop yield changes, and (4) the economic welfare implications of such market responses. In this paper, we use information about the first two processes from available climate-crop model comparison studies to analyze implications for the third and fourth processes. Applying the range of crop yield changes in a Global Integrated Assessment Model (GCAM) highlights several important economic relationships. First, we find a consistent relationship between global cropland area and yield change that is approximately orthogonal to the relationship between regional cropland area and yield change. Second, we find that the change in economic welfare, expressed as total surplus change per unit economic output, peaks during the 21st century. Third, we find that, at the global level, changes in yield affect both producer surplus and consumer surplus. Specifically, surplus changes to producers and consumers are always opposite in sign, although which economic actors gain or lose varies with the sign of yield change for any given commodity. Taken together, these results contribute to a growing body of research on climate-induced changes on agriculture by highlighting several economic relationships that are robust to differences in the underlying biophysical responses.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2010

Real-Time Visualization of Network Behaviors for Situational Awareness

Plentiful, complex, and dynamic data make understanding the state of an enterprise network difficult. Although visualization can help analysts understand baseline behaviors in network traffic and identify off-normal events, visual analysis systems often do not scale well to operational data volumes (in the hundreds of millions to billions of transactions per day) nor to analysis of emergent trends in real-time data. We present a system that combines multiple, complementary visualization techniques coupled with in-stream analytics, behavioral modeling of network actors, and a high-throughput processing platform called MeDICi. This system provides situational understanding of real-time network activity to help analysts take proactive response steps. We have developed these techniques using requirements gathered from the government users for which the tools are being developed. By linking multiple visualization tools to a streaming analytic pipeline, and designing each tool to support a particular kind of analysis (from high-level awareness to detailed investigation), analysts can understand the behavior of a network across multiple levels of abstraction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2013

Massive Scale Cyber Traffic Analysis: A Driver for Graph Database Research

We describe the significance and prominence of network traffic analysis (TA) as a graph- and network-theoretical domain for advancing research in graph database systems. TA involves observing and analyzing the connections between clients, servers, hosts, and actors within IP networks, both at particular times and as extended over times. Towards that end, NetFlow (or more generically, IPFLOW) data are available from routers and servers which summarize coherent groups of IP packets flowing through the network. IPFLOW databases are routinely interrogated statistically and visualized for suspicious patterns. But the ability to cast IPFLOW data as a massive graph and query it interactively, in order to e.g.\ identify connectivity patterns, is less well advanced, due to a number of factors including scaling, and their hybrid nature combining graph connectivity and quantitative attributes. In this paper, we outline requirements and opportunities for graph-structured IPFLOW analytics based on our experience with real IPFLOW databases. Specifically, we describe real use cases from the security domain, cast them as graph patterns, show how to express them in two graph-oriented query languages SPARQL and Datalog, and use these examples to motivate a new class of "hybrid" graph-relational systems.

Joslyn, Cliff A.↗
DOE OSTI2018

Butterfly Counting in Bipartite Networks

We consider the problem of counting motifs in bipartite affiliation networks, such as author-paper, user-product, and actor-movie relations. We focus on counting the number of occurrences of a "butterfly", a complete 2x2 biclique, the simplest cohesive higher-order structure in a bipartite graph. Our main contribution is a suite of randomized algorithms that can quickly approximate the number of butterflies in a graph with a provable guarantee on accuracy. An experimental evaluation on large real-world networks shows that our algorithms return accurate estimates within a few seconds, even for networks with trillions of butterflies and hundreds of millions of edges.

Sanei-Mehri, Seyed-Vahid↗