Soft Actor-Critic Reinforcement Learning Improves Distillation Column Internals Design Optimization
Explore the source record for details and available documents.
Dhan Lord B. Fortela↗
SEARCH · Engineering Papers
Results for “Actors”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Behaviors of Actors in a Resource-Exchange Model of Geopolitics.
Abstract not provided.
Cooper, Curtis S↗
An analysis framework for characterizing and explaining development of EIA legislation in developing countries-Illustrated for Georgia, Ghana and Yemen
Actors in the field of international development co-operation supporting the development of EIA legislation in developing countries often do not achieve the results envisaged. The performance of EIA in these countries often remains weak. One reason, we assume, is that often those actors support the establishment of overly ambitious EIA legislation that cannot achieve its objectives in the light of constraining contexts. To provide more effective support we need to better understand the enabling and constraining contextual factors that influence the development of EIA legislation and to which support actors should align itself. In this article a new analysis framework for classifying, characterizing and explaining the development of EIA legislation is described, measured in terms of ambition levels. Ambitions are defined as intentions the EIA authorities aim to fulfill, expressed in formal EIA legislation. Three country cases, Yemen, Georgia and Ghana are used to illustrate the usefulness of our framework and as a first test to refine the framework. We have formulated the following five hypotheses that complement and refine our analysis framework. One, EIA legislation may develop multilinearly in terms of ambition levels. Two, ambitions in EIA legislation seem to be influenced to a great extent by the power and capacity of, on the one hand, the environmental authorities supporting EIA and, on the other hand, the sector authorities hindering the development of EIA. Three, the political system is the most important context factor influencing the rules of policy-making and the power of the different actors involved. Four, the importance of context factors on the development of ambitions is dependent on the phase of EIA system development. Five, some ambitions seem to be influenced by particular factors; for instance the ambitions for the object of study seem to be influenced by the level of environmental awareness of the sector ministries and parliament. The analysis framework may also assist actors involved in the development of EIA legislation in setting ambitions for EIA legislation that are feasible within the context in which it will be developed and implemented. Application of a country-specific EIA model would seem to be the preferred model to develop EIA legislation because by taking capacities of actors and context factors as a starting point, it offers more potential to well-performing EIA systems. - Highlights: Black-Right-Pointing-Pointer EIA systems develop from less to high ambitious and sometimes vice versa. Black-Right-Pointing-Pointer Ambitions in EIA legislation are determined by the capacity of environment- and sector authority. Black-Right-Pointing-Pointer The political system is the most important context factor explaining the ambitions of an EIA system. Black-Right-Pointing-Pointer An analysis framework developed to measure EIA system ambitions might help to setambitions.
54 ENVIRONMENTAL SCIENCES↗
The significance of structural power in Strategic Environmental Assessment
This article presents a study of how power dynamics enables and constrains the influence of actors upon decision-making and Strategic Environmental Assessment (SEA). Based on structuration theory, a model for studying power dynamics in strategic decision-making processes is developed. The model is used to map and analyse key decision arenas in the decision process of aluminium production in Greenland. The analysis shows that communication lines are an important resource through which actors exercise power and influence decision-making on the location of the aluminium production. The SEA process involved not only reproduction of formal communication and decision competence but also production of alternative informal communication structures in which the SEA had capability to influence. It is concluded, that actors influence strategic decision making, and attention needs to be on not only the formal interactions between SEA process and strategic decision-making process but also on informal interaction and communication between actors as the informal structures, which can be crucial to the outcome of the decision-making process. This article is meant as a supplement to the understanding of power dynamics influence in IA processes and as a contribution to the IA research field with a method to analyse power dynamics in strategic decision-making processes. The article also brings reflections of strengths and weaknesses of using the structuration theory as an approach to power analysis. - Highlights: Black-Right-Pointing-Pointer Informal interaction influenced process despite the presence of formalised rules. Black-Right-Pointing-Pointer Interdependence of actors influenced SEA effectiveness. Black-Right-Pointing-Pointer SEA practitioners successfully exercised power to influence decision-making. Black-Right-Pointing-Pointer Power dynamics are properties of actors' interactions in decision-making. Black-Right-Pointing-Pointer Power structures can be enabling and not solely limiting.
54 ENVIRONMENTAL SCIENCES↗
Is adaptation a local responsibility?
Adaptation is now strongly embedded in the societal discourse regarding the management of climate risk. In this discourse, adaptation planning and implementation at the local level are seen as particularly important for developing robust responses to climate change. However, it is not clear whether the mantra that adaptation is local holds true given the multi-level nature of climate risk governance. Using a multi-method approach, this paper examines the extent to which adaptation should be framed as a local issue and, specifically, the role of local government in adaptation relative to other actors. In so doing, the paper first explores the extent to which the local framing of adaptation is embedded in the international adaptation literature. This is followed by a specific case study from Southeast Queensland, Australia, which focuses on the critical examination of the processes of responsibility shifting and taking among actors involved in coastal adaptation planning. Results indicate the assumption that adaptation is local remains widely held in adaptation science, although counter arguments can be readily identified. Interviews with adaptation actors revealed unclear divisions of responsibility for climate change adaptation as a significant constraint on actors willingness to implement adaptation. Additionally, attributing responsibility for adaptation to local actors might not necessarily be a robust strategy, due to the existence of particularly strong constraints and value conflicts at local levels of governance. Greater appreciation by researchers and practitioners for the interactions between local actors and those at higher levels of governance in shaping response capacity may contribute to more equitable and effective allocations of responsibilities for adaptation action.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Sci-Vis Framework
SVF is a full featured OpenGL 3d framework that allows for rapid creation of complex visualizations. The SVF framework handles much of the lifecycle and complex tasks required for a 3d visualization. Unlike a game framework SVF was designed to use fewer resources, work well in a windowed environment, and only render when necessary. The scene also takes advantage of multiple threads to free up the UI thread as much as possible. Shapes (actors) in the scene are created by adding or removing functionality (through support objects) during runtime. This allows a highly flexible and dynamic means of creating highly complex actors without the code complexity (it also helps overcome the lack of multiple inheritance in Java.) All classes are highly customizable and there are abstract classes which are intended to be subclassed to allow a developer to create more complex and highly performant actors. There are multiple demos included in the framework to help the developer get started and shows off nearly all of the functionality. Some simple shapes (actors) are already created for you such as text, bordered text, radial text, text area, complex paths, NURBS paths, cube, disk, grid, plane, geometric shapes, and volumetric area. It also comes with various camera types for viewing that can be dragged, zoomed, and rotated. Picking or selecting items in the scene can be accomplished in various ways depending on your needs (raycasting or color picking.) The framework currently has functionality for tooltips, animation, actor pools, color gradients, 2d physics, text, 1d/2d/3d textures, children, blending, clipping planes, view frustum culling, custom shaders, and custom actor states
Arthur Bleeker, PNNL↗
Ada and knowledge-based systems: A prototype combining the best of both worlds
A software architecture is described which facilitates the construction of distributed expert systems using Ada and selected knowledge based systems. This architecture was utilized in the development of a Knowledge-based Maintenance Expert System (KNOMES) prototype for the Space Station Mobile Service Center (MSC). The KNOMES prototype monitors a simulated data stream from MSC sensors and built-in test equipment. It detects anomalies in the data and performs diagnosis to determine the cause. The software architecture which supports the KNOMES prototype allows for the monitoring and diagnosis tasks to be performed concurrently. The basic concept of this software architecture is named ACTOR (Ada Cognitive Task ORganization Scheme). An individual ACTOR is a modular software unit which contains both standard data processing and artificial intelligence components. A generic ACTOR module contains Ada packages for communicating with other ACTORs and accessing various data sources. The knowledge based component of an ACTOR determines the role it will play in a system. In this prototype, an ACTOR will monitor the MSC data stream.
Brauer, David C.↗
Sci-Vis Framework
SVF is a full featured OpenGL 3d framework that allows for rapid creation of complex visualizations. The SVF framework handles much of the lifecycle and complex tasks required for a 3d visualization. Unlike a game framework SVF was designed to use fewer resources, work well in a windowed environment, and only render when necessary. The scene also takes advantage of multiple threads to free up the UI thread as much as possible. Shapes (actors) in the scene are created by adding or removing functionality (through support objects) during runtime. This allows a highly flexible and dynamic means of creating highly complex actors without the code complexity (it also helps overcome the lack of multiple inheritance in Java.) All classes are highly customizable and there are abstract classes which are intended to be subclassed to allow a developer to create more complex and highly performant actors. There are multiple demos included in the framework to help the developer get started and shows off nearly all of the functionality. Some simple shapes (actors) are already created for you such as text, bordered text, radial text, text area, complex paths, NURBS paths, cube, disk, grid, plane, geometric shapes, and volumetric area. It also comes with various camera types for viewing that can be dragged, zoomed, and rotated. Picking or selecting items in the scene can be accomplished in various ways depending on your needs (raycasting or color picking.) The framework currently has functionality for tooltips, animation, actor pools, color gradients, 2d physics, text, 1d/2d/3d textures, children, blending, clipping planes, view frustum culling, custom shaders, and custom actor states
Arthur Bleeker, PNNL↗
System on chip module configured for event-driven architecture
A system on chip (SoC) module is described herein, wherein the SoC modules comprise a processor subsystem and a hardware logic subsystem. The processor subsystem and hardware logic subsystem are in communication with one another, and transmit event messages between one another. The processor subsystem executes software actors, while the hardware logic subsystem includes hardware actors, the software actors and hardware actors conform to an event-driven architecture, such that the software actors receive and generate event messages and the hardware actors receive and generate event messages.
97 MATHEMATICS AND COMPUTING↗
System on chip module configured for event-driven architecture
A system on chip (SoC) module is described herein, wherein the SoC modules comprise a processor subsystem and a hardware logic subsystem. The processor subsystem and hardware logic subsystem are in communication with one another, and transmit event messages between one another. The processor subsystem executes software actors, while the hardware logic subsystem includes hardware actors, the software actors and hardware actors conform to an event-driven architecture, such that the software actors receive and generate event messages and the hardware actors receive and generate event messages.
97 MATHEMATICS AND COMPUTING↗
Dynamic, resilient virtual sensing system and shadow controller for cyber-attack neutralization
An industrial asset may have monitoring nodes (e.g., sensor or actuator nodes) that generate current monitoring node values. An abnormality detection and localization computer may receive the series of current monitoring node values and output an indication of at least one abnormal monitoring node that is currently being attacked or experiencing a fault. An actor-critic platform may tune a dynamic, resilient state estimator for a sensor node and output tuning parameters for a controller that improve operation of the industrial asset during the current attack or fault. The actor-critic platform may include, for example, a dynamic, resilient state estimator, an actor model, and a critic model. According to some embodiments, a value function of the critic model is updated for each action of the actor model and each action of the actor model is evaluated by the critic model to update a policy of the actor-critic platform.
Roychowdhury, Subhrajit↗
ERSAP: Toward Better NP Data-Stream Analytics With Flow-Based Programming
This paper presents an reactive, actor-model and FBP paradigm based framework that we develop to design data-stream processing applications for HEP and NP. This framework encourages a functional decomposition of the overall data processing application into small mono-functional artifacts. Artifacts that are easy to understand, develop, deploy and debug. The fact that these artifacts (actors) are programmatically independent they can be scaled and optimized independently, which is impossible to do for components of the monolithic application. One of the important advantages of this approach is fault tolerance where independent actors can come and go on the data-stream without forcing the entire application to crash. Furthermore, it also makes it is easy to locate the faulty actor in the data pipeline. Due the fact that the actors are loosely coupled, and that the data (inevitably) carries the context, they can run on heterogeneous environments, utilizing different accelerators. This paper describes the main design concepts of the framework and presents a ?proof of concept? application design and deployment results obtain processing on-beam calorimeter streaming data.
Gyurjyan, V.↗
Threat emulation framework
A method for emulating threats in virtual network computing environment is provided. The method comprises creating a number of virtual machines in the virtual network computing environment. A number of threat actors are emulated, wherein each threat actor comprises a number of threat artifacts that form a sequence of attack steps against the virtual network computing environment. The threat actors are then deployed against the virtual network computing environment. Behavioral data about actions of the threat actors in the virtual network computing environment is collected, as is performance data about the virtual network computing environment in response to the threat actors. The collected behavioral and performance data is then presented to a user via an interface.
Urias, Vincent↗
A Typology for Characterizing Human Action in MultiSector Dynamics Models
The role of individual and collective human agency is increasingly recognized as a prominent and arguably paramount determinant in shaping the behavior, trajectory, and vulnerability of multisector systems. This human influence operates at multiple scales: from short-term (hourly to daily) to long-term (annually to centennial) timescales, and from the local to the global, pushing systems towards either desirable or undesirable outcomes. However, the effort to represent human systems in multisector models has been fragmented across philosophical, methodological, and disciplinary lines. To cohere insights across diverse modeling approaches, we present a new typology for classifying how human actors are represented in the broad suite of coupled human-natural system models that are applied in MultiSector Dynamics (MSD) research. The typology conceptualizes a “sector” as a system-of-systems that includes a diverse group of human actors, defined across individual to collective social levels, involved in governing, provisioning, and utilizing products, goods, or services towards some human end. We trace the salient features of modeled representations of human systems by organizing the typology around three key questions: 1) Who are the modeled actors in MSD systems? 2) What are their modeled actions? 3) How and for what purpose are these actors and actions operationalized in a computational model? The typology is used to critically examine existing models and chart the frontier of future human systems modeling for MSD research.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Effect of Strong Opinions on the Dynamics of the Majority-Vote Model
We study how the presence of individuals with strong opinions affects a square lattice majority-vote model with noise. In a square lattice network we perform Monte-Carlo simulations and replace regular actors σ with strong actors μ in a random distribution. We find that the value of the critical noise parameter q c is a decreasing function of the concentration r of strong actors in the social interaction network. We calculate the critical exponents β/ν, γ/ν, and 1/ν and find that the presence of strong actors does not change the Ising universality class of the isotropic majority-vote model.
97 MATHEMATICS AND COMPUTING↗
Regression of exchangeable relational arrays
Relational arrays represent measures of association between pairs of actors, often in varied contexts or over time. Trade flows between countries, financial transactions between individuals, contact frequencies between school children in classrooms and dynamic protein-protein interactions are all examples of relational arrays. Elements of a relational array are often modelled as a linear function of observable covariates. Uncertainty estimates for regression coefficient estimators, and ideally the coefficient estimators themselves, must account for dependence between elements of the array, e.g., relations involving the same actor. Existing estimators of standard errors that recognize such relational dependence rely on estimating extremely complex, heterogeneous structure across actors. This paper develops a new class of parsimonious coefficient and standard error estimators for regressions of relational arrays. Here we leverage an exchangeability assumption to derive standard error estimators that pool information across actors, and are substantially more accurate than existing estimators in a variety of settings. This exchangeability assumption is pervasive in network and array models in the statistics literature, but not previously considered when adjusting for dependence in a regression setting with relational data. We demonstrate improvements in inference theoretically, via a simulation study, and by analysis of a dataset involving international trade.
97 MATHEMATICS AND COMPUTING↗
Living-off-the-land Techniques Unlikely to Supplant Energy Sector-Focused OT-Specific Malware
Despite increased reports of energy sector-focused threat actors using living-off-the-land (LOTL) techniques, it is unlikely LOTL techniques will wholly supplant malware in energy sector operational technology (OT)-focused cyber operations. Threat actors leverage LOTL techniques to access energy sector networks, abstracting process information and maintaining persistence. Although threat actors using LOTL techniques have successfully interrupted energy sector industrial control environments, designed features of OT-specific malware likely increase the cyber-physical impact of an attack and delay recovery of critical functions and services. Malicious actors will very likely continue to use LOTL techniques for stealth, while designing malware to bolster final impacts on cyber-physical systems in energy sector OT environments.
99 GENERAL AND MISCELLANEOUS↗