Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “INTERPRETATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Interpreting Primal-Dual Algorithms for Constrained Multiagent Reinforcement Learning: Preprint

We study multiagent reinforcement learning (MARL) with constraints. This setting is gaining importance as MARL algorithms find new applications in real-world systems ranging from power grids to drone swarms. Most constrained MARL (C-MARL) algorithms use a primal-dual approach to enforce constraints through a penalty function added to the reward. In this paper, we study the structural effects of the primal-dual approach on the constraints and value function. First, we show that using the constraint evaluation as the penalty leads to a weak notion of safety, but by making simple modifications to the penalty function, we can enforce meaningful probabilistic safety constraints. Second, we show that the penalty term changes the value function in a way that is easy to model, and demonstrate the consequences of not doing so. We conclude with simulations in a simple constrained multiagent environment to back up the theoretical results.

data-driven control↗
DOE OSTI2023

Interpreting Primal-Dual Algorithms for Constrained Multiagent Reinforcement Learning

Constrained multiagent reinforcement learning (C-MARL) is gaining importance as MARL algorithms find new applications in real-world systems ranging from energy systems to drone swarms. Most C-MARL algorithms use a primal-dual approach to enforce constraints through a penalty function added to the reward. In this paper, we study the structural effects of this penalty term on the MARL problem. First, we show that the standard practice of using the constraint function as the penalty leads to a weak notion of safety. However, by making simple modifications to the penalty term, we can enforce meaningful probabilistic (chance and conditional value at risk) constraints. Second, we quantify the effect of the penalty term on the value function, uncovering an improved value estimation procedure. We use these insights to propose a constrained multiagent advantage actor critic (C-MAA2C) algorithm. Simulations in a simple constrained multiagent environment affirm that our reinterpretation of the primal-dual method in terms of probabilistic constraints is effective, and that our proposed value estimate accelerates convergence to a safe joint policy.

chance constraints↗
DOE OSTI2015

Calculation of neutron and gamma fluxes in support to the interpretation of measuring devices irradiated in the core periphery of the OSIRIS Material Testing Reactor

Technological irradiations carried out in material testing reactors (MTRs) are used to study the behavior of materials under irradiation conditions required by different types of nuclear power plants (NPPs). For MTRs, specific instrumentation is required for the experiment monitoring and for the characterization of irradiation conditions, in particular the flux of neutrons and photons. To measure neutron and photon flux in experimental locations, different sensors can be used, such as SPNDs (self-powered neutron detectors), SPGDs (self-powered gamma detectors) and ionization chambers. These sensors involve interactions producing ultimately a measurable electric current. Various sensors have been recently tested in the core periphery of the OSIRIS reactor (located at the CEA-Saclay center) in order to qualify their responses to the neutron and the photon flux. One of the key input data for this qualification is to have a relevant evaluation of neutron and gamma fluxes at the irradiation location. The objective of this work is to evaluate the neutron and the gamma flux in the core periphery of the OSIRIS reactor. With this intention, specific neutron-photonic three-dimensional calculations have been performed and are mainly based on the TRIPOLI-4{sup R} three-dimensional continuous-energy Monte Carlo code, developed by CEA (Saclay Center) and extensively validated against reactor dosimetry benchmarks. In the case of the OSIRIS reactor, TRIPOLI-4{sup R} code has been validated against experimental results based on neutron flux and nuclear heating measurements performed in ex-core and in-core experiments. In this work, simultaneous contribution of neutrons and gamma photons in the core periphery is considered using neutron-photon coupled transport calculations. Contributions of prompt and decay photons have been taken into account for the gamma flux calculation. Specific depletion codes are used upstream to provide the decay-gamma sources required by TRIPOLI-4 calculations. In this paper, the neutron-photonic calculation scheme used for the neutron-gamma flux evaluation in the OSIRIS core periphery will be first detailed. Then, a comparison of calculated and measured values of neutron and gamma fluxes will be introduced. (author)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2017

Evaluation and Interpretation of Properties for Saltstone Cores Extracted from an SDU - 17344

Extraction and subsequent analysis of emplaced saltstone samples from a Savannah River Site (SRS) Saltstone Disposal Unit (SDU) were performed in order to realize the following key objectives: (1) to support the use of historical and future laboratory-derived sample data to predict the behavior of field-emplaced samples, and (2) to substantiate the saltstone properties currently assumed in Saltstone Disposal Facility (SDF) transport modeling, i.e., Performance Assessment (PA) and Special Analyses (SA) models. Multiple cores were extracted via a wet core drilling process in April-May 2015 approximately 20 months after the saltstone of interest was processed in the Saltstone Production Facility (SPF) and subsequently emplaced in SDU Cell 2A (SDU2A). The retrieved samples were stored in an inert N{sub 2} environment prior to, and during, the property testing that took place between October 2015 and March 2016. Sample analyses comprised evaluation of physical properties (density, porosity, and moisture content), saturated hydraulic conductivity (K{sub sat}), and determination of distribution coefficients and solubilities for key radionuclides. In general the SDU2A samples indicated comparative properties to laboratory-prepared samples and additionally verified many of the inputs currently assumed in the SDF PA. The principal exception was related to the leaching characteristics of I-129, which demonstrated a lower than anticipated affinity for retention within the saltstone matrix. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2016

Simplifying the Tracking of Waste Disposal Inventories: Process Improvement for Rapid Data Interpretation and Reduced Errors - 16143

Tracking the inventory of low-level radioactive waste at an operating disposal facility offers unique challenges. At the Savannah River Site's Saltstone Disposal Facility (SDF) the inventory used in Performance Assessment modeling is determined based on radionuclide concentrations from the aqueous waste in a feed tank and the volume of the waste that is transferred from the feed tank to the Saltstone Production Facility (SPF). These inputs are reported quarterly. As such, the disposal inventories are also updated quarterly; however, due to decay and ingrowth, the inventory values for some radionuclides can be misrepresented if the data is not tracked appropriately. Additionally, it is not feasible to analyze the feed tank samples for every possible radionuclide; therefore, a series of adjustments are necessary to estimate the concentrations of radionuclides that are not explicitly measured but still pose a potential dose risk. Prior to 2015, the SDF disposal inventories were updated using a series of spreadsheets that required users to perform a significant number of steps (including manually transferring data back and forth between a separate decay and ingrowth calculation software). Despite this labor intensive approach, the process only provided single point-in-time results. With multiple steps, minimal automation, and limited result data, this approach to inventory tracking was not ideal and minor mistakes were often identified during the equally cumbersome review process. As a process improvement, the simplified SDF Waste Inventory Disposed Estimator (SDF-WIDE) Model was developed using GoldSim software. The software allows users to identify specific dates to define the duration of the simulation, from the beginning of operations until the time of future facility closure, and provides graphical interfaces for displaying data over time. Further, GoldSim's Contaminant Transport Module is used to perform the decay and ingrowth calculations, making the model completely self-contained (i.e., there is no need to transfer intermediate data back and forth between different programs). GoldSim also includes model 'versioning' features that significantly reduce the time needed to perform the appropriate quality assurance reviews as required for each quarterly inventory update. By transitioning from the complex spreadsheets to the simplified SDFWIDE model, the time needed to perform updates to the SDF inventory has been reduced from days to hours, the risk of making human errors has been greatly mitigated, and users are able to quickly observe trends in the data over time. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗