Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Evaluation of global teleconnections in CMIP6 climate projections using complex networks

In climatological research, the evaluation of climate models is one of the central research subjects. As an expression of large-scale dynamical processes, global teleconnections play a major role in interannual to decadal climate variability. Their realistic representation is an indispensable requirement for the simulation of climate change, both natural and anthropogenic. Therefore, the evaluation of global teleconnections is of utmost importance when assessing the physical plausibility of climate projections. We present an application of the graph-theoretical analysis tool δ-MAPS, which constructs complex networks on the basis of spatio-temporal gridded data sets, here sea surface temperature and geopotential height at 500 hPa. Complex networks complement more traditional methods in the analysis of climate variability, like the classification of circulation regimes or empirical orthogonal functions, assuming a new non-linear perspective. While doing so, a number of technical tools and metrics, borrowed from different fields of data science, are implemented into the δ-MAPS framework in order to overcome specific challenges posed by our target problem. Those are trend empirical orthogonal functions (EOFs), distance correlation and distance multicorrelation, and the structural similarity index. δ-MAPS is a two-stage algorithm. In the first place, it assembles grid cells with highly coherent temporal evolution into so-called domains. In a second step, the teleconnections between the domains are inferred by means of the non-linear distance correlation. We construct 2 unipartite and 1 bipartite network for 22 historical CMIP6 climate projections and 2 century-long coupled reanalyses (CERA-20C and 20CRv3). Potential non-stationarity is taken into account by the use of moving time windows. The networks derived from projection data are compared to those from reanalyses. Our results indicate that no single climate projection outperforms all others in every aspect of the evaluation. But there are indeed models which tend to perform better/worse in many aspects. Differences in model performance are generally low within the geopotential height unipartite networks but higher in sea surface temperature and most pronounced in the bipartite network representing the interaction between ocean and atmosphere.

58 GEOSCIENCES↗
DOE OSTI2023

Regime-oriented causal model evaluation of Atlantic–Pacific teleconnections in CMIP6

The climate system and its spatio-temporal changes are strongly affected by modes of long-term internal variability, like the Pacific decadal variability (PDV) and the Atlantic multidecadal variability (AMV). As they alternate between warm and cold phases, the interplay between PDV and AMV varies over decadal to multidecadal timescales. Here, we use a causal discovery method to derive fingerprints in the Atlantic–Pacific interactions and to investigate their phase-dependent changes. Dependent on the phases of PDV and AMV, different regimes with characteristic causal fingerprints are identified in reanalyses in a first step. In a second step, a regime-oriented causal model evaluation is performed to evaluate the ability of models participating in the Coupled Model Intercomparison Project Phase 6 (CMIP6) in representing the observed changing interactions between PDV, AMV and their extra-tropical teleconnections. The causal graphs obtained from reanalyses detect a direct opposite-sign response from AMV to PDV when analyzing the complete 1900–2014 period and during several defined regimes within that period, for example, when AMV is going through its negative (cold) phase. Reanalyses also demonstrate a same-sign response from PDV to AMV during the cold phase of PDV. Historical CMIP6 simulations exhibit varying skill in simulating the observed causal patterns. Generally, large-ensemble (LE) simulations showed better network similarity when PDV and AMV were out of phase compared to other regimes. Also, the two largest ensembles (in terms of number of members) were found to contain realizations with similar causal fingerprints to observations. For most regimes, these same models showed higher network similarity when compared to each other. This work shows how causal discovery on LEs complements the available diagnostics and statistical metrics of climate variability to provide a powerful tool for climate model evaluation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Assessment of the ParFlow–CLM CONUS 1.0 integrated hydrologic model: evaluation of hyper-resolution water balance components across the contiguous United States

Abstract. Recent advancements in computational efficiency and Earth system modeling have awarded hydrologists with increasingly high-resolution models of terrestrial hydrology, which are paramount to understanding and predicting complex fluxes of moisture and energy. Continental-scale hydrologic simulations are, in particular, of interest to the hydrologic community for numerous societal, scientific, and operational benefits. The coupled hydrology–land surface model ParFlow–CLM configured over the continental United States (PFCONUS) has been employed in previous literature to study scale-dependent connections between water table depth, topography, recharge, and evapotranspiration, as well as to explore impacts of anthropogenic aquifer depletion to the water and energy balance. These studies have allowed for an unprecedented process-based understanding of the continental water cycle at high resolution. Here, we provide the most comprehensive evaluation of PFCONUS version 1.0 (PFCONUSv1) performance to date by comparing numerous modeled water balance components with thousands of in situ observations and several remote sensing products and using a range of statistical performance metrics for evaluation. PFCONUSv1 comparisons with these datasets are a promising indicator of model fidelity and ability to reproduce the continental-scale water balance at high resolution. Areas for improvement are identified, such as a positive streamflow bias at gauges in the eastern Great Plains, a shallow water table bias over many areas of the model domain, and low bias in seasonal total water storage amplitude, especially for the Ohio, Missouri, and Arkansas River basins. We discuss several potential sources for model bias and suggest that minimizing error in topographic processing and meteorological forcing would considerably improve model performance. Results here provide a benchmark and guidance for further PFCONUS model development, and they highlight the importance of concurrently evaluating all hydrologic components and fluxes to provide a multivariate, holistic validation of the complete modeled water balance.

O'Neill, Mary M. F. (ORCID:0000000221455165)↗
DOE OSTI2022

Implementation and evaluation of the unified stomatal optimization approach in the Functionally Assembled Terrestrial Ecosystem Simulator (FATES)

Abstract. Stomata play a central role in regulating the exchange of carbon dioxide and water vapor between ecosystems and the atmosphere. Their function is represented in land surface models (LSMs) by conductance models. The Functionally Assembled Terrestrial Ecosystem Simulator (FATES) is a dynamic vegetation demography model that can simulate both detailed plant demographic and physiological dynamics. To evaluate the effect of stomatal conductance model formulation on forest water and carbon fluxes in FATES, we implemented an optimality-based stomatal conductance model – the Medlyn (MED) model – that simulates the relationship between photosynthesis (A) and stomatal conductance to water vapor (gsw) as an alternative to the FATES default Ball–Woodrow–Berry (BWB) model. To evaluate how the behavior of FATES is affected by stomatal model choice, we conducted a model sensitivity analysis to explore the response of gsw to climate forcing, including atmospheric CO2 concentration, air temperature, radiation, and vapor pressure deficit in the air (VPDa). We found that modeled gsw values varied greatly between the BWB and MED formulations due to the different default stomatal slope parameters (g1). After harmonizing g1 and holding the stomatal intercept parameter (g0) constant for both model formulations, we found that the divergence in modeled gsw was limited to conditions when the VPDa exceeded 1.5 kPa. We then evaluated model simulation results against measurements from a wet evergreen forest in Panama. Results showed that both the MED and BWB model formulations were able to capture the magnitude and diurnal changes of measured gsw and A but underestimated both by about 30 % when the soil was predicted to be very dry. Comparison of modeled soil water content from FATES to a reanalysis product showed that FATES captured soil drying well, but translation of drying soil to modeled physiology reduced the models' ability to match observations. Our study suggests that the parameterization of stomatal conductance models and current model response to drought are the critical areas for improving model simulation of CO2 and water fluxes in tropical forests.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3

Systematic, routine, and comprehensive evaluation of Earth system models (ESMs) facilitates benchmarking improvement across model generations and identifying the strengths and weaknesses of different model configurations. By gauging the consistency between models and observations, this endeavor is becoming increasingly necessary to objectively synthesize the thousands of simulations contributed to the Coupled Model Intercomparison Project (CMIP) to date. The Program for Climate Model Diagnosis and Intercomparison (PCMDI) Metrics Package (PMP) is an open-source Python software package that provides quick-look objective comparisons of ESMs with one another and with observations. The comparisons include metrics of large- to global-scale climatologies, tropical inter-annual and intra-seasonal variability modes such as the El Niño–Southern Oscillation (ENSO) and Madden–Julian Oscillation (MJO), extratropical modes of variability, regional monsoons, cloud radiative feedbacks, and high-frequency characteristics of simulated precipitation, including its extremes. The PMP comparison results are produced using all model simulations contributed to CMIP6 and earlier CMIP phases. An important objective of the PMP is to document the performance of ESMs participating in the recent phases of CMIP, together with providing version-controlled information for all datasets, software packages, and analysis codes being used in the evaluation process. Among other purposes, this also enables modeling groups to assess performance changes during the ESM development cycle in the context of the error distribution of the multi-model ensemble. Quantitative model evaluation provided by the PMP can assist modelers in their development priorities. In this paper, we provide an overview of the PMP, including its latest capabilities, and discuss its future direction.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Synthesis of historical reservoir operations from 1980 to 2020 for the evaluation of reservoir representation in large-scale hydrologic models

Abstract. All the major river systems in the contiguous United States (CONUS) (and many in the world) are impacted by dams, yet reservoir operations remain difficult to quantify and model due to a lack of data. Reservoir operation data are often inaccessible or distributed across many local operating agencies, making the acquisition and processing of data records quite time-consuming. As a result, large-scale models often rely on simple parameterizations for assumed reservoir operations and have a very limited ability to evaluate how well these approaches match actual historical operations. Here, we use the first national dataset of historical reservoir operations in the CONUS domain, ResOpsUS, to analyze reservoir storage trends and operations in more than 600 major reservoirs across the US. Our results show clear regional differences in reservoir operations. In the eastern US, which is dominated by flood control storage, we see storage peaks in the winter months with sharper decreases in the operational range (i.e., the difference between monthly maximum and minimum storage) in the summer. In the more arid western US where storage is predominantly for irrigation, we find that storage peaks during the spring and summer with increases in the operational range during the summer months. The Lower Colorado region is an outlier because its seasonal storage dynamics more closely mirrored those of flood control basins, yet the region is classified as arid, and most reservoirs have irrigation uses. Consistent with previous studies, we show that average annual reservoir storage has decreased over the past 40 years, although our analyses show a much smaller decrease than previous work. The reservoir operation characterizations presented here can be used directly for development or evaluation of reservoir operations and their derived parameters in large-scale models. We also evaluate how well historical operations match common assumptions that are often applied in large-scale reservoir parameterizations. For example, we find that 100 dams have maximum storage values greater than the reported reservoir capacity from the Global Reservoirs and Dams database (GRanD). Finally, we show that operational ranges have been increasing over time in more arid regions and decreasing in more humid regions, pointing to the need for operating policies which are not solely based on static values.

Geology↗
DOE OSTI2025

Evaluating mesoscale model predictions of diurnal speedup events in the Altamont Pass Wind Resource Area of California

Mesoscale model predictions of wind, turbulence, and wind energy capacity factors are evaluated in the Altamont Pass Wind Resource Area of California (APWRA), where the diurnal regional sea breeze and associated terrain-driven speedup flows drive wind energy production during the summer months. Results from the Weather Research and Forecasting model version 4.4 using a novel three-dimensional planetary boundary layer (3D PBL) scheme, which treats both vertical and horizontal turbulent mixing, are compared to those using a well-established one-dimensional (1D) scheme that treats only vertical turbulent mixing. Each configuration is evaluated over a nearly 3-month-long period during the Hill Flow Study, and due to the recurring nature of the observed speedup flows, diurnal composite averaging is used to capture robust trends in model performance. Both model configurations showed similar overall skill. The general timing and direction of the speedup flows is captured, but their magnitude is overestimated within a typical wind turbine rotor layer. Both also fail to capture a persistent observed near-surface jet-like flow, likely due to the limited grid resolution that is typical of mesoscale models. However, the 3D PBL configuration shows several minor improvements over the 1D PBL configuration, including improved wind speed and turbulence kinetic energy profiles during the accelerating phase of the speedup events, as well as reduced positive wind speed bias at surface stations across the APWRA region. Using a mesoscale wind farm parameterization, modeled capacity factors are also compared to monthly data reported to the US Energy Information Administration (EIA) during the study period. Although the monthly trend in the data is captured, both model configurations overestimate capacity factors by roughly 7 %–11 %. Through model evaluation, this study provides confidence in the 3D PBL scheme for wind energy applications in complex terrain and provides guidance for future testing.

17 WIND ENERGY↗
DOE OSTI2022

A Prospective Design Method for Nuclear Power: The Evaluation, Requirements, and Goals Outline for Nuclear (ERGON) Method

Human factors researchers at Idaho National Laboratory (INL) have worked on projects spanning control room modernization, operator support systems, visualization design, and novel system creation. These projects demonstrated the need for an explicit design method for nuclear power. Human factors teams found a high standard in the Human Factors Engineering Program Review Model (NUREG-0711) and needed a design methodology which could be successful in gaining approval. Previous work has been synthesized as the Evaluation, Requirements, and Goals Outline for Nuclear (ERGON) method here. Design tasks are broken into four phases: Context and Orientation, Human Factors Review, Prototyping and Evaluation, Iteration and Improvement. ERGON is intended as a flexible and direct design method for many applications in nuclear power. ERGON has been vetted through collaborative research and development with nuclear utilities and as such, the ERGON method can assist utilities to achieve approval from a NUREG-0711 summative evaluation for HSI implementations.

42 ENGINEERING↗
DOE OSTI2024

Measuring Impact: Evaluating Thermal Zoning Simplification on Energy Efficiency Measures Analysis

Building Energy Modeling (BEM) is a versatile tool for designing, retrofitting, ensuring code compliance, obtaining certifications, qualifying for incentives, and enabling real-time building control. However, capturing all the details of building geometry for thermal zoning can be time-consuming, costly, and sometimes computationally challenging. As a result, modelers have been applying zoning simplification based on factors such as space functions and internal loads, as well as relying on their experience and judgment while adhering to zoning rules outlined in industry standards. Despite the prevalence of this common practice, a notable gap exists in the literature regarding studies quantifying the influence of simplified thermal zoning on the evaluation of Energy Efficiency Measures (EEMs). Recognizing this gap, this paper seeks to contribute to the field by enhancing the understanding of how the simplification of thermal zoning influences the evaluation of EEMs against a baseline design. The study utilized a medium office prototype model with a detailed floor plan featuring over 20 zones per floor covering diverse functional spaces with varying internal loads and occupancy schedules. A standard thermal zoning strategy outlined in ASHRAE Standard 90.1 Appendix G was employed as the simplified zoning method. This strategy condenses the zoning into a core zone and four perimeter zones per floor. It was compared with the detailed zoning approach, which involves one zone per space. Common Energy EEMs, such as enhanced envelope, high-efficiency appliances and equipment, and HVAC controls, were individually implemented and evaluated. The results indicate that the performance comparison between the two zoning methods varies depending on the type of measures considered. Basic measures, such as adding wall insulation, demonstrate similar energy impacts, while advanced HVAC control measures, such as static pressure reset, exhibit a more substantial difference that cannot be overlooked.

Xie, Jiarong↗
DOE OSTI2020

Remote Hardware-in-the-Loop Approach for Microgrid Controller Evaluation: Preprint

Utilities have been installing microgrids due to the advancements in the distributed energy resources technologies. Microgrids also improve the resiliency of the system due to their capability to isolate themselves from the grid and run in islanded mode of operation. Microgrid controllers are management systems that can run the microgrids under varied operating condition and enable the smooth operation of microgrids under various system conditions. It is of high value to de-risk the installation of such controllers. Hardware-in-the-loop evaluation is used by controller developers and utilities to evaluate the controllers under stressful conditions to understand the performance and to understand the necessary improvements to the microgrid controller. In this research work, the team has leveraged the existing infrastructure of real-time simulation at the Energy Systems Integration Facility (ESIF) and the capability of the microgrid controller to control assets over the Internet Protocol (IP) to evaluate a university developed microgrid controller in an efficient and cost-effective manner. The full paper will provide the complete setup, the experimental use cases and the results. In this abstract, one use case will be expalined, and the results from the use case is provided.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Vertex Reordering for Real-world Graphs and Applications: An Empirical Evaluation

Vertex reordering is a way to improve locality in graph computations. Given an input (or ``natural'') order, reordering aims to compute an alternate permutation of the vertices that is aimed at maximizing a locality-based objective. Given decades of research on this topic, there are tens of graph reordering schemes, and there are also several linear arrangement ``gap'' measures for treatment as objectives. However, a comprehensive empirical analysis of the efficacy of the ordering schemes against the different gap measures, and against real-world applications is currently lacking. In this study, we present an extensive empirical evaluation of up to 11 ordering schemes, taken from different classes of approaches, on a set of 34 real-world graphs emerging from different application domains. Our study is presented in two parts: a) a thorough comparative evaluation of the different ordering schemes on their effectiveness to optimize different linear arrangement gap measures, relevant to preserving locality; and b) extensive evaluation of the impact of the ordering schemes on two real-world, parallel graph applications, namely, community detection and influence maximization. Our studies show a significant divergence among the ordering schemes (up to $40\times$ between the best and the poor) in their effectiveness to reduce the gap measures; and a wide ranging impact of the ordering schemes on various aspects including application runtime (up to $4\times$), memory and cache use, load balancing, and parallel work and efficiency. The comparative study also help reveal the nuances of a parallel environment (compared to serial) on the ordering schemes and their role in optimizing applications.

Barik, Reet↗
DOE OSTI2020

Evaluation of Graph Analytics Frameworks Using the GAP Benchmark Suite

The analysis of connected data is an increasingly important application in high-performance computing. Such analyses can reveal fraudulent patterns in financial transactions, optimize telecommunications networks, predict information flow in social networks, etc. However, the landscape of graph analytics is highly diverse. Graph algorithms stress processor architectures differently, and no one graph can represent all topologies. Consequently, no single approach or framework is expected to be optimal for all graph analytics problems. To help make sense of this diverse landscape, we evaluated four approaches to graph analytics: GraphBLAS, Galois, BGL17, GraphIt; and compare them against hand-tuned implementations that take advantage of hardware features on our test platform. Graph- BLAS formulates graph analytics as sparse linear algebra. Galois provides syntactic constructs for data parallelism over irregular data structures. BGL17 is a generic C++ template library for implementing graph algorithms. GraphIt provides a domain- specific language to describe and optimize graph algorithms. We use the GAP Benchmark Suite to establish baseline performance and guide the side-by-side evaluation of each framework. GAP consists of 30 tests: six graph analytics algorithms (breadth- first search, single-source shortest path, PageRank, betweenness centrality, connected components, and triangle counting) run on five graphs, each with different topological characteristics (e.g., high diameter, skewed degree distribution, high average degree). High-performance reference implementations are included for each benchmark algorithm. Because a graph can be loaded into memory a number of ways (e.g., flat file on disk, compressed sparse format, data frames, retrieved from SQL or NoSQL databases), our evaluation focused on computational performance rather than I/O. Our results show the relative strengths of each framework.

Graph algorithms, Benchmarking, shared-memory prog↗
DOE OSTI2020

Performance Evaluation of Python Based Data Analytics Frameworks in Summit: Early Experiences

The explosion in the volumes of data generated from ever-larger simulation campaigns and experiments or observations necessitates competent tools for data wrangling and analysis). While the Oak Ridge Leadership Computing Facility (OLCF) provides a variety of tools to perform data wrangling and data analysis tasks, Python based tools often lack scalability, or the ability to fully exploit the computational capability of OLCF’s Summit supercomputer. NVIDIA RAPIDS and Dask offer a promising solution to accelerate and distribute data analytics workloads from personal computers to heterogeneous supercomputing systems. We discuss early performance evaluation results of RAPIDS and Dask on Summit to understand their capabilities, scalability, and limitations. Our evaluation includes a subset of RAPIDS libraries, i.e., cuDF, cuML, and cuGraph, and Chainer’s CuPy, and their multi-GPU variants when available.We also draw on the observed trends from the performance evaluation results to discuss best practices for maximizing performance.

Hernandez Arreguin, Benjamin↗
DOE OSTI2020

EVALUATION OF CONTROLLED END GAS AUTO IGNITION WITH EXHAUST GAS RECIRCULATION IN A STOICHIOMETRIC, SPARK IGNITED, NATURAL GAS ENGINE

Many stationary and heavy-duty on-road natural gas fueled engines today operate under stoichiometric conditions with a three-way catalyst. The disadvantage of stoichiometric natural gas engines compared to lean-burn natural gas and diesel engines is lower efficiency, resulting primarily from lower power density and compression ratio. Exhaust gas recirculation (EGR) coupled with advanced combustion controls can enable operation with higher compression ratio and power density, which yields higher efficiency. This also results in engine operation between the limits of knock and misfire. Operation between these limits has been named controlled end gas auto-ignition (C-EGAI) and can be used to improve the brake efficiency of the engine. Various methods of cylinder pressure-based knock quantification were explored to implement C-EGAI. The indicated quantification methods are used for the implementation of a control scheme for C-EGAI with a relation to the fractional heat release due to auto-ignition. A custom EGR system was built and the effect of EGR on the performance of a stochiometric, spark ignited, natural gas engine is evaluated. C-EGAI is implemented and the optimal parameters are determined for peak performance under EGR and C-EGAI conditions. In this study, knock detection is used for the recognition, magnitude, and location of the auto-ignition events. Cylinder pressure-based knock detection was the primary method for determining the occurrence and location of knock but was also used for implementing the ignition control scheme for controlled end gas auto-ignition. The combustion intensity metric (CIM) enabled parametric ignition timing control which allowed for the creation of a relationship between fractional heat release due to auto-ignition and CIM. Many stationary and heavy-duty on-road natural gas fueled engines today operate under stoichiometric conditions with a three-way catalyst. The disadvantage of stoichiometric natural gas engines compared to lean-burn natural gas and diesel engines is lower efficiency, resulting primarily from lower power density and compression ratio. Exhaust gas recirculation (EGR) coupled with advanced combustion controls can enable operation with higher compression ratio and power density, which yields higher efficiency. This also results in engine operation between the limits of knock and misfire. Operation between these limits has been named controlled end gas auto-ignition (C-EGAI) and can be used to improve the brake efficiency of the engine. Various methods of cylinder pressure-based knock quantification were explored to implement C-EGAI. The indicated quantification methods are used for the implementation of a control scheme for C-EGAI with a relation to the fractional heat release due to auto-ignition. A custom EGR system was built and the effect of EGR on the performance of a stochiometric, spark ignited, natural gas engine is evaluated. C-EGAI is implemented and the optimal parameters are determined for peak performance under EGR and C-EGAI conditions. In this study, knock detection is used for the recognition, magnitude, and location of the auto-ignition events. Cylinder pressure-based knock detection was the primary method for determining the occurrence and location of knock but was also used for implementing the ignition control scheme for controlled end gas auto-ignition. The combustion intensity metric (CIM) enabled parametric ignition timing control which allowed for the creation of a relationship between fractional heat release due to auto-ignition and CIM. Both exhaust gas recirculation and controlled end gas auto-ignition were analyzed with a cooperative fuel research (CFR) engine modified for boosted fuel/air intake. The data was interpreted to provide a proper evaluation of unique analytical methods to quantify the results of C_EGAI and characterize the live auto-ignition events. The control variables for this method of C-EGAI were optimized with EGR conditions to generate the point of peak performance on the CFR engine under stoichiometric, spark ignited, natural gas conditions.

Bayliff, Scott Michael↗
DOE OSTI2022

Advanced Power-Hardware-in-the-Loop Evaluation of Inverter-Based Resources (IBRs)

Power-hardware-in-the-loop evaluation of IBRs has become more and more important as it provides reliable testing results to investigate the real responses of inverters with interconnected systems. A successful laboratory PHIL testing gives confidence of the hardware system to be deployed and de-risk technology integration prior to field deployment. So far, there are two important applications for PHIL evaluation: (1) test stability and functionality of large utility inverters into the system when it interconnects to the distribution systems/microgrids; and (2) test the collective grid service that inverters can provide to the grid. For the first application, the PHIL evaluation has high requirements for the stability and accuracy of the PHIL interface as the close-loop in digital real time simulator (DRTS) should replicate the actual current and voltage dynamics in the inverter. This is challenging because of the delays, sensing errors, nonlinearities of inverters, and hardware bandwidth limitations of the elements in the HIL loop. For the second application, multiple inverters will be tested resulting in multiple PCCs, which naturally causes competing dynamics and oscillations among hardware inverters if traditional PHIL interface is used. Therefore, new PHIL interface should be developed to compromise between stability and accuracy and represent the dispatched grid services for the hardware inverters. In this presentation, we will share our latest work in developing PHIL interface in these two applications to address the two key challenges.

DERMS↗
DOE OSTI2021

Evaluating the ProtoDUNE-SP Detector Performance to Measure a 6 GeV/c Positive Kaon Inelastic Cross Section on Argon

The ProtoDUNE Single-Phase Liquid Argon Time Projection Chamber \\ (ProtoDUNE-SP LArTPC) is a prototype for the Deep Underground Neutrino Experiment (DUNE), a future long-baseline neutrino oscillation experiment. Based at the CERN Neutrino Platform, ProtoDUNE-SP LArTPC collected data from a charged test beam in the fall of 2018. It then took data of cosmic-ray muons from November 2018 to the summer of 2020. The main goals of the prototype were to measure parameters related to charged particle passage in argon and evaluate the performance of the detector to inform future DUNE Far Detector development. The test beam provided kaons, pions, muons, protons, and electrons to the detector. These particles represent common final state particles in neutrino interactions, therefore providing information to DUNE on modeling charged particles in argon for its neutrino physics program. In addition to neutrino physics, DUNE has proposed an analysis using the DUNE Far Detector module to set limits for proton decay through the decay channel $p\rightarrow K^++\bar{\nu}$. This measurement would require information on kaons in argon, providing ProtoDUNE-SP LArTPC another opportunity to aid DUNE. This thesis describes the calibration of ProtoDUNE-SP and its detector performance, which serves as a benchmark for the performance of the DUNE Far Detector modules. A specific calibration highlighted is the evaluation of the liquid argon purity in the detector. These measurements use cosmic-ray muons reconstructed in the detector that are calibrated and matched to data from scintillator strips external to the TPC, known as the Cosmic Ray Tagger (CRT). The thesis will discuss the algorithms to match the data between the ProtoDUNE-SP LArTPC and the CRT and discuss the liquid argon purity measurements using one of the algorithms. Data sets of calibrated tracks measured the liquid argon contamination as consistently below 100 ppt oxygen equivalent. After these discussions on the ProtoDUNE-SP LArTPC detector, the thesis will present an evaluation of the inclusive inelastic, sometimes referred to as a reactive, cross section on argon of kaons from the ProtoDUNE-SP test beam with an average momentum of 6 GeV/c.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Dynamic Human-in-the-Loop Simulated Nuclear Power Plant Thermal Dispatch System Demonstration and Evaluation Study

An Idaho National Laboratory research team performed a human-in-the-loop study with two formerly licensed retired operators to evaluate thermal power dispatch operations supported by the modified GSE Systems GPWR plant simulator. Virtual representations of the analog control panels were presented on touch-screen bays configured to mimic the control room layout in the newly renovated Human Systems Simulation Laboratory. The operators performed 15 scenarios covering normal evolutions to transition the plant from full turbine operation to joint turbine and thermal power dispatch operations in addition to transient response scenarios induced with simulated faults to evaluate the impact of thermal power dispatch system on operator and plant responses. A prototype human-system interface (HSI) was developed and displayed in tandem with the virtual analog panels to support the operators executing the procedurally drive evolutions and transient responses. An interdisciplinary team of operations experts, nuclear engineers, and human factors experts observed the operators performing the scenarios to evaluate the operations. Only a preliminary analysis of the results has been performed. The full analysis will be shared in a milestone report scheduled for release at the end of September; however, some high-level conclusions were readily available. Two high level findings for the system design were captured in the study. The manual control supported by the HSI to transition from standard operations to thermal power dispatch operation imposed a considerable amount of workload on the operators due to tedious manual valve manipulations and system monitoring required to verify their intended effect. An additional operator would be required in the control room to support the daily evolution. Automatic control for the transition was deemed a requirement for plant adoption without imposing additional staffing costs. The second finding was the necessity for an automatic thermal power dispatch system trip isolation function linked to a turbine and reactor trip signal. The operators completed scenarios with automatic isolation functionality and manually required actuation of the thermal power dispatch system. The operator response was sufficiently slower in the manual trip condition, such that operators were unable to manually actuate key post trip safety functions an indicate a degraded control capability that should be avoided. With an automatic trip signal little to no impact of the thermal power dispatch system was identified on the primary plant response and therefore the system could be readily and safely adopted. Together these two findings represent the need to support the adoption of thermal power dispatch capability into existing operations by leveraging automation to augment any additional operator tasking required to control and monitor an additional system beyond existing operations.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

Generalized Bayesian Framework for Evaluation of Integral Benchmark Experiments

A recently published generalized Bayesian optimization framework has provided a way to retract any or all of the three common assumptions underlying the conventional Generalized Linear Least Squares (GLLS) optimization method based on the concepts introduced in reference two. These assumptions are: 1. Perfection: The model used for data evaluation and the prior probability distribution function (PDF) of generalized* data are perfect; 2. Normality: The prior and posterior PDF are normal; and 3. Linearity: The model is linear. In this work we outline how the framework in 1 could be directly adopted for improved evaluation of nuclear criticality integral benchmark experiments (IBEs) by: 1. Removing the first assumption alone by utilizing the concept of imperfections introduced in 1 to enable evaluation in the presence of discrepancies between the data and model or of missing covariance information by a GLLS method that will be seen as a generalization of the conventional GLLS method employed by the TSURFER code, and by 2. Removing the remaining two assumptions by implement- ing a Markov Chain Monte Carlo method for computation of the posterior PDF in the SAMPLER code, where TSURFER and SAMPLER are the uncertainty quantification (UQ) codes for IBEs in the SCALE code system based on the GLLS, and the stochastic method, respectively.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗