Validation of Inflow Creation Methods Using Data Assimilation Against SCADA Data: Trends from a field campaign
Explore the source record for details and available documents.
Houck, Daniel Russell↗
SEARCH · Engineering Papers
Results for “data validation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Large Eddy Simulations of Turbulent and Buoyant Flows in Urban and Complex Terrain Areas Using the Aeolus Model
Fast and accurate predictions of the flow and transport of materials in urban and complex terrain areas are challenging because of the heterogeneity of buildings and land features of different shapes and sizes connected by canyons and channels, which results in complex patterns of turbulence that can enhance material concentrations in certain regions. To address this challenge, we have developed an efficient three-dimensional computational fluid dynamics (CFD) code called Aeolus that is based on first principles for predicting transport and dispersion of materials in complex terrain and urban areas. The model can be run in a very efficient Reynolds average Navier–Stokes (RANS) mode or a detailed large eddy simulation (LES) mode. The RANS version of Aeolus was previously validated against field data for tracer gas and radiological dispersal releases. As a part of this work, we have validated the Aeolus model in LES mode against two different sets of data: (1) turbulence quantities measured in complex terrain at Askervein Hill; and (2) wind and tracer data from the Joint Urban 2003 field campaign for urban topography. As a third set-up, we have applied Aeolus to simulate cloud rise dynamics for buoyant plumes from high-temperature explosions. For all three cases, Aeolus LES predictions compare well to observations and other models. These results indicate that Aeolus LES can be used to accurately simulate turbulent flow and transport for a wide range of applications and scales.
42 ENGINEERING↗
Standardized Architecture for a Mega-Biobank Phenomic Library: The Million Veteran Program (MVP)
Electronic health records (EHRs) provide a wealth of data for phenotype development in population health studies, and researchers invest considerable time to curate data elements and validate disease definitions. The ability to reproduce well-defined phenotypes increases data quality, comparability of results and expedites research. In this paper, we present a standardized approach to organize and capture phenotype definitions, resulting in the creation of an open, online repository of phenotypes. This resource captures phenotype development, provenance and process from the Million Veteran Program, a national mega-biobank embedded in the Veterans Health Administration (VHA). To ensure that the repository is searchable, extendable, and sustainable, it is necessary to develop both a proper digital catalog architecture and underlying metadata infrastructure to enable effective management of the data fields required to define each phenotype. Our methods provide a resource for VHA investigators and a roadmap for researchers interested in standardizing their phenotype definitions to increase portability.
Knight, Kathryn↗
Validation of SCALE 6.2.4 and ENDF/B-VII.1 data libraries for nuclide inventory analysis in PWR used fuel
Explore the source record for details and available documents.
Ilas, Germina↗
Standardized Architecture for a Mega-Biobank Phenomic Library: The Million Veteran Program (MVP)
Electronic health records (EHRs) provide a wealth of data for phenotype development in population health studies, and researchers invest considerable time to curate data elements and validate disease definitions. The ability to reproduce well-defined phenotypes increases data quality, comparability of results and expedites research. In this paper, we present a standardized approach to organize and capture phenotype definitions, resulting in the creation of an open, online repository of phenotypes. This resource captures phenotype development, provenance and process from the Million Veteran Program, a national mega-biobank embedded in the Veterans Health Administration (VHA). To ensure that the repository is searchable, extendable, and sustainable, it is necessary to develop both a proper digital catalog architecture and underlying metadata infrastructure to enable effective management of the data fields required to define each phenotype. Our methods provide a resource for VHA investigators and a roadmap for researchers interested in standardizing their phenotype definitions to increase portability.
Knight, Kathryn↗
Validation of CTF Models Using NRC Data from RBHT Reflood Experiments
Explore the source record for details and available documents.
Stoppel, Alicja [Purdue University]↗
Single Primary Heat Extraction and Removal Emulator (SPHERE) Long Duration Testing
For the development of heat-pipe cooled microreactors, it is crucial to thoroughly understand the characteristics and functioning of heat pipes across a wide spectrum of operating conditions. Passive heat removal and its long-term performance stability are critical factors in this context. Enhanced experimental data is vital for evaluating the operational lifespan of alkali metal heat pipes. Idaho National Laboratory (INL) has successfully conducted an extended duration test on a high-performance sodium-filled heat pipe, closely monitoring the axial temperature profile, power supplied by the heaters, and heat removed by a gas-gap calorimeter. The results from this testing provide valuable data that are instrumental in supporting heat pipe validation efforts. Specifically, this data aids in the development and validation of Sockeye, the Multiphysics Object-Oriented Simulation Environment (MOOSE) tool under the US-DOE NEAMS program designed for heat pipe modeling. By comparing experimental results with Sockeye’s predictions, the tool's accuracy and reliability can be assessed and improved, thereby enhancing its capability to simulate heat pipe operations under various conditions.
22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
Validation of Spent Fuel Dose Rate Calculations Using NDA Measurement Campaign Data
The predicted radiation gamma dose rate is a key parameter to determine if a spent nuclear fuel assembly is self-protected from misuse as well as an indicator for worker/inspector safety. Recent studies showed that using state-of-the-art techniques for dose rate calculations, including the one adopted for this study, the numerical calculations of the gamma dose rates are three times lower than those from the most commonly-cited reference values for spent LWR fuel used by domestic and international agencies. With only a few publically available experimental data points worldwide for this type of benchmark study, the gamma flux measurements from the Spent Fuel Non Destructive Assay (NDA) measurement campaign can be used to help validate the physics approach used in calculating gamma dose rates. Specifically, this data would validate the gamma flux calculation from spent fuel, which is a key component of these multi-physics techniques for dose rate assessments; dose rate measurements were not part of the NDA campaign. These data are primarily the passive gamma measurements of the spent nuclear fuel assemblies from the Swedish Nuclear Fuel and Waste Management Company (SKB).
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
Improvements to the New CTH Code Verification & Validation Test Suite (FY2020)
The CTH multiphysics hydrocode, which is used for a wide range of important calculations, has undertaken in recent years to overhaul its software quality and testing processes. A key part of this effort entailed building a new, robust V&V test suite made up of traditional hydrocode verification problems, such as those listed in the ASC Tri-Lab Test Suite and the Enhanced Tri-Lab Test Suite, as well as validation problems for some of CTHs most frequently used equations of state, materials models, and other key capabilities. Substantial progress towards this goal was made in FY19. In FY20, this test suite has been expanded to include verification and validation tests of the Sesame and JWL equation of state models as well as the Mader verification problem from the Tri-Lab Test Suite and the Blake verification problem - a linear elastic analog to the Hunter problem from the Enhanced Tri-Lab Test Suite. This report documents CTH performance on the new test suite problems. Verification test results are compared to analytic solutions and, for most tests, convergence results are presented. Validation test results are compared to experimental data and mesh refinement studies are included. CTH performs well overall on the new test problems. Convergence rates for the Blake and Mader problems are comparable to those for similar ASC codes. The JWL and Sesame verification tests show good agreement with analytic solutions. Likewise, CTH simulation results show good agreement with experimental validation data for the Sesame and JWL equations of state for the materials tested. Future V&V work will focus on adding tests for other key capabilities like fracture and high explosive models.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
Early Battery Performance Prediction for Mixed Use Charging Profiles Using Hierarchal Machine Learning
A key step limiting how fast batteries can be deployed is the time necessary to provide evaluation and validation of performance. Using data analysis approaches, such as machine learning, the validation process can be accelerated. However, questions on the validity of projecting models trained on limited data or simple cycling profiles, such as constant current cycling, to real-world scenarios with complex loads remains. Here, we present the ability to predict performance with less than 1.2% mean absolute percent error when trained on cells aged using complex electric vehicle discharge profiles, and either AC Level 2 charge or DC Fast charge profiles, using only the first 45 cycles, namely 5% of the total testing time. While error is low across the projections, this study also highlights that battery lifetime analysis using only cycling data may not extrapolate safely to certain real-world conditions due to the impact of calendar degradation.
25 ENERGY STORAGE↗
VALIDATION, VERIFICATION, AND CALIBRATION THROUGH A CAUSAL LENS
This paper presents an alternative method based on causal inference to perform validation, verification, and calibration of simulation models. While classical validation and verification approaches focus on the identification of the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on the identification of causal relationships between data elements. Statistical and machine learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between datasets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, then the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles it is known as a directed acyclic graph (DAG). A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and from experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts have a means to identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.
97 MATHEMATICS AND COMPUTING↗
Model-based economic analysis under uncertainty for PFAS treatment by granular activated carbon and ion exchange technologies
Recent drinking water regulations have imposed the need for per- and polyfluoroalkyl substances (PFAS) remediation. In response, treatment facilities may be required to retrofit existing treatment schemes to treat PFAS below maximum contaminant levels (MCLs). Adsorption technologies such as granular activated carbon (GAC) and ion exchange (IX) have been demonstrated to be effective; however, there are limited techno-economic metrics available which provide guidance on technology selection and design for diverse PFAS-containing source water conditions. Process systems engineering (PSE) tools which can traditionally perform these analyses are hindered by the data availability, model validity, and understanding of treatment phenomena for emerging contaminants. This work employs published data regressions, statistical models, process models, techno-economic analyses, and other process systems tools in a model-based uncertainty framework to consider the limitations of emerging contaminant research. Through this analysis framework, economic results are provided as probabilistic distributions based on the uncertainty of the models and diverse conditions that treatment facilities experience.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
FY2021 Improvements to the New CTH Code Verification & Validation Test Suite
Over the past few years, the CTH multiphysics hydrocode has overhauled its software quality and testing processes, implementing current best practices in software quality and building a robust V&V test suite comprised of traditional hydrocode verification problems, including ASC Tri-Lab Test Suite and Enhanced Tri-Lab Test Suite problems, as well as validation problems for some of CTH’s most frequently used equations of state, materials models, and other key capabilities. Substantial progress towards building this new test suite was made in FY19 and FY20. In FY21, the test suite has been expanded to include verification and validation tests of the Steinberg-Guinan-Lund (ST) viscoplastic model and the Johnson Cook (JFRAC) fracture model. Additionally, two new verification tests were added, covering hydrodynamics and high explosive (HE) modeling capabilities: the Kidder Gaussian density problem and the Escape of HE Products (EHEP) problem from the Tri-Lab Test Suite. This report discusses each of these test problems in detail. Verification test results are compared to analytic solutions. Validation test results are compared to experimental data. Wherever possible, convergence or mesh refinement studies are included. Additionally, while implementing the Kidder verification problem, a bug was identified that affects the use of tables to initialize pressure or density in 1D or 2D calculations. A brief discussion of the bug and its fix is included. CTH demonstrates good performance overall on the new test suite problems. Simulation results showed good agreement with analytic solutions for the Kidder problem, with convergence rates ranging between 1.8 and sub-linear, and relatively good agreement for the EHEP problem, though convergence rates for pressure and density were nearly 0. The ST and JFRAC strain rate loading verification tests show good agreement with analytic solutions. Likewise, CTH simulation results show good agreement with experimental validation data, including Taylor rod impact testing, for the materials tested. Future V&V work will focus on adding 2D and 3D versions of existing verification tests as well as adding validation tests of other frequently used capabilities such as other fracture models.
42 ENGINEERING↗
SAM Code Validation on Frictional Pressure Drop through Pebble Beds
The System Analysis Module (SAM) is currently under development at Argonne National Laboratory as a modern system-level modeling and simulation tool for safety analyses of advanced non-light water reactors. This report presents a recent effort to validate the capability of SAM to predict the frictional pressure drop through pebble beds. Selected experimental data were used for code validation, including data from test facilities at Texas A&M University, Missouri University of Science and Technology, and North-West University of South Africa. SAM implements three empirical correlations to predict frictional pressure drop: the classical Ergun correlation; the KTA correlation, which is widely used in high-temperature gas-cooled reactor applications; and the Eisfeld and Schnitzlein correlation, which explicitly considers wall effect. Code validation was performed using all three correlations. For all selected experimental data, the KTA correlation shows the best performance and agrees very well with experimental measurement; the Eisfeld and Schnitzlein correlation, explicitly considering wall effects, shows acceptable accuracy, while there is no evidence that it is better than the KTA correlation; the Ergun correlation, however, over-predicts frictional pressure drop for most selected data points.
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
Advancing Offshore Wind Resource Characterization Using Buoy-based Observations
As countries continue to implement sustainable and renewable energy goals, the need for affordable low-carbon technologies, including those related to offshore wind energy, is accelerating. The U.S. federal government recognizes the environmental and economic benefits of offshore wind development and is taking the necessary steps to overcome critical challenges facing the industry to realize these benefits. The U.S. Department of Energy (DOE) is investing in buoy-mounted lidar systems to facilitate offshore measurement campaigns that will advance our understanding of the offshore environment and provide the observational data needed for model validation, particularly at hub height where offshore observations are particularly lacking. On behalf of the DOE, Pacific Northwest National Laboratory manages a Lidar Buoy Program that facilitates meteorological and oceanographic data collection using validated methods to support the U.S. offshore wind industry. Since being acquired in 2014, two DOE lidar buoys have been deployed on the U.S. east and west coasts; and their data represent the first publicly available multi-seasonal hub height data to be collected in U.S. waters. In addition, the buoys have undergone performance testing, significant upgrades, and a lidar validation campaign to ensure the accuracy and reliability of the lidar data needed to support wind resource characterization and model validation. The Lidar Buoy Program is providing valuable offshore data to the wind energy community, while focusing data collection on areas of acknowledged high priority.
offshore wind energy, lidar buoy, wind resource ch↗
TMS 2023 - Methodology and Density of PuCl3-NaCl Mixtures
The development of molten salt reactors and their associated components demands reliable and accurate thermophysical property data for design and validation. A candidate fuel salt, PuCl3-NaCl (36 mol% PuCl3) has been synthesized and studied at the Idaho National Laboratory. This study has determined the density of PuCl3-NaCl at multiple compositions and temperatures, providing data for validation of modeling efforts and making improvements on the buoyancy method for density measurements of actinide-bearing molten salts.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
The importance of cycle-by-cycle data in performing rapid battery technology development and validation
Lithium-ion battery (LiB) technology is playing a crucial role in transforming the predominantly fossil fuel-based transportation and stationary storage sectors to achieve a low-carbon economy. Rapid innovation in the LiB materials to electrode to cell design is happening to satisfy the performance, life, and safety metrics required by those myriads of applications. Lately, advanced analytics, such as machine-learning or artificial intelligence (ML/AI) techniques, are being used more frequently to aid in expedited LiB technology development, performance validation, and life prediction. The success of these techniques often relies on a large volume of well-defined and high-quality battery test data. On the other hand, most battery developers and research and development (R&D) communities are still following a classical approach to develop batteries, which is running calendar- and/or cycle-aging tests, performing reference performance tests (RPTs), and conducting post-mortem analyses periodically without paying attention to the wealth of data often not collected during the calendar or cycle life aging tests. This sparse data collection approach is time- and resource-intensive, requiring data capture and evaluation of months to years of RPT data to diagnose accurate battery state of performance, health, and safety. Even so, the underlying aging modes and mechanisms can be missed. If collected properly, battery test data during cycling or calendaring can be efficiently combined with ML/AI techniques to create powerful tools in the rapid diagnosis of battery state of performance, health, and safety along with insights into underlying aging modes and mechanisms. In this report, we discuss the importance of effective cycle-by-cycle (CBC) data collection with example case studies. Within a reasonable timeframe, RPT data are often inadequate in capturing many of the crucial battery aging dynamics, which often predominantly show up in CBC test data. Finally, we also show examples of ML/AI techniques that use CBC data in rapid diagnosis and projection of LiB state of health (SOH) to motivate the scientific community in collecting and using CBC data to facilitate expeditious technology development and validation.
25 ENERGY STORAGE↗
The Need for a New LLNL Pulsed Sphere Neutron Leakage Spectra Series
Here, it is shown that spectra measured as part of the Lawrence Livermore National Laboratory Pulsed Sphere (LPS) program offer decisive information to locate formatting or physics issues in nuclear data of key interest for fusion reactor simulations. However, experiments from this measurement series are not benchmarks. For instance, their uncertainties are incomplete. There are also many open questions—e.g., on the setup, the detector response, and whether LPS are accurately modeled—that cannot be answered anymore given the limited documentation and that many of the experimenters are no longer actively working. This limited knowledge has implications when one tries to adjust nuclear data to LPS spectra. Usually, one adjusts to benchmarks representing an application with the hope to get more precise nuclear data for the application of interest where differential data might be scarce and/or to reduce nuclear data uncertainties in the application simulations. However, it is demonstrated that adjustment with LPS spectra without accounting for missing uncertainties and modeling potential biases in the experimental data leads to adjusted data that are highly unphysical. That means adjusted data differ significantly from evaluated data based on information from differential experiments; also, application quantities predicted with the adjusted data deviate distinctly from experimental ones. While we can approximate our limited knowledge on these experiments with Gaussian processes in the adjustment process, this modeling of bias is arbitrary rather than based on a physics explanation, calling into doubt the validity of resulting adjusted data. Thus, we discuss here the need for a new measurement series, learning from the strengths and weaknesses of the LPS program, to yield decisive and well-benchmarked integral experiments to support fusion reactor research.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗