Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Status of the WPEC subgroup 46 - Efficient and effective use of integral experiments for nuclear data validation

The present paper summarizes the current status of the activities of the on-going WPEC subgroup 46 which was the last significant initiative of Massimo before he passed away. The goal of WPEC/SG46 is to define, test and document a methodology to provide unambiguous feedback to the nuclear data evaluator community, based on the joint use of integral experiments and data assimilation techniques. Part of this effort resulted in a renewed analysis of the original Target Accuracy Requirement (TAR) exercise of WPEC/SG26, by adding more diverse nuclear systems and parameters, including reaction channels correlations and a coarser energy group structure; and making use of the progress made in the most recent evaluations in terms of both nuclear data and covariance matrices. The preliminary outcomes of the updated TAR exercise, documented by various groups worldwide are clear already: uncertainty reductions are required for many nuclide-reaction pairs in a variety of energy range if the target uncertainty requirements set by the industry are to be met, especially for k{sub eff}. The inclusion of correlations between the various reaction channels had a major impact on the magnitude of the required uncertainty reduction. Those uncertainty reductions are unlikely to be met by differential measurements alone. However, the selection of relevant integral experiment and a subsequent adjustment procedure may help meet these requirements. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE Cold Climate Heat Pump Challenge Field Validation: Data Collection and Analysis Plan

This document details the data collection, storage, and analysis plan and methodologies for conducting the field validation portion of DOE’s Cold Climate Heat Pump (CCHP) Challenge. The study is focused on validating the in-field heating performance of prototypical CCHPs that have successfully demonstrated that they meet or exceed the Challenge specification in a laboratory setting. The units that have passed laboratory testing will be installed in real homes along with sensors and loggers for monitoring performance over an entire heating season. Data collected through monitoring will be cleaned and stored in a secure database. The data will be analyzed for calculating the key metrics defined by the Challenge including heating capacities at low outdoor air temperatures (below 32 °F), efficiency in terms of the Coefficient of Performance (COP), switchover temperatures and auxiliary heat staging. Demand Response (DR) capabilities will also be tested using specially designed DR events. In most cases, shoulder season and cooling season performance will also be determined and reported.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Development of Training Materials for Pathologists to Provide Machine Learning Validation Data of Tumor-Infiltrating Lymphocytes in Breast Cancer

The High Throughput Truthing project aims to develop a dataset for validating artificial intelligence and machine learning models (AI/ML) fit for regulatory purposes. The context of this AI/ML validation dataset is the reporting of stromal tumor-infiltrating lymphocytes (sTILs) density evaluations in hematoxylin and eosin-stained invasive breast cancer biopsy specimens. After completing the pilot study, we found notable variability in the sTILs estimates as well as inconsistencies and gaps in the provided training to pathologists. Using the pilot study data and an expert panel, we created custom training materials to improve pathologist annotation quality for the pivotal study. We categorized regions of interest (ROIs) based on their mean sTILs density and selected ROIs with the highest and lowest sTILs variability. In a series of eight one-hour sessions, the expert panel reviewed each ROI and provided verbal density estimates and comments on features that confounded the sTILs evaluation. We aggregated and shaped the comments to identify pitfalls and instructions to improve our training materials. From these selected ROIs, we created a training set and proficiency test set to improve pathologist training with the goal to improve data collection for the pivotal study. We are not exploring AI/ML performance in this paper. Instead, we are creating materials that will train crowd-sourced pathologists to be the reference standard in a pivotal study to create an AI/ML model validation dataset. The issues discussed here are also important for clinicians to understand about the evaluation of sTILs in clinical practice and can provide insight to developers of AI/ML models.

60 APPLIED LIFE SCIENCES↗

Dataset for ASME VVUQ Symposium Workshop on Regression of Validation Data to an Application Point

This dataset consists of a collection of Excel spreadsheets that contain output from analysis specified in the workshop. The analysis involves ASME V&V 20-style validation as well as the application of a supplement methodology for regression of validation comparison error and validation uncertainty to application points where experimental data does not exist for comparison. The simulation results and experimental data are provided by the workshop organizers and a NASA report, respectively.

Kirsch, Jared Roelof [Sandia National Laboratories↗

Verified, Archived Library of Inputs and Data (VALID) Online Repository [Slides]

VALID continues to serve as a library of high-quality models used for evaluating SCALE and nuclear data. Large number of cases are in the pipeline. Online repository is available for use. Future plans include simplifying the process for adding cases, including additional models outside the ICSBEP Handbook (HTC models, DNCSH models, International Handbook of Evaluated Reactor Physics Benchmark Experiments [IRPhE], SINBAD, etc.), and increasing the availability of models and results for external users.

KENO↗

An Alternative to Solution Experiments for Nuclear Data Validation: Reflection and Interaction of Juxtaposed Uranium (RAIJU) Experiment Design

The need for solution experiments was thoroughly discussed at the recent NCERC (National Criticality Experiments Research Center) Futures Meeting in September 2022 for multiple applications including criticality safety, training, and nuclear data. However, this capability does not exist anywhere in the United States. NCERC, located at the Nevada National Security Site and operated by LANL (Los Alamos National Laboratory) is the only general-purpose critical experiments laboratory in the United States. However, solution experiments are not authorized at NCERC, and obtaining that authorization would be too time consuming and costly to happen in the foreseeable future. An alternative is needed – an experimental configuration with the homogeneity of liquid experiments, but without being a liquid. This project, Reflection and Interaction of Juxtaposed Uranium (RAIJU) will fill the gap in capability within LANL, the U.S. Department of Energy, and the international community and will support current and future nuclear material processing needs.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Deep learning interfacial momentum closures in coarse-mesh CFD two-phase flow simulation using validation data

Multiphase flow phenomena have been widely observed in the industrial applications while it remains a challenging yet unsolved problems. Three-dimensional computational fluid dynamics (CFD) approaches resolve the flow fields on a finer special and temporal scales which can complement the dedicated experimental study. However, closures have to be introduced to reflect the underlying physics in multiphase flow. Among them, the interfacial forces, including drag, lift, turbulent dispersion and wall lubrication forces, play in important role on the bubble’s distribution and migration in liquid-vapor two-phase flow. Development of those closures traditionally rely on the experimental data and analytical derivation with simplified assumptions which usually cannot deliver a universal solution across wide range of flow conditions. In this paper, a data-driven approach, named as Feature Similarity Measurement (FSM), is developed and applied to improve the simulation capability of two-phase flow with coarse-mesh CFD approach. Interfacial momentum transfer in adiabatic bubbly flow serves as the focus of the present study. Both a mature and a simplified set of interfacial closures are taken as the low fidelity data. Experimental data and fine mesh CFD simulations results are adopted as high-fidelity data. Qualitative and quantitative analysis are performed in this paper which reveals that FSM can substantially improve the prediction of coarse mesh CFD model regardless of the choice of interfacial closures and it provides scalability and consistency across discontinuous flow regimes. Furthermore, it demonstrates that data-driven method can aid the multiphase flow modeling by exploring the connections between local physical features and simulation errors.

97 MATHEMATICS AND COMPUTING↗

CORAL: A framework for rigorous self-validated data modeling and integrative, reproducible data analysis

Abstract Background Many organizations face challenges in managing and analyzing data, especially when relevant datasets arise from multiple sources and methods. Analyzing heterogeneous datasets and additional derived data requires rigorous tracking of their interrelationships and provenance. This task has long been a Grand Challenge of data science and has more recently been formalized in the FAIR principles: that all data objects be Findable, Accessible, Interoperable, and Reusable, both for machines and for people. Adherence to these principles is necessary for proper stewardship of information, for testing regulatory compliance, for measuring the efficiency of processes, and for facilitating reuse of data-analytical frameworks. Findings We present the Contextual Ontology-based Repository Analysis Library (CORAL), a platform that greatly facilitates adherence to all 4 of the FAIR principles, including the especially difficult challenge of making heterogeneous datasets Interoperable and Reusable across all parts of a large, long-lasting organization. To achieve this, CORAL's data model requires that data generators extensively document the context for all data, and our tools maintain that context throughout the entire analysis pipeline. CORAL also features a web interface for data generators to upload and explore data, as well as a Jupyter notebook interface for data analysts, both backed by a common API. Conclusions CORAL enables organizations to build FAIR data types on the fly as they are needed, avoiding the expense of bespoke data modeling. CORAL provides a uniquely powerful platform to enable integrative cross-dataset analyses, generating deeper insights than are possible using traditional analysis tools.

97 MATHEMATICS AND COMPUTING↗

NGEE Arctic Rainfall Simulator Validation Data from Los Alamos National Laboratory, New Mexico, Summer 2022

Experiments evaluating the uniformity and intensity of rainfall produced by the NGEE Arctic Rainfall Simulator (NARS) were conducted at Los Alamos National Laboratory, New Mexico, over summer 2022. Petri dishes were placed in a grid within the NARS plot. Simulated rainfall was collected in each petri dish and the intensity and uniformity of the simulator was subsequently calculated. This data package contains two .csv files, one that summarizes the rainfall intensity and uniformity for each experiment, the other that contains individual petri dish water volume and intensity for each plot location and experiment. The Python scripts to control NARS are also included. The NGEE Arctic Rainfall Simulator (NARS) is a variable intensity rainfall simulator (RFS) with a frame design based on the Humphry et al. (2002) RFS and a water delivery system based on the Walnut Gulch (Paige et al., 2004) RFS. The NARS uses an aluminum frame that is fully deconstructable for transportation to field locations and a water system that enables variable rain intensity. Rain intensity control and data collection are automated using a Raspberry Pi microcomputer. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗