Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

A Hybrid Heavy Duty Diesel Power System for Off-Road Applications—Concept Validation

A multiyear power system R&D program was completed with the objective of developing an off-road hybrid heavy duty diesel engine with front end accessory drive-integrated energy storage. This system was validated to deliver 10.5–25.6% reduction in fuel consumption over current Tier 4 Final-based 18L diesel engines, over various off-road machine application cycles. The power system consisted of a downsized heavy-duty diesel 13L engine containing advanced combustion technologies, capable of elevated peak cylinder pressures and thermal efficiencies, thermal barrier coatings, exhaust waste heat recovery via SuperTurbo™ turbocompounding, and hybrid energy assisting and recovery through both mechanical and electrical systems. Following the concept definition, design, and analysis phases of the program, the final phase focused on building and validating the performance and efficiency in laboratory tests. While aspects of the system such as start/stop and reduced off-road cooling package energy losses were only analytically evaluated, the main 13L concept engine with full hybrid system was successfully built and tested in steady-state and in transient certification and real-world application cycles. Extensive simulations in Caterpillar's DYNASTY™ software environment utilized the validation test data to assess performance more fully and confidently over varied cycles and strategies. An average fuel consumption reduction of 17.9% was realized, and the majority (~13%) of the benefit stemmed from the core concept 13L engine. In conclusion, a total cost of ownership analysis provides context to commercial viability and where adoption focus should be placed.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

SAM Code Validation on Frictional Pressure Drop through Pebble Beds

The System Analysis Module (SAM) is currently under development at Argonne National Laboratory as a modern system-level modeling and simulation tool for safety analyses of advanced non-light water reactors. This report presents a recent effort to validate the capability of SAM to predict the frictional pressure drop through pebble beds. Selected experimental data were used for code validation, including data from test facilities at Texas A&M University, Missouri University of Science and Technology, and North-West University of South Africa. SAM implements three empirical correlations to predict frictional pressure drop: the classical Ergun correlation; the KTA correlation, which is widely used in high-temperature gas-cooled reactor applications; and the Eisfeld and Schnitzlein correlation, which explicitly considers wall effect. Code validation was performed using all three correlations. For all selected experimental data, the KTA correlation shows the best performance and agrees very well with experimental measurement; the Eisfeld and Schnitzlein correlation, explicitly considering wall effects, shows acceptable accuracy, while there is no evidence that it is better than the KTA correlation; the Ergun correlation, however, over-predicts frictional pressure drop for most selected data points.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Updated Gadolinium Validation in SCALE 6.3.0 using ENDF/B-VIII.0 Data [Slides]

This presentation provides a brief recap of the ANS Summer meeting in 2018 with a discussion of the results. The presentation also provides an overview of new models and states that all new models have been checked but have not yet been added to the VALID library. It also states that the models were originally created as part of a master's thesis or summer internships. Additionally, all models have been rerun in SCALE 6.3.0 using CE ENDF/B-VIII.0 library. In conclusion, this project has facilitated a significant expansion of validation set containing gadolinium, including 13 cases previously in VALID plus 99 new cases. The completion of IPPE HST experiments confirm no clear trend as a function of concentration or spectrum. Solid absorber cases also show no clear trends and LANL HMT experiments have significant discrepancies in Gd alloy cases. While almost half of the total gadolinium-bearing cases from the ICSBEP Handbook are considered here, the presentation recognizes that there is more work to be done.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Expansion of the Verified, Archived, Library of Inputs and Data (VALID) [Slides]

This project dialogue provides an update on the Expansion of Verified, Archived, Library of Inputs and Data or VALID. VALID is a QA-Like (Quality Assurance) process to generate high quality models from reliable reference descriptions and make those models available to users. This presentation provides a brief project overview, a reminder of cases added in FY2021, cases currently in progress, and future plans for VALID.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2023

Applying Methodology for Evaluating and Validating TSLs to Materials of Interest to NCSP [Slides]

This presentation covers the topic of applying methodology for evaluation validation of TSLs to material of interest to the Nuclear Criticality Safety Program (NCSP). The talk covers recent efforts in validating thermal neutron scattering cross sections. The presentation also proposes a methodology for not only validating thermal scattering files that utilizes all available experimental data, but also for evaluating new libraries as demonstrated on Polystyrene and Lucite

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Validation and Verification of TEDS Facility HYBRID Modeling

The HYBRID modeling repository is an in-house developed library of models for selected integrated energy systems (IES) modelling. HYBRID models have been developed since 2015 to describe the physical operation of tightly coupled thermal systems including power generators, thermal transport systems, thermal storage, thermal-to-electric conversion systems, and other thermal applications. Here, validation and verification (V&V) capabilities are demonstrated using the Thermal Energy Distribution System (TEDS) at INL. Building upon prior work, the TEDS model has been updated and verified so that it better represents the installed system configuration and the operating control system. The model control system was changed to allow replication of actual experimental procedures. Experimental operations focusing primarily on thermocline tank performance were devised and performed. Several anomalies were found in the operation data of the experiment facility. V&V activities calibrating a selected input parameter are demonstrated on a single component as well as with a single parameter within the thermocline. Calibrating is then demonstrated on multiple components and a multi-parameter metric for the entire system. The validation methodology is successfully applied to validate the model with experimental data. It is also used to confirm a hypothesis behind one of the anomalies in experimental performance.

25 ENERGY STORAGE↗
DOE OSTI2023

HYBRID Modeling Validation and Verification Status Matrix

The HYBRID modeling repository is a premier resource for integrated energy systems modeling. HYBRID models have been developed since 2015 to describe the physical operation of tightly coupled thermal systems including power generators, thermal transport systems, thermal storage, thermal-to-electric conversion systems, and other thermal applications. Due to the increased size of the repository, a concise summary matrix of available models is desired. This matrix will consolidate not only the list of available models but also indicate original information sources, publications that have model examples, and level of validation and verification that exists for the models. Validation and verification (V&V) levels begin from simplified algebraic relationship and advance to dynamic data validation. Moving forward, as new models are contributed to HYBRID, their V&V level will be included, updating this matrix.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Improving Residential Building Simulations Through Large-Scale Empirical Validation

Residential building energy simulations are increasingly used for energy-efficient building design, codes and standards analysis, home certifications and ratings, utility programs, and technology assessments. Various software tools exist to perform residential building simulations, and these tools often use different models, inputs, and assumptions. This leads to inconsistencies that can undermine confidence in the predicted results. Validation of these tools can increase confidence by ensuring their accuracy and consistency. One way to validate simulation tools is through empirical testing, which compares predicted energy usage to measured utility billing data. This paper describes the process of data collection, data standardization, and empirical validation, and illustrates its use with our residential EnergyPlus (R)-based software. The data and process can be extended to other simulation tools and contribute to improving residential building simulations more broadly.

empirical validation↗
DOE OSTI2021

ACCRUE—An Integral Index for Measuring Experimental Relevance in Support of Neutronic Model Validation

A key challenge for the introduction of any design changes, e.g., advanced fuel concepts, first-of-a-kind nuclear reactor designs, etc., is the cost of the associated experiments, which are required by law to validate the use of computer models for the various stages, starting from conceptual design, to deployment, licensing, operation, and safety. To achieve that, a criterion is needed to decide on whether a given experiment, past or planned, is relevant to the application of interest. This allows the analyst to select the best experiments for the given application leading to the highest measures of confidence for the computer model predictions. The state-of-the-art methods rely on the concept of similarity or representativity, which is a linear Gaussian-based inner-product metric measuring the angle—as weighted by a prior model parameters covariance matrix—between two gradients, one representing the application and the other a single validation experiment. This manuscript emphasizes the concept of experimental relevance which extends the basic similarity index to account for the value accrued from past experiments and the associated experimental uncertainties, both currently missing from the extant similarity methods. Accounting for multiple experiments is key to the overall experimental cost reduction by prescreening for redundant information from multiple equally-relevant experiments as measured by the basic similarity index. Accounting for experimental uncertainties is also important as it allows one to select between two different experimental setups, thus providing for a quantitative basis for sensor selection and optimization. The proposed metric is denoted by ACCRUE, short for Accumulative Correlation Coefficient for Relevance of Uncertainties in Experimental validation. Using a number of criticality experiments for highly enriched fast metal systems and low enriched thermal compound systems with accident tolerant fuel concept, the manuscript will compare the performance of the ACCRUE and basic similarity indices for prioritizing the relevance of a group of experiments to the given application.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Anion exchange membrane test protocol validation

This study presents the validation of protocols for measuring ion exchange capacity (IEC) and alkaline stability of anion exchange membranes (AEMs) for low-temperature water electrolysis. While protocols are often tested within individual laboratories, their results across multiple laboratories with varying equipment, environmental conditions, and personnel qualification remain unverified. The validation involved Los Alamos National Laboratory (LANL), National Renewable Energy Laboratory (NREL), and University of Oregon (UO) using the same commercially available AEM to assess reproducibility and reliability of the protocols under diverse conditions. For the IEC protocol, results across laboratories were consistent within ±10% of the NMR-determined reference value. The alkaline stability protocol could pose greater challenges due to factors such as variations in sample collection timing, preservation methods, and analytical techniques, but consistent test results for percentage IEC loss were demonstrated across institutions. These results highlight the reliability and applicability of the protocols, emphasizing the importance of validation to ensure consistency in diverse research environments.

08 HYDROGEN↗
DOE OSTI2022

Development of Training Materials for Pathologists to Provide Machine Learning Validation Data of Tumor-Infiltrating Lymphocytes in Breast Cancer

The High Throughput Truthing project aims to develop a dataset for validating artificial intelligence and machine learning models (AI/ML) fit for regulatory purposes. The context of this AI/ML validation dataset is the reporting of stromal tumor-infiltrating lymphocytes (sTILs) density evaluations in hematoxylin and eosin-stained invasive breast cancer biopsy specimens. After completing the pilot study, we found notable variability in the sTILs estimates as well as inconsistencies and gaps in the provided training to pathologists. Using the pilot study data and an expert panel, we created custom training materials to improve pathologist annotation quality for the pivotal study. We categorized regions of interest (ROIs) based on their mean sTILs density and selected ROIs with the highest and lowest sTILs variability. In a series of eight one-hour sessions, the expert panel reviewed each ROI and provided verbal density estimates and comments on features that confounded the sTILs evaluation. We aggregated and shaped the comments to identify pitfalls and instructions to improve our training materials. From these selected ROIs, we created a training set and proficiency test set to improve pathologist training with the goal to improve data collection for the pivotal study. We are not exploring AI/ML performance in this paper. Instead, we are creating materials that will train crowd-sourced pathologists to be the reference standard in a pivotal study to create an AI/ML model validation dataset. The issues discussed here are also important for clinicians to understand about the evaluation of sTILs in clinical practice and can provide insight to developers of AI/ML models.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Ten Years of VIIRS Land Surface Temperature Product Validation

The Visible Infrared Imaging Radiometer Suite (VIIRS) Land Surface Temperature (LST) has been operationally produced for a decade since the Suomi National Polar-orbiting Partnership (SNPP) launched in October 2011. A comprehensive evaluation of its accuracy and precision will be helpful for product users in climate studies and atmospheric models. In this study, the VIIRS LST is validated with ground observations from multiple high-quality radiation networks, including six stations from the Surface Radiation budget (SURFRAD) network, two stations from the Baseline Surface Radiation Network (BSRN), and 13 stations from the Atmospheric Radiation Measurement (ARM) network, to evaluate its performance over various land-cover types. The VNP21A1 LST was validated against the same ground observations as a reference. The results yield a close agreement between the SNPP VIIRS LST and ground LSTs with a bias of -0.4 K and a RMSE of 1.96 K over six SURFRAD sites; a bias of -0.2 K and a RMSE of 1.93 K over two BSRN sites; and a bias of -0.1 K and a RMSE of 1.7 K over the 13 ARM sites. The time series of the LST errors over individual sites indicate seasonal cycles. The data anomaly over the BSRN site in Cabauw and the SURFRAD site in Desert Rock is revealed and discussed in this study. In addition, a method using Landsat-8 data is applied to quantify the heterogeneity level of each ground station and the results provide promising insights. The validation results demonstrate the maturity of the JPSS VIIRS LST products and their readiness for various application studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Validation of Oregon State University High Temperature Test Facility Experiments Using Pronghorn

The OSU High Temperature Test Facility is a quarter-scale diameter, 1/64 scale volume test facility meant to replicate thermophysical phenomena in the prototypical General Atomics Modular High Temperature Gas Reactor. Tests pertaining to conduction cooldown events were performed from 2016-2019, providing a large database by which computational methods that are applicable to different length scales can be validated. One of these codes is Pronghorn, which is a coarse-meshed, porous-based subchannel thermal hydraulics code based on the MOOSE application, with the intention of better capturing the physics of both conduction and convection heat transfer within the OSU HTTF core. The goal of this summer project is to develop the framework by which Pronghorn can perform validation exercises of the HTTF core for benchmarking, by generating a mesh appropriate to the geometry of the HTTF core, developing input decks that accurately capture the initial and boundary conditions, materials, and relevant equations to the physics seen in the HTTF core, and using a postprocessor to compare simulation results to various experimental data. While validation of codes is a multi-year project, a mesh has been generated and tested in Pronghorn that meets mass conservation and basic heat transfer principles. The next step is to accurate depict the fluid inlet and outlet boundary conditions, which will be performed using computational fluid dynamics software.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Conducting Field Validations of Commercial Energy Efficiency Technologies with Underserved Communities: Preprint

Underserved communities in the United States often experience the negative impacts of climate change and environmental degradation but enjoy few of the benefits of technological and environmental advances. The White House has addressed this inequity through the Justice40 initiative, which requires 40% of the benefits of select federal investments to be directed to underserved communities (The White House, 2022). Clean energy and energy efficiency are two highlighted investment categories, so the U.S. Department of Energy will guide implementation of the Justice40 initiative by, among other things, decreasing energy burdens, increasing parity in clean energy technology access and adoption, and increasing energy resiliency. A strategy for reaching these goals is to evaluate and validate new energy efficiency technologies in commercial buildings in underserved communities, where buildings may be older, smaller, and have deferred maintenance due to historical underinvestment. This paper assesses the proficiency of the technologies under these conditions and increases awareness of the benefits to the communities. In addition, historical redlining and past negative experiences with government and large institutions may make residents wary of participating in these field validations. Researchers, therefore, may need to spend more time building relationships and matching technologies to buildings. In this paper, we analyzed technical reports to identify common required and desired field validation building characteristics, and conducted semi-structured expert conversations to identify key stages and major themes of engaging underserved communities. Our results indicate that the benefits to both the community and energy efficiency research justify the effort. The White House. (2022). Justice40. https://www.whitehouse.gov/environmentaljustice/justice40/

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION↗
DOE OSTI2024

Verification, Validation, and Calibration Through a Causal Lens

While typical validation and verification approaches focus on identifying the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on identifying causal relationships between data elements. Statistical and machine-learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between data sets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify, and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles, it is known as a directed acyclic graph. A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts can identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Validating Mixtures of 233 U, 235 U, and 239 Pu for the Sum-of-Fractions Method

The Sum-of-Fractions method is a technique used to assure that homogeneous mixtures of fissile and fissionable isotopes are below a minimum margin of k eff or reactivity. Current work by Pacific Northwest National Laboratory examines different mixtures of 233 U, 235 U, and 239 Pu to determine critical mass limits for mixtures of transuranic actinides lacking a validation basis. To provide a validation basis for these limits, the work presented here describes the results of a sensitivity and uncertainty analysis of various mixtures of these isotopes in various concentrations moderated and reflected by light water and polyethylene. The TSUNAMI-1D sequence in the SCALE code system was used to generate sensitivity coefficients for three different concentrations of mixtures of 233 U, 235 U, and 239 Pu. The TSUNAMI-IP sequence was then used for similarity assessment (c k ) with critical benchmark experiment sensitivity data files (SDFs) from the Oak Ridge National Laboratory Verified, Archived Library of Inputs and Data and the Nuclear Energy Agency SDF database. The VADER sequence in SCALE was used for statistical testing and to generate upper subcritical limits from the data to develop a basis for validating critical mass limits.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2024

Modeling and Validation of a Residential Multi-Functional Variable Refrigerant Flow Heat Pump System with Heat Recovery

To bridge the existing gap in modeling the variable refrigerant flow heat pump systems with heat recovery (VRFHR), we developed a suite of dynamic VRFHR system models in Modelica. These models are specifically tailored for residential multi-functional VRFHR (MF-VRFHR) applications, including space conditioning and domestic hot water (DHW) heating, utilizing both the TIL library for HVAC equipment and the Buildings library for thermal load calculations. The development comprises essential component models, including the newly developed heat recovery unit (HRU), along with system models that integrate the heat pump system and building envelope. These system models accommodate various operational modes such as heating-only, cooling-only, and heating-recovery (including heating-dominant and cooling-dominant) modes. Furthermore, we propose an efficient optimization-based model calibration method that identifies critical model parameters while utilizing a small amount of data obtained from either real systems or manufacturer's specifications. We demonstrate the effectiveness of these models and the proposed calibration method for a MF-VRFHR system installed in Richland, WA. The developed models are calibrated and validated using data collected under different operational modes during both heating and cooling seasons. The results show that the models capture the system dynamics and achieve high accuracy, with the coefficient of the variation of the root-mean-square-error less than 15% for variables such as outdoor unit power consumption, compressor speed, space temperature and DHW temperature. The validated models serve as a reliable representation of the MF-VRFHR system, facilitating the development and validation of optimized controls needed to realize the full benefits of integrated heat pump systems. Future research will utilize these models to develop advanced controls and optimize system performance for improved energy efficiency and demand flexibility.

Modeling, Variable refrigerant flow (VRF) systems,↗
DOE OSTI2025

EMT Model Validation of a 2 MVA PV Inverter Using Transient and Frequency-Domain Hardware Testing: Preprint

This paper presents results and new insights gained from a hardware test campaign on a 2 MVA PV inverter for validating its vendor-supplied EMT model. The test campaign was conducted using a 7 MVA grid simulator and a 2 MW PV emulator. It considered both time-domain transient tests and frequency-domain impedance scan tests. The paper highlights the inadequacy of transient tests in capturing all critical resonance modes of the inverter, and the effectiveness of the frequency scan testing in addressing this problem. The paper shows the frequency scan testing as an effective tool for EMT model validation of IBR units which can highlight inaccuracies in the EMT models that are easy to overlook when model validation is performed using only the time-domain transient tests such as voltage ride-through and phase jump tests.

24 POWER TRANSMISSION AND DISTRIBUTION↗