Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Independent Verification and Validation Of SAPHIRE 8 Software Requirements Project Number: N6423 U.S. Nuclear Regulatory Commission

The purpose of the Independent Verification and Validation (IV&V) role in the evaluation of the SAPHIRE requirements definition is to assess the activities that results in the specification, documentation, and review of the requirements that the software product must satisfy, including functionality, performance, design constraints, attributes and external interfaces. The IV&V team began this endeavor after the software engineering and software development of SAPHIRE had already been in production. IV&V reviewed the requirements specified in the NRC Form 189s to verify these requirements were included in SAPHIRE’s Software Verification and Validation Plan (SVVP).

99 GENERAL AND MISCELLANEOUS↗

Independent Verification and Validation Of SAPHIRE 8 Software Design and Interface Design Project Number: N6423 U.S. Nuclear Regulatory Commission

The purpose of the Independent Verification and Validation (IV&V) role in the evaluation of the SAPHIRE software design and interface design is to assess the activities that results in the development, documentation, and review of a software design that meets the requirements defined in the software requirements documentation. The IV&V team began this endeavor after the software engineering and software development of SAPHIRE had already been in production. IV&V reviewed the requirements specified in the NRC Form 189s to verify these requirements were included in SAPHIRE’s Software Verification and Validation Plan (SVVP) design specification.

99 GENERAL AND MISCELLANEOUS↗

Test plan for validation of the radiative transfer equation.

As the capabilities of numerical simulations increase, decision makers are increasingly relying upon simulations rather than experiments to assess risks across a wide variety of accident scenarios including fires. There are still, however, many aspects of fires that are either not well understood or are difficult to treat from first principles due to the computational expense. For a simulation to be truly predictive and to provide decision makers with information which can be reliably used for risk assessment the remaining physical processes must be studied and suitable models developed for the effects of the physics. A set of experiments are outlined in this report which will provide soot volume fraction/temperature data and heat flux (intensity) data for the validation of models for the radiative transfer equation. In addition, a complete set of boundary condition measurements will be taken to allow full fire predictions for validation of the entire fire model. The experiments will be performed with a lightly-sooting liquid hydrocarbon fuel fire in the fully turbulent scale range (2 m diameter).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Computational solution verification and validation applied to a thermal model of a ruggedized instrumentation package

This study details a methodology for quantification of errors and uncertainties of a finite element heat transfer model applied to a Ruggedized Instrumentation Package (RIP). The proposed verification and validation (V&V) process includes solution verification to examine errors associated with the code's solution techniques, and model validation to assess the model's predictive capability for quantities of interest. The model was subjected to mesh resolution and numerical parameters sensitivity studies to determine reasonable parameter values and to understand how they change the overall model response and performance criteria. To facilitate quantification of the uncertainty associated with the mesh, automatic meshing and mesh refining/coarsening algorithms were created and implemented on the complex geometry of the RIP. Automated software to vary model inputs was also developed to determine the solution’s sensitivity to numerical and physical parameters. The model was compared with an experiment to demonstrate its accuracy and determine the importance of both modelled and unmodelled physics in quantifying the results' uncertainty. An emphasis is placed on automating the V&V process to enable uncertainty quantification within tight development schedules.

97 MATHEMATICS AND COMPUTING↗

Validation of a metabolite–GWAS network for Populus trichocarpa family 1 UDP-glycosyltransferases

Metabolite genome-wide association studies (mGWASs) are increasingly used to discover the genetic basis of target phenotypes in plants such as Populus trichocarpa , a biofuel feedstock and model woody plant species. Despite their growing importance in plant genetics and metabolomics, few mGWASs are experimentally validated. Here, we present a functional genomics workflow for validating mGWAS-predicted enzyme–substrate relationships. We focus on uridine diphosphate–glycosyltransferases (UGTs), a large family of enzymes that catalyze sugar transfer to a variety of plant secondary metabolites involved in defense, signaling, and lignification. Glycosylation influences physiological roles, localization within cells and tissues, and metabolic fates of these metabolites. UGTs have substantially expanded in P. trichocarpa , presenting a challenge for large-scale characterization. Using a high-throughput assay, we produced substrate acceptance profiles for 40 previously uncharacterized candidate enzymes. Assays confirmed 10 of 13 leaf mGWAS associations, and a focused metabolite screen demonstrated varying levels of substrate specificity among UGTs. A substrate binding model case study of UGT-23 rationalized observed enzyme activities and mGWAS associations, including glycosylation of trichocarpinene to produce trichocarpin, a major higher-order salicylate in P. trichocarpa. We identified UGTs putatively involved in lignan, flavonoid, salicylate, and phytohormone metabolism, with potential implications for cell wall biosynthesis, nitrogen uptake, and biotic and abiotic stress response that determine sustainable biomass crop production. Our results provide new support for in silico analyses and evidence-based guidance for in vivo functional characterization.

59 BASIC BIOLOGICAL SCIENCES↗

Development and Validation of Numerical Models for Evaluation of Foam-Vacuum Insulation Panel Composite Boards, Including Edge Effects

A combined finite element analysis (FEA) and experimental validation approach to estimating effective edge conductivities of vacuum insulation panels (VIPs) embedded in foam-VIP composites is presented. The edge conductivities were estimated by comparing the simulation results with measurements of small-scale (0.61 × 0.61 m) foam-VIP composites and using an error minimization method. The two composites contained multiple VIPs that were butt-jointed with each other in one composite and separated by foam insulation in the other. Edge conductivities were estimated by considering the neighboring materials, i.e., whether the VIPs were adjacent to other VIPs or foam insulation. Models incorporating the edge conductivities were then used to simulate additional small- and large-scale (2.44 × 1.22 m) composites for validation and evaluation of the overall thermal transmission properties. The simulations used either the same boundary conditions as the experiments or used the experimental parameters to define the appropriate boundary conditions.

36 MATERIALS SCIENCE↗

Wind Resource Assessment for Alaska’s Offshore Regions: Validation of a 14-Year High-Resolution WRF Data Set

Offshore wind resource assessments for the conterminous U.S. and Hawai’i have been developed before, but Alaska’s offshore wind resource has never been rigorously assessed. Alaska, with its vast coastline, presents ample potential territory in which to build offshore wind farms, but significant challenges have thus far limited Alaska’s deployment of utility-scale wind energy capacity to a modest 62 MW (or approximately 2.7% of the state’s electric generation) as of this writing, all in land-based wind farms. This study provides an assessment of Alaska’s offshore wind resource, the first such assessment for Alaska, using a 14-year, high-resolution simulation from a numerical weather prediction and regional climate model. This is the longest-known high-resolution model data set to be used in a wind resource assessment. Widespread areas with relatively shallow ocean depth and high long-term average 100-m wind speeds and estimated net capacity factors over 50% were found, including a small area near Alaska’s population centers and the largest transmission grid that, if even partially developed, could provide the bulk of the state’s energy needs. The regional climate simulations were validated against available radiosonde and surface wind observations to provide the confidence of the model-based assessment. The model-simulated wind speed was found to be skillful and with near-zero average bias (−0.4–0.2 m s−1) when averaged over the domain. Small sample sizes made regional validation noisy, however.

17 WIND ENERGY↗

OC6 Phase Ib: Floating Wind Component Experiment for Difference-Frequency Hydrodynamic Load Validation

A new validation campaign was conducted at the W2 Harold Alfond Ocean Engineering Laboratory at the University of Maine to investigate the hydrodynamic loading on floating offshore wind substructures, with a focus on the low-frequency contributions that tend to drive extreme and fatigue loading in semisubmersible designs. A component-level approach was taken to examine the hydrodynamic loads on individual parts of the semisubmersible in isolation and then in the presence of other members to assess the change in hydrodynamic loading. A variety of wave conditions were investigated, including bichromatic waves, to provide a direct assessment of difference-frequency wave loading. An assessment of the impact of wave uncertainty on the loading was performed, with the goal of enabling validation with this dataset of numerical models with different levels of fidelity. The dataset is openly available for public use and can be downloaded from the U.S. Department of Energy Data Archive and Portal.

17 WIND ENERGY↗

A Review of Candidates for a Validation Data Set for High-Assay Low-Enrichment Uranium Fuels

Many advanced reactor concept designs rely on high-assay low-enriched uranium (HALEU) fuel, enriched up to approximately 19.75% 235 U by weight. Efforts are underway by the US government to increase HALEU production in the United States to meet anticipated needs. However, very few data exist for validation of computational models that include HALEU, beyond a few fresh fuel benchmark specifications in the International Reactor Physics Experiment Evaluation Project. Nevertheless, there are other data with potential value available for developing into quality benchmarks for use in data- and software-validation efforts. This paper reviews the available evaluated HALEU fuel benchmarks and some of the potentially relevant benchmarks for fresh highly enriched uranium. It then introduces experimental data for HALEU fuel irradiated at Idaho National Laboratory, from relatively recent irradiation programs at the Advanced Test Reactor. Such data should be evaluated and, if valuable, collected into detailed benchmark specifications to meet the needs of HALEU-based reactor designers.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Validation of the SCALE/Polaris-PARCS Code Procedure with the ENDF/B-VII.1 AMPX 56-Group Library: Pressurized Water Reactor

This study was conducted to validate the SCALE/Polaris v6.3.0–PARCS v3.4.2 code procedure with the Evaluated Nuclear Data File (ENDF)/B-VII.1 AMPX 56-group library for pressurized water reactor (PWR) analysis, by comparing simulated results with measured data for critical experiments and operating PWRs. Uncertainties of the SCALE/Polaris–PARCS code procedure for PWR analysis were evaluated in the validation for the PWR key nuclear parameters such as critical boron concentrations, reactivity, control bank work, temperature coefficients, and pin and assembly power peaking factors.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Validation of the SCALE/Polaris–PARCS Code Procedure With the ENDF/B-VII.1 AMPX 56-Group Library: Boiling Water Reactor

The SCALE/Polaris–PARCS code procedure has been used in the confirmatory analysis for boiling water reactors by the US Nuclear Regulatory Commission. In this study, the SCALE/Polaris v6.3.0–PARCS v3.4.2 code procedure with the Evaluated Nuclear Data File (ENDF)/B-VII.1 AMPX 56-group library was validated by comparing the simulated results with the measured data for operating boiling water reactors, including Peach Bottom Unit 2 cycles 1–3, Hatch Unit 1 cycles 1–3, and Quad Cities Unit 1 cycles 1–3. The uncertainties and biases of the SCALE/Polaris–PARCS code package for boiling water reactor physics analysis were evaluated in the validation for key nuclear parameters such as reactivity and traversing in-core probe data.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Three Statistically Validated K2 Transiting Warm Jupiter Exoplanets Confirmed as Low-mass Stars

We have identified three K2 transiting star–planet systems, K2-51 (EPIC 202900527), K2-67 (EPIC 206155547), and K2-76 (EPIC 206432863), as stellar binaries with low-mass stellar secondaries. The three systems were statistically validated as transiting planets, and through measuring their orbits by radial velocity (RV) monitoring we have derived the companion masses to be 0.1459{sub −0.0032}{sup +0.0029} M{sub ⊙} (EPIC 202900527 B), 0.1612{sub −0.0067}{sup +0.0072} M{sub ⊙} (EPIC 206155547 B), and 0.0942 ± 0.0019 M{sub ⊙} (EPIC 206432863 B). Therefore, they are not planets but small stars, part of the small sample of low-mass stars with measured radius and mass. The three systems are at an orbital period range of 12–24 days, and the secondaries have a radius within 0.9–1.9 R{sub J}, not inconsistent with the properties of warm Jupiter planets. These systems illustrate some of the existing challenges in the statistical validation approach. We point out a few possible origins for the initial misclassification of these objects, including poor characterization of the host star, the difficulty in detecting a secondary eclipse in systems on an eccentric orbit, and the difficulty in distinguishing between the smallest stars and gas giant planets as the two populations have indistinguishable radius distributions. Our work emphasizes the need for obtaining medium-precision RV measurements to distinguish between companions that are small stars, brown dwarfs, and gas giant planets.

79 ASTRONOMY AND ASTROPHYSICS↗

Analytical Validation of Accelerator Mass Spectrometry for Pharmaceutical Development: the Measurement of Carbon-14 Isotope Ratio.

Accelerator mass spectrometry (AMS) is an isotope based measurement technology that utilizes carbon-14 labeled compounds in the pharmaceutical development process to measure compounds at very low concentrations, empowers microdosing as an investigational tool, and extends the utility of {sup 14}C labeled compounds to dramatically lower levels. It is a form of isotope ratio mass spectrometry that can provide either measurements of total compound equivalents or, when coupled to separation technology such as chromatography, quantitation of specific compounds. The properties of AMS as a measurement technique are investigated here, and the parameters of method validation are shown. AMS, independent of any separation technique to which it may be coupled, is shown to be accurate, linear, precise, and robust. As the sensitivity and universality of AMS is constantly being explored and expanded, this work underpins many areas of pharmaceutical development including drug metabolism as well as absorption, distribution and excretion of pharmaceutical compounds as a fundamental step in drug development. The validation parameters for pharmaceutical analyses were examined for the accelerator mass spectrometry measurement of {sup 14}C/C ratio, independent of chemical separation procedures. The isotope ratio measurement was specific (owing to the {sup 14}C label), stable across samples storage conditions for at least one year, linear over 4 orders of magnitude with an analytical range from one tenth Modern to at least 2000 Modern (instrument specific). Further, accuracy was excellent between 1 and 3 percent while precision expressed as coefficient of variation is between 1 and 6% determined primarily by radiocarbon content and the time spent analyzing a sample. Sensitivity, expressed as LOD and LLOQ was 1 and 10 attomoles of carbon-14 (which can be expressed as compound equivalents) and for a typical small molecule labeled at 10% incorporated with {sup 14}C corresponds to 30 fg equivalents. AMS provides an sensitive, accurate and precise method of measuring drug compounds in biological matrices.

07 ISOTOPE AND RADIATION SOURCES↗

A globally sampled high-resolution hand-labeled validation dataset for evaluating surface water extent maps

Effective monitoring of global water resources is increasingly critical due to climate change and population growth. Advancements in remote sensing technology, specifically in spatial, spectral, and temporal resolutions, are revolutionizing water resource monitoring, leading to more frequent and high-quality surface water extent maps using various techniques such as traditional image processing and machine learning algorithms. However, satellite imagery datasets contain trade-offs that result in inconsistencies in performance, such as disparities in measurement principles between optical (e.g., Sentinel-2) and radar (e.g., Sentinel-1) sensors and differences in spatial and spectral resolutions among optical sensors. Therefore, developing accurate and robust surface water mapping solutions requires independent validations from multiple datasets to identify potential biases within the imagery and algorithms. However, high-quality validation datasets are expensive to build, and few contain information on water resources. For this purpose, we introduce a globally sampled, high-spatial-resolution dataset labeled using 3 m PlanetScope imagery. Our surface water extent dataset comprises 100 images, each with a size of 1024×1024 pixels, which were sampled using a stratified random sampling strategy covering all 14 biomes. We highlighted urban and rural regions, lakes, and rivers, including braided rivers and coastal regions. We evaluated two surface water extent mapping methods using our dataset – Dynamic World, based on Sentinel-2, and the NASA IMPACT model, based on Sentinel-1. Dynamic World achieved a mean intersection over union (IoU) of 72.16 % and F1 score of 79.70 %, while the NASA IMPACT model had a mean IoU of 57.61 % and F1 score of 65.79 %. Performance varied substantially across biomes, highlighting the importance of evaluating models on diverse landscapes to assess their generalizability and robustness. Our dataset can be used to analyze satellite products and methods, providing insights into their advantages and drawbacks. Our dataset offers a unique tool for analyzing satellite products, aiding the development of more accurate and robust surface water monitoring solutions. The dataset can be accessed via https://doi.org/10.25739/03nt-4f29.

54 ENVIRONMENTAL SCIENCES↗

An ice sheet model validation framework for the Greenland ice sheet

We propose a new ice sheet model validation framework the Cryospheric Model Comparison Tool (CMCT) that takes advantage of ice sheet altimetry and gravimetry observations collected over the past several decades and is applied here to modeling of the Greenland ice sheet. We use realistic simulations performed with the Community Ice Sheet Model (CISM) along with two idealized, non-dynamic models to demonstrate the framework and its use. Dynamic simulations with CISM are forced from 1991 to 2013 using combinations of reanalysis-based surface mass balance and observations of outlet glacier flux change. We propose and demonstrate qualitative and quanti- tative metrics for use in evaluating the different model simulations against the observations. We find 10 that the altimetry observations used here are largely ambiguous in terms of their ability to distinguish one simulation from another. Based on basin- and whole-ice-sheet scale metrics, the model initial condition as well as output from idealized and dynamic models all provide an equally reasonable representation of the ice sheet surface (mean elevation differences of <1 m). This is likely due to their short period of record, biases inherent to digital elevation models used for model initial conditions, and biases resulting from firn dynamics, which are not explicitly accounted for in the models or observations. On the other hand, we find that the gravimetry observations used here are able to unambiguously distinguish between simulations of varying complexity, and along with the CMCT, can provide a quantitative score for assessing a particular model and/or simulation. The new framework demonstrates that our proposed metrics can distinguish relatively better from relatively worse simulations and that dynamic ice sheet models, when appropriately initialized and forced with the right boundary conditions, demonstrate predictive skill with respect to observed dynamic changes occurring on Greenland over the past few decades. An extensible design will allow for continued use of the CMCT as future altimetry, gravimetry, and other remotely sensed data become available for use in ice sheet model validation.

58 GEOSCIENCES↗

FAST.Farm load validation for single wake situations at alpha ventus

The main objective of the presented work is the validation of the simulation tool FAST.Farm for the calculation of power and structural loads in single wake situations; the basis for the validation is the measurement database of the operating offshore wind farm alpha ventus. The approach is described in detail and covers the calibration of the aeroelastic turbine model, transfer of environmental conditions to simulations, and comparison between simulations and adequately filtered measurements. It is shown that FAST.Farm accurately predicts power and structural load distributions over wind direction with discrepancies of less than 10 % for most of the cases compared to the measurements. Additionally, the frequency response of the structure is investigated, and it is calculated by FAST.Farm in good agreement with the measurements. In general, the calculation of fatigue loads is improved with a wake-added turbulence model added to FAST.Farm in the course of this study.

17 WIND ENERGY↗

One-to-one aeroservoelastic validation of operational loads and performance of a 2.8 MW wind turbine model in OpenFAST

Abstract. This article presents a validation study of the popular aeroservoelastic code suite OpenFAST leveraging weeks of measurements obtained during normal operation of a 2.8 MW land-based wind turbine. Measured wind conditions were used to generate one-to-one turbulent flow fields (i.e., comparing simulation to measurement in 10 min increments, or bins) through unconstrained and constrained assimilation methods using the kinematic turbulence generators TurbSim and PyConTurb. A total of 253 bins of 10 min of normal turbine operation were selected for analysis, and a statistical comparison in terms of performance and loads is presented. We show that successful validation of the model was not strongly dependent on the type of inflow assimilation method used for mean quantities of interest, which had median modeling errors per wind-speed interval generally within 5 %–10 % of the measurement. The type of inflow assimilation method did have a larger effect on the fatigue predictions for blade-root flapwise and tower-base fore–aft quantities, which surprisingly saw larger errors from the assumed higher-fidelity assimilation methods. Avenues for further work are discussed and include possible improvements to the aerodynamic, structural, and controller modeling that may offer insight on the origin of the up to ∼ 40 % median overprediction of fatigue for these quantities.

17 WIND ENERGY↗

A standardized approach to PV system performance model validation.

PV performance models are used to predict how much energy a PV system will produce at a given location and subject to prescribed weather conditions. These models are commonly used by project developers to choose between module technologies and array designs (e.g., fixed tilt vs. tracking) for a given site or to choose between different geographic locations, and are used by the financial community to establish project viability. Available models can differ significantly in their underlying mathematical formulations and assumptions and in the options available to the analyst for setting up a simulation. Some models lack complete documentation and transparency, which can result in confusion on how to properly set up, run, and document a simulation. Furthermore, the quality and associated uncertainty of the available data upon which these models rely (e.g., irradiance, module parameters, etc.) is often quite variable and frequently undefined. For these reasons, many project developers and other industry users of these simulation tools have expressed concerns related to the confidence they place in PV performance model results. To address this problem, we propose a standardized method for the validation of PV system-level performance models and a set of guidelines for setting up these models and reporting results. This paper describes the basic elements for a standardized model validation process adapted especially for PV performance models, suggests a framework to implement the process, and presents an example of its application to a number of available PV performance models.

14 SOLAR ENERGY↗