Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

Control Strategies and Validation in the Hybrid Optimization and Performance Platform (HOPP)

The Hybrid Optimization and Performance Platform (HOPP) is a tool that simulates hybrid power plants in various configurations, and also calculates the financial feasibility of these plants. This report outlines an overview of HOPP and the energy storage dispatch strategies available. It then presents three case studies which demonstrate different applications of HOPP. The first case looks at the profitability of hybrid power plants in different locations in the USA. The second case examines the availability of hybrid power plants to provide energy reliability services. The third case presents a plant that produces both hydrogen and electricity, and demonstrates a dispatch strategy that chooses the most profitable energy vector based on price signals. The next section shows the validation of HOPP on operational data, using data from both unit-scale and utility-scale power plants. This validation process demonstrated that HOPP can simulate the power output of both wind and solar PV plants at both scales with comparable fidelity to an existing commercial software tool. Finally, HOPP is applied in a field test which applies an optimal dispatch strategy to a physical battery in a unit-scale hybrid plant at NREL. HOPP's optimal dispatch strategy, applied in a real-world setting, improved this hybrid plant's ability to meet a load signal while minimizing operational costs.

14 SOLAR ENERGY↗

Computational solution verification and validation applied to a thermal model of a ruggedized instrumentation package

This study details a methodology for quantification of errors and uncertainties of a finite element heat transfer model applied to a Ruggedized Instrumentation Package (RIP). The proposed verification and validation (V&V) process includes solution verification to examine errors associated with the code's solution techniques, and model validation to assess the model's predictive capability for quantities of interest. The model was subjected to mesh resolution and numerical parameters sensitivity studies to determine reasonable parameter values and to understand how they change the overall model response and performance criteria. To facilitate quantification of the uncertainty associated with the mesh, automatic meshing and mesh refining/coarsening algorithms were created and implemented on the complex geometry of the RIP. Automated software to vary model inputs was also developed to determine the solution’s sensitivity to numerical and physical parameters. The model was compared with an experiment to demonstrate its accuracy and determine the importance of both modelled and unmodelled physics in quantifying the results' uncertainty. An emphasis is placed on automating the V&V process to enable uncertainty quantification within tight development schedules.

97 MATHEMATICS AND COMPUTING↗

Validation of a metabolite–GWAS network for Populus trichocarpa family 1 UDP-glycosyltransferases

Metabolite genome-wide association studies (mGWASs) are increasingly used to discover the genetic basis of target phenotypes in plants such as Populus trichocarpa , a biofuel feedstock and model woody plant species. Despite their growing importance in plant genetics and metabolomics, few mGWASs are experimentally validated. Here, we present a functional genomics workflow for validating mGWAS-predicted enzyme–substrate relationships. We focus on uridine diphosphate–glycosyltransferases (UGTs), a large family of enzymes that catalyze sugar transfer to a variety of plant secondary metabolites involved in defense, signaling, and lignification. Glycosylation influences physiological roles, localization within cells and tissues, and metabolic fates of these metabolites. UGTs have substantially expanded in P. trichocarpa , presenting a challenge for large-scale characterization. Using a high-throughput assay, we produced substrate acceptance profiles for 40 previously uncharacterized candidate enzymes. Assays confirmed 10 of 13 leaf mGWAS associations, and a focused metabolite screen demonstrated varying levels of substrate specificity among UGTs. A substrate binding model case study of UGT-23 rationalized observed enzyme activities and mGWAS associations, including glycosylation of trichocarpinene to produce trichocarpin, a major higher-order salicylate in P. trichocarpa. We identified UGTs putatively involved in lignan, flavonoid, salicylate, and phytohormone metabolism, with potential implications for cell wall biosynthesis, nitrogen uptake, and biotic and abiotic stress response that determine sustainable biomass crop production. Our results provide new support for in silico analyses and evidence-based guidance for in vivo functional characterization.

59 BASIC BIOLOGICAL SCIENCES↗

Development and Validation of Numerical Models for Evaluation of Foam-Vacuum Insulation Panel Composite Boards, Including Edge Effects

A combined finite element analysis (FEA) and experimental validation approach to estimating effective edge conductivities of vacuum insulation panels (VIPs) embedded in foam-VIP composites is presented. The edge conductivities were estimated by comparing the simulation results with measurements of small-scale (0.61 × 0.61 m) foam-VIP composites and using an error minimization method. The two composites contained multiple VIPs that were butt-jointed with each other in one composite and separated by foam insulation in the other. Edge conductivities were estimated by considering the neighboring materials, i.e., whether the VIPs were adjacent to other VIPs or foam insulation. Models incorporating the edge conductivities were then used to simulate additional small- and large-scale (2.44 × 1.22 m) composites for validation and evaluation of the overall thermal transmission properties. The simulations used either the same boundary conditions as the experiments or used the experimental parameters to define the appropriate boundary conditions.

36 MATERIALS SCIENCE↗

Wind Resource Assessment for Alaska’s Offshore Regions: Validation of a 14-Year High-Resolution WRF Data Set

Offshore wind resource assessments for the conterminous U.S. and Hawai’i have been developed before, but Alaska’s offshore wind resource has never been rigorously assessed. Alaska, with its vast coastline, presents ample potential territory in which to build offshore wind farms, but significant challenges have thus far limited Alaska’s deployment of utility-scale wind energy capacity to a modest 62 MW (or approximately 2.7% of the state’s electric generation) as of this writing, all in land-based wind farms. This study provides an assessment of Alaska’s offshore wind resource, the first such assessment for Alaska, using a 14-year, high-resolution simulation from a numerical weather prediction and regional climate model. This is the longest-known high-resolution model data set to be used in a wind resource assessment. Widespread areas with relatively shallow ocean depth and high long-term average 100-m wind speeds and estimated net capacity factors over 50% were found, including a small area near Alaska’s population centers and the largest transmission grid that, if even partially developed, could provide the bulk of the state’s energy needs. The regional climate simulations were validated against available radiosonde and surface wind observations to provide the confidence of the model-based assessment. The model-simulated wind speed was found to be skillful and with near-zero average bias (−0.4–0.2 m s−1) when averaged over the domain. Small sample sizes made regional validation noisy, however.

17 WIND ENERGY↗

OC6 Phase Ib: Floating Wind Component Experiment for Difference-Frequency Hydrodynamic Load Validation

A new validation campaign was conducted at the W2 Harold Alfond Ocean Engineering Laboratory at the University of Maine to investigate the hydrodynamic loading on floating offshore wind substructures, with a focus on the low-frequency contributions that tend to drive extreme and fatigue loading in semisubmersible designs. A component-level approach was taken to examine the hydrodynamic loads on individual parts of the semisubmersible in isolation and then in the presence of other members to assess the change in hydrodynamic loading. A variety of wave conditions were investigated, including bichromatic waves, to provide a direct assessment of difference-frequency wave loading. An assessment of the impact of wave uncertainty on the loading was performed, with the goal of enabling validation with this dataset of numerical models with different levels of fidelity. The dataset is openly available for public use and can be downloaded from the U.S. Department of Energy Data Archive and Portal.

17 WIND ENERGY↗

A Review of Candidates for a Validation Data Set for High-Assay Low-Enrichment Uranium Fuels

Many advanced reactor concept designs rely on high-assay low-enriched uranium (HALEU) fuel, enriched up to approximately 19.75% 235 U by weight. Efforts are underway by the US government to increase HALEU production in the United States to meet anticipated needs. However, very few data exist for validation of computational models that include HALEU, beyond a few fresh fuel benchmark specifications in the International Reactor Physics Experiment Evaluation Project. Nevertheless, there are other data with potential value available for developing into quality benchmarks for use in data- and software-validation efforts. This paper reviews the available evaluated HALEU fuel benchmarks and some of the potentially relevant benchmarks for fresh highly enriched uranium. It then introduces experimental data for HALEU fuel irradiated at Idaho National Laboratory, from relatively recent irradiation programs at the Advanced Test Reactor. Such data should be evaluated and, if valuable, collected into detailed benchmark specifications to meet the needs of HALEU-based reactor designers.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Validation of the SCALE/Polaris-PARCS Code Procedure with the ENDF/B-VII.1 AMPX 56-Group Library: Pressurized Water Reactor

This study was conducted to validate the SCALE/Polaris v6.3.0–PARCS v3.4.2 code procedure with the Evaluated Nuclear Data File (ENDF)/B-VII.1 AMPX 56-group library for pressurized water reactor (PWR) analysis, by comparing simulated results with measured data for critical experiments and operating PWRs. Uncertainties of the SCALE/Polaris–PARCS code procedure for PWR analysis were evaluated in the validation for the PWR key nuclear parameters such as critical boron concentrations, reactivity, control bank work, temperature coefficients, and pin and assembly power peaking factors.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Validation of the SCALE/Polaris–PARCS Code Procedure With the ENDF/B-VII.1 AMPX 56-Group Library: Boiling Water Reactor

The SCALE/Polaris–PARCS code procedure has been used in the confirmatory analysis for boiling water reactors by the US Nuclear Regulatory Commission. In this study, the SCALE/Polaris v6.3.0–PARCS v3.4.2 code procedure with the Evaluated Nuclear Data File (ENDF)/B-VII.1 AMPX 56-group library was validated by comparing the simulated results with the measured data for operating boiling water reactors, including Peach Bottom Unit 2 cycles 1–3, Hatch Unit 1 cycles 1–3, and Quad Cities Unit 1 cycles 1–3. The uncertainties and biases of the SCALE/Polaris–PARCS code package for boiling water reactor physics analysis were evaluated in the validation for key nuclear parameters such as reactivity and traversing in-core probe data.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Three Statistically Validated K2 Transiting Warm Jupiter Exoplanets Confirmed as Low-mass Stars

We have identified three K2 transiting star–planet systems, K2-51 (EPIC 202900527), K2-67 (EPIC 206155547), and K2-76 (EPIC 206432863), as stellar binaries with low-mass stellar secondaries. The three systems were statistically validated as transiting planets, and through measuring their orbits by radial velocity (RV) monitoring we have derived the companion masses to be 0.1459{sub −0.0032}{sup +0.0029} M{sub ⊙} (EPIC 202900527 B), 0.1612{sub −0.0067}{sup +0.0072} M{sub ⊙} (EPIC 206155547 B), and 0.0942 ± 0.0019 M{sub ⊙} (EPIC 206432863 B). Therefore, they are not planets but small stars, part of the small sample of low-mass stars with measured radius and mass. The three systems are at an orbital period range of 12–24 days, and the secondaries have a radius within 0.9–1.9 R{sub J}, not inconsistent with the properties of warm Jupiter planets. These systems illustrate some of the existing challenges in the statistical validation approach. We point out a few possible origins for the initial misclassification of these objects, including poor characterization of the host star, the difficulty in detecting a secondary eclipse in systems on an eccentric orbit, and the difficulty in distinguishing between the smallest stars and gas giant planets as the two populations have indistinguishable radius distributions. Our work emphasizes the need for obtaining medium-precision RV measurements to distinguish between companions that are small stars, brown dwarfs, and gas giant planets.

79 ASTRONOMY AND ASTROPHYSICS↗

A globally sampled high-resolution hand-labeled validation dataset for evaluating surface water extent maps

Effective monitoring of global water resources is increasingly critical due to climate change and population growth. Advancements in remote sensing technology, specifically in spatial, spectral, and temporal resolutions, are revolutionizing water resource monitoring, leading to more frequent and high-quality surface water extent maps using various techniques such as traditional image processing and machine learning algorithms. However, satellite imagery datasets contain trade-offs that result in inconsistencies in performance, such as disparities in measurement principles between optical (e.g., Sentinel-2) and radar (e.g., Sentinel-1) sensors and differences in spatial and spectral resolutions among optical sensors. Therefore, developing accurate and robust surface water mapping solutions requires independent validations from multiple datasets to identify potential biases within the imagery and algorithms. However, high-quality validation datasets are expensive to build, and few contain information on water resources. For this purpose, we introduce a globally sampled, high-spatial-resolution dataset labeled using 3 m PlanetScope imagery. Our surface water extent dataset comprises 100 images, each with a size of 1024×1024 pixels, which were sampled using a stratified random sampling strategy covering all 14 biomes. We highlighted urban and rural regions, lakes, and rivers, including braided rivers and coastal regions. We evaluated two surface water extent mapping methods using our dataset – Dynamic World, based on Sentinel-2, and the NASA IMPACT model, based on Sentinel-1. Dynamic World achieved a mean intersection over union (IoU) of 72.16 % and F1 score of 79.70 %, while the NASA IMPACT model had a mean IoU of 57.61 % and F1 score of 65.79 %. Performance varied substantially across biomes, highlighting the importance of evaluating models on diverse landscapes to assess their generalizability and robustness. Our dataset can be used to analyze satellite products and methods, providing insights into their advantages and drawbacks. Our dataset offers a unique tool for analyzing satellite products, aiding the development of more accurate and robust surface water monitoring solutions. The dataset can be accessed via https://doi.org/10.25739/03nt-4f29.

54 ENVIRONMENTAL SCIENCES↗

An ice sheet model validation framework for the Greenland ice sheet

We propose a new ice sheet model validation framework the Cryospheric Model Comparison Tool (CMCT) that takes advantage of ice sheet altimetry and gravimetry observations collected over the past several decades and is applied here to modeling of the Greenland ice sheet. We use realistic simulations performed with the Community Ice Sheet Model (CISM) along with two idealized, non-dynamic models to demonstrate the framework and its use. Dynamic simulations with CISM are forced from 1991 to 2013 using combinations of reanalysis-based surface mass balance and observations of outlet glacier flux change. We propose and demonstrate qualitative and quanti- tative metrics for use in evaluating the different model simulations against the observations. We find 10 that the altimetry observations used here are largely ambiguous in terms of their ability to distinguish one simulation from another. Based on basin- and whole-ice-sheet scale metrics, the model initial condition as well as output from idealized and dynamic models all provide an equally reasonable representation of the ice sheet surface (mean elevation differences of <1 m). This is likely due to their short period of record, biases inherent to digital elevation models used for model initial conditions, and biases resulting from firn dynamics, which are not explicitly accounted for in the models or observations. On the other hand, we find that the gravimetry observations used here are able to unambiguously distinguish between simulations of varying complexity, and along with the CMCT, can provide a quantitative score for assessing a particular model and/or simulation. The new framework demonstrates that our proposed metrics can distinguish relatively better from relatively worse simulations and that dynamic ice sheet models, when appropriately initialized and forced with the right boundary conditions, demonstrate predictive skill with respect to observed dynamic changes occurring on Greenland over the past few decades. An extensible design will allow for continued use of the CMCT as future altimetry, gravimetry, and other remotely sensed data become available for use in ice sheet model validation.

58 GEOSCIENCES↗

FAST.Farm load validation for single wake situations at alpha ventus

The main objective of the presented work is the validation of the simulation tool FAST.Farm for the calculation of power and structural loads in single wake situations; the basis for the validation is the measurement database of the operating offshore wind farm alpha ventus. The approach is described in detail and covers the calibration of the aeroelastic turbine model, transfer of environmental conditions to simulations, and comparison between simulations and adequately filtered measurements. It is shown that FAST.Farm accurately predicts power and structural load distributions over wind direction with discrepancies of less than 10 % for most of the cases compared to the measurements. Additionally, the frequency response of the structure is investigated, and it is calculated by FAST.Farm in good agreement with the measurements. In general, the calculation of fatigue loads is improved with a wake-added turbulence model added to FAST.Farm in the course of this study.

17 WIND ENERGY↗

One-to-one aeroservoelastic validation of operational loads and performance of a 2.8 MW wind turbine model in OpenFAST

Abstract. This article presents a validation study of the popular aeroservoelastic code suite OpenFAST leveraging weeks of measurements obtained during normal operation of a 2.8 MW land-based wind turbine. Measured wind conditions were used to generate one-to-one turbulent flow fields (i.e., comparing simulation to measurement in 10 min increments, or bins) through unconstrained and constrained assimilation methods using the kinematic turbulence generators TurbSim and PyConTurb. A total of 253 bins of 10 min of normal turbine operation were selected for analysis, and a statistical comparison in terms of performance and loads is presented. We show that successful validation of the model was not strongly dependent on the type of inflow assimilation method used for mean quantities of interest, which had median modeling errors per wind-speed interval generally within 5 %–10 % of the measurement. The type of inflow assimilation method did have a larger effect on the fatigue predictions for blade-root flapwise and tower-base fore–aft quantities, which surprisingly saw larger errors from the assumed higher-fidelity assimilation methods. Avenues for further work are discussed and include possible improvements to the aerodynamic, structural, and controller modeling that may offer insight on the origin of the up to ∼ 40 % median overprediction of fatigue for these quantities.

17 WIND ENERGY↗

Noninvasive assessment of mitral inertness: clinical results with numerical model validation

Inertial forces (Mdv/dt) are a significant component of transmitral flow, but cannot be measured with Doppler echo. We validated a method of estimating Mdv/dt. Ten patients had a dual sensor transmitral (TM) catheter placed during cardiac surgery. Doppler and 2D echo was performed while acquiring LA and LV pressures. Mdv/dt was determined from the Bernoulli equation using Doppler velocities and TM gradients. Results were compared with numerical modeling. TM gradients (range: 1.04-14.24 mmHg) consisted of 74.0 +/- 11.0% inertial forcers (range: 0.6-12.9 mmHg). Multivariate analysis predicted Mdv/dt = -4.171(S/D (RATIO)) + 0.063(LAvolume-max) + 5. Using this equation, a strong relationship was obtained for the clinical dataset (y=0.98x - 0.045, r=0.90) and the results of numerical modeling (y=0.96x - 0.16, r=0.84). TM gradients are mainly inertial and, as validated by modeling, can be estimated with echocardiography.

NASA Discipline Cardiopulmonary↗

MISR - Science Data Validation Plan

This Science Data Validation Plan describes the plans for validating a subset of the Multi-angle Imaging SpectroRadiometer (MISR) Level 2 algorithms and data products and supplying top-of-atmosphere (TOA) radiances to the In-flight Radiometric Calibration and Characterization (IFRCC) subsystem for vicarious calibration.

MISR science data validation Plan↗

NDSC Lidar Intercomparisons and Validation: OPAL and MLO3 Campaigns in 1995

The Network for the Detection of Stratospheric Change (NDSC) has developed and adopted a Validation Policy in order to ensure that the results submitted and stored in its archives are of a known, high quality. As a part of this validation policy, blind instrument intercomparisons are considered an essential element in the certification of NDSC instruments and a specific format for these campaigns has been recommended by the NDSC-Steering Committee.

Stratospheric Change The Network for the Detection↗