Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Validation of MCNPX-PoliMi code for simulations of radioxenon beta-gamma coincidence detection

Radioxenon detection is an important component of the verification regime for the Comprehensive Nuclear-Test-Ban Treaty. We developed and validated a new model in MCNPX-PoliMi to simulate the decay of various radioxenon isotopes and the detector response of a variety of detector types. The model was validated using calibration data from a plastic and NaI(Tl) beta-gamma coincidence detector and the results are presented. The results of this validation show that this model can also be used as a tool to produce training spectra and as a method to calibrate radioxenon detection systems.

Radioxenon analysis, MCNP, beta-gamma coincidence↗
DOE OSTI2021

Scalable Programming Workflows for Validation of Quantum Computers

Hybrid quantum-classical workflows have become standard methods for executing variational algorithms and other quantum simulation techniques, which are key applications for noisy intermediate scale quantum (NISQ) computers. Validating these simulations is an important task which helps gauge the progress of quantum computer development, and classical simulation can serve as a tool to this end. Both exact and more scalable approximate methods with quantifiable error bounds can be used in validation tasks where the applicable metrics include the distance from a calculable ground truth, the quality of an error model fit to data, etc. Here we present a library extension that includes methods for validation of quantum simulations based on scalable hybrid workflows executable on high performance computers. We provide examples that use approximate methods based on tensor networks and stabilizer simulators to bound the error of quantum simulations on NISQ hardware.

Nguyen, Thien↗
DOE OSTI2016

Introduction: The 2014 Sandia Verification and Validation Challenge Workshop [The 2014 Sandia Verification and Validation Challenge Workshop]

The 2014 Sandia Verification & Validation Challenge Workshop was held at the 3rd ASME Verification & Validation Symposium in Las Vegas, on May 5-8, 2014. The workshop was built around a challenge problem, formulated as an engineering investigation that required integration of experimental data, modeling and simulation, and verification and validation. The challenge problem served as a common basis for the ASME Journal of Verification, Validation, and Uncertainty Quantification participants to both demonstrate methodology and explore a critical aspect of the field: the role of verification and validation in establishing credibility and supporting decision making. Ten groups presented responses to the challenge problem at the workshop, and the follow-on efforts are documented in this special edition of the ASME Journal of Verification, Validation, and Uncertainty Quantification.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Lab-Scale, Closed-Loop Experimental Characterization, Model Refinement, and Validation of a Hydrokinetic Energy-Harvesting Ocean Kite

This paper presents a study wherein we experimentally characterize the dynamics and control system of a lab-scale ocean kite, and then refine, validate, and extrapolate this model for use in a full-scale system. Ocean kite systems, which harvest tidal and ocean current resources through high-efficiency cross-current motion, enable energy extraction with an order of magnitude less material (and cost) than stationary systems with the same rated power output. However, an ocean kite represents a nascent technology that is characterized by relatively complex dynamics and requires sophisticated control algorithms. In order to characterize the dynamics and control of ocean kite systems rapidly, at a relatively low cost, the authors have developed a lab-scale, closed-loop prototyping environment for characterizing tethered systems, whereby 3D printed systems are tethered and flown in a water channel environment. While this system has been shown to be capable of yielding similar dynamic characteristics to some full-scale systems, there are also fundamental limitations to the geometric scales and flow speeds within the water channel environment, making many other real-world scenarios impossible to replicate from the standpoint of dynamic similarity. Here, to address these scenarios, we show how the lab-scale framework is used to refine and validate a scalable dynamic model of a tethered system, which can then be extrapolated to full-scale operation. In this work, we present an extensive case study of this model refinement, validation, and extrapolation on an ocean kite system intended for operation in the Gulf Stream or similar current environments.

42 ENGINEERING↗
NASA NTRS2004

Can One Satellite Data Set Validation Another? Validation of Envisat SCIAMACHY Data by Comparisons with NOAA-16 SBUV/2 and ERS-2 GOME

Validation of satellite data remains a high priority for the construction of climate data sets. Traditionally ground based measurements have provided the primary comparison data for validation. For some atmospheric parameters such as ozone, a thoroughly validated satellite data record can be used to validate a new instrument s data product in addition to using ground based data. Comparing validated data with new satellite data has several advantages; availability of much more data, which will improve precision, larger geographical coverage, and the footprints are closer in size, which removes uncertainty due to different observed atmospheric volumes. To demonstrate the applicability and some limitations of this technique, observations from the newly launched SCIAMACHY instrument were compared with the NOM-16 SBW/2 and ERS-2 GOME instruments. The SBW/2 data had all ready undergone validation by comparing to the total ozone ground network. Overall the SCIAMACHY data were found to low by 3% with respect to satellite data and 1% low with respect to ground station data. There appears to be seasonal and or solar zenith angle dependences in the comparisons with SBW/2 where differences increase with higher solar zenith angles. It is known that accuracies in both satellite and ground based total ozone algorithms decrease at high solar zenith angles. There is a strong need for more accurate measurement from and the ground under these conditions. At the present time SCIAMACHY data are limited and longer data set with more coverage in both hemispheres is needed to unravel the cause of these differences.

Hilsenrath, E.↗
DOE OSTI2019

Validation of the first LiDAR wind resource assessment buoy system offshore the Northeast United States

The US offshore wind industry is maturing with several projects in various stages of development. These projects require site wind and environmental data before and during operation. Conventional techniques such as fixed-bottom meteorological towers present economical and permitting challenges for the US. Floating Light Detection and Ranging (LiDAR) buoys offer significant advantages including reduced costs, less permitting, and reusability. This paper presents the validation of the first floating LiDAR buoy in Northeast US waters. The buoy, named DeepCLiDAR, includes a LiDAR, ecological monitoring sensors, and metocean sensors. A three-phase LiDAR validation plan was executed, and its results are presented. The objective of the validation plan was to verify the accuracy of measurements made by the LiDAR buoy in wave environments against an unmoving reference wind measurement. Due to a lack of reference met masts, the use of a LiDAR on land as a baseline reference was implemented for validation. Comparison to a reference LiDAR instead of a traditional meteorological tower was a unique approach required in the Northeast US waters due to the absence of a reference fixed-bottom meteorological tower in the region at the time of this study. The testing included a comparison of wind speed measurements made by the buoy deployed 15 km offshore from the mainland and a land-based reference LiDAR located on a nearby island. This paper presents the methodology and results of this program, which indicate favorable agreement. This was the first such validation program in the Northeast USA which is now seeing rapid development of offshore wind.

17 WIND ENERGY↗
NASA NTRS2008

In-Flight Validation of Mid and Thermal Infrared Remotely Sensed Data Using the Lake Tahoe and Salton Sea Automated Validation Sites

The presentation includes an introduction, Lake Tahoe site layout and measurements, Salton Sea site layout and measurements, field instrument calibration and cross-calculations, data reduction methodology and error budgets, and example results for MODIS. Summary and conclusions are: 1) Lake Tahoe CA/NV automated validation site was established in 1999 to assess radiometric accuracy of satellite and airborne mid and thermal infrared data and products. Water surface temperatures range from 4-25C.2) Salton Sea CA automated validation site was established in 2008 to broaden range of available water surface temperatures and atmospheric water vapor test cases. Water surface temperatures range from 15-35C. 3) Sites provide all information necessary for validation every 2 mins (bulk temperature, skin temperature, air temperature, wind speed, wind direction, net radiation, relative humidity). 4) Sites have been used to validate mid and thermal infrared data and products from: ASTER, AATSR, ATSR2, MODIS-Terra, MODIS-Aqua, Landsat 5, Landsat 7, MTI, TES, MASTER, MAS. 5) Approximately 10 years of data available to help validate AVHRR.

Lake Tahoe↗
NASA NTRS2007

Initial Retrieval Validation from the Joint Airborne IASI Validation Experiment (JAIVEx)

The Joint Airborne IASI Validation Experiment (JAIVEx) was conducted during April 2007 mainly for validation of the Infrared Atmospheric Sounding Interferometer (IASI) on the MetOp satellite, but also included a strong component focusing on validation of the Atmospheric InfraRed Sounder (AIRS) aboard the AQUA satellite. The cross validation of IASI and AIRS is important for the joint use of their data in the global Numerical Weather Prediction process. Initial inter-comparisons of geophysical products have been conducted from different aspects, such as using different measurements from airborne ultraspectral Fourier transform spectrometers (specifically, the NPOESS Airborne Sounder Testbed Interferometer (NAST-I) and the Scanning-High resolution Interferometer Sounder (S-HIS) aboard the NASA WB-57 aircraft), UK Facility for Airborne Atmospheric Measurements (FAAM) BAe146-301 aircraft insitu instruments, dedicated dropsondes, radiosondes, and ground based Raman Lidar. An overview of the JAIVEx retrieval validation plan and some initial results of this field campaign are presented.

Zhou, Daniel K.↗
NASA NTRS2017

Validation and Scaling of Soil Moisture in a Semi-Arid Environment: SMAP Validation Experiment 2015 (SMAPVEX15)

The NASA SMAP (Soil Moisture Active Passive) mission conducted the SMAP Validation Experiment 2015 (SMAPVEX15) in order to support the calibration and validation activities of SMAP soil moisture data products. The main goals of the experiment were to address issues regarding the spatial disaggregation methodologies for improvement of soil moisture products and validation of the in situ measurement upscaling techniques. To support these objectives high-resolution soil moisture maps were acquired with the airborne PALS (Passive Active L-band Sensor) instrument over an area in southeast Arizona that includes the Walnut Gulch Experimental Watershed (WGEW), and intensive ground sampling was carried out to augment the permanent in situ instrumentation. The objective of the paper was to establish the correspondence and relationship between the highly heterogeneous spatial distribution of soil moisture on the ground and the coarse resolution radiometer-based soil moisture retrievals of SMAP. The high-resolution mapping conducted with PALS provided the required connection between the in situ measurements and SMAP retrievals. The in situ measurements were used to validate the PALS soil moisture acquired at 1-km resolution. Based on the information from a dense network of rain gauges in the study area, the in situ soil moisture measurements did not capture all the precipitation events accurately. That is, the PALS and SMAP soil moisture estimates responded to precipitation events detected by rain gauges, which were in some cases not detected by the in situ soil moisture sensors. It was also concluded that the spatial distribution of the soil moisture resulted from the relatively small spatial extents of the typical convective storms in this region was not completely captured with the in situ stations. After removing those cases (approximately10 of the observations) the following metrics were obtained: RMSD (root mean square difference) of0.016m3m3 and correlation of 0.83. The PALS soil moisture was also compared to SMAP and in situ soil moisture at the 36-km scale, which is the SMAP grid size for the standard product. PALS and SMAP soil moistures were found to be very similar owing to the close match of the brightness temperature measurements and the use of a common soil moisture retrieval algorithm. Spatial heterogeneity, which was identified using the high-resolution PALS soil moisture and the intensive ground sampling, also contributed to differences between the soil moisture estimates. In general, discrepancies found between the L-band soil moisture estimates and the 5-cm depth in situ measurements require methodologies to mitigate the impact on their interpretations in soil moisture validation and algorithm development. Specifically, the metrics computed for the SMAP radiometer-based soil moisture product over WGEW will include errors resulting from rainfall, particularly during the monsoon season when the spatial distribution of soil moisture is especially heterogeneous.

SMAPVEX15↗
DOE OSTI2020

Investigating Core Gaps and the Development of Subcomponent Validation Methods for Wind Turbine Blades: Preprint

Core gaps are a common manufacturing defect observed in wind blade composite sandwich constructions, which occur when sheets of core material are not properly butted up against each other in the mold. The aim of this study was to characterize core gaps in composite sandwich constructions at the coupon scale. This was to gain an initial understanding of the defect before developing appropriate methodologies for more complex subcomponents as part of a much broader wind blade structural validation and damage tolerance program. Long beam flexure in 4-point-bending was chosen as the most appropriate loading scenario. Beam specimens were characterized with and without 10 mm core gaps in fiberglass/balsa sandwich beams. The core gaps were characterized with two separate resin systems; a Hexion epoxy and Arkema's Elium resins system (a novel, infusible thermoplastic). Results showed that the Elium beams without the core gaps were had a 15% lower static strength than their epoxy counterparts. The introduction of the core gap to the epoxy beams reduced their static strength by 35%. The Elium beams, however, exhibited negligible strength reductions with the inclusion of the core gap. Overall, this characterization study provided pertinent information with regards to core gaps as a manufacturing defect to allow for continued development of damage tolerance and subcomponent validation methodologies with the inclusion of manufacturing defects.

17 WIND ENERGY↗
DOE OSTI2021

Validation of the Community Land Model Version 5 over the Contiguous United States (CONUS) using in situ and remote sensing data sets

The Community Land Model (CLM) is an effective tool to simulate the biophysical and biogeochemical processes and their interactions with the atmosphere. Although CLM Version 5 (CLM5) constitutes various updates in these processes, its performance in simulating energy, water and carbon cycles over the Contiguous United States (CONUS) at scales which land surface changes and hydrometeorological and hydroclimatological applications are more locally relevant is yet to be assessed. In this study, we conducted three simulations at 0.125? during 1979-2018 over the CONUS using different configurations of CLM, namely CLM5-biogeochemistry (CLM5BGC), CLM4.5BGC, and CLM5-satellite phenology (CLM5SP). We validated and compared their simulations against multiple remote-sensed and in-situ datasets. Overall, the parametric and structural updates (e.g., carbon cost for nitrogen uptake, variable soil thickness, dry surface layer) in CLM5 improve its ability in capturing terrestrial biogeochemical dynamics. The low evapotranspiration in CLM5BGC is associated with biases in simulating vegetation phenological characteristics rather than soil water limitations. The mismatch between CLM5BGC-simulated peak leaf area index and reference data can be attributed to CLM5BGC's inability in simulating phenology of trees and grasses. The differences between CLM-simulated irrigation and reference estimates can be attributed to differences between processes represented in models and in reality, and uncertainties in input and validation datasets. Evaluation against observations at small catchments suggest that hydrologic parameters needed to be calibrated to improve simulations of runoff, especially subsurface runoff. Additional efforts are needed to incorporate spatially-distributed plant phenology and physiology parameters and regional-specific agricultural management practices (e.g., planting, harvest).

Cheng, Yanyan↗
DOE OSTI2016

Validation of IRDFF in 252Cf standard and IRDF-2002 reference neutron fields

The results of validation of the latest release of International Reactor Dosimetry and Fusion File, IRDFF-1.03, in the standard 252Cf(s.f.) and reference 235U(nth,f) neutron benchmark fields are presented. The spectrum-averaged cross sections were shown to confirm the recommended spectrum for 252Cf spontaneous fission source; that was not the case for the current recommended spectra for 235U(nth,f). IRDFF was also validated in the spectra of the research reactor facilities ISNF, Sigma-Sigma and YAYOI, which are available in the IRDF- 2002 collection. Before this analysis, the ISFN spectrum was resimulated to remove unphysical oscillations in spectrum. IRDFF-1.03 was shown to reasonably reproduce the spectrum-averaged data measured in these fields except for the case of YAYOI.

IRDFF↗
DOE OSTI2021

Combination of cluster number counts and two-point correlations: validation on mock Dark Energy Survey

ABSTRACT We present a method of combining cluster abundances and large-scale two-point correlations, namely galaxy clustering, galaxy–cluster cross-correlations, cluster autocorrelations, and cluster lensing. This data vector yields comparable cosmological constraints to traditional analyses that rely on small-scale cluster lensing for mass calibration. We use cosmological survey simulations designed to resemble the Dark Energy Survey Year 1 (DES-Y1) data to validate the analytical covariance matrix and the parameter inferences. The posterior distribution from the analysis of simulations is statistically consistent with the absence of systematic biases detectable at the precision of the DES-Y1 experiment. We compare the χ2 values in simulations to their expectation and find no significant difference. The robustness of our results against a variety of systematic effects is verified using a simulated likelihood analysis of DES-Y1-like data vectors. This work presents the first-ever end-to-end validation of a cluster abundance cosmological analysis on galaxy catalogue level simulations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Dark Energy Survey Year 3 results: Cosmology from combined galaxy clustering and lensing validation on cosmological simulations

In this work, we present a validation of the Dark Energy Survey Year 3 (DES Y3) 3×2-point analysis choices by testing them on Buzzard2.0, a new suite of cosmological simulations that is tailored for the testing and validation of combined galaxy clustering and weak-lensing analyses. We show that the buzzard2.0 simulations accurately reproduce many important aspects of the DES Y3 data, including photometric redshift and magnitude distributions, and the relevant set of two-point clustering and weak-lensing statistics. We then show that our model for the 3×2-point data vector is accurate enough to recover the true cosmology in simulated surveys assuming the true redshift distributions for our source and lens samples, demonstrating robustness to uncertainties in the modeling of the nonlinear matter power spectrum, nonlinear galaxy bias, and higher-order lensing corrections. Additionally, we demonstrate for the first time that our photometric redshift calibration methodology, including information from photometry, spectroscopy, clustering cross-correlations, and galaxy–galaxy lensing ratios, is accurate enough to recover the true cosmology in simulated surveys in the presence of realistic photometric redshift uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Dark Energy Survey Year 3 results: Simulation-based cosmological inference with wavelet harmonics, scattering transforms, and moments of weak lensing mass maps. Validation on simulations

Beyond-two-point statistics contain additional information on cosmological as well as astrophysical and observational (systematics) parameters. In this methodology paper we provide an end-to-end simulationbased analysis of a set of Gaussian and non-Gaussian weak lensing statistics using detailed mock catalogs of the Dark Energy Survey (DES). Here, we implement: 1) second and third moments; 2) wavelet phase harmonics (WPH); 3) the scattering transform (ST). Our analysis is fully based on simulations, it spans a space of seven $νw$CDM cosmological parameters, and it forward models the most relevant sources of systematics of the data (masks, noise variations, clustering of the sources, intrinsic alignments, and shear and redshift calibration). We implement a neural network compression of the summary statistics, and we estimate the parameter posteriors using a likelihood-free-inference approach. We validate the pipeline extensively, and we find that WPH exhibits the strongest performance when combined with second moments, followed by ST, and then by third moments. The combination of all the different statistics further enhances constraints with respect to second moments, up to 25 percent, 15 percent, and 90 percent for S 8 , Ω m , and the figure-of-merit FoM S8;Ωm , respectively. We further find that non-Gaussian statistics improve constraints on w and on the amplitude of intrinsic alignment with respect to second moments constraints. The methodological advances presented here are suitable for application to Stage IV surveys from Euclid, Rubin-LSST, and Roman with additional validation on mock catalogs for each survey. In a companion paper we present an application to DES Year 3 data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2018

Development and Validation of a SiC Based 50 kW Grid-Connected PV Inverter: Preprint

In this digest a 50kW string PV inverter formed using all SiC semiconductor devices is presented. The inverter design includes additively manufactured power block, symmetrical Y-core inductors for ac side filter, and advanced inverter functionality for grid support. This inverter utilizes the conventional three-phase Voltage Source Inverter topology and optimizes the design for SiC based devices. This paper presents the full functional validation of the designed inverter along with quantification of the efficiency and power density. The performance of the inverter for high dc-bus voltage without multi-level topology to exploit SiC advantages is also presented in this digest. The full paper will include details of inverter design, optimization and further experimental validation.

14 SOLAR ENERGY↗
DOE OSTI2015

From deep TLS validation to ensembles of atomic models built from elemental motions

Procedures are described for extracting the vibration and libration parameters corresponding to a given set of TLS matrices and their simultaneous validation. Knowledge of these parameters allows the generation of structural ensembles corresponding to these matrices. The translation–libration–screw model first introduced by Cruickshank, Schomaker and Trueblood describes the concerted motions of atomic groups. Using TLS models can improve the agreement between calculated and experimental diffraction data. Because the T, L and S matrices describe a combination of atomic vibrations and librations, TLS models can also potentially shed light on molecular mechanisms involving correlated motions. However, this use of TLS models in mechanistic studies is hampered by the difficulties in translating the results of refinement into molecular movement or a structural ensemble. To convert the matrices into a constituent molecular movement, the matrix elements must satisfy several conditions. Refining the T, L and S matrix elements as independent parameters without taking these conditions into account may result in matrices that do not represent concerted molecular movements. Here, a mathematical framework and the computational tools to analyze TLS matrices, resulting in either explicit decomposition into descriptions of the underlying motions or a report of broken conditions, are described. The description of valid underlying motions can then be output as a structural ensemble. All methods are implemented as part of the PHENIX project.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗