Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Open-source MFIX-DEM software for gas-solids flows: Part II — Validation studies

With rapid advancements in computer hardware and numerical algorithms, computational fluid dynamics (CFD) has been increasingly employed as a useful tool for investigating the complex hydrodynamics inherent in multiphase flows. An important step during the development of a CFD model and prior to its application is conducting careful and comprehensive verification and validation studies. Accordingly, efforts to verify and validate the open-source MFIX-DEM software, which can be used for simulating the gas–solids flow using an Eulerian reference frame for the continuum fluid and a Lagrangian discrete framework (Discrete Element Method) for the particles, have been made at the National Energy Technology Laboratory (NETL). In part I of this paper, extensive verification studies were presented and in this part, detailed validation studies of MFIX-DEM are presented. A series of test cases covering a range of gas–solids flow applications were conducted. In particular the numerical results for the random packing of a binary particle mixture, the repose angle of a sandpile formed during a side charge process, velocity, granular temperature, and voidage profiles from a bounded granular shear flow, lateral voidage and velocity profiles from a monodisperse bubbling fluidized bed, lateral velocity profiles from a spouted bed, and the dynamics of segregation of a binary mixture in a bubbling bed were compared with available experimental data, and in some instances with empirical correlations. In addition, sensitivity studies were conducted for various parameters to quantify the error in the numerical simulation.

42 ENGINEERING↗

Numerical studies and metric development for validation of magnetohydrodynamic models on the HIT-SI experiment

We present application of three scalar metrics derived from the Biorthogonal Decomposition (BD) technique to evaluate the level of agreement between macroscopic plasma dynamics in different data sets. BD decomposes large data sets, as produced by distributed diagnostic arrays, into principal mode structures without assumptions on spatial or temporal structure. These metrics have been applied to validation of the Hall-MHD model using experimental data from the Helicity Injected Torus with Steady Inductive helicity injection experiment. Each metric provides a measure of correlation between mode structures extracted from experimental data and simulations for an array of 192 surface-mounted magnetic probes. Numerical validation studies have been performed using the NIMROD code, where the injectors are modeled as boundary conditions on the flux conserver, and the PSI-TET code, where the entire plasma volume is treated. Initial results from a comprehensive validation study of high performance operation with different injector frequencies are presented, illustrating application of the BD method. Using a simplified (constant, uniform density and temperature) Hall-MHD model, simulation results agree with experimental observation for two of the three defined metrics when the injectors are driven with a frequency of 14.5 kHz.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Validation metrics for turbulent plasma transport

Developing accurate models of plasma dynamics is essential for confident predictive modeling of current and future fusion devices. In modern computer science and engineering, formal verification and validation processes are used to assess model accuracy and establish confidence in the predictive capabilities of a given model. This paper provides an overview of the key guiding principles and best practices for the development of validation metrics, illustrated using examples from investigations of turbulent transport in magnetically confined plasmas. Particular emphasis is given to the importance of uncertainty quantification and its inclusion within the metrics, and the need for utilizing synthetic diagnostics to enable quantitatively meaningful comparisons between simulation and experiment. As a starting point, the structure of commonly used global transport model metrics and their limitations is reviewed. An alternate approach is then presented, which focuses upon comparisons of predicted local fluxes, fluctuations, and equilibrium gradients against observation. The utility of metrics based upon these comparisons is demonstrated by applying them to gyrokinetic predictions of turbulent transport in a variety of discharges performed on the DIII-D tokamak [J. L. Luxon, Nucl. Fusion 42, 614 (2002)], as part of a multi-year transport model validation activity.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Testing and validation of multi‐lidar scanning strategies for wind energy applications

Abstract Several factors cause lidars to measure different values of turbulence than an anemometer on a tower, including volume averaging, instrument noise and the use of a scanning circle to estimate the wind field. One way to avoid the use of a scanning circle is to deploy multiple scanning lidars and point them toward the same volume in space to collect velocity measurements and extract high‐resolution turbulence information. This paper explores the use of two multi‐lidar scanning strategies, the tri‐Doppler technique and the virtual tower technique, for measuring 3‐D turbulence. In summer 2013, a vertically profiling Leosphere WindCube lidar and three Halo Photonics Streamline lidars were operated at the Southern Great Plains Atmospheric Radiation Measurement site to test these multi‐lidar scanning strategies. During the first half of the field campaign, all three scanning lidars were pointed at approximately the same point in space and a tri‐Doppler analysis was completed to calculate the three‐dimensional wind vector every second. Next, all three scanning lidars were used to build a ‘virtual tower’ above the WindCube lidar. Results indicate that the tri‐Doppler technique measures higher values of horizontal turbulence than the WindCube lidar under stable atmospheric conditions, reduces variance contamination under unstable conditions and can measure high‐resolution profiles of mean wind speed and direction. The virtual tower technique provides adequate turbulence information under stable conditions but cannot capture the full temporal variability of turbulence experienced under unstable conditions because of the time needed to readjust the scans. Copyright © 2016 John Wiley & Sons, Ltd.

Newman, Jennifer F.↗

Conversion and Validation of Distribution System Model from a QSTS-Based Tool to a Real-Time Dynamic Phasor Simulator

A software process is developed to convert distribution network models from a quasi-static time-series tool (OpenDSS) to a real-time dynamic phasor simulator (ePHASORSIM). The description of this process in this paper would be helpful for researchers who intend to perform similar conversions. The converter could be utilized directly by users of real-time simulators who intend to perform software-in-the-loop or hardware-in-the-loop tests on large distribution test feeders for a range of use cases, including testing functions of advanced distribution management systems against a simulated distribution system. In the future, the developers intend to release the conversion tool as open source to enable use by others.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Validation of MCNPX-PoliMi code for simulations of radioxenon beta-gamma coincidence detection

Radioxenon detection is an important component of the verification regime for the Comprehensive Nuclear-Test-Ban Treaty. We developed and validated a new model in MCNPX-PoliMi to simulate the decay of various radioxenon isotopes and the detector response of a variety of detector types. The model was validated using calibration data from a plastic and NaI(Tl) beta-gamma coincidence detector and the results are presented. The results of this validation show that this model can also be used as a tool to produce training spectra and as a method to calibrate radioxenon detection systems.

Radioxenon analysis, MCNP, beta-gamma coincidence↗

Scalable Programming Workflows for Validation of Quantum Computers

Hybrid quantum-classical workflows have become standard methods for executing variational algorithms and other quantum simulation techniques, which are key applications for noisy intermediate scale quantum (NISQ) computers. Validating these simulations is an important task which helps gauge the progress of quantum computer development, and classical simulation can serve as a tool to this end. Both exact and more scalable approximate methods with quantifiable error bounds can be used in validation tasks where the applicable metrics include the distance from a calculable ground truth, the quality of an error model fit to data, etc. Here we present a library extension that includes methods for validation of quantum simulations based on scalable hybrid workflows executable on high performance computers. We provide examples that use approximate methods based on tensor networks and stabilizer simulators to bound the error of quantum simulations on NISQ hardware.

Nguyen, Thien↗

Introduction: The 2014 Sandia Verification and Validation Challenge Workshop [The 2014 Sandia Verification and Validation Challenge Workshop]

The 2014 Sandia Verification & Validation Challenge Workshop was held at the 3rd ASME Verification & Validation Symposium in Las Vegas, on May 5-8, 2014. The workshop was built around a challenge problem, formulated as an engineering investigation that required integration of experimental data, modeling and simulation, and verification and validation. The challenge problem served as a common basis for the ASME Journal of Verification, Validation, and Uncertainty Quantification participants to both demonstrate methodology and explore a critical aspect of the field: the role of verification and validation in establishing credibility and supporting decision making. Ten groups presented responses to the challenge problem at the workshop, and the follow-on efforts are documented in this special edition of the ASME Journal of Verification, Validation, and Uncertainty Quantification.

97 MATHEMATICS AND COMPUTING↗

Lab-Scale, Closed-Loop Experimental Characterization, Model Refinement, and Validation of a Hydrokinetic Energy-Harvesting Ocean Kite

This paper presents a study wherein we experimentally characterize the dynamics and control system of a lab-scale ocean kite, and then refine, validate, and extrapolate this model for use in a full-scale system. Ocean kite systems, which harvest tidal and ocean current resources through high-efficiency cross-current motion, enable energy extraction with an order of magnitude less material (and cost) than stationary systems with the same rated power output. However, an ocean kite represents a nascent technology that is characterized by relatively complex dynamics and requires sophisticated control algorithms. In order to characterize the dynamics and control of ocean kite systems rapidly, at a relatively low cost, the authors have developed a lab-scale, closed-loop prototyping environment for characterizing tethered systems, whereby 3D printed systems are tethered and flown in a water channel environment. While this system has been shown to be capable of yielding similar dynamic characteristics to some full-scale systems, there are also fundamental limitations to the geometric scales and flow speeds within the water channel environment, making many other real-world scenarios impossible to replicate from the standpoint of dynamic similarity. Here, to address these scenarios, we show how the lab-scale framework is used to refine and validate a scalable dynamic model of a tethered system, which can then be extrapolated to full-scale operation. In this work, we present an extensive case study of this model refinement, validation, and extrapolation on an ocean kite system intended for operation in the Gulf Stream or similar current environments.

42 ENGINEERING↗

Validation of the first LiDAR wind resource assessment buoy system offshore the Northeast United States

The US offshore wind industry is maturing with several projects in various stages of development. These projects require site wind and environmental data before and during operation. Conventional techniques such as fixed-bottom meteorological towers present economical and permitting challenges for the US. Floating Light Detection and Ranging (LiDAR) buoys offer significant advantages including reduced costs, less permitting, and reusability. This paper presents the validation of the first floating LiDAR buoy in Northeast US waters. The buoy, named DeepCLiDAR, includes a LiDAR, ecological monitoring sensors, and metocean sensors. A three-phase LiDAR validation plan was executed, and its results are presented. The objective of the validation plan was to verify the accuracy of measurements made by the LiDAR buoy in wave environments against an unmoving reference wind measurement. Due to a lack of reference met masts, the use of a LiDAR on land as a baseline reference was implemented for validation. Comparison to a reference LiDAR instead of a traditional meteorological tower was a unique approach required in the Northeast US waters due to the absence of a reference fixed-bottom meteorological tower in the region at the time of this study. The testing included a comparison of wind speed measurements made by the buoy deployed 15 km offshore from the mainland and a land-based reference LiDAR located on a nearby island. This paper presents the methodology and results of this program, which indicate favorable agreement. This was the first such validation program in the Northeast USA which is now seeing rapid development of offshore wind.

17 WIND ENERGY↗

Investigating Core Gaps and the Development of Subcomponent Validation Methods for Wind Turbine Blades: Preprint

Core gaps are a common manufacturing defect observed in wind blade composite sandwich constructions, which occur when sheets of core material are not properly butted up against each other in the mold. The aim of this study was to characterize core gaps in composite sandwich constructions at the coupon scale. This was to gain an initial understanding of the defect before developing appropriate methodologies for more complex subcomponents as part of a much broader wind blade structural validation and damage tolerance program. Long beam flexure in 4-point-bending was chosen as the most appropriate loading scenario. Beam specimens were characterized with and without 10 mm core gaps in fiberglass/balsa sandwich beams. The core gaps were characterized with two separate resin systems; a Hexion epoxy and Arkema's Elium resins system (a novel, infusible thermoplastic). Results showed that the Elium beams without the core gaps were had a 15% lower static strength than their epoxy counterparts. The introduction of the core gap to the epoxy beams reduced their static strength by 35%. The Elium beams, however, exhibited negligible strength reductions with the inclusion of the core gap. Overall, this characterization study provided pertinent information with regards to core gaps as a manufacturing defect to allow for continued development of damage tolerance and subcomponent validation methodologies with the inclusion of manufacturing defects.

17 WIND ENERGY↗

Validation of the Intestinal Part of the Prostate Cancer Questionnaire 'QUFW94': Psychometric Properties, Responsiveness, and Content Validity

Purpose: Several treatment options are available for patients with prostate cancer. Applicable and valid self-assessment instruments for assessing health-related quality of life (HRQOL) are of paramount importance. The aim of this study was to explore the validity and responsiveness of the intestinal part of the prostate cancer-specific questionnaire QUFW94. Methods and Materials: The content of the intestinal part of QUFW94 was examined by evaluation of experienced clinicians and reviewing the literature. The psychometric properties and responsiveness were assessed by analyzing HRQOL data from the randomized study Scandinavian Prostate Cancer Group 7 (SPCG)/Swedish Association for Urological Oncology 3 (SFUO). Subscales were constructed by means of exploratory factor analyses. Internal consistency was assessed by Cronbach's alpha. Responsiveness was investigated by comparing baseline scores with the 4-year posttreatment follow-up. Results: The content validity was found acceptable, but some amendments were proposed. The factor analyses revealed two symptom scales. The first scale comprised five items regarding general stool problems, frequency, incontinence, need to plan toilet visits, and daily activity. Cronbach's alpha at 0.83 indicated acceptable homogeneity. The second scale was less consistent with a Cronbach's alpha at 0.55. The overall responsiveness was found to be very satisfactory. Conclusion: Two scales were identified in the bowel dimension of the QUFW94; the first one had good internal consistency. The responsiveness was excellent, and some modifications are suggested to strengthen the content validity.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Validation of the Community Land Model Version 5 over the Contiguous United States (CONUS) using in situ and remote sensing data sets

The Community Land Model (CLM) is an effective tool to simulate the biophysical and biogeochemical processes and their interactions with the atmosphere. Although CLM Version 5 (CLM5) constitutes various updates in these processes, its performance in simulating energy, water and carbon cycles over the Contiguous United States (CONUS) at scales which land surface changes and hydrometeorological and hydroclimatological applications are more locally relevant is yet to be assessed. In this study, we conducted three simulations at 0.125? during 1979-2018 over the CONUS using different configurations of CLM, namely CLM5-biogeochemistry (CLM5BGC), CLM4.5BGC, and CLM5-satellite phenology (CLM5SP). We validated and compared their simulations against multiple remote-sensed and in-situ datasets. Overall, the parametric and structural updates (e.g., carbon cost for nitrogen uptake, variable soil thickness, dry surface layer) in CLM5 improve its ability in capturing terrestrial biogeochemical dynamics. The low evapotranspiration in CLM5BGC is associated with biases in simulating vegetation phenological characteristics rather than soil water limitations. The mismatch between CLM5BGC-simulated peak leaf area index and reference data can be attributed to CLM5BGC's inability in simulating phenology of trees and grasses. The differences between CLM-simulated irrigation and reference estimates can be attributed to differences between processes represented in models and in reality, and uncertainties in input and validation datasets. Evaluation against observations at small catchments suggest that hydrologic parameters needed to be calibrated to improve simulations of runoff, especially subsurface runoff. Additional efforts are needed to incorporate spatially-distributed plant phenology and physiology parameters and regional-specific agricultural management practices (e.g., planting, harvest).

Cheng, Yanyan↗

Validation of IRDFF in 252Cf standard and IRDF-2002 reference neutron fields

The results of validation of the latest release of International Reactor Dosimetry and Fusion File, IRDFF-1.03, in the standard 252Cf(s.f.) and reference 235U(nth,f) neutron benchmark fields are presented. The spectrum-averaged cross sections were shown to confirm the recommended spectrum for 252Cf spontaneous fission source; that was not the case for the current recommended spectra for 235U(nth,f). IRDFF was also validated in the spectra of the research reactor facilities ISNF, Sigma-Sigma and YAYOI, which are available in the IRDF- 2002 collection. Before this analysis, the ISFN spectrum was resimulated to remove unphysical oscillations in spectrum. IRDFF-1.03 was shown to reasonably reproduce the spectrum-averaged data measured in these fields except for the case of YAYOI.

IRDFF↗