Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Validation Studies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Nonsteady Load Responses of Wind Turbines to Atmospheric and Mountain-Generated Turbulence Eddies, With Impacts on the Main Bearing: A Validation Study

Previous computational and field experiments identify three characteristic time scales in the aerodynamic responses of utility-scale wind turbine loads to atmospheric boundary layer (ABL) turbulence: a 30-90 second time scale for the passage of high/low speed "streaks" through the rotor plane, the blade and rotor rotation time scales (approximately 1 to 5 seconds), and a sub-second time scale created by blade rotation through gradients within eddy coherent structure. In the current study we compare aerodynamic load responses from daytime ABL turbulence quantified with large-eddy simulation and a actuator line model of the NREL 5 MW wind turbine with analysis of field data from the NREL/GE 1.5 MW wind turbine 5 kilometers east of the Rocky Mountain Front Range in Colorado. In addition, we contrast the responses to the passage of the mountain-generated eddies embedded within the westerly winds with the ABL eddies embedded within northerly/southerly winds. These analyses are in context with the nonsteady forcing of the main bearing by the aerodynamic generation of nontorque bending moments on the main shaft. Potentially relevant to main bearing failure mechanisms, both computational and field data show that the magnitudes of turbulence-generated nontorque bending moments, that we show generate nonsteady force on the main bearing, are of order, and often larger than, torque (which underlies power). However, the temporal variations in these two responses are uncorrelated, implying that the aerodynamic mechanisms that drive power and main bearing response are fundamentally different. We find this to be the case in the field with both mountain-generated eddies (westerly winds) and ABL-generated eddies (northerly/southerly winds). Whereas the time and length scales are comparable, the mountain eddies were somewhat more energetic than the northerly/southerly ABL eddies. Interestingly, however, the fluctuations in nontorque bending moment that force the main bearing were found to be stronger when forced by the ABL eddies than the mountain eddies. The field studies validate the key results from the computational study and show even stronger response in the nontorque bending moment than in the computer simulations. In all cases, the torque and nontorque bending moments are temporally uncorrelated, torque and power are driven by time variations in rotor-averaged horizontal wind velocity and nontorque bending moments are driven by time changes in the degree of nonuniformity in the distribution of velocity over the rotor plane. Thus the results generalize the mechanisms underlying nonsteady aerodynamic forcing to classes of turbulence eddy types with strength of order or stronger than ABL eddies with transverse scale of order the wind turbine rotor. These include atmospheric turbulence eddies, topography-generated turbulence eddies and, by extension, impacts of turbine-wake-scale turbulence eddies on downstream wind turbine rotors.

17 WIND ENERGY↗

Open-source MFIX-DEM software for gas-solids flows: Part II — Validation studies

With rapid advancements in computer hardware and numerical algorithms, computational fluid dynamics (CFD) has been increasingly employed as a useful tool for investigating the complex hydrodynamics inherent in multiphase flows. An important step during the development of a CFD model and prior to its application is conducting careful and comprehensive verification and validation studies. Accordingly, efforts to verify and validate the open-source MFIX-DEM software, which can be used for simulating the gas–solids flow using an Eulerian reference frame for the continuum fluid and a Lagrangian discrete framework (Discrete Element Method) for the particles, have been made at the National Energy Technology Laboratory (NETL). In part I of this paper, extensive verification studies were presented and in this part, detailed validation studies of MFIX-DEM are presented. A series of test cases covering a range of gas–solids flow applications were conducted. In particular the numerical results for the random packing of a binary particle mixture, the repose angle of a sandpile formed during a side charge process, velocity, granular temperature, and voidage profiles from a bounded granular shear flow, lateral voidage and velocity profiles from a monodisperse bubbling fluidized bed, lateral velocity profiles from a spouted bed, and the dynamics of segregation of a binary mixture in a bubbling bed were compared with available experimental data, and in some instances with empirical correlations. In addition, sensitivity studies were conducted for various parameters to quantify the error in the numerical simulation.

42 ENGINEERING↗

Validation study of sodium pool fire modeling efforts in $\mathrm{MELCOR}$ and $\mathrm{SPHINCS}$ codes

Discharge of sodium coolant into containment from a sodium-cooled fast reactor vessel can occur in the event of a pipe leak or break. In this situation, some of the liquid sodium droplets discharged from the coolant system will react with oxygen in the air before reaching the containment. This phase of the event is normally termed the sodium spray fire phase. Unreacted sodium droplets pool on the containment floor where continued reaction with containment atmospheric oxygen occurs. This phase of the event is normally termed the sodium pool fire phase. Both phases of these sodium-oxygen reactions (or fires) are important to model because of the heat addition and aerosol generation that occur. Any fission products trapped in the sodium coolant may also be released during this progression of events, which if released from containment could pose a health risk to workers and the public. The paper describes progress of an international collaborative research in the area of the sodium fire modeling in the sodium-cooled fast reactors between the United States and Japan under the framework of the Civil Nuclear Energy Research and Development Working Group. In this collaboration between Sandia National Laboratories and Japan Atomic Energy Agency, the validation basis for and modeling capabilities of sodium spray and pool fires in MELCOR of Sandia National Laboratories and SPHINCS of Japan Atomic Energy Agency are being enhanced. Here this study documents MELCOR and SPHINCS sodium pool fire model validation exercises against the JAEA’s sodium pool fire experiments, F7-1 and F7-2. The proposed enhancement of the sodium pool fire models in MELCOR through addition of thermal hydraulic and sodium spreading models that enable a better representation of experimental results is also described.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Modeling heat transport processes in enhanced geothermal systems: Validation study from EGS Collab Experiment 1

Heat recovery from enhanced geothermal systems (EGS) is a complex process involving heat transport in both fracture networks and rock formations. A comprehensive understanding of and the ability to model the underlying heat transport mechanisms is important for the success of EGS but remains challenging in practice due to the generally insufficient characterization of EGS reservoirs. In the present study, we analyze an extensively monitored intermediate-scale EGS field experiment performed in a well-characterized testbed. The high-resolution, high-quality measurements from the field experiment enable the development of a high-fidelity model incorporating a well-constrained fracture network. Based on the field experiment, we investigate the complex heat transport processes in an EGS-relevant environment and validate the capability of a numerical approach in simulating these inherently coupled heat transport processes. A series of numerical simulations were performed to study the effects of different heat transport mechanisms, including thermal convection with fracture flow, thermal conduction in rock formations, and the Joule-Thomson effect. The agreement of thermal responses between field measurements and simulation results indicates that our numerical approach can appropriately model the heat transport processes pertaining to heat recovery from EGS reservoirs.

Wu, Hui↗

High-Fidelity Numerical Wave Tank Verification & Validation Study: Wave Generation Through Paddle Motion: Preprint

This paper presents a numerical benchmark study of wave propagation due to a paddle motion using different high-fidelity numerical models, which are capable of replicating the nearly actual physical wave tank testing. A full time series of the measured wave generation paddle motion which was used to generate wave propagation in the physical wave tank will be utilized in each of the models contributed by IEA OES Task 10's participants, which includes both computational fluid dynamics (CFD) and smooth hydrodynamic particle (SPH). The high-fidelity simulations of the physical wave testcase will allow for the evaluation of the initial transient effects from wave ramp-up and its evolution in the wave tank over time for two representative regular waves with varying levels of nonlinearity. A couple of interesting metrics like the predicted wave surface elevation at select wave probes, wave period, and phase-shift in time will be assessed to evaluate the relative accuracy of numerical models versus experimental data within specified time intervals. These models will serve as a guide for modelers in the wave energy community and provide a base case to allow further and more detailed numerical modeling of the fixed Kramer Sphere Cases under wave excitation force wave tank testing.

HYDRO ENERGY,TIDAL AND WAVE POWER↗

SCEC/USGS Community Stress-Drop Validation Study: How Spectral Fitting Approaches Influence Measured Source Parameters

Spectral source parameters used to estimate an earthquake’s stress drop (⁠Δσ⁠) can vary significantly across measurement approaches. The Statewide California Earthquake Center/U.S. Geological Survey Community Stress‐Drop Validation Study was initiated to compare source parameter estimates, focusing initially on a dataset from the 2019 Ridgecrest earthquake sequence. As part of that validation effort, here we focus on one potential source of uncertainty: whether spectral fitting approaches alone, applied to a common set of spectra from the 2019 Ridgecrest sequence result in different source parameter estimates. By using a common set of benchmark spectra analyzed across a consistent frequency band of 1–40 Hz, we eliminate many sources of variability. A subgroup of validation study participants volunteered to estimate the low‐frequency displacement (⁠Ω 0 ⁠) and corner frequency (⁠ƒ c ⁠) by fitting a smooth function to benchmark displacement spectra. Participants used linear‐ or log‐sampled spectra, assumed a Brune or Boatwright spectral model, and applied different misfit criteria. We compare 17 approaches used to estimate ⁠Ω 0 ⁠, ƒ c ⁠, and Δσ for 54 earthquake spectra. Our results reveal that 35% of events have Δσ estimates within a factor of two, whereas others exhibit variations exceeding an order of magnitude. The variability in and can largely be attributed to whether a spectrum is consistent with the smooth function of an idealized simple crack model. The trade‐off between Ω 0 and ƒ c may be more pronounced when using linearly sampled spectra, as higher frequency spectral bumps control the fits. As expected, methods that assumed a Boatwright model tended to have lower Ω 0 and somewhat higher ƒ c compared to those assuming a Brune model, although resulting Δσ estimates are similar. Finally, when compared to the overall validation study results, the fitting approach alone may account for between 5% and 90% (25% on average) of the total variability in spectral Δσ⁠.

58 GEOSCIENCES↗

The Importance of Addressing Disagreements Between Nominal and Effective Treatments During Bat Mortality Minimization Validation Studies

As the wind energy industry grows, so too does our need for effective and low-cost bat mortality minimization solutions. Despite knowledge gaps in our understanding of what drives bats to collide with spinning turbines, minimization solutions have shown success during validation studies. Curtailment has been consistently effective, reducing bat mortality from 33%-79%, depending on the curtailment scenario and species present. Several validation studies have demonstrated deterrent solutions, specifically ultrasonic deterrents, to be effective, but overall, more variable compared to curtailment solutions. Further, a study combining curtailment with ultrasonic deterrents produced encouraging results, finding that adding ultrasonic deterrents to turbines that were designated to curtail, significantly reduced mortality rates compared to curtailment only turbines. Despite positive results, the strength of inference achieved with validation studies is limited by methodological constraints associated with appropriately assigning fatalities to treatments. Because of the temporal separation between when a bat collides with a turbine and when it is discovered during a ground-based carcass survey, we must assign carcasses to a treatment that ran during the prior night(s). This process may introduce errors at multiple stages. First, for studies that rotate treatments among turbines, mortality surveyors must be confident that carcasses are 'fresh' such that mortalities are correctly assigned to the treatment from the previous night(s). Second, we must reconcile any misalignments between how we assign treatments and how we implement treatments (e.g., turbines assigned with a deterrent treatment may be implemented as another treatment when deterrent devices are not operating as designed). Finally, for curtailment solutions, it is critical to recognize that measured effects are a function of not just the treatment as implemented but the proportion of the night the treatment is realized (e.g., if wind speeds are greater than the curtailment treatment cut-in speed for the entire night, we cannot expect there to me any differences in mortality reduction relative to control turbines). Using a dataset collected between June and October 2017, that rotated 3 treatments (Deterrent Only, 5 m/s Curtail only, and 5 m/s Curtail & Deterrent) and 1 control condition across 16 turbines each night, we explored the importance and implications of accounting for potential errors in assigning fatalities to treatments. We present preliminary results comparing the mortality associated with error-corrected treatments and control conditions highlighting how the measured effect of a treatment (mortality) greatly depends on site specific implementation.

bats↗

Quick Urban and Industrial Complex (QUIC) CBR Plume Modeling System: Validation-Study Document

This document contains information on QUIC validation studies that have been performed to evaluate the wind, pressure, and concentration solutions produced by QUIC. Tests of QUIC's source term models and specialized transport mechanisms (e.g., buoyancy algorithms, particle settling and deposition, liquid pool growth, droplet and pool evaporation) are also provided. A brief description of the experiment, a few example validation results, and references to journal articles, reports, and/or presentations are given. Both LANL and non-LANL sources are provided.

54 ENVIRONMENTAL SCIENCES↗

Monte Carlo simulations of adult and pediatric computed tomography exams: Validation studies of organ doses with physical phantoms

Purpose: To validate the accuracy of a Monte Carlo source model of the Siemens SOMATOM Sensation 16 CT scanner using organ doses measured in physical anthropomorphic phantoms. Methods: The x-ray output of the Siemens SOMATOM Sensation 16 multidetector CT scanner was simulated within the Monte Carlo radiation transport code, MCNPX version 2.6. The resulting source model was able to perform various simulated axial and helical computed tomographic (CT) scans of varying scan parameters, including beam energy, filtration, pitch, and beam collimation. Two custom-built anthropomorphic phantoms were used to take dose measurements on the CT scanner: an adult male and a 9-month-old. The adult male is a physical replica of University of Florida reference adult male hybrid computational phantom, while the 9-month-old is a replica of University of Florida Series B 9-month-old voxel computational phantom. Each phantom underwent a series of axial and helical CT scans, during which organ doses were measured using fiber-optic coupled plastic scintillator dosimeters developed at University of Florida. The physical setup was reproduced and simulated in MCNPX using the CT source model and the computational phantoms upon which the anthropomorphic phantoms were constructed. Average organ doses were then calculated based upon these MCNPX results. Results: For all CT scans, good agreement was seen between measured and simulated organ doses. For the adult male, the percent differences were within 16% for axial scans, and within 18% for helical scans. For the 9-month-old, the percent differences were all within 15% for both the axial and helical scans. These results are comparable to previously published validation studies using GE scanners and commercially available anthropomorphic phantoms. Conclusions: Overall results of this study show that the Monte Carlo source model can be used to accurately and reliably calculate organ doses for patients undergoing a variety of axial or helical CT examinations on the Siemens SOMATOM Sensation 16 scanner.

60 APPLIED LIFE SCIENCES↗

L-mode validation studies of gyrokinetic turbulence simulations via multiscale and multifield turbulence measurements on the DIII-D tokamak

A series of carefully designed experiments on DIII-D have taken advantage of a broad set of turbulence and profile diagnostics to rigorously test gyrokinetic turbulence simulations. In this paper the goals, tools and experiments performed in these validation studies are reviewed and specific examples presented. It is found that predictions of transport and fluctuation levels in the mid-core region (0.4 < ρ < 0.75) are in better agreement with experiment than those in the outer region (ρ ≥ 0.75) where edge coupling effects may become increasingly important and multiscale simulations may also be necessary. Validation studies such as these are crucial in developing confidence in a first-principles based predictive capability for ITER.

Physics↗

Validation Study in SAS4A Code in Simulated Mild TOP Condition

Model improvements and validation efforts for SAS4A code, which is the most advanced computer code for simulating the the primary phase of the Core Disruptive Accident (CDA) of MOX-fueled Sodium-cooled Fast Reactors, have been performed utilizing the experimental data from the CABRI programs by JAEA (Japan Atomic Energy Agency), IRSN (Institut de Radioprotection et de Surete Nucleaire), CEA (Commissariat a l'Energie Atomique et aux Energies Alternatives) and KIT (Karlsruhe Institute of Technology). In order to confirm validity of improved models of SAS4A, a systematic and comprehensive validation plan was defined. It was based on the PIRT (Phenomena Identification and Ranking Table) result for CDA of MOX-fueled fast reactors. The fuel failure position and time are the most important parameters, which dominate the analytical results in a reactor calculation. The failure position will affect the reactivity feedback due to the fuel distribution after failure and consequently would have an effect on the energy release in the initiating phase. This paper describes the preliminary result of validation study for SAS4A code in simulated Transient Over-Power (TOP) condition. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Validation Study of Experimental Insulating and Air-Sealing Technology for Enclosed Roof Cavities

Validation Study of Experimental Insulating and Air-Sealing Technology for Enclosed Roof Cavities, explores a new minimally invasive system known as Pinhole Insulation ® for retroft insulation of cathedral ceilings, flat roofs, dormer roofs, and other enclosed roof cavities. It also explores the validation of the associated equipment, software, and materials used in this application. The Pinhole Insulation process essentially consists of drilling a ¼” hole in the ceiling surface and then injecting closed cell polyurethane foam such that the foam is deposited on the interior surface of the exterior roof sheathing. In a typical cathedral ceiling with R19 batts, the R value will be improved by at least 60% and the cavity will become completely air sealed. The system is quick, minimally invasive and at least an order of magnitude less expensive than alternatives such as removing the ceiling surface and spraying closed cell foam.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Plasma Levels of IL-8 and TGF-β1 Predict Radiation-Induced Lung Toxicity in Non-Small Cell Lung Cancer: A Validation Study

Purpose and Objectives: We previously reported that the combination of mean lung dose (MLD) and inflammatory cytokines interleukin-8 (IL-8) and transforming growth factor-β1 (TGF-β1) may provide a more accurate model for radiation-induced lung toxicity (RILT) prediction in 58 patients with non-small cell lung cancer (NSCLC). This study is to validate the previous findings with new patients and to explore new models with more cytokines. Methods and Materials: One hundred forty-two patients with stage I-III NSCLC treated with definitive radiation therapy (RT) from prospective studies were included. Sixty-five new patients were used to validate previous findings, and all 142 patients were used to explore new models. Thirty inflammatory cytokines were measured in plasma samples before RT and 2 weeks and 4 weeks during RT (pre, 2w, 4w). Grade ≥2 RILT was defined as grade 2, and higher radiation pneumonitis or symptomatic pulmonary fibrosis was the primary endpoint. Logistic regression was performed to evaluate the risk factors of RILT. The area under the curve (AUC) for the receiver operating characteristic curves was used for model assessment. Results: Sixteen of 65 patients (24.6%) experienced RILT2. Lower pre IL-8 and higher TGF-β1 2w/pre ratio were associated with higher risk of RILT2. The AUC increased to 0.73 by combining MLD, pre IL-8, and TGF-β1 2w/pre ratio compared with 0.61 by MLD alone to predict RILT. In all 142 patients, 29 patients (20.4%) experienced grade ≥2 RILT. Among the 30 cytokines measured, only IL-8 and TGF-β1 were significantly associated with the risk of RILT2. MLD, pre IL-8 level, and TGF-β1 2w/pre ratio were included in the final predictive model. The AUC increased to 0.76 by combining MLD, pre IL-8, and TGF-β1 2w/pre ratio compared with 0.62 by MLD alone. Conclusions: We validated that a combination of mean lung dose, pre IL-8 level, and TGF-β1 2w/pre ratio provided a more accurate model to predict the risk of RILT2 compared with MLD alone.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A GLOBAL TWO-TEMPERATURE CORONA AND INNER HELIOSPHERE MODEL: A COMPREHENSIVE VALIDATION STUDY

The recent solar minimum with very low activity provides us a unique opportunity for validating solar wind models. During CR2077 (2008 November 20 through December 17), the number of sunspots was near the absolute minimum of solar cycle 23. For this solar rotation, we perform a multi-spacecraft validation study for the recently developed three-dimensional, two-temperature, Alfven-wave-driven global solar wind model (a component within the Space Weather Modeling Framework). By using in situ observations from the Solar Terrestrial Relations Observatory (STEREO) A and B, Advanced Composition Explorer (ACE), and Venus Express, we compare the observed proton state (density, temperature, and velocity) and magnetic field of the heliosphere with that predicted by the model. Near the Sun, we validate the numerical model with the electron density obtained from the solar rotational tomography of Solar and Heliospheric Observatory/Large Angle and Spectrometric Coronagraph C2 data in the range of 2.4 to 6 solar radii. Electron temperature and density are determined from differential emission measure tomography (DEMT) of STEREO A and B Extreme Ultraviolet Imager data in the range of 1.035 to 1.225 solar radii. The electron density and temperature derived from the Hinode/Extreme Ultraviolet Imaging Spectrometer data are also used to compare with the DEMT as well as the model output. Moreover, for the first time, we compare ionic charge states of carbon, oxygen, silicon, and iron observed in situ with the ACE/Solar Wind Ion Composition Spectrometer with those predicted by our model. The validation results suggest that most of the model outputs for CR2077 can fit the observations very well. Based on this encouraging result, we therefore expect great improvement for the future modeling of coronal mass ejections (CMEs) and CME-driven shocks.

79 ASTRONOMY AND ASTROPHYSICS↗

Overview of the SCEC/USGS Community Stress Drop Validation Study Using the 2019 Ridgecrest Earthquake Sequence

We present initial findings from the ongoing Community Stress Drop Validation Study to compare spectral stress-drop estimates for earthquakes in the 2019 Ridgecrest, California, sequence. This study uses a unified dataset to independently estimate earthquake source parameters through various methods. Stress drop, which denotes the change in average shear stress along a fault during earthquake rupture, is a critical parameter in earthquake science, impacting ground motion, rupture simulation, and source physics. Spectral stress drop is commonly derived by fitting the amplitude-spectrum shape, but estimates can vary substantially across studies for individual earthquakes. Sponsored jointly by the U.S. Geological Survey and the Statewide (previously, Southern) California Earthquake Center our community study aims to elucidate sources of variability and uncertainty in earthquake spectral stress-drop estimates through quantitative comparison of submitted results from independent analyses. The dataset includes nearly 13,000 earthquakes ranging from M 1 to 7 during a two-week period of the 2019 Ridgecrest sequence, recorded within a 1° radius. Here, in this article, we report on 56 unique submissions received from 20 different groups, detailing spectral corner frequencies (or source durations), moment magnitudes, and estimated spectral stress drops. Methods employed encompass spectral ratio analysis, spectral decomposition and inversion, finite-fault modeling, ground-motion-based approaches, and combined methods. Initial analysis reveals significant scatter across submitted spectral stress drops spanning over six orders of magnitude. However, we can identify between-method trends and offsets within the data to mitigate this variability. Averaging submissions for a prioritized subset of 56 events shows reduced variability of spectral stress drop, indicating overall consistency in recovered spectral stress-drop values.

58 GEOSCIENCES↗