Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Validation Studies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Nonsteady Load Responses of Wind Turbines to Atmospheric and Mountain-Generated Turbulence Eddies, With Impacts on the Main Bearing: A Validation Study

Previous computational and field experiments identify three characteristic time scales in the aerodynamic responses of utility-scale wind turbine loads to atmospheric boundary layer (ABL) turbulence: a 30-90 second time scale for the passage of high/low speed "streaks" through the rotor plane, the blade and rotor rotation time scales (approximately 1 to 5 seconds), and a sub-second time scale created by blade rotation through gradients within eddy coherent structure. In the current study we compare aerodynamic load responses from daytime ABL turbulence quantified with large-eddy simulation and a actuator line model of the NREL 5 MW wind turbine with analysis of field data from the NREL/GE 1.5 MW wind turbine 5 kilometers east of the Rocky Mountain Front Range in Colorado. In addition, we contrast the responses to the passage of the mountain-generated eddies embedded within the westerly winds with the ABL eddies embedded within northerly/southerly winds. These analyses are in context with the nonsteady forcing of the main bearing by the aerodynamic generation of nontorque bending moments on the main shaft. Potentially relevant to main bearing failure mechanisms, both computational and field data show that the magnitudes of turbulence-generated nontorque bending moments, that we show generate nonsteady force on the main bearing, are of order, and often larger than, torque (which underlies power). However, the temporal variations in these two responses are uncorrelated, implying that the aerodynamic mechanisms that drive power and main bearing response are fundamentally different. We find this to be the case in the field with both mountain-generated eddies (westerly winds) and ABL-generated eddies (northerly/southerly winds). Whereas the time and length scales are comparable, the mountain eddies were somewhat more energetic than the northerly/southerly ABL eddies. Interestingly, however, the fluctuations in nontorque bending moment that force the main bearing were found to be stronger when forced by the ABL eddies than the mountain eddies. The field studies validate the key results from the computational study and show even stronger response in the nontorque bending moment than in the computer simulations. In all cases, the torque and nontorque bending moments are temporally uncorrelated, torque and power are driven by time variations in rotor-averaged horizontal wind velocity and nontorque bending moments are driven by time changes in the degree of nonuniformity in the distribution of velocity over the rotor plane. Thus the results generalize the mechanisms underlying nonsteady aerodynamic forcing to classes of turbulence eddy types with strength of order or stronger than ABL eddies with transverse scale of order the wind turbine rotor. These include atmospheric turbulence eddies, topography-generated turbulence eddies and, by extension, impacts of turbine-wake-scale turbulence eddies on downstream wind turbine rotors.

17 WIND ENERGY↗
DOE OSTI2024

High-Fidelity Numerical Wave Tank Verification & Validation Study: Wave Generation Through Paddle Motion: Preprint

This paper presents a numerical benchmark study of wave propagation due to a paddle motion using different high-fidelity numerical models, which are capable of replicating the nearly actual physical wave tank testing. A full time series of the measured wave generation paddle motion which was used to generate wave propagation in the physical wave tank will be utilized in each of the models contributed by IEA OES Task 10's participants, which includes both computational fluid dynamics (CFD) and smooth hydrodynamic particle (SPH). The high-fidelity simulations of the physical wave testcase will allow for the evaluation of the initial transient effects from wave ramp-up and its evolution in the wave tank over time for two representative regular waves with varying levels of nonlinearity. A couple of interesting metrics like the predicted wave surface elevation at select wave probes, wave period, and phase-shift in time will be assessed to evaluate the relative accuracy of numerical models versus experimental data within specified time intervals. These models will serve as a guide for modelers in the wave energy community and provide a base case to allow further and more detailed numerical modeling of the fixed Kramer Sphere Cases under wave excitation force wave tank testing.

HYDRO ENERGY,TIDAL AND WAVE POWER↗
DOE OSTI2024

SCEC/USGS Community Stress-Drop Validation Study: How Spectral Fitting Approaches Influence Measured Source Parameters

Spectral source parameters used to estimate an earthquake’s stress drop (⁠Δσ⁠) can vary significantly across measurement approaches. The Statewide California Earthquake Center/U.S. Geological Survey Community Stress‐Drop Validation Study was initiated to compare source parameter estimates, focusing initially on a dataset from the 2019 Ridgecrest earthquake sequence. As part of that validation effort, here we focus on one potential source of uncertainty: whether spectral fitting approaches alone, applied to a common set of spectra from the 2019 Ridgecrest sequence result in different source parameter estimates. By using a common set of benchmark spectra analyzed across a consistent frequency band of 1–40 Hz, we eliminate many sources of variability. A subgroup of validation study participants volunteered to estimate the low‐frequency displacement (⁠Ω 0 ⁠) and corner frequency (⁠ƒ c ⁠) by fitting a smooth function to benchmark displacement spectra. Participants used linear‐ or log‐sampled spectra, assumed a Brune or Boatwright spectral model, and applied different misfit criteria. We compare 17 approaches used to estimate ⁠Ω 0 ⁠, ƒ c ⁠, and Δσ for 54 earthquake spectra. Our results reveal that 35% of events have Δσ estimates within a factor of two, whereas others exhibit variations exceeding an order of magnitude. The variability in and can largely be attributed to whether a spectrum is consistent with the smooth function of an idealized simple crack model. The trade‐off between Ω 0 and ƒ c may be more pronounced when using linearly sampled spectra, as higher frequency spectral bumps control the fits. As expected, methods that assumed a Boatwright model tended to have lower Ω 0 and somewhat higher ƒ c compared to those assuming a Brune model, although resulting Δσ estimates are similar. Finally, when compared to the overall validation study results, the fitting approach alone may account for between 5% and 90% (25% on average) of the total variability in spectral Δσ⁠.

58 GEOSCIENCES↗
DOE OSTI2025

Overview of the SCEC/USGS Community Stress Drop Validation Study Using the 2019 Ridgecrest Earthquake Sequence

We present initial findings from the ongoing Community Stress Drop Validation Study to compare spectral stress-drop estimates for earthquakes in the 2019 Ridgecrest, California, sequence. This study uses a unified dataset to independently estimate earthquake source parameters through various methods. Stress drop, which denotes the change in average shear stress along a fault during earthquake rupture, is a critical parameter in earthquake science, impacting ground motion, rupture simulation, and source physics. Spectral stress drop is commonly derived by fitting the amplitude-spectrum shape, but estimates can vary substantially across studies for individual earthquakes. Sponsored jointly by the U.S. Geological Survey and the Statewide (previously, Southern) California Earthquake Center our community study aims to elucidate sources of variability and uncertainty in earthquake spectral stress-drop estimates through quantitative comparison of submitted results from independent analyses. The dataset includes nearly 13,000 earthquakes ranging from M 1 to 7 during a two-week period of the 2019 Ridgecrest sequence, recorded within a 1° radius. Here, in this article, we report on 56 unique submissions received from 20 different groups, detailing spectral corner frequencies (or source durations), moment magnitudes, and estimated spectral stress drops. Methods employed encompass spectral ratio analysis, spectral decomposition and inversion, finite-fault modeling, ground-motion-based approaches, and combined methods. Initial analysis reveals significant scatter across submitted spectral stress drops spanning over six orders of magnitude. However, we can identify between-method trends and offsets within the data to mitigate this variability. Averaging submissions for a prioritized subset of 56 events shows reduced variability of spectral stress drop, indicating overall consistency in recovered spectral stress-drop values.

58 GEOSCIENCES↗
DOE OSTI2025

Alaska's Rural Building Stock: a Validation Study Using ResStock and Field Data

The availability of accurate national data on demographics, building stock, and energy use is vital for modeling residential buildings and evaluating decarbonization strategies. However, rural and Indigenous populations, including those in rural Alaska, are typically underrepresented in these datasets. These communities face unique challenges due to their remote locations, severe weather conditions, and limited access to resources, resulting in high energy burden. This report examines how rural Alaskan communities are underrepresented in the ResStock housing model and highlights the need for improved data to address their unique housing and energy challenges. Thus, this report examines the representation of rural Alaskan communities within the national housing stock model, ResStock. A validation study was conducted, considering ResStock, Field Data and Aerial and 3D-view data collection (A3DDC) datasets. The validation process started by using the down selecting approach on the ResStock building stock dataset. For the purpose of this study, only the rural Alaska Boroughs and Census areas located in ASHRAE IECC Climate Zone 8 were considered to ensure a more accurate and fair comparison with the field data, which was collected in rural areas located in climate zone 8, specifically within the Nome Census area. While ResStock may accurately represent several characteristics of the building stock for rural Alaska, some differences between modeled, field data, and aerial and 3D-view data collection datasets were identified. The following building characteristics have a high impact on modeled energy consumption and demonstrated large differences: Revisit heating setpoints and consider a substantially higher setpoint distribution, it could potentially address "missing loads" if this is the case. Develop and include Toyo heating in future modeling for ResStock and EnergyPlus. Remove natural gas as a water heater fuel type outside of North Slope County. Foundation type updated to have more crawlspaces rather than basements. Infiltration rates need reexamination for a larger distribution toward higher infiltration rates. Include more vinyl and less brick in exterior wall type and revise wall color for greater proportion of light rather than dark color. Roof material revised from majority shingles to majority metal. Update number of occupants to higher number of occupant count. Building orientation represents a higher proportion of south facing buildings rather than relatively equal. The findings suggest that updating ResStock's probability logic could better represent rural Alaskan buildings. ResStock can be utilized to identify the best upgrades or energy efficiency and energy efficiency improvements, helping community leaders in making more informed decisions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Californium-252 production at the High Flux Isotope Reactor - I: Validation study using campaign data

This paper presents a series of 252 Cf production validation and code-to-code comparison studies performed based on data from the production campaigns at the High Flux Isotope Reactor (HFIR). These studies support efforts to convert HFIR from using highly enriched uranium (HEU) fuel to low-enriched uranium (LEU) fuel. HFIR must maintain its world-class performance and missions following this conversion, and because 252 Cf is a vital neutron-emitting radioisotope used for a variety of high-impact applications (e.g., reactor startup, cancer treatment), the ability to efficiently produce 252 Cf must be preserved. In this work, the HFIRCON, Shift, ORIGEN, and TCOMP codes were deployed, and several sets of data libraries were investigated to better understand the calculation codes and the data biases. As-loaded target composition data, as-run irradiation history data, and post-irradiation measurements from recent multi-cycle irradiation campaigns of the HEU core were used to validate and determine methodology biases. Further, the findings demonstrated a good agreement, with results falling within 3 standard deviations of measurements. This paper lays the ground work for the second paper, which evaluates and compares 252 Cf production and safety metrics with the HEU core and a proposed LEU core.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2024

Validation study of RWM stability in DIII-D high- β N plasmas

The n = 1 (n is the toroidal mode number) resistive wall mode (RWM) stability is numerically investigated for two DIII-D high-β N discharges 176440 and 172461, utilizing the MARS-F (Liu et al 2000 Phys. Plasmas 7 3681) and MARS-K (Liu et al 2008 Phys. Plasmas 15 112503) codes. Systematic validation efforts are attempted, for the first time, for discharges with very slow or vanishing toroidal flow for a large fraction of the plasma volume. While gaining physics insights in accessing stable operation regime at β N exceeding the Troyon no-wall limit in these slow-rotation experiments, the predictive capability of fluid and non-perturbative magnetohydrodynamic-kinetic hybrid models for the RWM is further confirmed. The MARS-F fluid model, with a strong but numerically tunable viscosity mimicking ion Landau damping of parallel sound waves, finds complete stabilization of the n = 1 RWM in the considered DIII-D plasmas under the experimental flow conditions. Similarly, either full stabilization (for discharge 176440) or marginal stability (for discharge 172461) of the mode is computed by the MARS-K hybrid model, which is first-principle based without free model parameters. In particular, all drift kinetic resonances, including those of thermal and energetic particles, are found to synergistically act to marginally stabilize the RWM in discharge 172461. These MARS-F/K modeling results explain the experimentally observed stable operational regime in DIII-D, as far as the RWM stability is concerned. Extensive numerical sensitivity studies, with respect to the plasma toroidal flow speed as well as the radial location of the resistive wall, are also carried out to further support the validation study.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Validation Studies of RELAP5-3D for High-Temperature Gas-Cooled Reactor Analysis Using a Refined RELAP5-3D Model of the High Temperature Test Facility

RELAP5-3D has been used extensively for high-temperature gas-cooled reactor (HTGR) analysis, but such analysis lies outside the validation basis for the code. Oregon State University (OSU) and the United States Department of Energy’s (DOE) Advanced Reactor Technologies (ART) – Gas-cooled reactor campaign worked together to design and operate the High Temperature Test Facility (HTTF) at OSU to provide validation data for prismatic HTGR thermal hydraulics analysis. Work using a previous RELAP5-3D model of HTTF demonstrated the ability to reproduce trends in HTTF data but an inability to reproduce the values measured in multiple experiments within the uncertainty. It was hypothesized that a new model with a finer radial nodalization would perform better for HTTF analysis. In this paper, we present the development of that more refined model and analyze HTTF experiments PG-27 and PG-29, a pressurized (PCC) and depressurized conduction cooldown (DCC) transient. Comparing PG-27 results to experimental data shows a better prediction of steady state and transient temperatures; however, a deeper dive reveals that better transient temperature predictions are a result of better initial conditions. The transient temperature rise in the core is comparable between the two models, but the legacy model predicts temperatures in the reflectors better. The new model demonstrates the ability to predict unique temperatures in each sector of the core during PG-29, capturing the azimuthal asymmetry; however, the temperature predictions still differ from measured temperatures. One hypothesis is that differences between the assumed and actual power distribution leads to the underprediction of the individual block temperatures. These results suggest that gaps and uncertainties in the measured boundary conditions for the HTTF tests do not allow to fully validate RELAP5-3D for prismatic HTGR analyses. The authors suspect that some of the differences between predicted and measured temperatures may be a result of uncertainties associated with HTTF itself rather than RELAP5-3D. We demonstrated improved validation for steady-state analysis, but significantly improved transient performance has yet to be recognized.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

SCALE 6.3 Validation: Radiation Shielding

Safe and reliable use of scientific and engineering computer codes requires validation for the types of applications in which they will be used. An example in the nuclear reactor engineering and licensing field is radiation transport employed in shielding analyses. The validity of computer codes for shielding applications is demonstrated in this report for SCALE version 6.3.0. Representative benchmarks corresponding to shielding analyses are selected for the validation study. Typical measurement results analyzed from these benchmarks include neutron fluxes, detector count rates, detector energy response functions, neutron and gamma dose rates, neutron activation rates and activities, neutron leakage fluxes, and skyshine dose rates. Thousands of points of comparison between measurement and calculation are presented in this work. Other than rare outliers typically explained by either a lack of information or large uncertainties in the experiment conditions, material, or dimensions, the Monaco with Automated Variance Reduction using Importance Calculations (MAVRIC) radiation transport computer code with built-in variance reduction methods distributed with the SCALE computer code system agrees well with the measurement results. In selected benchmarks, MAVRIC is also compared to Monte Carlo N- Particle® (MCNP® ) 1 calculations. Both computer codes generally agree well within the estimated uncertainties. With the release of SCALE 6.3.0, Shift was integrated as an alternative transport solver in MAVRIC, denoted MAVRIC-Shift. Although the traditional MAVRIC using Monaco was used primarily in this validation study, many results have also been generated using MAVRIC-Shift. Agreement between MAVRIC-Monaco and MAVRIC-Shift is generally very good. The benchmarks presented in this report were obtained from reliable sources such as the International Criticality Safety Benchmark Evaluation Project Handbook, the Shielding Integral Benchmark Archive & Database, and other shielding validation work found in the literature. Additional datapoints and benchmarks will be added to future versions of this report to expand the shielding validation suite.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2024

Experimental Study for Validation of Resilient Response of Controls - Thrust 2 Controls Assessment

The focus of this project is to design, execute, and analyze experiments around resilience response. As part of the Resilience through Data-Driven, Intelligently Designed Control (RD2C) initiative, this project builds upon the previously designed control algorithms and experiments. It designs detailed uses cases to test RD2C-developed mitigation schemes in specific realistic scenarios, analyze and save the measurement data sets. Having a high-confidence and consistent data set is crucial for identifying relevant metrics to describe the system resilience in specific real-life-like scenarios of power grid operation.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Structural uncertainty assessment for fire-engulfed objects in crosswind: Establishing credibility for a multiphysics wall-modeled large-eddy simulation paradigm

A structural uncertainty validation study for a large-scale, fire-engulfed, elevated object subjected to crosswind is presented to establish the credibility of a high-fidelity, low-Mach, turbulent reacting flow wall-modeled large-eddy simulation (WMLES) approach that includes multiphysics coupling to participating media radiation and conjugate heat transfer. To establish that WMLES can accurately predict surface quantities including drag and pressure coefficient in the low-Mach crosswind regime, a foundational elevated isothermal cylinder validation case is presented at a similar gap-to-diameter ratio of 0.25, spanning the subcritical to supercritical drag regime (Re 𝐷 = 1.1 × 10 5 and 4.3 × 10 5 , respectively). Here, this study exercised both static and dynamic coefficient LES (Smagorinsky and 𝑘 sgs ) with both local and exchange-based velocity sampling. Results showcase that the drag crisis (or the sudden drop in drag coefficient at increased Re 𝐷 ) is well captured when using an exchange-based dynamic coefficient WMLES methodology, while noting lack of mesh convergence and overall drag and pressure coefficient predictively when using a static coefficient, local velocity sampling WMLES. For the 𝒪⁡(10) m JP-8 liquid pool fire crosswind validation study presented, two experimental crosswind configurations (2 m/s and 9.5 m/s) are showcased for a fire-engulfed mock fuselage roughly 4 m in diameter. Using the best model-form practices identified in the isothermal study, dynamic coefficient 𝑘 sgs exchange-based WMLES fire validation findings demonstrate accurate peak irradiation and skin temperature predictions as a function of crosswind magnitude. Excessive yaw in the low-crosswind fuselage configuration, consistent with experimental findings, captured a significant predicted asymmetry in flame attachment and heat flux toward the downwind cylindrical cap—indicative of axial vortex structures transporting the flame along the upper and lower fuselage leeward surface. All fire mesh resolution simulations captured the experimental finding that as crosswind increased, predicted flame shape and peak irradiation magnitude onto the fuselage transitioned from a windward to a leeward cylinder location due to the migration of the upper- to lower-shear fuel/air mixing layer thereby demonstrating the novelty, significance, and credibility of this high-fidelity WMLES reacting flow framework.

Domino, Stefan Paul [Sandia National Laboratories ↗
DOE OSTI2025

GADRAS-DRF Validation for Safeguards and Custom Peak Fit Enhancements

In previous years, SGTech funded enhancements to the isotopics routine in the software called Gamma Detector Response and Analysis Software-Detector Response Function (GADRAS-DRF), including the addition of peak fit customization capabilities. A project was also funded that focused on implementing a peak-based model fitting routine, allowing model fitting to be performed without dependence on export-controlled cross-sections. In FY25 significant improvements were made to the custom peak fitting interface, accompanied by several validation studies within GADRAS-DRF. These studies encompassed IsotopeID performance, distributed source analysis, isotopics validation, and activity estimation. Additionally, the peak-only model fitting option was validated using an HPGe measurement of a rotating drum with line sources.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Bifacial Vertical Testbed and Ground Irradiance Data in Golden, Colorado

This data was collected for Tonita et al., “Vertical bifacial photovoltaic system model validation: study with field data, various orientations, and latitudes,” for validation of optical models for vertically-oriented photovoltaics under high albedo. Ground irradiance data for vertical PV arrays modeling in agrivoltaics is also provided. The dataset is provided for further use or study as open source. For any questions on the dataset, email silvana.ovaitt@nlr.gov.

14 SOLAR ENERGY↗