Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model validation and calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Dark Energy Survey Year 3 Results: Multi-Probe Modeling Strategy and Validation

This paper details the modeling pipeline and validates the baseline analysis choices of the DES Year 3 joint analysis of galaxy clustering and weak lensing (a so-called "3$\times$2pt" analysis). These analysis choices include the specific combination of cosmological probes, priors on cosmological and systematics parameters, model parameterizations for systematic effects and related approximations, and angular scales where the model assumptions are validated. We run a large number of simulated likelihood analyses using synthetic data vectors to test the robustness of our baseline analysis. We demonstrate that the DES Year 3 modeling pipeline, including the calibrated scale cuts, is sufficiently accurate relative to the constraining power of the DES Year 3 analyses. Our systematics mitigation strategy accounts for astrophysical systematics, such as galaxy bias, intrinsic alignments, source and lens magnification, baryonic effects, and source clustering, as well as for uncertainties in modeling the matter power spectrum, reduced shear, and estimator effects. We further demonstrate excellent agreement between two independently-developed modeling pipelines, and thus rule out any residual uncertainties due to the numerical implementation.

79 ASTRONOMY AND ASTROPHYSICS↗

Validation of CFD simulations of the moored DeepCwind offshore wind semisubmersible in irregular waves

This article examines the use of computational fluid dynamics (CFD) simulations to predict the response of a floating wind platform to irregular-wave excitation. This work was conducted as part of the Reproducible CFD Joint Industry Project for Floating Offshore Wind Applications and involved verification across several participants and modeling tools and validation against experiments. The authors pay special attention to the uncertainties in both CFD results and experimental measurements. In this work, we perform detailed comparisons of the incident waves and the motion of a moored structure. The nonlinear, low-frequency resonance motion is of particular interest because it potentially drives the mooring and tower-base loads. The verification and validation study is partially successful in that the CFD simulations capture the low-frequency slow-drift motion well but underpredict the low-frequency pitch resonance. This underprediction can be attributed in part to the CFD incident waves, which showed some discrepancies with the experimental waves, especially around extreme events. The effects of the wave discrepancies are also estimated and investigated using a mid-fidelity OpenFAST model. Overall, the present study increases our confidence in using CFD simulations to predict the global performance of offshore wind platforms in irregular waves and to produce data for the calibration of lower-fidelity models.

17 WIND ENERGY↗

Radon emanation rate measurements using liquid scintillation counting

This article describes a radon emanation measurement technique using liquid scintillator counting. A model for radon loading and transport is described, along with its calibration. Detector background and blank have been studied and quantified. The Minimal detectable activity has been determined for the counting setup using a toy Monte Carlo simulation. Here, the measurement technique is validated using a butyl rubber sample previously used for cross-calibration between different radon counting facilities.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

An atlas of selected calibrated stellar spectra

Five hundred and fifty six stars in the IRAS PSC-2 that are suitable for stellar radiometric standards and are brighter than 1 Jy at 25 microns were identified. In addition, 123 stars that meet all of our criteria for calibration standards, but which lack a luminosity class were identified. An approach to absolute stellar calibration of broadband infrared filters based upon new models of Vega and Sirius due to Kurucz (1992) is presented. A general technique used to assemble continuous wide-band calibrated infrared spectra is described and an absolutely calibrated 1-35 micron spectrum of alpha(Tau) is constructed and the method using new and carefully designed observations is independently validated. The absolute calibration of the IRAS Low Resolution Spectrometer (LRS) database is investigated by comparing the observed spectrum of alpha(Tau) with that assumed in the original LRS calibration scheme. Neglect of the SiO fundamental band in alpha(Tau) has led to the presence of a specious 'emission' feature in all LRS spectra near 8.5 microns, and to an incorrect spectral slope between 8 and 12 microns. Finally, some of the properties of asteroids that effect their utility as calibration objects for the middle and far infrared region are examined. A technique to determine, from IRAS multiwaveband observations, the basic physical parameters needed by various asteroid thermal models that minimize the number of assumptions required is developed.

Walker, Russell G.↗

Virtual reality as a human factors design analysis tool: Macro-ergonomic application validation and assessment of the Space Station Freedom payload control area

A virtual reality (VR) Applications Program has been under development at MSFC since 1989. Its objectives are to develop, assess, validate, and utilize VR in hardware development, operations development and support, missions operations training, and science training. A variety of activities are under way within many of these areas. One ongoing macro-ergonomic application of VR relates to the design of the Space Station Freedom Payload Control Area (PCA), the control room from which onboard payload operations are managed. Several preliminary conceptual PCA layouts have been developed and modeled in VR. Various managers and potential end users have virtually 'entered' these rooms and provided valuable feedback. Before VR can be used with confidence in a particular application, it must be validated, or calibrated, for that class of applications. Two associated validation studies for macro-ergonomic applications are under way to help characterize possible distortions of filtering of relevant perceptions in a virtual world. In both studies, existing control rooms and their 'virtual counterparts will be empirically compared using distance and heading estimations to objects and subjective assessments. Approaches and findings of the PCA activities and details of the studies are presented.

Hale, Joseph P.↗

Thermographic Imaging of the Space Shuttle During Re-Entry Using a Near Infrared Sensor

High resolution calibrated near infrared (NIR) imagery of the Space Shuttle Orbiter was obtained during hypervelocity atmospheric re-entry of the STS-119, STS-125, STS-128, STS-131, STS-132, STS-133, and STS-134 missions. This data has provided information on the distribution of surface temperature and the state of the airflow over the windward surface of the Orbiter during descent. The thermal imagery complemented data collected with onboard surface thermocouple instrumentation. The spatially resolved global thermal measurements made during the Orbiter s hypersonic re-entry will provide critical flight data for reducing the uncertainty associated with present day ground-to-flight extrapolation techniques and current state-of-the-art empirical boundary-layer transition or turbulent heating prediction methods. Laminar and turbulent flight data is critical for the validation of physics-based, semi-empirical boundary-layer transition prediction methods as well as stimulating the validation of laminar numerical chemistry models and the development of turbulence models supporting NASA s next-generation spacecraft. In this paper we provide details of the NIR imaging system used on both air and land-based imaging assets. The paper will discuss calibrations performed on the NIR imaging systems that permitted conversion of captured radiant intensity (counts) to temperature values. Image processing techniques are presented to analyze the NIR data for vignetting distortion, best resolution, and image sharpness. Keywords: HYTHIRM, Space Shuttle thermography, hypersonic imaging, near infrared imaging, histogram analysis, singular value decomposition, eigenvalue image sharpness

Zalameda, Joseph N.↗

Status of the TESS Science Processing Operations Center

The Transiting Exoplanet Survey Satellite (TESS) science pipeline is being developed by the Science Processing Operations Center (SPOC) at NASA Ames Research Center based on the highly successful Kepler Mission science pipeline. Like the Kepler pipeline, the TESS science pipeline will provide calibrated pixels, simple and systematic error-corrected aperture photometry, and centroid locations for all 200,000+ target stars, observed over the 2-year mission, along with associated uncertainties. The pixel and light curve products are modeled on the Kepler archive products and will be archived to the Mikulski Archive for Space Telescopes (MAST). In addition to the nominal science data, the 30-minute Full Frame Images (FFIs) simultaneously collected by TESS will also be calibrated by the SPOC and archived at MAST. The TESS pipeline will search through all light curves for evidence of transits that occur when a planet crosses the disk of its host star. The Data Validation pipeline will generate a suite of diagnostic metrics for each transit-like signature discovered, and extract planetary parameters by fitting a limb-darkened transit model to each potential planetary signature. The results of the transit search will be modeled on the Kepler transit search products (tabulated numerical results, time series products, and pdf reports) all of which will be archived to MAST.

high performance computing↗

FORGE STRESS annual report

The project's goal is to combine high-fidelity numerical models and true-triaxial block fracturing tests at high temperatures to understand the relationship between in situ stress, thermal effects, wellbore orientations and hydraulic fracture patterns. The numerical models are calibrated against field data, such as well pressures and microseismic data, and employed to estimate the in situ stress at the FORGE site. Laboratory experiments investigate the complex physics driving hydraulic fracture nucleation in EGS, enhancing understanding of the role of parameters like temperature, well orientation, and stress. Additionally, they are employed to validate some of the numerical tools used in the project. The project will have a significant impact by: (1) improving the characterization of the in-situ stress field at FORGE; (2) demonstrating the use of high-fidelity modeling tools for EGS; (3) providing a unique set of high-temperature hydraulic fracturing results to identify key components for in-situ stress estimation, validate current theories, and propose new ones; (4) offering a validated set of numerical tools within an open-source simulation framework, GEOS, that will be available to any future user.

15 GEOTHERMAL ENERGY↗

Towards robust autonomous impedance spectroscopy analysis: A calibrated hierarchical Bayesian approach for electrochemical impedance spectroscopy (EIS) inversion

Distribution-based analyses, such as the distribution of relaxation times (DRT) and the distribution of diffusion times (DDT), present model-free alternatives to equivalent circuit modeling for analysis of electrochemical impedance spectroscopy (EIS) data. However, reconstructing such distributions from noisy impedance data is an ill-posed problem that must be solved with specialized inversion algorithms, requiring careful control and tuning. Furthermore, most inversion algorithms developed to date can only solve problems of limited complexity. Herein, we present a new hierarchical Bayesian method for EIS inversion, leveraging efficient algorithms for optimization and Hamiltonian Monte Carlo (HMC) sampling to solve models of arbitrary complexity. We overcome the challenge of ad-hoc parameter tuning by encoding intrinsic characteristics of the DRT and DDT into flexible prior distributions and “pre-calibrating” the model to simulated data. This approach is versatile, highly robust to noise, and provides quantitative estimates of both the error structure of the data and the uncertainty in the recovered distributions. The model is validated with simulated data to demonstrate accurate recovery of the DRT and the DDT. The method also shows promise for simultaneous recovery of multiple distributions, raising the intriguing possibility of semi-autonomous EIS analysis and ad-hoc model construction. Finally, the practical utility of the method is illustrated with experimental data. Throughout, we draw comparisons to several recently published EIS inversion methodologies.

36 MATERIALS SCIENCE↗

A New 1D Model for Thermal Mixing and Stratification in Advanced Reactor Transients

Thermal mixing and stratification in large pools and enclosures play a critical role in the safety and performance of pool-type nuclear reactors, particularly during transient scenarios involving significant temperature differences between incoming and bulk coolant. Accurate modeling of these phenomena is essential for predicting system behavior and supporting passive safety features such as natural circulation. Here, this paper presents a new 1D model for thermal mixing and stratification, developed and implemented in the SAM code. The model represents a large pool as 1D coolant jet channels and zero-dimensional bulk pool volumes, enabling the simulation of a wide range of flow configurations, including hot and cold jet interactions, stratified layers, and the influence of complex geometries such as ceilings, free surfaces, and internal obstacles. Heat exchange between jet and pool regions is governed by closure relations calibrated against 3D computational fluid dynamics (CFD) simulations. The model improves upon earlier approaches by incorporating time-dependent jet characteristics and capturing the associated delay effects more accurately. Code-to-code comparisons and validation against experimental data from the Thermal Stratification Test Facility demonstrate the model’s accuracy and flexibility. This work offers two key contributions: (1) an efficient and robust method for simulating thermal mixing and stratification at the system level, eliminating the need for external coupling between system analysis codes and CFD, and (2) a significant enhancement of SAM’s capabilities to analyze thermal stratification phenomena in advanced reactor systems.

SAM↗

Eye Safe, Visible Wavelength Lidar Systems: Design and Operational Advances, Results and Potential

In the early nineties the first of the eye safe visible wavelength lidar systems known now as Micro Pulse Lidar (MPL) became operational. The important advance of the design was a system that, unlike most existing lidar, operated at eye safe energy densities and could thus operate unattended for full time monitoring. Since that time there have been many dozens of these systems produced and applied for full time profiling of atmospheric cloud and aerosol structure. There is currently an observational network of MPL sites to support global climate research. In thc course of application of these instruments there have been significant improvements in the, design and performance of the systems. In the last half decade particularly there has been significant application and technical development of MPL systems. In this paper we review progress. The current MPL systems in use are all single wavelength systems designed for cloud and aerosol applications. For the cloud and aerosol applications, both lidar depolarization and multi wavelength measurements have significant applications. These can be accomplished with the MPL, approach. The main current challenge for the lidar network activity are in the area of the reliability, repeatability and efficiency of data processing. The network makes use of internet data downloads and automated processing. The heights of all cloud and aerosol layers are needed. The recent emphasis has been in operationally deriving aerosol extinction cross section. Future emphasis will include adding cirrus optical parameters. For operational effectiveness, improvements to simplify routine data signal calibration are being researched. Overall the MPL systems have proven very effective. A large data base of results from globally distributed sites can be easily accessed through the internet. Applications have included atmospheric model development. Validation of current global satellite observations of aerosol and clouds, including now orbital lidar observations, was a primary goal for NASA. Although sampling issues require careful consideration, results have proven useful.

Spinhirne, James↗

Improving the longest SI traceable hyperspectral infrared record from space from the AIRS

The Atmospheric Infrared Sounder (AIRS) is a “facility” instrument developed by NASA as an experimental demonstration of advanced technology for remote sensing and the benefits of high resolution infrared spectra to weather forecasting and science investigations . It was launched into a 1:30 am/pm polar orbit on May 4, 2002 on the EOS Aqua Spacecraft, and is expected to provide highly calibrated data beyond 2024. AIRS has 2378 infrared channels ranging from 3.7 um to 15.4 um and a 13.5 km footprint. The AIRS data are used for weather forecasting, climate process studies and validating climate models. AIRS is a vital IR reference sensor for GSICS and is used by JMA for comparison to Himawari AHI , KMA for comparison to COMS , NOAA for comparison to CrIS and GOES , and EUMETSAT for comparison to IASI .

Strow, Larrabee↗

Cross Calibration of TOMS, SBUV/2 and Sciamachy Radiances from Ground Observations

Verification of a stratospheric ozone recovery remains a high priority for environmental research and policy definition. Models predict an ozone recovery at a much lower rate than the measured depletion rate observed to date. Therefore improved precision of the satellite and ground ozone observing systems are required over the long term to verify recovery. We have shown that validation of radiances is the most effective means for correcting absolute accuracy and long term drifts of backscatter type satellite measurements. This method by-passes the algorithms used for both satellite and ground based measurements which are normally used to validate and correct the satellite data. Validation of radiances will also improve all higher level data products derived from the satellite observations. Backscatter algorithms suffer from several errors such as unrepresentative a-priori data and air mass factor corrections. Radiance comparisons employ forward models but are inherently more accurate and than inverse (retrieval) algorithms. A new method for satellite validation is planned which will compliment measurements from the existing ground-based networks. This method will employ very accurate comparisons between ground based zenith sky radiances and satellite nadir radiances. These comparisons will rely heavily on the experience derived from the Shuttle SBUV (SSBUV) program which provided a reference standard of radiance measurements for SBUV/2, TOMS, and GOME. This new measurement program, called "Skyrad", employs two well established capabilities at the Goddard Space Flight Center, 1) the SSBUV calibration facilities and 2) the radiative transfer codes used for the TOMS and SBUV/2 algorithms and their subsequent refinements. Radiative transfer calculations show that ground based zenith sky and satellite nadir backscatter ultraviolet comparisons can be made very accurately under certain viewing conditions. The Skyrad instruments (SSBUV, Brewer spectrophotometers, and possibly others) will be calibrated and maintained to a precision of a few tenths of a percent. Skyrad data will then enable long term calibration of upcoming satellite instruments such as QuickTOMS. SBUV/2s and SCIAMACHY with a high degree of precision. This technique can be further employed to monitor the performance of future instruments such as GOME-2, OMI, and OMPS. Initial ground observations taken from Goddard Space Flight Center compared with radiative transfer calculations has indicated the feasibility of this method.

Hillsenrath, Ernest↗

Achieving Realistic Runoff in the Western United States with a Land Surface Model Forced by Dynamically Downscaled Meteorology

Abstract In this study, we calibrate a regional climate model’s (RCM) underlying land surface model (LSM). In addition to providing a realistic representation of runoff across the hydroclimatically diverse western United States, this is done to take advantage of the RCM’s ability to physically resolve meteorological forcing data in ungauged regions, and to prepare the calibrated hydrologic model for tight coupling, or the ability to represent land surface–atmosphere interactions, with the RCM. Specifically, we use a 9-km resolution meteorological forcing dataset across the western United States, from the fifth generation ECMWF Reanalysis (ERA5) downscaled by the Weather Research Forecasting (WRF) regional climate model, as an offline forcing for Noah-Multiparameterization (Noah-MP). We detail the steps involved in producing an LSM capable of accurately representing runoff, including physical parameterization selection, parameter calibration, and regionalization to ungauged basins. Based on our model evaluation from 1954 to 2021 for 586 basins with daily natural streamflow, the streamflow bias is reduced from 24.2% to 4.4%, and the median daily Nash–Sutcliffe efficiency (NSE) is improved from 0.12 to 0.36. When validating against basins with monthly natural streamflow data, we obtain a similar reduction in bias and a median monthly NSE improvement from 0.18 to 0.56. In this study, we also discover the optimal setup when using a donor-basin method to regionalize parameters to ungauged basins, which can vary by 0.06 NSE for unique designs of this regionalization method. Significance Statement This study provides useful guidance for improving a land surface model to accurately represent runoff across a spatially extensive and hydroclimatically diverse region (the western United States). The land surface model is updated to represent runoff more accurately at gauged basins, and then additionally updated for basins without observational data using a mathematical approach called the donor-basin method. We make use of a regional climate model’s reanalysis-derived meteorological data and its underlying land surface model to achieve realistic runoff. The calibrated land surface model can thus be tightly coupled in subsequent studies in a manner that should more accurately reflect runoff conditions. Findings from this study will serve as a useful reference for the atmospheric (and hydrologic) modeling communities and their ability to represent large-scale hydrology accurately.

Meteorology & Atmospheric Sciences↗

Improved Calibration of Modeled Discharge and Storage Change in the Atchafalaya Floodplain Using SAR Interferometry

This study focuses on the feasibility of using SAR interferometry to support 2D hydrodynamic model calibration and provide water storage change in the floodplain. Two-dimensional (2D) flood inundation modeling has been widely studied using storage cell approaches with the availability of high resolution, remotely sensed floodplain topography. The development of coupled 1D/2D flood modeling has shown improved calculation of 2D floodplain inundation as well as channel water elevation. Most floodplain model results have been validated using remote sensing methods for inundation extent. However, few studies show the quantitative validation of spatial variations in floodplain water elevations in the 2D modeling since most of the gauges are located along main river channels and traditional single track satellite altimetry over the floodplain are limited. Synthetic Aperture Radar (SAR) interferometry recently has been proven to be useful for measuring centimeter-scale water elevation changes over the floodplain. In the current study, we apply the LISFLOOD hydrodynamic model to the central Atchafalaya River Basin, Louisiana, during a 62 day period from 1 April to 1 June 2008 using two different calibration schemes for Manning's n. First, the model is calibrated in terms of water elevations from a single in situ gauge that represents a more traditional approach. Due to the gauge location in the channel, the calibration shows more sensitivity to channel roughness relative to floodplain roughness. Second, the model is calibrated in terms of water elevation changes calculated from ALOS PALSAR interferometry during 46 days of the image acquisition interval from 16 April 2008 to 1 June 2009. Since SAR interferometry receives strongly scatters in floodplain due to double bounce effect as compared to specular scattering of open water, the calibration shows more dependency to floodplain roughness. An iterative approach is used to determine the best-fit Manning's n for the two different calibration approaches. Results suggest similar floodplain roughness but slightly different channel roughness. However, application of SAR interferometry provides a unique view of the floodplain flow gradients, not possible with a single gauge calibration. These gradients, allow improved computation of water storage change over the 46-day simulation period. Overall, the results suggest that the use of 2D SAR water elevation changes in the Atchafalaya basin offers improved understanding and modeling of floodplain hydrodynamics.

Jung, Hahn Chul↗

Geometric Scale-up Experiments on Fluidization of Geldart B Glass Beads

The objective of this work is to provide a valuable database from controlled experiments for validating computational models. Recently, coarse-grained techniques such as particle-in-cell (PIC) or coarse-grained discrete element modeling (DEM) have gained popularity due to their computational efficiency while modeling large-scale systems; however, the influence of model parameters and their sensitivities at different geometric scales and flow conditions remain to be analyzed. These datasets are critical for the multiphase flow research community to assess predictive capability of modeling techniques as well as elucidate the hydrodynamic behavior in these systems. This study performed fluidization experiments using three different test sections with internal diameters of 2.5, 4, and 6 in. The operating conditions, bed material, and range of flow velocities at the inlet were constant in all the units, which were not hydrodynamically scaled. Glass beads having a Sauter Mean Diameter of 332 μm were used. Superficial velocity was varied from 2.97 to 5.35 times the minimum fluidization velocity and the initial static bed height was 0.1524 m. The order in which the experiments were performed was randomized and replicates were included to provide uncertainty in measurements. Statistics of differential pressure and bed height from these tests were reported. Future plans include validating PIC methodology in the open-source software, MFiX (Multiphase Flow with Interphase Exchanges) using results from this study. This could further be extended to determine optimal model parameters using inverse techniques such as deterministic calibration or Bayesian inference.

20 FOSSIL-FUELED POWER PLANTS↗

Geometric Scale-up Experiments on Fluidization of Geldart B Glass Beads

The objective of this work is to provide a valuable database from controlled experiments for validating computational models. Recently, coarse-grained techniques such as particle-in-cell (PIC) or coarse-grained discrete element modeling (DEM) have gained popularity due to their computational efficiency while modeling large-scale systems; however, the influence of model parameters and their sensitivities at different geometric scales and flow conditions remain to be analyzed. These datasets are critical for the multiphase flow research community to assess predictive capability of modeling techniques as well as elucidate the hydrodynamic behavior in these systems. This study performed fluidization experiments using three different test sections with internal diameters of 2.5, 4, and 6 in. The operating conditions, bed material, and range of flow velocities at the inlet were constant in all the units, which were not hydrodynamically scaled. Glass beads having a Sauter Mean Diameter of 332 μm were used. Superficial velocity was varied from 2.97 to 5.35 times the minimum fluidization velocity and the initial static bed height was 0.1524 m. The order in which the experiments were performed was randomized and replicates were included to provide uncertainty in measurements. Statistics of differential pressure and bed height from these tests were reported. Future plans include validating PIC methodology in the open-source software, MFiX (Multiphase Flow with Interphase Exchanges) using results from this study. This could further be extended to determine optimal model parameters using inverse techniques such as deterministic calibration or Bayesian inference.

42 ENGINEERING↗

Experimental and computational surface and flow-field results for an all-body hypersonic aircraft

The objective of the present investigation is to establish a benchmark experimental data base for a generic hypersonic vehicle shape for validation and/or calibration of advanced computational fluid dynamics computer codes. This paper includes results from the comprehensive test program conducted in the NASA/Ames 3.5-foot Hypersonic Wind Tunnel for a generic all-body hypersonic aircraft model. Experimental and computational results on flow visualization, surface pressures, surface convective heat transfer, and pitot-pressure flow-field surveys are presented. Comparisons of the experimental results with computational results from an upwind parabolized Navier-Stokes code developed at Ames demonstrate the capabilities of this code.

Lockman, William K.↗