Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model validation and calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Improvement of two-phase closure models in CTF using Bayesian inference

Under the Consortium for Advanced Simulation of Light Water Reactors (CASL) program, extensive capabilities have been developed in CTF to analyze light-water reactors (LWRs) for normal operating conditions, departure from nucleate boiling (DNB), and system transients. However, further improvements are required in the modeling and simulation of boiling water reactors (BWRs), which is a focus of the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. In this work, CTF validation results were used to optimize selected modeling coefficients by calibrating to experimental data using a Bayesian inference approach. Here, calibration studies were conducted to improve (vapor) void fraction prediction without worsening the two-phase pressure drop prediction, as well as to improve the two-phase pressure drop prediction. Calibration was performed for interfacial drag and wall shear models. Surrogates were developed to alleviate the computational expense required for sampling the parameter space using Markov chain Monte Carlo (MCMC). An assessment performed with calibrated models demonstrated an improvement of CTF in its prediction of key parameters such as void fraction and two-phase pressure drop.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Quantifying Variability and Controls of Riverine Dissolved Organic Carbon Exported to Arctic Coastal Margins of North America (Final Report)

This project involved implementation and application of a coupled permafrost hydrology and dissolved organic carbon process models to investigate how spatial and seasonal variations in terrestrial hydrology and soil freeze/thaw dynamics influence the mobilization, loading, and export of organic carbon to the stream network for selected arctic basins across northern Alaska and northwest Canada. The model simulations were constrained by detailed observations of in- stream chemistry, soil active layer profile moisture and temperature dynamics, streamflow, soil carbon inventories and satellite microwave remote sensing based assessments of surface soil freeze-thaw dynamics. We developed and applied the numerical modeling and data analysis, incorporating observed data for calibration and validation, in order to investigate the terrestrial hydrology, permafrost dynamics, and associated DOC production and loading to rivers across a region encompassing watersheds draining to the coast. The project produced six publications and three datasets archived in public repositories.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

CFD Validation Study of a Hypersonic Cone-Slice-Flap Configuration

Model validation is the process of determining the degree of accuracy between the real world and the model. The result of model validation can either be used to improve the model through calibration or quantify the model-form uncertainty. This work focuses on providing the model-form uncertainty through an area metric for a hypersonic cone-slice-flap geometry configuration given uncertainty in both the simulation and experimental data. A procedure will be presented that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs. The work will also assess the impact between using different high-fidelity solvers and different turbulence models.The goal of performing this comparison is to provide a quantifiable measurement for the accuracy of each solver and turbulence model for this type of design. A low-fidelity analysis will also be performed to get a model-form uncertainty for the lower fidelity analysis. The two high-fidelty CFD solvers used are VULCAN-CFD and FUN3D and the low-fidelity results will come from Cart3D. The experimental data came from the 20-inch Mach 6Tunnel located at NASA Langley Research Center.

Laura M. White↗
NASA NTRS2020

Effects of Resistive Windscreens and Foam Inserts on The Acoustic Response of an In-Flow Phased Microphone Array

The effects of varying windscreen resistance and cavity foam treatments on the acoustic response of an in-flow phased microphone array have been characterized by recent experiments at ARC, GRC, and LaRC using common array and calibration source designs. New correction models have been developed and validated with results from recent impedance tube, anechoic chamber, and wind tunnel tests.

Wind tunnel aeroacoustics research↗
NASA NTRSDate not supplied

CFD Validation Study of a Hypersonic Cone-Slice-Flap Configuration

Model validation is the process of determining the degree of accuracy between the real world and the model. The result of model validation can be used to either improve the model through calibration or quantify the model-form uncertainty. This work focuses on estimating the model-form uncertainty through an area metric for a hypersonic cone-slice-flap geometry configuration given the uncertainty in both the simulation and experimental data. A procedure that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs is outlined. The work also assesses the impact of using different high-fidelity solvers and different turbulence models. The goal of performing this comparison is to provide a quantifiable measurement of the accuracy of each solver and turbulence model for this type of design. A low-fidelity analysis is also performed to get a model-form uncertainty for this type of analysis. The two high-fidelity CFD solvers used here are VULCAN-CFD and FUN3D, and the low-fidelity results comes from Cart3D.The experimental data comes from the 20-inch Mach 6 Tunnel located at NASA Langley Research Center. The work here shows that the models used tend to under-predict the drag and moment aerodynamic coefficients for this type of design leading to a model-form uncertainty estimate which can account for up to an 86% of the total uncertainty in the model predictions.

Laura M White↗
NASA NTRSDate not supplied

CFD Validation Study of a Hypersonic Cone-Slice-Flap Variable Geometry Configuration

Model validation is the process of determining the degree of accuracy between physical reality and the model. The result of model validation can either be used to improve the model through calibration or quantify the model-form uncertainty. This work focuses on providing the model-form uncertainty through an area metric for a hypersonic cone-slice-flap variable geometry configuration given uncertainty in both the simulation and experimental data. The research here compares two different turbulence models for the simulations. For a variable geometry, performing uncertainty quantification to capture the model-form uncertainty on every configuration is computationally challenging. This work lays out a procedure that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs and many low-fidelity runs on multiple configurations. Running this comparison provides a quantifiable measurement for the accuracy of each turbulence model for this type of design. The high-fidelity CFD solver used was VULCAN-CFD and the low-fidelity results came from Cart3D. The experimental data came from the 20-Inch Mach 6 Tunnel located at NASA Langley Research Center. The present work showed that the using both the Spalart and Allamaras and Menter Shear-Stress Transport turbulence models overpredicted the drag and lift coefficient, while underpredicting the pitching moment coefficient. The model-form uncertainty estimate resulted in up to a 13.6% change in the total uncertainty for the drag coefficient, up to a 57.4% change in total uncertainty for the lift coefficient, and up to a 100% change in total uncertainty for the pitching moment coefficient.

Laura M. White↗
NASA NTRSDate not supplied

CFD Validation Study of a Hypersonic Cone-Slice-Flap Variable Geometry Configuration

Model validation is the process of determining the degree of accuracy between physical reality and the model. The result of model validation can either be used to improve the model through calibration or quantify the model-form uncertainty. This work focuses on providing the model-form uncertainty through an area metric for a hypersonic cone-slice-flap variable geometry configuration given uncertainty in both the simulation and experimental data. For a variable geometry, performing uncertainty quantification to capture the model-form uncertainty on every configuration is computationally challenging. This work lays out a procedure that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs and many low-fidelity runs on multiple configurations. Running this comparison provides a quantifiable measurement for the accuracy of each turbulence model for this type of design. The high-fidelity CFD solver used was VULCAN-CFD and the low-fidelity results came from Cart3D. The experimental data came from the 20-Inch Mach 6 Tunnel located at NASA Langley Research Center. The present work showed that the turbulence simulation overpredicted the drag and lift coefficient, while underpredicting the pitching moment coefficient. The model-form uncertainty estimate resulted up to a 13.6% change in the total uncertainty for the drag coefficient, up to a 57.4% change in total uncertainty for the lift coefficient, and up to a 100% change in total uncertainty for the pitching moment coefficient.

Laura White↗
DOE OSTI2020

Validation of selection function, sample contamination and mass calibration in galaxy cluster samples

ABSTRACT We construct and validate the selection function of the MARD-Y3 galaxy cluster sample. This sample was selected through optical follow-up of the 2nd ROSAT faint source catalogue with Dark Energy Survey year 3 data. The selection function is modelled by combining an empirically constructed X-ray selection function with an incompleteness model for the optical follow-up. We validate the joint selection function by testing the consistency of the constraints on the X-ray flux–mass and richness–mass scaling relation parameters derived from different sources of mass information: (1) cross-calibration using South Pole Telescope Sunyaev-Zel'dovich (SPT-SZ) clusters, (2) calibration using number counts in X-ray, in optical and in both X-ray and optical while marginalizing over cosmological parameters, and (3) other published analyses. We find that the constraints on the scaling relation from the number counts and SPT-SZ cross-calibration agree, indicating that our modelling of the selection function is adequate. Furthermore, we apply a largely cosmology independent method to validate selection functions via the computation of the probability of finding each cluster in the SPT-SZ sample in the MARD-Y3 sample and vice versa. This test reveals no clear evidence for MARD-Y3 contamination, SPT-SZ incompleteness or outlier fraction. Finally, we discuss the prospects of the techniques presented here to limit systematic selection effects in future cluster cosmological studies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Sequentially calibrating a Bayesian microsimulation model to incorporate new information and assumptions

Background: Microsimulation models are mathematical models that simulate event histories for individual members of a population. They are useful for policy decisions because they simulate a large number of individuals from an idealized population, with features that change over time, and the resulting event histories can be summarized to describe key population-level outcomes. Model calibration is the process of incorporating evidence into the model. Calibrated models can be used to make predictions about population trends in disease outcomes and effectiveness of interventions, but calibration can be challenging and computationally expensive. Methods: This paper develops a technique for sequentially updating models to take full advantage of earlier calibration results, to ultimately speed up the calibration process. A Bayesian approach to calibration is used because it combines different sources of evidence and enables uncertainty quantification which is appealing for decision-making. We develop this method in order to re-calibrate a microsimulation model for the natural history of colorectal cancer to include new targets that better inform the time from initiation of preclinical cancer to presentation with clinical cancer (sojourn time), because model exploration and validation revealed that more information was needed on sojourn time, and that the predicted percentage of patients with cancers detected via colonoscopy screening was too low. Results: The sequential approach to calibration was more efficient than recalibrating the model from scratch. Incorporating new information on the percentage of patients with cancers detected upon screening changed the estimated sojourn time parameters significantly, increasing the estimated mean sojourn time for cancers in the colon and rectum, providing results with more validity. Conclusions: A sequential approach to recalibration can be used to efficiently recalibrate a microsimulation model when new information becomes available that requires the original targets to be supplemented with additional targets.

60 APPLIED LIFE SCIENCES↗
NASA NTRSDate not supplied

Observations of Keyhole Porosity and Comparisons to Analytical Models for Ti-6Al-4V Powder Bed Fusion

Keyhole porosity defects are a common concern in powder bed fusion (PBF) processing. Keyhole porosity prediction models have generally fallen into two categories – high fidelity computational fluid dynamics simulations and low fidelity analytical or empirical models based on keyhole vibration dynamics. The low computational cost of low fidelity models allows them to better approach part-scale predictions. However, studies on low fidelity modeling techniques are limited by the lack of experimental data to assess the validity of the calibration over a wide range of processing conditions. This work extracts and quantifies keyhole porosity across 14 laser velocities, two laser powers, and six+ repetitions for a total of 176 independent trials. The measured porosity data are compared to low fidelity keyhole models to assess their success in predictive porosity occurrence. This work impacts the field by providing independent validation of keyhole porosity models for PBF for use in part-scale defect prediction.

powder bed fusion↗
DOE OSTI2021

SWAT model application for evaluating agricultural conservation practice effectiveness in reducing phosphorous loss from the Western Lake Erie Basin

Lake Erie is threatened by eutrophication and harmful algal blooms due to excess nutrient loading from agricultural sources. Agricultural conservation practices (ACPs) have been developed and implemented to reduce nutrient losses but estimating ACP effectiveness is challenging. The Soil and Water Assessment Tool (SWAT) has been used to investigate ACP effectiveness for water quality improvement. Many SWAT applications have been developed by different investigators to evaluate ACP effectiveness for reducing nutrient, particularly phosphorus (P), loading in the agriculturally-dominated Western Lake Erie Basin (WLEB). Our objective is to establish what has been achieved by past modeling research and make suggestions for future applications and improvements. We synthesized the findings of 28 SWAT modeling studies within the WLEB. Models generally performed satisfactorily against accepted criteria for streamflow and sediment, but performance for P loads, like soluble reactive P, was mostly “unsatisfactory”. The “unsatisfactory” performance maybe due to imperfections and idealizations in model formulations and/or parameterization. Thus, simulations of P transport and transformation processes need improvement. In addition, model parameter selection is the key part of model set-up. Most SWAT modeling studies used default values during initial set-up, then performed calibration and validation. It was found that the calibrated P related parameter values varied widely across different studies, even within the same watershed with some values unrealistic for the study areas. The phenomena of different combinations of model parameters producing similar outputs indicates equifinality. Equifinality in the baseline model may impact results when ACPs are incorporated. Furthermore, the unrealistic values used in ACP assessment undermine the credibility of ACP effectiveness. Future model applications should try to re-examine the calibrated P parameters and make sure they are realistic for the study area as well as reduce equifinality by constraining the model with characterization of watershed conditions, better understanding of hydrologic processes, and parameter values based on real-world observations. As a result, future model applications should focus on improving P transport and transformation processes, using measured watershed characteristics for parameterization, and improving reflections of climate change, which could result in more accurate assessments of ACP effectiveness to meet targeted goals.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1980

ERBE - Assessment of measurement accuracy

The Earth Radiation Budget Experiment (ERBE) represents a continuing effort to estimate the solar incident and earth reflected and emitted radiance from spacecraft measurements. The development of accurate and stable sensors and calibration sources is mandatory but not sufficient to attain and validate required measurement accuracies. It is also necessary to develop and experimentally test computational models of the calibration and measurement processes to account for environmental differences between (static) calibrations and (dynamic) measurements of the earth radiant exitance that varies with wavelength, position, direction, and time.

Spiers, R. B., Jr.↗
NASA NTRS2007

Emerging Techniques for Vicarious Calibration of Visible Through Short Wave Infrared Remote Sensing Systems

Autonomous Visible to SWIR ground-based vicarious Cal/Val will be an essential Cal/Val component with such a large number of systems. Radiometrically calibrated spectroradiometers can improve confidence in current ground truth data through validation of radiometric modeling and validation or replacement of traditional sun photometer measurement. They also should enable significant reduction in deployed equipment such as equipment used in traditional sun photometer approaches. Simple, field-portable, white-light LED calibration source shows promise for visible range (420-750 nm). Prototype demonstrated <0.5% drift over 10-40 C temperature range. Additional complexity (more LEDs) will be necessary for extending spectral range into the NIR and SWIR. LED long lifetimes should produce at least several hundreds of hours or more of stability, minimizing the need for expensive calibrations and supporting long-duration field campaigns.

Ryan, Robert E.↗
NASA NTRS2012

Microwave Satellite Data for Hydrologic Modeling in Ungauged Basins

An innovative flood-prediction framework is developed using Tropical Rainfall Measuring Mission precipitation forcing and a proxy for river discharge from the Advanced Microwave Scanning Radiometer for Earth Observing System (AMSR-E) onboard the National Aeronautics and Space Administration's Aqua satellite. The AMSR-E-detected water surface signal was correlated with in situ measurements of streamflow in the Okavango Basin in Southern Africa as indicated by a Pearson correlation coefficient of 0.90. A distributed hydrologic model, with structural data sets derived from remote-sensing data, was calibrated to yield simulations matching the flood frequencies from the AMSR-E-detected water surface signal. Model performance during a validation period yielded a Nash-Sutcliffe efficiency of 0.84. We concluded that remote-sensing data from microwave sensors could be used to supplement stream gauges in large sparsely gauged or ungauged basins to calibrate hydrologic models. Given the global availability of all required data sets, this approach can be potentially expanded to improve flood monitoring and prediction in sparsely gauged basins throughout the world

Distributed hydrologic modeling↗
DOE OSTI2021

A combined experimental and computational analysis of failure mechanisms in open-hole cross-ply laminates under flexural loading

In this work, integrated experimental tests and computational modeling are proposed to investigate the failure mechanisms of open-hole cross-ply carbon fiber reinforced polymer (CFRP) laminated composites. In particular, we propose two effective methods, which include width-tapered double cantilever beam (WTDCB) and fixed-ratio mixed-mode end load split (FRMMELS) tests, to obtain the experimental data more reliably. We then calibrate the traction-separation laws of cohesive zone model (CZM) used among laminas of the composites by leveraging these two methods. The experimental results of fracture energy, i.e. G Ic and G Tc , obtained from WTDCB and FRMMELS tests are generally insensitive to the crack length thus requiring no effort to accurately measure the crack tip. Moreover, FRMMELS sample contains a fixed mixed-mode ratio of G IIc /G Tc depending on the width taper ratio. Examining comparisons between experimental results of FRMMELS tests and failure surface of B–K failure criterion predicted from a curve fitting, good agreement between the predictions and experimental data has been found, indicating that FRMMELS tests are an effective method to determine mixed-mode fracture criterion. In addition, a coupled experimental-computational modeling of WTDCB, edge notched flexure, and FRMMELS tests are adopted to calibrate and validate the interfacial strengths. Finally, failure mechanisms of open-hole cross-ply CFRP laminates under flexural loading have been studied systematically using experimental and multi-scale computational analyses based on the developed CZM model. The initiation and propagation of delamination, the failure of laminated layers as well as load-displacement curves predicted from computational analyses are in good agreement with what we have observed experimentally.

36 MATERIALS SCIENCE↗
NASA NTRS1989

Calibration of seven-hole pressure probes for use in fluid flows with large angularity

Described here is the calibration of a non-nulling, conical, seven-hole pressure probe over a large range of flow onset angles. The calibration procedure is based on the use of differential pressures to determine the three components of velocity. The method allows determination of the flow angle to within 0.5 deg and velocity magnitude to approximately 1.0 percent. Also included is an examination of the factors which limit the use of the probe, a description of the measurement chain, an error analysis, and a typical experimental result. In addition, a new general analytical model of pressure probe behavior is described and the validity of the model is demonstrated by comparing it with experimentally measured calibration data for a three-hole yaw meter and a seven-hole probe.

Zilliac, Gregory G.↗
NASA NTRS1977

Altimeter error sources at the 10-cm performance level

Error sources affecting the calibration and operational use of a 10 cm altimeter are examined to determine the magnitudes of current errors and the investigations necessary to reduce them to acceptable bounds. Errors considered include those affecting operational data pre-processing, and those affecting altitude bias determination, with error budgets developed for both. The most significant error sources affecting pre-processing are bias calibration, propagation corrections for the ionosphere, and measurement noise. No ionospheric models are currently validated at the required 10-25% accuracy level. The optimum smoothing to reduce the effects of measurement noise is investigated and found to be on the order of one second, based on the TASC model of geoid undulations. The 10 cm calibrations are found to be feasible only through the use of altimeter passes that are very high elevation for a tracking station which tracks very close to the time of altimeter track, such as a high elevation pass across the island of Bermuda. By far the largest error source, based on the current state-of-the-art, is the location of the island tracking station relative to mean sea level in the surrounding ocean areas.

Martin, C. F.↗