Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model validation and calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Statistical Calibration and Validation of a Homogeneous Ventilated Wall-Interference Correction Method for the National Transonic Facility

Wind tunnel experiments will continue to be a primary source of validation data for many types of mathematical and computational models in the aerospace industry. The increased emphasis on accuracy of data acquired from these facilities requires understanding of the uncertainty of not only the measurement data but also any correction applied to the data. One of the largest and most critical corrections made to these data is due to wall interference. In an effort to understand the accuracy and suitability of these corrections, a statistical validation process for wall interference correction methods has been developed. This process is based on the use of independent cases which, after correction, are expected to produce the same result. Comparison of these independent cases with respect to the uncertainty in the correction process establishes a domain of applicability based on the capability of the method to provide reasonable corrections with respect to customer accuracy requirements. The statistical validation method was applied to the version of the Transonic Wall Interference Correction System (TWICS) recently implemented in the National Transonic Facility at NASA Langley Research Center. The TWICS code generates corrections for solid and slotted wall interference in the model pitch plane based on boundary pressure measurements. Before validation could be performed on this method, it was necessary to calibrate the ventilated wall boundary condition parameters. Discrimination comparisons are used to determine the most representative of three linear boundary condition models which have historically been used to represent longitudinally slotted test section walls. Of the three linear boundary condition models implemented for ventilated walls, the general slotted wall model was the most representative of the data. The TWICS code using the calibrated general slotted wall model was found to be valid to within the process uncertainty for test section Mach numbers less than or equal to 0.60. The scatter among the mean corrected results of the bodies of revolution validation cases was within one count of drag on a typical transport aircraft configuration for Mach numbers at or below 0.80 and two counts of drag for Mach numbers at or below 0.90.

Walker, Eric L.↗

Impact of cirrus on the surface radiative environment at the FIRE ETLA Palisades, NY site

FIRE Extended Time Limited Area (ETLA) observations provide year round information critical to gaining a better understanding of cloud/climate interactions. The Lamont/Rutgers team has participated in the ETLS program through the collection and analysis of shortwave and longwave downwelling irradiances at Palisades, NY. These data are providing useful information on surface radiative fluxes with respect to sky condition, solar zenith angle and season. Their utility extends to the calibration and validation of cloud/radiative models and satellite cloud and radiative retrievals. The impact cirrus clouds have on the surface radiative environment is examined using Palisades ETLA information on atmospheric transmissivities and downwelling longwave fluxes for winter and summer cirrus and clear sky episodes in 1987.

Robinson, David A.↗

Full-Scale Crash Tests and Analyses of Three High-Wing Single

The NASA Emergency Locator Transmitter Survivability and Reliability (ELTSAR) project was initiated in 2014 to assess the crash performance standards for the next generation of ELT systems. Three Cessna 172 aircraft have been acquired to conduct crash testing at NASA Langley Research Center's Landing and Impact Research Facility. Testing is scheduled for the summer of 2015 and will simulate three crash conditions; a flare to stall while emergency landing, and two controlled flight into terrain scenarios. Instrumentation and video coverage, both onboard and external, will also provide valuable data of airframe response. Full-scale finite element analyses will be performed using two separate commercial explicit solvers. Calibration and validation of the models will be based on the airframe response under these varying crash conditions.

Annett, Martin S.↗

Optimization of a Remote Sensing Energy Balance Method over Different Canopy Applied at Global Scale

Parameterization methods which calculate turbulent heat and water fluxes with thermal remote sensing data were evaluated in the revised remote sensing surface energy balance system (SEBS) model (Chen et al., 2013). The model calculates sensible heat (H) based on the Monin-Obukhov similarity theory (MOST) and determines latent heat (LE) as the residual of energy balance. We examined the uncertainties of H and LE in the SEBS model due to five key parameters at the local station point scale. Observations at 27 flux towers located in seven land cover types (needle-leaf forest, broad leaf forest, shrub, savanna, grassland, cropland, and sparsely vegetated land) and an artificial intelligence particle swarm optimization (PSO) algorithm was combined to calibrate the five parameters (leaf drag coefficient, leaf heat transfer coefficients, roughness length for soil, and two parameters for ground heat calculation) in the SEBS model. The root-mean-square error at the site scale was reduced by 9 W/sq.m for H, and 92 W/sq.m for LE, and their correlation coefficients were increased by 0.07 (H) and 0.11 (LE) after using the calibrated parameters. The updated model validation was further conducted globally for the remotely sensed evapotranspiration (ET) calculations. Overestimation of SEBS global ET was significantly improved by using the optimized values of the parameters. The results suggested PSO was able to consistently locate the global optimum of the SEBS model, and appears to be capable of solving the ET model optimization problem.

Chen, Xuelong↗

Advances in Entry Modeling for Impact Risk Assessment

A summary of recent advancements in the detailed modeling of asteroid atmospheric entry processes made through NASA’s Asteroid Threat Assessment Project (ATAP) is presented. Understanding, and accurately modeling these processes and their associated uncertainties is critical to predicting all downstream impact effects, such as blast wave and thermal damage footprints. Furthermore, there is (perhaps thankfully) a dearth of empirical data for large impactors of the kind that would pose a threat to human populations, on which to anchor and/or validate models used in risk assessments. Therefore, we must rely heavily on detailed theoretical and numerical modeling to develop robust assessments for decision makers. To that end, ATAP has made some significant progress in advancing the capabilities in this area. Two areas in particular are highlighted in the present work: meteoroid ablation mechanisms, and bolide luminosity. The first research area – meteoroid ablation mechanisms – has focused on performing novel high-enthalpy wind tunnel experiments on meteorites and meteorite analogs, and utilizing the resulting data to develop high-fidelity models for impactor mass loss at scale. These efforts have resulted in several insights. Of note, these data suggest a differential vaporization process where volatiles are liberated preferentially when the asteroidal material is subject to high heat, while refractory components remain in the molten layer on the surface. A numerical model has been developed which considers this phenomena, and its effect on the bulk impactors effective heat of ablation is examined. The second research thrust that is discussed is focused on accurate modeling of impactor radiation phenomena. While another submission to the conference will discuss the application of our approach to thermal ground damage modeling, here, we present an overview of our extensive efforts to utilize available ground- and space-based observations of large bolides (~1m diameter, and above) to inform and validate our detailed modeling approaches. These methods have been shown to accurately reconstruct the detailed spectra for the Benesov bolide, as well as approximate the burn footprint for the Tunguska event. Recent effort has focused on reconciling light curve data from multiple sources (all-sky camera networks, GLM, US government sensors), using our validated model, and providing a calibrated model for luminous efficiency which can then be utilized to infer impactor properties such as shape, mass, and composition. This work will be demonstrated through an exemplar case study focusing on a large bolide event with observational data (e.g. Chelyabinsk, Flensburg, etc.). Finally, our team’s assessment on the current maturity of atmospheric entry models, and priorities for future research will be provided.

ATAP↗

Towards A National-Scale Automated Landslide Mapping System for Nepal

The mountains of Nepal are among the most hazardous environments in the world, with frequent landslides causing loss of lives and substantial damage to infrastructure every year. Landslide mapping is vital for characterizing impacts in the days after extreme triggering events, as well as for advancing landslide hazard models through robust calibration and validation. Conventionally, landslide inventories are produced by field surveys and/or manual interpretation of aerial photos and satellite images. This process is very subjective and time consuming.

Pukar Amatya↗

Technical Report Series on Global Modeling and Data Assimilation: Soil Moisture Active Passive (SMAP) Project Calibration and Validation for the L4_C Beta-Release Data Product - Volume 42

During the post-launch Cal/Val Phase of SMAP there are two objectives for each science product team: 1) calibrate, verify, and improve the performance of the science algorithms, and 2) validate accuracies of the science data products as specified in the L1 science requirements according to the Cal/Val timeline. This report provides analysis and assessment of the SMAP Level 4 Carbon (L4_C) product specifically for the beta release. The beta-release version of the SMAP L4_C algorithms utilizes a terrestrial carbon flux model informed by SMAP soil moisture inputs along with optical remote sensing (e.g. MODIS) vegetation indices and other ancillary biophysical data to estimate global daily NEE and component carbon fluxes, particularly vegetation gross primary production (GPP) and ecosystem respiration (Reco). Other L4_C product elements include surface (<10 cm depth) soil organic carbon (SOC) stocks and associated environmental constraints to these processes, including soil moisture and landscape FT controls on GPP and Reco (Kimball et al. 2012). The L4_C product encapsulates SMAP carbon cycle science objectives by: 1) providing a direct link between terrestrial carbon fluxes and underlying freeze/thaw and soil moisture constraints to these processes, 2) documenting primary connections between terrestrial water, energy and carbon cycles, and 3) improving understanding of terrestrial carbon sink activity in northern ecosystems.

Cal/Val↗

Experimental and Computational Sonic Boom Assessment of Boeing N+2 Low Boom Models

Near-field pressure signatures were measured and computational predictions made for several sonic boom models representing Boeing's Quiet Experimental Validation Concept (QEVC) supersonic transport, as well as three axisymmetric calibration models. Boeing developed the QEVC under a NASA Research Announcement (NRA) contract for Experimental Systems Validations for N+2 Supersonic Commercial Transport Aircraft, which was led by the NASA High Speed Project under the Fundamental Aeronautics Program. The concept was designed to address environmental and performance goals given in the NRA, specifically for low sonic boom loudness levels and high cruise efficiency, for an aircraft anticipated to enter service in the 2020 timeframe. Wind tunnel tests were conducted on the aircraft and calibration models during Phases I and II of the NRA contract from 2011 to 2013 in the NASA Ames 9- by 7-Foot and NASA Glenn 8- by 6-Foot Supersonic Wind Tunnels. Sonic boom pressure signatures were acquired primarily at Mach 1.6 and 1.8, and force and moment data were acquired from Mach 0.8 to 1.8. The sonic boom test data were obtained using a 2-in. flat-top pressure rail and a 14-in. round-top tapered "reflection factor 1" (RF1) pressure rail. Both rails capture an entire pressure signature in one data point, and successive signatures at varying positions along or above the rail were used to improve data quality through spatial averaging. The sonic boom data obtained by the rails were validated with high-fidelity numerical simulations of off-body pressures using the CFD codes USM3D, Cart3D, and OVERFLOW. The test results from the RF1 rail showed good agreement between the computational and experimental data when a variety of testing techniques including spatial averaging of a series of pressure signatures were employed, however, reflections off the 2-in. flat-top rail caused distortions in the signatures that did not agree with the CFD predictions. The 9 x 7 and 8 x 6 wind tunnels generally produced comparable data.

pressure signature↗

Soil Moisture Active Passive (SMAP) L-Band Microwave Radiometer Post-Launch Calibration

The SMAP microwave radiometer is a fully-polarimetric L-band radiometer flown on the SMAP satellite in a 6 AM/ 6 PM sun-synchronous orbit at 685 km altitude. Since April, 2015, the radiometer is under calibration and validation to assess the quality of the radiometer L1B data product. Calibration methods including the SMAP L1B TA2TB (from Antenna Temperature (TA) to the Earth's surface Brightness Temperature (TB)) algorithm and TA forward models are outlined, and validation approaches to calibration stability/quality are described in this paper including future work. Results show that the current radiometer L1B data satisfies its requirements.

simulation↗

Soil Moisture ActivePassive (SMAP) L-Band Microwave Radiometer Post-Launch Calibration

The SMAP microwave radiometer is a fully-polarimetric L-band radiometer flown on the SMAP satellite in a 6 AM/ 6 PM sun-synchronous orbit at 685 km altitude. Since April, 2015, the radiometer is under calibration and validation to assess the quality of the radiometer L1B data product. Calibration methods including the SMAP L1B TA2TB (from Antenna Temperature (TA) to the Earth’s surface Brightness Temperature (TB)) algorithm and TA forward models are outlined, and validation approaches to calibration stability/quality are described in this paper including future work. Results show that the current radiometer L1B data satisfies its requirements.

radiometers↗

Development of an Intelligent Videogrammetric Wind Tunnel Measurement System

A videogrammetric technique developed at NASA Langley Research Center has been used at five NASA facilities at the Langley and Ames Research Centers for deformation measurements on a number of sting mounted and semispan models. These include high-speed research and transport models tested over a wide range of aerodynamic conditions including subsonic, transonic, and supersonic regimes. The technique, based on digital photogrammetry, has been used to measure model attitude, deformation, and sting bending. In addition, the technique has been used to study model injection rate effects and to calibrate and validate methods for predicting static aeroelastic deformations of wind tunnel models. An effort is currently underway to develop an intelligent videogrammetric measurement system that will be both useful and usable in large production wind tunnels while providing accurate data in a robust and timely manner. Designed to encode a higher degree of knowledge through computer vision, the system features advanced pattern recognition techniques to improve automated location and identification of targets placed on the wind tunnel model to be used for aerodynamic measurements such as attitude and deformation. This paper will describe the development and strategy of the new intelligent system that was used in a recent test at a large transonic wind tunnel.

Graves, Sharon S.↗

Small Scale Mass Flow Plug Calibration

A simple control volume model has been developed to calculate the discharge coefficient through a mass flow plug (MFP) and validated with a calibration experiment. The maximum error of the model in the operating region of the MFP is 0.54%. The model uses the MFP geometry and operating pressure and temperature to couple continuity, momentum, energy, an equation of state, and wall shear. Effects of boundary layer growth and the reduction in cross-sectional flow area are calculated using an in- integral method. A CFD calibration is shown to be of lower accuracy with a maximum error of 1.35%, and slower by a factor of 100. Effects of total pressure distortion are taken into account in the experiment. Distortion creates a loss in flow rate and can be characterized by two different distortion descriptors.

mass-flow measurements↗

LOFTID Heat Flux Gauge Calibration: What is Truth?

The Low-Earth Orbit Flight Test of an Inflatable Decelerator (LOFTID) is a demonstration of Hypersonic Inflatable Aerodynamic Decelerator (HIAD) technology, which may enable the delivery of heavy payloads to Mars, Venus, and Titan, as well as return to Earth. Unlike rigid aeroshells that are constrained by the size of the rocket’s shroud, inflatable aeroshells can be deployed to a much larger scale, thus allowing a spacecraft to begin its deceleration earlier and experience less heating. On LOFTID, there will be 4 total heat flux gauges (HFG) with a range of 70 W/cm2 and 1 radiometer with a range of 3 W/cm2, arranged as shown in Fig. 1. Both the radiometer and total HFGs are Schmidt-Boelter gauges purchased from an external vendor. Radiative calibrations were performed in-house at NASA Ames’ Sensors and TPS Advanced Research Laboratories (STAR Labs) before and after environmental testing to investigate how the testing affected the sensors' response. Additional rounds of radiative calibration at STAR Labs were also performed in order to investigate the large uncertainties associated with these tests. For example, a survey of multiple calibration facilities concluded that the uncertainty within a given facility was +/-3% [1]. An additional NIST study that calibrated heat flux gauges at 7 different facilities also found the variation in calibration coefficients to be up to ~3% within a given facility, but up to 15% between facilities, suggesting systematic differences between test setups [2]. Finally, the response of heat flux gauges to radiative versus convective heat flux has shown to differ by up to 20% [3],[4]. Because the heat flux gauges on LOFTID will predominantly experience convective heat flux during flight, a convective calibration study was performed at Boeing's Large-Core Arc Tunnel (LCAT) facility. Radiative Calibration Procedure The calibrations performed at STAR Labs utilize a quartz lamp bank (QLB) that provides a maximum heat flux of 50 W/cm2, which bounds the expected LOFTID flight environment. The calibration involves exposing a water-cooled Gardon gauge (reference) and then the unit-under-test (UUT) to 5 different heat fluxes multiple times for 10 seconds each, and then calculating a linear fit. The test setup is shown in Fig. 2. The total HFGs were calibrated at STAR Labs 3 times, denoted as STAR 1 (before environmental testing), STAR 2 (after protoflight vibration and thermal-vacuum testing), and STAR 3 (no change from previous test). All 8 flight-lot total HFGs showed a decrease in full-scale output from STAR 1 to STAR 2 by between 0.5% and 10. The first portion of this investigation was to determine whether the change could be due to differences in temperature between the two calibration runs. A typical linear fit to the calibration data was performed using Eq. 1 where q’ is the heat flux in W/cm2, c is the calibration coefficient, and mV is the sensor output. To account for temperature, the data were fit to a nonlinear function that included both the sensor output (mV) and the temperature from the thermocouple embedded inside the HFG near the surface (T): q'=mV/(c1* T + c0}. The residuals between the fits and the actual data points were calculated for every point, and proven to be much smaller for the temperature-compensated fits than for the linear fits for all sensors. An example is shown in Fig. 3. When the temperature-compensated fits from STAR 1 were applied to the STAR 2 data, the residuals did not improve, suggesting that the change in sensitivity between these two calibration runs was not due to temperature. A third round of calibration (STAR 3) was conducted to further address the temperature dependence of the total HFGs, and the resulting sensitivities matched closely to STAR 2 (within 2%). Temperature-compensated calibration curves were once again fit to the data. In this case, when the temperature-compensated fits from STAR 3 were applied to STAR 2 data, the residuals between the fits and STAR 2 data were much lower than the residuals due to the linear fits. This suggests that the changes seen between STAR 1 and STAR 2 were likely due to actual changes in the sensors caused by the environmental testing between the two calibrations. A modification of the original calibration process, in which the UUT was exposed to each heat flux for just 3 seconds (instead of 10) to reduce the temperature increase during the test, was additionally performed on several of the HFGs. In general, the sensitivities were 1-1.5% lower than from the 10-second tests, but the temperatures were also significantly lower. When the temperature-compensated fits from the 10-second tests were applied to the 3-second test data, the residuals were greatly improved than when just using the linear fits, further suggesting that the temperature-compensated fits may lead to better accuracy than the linear fits in flight. Convective Calibration The second portion of this study was to create a mapping between the radiative and convective calibration coefficients. The majority of the heating during flight will be convective, so it is important to understand how the HFG response differs under these conditions. However, there are no standardized methods for convective calibration [5]. Because the TPS aerothermal response models were validated at LCAT, the same facility was chosen for convective calibration of two of the total HFGs (Fig. 4). Preliminary results showed that the full-scale output was 3% and 8% higher in convective heat flux as compared to radiative heat flux. However, tunnel variation may have contributed to noise and uncertainty in the measurements, and more testing and analysis remains to be done. Scope of Presentation The presentation will include an overview of the changes seen in HFG calibration before and after environmental testing, differences between radiative and convective calibrations, the modeling work done to aid in understanding the sensor response to varying environments, and recommended future work.

H S Alpert↗

Numerical Calibration of Mass Flow Plug for Inlet Testing

A simple control volume model has been developed to calculate the discharge coefficient through a mass flow plug (MFP) and validated with a calibration experiment. The maximum error of the model within the operating region of the MFP is 0.54%. The control volume analysis developed work is comprised of a sequence of flow calculations through the MFP. The model uses the MFP geometry and operating pressure and temperature to couple continuity, momentum, energy, an equation of state, and wall shear. The discharge coefficient calculation also includes the effects of boundary layer growth, including the reduction in cross-sectional flow area as characterized by the boundary layer displacement thickness. The last calculation in the sequence uses an integral method to calculate the growth of the boundary layer, from which the displacement thickness is then determined. The result of these successive calculations is an accurate one-dimension model of the velocity, pressure, and temperature through the MFP. For comparison, a computational fluid dynamic (CFD) calibration is shown, which when compared to the presented numerical model, had a lower accuracy with a maximum error of 1.35% in addition to being slower by a factor of 100."

Flow Measurement↗

Estimating the urban bias of surface shelter temperatures using upper-air and satellite data. Part 1: Development of models predicting surface shelter temperatures

Multiple regression techniques were used to predict surface shelter temperatures based on the time period 1986-89 using upper-air data from the European Centre for Medium-Range Weather Forecasts (ECMWF) to represent the background climate and site-specific data to represent the local landscape. Global monthly mean temperature models were developed using data from over 5000 stations available in the Global Historical Climate Network (GHCN). Monthly maximum, mean, and minimum temperature models for the United States were also developed using data from over 1000 stations available in the U.S. Cooperative (COOP) Network and comparative monthly mean temperature models were developed using over 1150 U.S. stations in the GHCN. Three-, six-, and full-variable models were developed for comparative purposes. Inferences about the variables selected for the various models were easier for the GHCN models, which displayed month-to-month consistency in which variables were selected, than for the COOP models, which were assigned a different list of variables for nearly every month. These and other results suggest that global calibration is preferred because data from the global spectrum of physical processes that control surface temperatures are incorporated in a global model. All of the models that were developed in this study validated relatively well, especially the global models. Recalibration of the models with validation data resulted in only slightly poorer regression statistics, indicating that the calibration list of variables was valid. Predictions using data from the validation dataset in the calibrated equation were better for the GHCN models, and the globally calibrated GHCN models generally provided better U.S. predictions than the U.S.-calibrated COOP models. Overall, the GHCN and COOP models explained approximately 64%-95% of the total variance of surface shelter temperatures, depending on the month and the number of model variables. In addition, root-mean-square errors (rmse's) were over 3 C for GHCN models and over 2 C for COOP models for winter months, and near 2 C for GHCN models and near 1.5 C for COOP models for summer months.

Epperson, David L.↗

Using Numerical Modeling to Simulate Space Capsule Ground Landings

Experimental work is being conducted at the National Aeronautics and Space Administration s (NASA) Langley Research Center (LaRC) to investigate ground landing capabilities of the Orion crew exploration vehicle (CEV). The Orion capsule is NASA s replacement for the Space Shuttle. The Orion capsule will service the International Space Station and be used for future space missions to the Moon and to Mars. To evaluate the feasibility of Orion ground landings, a series of capsule impact tests are being performed at the NASA Langley Landing and Impact Research Facility (LandIR). The experimental results derived at LandIR provide means to validate and calibrate nonlinear dynamic finite element models, which are also being developed during this study. Because of the high cost and time involvement intrinsic to full-scale testing, numerical simulations are favored over experimental work. Subsequent to a numerical model validated by actual test responses, impact simulations will be conducted to study multiple impact scenarios not practical to test. Twenty-one swing tests using the LandIR gantry were conducted during the June 07 through October 07 time period to evaluate the Orion s impact response. Results for two capsule initial pitch angles, 0deg and -15deg , along with their computer simulations using LS-DYNA are presented in this article. A soil-vehicle friction coefficient of 0.45 was determined by comparing the test stopping distance with computer simulations. In addition, soil modeling accuracy is presented by comparing vertical penetrometer impact tests with computer simulations for the soil model used during the swing tests.

Heymsfield, Ernie↗

Structural and thermal response of 30 cm diameter ion thruster optics

Tabular and graphical data are presented which are intended for use in calibrating and validating structural and thermal models of ion thruster optics. A 30 cm diameter, two electrode, mercury ion thruster was operated using two different electrode assembly designs. With no beam extraction, the transient and steady state temperature profiles and center electrode gaps were measured for three discharge powers. The data showed that the electrode mount design had little effect on the temperatures, but significantly impacted the motion of the electrode center. Equilibrium electrode gaps increased with one design and decreased with the other. Equilibrium displacements in excess of 0.5 mm and gap changes of 0.08 mm were measured at 450 W discharge power. Variations in equilibrium gaps were also found among assemblies of the same design. The presented data illustrate the necessity for high fidelity ion optics models and development of experimental techniques to allow their validation.

Macrae, G. S.↗