SEARCH · Engineering Papers

Results for “data base for model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

NASA NTRS2019

Progress Towards Modeling the Ablation Response of NuSil-Coated PICA

The Mars Science Laboratory (MSL) Entry, Descent and Landing Instrumentation (MEDLI) collected in-flight data largely used by the ablation community to verify and validate physics-based models for the response of the Phenolic Impregnated Carbon Ablator (PICA) material [1-4]. MEDLI data were recently used to guide the development of NASA’s high-fidelity material response models for PICA, implemented in the Porous material Analysis Toolbox based on OpenFOAM (PATO) software [5-6]. A follow-up instrumentation suite, MEDLI2, is planned for the upcoming Mars 2020 mission [7] after the large scientific impact of MEDLI. Recent analyses performed as part of MEDLI2 development draw the attention to significant effects of a protective coating to the aerothermal response of PICA. NuSil, a silicone-based overcoat sprayed onto the MSL heatshield as contamination control, is currently neglected in PICA ablation models. To mitigate the spread of phenolic dust from PICA, NuSil was applied to the entire MSL heatshield, including the MEDLI plugs. NuSil is a space grade designation of the siloxane copolymer, primarily used to protect against atomic oxygen erosion in the Low Earth Orbit environment. Ground testing of PICA-NuSil (PICA-N) models all exhibited surface temperature jumps of the order of 200 K due to oxide scale formation and subsequent NuSil burn-off. It is therefore critical to include a model for the aerothermal response of the coating in ongoing code development and validation efforts.

Meurisse, Jeremie B.↗

NASA NTRS1997

Satellite Sensed Skin Sea Surface Temperature

Quantitative predictions of spatial and temporal changes the global climate rely heavily on the use of computer models. Unfortunately, such models cannot provide the basis for climate prediction because key physical processes are inadequately treated. Consequently, fine tuning procedures are often used to optimize the fit between model output and observational data and the validation of climate models using observations is essential if model based predictions of climate change are to be treated with any degree of confidence. Satellite Sea Surface Temperature (SST) observations provide high spatial and temporal resolution data which is extremely well suited to the initialization, definition of boundary conditions and, validation of climate models. In the case of coupled ocean-atmosphere models, the SST (or more correctly the 'Skin' SST (SSST)) is a fundamental diagnostic variable to consider in the validation process. Daily global SST maps derived from satellite sensors also provide adequate data for the detection of global patterns of change which, unlike any other SST data set, repeatedly extend into the southern hemisphere extra-tropical regions. Such data are essential to the success of the spatial 'fingerprint' technique, which seeks to establish a north-south asymmetry where warming is suppressed in the high latitude Southern Ocean. Some estimates suggest that there is a greater than 80% chance of directly detecting significant change (97.5 % confidence level) after 10-12 years of consistent global observations of mean sea surface temperature. However, these latter statements should be qualified with the assumption that a negligible drift in the observing system exists and that biases between individual instruments required to derive a long term data set are small. Given that current estimates for the magnitude of global warming of 0.015 K yr(sup -1) - 0.025 K yr(sup -1), satellite SST data sets need to be both accurate and stable if such a warming trend is to be confidently detected. Some of these activities are focussed to develop and deploy instrumentation suitable for the collection of precise in situ measurements of the SSST which can be used to improve the accuracy of satellite measurements, while others develop techniques to generate improved global analyses of sea surface temperature using historical data.

Donlon, Craig↗

NASA NTRS1993

Validation of Atmospheric Correction of Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) Radiance Data Based on Radiative Transfer Modeling

An evaluation of atmospheric correction of AVIRIS data using radiative transfer codes LOWTRAN7 and MODTRAN is presented. The algorithm employed is based on a simple model of radiance L at each wavelength at the sensor that can be written approximately LAV=Lp+Tp, where subscript AV referes to AVIRIS, Lp is the path radiance and Tp is the diffuse + direct transmitted radiance of the atmosphere at AVIRIS.

Infrared Mapping↗

NASA NTRS2023

Evaluating Greenland Surface-Mass-Balance and Firn-Densification Data Using ICESat-2 Altimetry

Surface-mass-balance (SMB) and firn-densification (FD) models are widely used in altimetry studies as a tool to separate atmospheric-driven from ice-dynamics-driven ice-sheet mass changes and to partition observed volume changes into ice-mass changes and firn-air-content changes. Until now, SMB models have been principally validated based on comparison with ice core and weather station data or comparison with widely separated flight radar-survey flight lines. Firn-densification models have been primarily validated based on their ability to match net densification over decades, as recorded in firn cores, and the short-term time-dependent component of densification has rarely been evaluated at all. The advent of systematic ice-sheet-wide repeated ice-surface-height measurements from ICESat-2 (the Ice Cloud, and land Elevation Satellite, 2) allows us to measure the net surface-height change of the Greenland ice sheet at quarterly resolution and compare the measured surface-height differences directly with those predicted by three FD–SMB models: MARv3.5.11 (Modèle Atmosphérique Régional version 3.5.11) and GSFCv1.1 and GSFCv1.2 (the Goddard Space Flight Center FD–SMB models version 1.1 and 1.2). By segregating the data by season and elevation, and based on the timing and magnitude of modelled processes in areas where we expect minimal ice-dynamics-driven height changes, we investigate the models' accuracy in predicting atmospherically driven height changes. We find that while all three models do well in predicting the large seasonal changes in the low-elevation parts of the ice sheet where melt rates are highest, two of the models (MARv3.5.11 and GSFCv1.1) systematically overpredict, by around a factor of 2, the magnitude of height changes in the high-elevation parts of the ice sheet, particularly those associated with melt events. This overprediction seems to be associated with the melt sensitivity of the models in the high-elevation part of the ice sheet. The third model, GSFCv1.2, which has an updated high-elevation melt parameterization, avoids this overprediction.

Benjamin E. Smith↗

DOE OSTI2023

Modeling Assessment of Residential Air-to-Water Heat Pumps Coupled with Cooling Thermal Storage

This study explored the performance and operating cost viability of air-to-water heat pumps (AWHPs) coupled with thermal energy storage (TES) in efficient new residential construction. AWHPs are an emerging technology in this country, but offer promise in terms of high efficiency, fully contained and factory charged outdoor refrigeration system, and hydronic delivery capabilities, which facilitates zoning, ducts in conditioned space, and TES integration for summer load-shifting. Although this AWHP+TES strategy is not yet mainstream, the authors feel that in ten years as decarbonization efforts proceed and TOU rates become more common, strategies such as this will be more accessible. Validated EnergyPlus simulation models were developed based on detailed monitoring data collected over several years at Pacific Gas and Electric's CVRH laboratory test homes located in Stockton, California. One of the CVRH test homes (1,962 ft 2 two-story) had been testing various AWHP systems and configurations over the past six years. The validated model was then updated with high efficiency IECC ZERH envelope and component requirements for climate zones 1-5, including ducts in conditioned space thermal distribution. Simulations were completed for the 1,962 ft 2 home in each climate zone for a minimum efficiency ASHP, an AWHP coupled with a fan coil, and an AWHP coupled with TES sized to eliminate summer on-peak compressor operation. To maintain consistency in reporting energy use estimates, all cases were run with a similar indoor thermostat control strategy to pre-cool the house below the nominal 76 degrees Fahrenheit set point prior to the on-peak period and float slightly above the set point during the peak period. The AWHP+TES configuration was controlled to alternately condition the indoor space or to charge the TES tanks prior to the beginning of the on-peak. Three composite TOU rates were developed based on existing TOU rates across the U.S. to provide differing economic scenarios to evaluate customer bill impacts throughout the summer. Two of the TOU rates had short three-hour peak periods, while the third rate had a longer seven-hour duration peak period. AWHP modeling projections were based on the observed field performance of the Chiltrix CX34 variable speed unit. Other products on the market or entering the market in the near term would likely perform differently.

25 ENERGY STORAGE↗

DOE OSTI2026

An ultra-fast method for generating synthetic down-scattered neutron data for inertial confinement fusion implosions

In inertial confinement fusion experiments at the National Ignition Facility, asymmetries are probed by a variety of neutron diagnostics, including neutron imaging systems, real-time neutron activation diagnostics (RTNADs), and neutron spectrometers. It is often useful to generate synthetic data based on these diagnostics to validate and tune models. However, current methods of doing so using Monte Carlo particle tracing are time-consuming. In this paper, an ultra-fast method is presented for generating synthetic neutron images, RTNAD data, and spectrometry data using line integrals and 3D convolutions. While it does not contain as much physics as particle tracing codes, it is thousands of times faster and produces nearly identical data. This enables analysis techniques that depend on generating large amounts of synthetic data, which will prove very useful for the study of asymmetries going forward.

Deuterium↗

NASA NTRS1994

Real-time remote scientific model validation

This paper describes flight results from the use of a CLIPS-based validation facility to compare analyzed data from a space life sciences (SLS) experiment to an investigator's preflight model. The comparison, performed in real-time, either confirms or refutes the model and its predictions. This result then becomes the basis for continuing or modifying the investigator's experiment protocol. Typically, neither the astronaut crew in Spacelab nor the ground-based investigator team are able to react to their experiment data in real time. This facility, part of a larger science advisor system called Principal Investigator in a Box, was flown on the space shuttle in October, 1993. The software system aided the conduct of a human vestibular physiology experiment and was able to outperform humans in the tasks of data integrity assurance, data analysis, and scientific model validation. Of twelve preflight hypotheses associated with investigator's model, seven were confirmed and five were rejected or compromised.

Frainier, Richard↗

NASA NTRS1992

Experimental studies of characteristic combustion-driven flows for CFD validation

A series of rocket-related studies intended to develop a suitable data base for validation of Computational Fluid Dynamics (CFD) models of characteristic combustion-driven flows was undertaken at the Propulsion Engineering Research Center at Penn State. Included are studies of coaxial and impinging jet injectors as well as chamber wall heat transfer effects. The objective of these studies is to provide fundamental understanding and benchmark quality data for phenomena important to rocket combustion under well-characterized conditions. Diagnostic techniques utilized in these studies emphasize determinations of velocity, temperature, spray and droplet characteristics, and combustion zone distribution. Since laser diagnostic approaches are favored, the development of an optically accessible rocket chamber has been a high priority in the initial phase of the project. During the design phase for this chamber, the advice and input of the CFD modeling community were actively sought through presentations and written surveys. Based on this procedure, a suitable uni-element rocket chamber was fabricated and is presently under preliminary testing. Results of these tests, as well as the survey findings leading to the chamber design, were presented.

Santoro, R. J.↗

NASA NTRS1986

Comments on Lambeck and Coleman - 'The earth's shape and gravity field: A report of progress from 1958 to 1982'

The accuracy and validation of global gravity models based on satellite data are discussed, responding to the statistical analysis of Lambeck and Coleman (1983) (LC). Included are an evaluation of the LC error spectra, a summary of independent-observation calibrations of the error estimates of the Goddard Earth Models (GEM) 9 and L2 (Lerch et al., 1977, 1979, 1982, 1983, and 1985), a comparison of GEM-L2 with GRIM-3B (Reigber et al., 1983), a comparison of recent models with LAGEOS laser ranging, and a summary of resonant-orbit model tests. It is concluded that the accuracy of GEMs 9, 10, and L2 is much higher than claimed by LC, that the GEMs are in good agreement with independent observations and with GRIM-3B, and that the GEM calibrations were adequate. In a reply by LC, a number of specific questions regarding the error estimates are addressed, and it is pointed out that the intermodel discrepancies of the greatest geophysical interest are those in the higher-order coefficients, not discussed in the present comment. It is argued that the differences among the geoid heights of even the most recent models are large enough to call for considerable improvements.

Lerch, F. J.↗

NASA NTRS1988

Application of unsteady aeroelastic analysis techniques on the national aerospace plane

A presentation provided at the Fourth National Aerospace Plane Technology Symposium held in Monterey, California, in February 1988 is discussed. The objective is to provide current results of ongoing investigations to develop a methodology for predicting the aerothermoelastic characteristics of NASP-type (hypersonic) flight vehicles. Several existing subsonic and supersonic unsteady aerodynamic codes applicable to the hypersonic class of flight vehicles that are generally available to the aerospace industry are described. These codes were evaluated by comparing calculated results with measured wind-tunnel aeroelastic data. The agreement was quite good in the subsonic speed range but showed mixed agreement in the supersonic range. In addition, a future endeavor to extend the aeroelastic analysis capability to hypersonic speeds is outlined. An investigation to identify the critical parameters affecting the aeroelastic characteristics of a hypersonic vehicle, to define and understand the various flutter mechanisms, and to develop trends for the important parameters using a simplified finite element model of the vehicle is summarized. This study showed the value of performing inexpensive and timely aeroelastic wind-tunnel tests to expand the experimental data base required for code validation using simple to complex models that are representative of the NASP configurations and root boundary conditions are discussed.

Pototzky, Anthony S.↗

NASA NTRSDate not supplied

Flight Metal Plasma Thruster (MPT) Development, Qualification, and Thrust Measurement Campaign

A torsional thrust stand, calibrated for impulse bits in the range of 0.1mNs -0.5 mNs, was used to measure impulse bits during two campaigns at the NASA/GRC VF-3 Vacuum test Facility. Metal Plasma Thrusters (MPTs) with targets of Molybdenum, Copper and Stainless Steel (as used in upper stages of launch vehicles that are abandoned in LEO) were tested. This paper describes data from Mo targets (called pucks). The Cu and ss data will be presented elsewhere. Model predictions (based on a simple circuit model and published plasma parameters) were validated by data from the calibrated torsional thrust stand. The Metal Plasma Thruster uses solid metal propellant, hence requires no liquids, gases, flow valves or flow controls and has no moving parts. Total impulse ~5000Ns/U provides orbit raising and drag compensation capability.

Electric Propulsion↗

NASA NTRSDate not supplied

Flight MPT Development, Qualification and Thrust Measurement Campaign

Electric Propulsion↗

DOE OSTI2024

Verification, Validation, and Calibration Through a Causal Lens

While typical validation and verification approaches focus on identifying the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on identifying causal relationships between data elements. Statistical and machine-learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between data sets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify, and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles, it is known as a directed acyclic graph. A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts can identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2008

SEE Rate Estimation: Model Complexity and Data Requirements

Statistical Methods outlined in [Ladbury, TNS20071 can be generalized for Monte Carlo Rate Calculation Methods Two Monte Carlo Approaches: a) Rate based on vendor-supplied (or reverse-engineered) model SEE testing and statistical analysis performed to validate model; b) Rate calculated based on model fit to SEE data Statistical analysis very similar to case for CREME96. Information Theory allows simultaneous consideration of multiple models with different complexities: a) Model with lowest AIC usually has greatest predictive power; b) Model averaging using AIC weights may give better performance if several models have similar good performance; and c) Rates can be bounded for a given confidence level over multiple models, as well as over the parameter space of a model.

Ladbury, Ray↗

NASA NTRS2008

New Developments for Physically-based Falling Snow Retrievals over Land in Preparation for GPM

The NASA Global Precipitation Measurement mission (GPM) concept centers on deploying a Core spacecraft carrying a dual-frequency precipitation radar and a microwave radiometric imager with channels from 10 to 183 GHz to serve as a precipitation physics observatory and a calibration reference to unify a constellation of dedicated and operational passive microwave sensors. Because of the extended orbit of the Core (plus or minus 65 deg) and the enhanced dual frequency radar and high frequency radiometer, GPM will be able to sense falling snow precipitation and light rain over land. Accordingly, GPM has partnered with the Canadian CloudSat/CALIPSO Validation Project (C3VP) to obtain observations to provide one of several important ground-based validation data sets around which the falling snow models and retrieval algorithms can be further developed and tested. In this work we compare and correlate the long time series (Nov.'06 - March '07) measurements of precipitation rate from parsivels to the passive (89, 150, 183 plus or minus 1, plus or minus 3, plus or minus 7 GHz) observations of NOAA's AMSU-B radiometer. We separate the comparisons into categories of no precipitation, liquid rain and falling snow precipitation. We found that there are similar TBs (especially at 89 and 150 GHz) for cases with falling snow and for non-precipitating cases. The comparisons indicate that surface emissivity contributions to the satellite observed TB over land can add uncertainty in detecting and estimating falling snow. The newest results show that by computing brightness temperatures based on CARE radiosonde data and a rough estimate of surface emissivity show that the cloud ice scattering signal in the AMSU-B data is detected. That is the differences in computed TB and AMSU-B TB for precipitating and non-precipitating cases are unique such that the precipitating and non-precipitating cases can be identified. These results require that the radiosonde releases are within an hour of the AMSU-B data. Forest fraction, snow cover, and measured emissivities were combined to calculate the surface emissivities.

Jackson, Gail S.↗

NASA NTRS2008

CFD Modeling of Superheated Fuel Sprays

An understanding of fuel atomization and vaporization behavior at superheat conditions is identified to be a topic of importance in the design of modern supersonic engines. As a part of the NASA aeronautics initiative, we have undertaken an assessment study to establish baseline accuracy of existing CFD models used in the evaluation of a ashing jet. In a first attempt towards attaining this goal, we have incorporated an existing superheat vaporization model into our spray solution procedure but made some improvements to combine the existing models valid at superheated conditions with the models valid at stable (non-superheat) evaporating conditions. Also, the paper reports some validation results based on the experimental data obtained from the literature for a superheated spray generated by the sudden release of pressurized R134A from a cylindrical nozzle. The predicted profiles for both gas and droplet velocities show a reasonable agreement with the measured data and exhibit a self-similar pattern similar to the correlation reported in the literature. Because of the uncertainty involved in the specification of the initial conditions, we have investigated the effect of initial droplet size distribution on the validation results. The predicted results were found to be sensitive to the initial conditions used for the droplet size specification. However, it was shown that decent droplet size comparisons could be achieved with properly selected initial conditions, For the case considered, it is reasonable to assume that the present vaporization models are capable of providing a reasonable qualitative description for the two-phase jet characteristics generated by a ashing jet. However, there remains some uncertainty with regard to the specification of certain initial spray conditions and there is a need for experimental data on separate gas and liquid temperatures in order to validate the vaporization models based on the Adachi correlation for a liquid involving R134A.

Raju, M. S.↗

NASA NTRSDate not supplied

3D Material Response of the MSL Heatshield Using NuSil-Coated PICA

The Mars Science Laboratory (MSL) Entry, Descent and Landing Instrumentation (MEDLI) collected in-flight data largely used by the ablation community to verify and validate physics-based models for the response of the Phenolic Impregnated Carbon Ablator (PICA) material [1-4]. MEDLI data were recently used to guide the development of NASA’s high-fidelity material response models for PICA implemented in the Porous material Analysis Toolbox based on OpenFOAM (PATO) software [5-6]. A follow-up instrumentation suite, MEDLI2, was used for the Mars 2020 mission [7] after the large scientific impact of MEDLI. Recent analyses performed as part of MEDLI2 development drew the attention to significant effects of a protective coating to the aerothermal response of PICA. NuSil, a silicone-based overcoat sprayed onto the MSL heatshield, including the MEDLI plugs, as contamination control, is currently neglected in PICA ablation models. To mitigate the spread of phenolic dust from PICA, NuSil was applied to the entire MSL and Mars 2020 heatshields, including the MEDLI and MEDLI2 plugs. Ground testing of PICA-NuSil (PICA-N) models exhibited surface temperature jumps due to oxide scale formation and subsequent NuSil burn- off. It is therefore critical to include a model for the aerothermal response of the coating in ongoing code development and validation efforts. Figure 1 illustrates the PICA-N model implemented in PATO with a test case that shows a temperature jump and a change of recession rate at the wall after 20 seconds of simulation when the NuSil coating was fully removed.

Aerospace↗

DOE OSTI2023

Wind Turbine Drivetrain Reliability Research - Gearbox Bearing Axial Cracking Failure Mode Example

The U.S. Department of Energy's National Renewable Energy Laboratory and Argonne National Laboratory have been conducting wind turbine drivetrain (formerly gearbox) reliability research for many years. Although the drivetrain focus has not changed, detailed projects are adjusted every few years based on dynamic needs seen in the field across the wind industry. This webinar will walk through the research methodology by using wind turbine gearbox bearing axial cracking failure mode as an example. The detailed steps include: 1) top failure mode identification based on actual failure data collected from project partners, 2) bench-top testing to identify possible contributing factors and formulate a damage metric, 3) physics domain modeling and validation through testing, 4) reliability assessment and prognosis based on the physics domain model and data domain inputs, and further enhancement through machine learning algorithms, using actual wind plant operational and failure event data. Hopefully, the presented work is of interest to the IISE community, and some members can apply their expertise to wind turbine and plant applications, helping enhance wind power generation technology advancement and its broader deployment.

axial cracking↗