Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Model comparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Conductance Effects on Inner Magnetospheric Plasma Morphology: Model Comparisons with IMAGE EUV, MENA, and HENA Data

Modeling results of the inner magnetosphere showing the influence of the ionospheric conductance on the inner magnetospheric electric fields during the April 17, 2002 magnetic storm are presented. Kinetic plasma transport code results are analyzed in combination with observations of the inner magnetospheric plasma populations, in particular those from the IMAGE satellite. Qualitative and quantitative comparisons are made with the observations from EW, MENA, and HENA, covering the entire energy range simulated by the model (0 to 300 keV). The electric field description, and in particular the ionospheric conductance, is the only variable between the simulations. Results from the data-model comparisons are discussed, detailing the strengths and weaknesses of each conductance choice for each energy channel.

Liemohn, M.

Cost Model Comparison: A Study of Internally and Commercially Developed Cost Models in Use by NASA

NASA makes use of numerous cost models to accurately estimate the cost of various components of a mission - hardware, software, mission/ground operations - during the different stages of a mission's lifecycle. The purpose of this project was to survey these models and determine in which respects they are similar and in which they are different. The initial survey included a study of the cost drivers for each model, the form of each model (linear/exponential/other CER, range/point output, capable of risk/sensitivity analysis), and for what types of missions and for what phases of a mission lifecycle each model is capable of estimating cost. The models taken into consideration consisted of both those that were developed by NASA and those that were commercially developed: GSECT, NAFCOM, SCAT, QuickCost, PRICE, and SEER. Once the initial survey was completed, the next step in the project was to compare the cost models' capabilities in terms of Work Breakdown Structure (WBS) elements. This final comparison was then portrayed in a visual manner with Venn diagrams. All of the materials produced in the process of this study were then posted on the Ground Segment Team (GST) Wiki.

cost models

The Southern Ocean Sea Surface Temperature Response to Ozone Depletion: A Multi-Model Comparison

The effect of the Antarctic ozone hole extends downwards from the stratosphere, with clear signatures in surface weather patterns including a positive trend in the Southern Annular Mode (SAM). Several recent studies have used coupled climate models to investigate the impact of these changes on Southern Ocean sea surface temperature (SST), notably motivated by the observed cooling from the late 1970s. Here we examine the robustness of these model results through comparison of both previously published and new simulations. We focus on the calculation of ‘climate response functions' (CRFs), transient responses to an instantaneous step-change in ozone concentrations. The CRF for most models consists of a rapid cooling of SST, followed by a slower warming trend. However, inter-model comparison reveals large uncertainties, such that even the sign of the impact of ozone depletion on historical SST, when reconstructed from the CRF, remains unconstrained. Comparison of these CRFs with SST responses to a hypothetical step-change in the SAM, inferred through lagged linear regression, shows broadly similar results. Causes of uncertainty are explored by examining relationships between model climatologies and their CRFs. The inter-model spread in CRFs can be reproduced by varying a single subgrid-scale mixing parameter within a single model. Antarctic sea-ice CRFs are also calculated: these do not generally exhibit the two-time-scale behavior of SST, suggesting a complex relationship between the two. Finally, by constraining model climatology-response relationships with observational values, we conclude that ozone depletion in unlikely to have been the primary driver of the observed SST cooling trend.

Climate response functions (CRF)

Diurnal Variations of Stratospheric Ozone Measured by Ground-Based Microwave Remote Sensing at the Mauna Loa NDACC Site: Measurement Validation and GEOSCCM Model Comparison

There is presently renewed interest in diurnal variations of stratospheric and mesospheric ozone for the purpose of supporting homogenization of records of various ozone measurements that are limited by the technique employed to being made at certain times of day. We have made such measurements for 19 years using a passive microwave remote sensing technique at the Mauna Loa Observatory (MLO) in Hawaii, which is a primary station in the Network for Detection of Atmospheric Composition Change (NDACC). We have recently reprocessed these data with hourly time resolution to study diurnal variations. We inspected differences between pairs of the ozone spectra (e.g., day and night) from which the ozone profiles are derived to determine the extent to which they may be contaminated by diurnally varying systematic instrumental or measurement effects. These are small, and we have reduced them further by selecting data that meet certain criteria that we established. We have calculated differences between profiles measured at different times: morning-night, afternoon-night, and morning-afternoon and have intercompared these with like profiles derived from the Aura Microwave Limb Sounder (Aura-MLS), the Upper Atmosphere Research Satellite Microwave Limb Sounder (UARS-MLS),t he Superconducting Submillimeter-Wave Limb-Emission Sounder (SMILES), and Solar Backscatter Ultraviolet version 2 (SBUV2) measurements. Differences between averages of coincident profiles are typically less than 1.5 percent of typical nighttime values over most of the covered altitude range with some exceptions. We calculated averages of ozone values for each hour from the Mauna Loa microwave data, and normalized these to the average for the first hour after midnight for comparison with corresponding values calculated with the Goddard Earth Observing System Chemistry Climate Model (GEOSCCM). We found that the measurements and model output mostly agree to better than 1.5 percent of the midnight value, with one noteworthy exception: The measured morning-night values are significantly (2-3 percent) higher than the modeled ones from 3.2 to 1.8 hPa (approximately 39-43 km), and there is evidence that the measured values are increasing compared to the modeled values before sunrise in this region.

GEOSCCM model comparison

Antarctic ice sheet model comparison with uncurated geological constraints shows that higher spatial resolution improves deglacial reconstructions

Accurately reconstructing past changes to the shape and volume of the Antarctic ice sheet relies on the use of physically based and thus internally consistent ice sheet modeling, benchmarked against spatially limited geologic data. The challenge in model benchmarking against geologic data is diagnosing whether model-data misfits are the result of an inadequate model, inherently noisy or biased geologic data, and/or incorrect association between modeled quantities and geologic observations. In this work we address this challenge by (i) the development and use of a new model-data evaluation framework applied to an uncurated data set of geologic constraints, and (ii) nested high-spatial-resolution modeling designed to test the hypothesis that model resolution is an important limitation in matching geologic data. While previous approaches to model benchmarking employed highly curated datasets, our approach applies an automated screening and quality control algorithm to an uncurated public dataset of geochronological observations (specifically, cosmogenic-nuclide exposure-age measurements from glacial deposits in ice-free areas). This optimizes data utilization by including more geological constraints, reduces potential interpretive bias, and allows unsupervised assimilation of new data as they are collected. We also incorporate a nested model framework in which high-resolution domains are downscaled from a continent-wide ice sheet model. We highlight the application of this framework by applying these methods to a small ensemble of deglacial ice-sheet model simulations, and demonstrate that the nested approach improves the ability of model simulations to match exposure age data collected from areas of complex topography and ice flow. We develop a range of diagnostic model-data comparison metrics to provide more insight into model performance than possible from a single-valued misfit statistic, showing that different metrics capture different aspects of ice sheet deflation.

Geosciences

Magnetospheric substorm models - Comparison with neutral sheet magnetic field observations

Four models for geomagnetic substorms, a quiet tail model, and models incorporating structural effects of the tail are examined for consistency with magnetic-field data during satellite crossings of the tail neutral sheet/plasma sheet. For this data the tearing mode instability model is always consistent, and inward moving distant neutral line is sometimes consistent, quasi-steady reconnection with slow shock and intermediate wave structure and locally quiet tail rarely consistent, and an outward propagating rarefaction wave is never consistent with the magnetic observations. In several cases structural effects of the tail are consistent with key features of the magnetic signatures.

Speiser, T. W.

The GEOS Chemistry Climate Model: Comparisons to Satellite Data

The Goddard Earth Observing System Chemistry Climate Model (GEOS CCM) has been developed by combining the atmospheric chemistry and transport modules developed over the years at Goddard and the GEOS general circulation model, also developed at Goddard. We will compare model simulations of ozone, and the minor constituents that affect ozone, for the period around 1980 with newly released revised data from the Limb Infrared Monitor of the Stratosphere (LIMS) instrument on Nimbus 4. We will also compare model simulations for the period of the early 2000s with the data from the Microwave Limb Sounder (MLS) and the High Resolution Dynamic Limb Sounder (HRDLS) on the Aura satellite. We will use these comparisons to examine the performance of the model for the present atmosphere and for the change that has occurred during the last 2 decades of ozone loss due to chlorine and bromine compounds released from chlorofluorocarbons and halons.

Stolarski, Richard S.

A Model-Model and Data-Model Comparison for the Early Eocene Hydrological Cycle

A range of proxy observations have recently provided constraints on how Earth's hydrological cycle responded to early Eocene climatic changes. However, comparisons of proxy data to general circulation model (GCM) simulated hydrology are limited and inter-model variability remains poorly characterised. In this work, we undertake an intercomparison of GCM-derived precipitation and P - E distributions within the extended EoMIP ensemble (Eocene Modelling Intercomparison Project; Lunt et al., 2012), which includes previously published early Eocene simulations performed using five GCMs differing in boundary conditions, model structure, and precipitation-relevant parameterisation schemes. We show that an intensified hydrological cycle, manifested in enhanced global precipitation and evaporation rates, is simulated for all Eocene simulations relative to the preindustrial conditions. This is primarily due to elevated atmospheric paleo-CO2, resulting in elevated temperatures, although the effects of differences in paleogeography and ice sheets are also important in some models. For a given CO2 level, globally averaged precipitation rates vary widely between models, largely arising from different simulated surface air temperatures. Models with a similar global sensitivity of precipitation rate to temperature (dP=dT ) display different regional precipitation responses for a given temperature change. Regions that are particularly sensitive to model choice include the South Pacific, tropical Africa, and the Peri-Tethys, which may represent targets for future proxy acquisition. A comparison of early and middle Eocene leaf-fossil-derived precipitation estimates with the GCM output illustrates that GCMs generally underestimate precipitation rates at high latitudes, although a possible seasonal bias of the proxies cannot be excluded. Models which warm these regions, either via elevated CO2 or by varying poorly constrained model parameter values, are most successful in simulating a match with geologic data. Further data from low-latitude regions and better constraints on early Eocene CO2 are now required to discriminate between these model simulations given the large error bars on paleoprecipitation estimates. Given the clear differences between simulated precipitation distributions within the ensemble, our results suggest that paleohydrological data offer an independent means by which to evaluate model skill for warm climates.

Boundary conditions

Modeling aerosol bolus inhalations in the human lung with the multiple path particle deposition model: Comparison with experimental data

Existing one-dimensional (1D) models of aerosol dosimetry often ignore mixing mechanisms of inhaled aerosols during their transport in the lung. This mixing or aerosol dispersion results from different physical mechanisms in different regions of the lung. It is a higher order effect, which cannot be directly captured in 1D modeling approaches, and thus is sometimes modeled as a diffusive process. Here, in this study, we improved our recently developed alveolar mixing module incorporated in the multiple path particle dosimetry model (MPPD) to account for flow irreversibility and particle trapping in the alveolar spaces, as well as mixing occurring in the tracheobronchial region. This new version of MPPD was coupled with CFPD-based predictions of aerosol bolus dispersion in the oral airway. The model was used to predict the deposition, dispersion, and mode shift of aerosol bolus inhaled at different penetration depths within the lung for breathing patterns and particle size matching those used in a previous experimental study (Darquenne et al., 2016). Even though a quite simplified approach was used, the computations appear to describe subject-specific and test-specific experimental data reasonably well. The proposed combined dispersion-deposition model can be a useful tool for targeted drug delivery and also for exposure health risk assessment.

MPPD

A critical examination of the dendrite growth models Comparison of theory with experimental data

Three dendrite growth models for directionally solidified succinonitrile-acetone, succinonitrile-salol, aluminum-copper, and lead-paladium alloys are evaluated. The characteristics of the Burden and Hunt (1974) model, the Laxmanan (1985) model, and the Trivedi (1980) model are described. The dendrite tip temperature, tip radius, liquid composition, and primary arm spacing for the alloys are analyzed in terms of growth speed, alloy composition, and temperature gradient. It is observed that the Burden and Hunt model accurately predicts the proper behavior of the parameters, but does not provide good quantitative predictions. A good fit between the experimental data and the Trivedi and Laxmanan models is detected. The advantages of the Trivedi marginal stability analysis and the Laxmanan minimum dendrite tip undercooling approaches are discussed.

Tewari, S. N.

Infrared cooling rate calculations in operational general circulation models - Comparisons with benchmark computations

The performance of several parameterized models is described with respect to numerical prediction and climate research at GFDL, NCAR, and GISS. The radiation codes of the models were compared to benchmark calculations and other codes for the intercomparison of radiation codes in climate models (ICRCCM). Cooling rates and fluxes calculated from the models are examined in terms of their application to established general circulation models (GCMs) from the three research institutions. The newest radiation parameterization techniques show the most significant agreement with the benchmark line-by-line (LBL) results. The LBL cooling rates correspond to cooling rate profiles from the models, but the parameterization of the water vapor continuum demonstrates uncertain results. These uncertainties affect the understanding of some lower tropospheric cooling, and therefore more accurate parameterization of the water vapor continuum, as well as the weaker absorption bands of CO2 and O3 is recommended.

Kiehl, J. T.

Turbulence Model Comparisons for a High-Speed Aircraft

Four turbulence models are described and evaluated for transonic flows over the High-Speed Research/industry baseline configuration known as Reference H by using the thin-layer, upwind, Navier-Stokes solver known as CFL3D. The turbulence models studied are the equilibrium model of Baldwin-Lomax (B-L) with the Degani-Schiff (D-S) modifications, the one-equation Baldwin-Barth (B-B) model, the one-equation Spalart-Allmaras (S-A) model, and Menter's two-equation Shear Stress Transport (SST) model. The flow conditions, which correspond to tests performed in the National Transonic Facility (NTF) at Langley Research Center, are a Mach number of 0.90 and a Reynolds number of 30 x 10 (exp. 6) based on mean aerodynamic chord for angles of attack of 1 deg., 5 deg., and 10 deg. The effects of grid topology and the representation of the actual wind tunnel model geometry are also investigated. Computed forces and surface pressures compare reasonably well with the experimental data for all four turbulence models.

Rivers, Melissa B.

Radicals and Reservoirs in the GMI Chemistry and Transport Model: Comparison to Measurements

The most important use of atmospheric chemistry and transport models is to predict the future composition of the atmosphere. The amounts of gases like chlorofluorcarbons, methyl bromide, nitrous oxide and methane are changing and the stratospheric ozone layer will change because these gases are changing. Methyl bromide, nitrous oxide and methane all have natural sources, and also change because of human activity. Chlorofluorcarbons are man-made gases; these are known to decrease stratospheric ozone and future production is banned. They are long-lived gases, and many decades will pass before they are insignificant in the atmosphere. The models are used to predict changes in ozone and other gases; this is a straightforward application. The models must be also tested using observations for the present day atmosphere. This is a challenging task, because the model contains more than 50 species and more than 150 chemical reactions. Data from satellites, ground stations, aircraft and balloons are used to evaluate the model. Different models that are used in international assessments produce different results; in the most recent assessment some predict that ozone will return to 1980 levels by 2025 and others predict that this will not happen until 2050. Since all the parts of the models are conceptually the same, there must be differences in implementation that produce these differences, This work takes a single model, two different sets of winds and temperatures, and repeats the same prediction for the future. Here we compare the results for these two simulations with many observations. The purpose is to identify differences in the model results for the present atmosphere that will lead to different predictions. This sort of controlled comparison will reduce uncertainty in the predictions for stratospheric ozone.

Douglas, Anne R.

A cometary hydrogen model - Comparison with OGO-5 measurements of Comet Bennett /1970 II/

A model is constructed for the hydrogen cloud of Comet Bennett (1970 II) based on highly sensitive observations of its Lyman alpha emission by a photometer on board OGO-5 and taking into account the cometary motion, field gradients, solar L-alpha profile, and finite lifetime of the H atoms along their trajectories. The solar L-alpha flux is determined independently of instrumental calibration using the strong curvature of the hydrogen cloud in the orbital plane of the comet, and the cometary production rate of hydrogen atoms is calculated. The combination of two equally weighted Maxwellian velocity distributions with mean velocities of 7 and 21 km/sec is found to match the photometer scans across the comet better than any single Maxwellian distribution. A complete L-alpha isophote map is presented for the model hydrogen cloud on Mar. 20, 1970.

Keller, H. U.

Multi-Layer Arctic Mixed-Phase Clouds Simulated by a Cloud-Resolving Model: Comparison with ARM Observations and Sensitivity Experiments

A cloud-resolving model (CRM) is used to simulate the multiple-layer mixed-phase stratiform (MPS) clouds that occurred during a three-and-a-half day subperiod of the Department of Energy-Atmospheric Radiation Measurement Program s Mixed-Phase Arctic Cloud Experiment (M-PACE). The CRM is implemented with an advanced two-moment microphysics scheme, a state-of-the-art radiative transfer scheme, and a complicated third-order turbulence closure. Concurrent meteorological, aerosol, and ice nucleus measurements are used to initialize the CRM. The CRM is prescribed by time-varying large-scale advective tendencies of temperature and moisture and surface turbulent fluxes of sensible and latent heat. The CRM reproduces the occurrences of the single- and double-layer MPS clouds as revealed by the M-PACE observations. However, the simulated first cloud layer is lower and the second cloud layer thicker compared to observations. The magnitude of the simulated liquid water path agrees with that observed, but its temporal variation is more pronounced than that observed. As in an earlier study of single-layer cloud, the CRM also captures the major characteristics in the vertical distributions and temporal variations of liquid water content (LWC), total ice water content (IWC), droplet number concentration and ice crystal number concentration (nis) as suggested by the aircraft observations. However, the simulated mean values differ significantly from the observed. The magnitude of nis is especially underestimated by one order of magnitude. Sensitivity experiments suggest that the lower cloud layer is closely related to the surface fluxes of sensible and latent heat; the upper cloud layer is probably initialized by the large-scale advective cooling/moistening and maintained through the strong longwave (LW) radiative cooling near the cloud top which enhances the dynamical circulation; artificially turning off all ice-phase microphysical processes results in an increase in LWP by a factor of 3 due to interactions between the excessive LW radiative cooling and extra cloud water; heating caused by phase change of hydrometeors could affect the LWC and cloud top height by partially canceling out the LW radiative cooling. It is further shown that the resolved dynamical circulation appears to contribute more greatly to the evolution of the MPS cloud layers than the parameterized subgrid-scale circulation.

Luo, Yali

Calibration of radiation codes in climate models: Comparison of calculations with observations from the SPECtral Radiation Experiment (SPECTRE)

The primary goal of SPECTRE is to: close the loopholes by which longwave radiation models have eluded incisive comparisons with measurements. Likewise, the experimental approach was quite simple in concept, namely: accurately measure the zenith infrared radiance at high spectral resolution while simultaneously profiling the radiatively important atmospheric properties with conventional and remote sensing devices. The field phase of SPECTRE was carried out as part of FIRE Cirrus II, and detailed spectra of the down welling radiance were obtained by several interferometers simultaneous to the measurement of the optical properties of the atmosphere. We are now well along in the process of analyzing the data and calibrating radiation codes so that they may be used more effectively in climate related studies. The calibration is being done with models ranging from the most detailed (line-by-line) to the broad-band parameterizations used in climate models. This paper summarizes our progress in the calibration for clear-sky conditions. When this stage is completed, we will move on to the calibration for cirrus conditions.

Ellingson, R. G.