Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model comparison.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

Crop weather models of barley and spring wheat yield for agrophysical units in North Dakota

Models based on multiple regression were developed to estimate barley yield and spring wheat yield from weather data for Agrophysical units(APU) in North Dakota. The predictor variables are derived from monthly average temperature and monthly total precipitation data at meteorological stations in the cooperative network. The models are similar in form to the previous models developed for Crop Reporting Districts (CRD). The trends and derived variables were the same and the approach to select the significant predictors was similar to that used in developing the CRD models. The APU models show sight improvements in some of the statistics of the models, e.g., explained variation. These models are to be independently evaluated and compared to the previously evaluated CRD models. The comparison will indicate the preferred model area for this application, i.e., APU or CRD.

Leduc, S.↗

Near-wall modeling of the dissipation rate equation

Near-wall modeling of the dissipation rate equation is investigated and its asymptotic behavior is studied in detail using a k-epsilon model. It is found that all existing modeled dissipation rate equations predict an incorrect behavior for the dissipation rate near a wall. An improvement is proposed and the resulting near-wall dissipation rate distribution is found to be similar to that given by numerical simulation data. To further validate the improved k-epsilon model, it is used to calculate flat-plate turbulent boundary-layer flows at high- as well as low-turbulence Reynolds numbers, and the results are compared with measurements, numerical simulation data, and the calculations of three different two-equation models. These comparisons show that all the models tested give essentially the same flow properties away from the wall; significant differences only occur in a region very close to the wall. In this region, the calculations of the improved k-epsilon model are in better agreement with measurements and numerical simulation data. In particular, the modeled distribution of the dissipation rate is significantly improved and a maximum is predicted at the wall instead of away from the wall. Furthermore, the improved k-epsilon model is found to be the most asymptotically consistent among the four different two-equation models examined.

So, R. M. C.↗

Microwave Signatures of Snow on Sea Ice: Modeling

Accurate knowledge of snow-depth distribution over sea ice is critical for polar climate studies. Current snow-depth-over-sea-ice retrieval algorithms do not sufficiently account for variations in snow and ice physical properties that can affect the accuracy of retrievals. For this reason, airborne microwave observations were coordinated with ground-based measurements of snow depth and snow properties in the vicinity of Barrow, AK, in March 2003. In this paper, the effects of snowpack properties and ice conditions on microwave signatures are examined using detailed surface-based measurements and airborne observations in conjunction with a thermal microwave-emission model. A comparison of the Microwave Emission Model of Layered Snowpacks (MEMLS) simulations with detailed snowpack and ice data from stakes along the Elson Lagoon and the Beaufort Sea and ra- 'diometer data taken from low-level flights using a Polarimetric Scanning Radiometer (PSR-A) shows that MEMLS can be used to simulate snow on sea ice and is a useful tool for understanding the limitations of the snow-depth algorithm. Analysis of radiance data taken over the Elson Lagoon and the Beaufort Sea using MEMLS suggests that the radiometric differences between the two locations are due to the differences in sea-ice emissivity. Furthermore, measured brightness temperatures suggest that the current snow-depth retrieval algorithm is sufficient for areas of smooth first-year sea ice, whereas new algorithm coefficients are needed for rough first-year sea ice. Snowpack grain size and density remain an unresolved issue for snow-depth retrievals using passive-microwave radiances.

Powell, D. C.↗

Estimating Model Prediction Error: Should You Treat Predictions as Fixed or Random?

Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEP fixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEP uncertain( X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEP uncertain (X) can be estimated using a random effects ANOVA. It is argued that MSEP uncertain (X) is the more informative uncertainty criterion, because it is specific to each prediction situation.

model structure uncertainty↗

VESIcal Part I: An open-source thermodynamic model engine for mixed volatile (H2O-CO2) solubility in silicate melts

Thermodynamics has been fundamental to the interpretation of geologic data and modeling of geologic systems for decades. However, more recent advancements in computational capabilities and a marked increase in researchers’ accessibility to computing tools has outpaced the functionality and extensibility of currently available modeling tools. Here we present VESIcal (Volatile Equilibria and Saturation Identification calculator): the first comprehensive modeling tool for H 2 O, CO 2 , and mixed (H 2 O-CO 2 ) solubility in silicate melts that: a) allows users access to seven commonly used models, plus easy inter-comparison between models; b) provides universal functionality for all models (e.g., functions for calculating saturation pressures, degassing paths, etc.); c) can process large datasets (1,000’s of samples) automatically; d) can output computed data into an excel spreadsheet for simple post-modeling analysis; e) integrates advanced plotting capabilities directly within the tool; and f) provides all of these within the framework of a python library, making the tool extensible by the user and allowing any of the model functions to be incorporated into any other code capable of calling python. The tool is presented within this manuscript, which is a Jupyter notebook containing worked examples accessible to python users with a range of skill levels. The basic functions of VESIcal can also be access via a web app (https://vesical.anvil.app). The VESIcal python library is open-source and available for download at https://github.com/kaylai/VESIcal.

K. Iacovino↗

VESIcal: An Open-source Thermodynamic Model Engine for Mixed Volatile (H2O-CO2) Solubility in Silicate Melts

Modeling the solubility of volatiles in silicate melts is fundamental to the interpretation of volcanic systems and has implications for magma dynamics, eruption style, and material transport between the mantle, crust, and atmosphere. Recent advancements in computational capabilities and access to computing tools has outpaced the functionality and extensibility of previously available modeling platforms. Here we present VESIcal (Volatile Equilibria and Saturation Index calculator), the first comprehensive modeling tool for H2O, CO2, and mixed (H2O-CO2) solubility in silicate melts that: a) allows users access to seven popular models, with easy inter-comparison between models; b) provides universal functionality for all models (e.g., functions for calculating saturation pressures, degassing paths, etc.); c) can process large datasets (1,000’s of samples) automatically; d) can output computed data into an Excel spreadsheet or CSV file for post-modeling analysis; e) integrates plotting capabilities directly within the tool; and f) provides all of this within the framework of a python library, making the tool extensible by the user and allowing any of the model functions to be incorporated into any other code capable of calling python.Here we will provide a demonstration of VESIcal and its capabilities with applications to various volcanic processes affected by volatiles. VESIcal represents the first tool capable of directly comparing multiple solubility models and equations of state. We find that commonly used models predict surprisingly different volatile solubilities, particularly for pure CO2 or mixed CO2-H2O fluids. Even for melt compositions that are well represented in the calibration datasets of multiple models (e.g., MORBs), calculated solubilities for pure CO2 and pure H2O can deviate from one another by factors of >2 leading to 2x deviations in calculated saturation pressures (e.g., 5 to 10 kbar). The solubility of CO2 predicted by different rhyolitic models also differs substantially, overwhelming other sources of uncertainty such as analytical errors on measurements of volatile contents or uncertainties in crustal density profiles. This highlights the importance of model choice when drawing geological conclusions based on volatiles in magmas.

Kayla Iacovino↗

Measurements of the time-dependent cosmic-ray Sun shadow with seven years of IceCube data: Comparison with the Solar cycle and magnetic field models

Observations of the time-dependent cosmic-ray Sun shadow have been proven as a valuable diagnostic for the assessment of solar magnetic field models. Here, seven years of IceCube data are compared to solar activity and solar magnetic field models. A quantitative comparison of solar magnetic field models with IceCube data on the event rate level is performed for the first time. Additionally, a first energy-dependent analysis is presented and compared to recent predictions. We use seven years of IceCube data for the moon and the Sun and compare them to simulations on data rate level. The simulations are performed for the geometrical shadow hypothesis for the moon and the Sun and for a cosmic-ray propagation model governed by the solar magnetic field for the case of the Sun. We find that a linearly decreasing relationship between Sun shadow strength and solar activity is preferred over a constant relationship at the 6.4σ level. We test two commonly used models of the coronal magnetic field, both combined with a Parker spiral, by modeling cosmic-ray propagation in the solar magnetic field. Both models predict a weakening of the shadow in times of high solar activity as it is also visible in the data. We find tensions with the data on the order of 3σ for both models, assuming only statistical uncertainties. The magnetic field model CSSS fits the data slightly better than the PFSS model. This is generally consistent with what is found previously by the Tibet AS-γ Experiment; a deviation of the data from the two models is, however, not significant at this point. Regarding the energy dependence of the Sun shadow, we find indications that the shadowing effect increases with energy during times of high solar activity, in agreement with theoretical predictions.

79 ASTRONOMY AND ASTROPHYSICS↗

Community Coordinated Modeling Center: Addressing Needs of Operational Space Weather Forecasting

Models are key elements of space weather forecasting. The Community Coordinated Modeling Center (CCMC, http://ccmc.gsfc.nasa.gov) hosts a broad range of state-of-the-art space weather models and enables access to complex models through an unmatched automated web-based runs-on-request system. Model output comparisons with observational data carried out by a large number of CCMC users open an unprecedented mechanism for extensive model testing and broad community feedback on model performance. The CCMC also evaluates model's prediction ability as an unbiased broker and supports operational model selections. The CCMC is organizing and leading a series of community-wide projects aiming to evaluate the current state of space weather modeling, to address challenges of model-data comparisons, and to define metrics for various user s needs and requirements. Many of CCMC models are continuously running in real-time. Over the years the CCMC acquired the unique experience in developing and maintaining real-time systems. CCMC staff expertise and trusted relations with model owners enable to keep up to date with rapid advances in model development. The information gleaned from the real-time calculations is tailored to specific mission needs. Model forecasts combined with data streams from NASA and other missions are integrated into an innovative configurable data analysis and dissemination system (http://iswa.gsfc.nasa.gov) that is accessible world-wide. The talk will review the latest progress and discuss opportunities for addressing operational space weather needs in innovative and collaborative ways.

Kuznetsova, M.↗

Confronting Large‐Eddy Simulations With Stereo Camera Data by Means of Reconstructed Hemispheric Cloud Size Distributions

High-resolution hemispheric camera images at a meteorological site in western Germany are used to analyze the multi-dimensional spatial characteristics of continental cumulus cloud fields, and to evaluate Large-Eddy Simulations on this aspect. Traditional non-hemispheric cloud-detecting instruments provide additional reference data. The main model-observation comparison focuses on cloud size distributions (CSDs), employing two methods: (a) directly using three-dimensional model fields, direct CSDs, and (b) using rendered hemispheric images of the model fields as produced by a camera simulator based on path-tracing. In the latter method, both the real and rendered images are used to three-dimensionally reconstruct the cloud fields, yielding hemispheric CSDs. Advantages of hemispheric comparisons over more classic approaches include (a) fair comparisons between model and data, and (b) full use of the enhanced resolutions and hemispheric spatial coverage of the camera imagery. Basic evaluation of the simulations demonstrates good agreement on thermodynamic structure and its diurnal cycle. Cloud heights and cloud cover are intercompared between the model, camera data and other instrumentation, providing insight into their structural differences. A consistent alignment is found between the hemispheric CSDs from both the model and the cameras. Power law fits reveal structurally lower exponents in hemispheric CSDs compared to non-hemispheric CSDs, which particularly caution against directly comparing hemispheric CSDs to non-hemispheric distributions. This result is robust for sample size and fitting method. These findings inform future use of hemispheric camera systems for studying cumulus cloud field morphology and model evaluation.

54 ENVIRONMENTAL SCIENCES↗

Large-database cross-verification and validation of tokamak transport models using baselines for comparison

State-of-the-art 1D transport solvers ASTRA and TRANSP are verified, then validated across a large database of semi-randomly selected, time-dependent DIII-D discharges. Various empirical models are provided as baselines to contextualize the validation figures of merit using statistical hypothesis tests. For predicting plasma temperature profiles, no statistically significant advantage is found for the ASTRA and TRANSP simulators over a baseline empirical (two-parameter) model. For predicting stored energy, a significant advantage is found for the simulators over a baseline empirical model based on confinement time scaling. Uncertainty in the results due to diagnostic and profile fitting uncertainties is approximated and determined to be insignificant due in part to the large quantity of discharges employed in the study. Advantages are discussed for validation methodologies like this one that employ (1) large databases and (2) baselines for comparison that are specific to the intended use-case of the model.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

GIS-Based Modeling of Contaminated Soil Volumes at Multiple Sites in the Formerly Utilized Sites Remedial Action Program - 20149

The remediation of hazardous, toxic, and radioactive waste (HTRW) sites produces cost-related risks associated with the estimation of contaminated soil or debris volumes. Historical risk-management techniques include cost contingencies to cover volume uncertainties that affect project budgeting and decision-making. The Buffalo District teamed with project partners to lessen volume uncertainty and reduce project risks at multiple HTRW sites managed under the Formerly Utilized Sites Remedial Action Program (FUSRAP). Historical remedial investigations under FUSRAP commonly identified the presence of radiological material in site media, the associated human health risk, and then areas of remediation. To manage remedial execution and reduce risk, pre-design or remediation-phase sampling essentially 'chased' contamination, which was not conducive to efficient predictive budgeting derived from Feasibility Study (FS) cost analyses. The Buffalo District first optimized their approach to better understand volume uncertainty by utilizing the Argonne National Laboratory's Bayesian Approaches for Adaptive Spatial Sampling (BAASS) software [1]. BAASS processed soft data (e.g., gamma walk-over data) and spatial sampling data to estimate the lateral extent of contaminated soil irrespective of depth (i.e., gross contamination extent) and define areas of contaminant uncertainty. The software performed a binary transformation of contaminant concentrations at all sampling points based upon remedial action goals or a sum of ratios approach (i.e., clean, impacted, or range of impacts in soil). The model produced two-dimensional (horizontal) contaminant probability contours and statistical uncertainty in the sampling coverage and resulting contaminant extents. This method was translated vertically by partitioning the sampling data into depth brackets that produced a stacked representation of contaminant extents and uncertainty in the subsurface (i.e., similar to construction lifts). The results commonly led to a better understanding of project uncertainty and the need for sampling strategies that produce high-confidence soil volumes, which control costs. The BAASS-based delineations were eventually replaced by Empirical Bayesian Kriging (EBK) methods available in ArcGIS Spatial or 3D Analysts [2]. The EBK method calculates contaminant probability zones derived from user-controlled semivariograms of the spatial datasets. The resulting probability zones (e.g., 50% or 80% of contaminant probability) represent the two-dimensional surface delineation of the overall horizontal remedial area, similarly to BAASS. However, unlike BAASS, the vertical sampling data within these probability zones became vertical control points to contour a subterranean surface that connects subsurface points to the land-surface delineations of contamination. The resulting representation of horizontal and vertical impacts within an enclosed envelop (volume) of soil included uncertainty distributions that are used to plan uncertainty-reduction sampling. These data-driven and math-based models of three-dimensional sampling results produced well-bounded remedial volumes for project planning and better uncertainty predictions during project budgeting. The EBK method was applied to several FUSRAP sites managed by the Buffalo District and compared to less rigorously modeled sites previously remediated by the District. The comparison of modeled to actual remediated volumes provide a basis for validating the volume-estimation method. This comparison is important to ensure modeled volumes match physical boundaries of site remediation. FUSRAP sites with denser investigative sampling and lesser volume uncertainty proved useful in remedial planning and contracting. The Buffalo District noted that historical sites with sparser sampling arrays had greater disparity between estimated volumes and final remedial volumes. The benefit achieved over the cost of detailed soil sampling appears positive for FUSRAP projects, especially where impacts vary widely and appear unbounded by investigation-phase sampling. The subsequent Empirical Bayesian Kriging of contamination coupled with vertical contouring for soil estimations reduces uncertainty in soil volumes or indicates where sampling is required to reduce uncertainty, which together optimize remedial planning and budgeting. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Earth Global Reference Atmospheric Model (GRAM) Overview and Comparison to Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2)

Earth-GRAM (Earth-Global Reference Atmospheric Model) Overview: Provides monthly statistics at any point in the atmosphere; Monthly, geographic, altitude variation; Current Version - Earth-GRAM 2016, C++; Output Includes - pressure, density, temperature, horizontal and vertical winds, speed of sound, atmospheric constituents; Used by engineering community to create atmospheric dispersions at a rapid runtime; Not a forecast model. MERRA-2 (Modern-Era Retrospective Analysis for Research and Applications, Version 2) Background: Developed by NASA Goddard Modelling and Assimilation Office; Horizontal Resolution: 0.625 degrees by 0.5 degrees longitude-by-latitude grid (NCEP (National Centers for Environmental Prediction) reanalysis I vs. 2.5 degrees by 2.5 degrees currently used in Earth-GRAM); Vertical resolution: 72 model layers or interpolated to 42 pressure levels to 0.1 hectopascals (hPa) (NCEP reanalysis I, surface to 10hPa at 17 pressure levels).

White, Patrick W.↗

Comparison of gas dynamic model with steady solar wind flow around Venus

A gas dynamic model for solar wind flow around Venus has been compared with Pioneer Venus orbiter plasma analyzer measurements from times when the solar wind flow seemed steadiest. The comparisons were made near the terminator. When the observed and model bow shock locations are matched, the model agrees fairly well with the observed parameters: the components of the flow velocity and magnetic field, and the proton number density and isotropic temperature. However, the Mach numbers required to fit the observed bow shock locations are less than 2/3 those estimated from the measured parameters of the free-stream flow, because the bow shock locations (near the terminator) are farther from Venus than expected. Sometimes the measured flow speeds appear to be retarded near the ionopause.

Mihalov, J. D.↗

Using Atmospheric Trace Gas Vertical Profiles to Evaluate Model Fluxes: A Case Study of Arctic-Cap Observations and Geos Simulations for the ABoVE Domain

Accurate estimates of carbon–climate feedbacks require an independent means for evaluating surface flux models at regional scales. The altitude-integrated enhancement (AIE) derived from the Arctic Carbon Atmospheric Profiles (Arctic-CAP) project demonstrates the utility of this bulk quantity for surface flux model evaluation. This bulk quantity leverages background mole fraction values from the middle free troposphere, is agnostic to uncertainties in boundary layer height, and can be derived from model estimates of mole fractions and vertical gradients. To demonstrate the utility of the bulk quantity, six airborne profiling surveys of atmospheric carbon dioxide (CO2), methane (CH4), and carbon monoxide (CO) throughout Alaska and northwestern Canada between April and November 2017 were completed as part of NASA’s Arctic–Boreal Vulnerability Experiment (ABoVE). The Arctic-CAP sampling strategy involved acquiring vertical profiles of CO2, CH4, and CO from the surface to 5 km altitude at 25 sites around the ABoVE domain on a 4- to 6-week time interval. All Arctic-CAP measurements were compared to a global simulation using the Goddard Earth Observing System (GEOS) modeling system. Comparisons of the AIE bulk quantity from aircraft observations and GEOS simulations of atmospheric CO2, CH4, and CO highlight the fidelity of the modeled surface fluxes. The model–data comparison over the ABoVE domain reveals that while current state-of-the-art models and flux estimates are able to capture broad-scale spatial and temporal patterns in near-surface CO2 and CH4 concentrations, more work is needed to resolve fine-scale flux features that are captured in CO observations

CO2↗

Coronal Physics and the Chandra Emission Line Project

With the launch of the Chandra X-ray Observatory, high resolution X-ray spectroscopy of cosmic sources has begun. Early, deep observations of three stellar coronal sources will provide not only invaluable calibration data, but will also give us benchmarks for plasma spectral modeling codes. These codes are to interpret data from stellar coronae, galaxies and clusters of galaxies. supernova remnants and other astrophysical sources, but they have been called into question in recent years as problems with understanding moderate resolution ASCA and EUVE data have arisen. The Emission Line Project is a collaborative effort to improve the models, with Phase 1 being the comparison of models with observed spectra of Capella, Procyon, and HR, 1099. Goals of these comparisons are (1) to determine and verify accurate and robust diagnostics and (2) to identify and prioritize issues in fundamental spectroscopy which will require further theoretical and/or laboratory work. A critical issue in exploiting the coronal data for these purposes is to understand the extent to which common simplifying assumptions (coronal equilibrium, time-independence, negligible optical depth) apply. We will discuss recent advances in our understanding of stellar coronae in this context.

Brickhouse, Nancy↗

Coronal Physics and the Chandra Emission Line Project

With the launch of the Chandra X-ray Observatory, high resolution X-ray spectroscopy of cosmic sources has begun. Early, deep observations of three stellar coronal sources Capella, Procyon, and HR 1099 are providing not only invaluable calibration data, but also benchmarks for plasma spectral models. These models are needed to interpret data from stellar coronae, galaxies and clusters of galaxies, supernova, remnants and other astrophysical sources. They have been called into question in recent years as problems with understanding low resolution ASCA and moderate resolution Extreme Ultraviolet Explorer Satellite (EUVE) data have arisen. The Emission Line Project is a collaborative effort, to improve the models, with Phase I being the comparison of models with observed spectra of Capella, Procyon, and HR 1099. Goals of these comparisons are (1) to determine and verify accurate and robust diagnostics and (2) to identify and prioritize issues in fundamental spectroscopy which will require further theoretical and/or laboratory work. A critical issue in exploiting the coronal data for these purposes is to understand the extent, to which common simplifying assumptions (coronal equilibrium, negligible optical depth) apply. We will discuss recent, advances in our understanding of stellar coronae, in this context.

Brickhouse, N. S.↗

Automated rendezvous and docking with video imagery

For rendezvous and docking, assessing and tracking relative orientation is necessary within a minimum approach distance. Special target light patterns have previously been considered for use with video sensors for ease of determining relative orientation. A generalization of those approaches is addressed. At certain ranges, the entire structure of the target vehicle constitutes an acceptable target; at closer ranges, substructures will suffice. Acting on the same principle as the human intelligence, these structures can be compared with a memory model to assess the relative orientation and range. Models for comparison are constructed from a CAD facet model and current imagery. This approach requires fast image handling, projection, and comparison techniques which rely on rapidly developing parallel processing technology. Relative orientation and range assessment consists of successful comparison of the perceived target aspect with a known aspect. Generating a known projection from a model within required times, say subsecond times, is only now approaching feasibility. With this capability, rates of comparison used by the human brain can be approached and arbitrary known structures can be compared in reasonable times. Future space programs will have access to powerful computation devices which far exceed even this capability. For example, the possibility will exist to assess unknown structures and then control rendezvous and docking, all at very fast rates. The first step which has the current utility, namely applying this to known structures, is taken.

Rodgers, Mike↗

Comparison of Two Statistical Models for Low Boom Dose-response Relationships with Correlated Responses

This study compares two statistical models to construct summary dose-response curves for low boom community noise surveys. Data from two NASA field surveys are used that consist of multiple responses per survey participant. These data require an approach that accounts for the correlation among repeated annoyance observations from the same participant. A multilevel model accounts for the correlation by allowing estimated parameters to vary with each survey participant. On the other hand, a population average model utilizes generalized estimating equations and accounts for the correlation via a userspecified within-subject correlation structure. A visual comparison of the dose-response curves for these two methods reveals similar results. When comparing specific points along the summary curves, the multilevel model yields more precise confidence bounds than the population average model. The similarity between the summary curves derived from each model lends validity to both approaches for approximating a population representative summary curve, though modeling assumptions may lend favor to the multilevel logistic modeling approach over the population average model.

dose-response↗