SEARCH · Engineering Papers

Results for “uncertainty estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

NASA NTRS2007

Technical Evaluation Report for Symposium AVT-147: Computational Uncertainty in Military Vehicle Design

The complexity of modern military systems, as well as the cost and difficulty associated with experimentally verifying system and subsystem design makes the use of high-fidelity based simulation a future alternative for design and development. The predictive ability of such simulations such as computational fluid dynamics (CFD) and computational structural mechanics (CSM) have matured significantly. However, for numerical simulations to be used with confidence in design and development, quantitative measures of uncertainty must be available. The AVT 147 Symposium has been established to compile state-of-the art methods of assessing computational uncertainty, to identify future research and development needs associated with these methods, and to present examples of how these needs are being addressed and how the methods are being applied. Papers were solicited that address uncertainty estimation associated with high fidelity, physics-based simulations. The solicitation included papers that identify sources of error and uncertainty in numerical simulation from either the industry perspective or from the disciplinary or cross-disciplinary research perspective. Examples of the industry perspective were to include how computational uncertainty methods are used to reduce system risk in various stages of design or development.

Radespiel, Rolf↗

NASA NTRS2018

Physics-Based Approach to Predict the Solar Activity Cycles

Observations of the complex highly non-linear dynamics of global turbulent flows and magnetic fields are currently available only from Earth-side observations. Recent progress in helioseismology has provided us some additional information about the subsurface dynamics, but its relation to the magnetic field evolution is not yet understood. These limitations cause uncertainties that are difficult take into account, and perform proper calibration of dynamo models. The current dynamo models have also uncertainties due to the complicated turbulent physics of magnetic field generation, transport and dissipation. Because of the uncertainties in both observations and theory, the data assimilation approach is natural way for the solar cycle prediction and estimating uncertainties of this prediction. I will discuss the prediction results for the upcoming Solar Cycle 25 and their uncertainties and affect of Ensemble Kalman Filter parameters to resulting predictions.

Physics-Based↗

NASA NTRS2004

Path following using visual odometry for Mars Rover in high-slip environments.

An architecture for autonomous operation of Mars rovers in high slip environments has been designed, implemented, and tested. This architecture is composed of several key technologies that enable the rover to accurately follow a designated path, compensate for slippage, and reach intended goals independent of the terrain over which it is traversing (within the mechanical constraints of the mobility system). These technologies include: visual odometry, full vehicle kinematics, a Kalman filter, and a slop compensation/path follower. Visual odometry tracks distinctive scene features in stereo imagery to estimate rover motion between successively acquired stereo image pairs using a maximum likelihood motion estimation algorithm. The full vehicle kinematics for a rocker-bogie suspension system estimates motion, with a no-slip assumption, by measuring wheel, rates, and rocker, bogie, and steering angles. The Kalman filter merges data from an Inertial Measurement Unit (IMU) and visual odometry. This merged estimate is then compared to the kinematic estimate to determining (tracking into account estimate uncertainties) if and how much slippage has occurred then a slip vector is calculated by differencing the current Kalman filter estimate from the kinematic estimate. This slip vector is then used, in conjunction with the inverse kinematics, to determine the necessary wheel velocities and steering angles to compensate for slip and follow the desired path.

Roumeliotis, Stergios I.↗

NASA NTRS1977

Flash photolysis resonance fluorescence investigation of the reaction of Cl/2P/ atoms with ClONO2

Rate constants for the removal of Cl(2P) atoms by homogeneous gas phase reaction with ClONO2 were measured using the flash photolysis resonance fluorescence technique at 224, 250, and 273 K. The values obtained have been used to derive the above Arrhenius equation. The uncertainties expressed are 95% confidence limits obtained using the statistical standard deviation of the individual rate constants plus a 15% additional estimated uncertainty attributed to difficulties in chlorine nitrate concentration measurements. The results indicate that destruction of chlorine nitrate by reaction with chlorine atoms is perhaps the least important of the atmospheric reactive channels, and is at least three orders of magnitude slower than calculated photodissociation rates at all stratospheric altitudes.

Kurylo, M. J.↗

NASA NTRS1999

Satellite Data Assimilation

Satellite altimetry provides the only routine observation of a dynamic variable of the global ocean. For instance, measurements from the TOPEX/POSEIDON altimeter have provided dramatic basin-wide images of the space-time evolution of sea level associated with the 1997-98 El Nino event. The nature of large-scale ocean circulation is being studied that underlies such sea level changes measured by satellite altimetry. To first approximation, properties of large-scale (order 1000 km and larger) sea level variability is latitudinally dependent. An analysis using a general circulation model shows that sea level changes are largely due to wind-driven baroclinic (depth dependent) circulation in the tropics (within 20 degrees of the equator), but are primarily due to the expansion and contraction of near surface water in temperate latitudes (between 20 deg. and 40 deg.) forced by seasonal heating and cooling. In contrast, wind-driven barotropic (depth independent) circulation dominates sea level variability in high latitudes (40 deg. and higher) characterized by periods that are as short as a few days. The presence of such inhomogeneity and the significance of high-frequency, large-scale sea level changes had not been fully recognized prior to this study, and are summarized in Fukumori et al. Numerical models provide theoretical relationships among properties that can be inverted using observations so as to estimate the entire state of the ocean, including properties that are otherwise difficult to measure remotely. The process is data assimilation. An approximate Kalman filter and smoother have been devised to assimilate three years of TOPEX/POSEIDON sea level data into a global ocean general circulation model. The figure below demonstrates the skill of the assimilation, and shows the altimeter assimilated estimate being in closer agreement than the simulation is with independent in situ measurements of subsur ace temperature and velocity, consistent with formal uncertainty estimates. Results from this study have been summarized and submitted for publication. The study demonstrates the feasibility of global ocean data assimilation and illustrates applications in monitoring and understanding of processes controlling the evolution of the ocean. Additional information is contained in the original.

Fukumori, Ichiro↗

NASA NTRS2011

Evaluation and Windspeed Dependence of MODIS Aerosol Retrievals Over Open Ocean

The Maritime Aerosol Network (MAN) data set provides high quality ground-truth to validate the MODIS aerosol product over open ocean. Prior validation of the ocean aerosol product has been limited to coastal and island sites. Comparing MODIS Collection 5 ocean aerosol retrieval products with collocated MAN measurements from ships shows that MODIS is meeting the pre-launch uncertainty estimates for aerosol optical depth (AOD) with 64% and 67% of retrievals at 550 nm, and 74% and 78% of retrievals at 870 nm, falling within expected uncertainty for Terra and Aqua, respectively. Angstrom Exponent comparisons show a high correlation between MODIS retrievals and shipboard measurements (R= 0.85 Terra, 0.83 Aqua), although the MODIS aerosol algorithm tends to underestimate particle size for large particles and overestimate size for small particles, as seen in earlier Collections. Prior analysis noted an offset between Terra and Aqua ocean AOD, without concluding which sensor was more accurate. The simple linear regression reported here, is consistent with other anecdotal evidence that Aqua agreement with AERONET is marginally better. However we cannot claim based on the current study that the better Aqua comparison is statistically significant. Systematic increase of error as a function of wind speed is noted in both Terra and Aqua retrievals. This wind speed dependency enters the retrieval when winds deviate from the 6 m/s value assumed in the rough ocean surface and white cap parameterizations. Wind speed dependency in the results can be mitigated by using auxiliary NCEP wind speed information in the retrieval process.

Kleidman, Richard G.↗

NASA NTRS2004

Accuracy Assessments and Validation of an Expanded UV Irradiance Database from Satellite Total Ozone Mapping Spectrometer (TOMS)

The TOMS UV irradiance database (1978 to 2000) has been expanded to include 5 new products (noon irradiance at 305, 310, 324, and 380 nm, and noon erythemal-weighted irradiance), in addition to the existing erythemal daily exposure, which permit direct Comparisons with ground-based measurements from UV spectrometers. Sensitivity studies are conducted to estimate uncertainties of the new TOMS UV irradiance data due to algorithm apriori assumptions. Comparisons with Brewer spectrometers as well as filter radiometers are used to review of the sources of known errors. Inability to distinguish between snow and cloud cover using only TOMS data results in large errors in estimating surface UV using snow climatology. A correction is suggested for the case when the regional snow albedo is known from an independent source. The summer-time positive bias between TOMS UV estimations and Brewer measurements can be seen at all wavelengths. This suggests the difference is not related to ozone absorption effects. We emphasize that uncertainty of boundary layer UV aerosol absorption properties remains a major source of error in modeling UV irradiance in clear sky conditions. Neglecting aerosol absorption by the present TOMS algorithm results in a positive summertime bias in clear-sky UV estimations over many locations. Due to high aerosol variability the bias is strongly site dependent. Data from UV-shadow-band radiometer and well-calibrated CIMEL sun-sky radiometer are used to quantify the bias at NASA/GSFC site in Greenbelt, MD. Recommendations are given to enable potential users to better account for local conditions by combining standard TOMS UV data with ancillary ground measurements.

Krotkov, N. A.↗

NASA NTRS1979

The probability distribution of the predicted CFM-induced ozone depletion

It is argued from the central limit theorem that the uncertainty in model predicted changes of the ozone column density is best represented by a normal probability density distribution. This conclusion is validated by comparison with a probability distribution generated by a Monte Carlo technique. In the case of the CFM-induced ozone depletion, and based on the estimated uncertainties in the reaction rate coefficients alone the relative mean standard deviation of this normal distribution is estimated to be 0.29.

Ehhalt, D. H.↗

NASA NTRS1990

Ozone measurements from the Balloon Intercomparison Campaign

Measurements of the Balloon Intercomparison Campaign (BIC), conducted during fall, 1982 (BIC-1) and summer, 1983 (BIC-2), are reported. Results of five remote and two in situ techniques agree (with a few exceptions) within 95-percent confidence level uncertainties and generally within 15 percent above 20 km. Weighted mean profiles, which best represent conditions during the campaign, are used as a comparison standard. Accuracies of experiments indicated by BIC generally confirm estimated uncertainties for ECC sondes, UV photometry, and microwave emission experiments, are somewhat better for far-IR emission and IR absorption experiments, and are somewhat worse for IR emission and solar UV absorption experiments. The large collection of BIC measurements confirms a problem reported earlier with current theoretical modeling of ozone near 40 km.

Robbins, D.↗

NASA NTRS2009

Estimate of the Impact of Absorbing Aerosol Over Cloud on the MODIS Retrievals of Cloud Optical Thickness and Effective Radius Using Two Independent Retrievals of Liquid Water Path

Two independent satellite retrievals of cloud liquid water path (LWP) from the NASA Aqua satellite are used to diagnose the impact of absorbing biomass burning aerosol overlaying boundary-layer marine water clouds on the Moderate Resolution Imaging Spectrometer (MODIS) retrievals of cloud optical thickness (tau) and cloud droplet effective radius (r(sub e)). In the MODIS retrieval over oceans, cloud reflectance in the 0.86-micrometer and 2.13-micrometer bands is used to simultaneously retrieve tau and r(sub e). A low bias in the MODIS tau retrieval may result from reductions in the 0.86-micrometer reflectance, which is only very weakly absorbed by clouds, owing to absorption by aerosols in cases where biomass burning aerosols occur above water clouds. MODIS LWP, derived from the product of the retrieved tau and r(sub e), is compared with LWP ocean retrievals from the Advanced Microwave Scanning Radiometer-EOS (AMSR-E), determined from cloud microwave emission that is transparent to aerosols. For the coastal Atlantic southern African region investigated in this study, a systematic difference between AMSR-E and MODIS LWP retrievals is found for stratocumulus clouds over three biomass burning months in 2005 and 2006 that is consistent with above-cloud absorbing aerosols. Biomass burning aerosol is detected using the ultraviolet aerosol index from the Ozone Monitoring Instrument (OMI) on the Aura satellite. The LWP difference (AMSR-E minus MODIS) increases both with increasing tau and increasing OMI aerosol index. During the biomass burning season the mean LWP difference is 14 g per square meters, which is within the 15-20 g per square meter range of estimated uncertainties in instantaneous LWP retrievals. For samples with only low amounts of overlaying smoke (OMI AI less than or equal to 1) the difference is 9.4, suggesting that the impact of smoke aerosols on the mean MODIS LWP is 5.6 g per square meter. Only for scenes with OMI aerosol index greater than 2 does the average LWP difference and the estimated bias in MODIS cloud optical thickness attributable to the impact of overlaying biomass burning aerosol exceed the instantaneous uncertainty in the retrievals.

Wilcox, Eric M.↗

NASA NTRS1996

Validation of UARS Microwave Limb Sounder Ozone Measurements

This paper describes the validation of ozone data from the Upper Atmosphere Research Satellite (UARS) Microwave Limb Sounder (MLS). The MLS ozone retrievals are obtained from the calibrated microwave radiances (emission spectra) in two separate bands, at frequencies near 205 and 183 GHz. Analyses described here focus on the MLS Version 3 data (the first set of files made publicly available). We describe results of simulations performed to assess the quality of the retrieval algorithms, in terms of both mixing ratio and radiance closure. From actual MLS observations, the 205-GHz ozone retrievals give better closure (smaller radiance residuals) than that from the 183-GHz measurements and should be considered more accurate from the calibration aspects. However, the 183-GHz data are less noise limited in the mesosphere and can provide the most useful scientific results in that region. We compare the retrieved 205-GHz ozone profiles in the middle-to lower stratosphere to ozonesonde measurements at a wide range of latitudes and seasons. Ground-based lidar data from Table Mountain, California, provide a good reference for comparisons at higher altitudes. Based on these analyses, comparisons with balloon-borne measurements and others, as well as a detailed budget of estimated uncertainties, MLS results appear to be generally of high quality, with some biases worth mentioning. Results for the lowermost stratosphere (approx. 50 to 100 bPa) are still in need of improvement. A set of estimated precision and accuracy values is derived for the MLS ozone data sets. We also comment on recent updates in the retrieval algorithms and their impact on ozone values.

Froidevaux, L.↗

NASA NTRS2022

Effective Uncertainty Quantification for Multi-Angle Polarimetric Aerosol Remote Sensing Over Ocean

Multi-angle polarimetric (MAP) measurements can enable detailed characterization of aerosol microphysical and optical properties and improve atmospheric correction in ocean color remote sensing. Advanced retrieval algorithms have been developed to obtain multiple geophysical parameters in the atmosphere–ocean system. Theoretical pixel-wise retrieval uncertainties based on error propagation have been used to quantify retrieval performance and determine the quality of data products. However, standard error propagation techniques in high-dimensional retrievals may not always represent true retrieval errors well due to issues such as local minima and the nonlinear dependence of the forward model on the retrieved parameters near the solution. In this work, we analyze these theoretical uncertainty estimates and validate them using a flexible Monte Carlo approach. The Fast Multi-Angular Polarimetric Ocean coLor (FastMAPOL) retrieval algorithm, based on efficient neural network forward models, is used to conduct the retrievals and uncertainty quantification on both synthetic HARP2 (Hyper-Angular Rainbow Polarimeter 2) and AirHARP (airborne version of HARP2) datasets. In addition, for practical application of the uncertainty evaluation technique in operational data processing, we use the automatic differentiation method to calculate derivatives analytically based on the neural network models. Both the speed and accuracy associated with uncertainty quantification for MAP retrievals are addressed in this study. Pixel-wise retrieval uncertainties are further evaluated for the real AirHARP field campaign data. The uncertainty quantification methods and results can be used to evaluate the quality of data products, as well as guide MAP algorithm development for current and future satellite systems such as NASA’s Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission.

PACE↗

NASA NTRS1995

Assimilation of TOPEX Sea Level Measurements with a Reduced-Gravity, Shallow Water Model of the Tropical Pacific Ocean

Sea surface height variability measured by TOPEX is analyzed in the tropical Pacific Ocean by way of assimilation into a wind-driven, reduced-gravity, shallow water model using an approximate Kalman filter and smoother. The analysis results in an optimal fit of the dynamic model to the observations, providing it dynamically consistent interpolation of sea level and estimation of the circulation. Nearly 80% of the expected signal variance is accounted for by the model within 20 deg of the equator, and estimation uncertainty is substantially reduced by the voluminous observation. Notable features resolved by the analysis include seasonal changes associated with the North Equatorial Countercurrent and equatorial Kelvin and Rossby waves. Significant discrepancies are also found between the estimate and TOPEX measurements, especially near the eastern boundary. Improvements in the estimate made by the assimilation are validated by comparisons with independent tide gauge and current meter observations. The employed filter and smoother are based on approximately computed estimation error covariance matrices, utilizing a spatial transformation and an symptotic approximation. The analysis demonstrates the practical utility of a quasi-optimal filter and smoother.

Fukumori, Ichiro↗

NASA NTRS2014

GCR Environmental Models I: Sensitivity Analysis for GCR Environments

Accurate galactic cosmic ray (GCR) models are required to assess crew exposure during long-duration missions to the Moon or Mars. Many of these models have been developed and compared to available measurements, with uncertainty estimates usually stated to be less than 15%. However, when the models are evaluated over a common epoch and propagated through to effective dose, relative differences exceeding 50% are observed. This indicates that the metrics used to communicate GCR model uncertainty can be better tied to exposure quantities of interest for shielding applications. This is the first of three papers focused on addressing this need. In this work, the focus is on quantifying the extent to which each GCR ion and energy group, prior to entering any shielding material or body tissue, contributes to effective dose behind shielding. Results can be used to more accurately calibrate model-free parameters and provide a mechanism for refocusing validation efforts on measurements taken over important energy regions. Results can also be used as references to guide future nuclear cross-section measurements and radiobiology experiments. It is found that GCR with Z>2 and boundary energies below 500 MeV/n induce less than 5% of the total effective dose behind shielding. This finding is important given that most of the GCR models are developed and validated against Advanced Composition Explorer/Cosmic Ray Isotope Spectrometer (ACE/CRIS) measurements taken below 500 MeV/n. It is therefore possible for two models to very accurately reproduce the ACE/CRIS data while inducing very different effective dose values behind shielding.

Slaba, Tony C.↗

NASA NTRS2021

Probabilistic Machine Learning Estimation of Ocean Mixed Layer Depth from Dense Satellite and Sparse In-Situ Observations

The ocean mixed layer plays an important role in the coupling between the upper ocean and atmosphere across a wide range of time scales. Estimation of the variability of the ocean mixed layer is therefore important for atmosphere-ocean prediction and analysis. The increasing coverage of in situ Argo profile data allows for an increasingly accurate analysis of the mixed layer depth (MLD) variability associated with deviations from the seasonal climatology. However, sampling rates are not sufficient to fully resolve subseasonal (<90 day) MLD variability. Yet, many multivariate observations-based analyses include implicit modeled subseasonal MLD variability. One analysis method is optimal interpolation of in situ data, but the interior analysis can be improved by leveraging surface data with regression or variational approaches. Here, we demonstrate how machine learning methods and satellite sea surface temperature, salinity, and height facilitate MLD estimation in a pilot study of two regions: the mid-latitude southern Indian and the eastern equatorial Pacific Oceans. We construct multiple machine learning architectures to produce weekly 1/2° gridded MLD anomaly fields (relative to a monthly climatology) with uncertainty estimates. We test multiple traditional and probabilistic machine learning techniques to compare both accuracy and probabilistic calibration. We validate our methodology by applying it to ocean model simulations. We find that incorporating sea surface data through a machine learning model improves the performance of spatiotemporal MLD variability estimation compared to optimal interpolation of Argo observations alone. These preliminary results are a promising first step for the application of machine learning to MLD prediction.

Machine Learning↗

NASA NTRS2019

A Pulsar-Based Time-Scale from the International Pulsar Timing Array

We have constructed a new time-scale, TT(IPTA16), based on observations of radio pulsars presented in the first data release from the International Pulsar Timing Array (IPTA). We used two analysis techniques with independent estimates of the noise models for the pulsar observations and different algorithms for obtaining the pulsar time-scale. The two analyses agree within the estimated uncertainties and both agree with TT(BIPM17), a post-corrected time-scale produced by the Bureau International des Poids et Mesures (BIPM). We show that both methods could detect significant errors in TT(BIPM17) if they were present. We estimate the stability of the atomic clocks from which TT(BIPM17) is derived using observations of four rubidium fountain clocks at the US Naval Observatory. Comparing the power spectrum of TT(IPTA16) with that of these fountain clocks suggests that pulsar-based time-scales are unlikely to contribute to the stability of the best time-scales over the next decade, but they will remain a valuable independent check on atomic time-scales. We also find that the stability of the pulsar-based time-scale is likely to be limited by our knowledge of solar-system dynamics, and that errors in TT(BIPM17) will not be a limiting factor for the primary goal of the IPTA, which is to search for the signatures of nano-Hertz gravitational waves.

G. Hobbs↗

NASA NTRS2010

Utilization of Hydrologic Remote Sensing Data in Land Surface Modeling and Data Assimilation: Current Status and Challenges

Recent advances in remote sensing technologies have enabled the monitoring and measurement of the Earth's land surface at an unprecedented scale and frequency. The myriad of these land surface observations must be integrated with the state-of-the-art land surface model forecasts using data assimilation to generate spatially and temporally coherent estimates of environmental conditions. These analyses are of critical importance to real-world applications such as agricultural production, water resources management and flood, drought, weather and climate prediction. This need motivated the development of NASA Land Information System (LIS), which is an expert system encapsulating a suite of modeling, computational and data assimilation tools required to address challenging hydrological problems. LIS integrates the use of several community land surface models, use of ground and satellite based observations, data assimilation and uncertainty estimation techniques and high performance computing and data management tools to enable the assessment and prediction of hydrologic conditions at various spatial and temporal scales of interest. This presentation will focus on describing the results, challenges and lessons learned from the use of remote sensing data for improving land surface modeling, within LIS. More specifically, studies related to the improved estimation of soil moisture, snow and land surface temperature conditions through data assimilation will be discussed. The presentation will also address the characterization of uncertainty in the modeling process through Bayesian remote sensing and computational methods.

Kumar, Sujay V.↗

NASA NTRS2020

Bayesian retrieval of optically relevant properties from hyperspectral water-leaving reflectances

Current methods to retrieve optically relevant properties from ocean color observations do not explicitly make use of prior knowledge about property distributions. Here we implement a simplified Bayesian approach that takes into account prior probability distributions on two sets of five optically relevant parameters, and conduct a retrieval of these parameters using hyperspectral simulated water-leaving reflectances. We focus specifically on the ability of the model to distinguish between two optically similar phytoplankton taxa, diatoms and Noctiluca scintillans. The inversion retrieval gives most-likely concentrations and uncertainty estimates, and we find that the model is able to probabilistically predict the occurrence of Noctiluca scintillans blooms using these metrics. We discuss how this method can be expanded to include a priori covariances between different parameters, and show the effect of varying measurement uncertainty and spectral resolution on Noctiluca scintillans bloom predictions.

Zachary K Erickson↗