Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “variance estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
NASA NTRS1978

Microwave scatter and sea state estimation - Two-scale ocean wave models

The efficient estimation of ocean wave-structure parameters with a remote, narrow-beam, pulsed, microwave radar at intermediate incidence angles is discussed. The sea surface is described as the sum of random small- and large-scale structures (waves), the latter the sum of a sinusoid and a random field. It is shown that the small-scale structure is responsible for scattering and that the scatter depends parametrically on the large-scale structure. For the estimation problem it is assumed, reasonably, that the received signal is normally distributed: a relatively simple processor which will efficiently estimate parameters of the sinusoidal structure is illustrated and its performance discussed. A brief comparison is made with a normal incidence system with which the variance of the large-scale random roughness can be estimated.

Harger, R. O.↗
DOE OSTI2016

Efficient estimators for likelihood ratio sensitivity indices of complex stochastic dynamics

We demonstrate that centered likelihood ratio estimators for the sensitivity indices of complex stochastic dynamics are highly efficient with low, constant in time variance and consequently they are suitable for sensitivity analysis in long-time and steady-state regimes. These estimators rely on a new covariance formulation of the likelihood ratio that includes as a submatrix a Fisher information matrix for stochastic dynamics and can also be used for fast screening of insensitive parameters and parameter combinations. The proposed methods are applicable to broad classes of stochastic dynamics such as chemical reaction networks, Langevin-type equations and stochastic models in finance, including systems with a high dimensional parameter space and/or disparate decorrelation times between different observables. Furthermore, they are simple to implement as a standard observable in any existing simulation algorithm without additional modifications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2014

Estimation and Uncertainty Analysis of Impacts of Future Heat Waves on Mortality in the Eastern United States

Background: It is anticipated that climate change will influence heat-related mortality in the future. However, the estimation of excess mortality attributable to future heat waves is subject to large uncertainties, which have not been examined under the latest greenhouse gas emission scenarios. Objectives: We estimated the future heat wave impact on mortality in the eastern United States (~ 1,700 counties) under two Representative Concentration Pathways (RCPs) and analyzed the sources of uncertainties. Methods Using dynamically downscaled hourly temperature projections in 2057-2059, we calculated heat wave days and episodes based on four heat wave metrics, and estimated the excess mortality attributable to them. The sources of uncertainty in estimated excess mortality were apportioned using a variance-decomposition method. Results: In the eastern U.S., the excess mortality attributable to heat waves could range from 200-7,807 with the mean of 2,379 persons/year in 2057-2059. The projected average excess mortality in RCP 4.5 and 8.5 scenarios was 1,403 and 3,556 persons/year, respectively. Excess mortality would be relatively high in the southern and eastern coastal areas. The major sources of uncertainty in the estimates are relative risk of heat wave mortality, the RCP scenarios, and the heat wave definitions. Conclusions: The estimated mortality risks from future heat waves are likely an order of magnitude higher than its current level and lead to thousands of deaths each year under the RCP8.5 scenario. The substantial spatial variability in estimated county-level heat mortality suggests that effective mitigation and adaptation measures should be developed based on spatially resolved data.

climate change↗
DOE OSTI2023

Improving multiwell petrophysical interpretation from well logs via machine learning and statistical models

Well-log interpretation estimates in situ rock properties along well trajectory, such as porosity, water saturation, and permeability, to support reserve-volume estimation, production forecasts, and decision making in reservoir development. However, due to measurement errors, variability of well logs caused by multiple measurement vendors, different borehole tools, and nonuniform drilling/borehole conditions, estimations of rock properties with original well logs without proper preprocessing may not be accurate, especially in the context of multiwell estimation. Well-log normalization techniques such as two-point scaling and mean-variance normalization are commonly used to improve the robustness of multiwell rock-property estimation. However, these techniques do not consider the correlation between well logs and require subjective knowledge for their effective implementation. To reduce uncertainties and processing time associated with multiwell rock-property estimation from well logs, we develop discriminative adversarial (DA) and linear constraint models for well-log normalization and rock-property estimation. The DA neural network model developed for well-log normalization and interpretation can perform linear and nonlinear well-log normalization while considering the joint distribution of each well log and rock properties. However, the linear constraint model uses an ensemble of predictions from linear models to constrain well-log normalization and rock-property estimation. We also develop a divergence-based type well identification method to select type (training) wells for a test well based on the statistical similarity of associated well-log distributions instead of the interwell distance. We apply the DA model to perform well-log normalization and prediction of permeability for the Seminole San Andres Unit carbonate reservoir. Compared with the permeability predicted with the classical machine learning model without well-log normalization and models with two-point scaling normalization, the DA model yields the most accurate permeability prediction by decreasing the mean-squared error of permeability prediction by 20%–50%.

Geochemistry & Geophysics↗
NASA NTRS1980

Maximum likelihood estimation of label imperfection probabilities and its use in the identification of mislabeled patterns

Estimating label imperfections and the use of estimations in the identification of mislabeled patterns are discussed. Expressions are presented for the asymptotic variances of the probability of correct classification and proportion, and for the maximum likelihood estimates of classification errors and a priori probabilities. Models are developed for imperfections in the labels and classification errors, and expressions are derived for the probability of imperfect label identification schemes resulting in wrong decisions. The expressions are used in computing thresholds and the techniques are given practical applications. The imperfect label identification scheme in the multiclass case is found to amount to establishing a region around each decision surface, and decisions of the label correction scheme are found in close agreement with the analyst-interpreter interpretations of the imagery films. As an example, the application of the maximum likelihood estimation to the processing of Landsat MSS data is discussed.

Chittineni, C. B.↗
DOE OSTI2016

Improved uncertainty quantification in nondestructive assay for nonproliferation

This paper illustrates methods to improve uncertainty quantification (UQ) for non-destructive assay (NDA) measurements used in nuclear nonproliferation. First, it is shown that current bottom-up UQ applied to calibration data is not always adequate, for three main reasons: (1) Because there are errors in both the predictors and the response, calibration involves a ratio of random quantities, and calibration data sets in NDA usually consist of only a modest number of samples (3–10); therefore, asymptotic approximations involving quantities needed for UQ such as means and variances are often not sufficiently accurate; (2) Common practice overlooks that calibration implies a partitioning of total error into random and systematic error, and (3) In many NDA applications, test items exhibit non-negligible departures in physical properties from calibration items, so model-based adjustments are used, but item-specific bias remains in some data. Therefore, improved bottom-up UQ using calibration data should predict the typical magnitude of item-specific bias, and the suggestion is to do so by including sources of item-specific bias in synthetic calibration data that is generated using a combination of modeling and real calibration data. Second, for measurements of the same nuclear material item by both the facility operator and international inspectors, current empirical (top-down) UQ is described for estimating operator and inspector systematic and random error variance components. A Bayesian alternative is introduced that easily accommodates constraints on variance components, and is more robust than current top-down methods to the underlying measurement error distributions.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1985

Heat balances of the surface mixed layer in the equatorial Atlantic and Indian Ocean during FGGE

Surface meteorological and surface and subsurface oceanographic data collected during FGGE in the equatorial Atlantic and Indian Oceans are used to estimate the terms in a heat balance relation for the mixed layer. The first balance tested is between changes in mixed layer temperature (MLT) and surface energy fluxes. Away from regions of low variance in MLT time series and equatorial and coastal upwelling, surface fluxes can account for 75 percent of the variance in the observed time series. Differences between observed and estimated MLTs indicate that on the average, maximum errors in surface flux are of the order of 20 to 30 W/sq m. In the Atlantic, the addition of zonal advection does not significantly improve the estimates. However in regions of equatorial upwelling, the eastern Atlantic vertical mixing and meridional advection can play an important role in the evolution of MLTs.

Molinari, R. L.↗
DOE OSTI2022

Covariance matrices for variance-suppressed simulations

ABSTRACT Cosmological N-body simulations provide numerical predictions of the structure of the Universe against which to compare data from ongoing and future surveys, but the growing volume of the Universe mapped by surveys requires correspondingly lower statistical uncertainties in simulations, usually achieved by increasing simulation sizes at the expense of computational power. It was recently proposed to reduce simulation variance without incurring additional computational costs by adopting fixed-amplitude initial conditions. This method has been demonstrated not to introduce bias in various statistics, including the two-point statistics of galaxy samples typically used for extracting cosmological parameters from galaxy redshift survey data, but requires us to revisit current methods for estimating covariance matrices of clustering statistics for simulations. In this work, we find that it is not trivial to construct covariance matrices analytically for fixed-amplitude simulations, but we demonstrate that ezmock (Effective Zel’dovich approximation mock catalogue), the most efficient method for constructing mock catalogues with accurate two- and three-point statistics, provides reasonable covariance matrix estimates for such simulations. We further examine how the variance suppression obtained by amplitude-fixing depends on three-point clustering, small-scale clustering, and galaxy bias, and propose intuitive explanations for the effects we observe based on the ezmock bias model.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Bayesian merging of numerical modeling and remote sensing for saltwater intrusion quantification in the Vietnamese Mekong Delta

Saltwater intrusion has become one of the most concerning issues in the Vietnamese Mekong Delta (VMD) due to its increasing impacts on agriculture and food security of Vietnam. Reliable estimation of salinity plays a crucial role to mitigate the impacts of saltwater intrusion. Here, this study developed a hybrid technique that merges satellite imagery with numerical simulations to improve the estimation of salinity in the VMD. The salinity derived from Landsat images and by numerical simulations was fused using the Bayesian inference technique. The results indicate that our technique significantly reduces the uncertainties and improves the accuracy of salinity estimates. The Nash–Sutcliffe coefficient is 0.74, which is much higher than that of numerical simulation (0.63) and Landsat estimation (0.6). The correlation coefficient between the ensemble and measured salinity is relatively high (0.88). The variance of the ensemble salinity errors (5.0 ppt 2 ) is lower than that of Landsat estimation (10.4 ppt 2 ) and numerical simulations (9.6 ppt 2 ). The proposed approach shows a great potential to combine multiple data sources of a variable of interest to improve its accuracy and reliability wherever these data are available.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2022

Remote Sensing of Aerosol Water Fraction, Dry Size Distribution and Soluble Fraction Using Multi-Angle, Multi-Spectral Polarimetry

A framework to infer volume water fraction, soluble fraction and dry size distributions of fine-mode aerosol from multi-angle, multi-spectral polarimetry retrievals of column-averaged ambient aerosol properties is presented. The method is applied to observations of the Research Scanning Polarimeter (RSP) obtained during two NASA aircraft campaigns, namely the Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment (ACTIVATE) and the Cloud, Aerosol, and Monsoon Processes Philippines Experiment (CAMP2Ex). All aerosol retrievals are statistically evaluated using in situ data. Volume water fraction is inferred from the retrieved ambient real part of the refractive index, assuming a dry refractive index of 1.54 and by applying a volume mixing rule to obtain the effective ambient refractive index. The uncertainties in inferred volume water fraction resulting from this simplified model are discussed and estimated to be lower than 0.2 and decreasing with increasing volume water fraction. The daily mean retrieved volume water fractions correlate well with the in situ values with a mean absolute difference of 0.09. Polarimeter-retrieved ambient effective radius for daily data is shown to increase as a function of volume water fraction as expected. Furthermore, the effective variance of the size distributions also increases with increasing effective radius, which we show is consistent with an external mixture of soluble and insoluble aerosol. The relative variations of effective radius and variance over an observation period are then used to estimate the soluble fraction of the aerosol. Daily results of soluble fraction correlate well with in situ-observed sulfate mass fraction with a correlation coefficient of 0.79. Subsequently, inferred water and soluble fractions are used to derive dry fine-mode size distributions from their ambient counterparts. While dry effective radii obtained in situ and from RSP show similar ranges, in situ values are generally substantially smaller during the ACTIVATE deployments, which may be due to biases in RSP retrievals or in the in situ observations, or both. Both RSP and in situ observations indicate the dominance of aerosol with low hygroscopicity during the ACTIVATE and CAMP2Ex campaigns. Furthermore, RSP indicates a high degree of external mixing of particles with low and high hygroscopicity. These retrievals of fine-mode water volume fraction and soluble fraction may be used for the evaluation of water uptake in atmospheric models. Furthermore, the framework allows us to estimate the variation in the concentration of fine-mode aerosol larger than a specific dry radius limit, which can be used as a proxy for the variation in cloud condensation nucleus concentrations. This framework may be applied to multi-angle, multi-spectral satellite data expected to be available in the near future.

Amount of water in particulate matter↗
NASA NTRS2022

Remote Sensing of Aerosol Water Fraction, Dry Size Distribution and Soluble Fraction Using Multi-Angle, Multi-Spectral Polarimetry

A framework to infer volume water fraction, soluble fraction and dry size distributions of fine mode aerosol from multi-angle, multi-spectral polarimetry retrievals of column-averaged ambient aerosol properties is presented. The method is applied to observations of the Research Scanning Polarimeter (RSP) obtained during two NASA aircraft campaigns, namely the Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment (ACTIVATE) and the Cloud, Aerosol, and Monsoon Processes-Philippines Experiment (CAMP2Ex). All aerosol retrievals are statistically evaluated using in situ data. Volume water fraction is inferred from the retrieved ambient real part of the refractive index, assuming a dry refractive index of 1.54 and by applying a volume mixing rule to obtain the effective ambient refractive index. The uncertainties in inferred volume water fraction resulting from this simplified model are discussed and estimated to be lower than 0.2 and decreasing with increasing volume water fraction. The daily mean retrieved volume water fractions correlate well with the in situ values with a mean absolute difference of 0.09. Polarimeter-retrieved ambient effective radius for daily data is shown to increase as a function of volume water fraction as expected. Furthermore, the effective variance of the size distributions also increases with increasing effective radius, which we show is consistent with an external mixture of soluble and insoluble aerosol. The relative variations of effective radius and variance over an observation period are then used to estimate the soluble fraction of the aerosol. Daily results of soluble fraction correlate well with in situ observed sulfate mass fraction with a correlation coefficient of 0.79. Subsequently, inferred water and soluble fractions are used to derive dry fine-mode size distributions from their ambient counterparts. While dry effective radii obtained in situ and from RSP show similar ranges, in situ values are generally substantially smaller during the ACTIVATE deployments, which may be due to biases in RSP retrievals or in the in situ observations, or both. Both RSP and in situ observations indicate the dominance of aerosol with low hygroscopicity during the ACTIVATE and CAMP2Ex campaigns. Furthermore, RSP indicates a high degree of external mixing of particles with low and high hygroscopicity. These retrievals of fine mode water volume fraction and soluble fraction may be used for the evaluation of water uptake in atmospheric models. Furthermore, the framework allows to estimate the variation in the concentration of fine-mode aerosol larger than a specific dry radius limit, which can be used as a proxy for the variation in cloud condensation nucleus concentrations. This framework may be applied to multi-angle, multi-spectral satellite data expected to be available in the near future.

Bastiaan Van Diedenhoven↗
NASA NTRS1993

Atmospheric moisture fields derived by satellite observations over the tropical Pacific Ocean

Values of precipitable water are retrieved over the tropical and subtropical Pacific Ocean from TOVS infrared and microwave channel brightness temperature and OLR observations by means of stepwise linear regression. The most useful temperature and moisture sensing channels are pre-selected from sensitivity tests of a radiative transfer model. Numerous models are developed and tested against collocated radiosonde observations and Nimbus-7 SMMR precipitable water estimates. For RAOB comparisons, the best estimator used 15 TOVS predictors and captured 71.1 deg percent of the variance (+0.62 g/sq cm standard error) for column precipitable water; for precipitable water of 700-500 mb bulk layer, these values were 71.7 percent and +/- 0.17 g/sq cm. Little skill of estimated precipitable water was obtained for moisture above 500 mb. Regressions were less skillful against SMMR, unless collocation parameters were tightly controlled; SMMR was less acceptable than RAOB's because of observational drift and errors. Generally, the most skillful predictors were boundary layer brightness temperatures of TOVS channels and satellite estimated stability indices. 'Moisture channels' were hardly useful except for estimating middle and upper tropospheric moisture. Additional regression models were constructed testing the sensitivity to different observational and meteorological characteristics. Models which used some in situ observations surface observations or stabilities calculated from RAOB, were the most successful. The best of these explained 87.5 percent of the variance but the regression selected almost no TOVS channels, relying instead on conventional RAOB and surface observations. A set of four regression models were developed, stratifying atmospheric characteristics on the basis of collocated OLR values. These models improved the variance explained by 5.0 percent; the model associated with the highest OLR values (275 W/sq m less than or equal to OLR; that is, no cloud) showed only marginal skill. Precipitable water fields were generated from the best TOVS-only model for seven days in January 1983 and compared with SMMR-estimated fields. OLR fields and ECMWF precipitable water analysis. The TOVS regression model compared favorably to the SMMR analysis in amplitudes and features. It revealed more evolving synoptic signal than the ECMWF analysis. In synoptically active regions, it differed with respect to the OLR analysis, primarily because of actual differences in the vertical distribution of water vapor.

Chung, Hyosang↗
DOE OSTI2024

Implications of stop-and-go traffic on training learning-based car-following control

Learning-based car-following control (LCC) of connected and autonomous vehicles (CAVs) is gaining significant attention with the advancement of computing power and data accessibility. While the flexibility and large model capacity of model-free architecture enable LCC to potentially outperform the model-based car-following (CF) model in improving traffic efficiency and mitigating congestion, the generalizability of LCC for traffic conditions different from the training environment/dataset is not well-understood. Herein, this study seeks to explore the impact of stop-and-go traffic in the training dataset on the generalizability of LCC. It uses the characteristics of lead vehicle trajectories to describe stop-and-go traffic, and links the theory of identifiability (i.e., obtaining a unique parameter estimation result using sensor measurements) to the generalizability of behavior cloning (BC) and policy-based deep reinforcement learning (DRL). Correspondingly, the study shows theoretically that: (i) stop-and-go traffic can enable the property of identifiability and enhance the control performance of BC-based LCC in different traffic conditions; (ii) stop-and-go traffic is not necessary for DRL-based LCC to generalize to different traffic conditions; (iii) DRL-based LCC trained with only constant-speed lead vehicle trajectories (not sufficient to ensure identifiability) can be generalized to different traffic conditions; and (iv) stop-and-go traffic increases variance in the training dataset, which improves the convergence of parameter estimation while negatively impacting the convergence of DRL to the optimal control policy. Numerical experiments validate the above findings, illustrating that BC-based LCC entails comprehensive training datasets for generalizing to different traffic conditions, while DRL-based LCC can achieve generalization with simple free-flow traffic training environments. This further suggests DRL as a more promising and cost-effective LCC approach to reduce operational costs, mitigate traffic congestion, and enhance safety and mobility, which can accelerate the deployment and acceptance of CAVs.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

Temporal covariance structure of multi-spectral phenotypes and their predictive ability for end-of-season traits in maize

Vegetation indices (VIs) derived from multi-spectral imaging (MSI) platforms can be used to study properties of crop canopy, providing non-destructive phenotypes that could be used to better understand growth curves throughout the growing season. To investigate the amount of variation present in several VIs and their relationship with important end-of-season traits, genetic and residual (co)variances for VIs, grain yield and moisture were estimated using data collected from maize hybrid trials. The VIs considered were Normalized Difference Vegetation Index (NDVI), Green NDVI, Red Edge NDVI, Soil-Adjusted Vegetation Index, Enhanced Vegetation Index and simple Ratio of Near Infrared to Red (Red) reflectance. Genetic correlations of VIs with grain yield and moisture were used to fit multi-trait models for prediction of end-of-season traits and evaluated using within site/year cross-validation. To explore alternatives to fitting multiple phenotypes from MSI, random regression models with linear splines were fit using data collected in 2016 and 2017. Heritability estimates ranging from (0.10 to 0.82) were observed, indicating that there exists considerable amount of genetic variation in these VIs. Furthermore, strong genetic and residual correlations of the VIs, NDVI and NDRE, with grain yield and moisture were found. Considerable increases in prediction accuracy were observed from the multi-trait model when using NDVI and NDRE as a secondary trait. Finally, random regression with a linear spline function shows potential to be used as an alternative to mixed models to fit VIs from multiple time points.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2018

Uncertainty Analysis of Simulations of the Turn-of-the-Century Drought in the Western United States

Here, we perform the first uncertainty quantification analysis of the turn-of-the-century drought in the western United States using a large perturbed-parameter ensemble of the Community Atmosphere Model version 4.0 (CAM4). We develop several metrics to characterize the aridity bias, spatial extent, and tropical forcing of the drought and use statistical models to ascertain that the modeled drought was mainly sensitive to CAM4 parameters related to deep convection and clouds. Deep convection parameters account for over half the variance across the drought metrics. We employ observed estimates of these drought metrics to infer probability distributions of the model parameters that lead to a better agreement with observations, thereby providing guidance on how to improve the simulation of drought in CAM4. We find that in some cases, the suggested parameter values that improve the simulation of one drought characteristic would degrade the simulation of another, suggesting that there is a complex relationship between the model parameters and drought in the western United States. We also demonstrate reductions in the uncertainty of the drought metrics of up to 30% by constraining with observations of all metrics. Additionally, we demonstrate for the first time that improvements to the simulation of the spatial extent of the turn-of-the-century drought also lead to improvements in the spatial extent of the Australian Millennium drought, suggesting that physics of drought as encoded by the model parameters may be generalizable.

58 GEOSCIENCES↗
DOE OSTI2015

Classification of octet AB-type binary compounds using dynamical charges: A materials informatics perspective

The role of dynamical (or Born effective) charges in classification of octet AB-type binary compounds between four-fold (zincblende/wurtzite crystal structures) and six-fold (rocksalt crystal structure) coordinated systems is discussed. We show that the difference in the dynamical charges of the fourfold and sixfold coordinated structures, in combination with Harrison’s polarity, serves as an excellent feature to classify the coordination of 82 sp–bonded binary octet compounds. We use a support vector machine classifier to estimate the average classification accuracy and the associated variance in our model where a decision boundary is learned in a supervised manner. Lastly, we compare the out-of-sample classification accuracy achieved by our feature pair with those reported previously.

36 MATERIALS SCIENCE↗