Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “variance estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

A comparison of stratified versus regression estimators

LANDSAT data acquired over an agricultural area along with ground enumeration of the same area are used to obtain crop acreage estimates which are better (as measured in terms of bias and variance) than can be obtained from either data source alone. Two basic approaches considered within the AgRISTARS program are a stratified crop acreage estimator and a regression estimator. A statement of the problem was mathematically formulated and some theorems were proved which relate to the variance of the two estimators. For a particular set of data, the regression and stratified estimators are compared in terms of certain easily computed parameters.

Takacs, H. C.↗

ENTROPY VS. ENERGY WAVEFORM PROCESSING: A COMPARISON ON THE HEAT EQUATION

Virtually all modern imaging devices function by collecting either electromagnetic or acoustic backscattered waves and using the energy carried by these waves to determine pixel values that build up what is basically an ”energy” picture. However, waves also carry ”informa- tion” that also may be used to compute the pixel values in an image. We have employed several measures of information, all of which are based on different forms of entropy. Numerous published studies have demonstrated the advantages of entropy, or “information imaging”, over conventional methods for materials characterization and medical imaging. Similar results also have been obtained with microwaves. The most sensitive information measure appears to be the joint entropy of the backscattered wave and a reference signal. A typical study is comprised of repeated acquisition of backscattered waves from a specimen that is changing slowing with acquisition time or location. The sensitivity of repeated experimental observations of such a slowly changing quantity may be defined as the mean variation (i.e., observed change) divided by mean variance (i.e., observed noise). We compute the sensitivity for joint entropy and signal energy measurements assuming that noise is Gaussian and using Wiener integration to compute the required mean values and variances. These can be written as solutions to the Heat equation, which permits estimation of their magnitudes. There always exists a reference such that joint entropy has larger variation and smaller variance than the corresponding quantities for signal energy, matching observations of several studies. Moreover, a general prescription for finding an “optimal” reference for the joint entropy emerges, which also has been validated in several studies.

Entropy↗

Modeling spatial patterns in soil arsenic to estimate natural baseline concentrations

ABSTRACT Arsenic in soil is an important public health concern. Toxicity guidelines and models based on laboratory studies (i.e., U.S. EPA’s Integrated Risk Information System) should consider natural soil As concentrations to avoid unnecessary remediation burdens on society. We used soil and stream sediment samples from the USGS National Geochemical Survey database to assess the spatial distribution of natural As in a 1.16E+5 km2 area. Samples were collected at 348 soil and 144 stream locations, providing approximately one sample for every 290 km2. Sample sites were selected to minimize the potential influence of anthropogenic inputs. Samples were processed using acid digestion of whole samples (concentrated HCl and ascorbic acid) and concentrations were measured using hydride-generation atomic absorption spectrometry. Soil As ranged from 2.0 to 45.6 mg kg-1. Geostatistical techniques were used to model and map the spatial variability of As. The mean and variance at unsampled locations were estimated using sequential Gaussian simulation. Five areas of elevated concentration (> the median of 10 mg kg-1) were identified and the relationships to geologic parent materials, glacial sedimentation patterns, and soil conditions interpreted. Our results showed As concentrations >10 mg kg-1 were common, and >20 mg kg-1 were not unusual for the central and west central portions of Ohio (USA). In contrast, concentrations <4 mg kg-1 were rare. Measured concentrations typically exceeded the soil As human generic screening levels of 0.39 mg/kg (1); the calculated value that corresponds to a cancer risk level of 1 in 1,000,000 for soil ingestion. Because the As content of Ohio soils is similar to many world soils, the USEPA generic soil screening level of 0.39 mg/kg is of little utility. A more useful and practical approach would be the uses of natural background levels. Regional soil As patterns based on geology and biogeochemistry and not political boundaries should be used for soil screening and other risk assessment determinations.

arsenic, background, mapping, geostatistics, toxic↗

Task-based detectability in CT image reconstruction by filtered backprojection and penalized likelihood estimation

Purpose: Nonstationarity is an important aspect of imaging performance in CT and cone-beam CT (CBCT), especially for systems employing iterative reconstruction. This work presents a theoretical framework for both filtered-backprojection (FBP) and penalized-likelihood (PL) reconstruction that includes explicit descriptions of nonstationary noise, spatial resolution, and task-based detectability index. Potential utility of the model was demonstrated in the optimal selection of regularization parameters in PL reconstruction. Methods: Analytical models for local modulation transfer function (MTF) and noise-power spectrum (NPS) were investigated for both FBP and PL reconstruction, including explicit dependence on the object and spatial location. For FBP, a cascaded systems analysis framework was adapted to account for nonstationarity by separately calculating fluence and system gains for each ray passing through any given voxel. For PL, the point-spread function and covariance were derived using the implicit function theorem and first-order Taylor expansion according toFessler [“Mean and variance of implicitly defined biased estimators (such as penalized maximum likelihood): Applications to tomography,” IEEE Trans. Image Process. 5(3), 493–506 (1996)]. Detectability index was calculated for a variety of simple tasks. The model for PL was used in selecting the regularization strength parameter to optimize task-based performance, with both a constant and a spatially varying regularization map. Results: Theoretical models of FBP and PL were validated in 2D simulated fan-beam data and found to yield accurate predictions of local MTF and NPS as a function of the object and the spatial location. The NPS for both FBP and PL exhibit similar anisotropic nature depending on the pathlength (and therefore, the object and spatial location within the object) traversed by each ray, with the PL NPS experiencing greater smoothing along directions with higher noise. The MTF of FBP is isotropic and independent of location to a first order approximation, whereas the MTF of PL is anisotropic in a manner complementary to the NPS. Task-based detectability demonstrates dependence on the task, object, spatial location, and smoothing parameters. A spatially varying regularization “map” designed from locally optimal regularization can improve overall detectability beyond that achievable with the commonly used constant regularization parameter. Conclusions: Analytical models for task-based FBP and PL reconstruction are predictive of nonstationary noise and resolution characteristics, providing a valuable framework for understanding and optimizing system performance in CT and CBCT.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

CIS Project 22359, Final Technical Report. Discretized Posterior Approximation in High Dimensions

Our primary aim in this work is to understand how to efficiently obtain reliable uncertainty quantification in automatic learning algorithms with limited training datasets. Standard approaches rely on cross-validation to tune hyper parameters. Unfortunately, when our datasets are too small, holdout datasets become unreliable—albeit unbiased—measures of prediction quality due to the lack of adequate sample size. We should not place confidence in holdout estimators under conditions wherein the sample variance is both large and unknown. More poigniantly, our training experiments on limited data (Duersch and Catanach, 2021) show that even if we could improve estimator quality under these conditions, the typical training trajectory may never even encounter generalizable models.

97 MATHEMATICS AND COMPUTING↗

Enhanced Performance Controller Design for Stochastic Systems by Adding Extra State Estimation onto the Existing Closed Loop Control

To enhance the performance of the tracking property , this paper presents a novel control algorithm for a class of linear dynamic stochastic systems with unmeasurable states, where the performance enhancement loop is established based on Kalman filter. Without changing the existing closed loop with the PI controller, the compensative controller is designed to minimize the variances of the tracking errors using the estimated states and the propagation of state variances. Moreover, the stability of the closed-loop systems has been analyzed in the mean-square sense. A simulated example is included to show the effectiveness of the presented control algorithm, where encouraging results have been obtained.

Stochastic coupling attenuation↗

Denoising of polychromatic CT images based on their own noise properties

Purpose: Because of high diagnostic accuracy and fast scan time, computed tomography (CT) has been widely used in various clinical applications. Since the CT scan introduces radiation exposure to patients, however, dose reduction has recently been recognized as an important issue in CT imaging. However, low-dose CT causes an increase of noise in the image and thereby deteriorates the accuracy of diagnosis. In this paper, the authors develop an efficient denoising algorithm for low-dose CT images obtained using a polychromatic x-ray source. The algorithm is based on two steps: (i) estimation of space variant noise statistics, which are uniquely determined according to the system geometry and scanned object, and (ii) subsequent novel conversion of the estimated noise to Gaussian noise so that an existing high performance Gaussian noise filtering algorithm can be directly applied to CT images with non-Gaussian noise. Methods: For efficient polychromatic CT image denoising, the authors first reconstruct an image with the iterative maximum-likelihood polychromatic algorithm for CT to alleviate the beam-hardening problem. We then estimate the space-variant noise variance distribution on the image domain. Since there are many high performance denoising algorithms available for the Gaussian noise, image denoising can become much more efficient if they can be used. Hence, the authors propose a novel conversion scheme to transform the estimated space-variant noise to near Gaussian noise. In the suggested scheme, the authors first convert the image so that its mean and variance can have a linear relationship, and then produce a Gaussian image via variance stabilizing transform. The authors then apply a block matching 4D algorithm that is optimized for noise reduction of the Gaussian image, and reconvert the result to obtain a final denoised image. To examine the performance of the proposed method, an XCAT phantom simulation and a physical phantom experiment were conducted. Results: Both simulation and experimental results show that, unlike the existing denoising algorithms, the proposed algorithm can effectively reduce the noise over the whole region of CT images while preventing degradation of image resolution. Conclusions: To effectively denoise polychromatic low-dose CT images, a novel denoising algorithm is proposed. Because this algorithm is based on the noise statistics of a reconstructed polychromatic CT image, the spatially varying noise on the image is effectively reduced so that the denoised image will have homogeneous quality over the image domain. Through a simulation and a real experiment, it is verified that the proposed algorithm can deliver considerably better performance compared to the existing denoising algorithms.

60 APPLIED LIFE SCIENCES↗

Comparison of Global Distributions of Zonal-Mean Gravity Wave Variance Inferred from Different Satellite Instruments

Gravity wave temperature fluctuations acquired by the CRISTA instrument are compared to previous estimates of zonal-mean gravity wave temperature variance inferred from the LIMS, MLS and GPS/MET satellite instruments during northern winter. Careful attention is paid to the range of vertical wavelengths resolved by each instrument. Good agreement between CRISTA data and previously published results from LIMS, MLS and GPS/MET are found. Key latitudinal features in these variances are consistent with previous findings from ground-based measurements and some simple models. We conclude that all four satellite instruments provide reliable global data on zonal-mean gravity wave temperature fluctuations throughout the middle atmosphere.

Preusse, Peter↗

Adaptive Sampling-Based Bi-Fidelity Stochastic Trust Region Method for Stochastic Derivative-Free Optimization

Bi-fidelity stochastic optimization has gained increasing attention as an efficient approach to reduce computational costs by leveraging a low-fidelity (LF) model to optimize an expensive high-fidelity (HF) objective. In this paper, we propose ASTRO-BFDF, an adaptive sampling trust-region method specifically designed for unconstrained bi-fidelity stochastic derivative-free optimization problems. In ASTRO-BFDF, the LF function serves two purposes: (i) to identify better iterates for the HF function when the optimization process indicates a high correlation between them and (ii) to reduce the variance of the HF function estimates using bi-fidelity Monte Carlo (BFMC). The algorithm dynamically determines sample sizes while adaptively choosing between crude Monte Carlo and BFMC to balance the trade-off between optimization and sampling errors. We prove that the iterates generated by ASTRO-BFDF converge to a first-order stationary point almost surely. Additionally, we demonstrate the effectiveness of the proposed algorithm through numerical experiments on synthetic benchmarks and simulation optimization problems involving discrete event systems.

97 MATHEMATICS AND COMPUTING↗

Context-aware learning of hierarchies of low-fidelity models for multi-fidelity uncertainty quantification

Multi-fidelity Monte Carlo methods leverage low-fidelity and surrogate models for variance reduction to make tractable uncertainty quantification even when numerically simulating the physical systems of interest with high-fidelity models is computationally expensive. This work proposes a context-aware multi-fidelity Monte Carlo method that optimally balances the costs of training low-fidelity models with the costs of Monte Carlo sampling. It generalizes the previously developed context-aware bi-fidelity Monte Carlo method to hierarchies of multiple models and to more general types of low-fidelity models. When training low-fidelity models, the proposed approach takes into account the context in which the learned low-fidelity models will be used, namely for variance reduction in Monte Carlo estimation, which allows it to find optimal trade-offs between training and sampling to minimize upper bounds of the mean-squared errors of the estimators for given computational budgets. This is in stark contrast to traditional surrogate modeling and model reduction techniques that construct low-fidelity models with the primary goal of approximating well the high-fidelity model outputs and typically ignore the context in which the learned models will be used in upstream tasks. Further, the proposed context-aware multi-fidelity Monte Carlo method applies to hierarchies of a wide range of types of low-fidelity models such as sparse-grid and deep-network models. Numerical experiments with the gyrokinetic simulation code Gene show speedups of up to two orders of magnitude compared to standard estimators when quantifying uncertainties in small-scale fluctuations in confined plasma in fusion reactors. This corresponds to a runtime reduction from 72 days to four hours on one node of the Lonestar6 supercomputer at the Texas Advanced Computing Center.

42 ENGINEERING↗

Optimization under uncertainty of a hybrid waste tire and natural gas feedstock flexible polygeneration system using a decomposition algorithm

Market uncertainties motivate the development of flexible polygeneration systems that are able to adjust operating conditions to favor production of the most profitable product portfolio. However, this operational flexibility comes at the cost of higher capital expenditure. A scenario-based two-stage stochastic nonconvex Mixed-Integer Nonlinear Programming (MINLP) approach lends itself naturally to optimizing these trade-offs. This work studies the optimal design and operation under uncertainty of a hybrid feedstock flexible polygeneration system producing electricity, methanol, dimethyl ether, olefins or liquefied (synthetic) natural gas. A recently developed C++ based software framework (named GOSSIP) is used for modeling the optimization problem as well as its efficient solution using the Nonconvex Generalized Benders Decomposition (NGBD) algorithm. Two different cases are studied: The first uses estimates of the means and variances of the uncertain parameters from historical data, whereas the second assesses the impact of increased uncertain parameter volatility. The value of implementing flexible designs characterized by the value of the stochastic solution (VSS) is in the range of 260–405 M$ for a scale of approximately 893 MW of thermal input. Increased price volatility around the same mean results in higher expected net present value and VSS as operational flexibility allows for asymmetric exploitation of price peaks.

42 ENGINEERING↗

Laser frequency stabilization using bichromatic crossover spectroscopy

We propose a Doppler-free spectroscopic method named bichromatic crossover spectroscopy (BCS), which we then use for the frequency stabilization of an off-resonant frequency that does not correspond to an atomic transition. The observed BCS in the 5S{sub 1/2} → 5P{sub 1/2} transition of {sup 87}Rb is related to the hyperfine structure of the conventional saturated absorption spectrum of this transition. Furthermore, the Doppler-free BCS is numerically calculated by considering all of the degenerate magnetic sublevels of the 5S{sub 1/2} → 5P{sub 1/2} transition in an atomic vapor cell, and is found to be in good agreement with the experimental results. Finally, we successfully achieve modulation-free off-resonant locking at the center frequency between the two 5S{sub 1/2}(F = 1 and 2) → 5P{sub 1/2}(F′ = 1) transitions using a polarization rotation of the BCS. The laser frequency stability was estimated to be the Allan variance of 2.1 × 10{sup −10} at 1 s.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Stochastic modelling of intermittent fluctuations in the scrape-off layer: Correlations, distributions, level crossings, and moment estimation

A stochastic model is presented for intermittent fluctuations in the scrape-off layer of magnetically confined plasmas. The fluctuations in the plasma density are modeled by a super-position of uncorrelated pulses with fixed shape and duration, describing radial motion of blob-like structures. In the case of an exponential pulse shape and exponentially distributed pulse amplitudes, predictions are given for the lowest order moments, probability density function, auto-correlation function, level crossings, and average times for periods spent above and below a given threshold level. Also, the mean squared errors on estimators of sample mean and variance for realizations of the process by finite time series are obtained. These results are discussed in the context of single-point measurements of fluctuations in the scrape-off layer, broad density profiles, and implications for plasma–wall interactions due to the transient transport events in fusion grade plasmas. The results may also have wide applications for modelling fluctuations in other magnetized plasmas such as basic laboratory experiments and ionospheric irregularities.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Effect of roughness, deterministic and random errors in film thickness on the reflecting properties of aperiodic mirrors for the EUV range

By the example of three aperiodic multilayer Mo/Si mirrors (AMM) for the wavelength ranges 17–21 nm, 24–29 nm, and 28–33 nm we have studied numerically the effect of the linearly determinisctic and random fluctuations of the film thickness and the interlayer roughness on the spectral dependences of the reflection coefficient. The simulation results are used to solve the inverse problem of reconstructing the interlayer roughness and the thickness of individual films from the measured dependences of the extreme UV radiation reflection coefficients. It is shown that the 'asymmetry' of the boundaries affects the magnitude and slope of the reflection coefficient plateau. Random fluctuations of the film thickness with the variance of 1%–2% weakly influence the reflection characteristics of AMMs and allow reliable reconstruction of the thickness of individual films. The fluctuations with the variance 8%–10% allow the estimation of individual thicknesses, but the reflection curve in this case strongly differs from the desirable one. Larger fluctuations do not allow the reconstruction of the AMM structure. The basic criteria for high-quality AMM synthesis are formulated. (extreme laser radiation: physics and fundamental applications)

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Dynamical tuning of the chemical potential to achieve a target particle number in grand canonical Monte Carlo simulations

We present a method to facilitate Monte Carlo simulations in the grand canonical ensemble given a target mean particle number. The method imposes a fictitious dynamics on the chemical potential, to be run concurrently with the Monte Carlo sampling of the physical system. Corrections to the chemical potential are made according to time-averaged estimates of the mean and variance of the particle number, with the latter being proportional to thermodynamic compressibility. Here, we perform a variety of tests, and in all cases find rapid convergence of the chemical potential—inexactness of the tuning algorithm contributes only a minor part of the total measurement error for realistic simulations.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Probing electromagnetic nonreciprocity with quantum geometry of photonic states

Reciprocal and nonreciprocal effects in dielectric and magnetic materials provide crucial information about the microscopic properties of electrons. However, experimentally distinguishing the two has proven to be challenging, especially when the associated effects are extremely small. To this end, we propose a contactless detection using a cross-cavity device where a material of interest is placed at its center. We show that the optical properties of the material, such as Kerr and Faraday rotation, or birefringence, manifest in the coupling between the cavity's electromagnetic modes and in the shift of their resonant frequencies. By calculating the dynamics of a geometrical photonic state, we formulate a measurement protocol based on the quantum metric and quantum process tomography that isolates the individual components of the material's complex refractive index and minimizes the quantum mechanical Cramér-Rao bound on the variance of the associated parameter estimation. Our approach is expected to be applicable across a broad spectrum of experimental platforms including Fock states in optical cavities, or coherent states in microwave and THz resonators. Published by the American Physical Society 2025

Petrides, Ioannis (ORCID:0000000174842444)↗

Trust Your Gut: Comparing Human and Machine Inference from Noisy Visualizations

People commonly utilize visualizations not only to examine a given dataset, but also to draw generalizable conclusions about the underlying models or phenomena. Prior research has compared human visual inference to that of an optimal Bayesian agent, with deviations from rational analysis viewed as problematic. However, human reliance on non-normative heuristics may prove advantageous in certain circumstances. We investigate scenarios where human intuition might surpass idealized statistical rationality. In two experiments, we examine individuals’ accuracy in characterizing the parameters of known data-generating models from bivariate visualizations. Our findings indicate that, although participants generally exhibited lower accuracy compared to statistical models, they frequently outperformed Bayesian agents, particularly when faced with extreme samples. Participants appeared to rely on their internal models to filter out noisy visualizations, thus improving their resilience against spurious data. However, participants displayed overconfidence and struggled with uncertainty estimation. They also exhibited higher variance than statistical machines. Our findings suggest that analyst gut reactions to visualizations may provide an advantage, even when departing from rationality. These results carry implications for designing visual analytics tools, offering new perspectives on how to integrate statistical models and analyst intuition for improved inference and decision-making. The data and materials for this paper are available at https://osf.io/qmfv6

human-machine collaboration↗