Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Noise Variance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Variance Reduction within Implicit Monte Carlo Thermal Radiation Transport using the Local Importance Function Transform [Slides]

System of equations derived by Fleck and Cummings to model time-dependent thermal radiative transfer (TRT) problems: Solution of radiation specific intensity (I), non-linearly coupled to material internal energy (U); Absorption and re-emission approximated by effective scattering events. Useful for high-energy density physics simulations: i.e., astrophysics, inertial confinement fusion (ICF). Whereas deterministic methods are fully discretized and free of statistical noise, Monte Carlo methods allow for dynamic sampling of the phase space at the price of statistical noise; Monte Carlo methods are also characterized by a slow $\frac{1}{√Ν}$ convergence rate.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2000

Three Averaging Techniques for Reduction of Antenna Temperature Variance Measured by a Dicke Mode, C-Band Radiometer

As new radiometer technologies provide the possibility of greatly improved spatial resolution, their performance must also be evaluated in terms of expected sensitivity and absolute accuracy. As aperture size increases, the sensitivity of a Dicke mode radiometer can be maintained or improved by application of any or all of three digital averaging techniques: antenna data averaging with a greater than 50% antenna duty cycle, reference data averaging, and gain averaging. An experimental, noise-injection, benchtop radiometer at C-band showed a 68.5% reduction in Delta-T after all three averaging methods had been applied simultaneously. For any one antenna integration time, the optimum 34.8% reduction in Delta-T was realized by using an 83.3% antenna/reference duty cycle.

Mackenzie, Anne I.↗
NASA NTRS1984

Doppler lidar results from the San Gorgonio Pass experiments

During FY-84, the Doppler Lidar data from the San Gorgonio Pass experiments were analyzed, evaluated, and interpreted with regard to signal strength, signal width, magnitude and direction of velocity component and a goodness parameter associated with the expected noise level of the signal. From these parameters, a screening criteria was developed to eliminate questionable data. For the most part analysis supports the validity of Doppler Lidar data obtained at San Gorgonio Pass with respect to the mean velocity magnitude and direction. The question as to whether the Doppler width could be interpreted as a measure of the variance of the turbulence within the Doppler Lidar System (DLS) focal volume was not resolved. The stochastic nature of the Doppler broadening from finite residence time of the particles in the beam as well as other Doppler broadening phenomenon tend to mask the Doppler spread associated with small scale turbulence. Future tests with longer pulses may assist in better understanding.

Cliff, W. C.↗
NASA NTRS1985

A class of optimum digital phase locked loops for the DSN advanced receiver

A class of optimum digital filters for digital phase locked loop of the deep space network advanced receiver is discussed. The filter minimizes a weighted combination of the variance of the random component of the phase error and the sum square of the deterministic dynamic component of phase error at the output of the numerically controlled oscillator (NCO). By varying the weighting coefficient over a suitable range of values, a wide set of filters are obtained such that, for any specified value of the equivalent loop-noise bandwidth, there corresponds a unique filter in this class. This filter thus has the property of having the best transient response over all possible filters of the same bandwidth and type. The optimum filters are also evaluated in terms of their gain margin for stability and their steady-state error performance.

Hurd, W. J.↗
NASA NTRS1999

Improved Stratospheric Temperature Retrievals for Climate Reanalysis

The Data Assimilation Office (DAO) is embarking on plans to generate a twenty year reanalysis data set of climatic atmospheric variables. One of the focus points will be in the evaluation of the dynamics of the stratosphere. The Stratospheric Sounding Unit (SSU), flown as part of the TIROS Operational Vertical Sounder (TOVS), is one of the primary stratospheric temperature sensors flown consistently throughout the reanalysis period. Seven unique sensors made the measurements over time, with individual instrument characteristics that need to be addressed. The stratospheric temperatures being assimilated across satellite platforms will profoundly impact the reanalysis dynamical fields. To attempt to quantify aspects of instrument and retrieval bias we are carefully collecting and analyzing all available information on the sensors, their instrument anomalies, forward model errors and retrieval biases. For the retrieval of stratospheric temperatures, we adapted the minimum variance approach of Jazwinski (1970) and Rodgers (1976) and applied it to the SSU soundings. In our algorithm, the state vector contains an initial guess of temperature from a model six hour forecast provided by the Goddard EOS Data Assimilation System (GEOS/DAS). This is combined with an a priori covariance matrix, a forward model parameterization, and specifications of instrument noise characteristics. A quasi-Newtonian iteration is used to obtain convergence of the retrieved state to the measurement vector. This algorithm also enables us to analyze and address the systematic errors associated with the unique characteristics of the cell pressures on the individual SSU instruments and the resolving power of the instruments to vertical gradients in the stratosphere. The preliminary results of the improved retrievals and their assimilation as well as baseline calculations of bias and rms error between the NESDIS operational product and col-located ground measurements will be presented.

Rokke, L.↗
NASA NTRS2023

Testing Cosmic Microwave Background Anomalies in E-mode Polarization with Current and Future Data

In this paper, we explore the power of the cosmic microwave background (CMB) polarization (E-mode) data to corroborate four potential anomalies in CMB temperature data: the lack of large angular-scale correlations, the alignment of the quadrupole and octupole (Q–O), the point-parity asymmetry, and the hemispherical power asymmetry. We use CMB simulations with noise representative of three experiments—the Planck satellite, the Cosmology Large Angular Scale Surveyor (CLASS), and the LiteBIRD satellite—to test how current and future data constrain the anomalies. We find the correlation coefficients ρ between temperature and E-mode estimators to be less than 0.1, except for the point-parity asymmetry (ρ = 0.17 for cosmic-variance-limited simulations), confirming that E-modes provide a check on the anomalies that is largely independent of temperature data. Compared to Planck component-separated CMB data (smica), the putative LiteBIRD survey would reduce errors on E-mode anomaly estimators by factors of ∼3 for hemispherical power asymmetry and point-parity asymmetry, and by ∼26 for lack of large-scale correlation. The improvement in Q–O alignment is not obvious due to large cosmic variance, but we found the ability to pin down the estimator value will be improved by a factor ≳100. Improvements with CLASS are intermediate to these.

Cosmic microwave background radiation↗
DOE OSTI2020

Stochasticity and robustness in spiking neural networks

Despite drawing inspiration from biological systems which are inherently noisy and variable, artificial neural networks have been shown to require precise weights to carry out the task which they are trained to accomplish. This creates a challenge when adapting these artificial networks to specialized execution platforms which may encode weights in a manner which restricts their accuracy and/or precision.Reflecting back on the non-idealities which are observed in biological systems, we investigated the effect these properties have on the robustness of spiking neural networks under perturbations to weights. First, we examined techniques extant in conventional neural networks which resemble noisy processes, and postulated they may produce similar beneficial effects in spiking neural networks. Second, we evolved a set of spiking neural networks utilizing biological non-idealities to solve a pole-balancing task, and estimated their robustness. We showed it is higher in networks using noisy neurons, and demonstrated that one of these networks can perform well under the variance expected when a hafnium-oxide based resistive memory is used to encode synaptic weights. Lastly, we trained a series of networks using a surrogate gradient method on the MNIST classification task. We confirmed that these networks demonstrate similar trends in robustness to the evolved networks. We discuss these results and argue that they display empirical evidence supporting the role of noise as a regularizer which can increase network robustness.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2022

How Well do Multisatellite Products Capture the Space-Time Dynamics of Precipitation? Part II: Building an Error Model Through Spectral System Identification

Satellite precipitation products, as all quantitative estimates, come with some inherent degree of uncertainty. To associate a quantitative value of the uncertainty to each individual estimate, error modeling is necessary. Most of the error models proposed so far compute the uncertainty as a function of precipitation intensity only, and only at one specific spatio-temporal scale. We propose a spectral error model which accounts for the neighboring space-time dynamics of precipitation into the uncertainty quantification. Systematic distortions of the precipitation signal and random errors are characterized distinctively in every frequency-wavenumber band in the Fourier domain, to accurately characterize error across scales. The systematic distortions are represented as a deterministic space-time linear filtering term. The random errors are represented as a non-stationary additive noise. The spectral error model is applied to the IMERG multi satellite precipitation product and its parameters are estimated empirically through a system identification approach using the GV-MRMS gauge-radar measurements as reference (“truth”) over the eastern United States. The filtering term is found to be essentially low-pass. While traditional error models attribute most of the error variance to random errors, it is found here that the systematic filtering term explains 48% of the error variance at the native resolution of IMERG. This fact confirms that, at high resolution, filtering effects in satellite precipitation products cannot be ignored, and that the error cannot be represented as a purely random additive or multiplicative term. An important consequence is that precipitation estimates derived from totally different sources shall not be expected to automatically have statistically independent errors.

Precipitation↗
NASA NTRS1977

ALTKAL: An optimum linear filter for GEOS-3 altimeter data

ALTKAL is a computer program designed to smooth sea surface height data obtained from the GEOS 3 altimeter, and to produce minimum variance estimates of sea surface height and sea surface slopes, along with their standard derivations. The program operates by processing the data through a Kalman filter in both the forward and backward directions, and optimally combining the results. The sea surface height signal is considered to have a geoid signal, modeled by a third order Gauss-Markov process, corrupted by additive white noise. The governing parameters for the signal and noise processes are the signal correlation length and the signal-to-noise ratio. Mathematical derivations of the filtering and smoothing algorithms are presented. The smoother characteristics are illustrated by giving the frequency response, the data weighting sequence and the transfer function of a realistic steady-state smoother example. Based on nominal estimates for geoidal undulation amplitude and correlation length, standard deviations for the estimated sea surface height and slope are 12 cm and 3 arc seconds, respectively.

Fang, B. T.↗
DOE OSTI2022

A Self-learning Neural Network Approach for Radio Frequency Interference Detection and Removal in Radio Astronomy

In this work, we present a novel neural network (NN) method for the detection and removal of radio frequency interference (RFI) from the raw digitized signal in the signal processing chain of a typical radio astronomy experiment. The main advantage of our method is that it does not require a training set. Instead, our method relies on the fact that the true signal of interest coming from astronomical sources is thermal and therefore described as a Gaussian random process, which cannot be compressed. We employ a variational encoder/decoder network to find the compressible information in the data stream that can explain the most variance with the fewest degrees of freedom. We demonstrate it on a set of toy problems and stored ring buffers from the Baryon Mapping eXperiment prototype. We find that the RFI subtraction is effective at cleaning simulated time streams: While we find that the power spectra of the RFI-cleaned time streams output by the NN suffer from extra signal consistent with additive noise, we find that it is generally around percent level across the band and sub 10% in contaminated spectral channels even when RFI power is an order of magnitude larger than the signal. We discuss the advantages and limitations of this method and possible implementation in the front end of future radio experiments.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1989

Optical rate sensor algorithms

Optical sensors, in particular Charge Coupled Device (CCD) arrays, will be used on Space Station to track stars in order to provide inertial attitude reference. Algorithms are presented to derive attitude rate from the optical sensors. The first algorithm is a recursive differentiator. A variance reduction factor (VRF) of 0.0228 was achieved with a rise time of 10 samples. A VRF of 0.2522 gives a rise time of 4 samples. The second algorithm is based on the direct manipulation of the pixel intensity outputs of the sensor. In 1-dimensional simulations, the derived rate was with 0.07 percent of the actual rate in the presence of additive Gaussian noise with a signal to noise ratio of 60 dB.

Uhde-Lacovara, Jo A.↗
NASA NTRS1984

LANDSAT-4 MSS and TM Spectral Class Comparison and Coherent Noise Analysis

A detailed spectral analysis is conducted of thematic mapper and MSS data for an area near Des Moines, Iowa. Data are utilized from 7 blocks distributed throughout the area which included agricultural, forest, suburan, urban, and water scene types. The blocks are processed using a clustering algorithm to produce up to 18 cluster groupings for each block. Each cluster class is then identified with a ground-cover class using aerial photography and maps of the area. The clusters from each of the 7 blocks are inspected with regard to separability, mean, and variances. The separability measure used in the transformed divergence function or processor measures the statistical distance between classes based on class means and covariance matrices. The measure has a maximum value of 2,000 and the minimum of 0. Spectrally, very close classes will typically have values as low as 50 to 500.

Anuta, P. E.↗
NASA NTRS1985

Performance of the Dsa's Subcarrier Demodulation Digital Loop

The subcarrier demodulation digital loop is part of the baseband assembly. The subcarrier demodulator is a fourth-order Costas-type loop corresponding to a type 2 analog loop in terms of steady state response. The expected value and the variance of the error signal are determined as functions of the input SNR. A Nyquist sampling rate of the input signal is assumed. From the integro-difference equations a mixed s/z domain block diagram is obtained. From the loop's transfer function a set of gains for the loop filter is obtained. Also, a set of state equations is presented for future reference. Finally, the noise-equivalent bandwidths are calculated for normalized computation times of 0, 0.25 and 0.5. The subcarrier demodulator analyzed tracks a parabolic phase input with finite steady state error. Since at each update instant the loop gains are adjusted to compensate for the variations in SNR of the input signal, the noise-equivalent bandwidth is maintained constant.

Simon, M. K.↗
NASA NTRS2001

Spectral Dimensionality and Scale of Urban Radiance

Characterization of urban radiance and reflectance is important for understanding the effects of solar energy flux on the urban environment as well as for satellite mapping of urban settlement patterns. Spectral mixture analyses of Landsat and Ikonos imagery suggest that the urban radiance field can very often be described with combinations of three or four spectral endmembers. Dimensionality estimates of Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) radiance measurements of urban areas reveal the existence of 30 to 60 spectral dimensions. The extent to which broadband imagery collected by operational satellites can represent the higher dimensional mixing space is a function of both the spatial and spectral resolution of the sensor. AVIRIS imagery offers the spatial and spectral resolution necessary to investigate the scale dependence of the spectral dimensionality. Dimensionality estimates derived from Minimum Noise Fraction (MNF) eigenvalue distributions show a distinct scale dependence for AVIRIS radiance measurements of Milpitas, California. Apparent dimensionality diminishes from almost 40 to less than 10 spectral dimensions between scales of 8000 m and 300 m. The 10 to 30 m scale of most features in urban mosaics results in substantial spectral mixing at the 20 m scale of high altitude AVIRIS pixels. Much of the variance at pixel scales is therefore likely to result from actual differences in surface reflectance at pixel scales. Spatial smoothing and spectral subsampling of AVIRIS spectra both result in substantial loss of information and reduction of apparent dimensionality, but the primary spectral endmembers in all cases are analogous to those found in global analyses of Landsat and Ikonos imagery of other urban areas.

Small, Christopher↗
NASA NTRS2013

Spatial Statistical Data Fusion (SSDF)

As remote sensing for scientific purposes has transitioned from an experimental technology to an operational one, the selection of instruments has become more coordinated, so that the scientific community can exploit complementary measurements. However, tech nological and scientific heterogeneity across devices means that the statistical characteristics of the data they collect are different. The challenge addressed here is how to combine heterogeneous remote sensing data sets in a way that yields optimal statistical estimates of the underlying geophysical field, and provides rigorous uncertainty measures for those estimates. Different remote sensing data sets may have different spatial resolutions, different measurement error biases and variances, and other disparate characteristics. A state-of-the-art spatial statistical model was used to relate the true, but not directly observed, geophysical field to noisy, spatial aggregates observed by remote sensing instruments. The spatial covariances of the true field and the covariances of the true field with the observations were modeled. The observations are spatial averages of the true field values, over pixels, with different measurement noise superimposed. A kriging framework is used to infer optimal (minimum mean squared error and unbiased) estimates of the true field at point locations from pixel-level, noisy observations. A key feature of the spatial statistical model is the spatial mixed effects model that underlies it. The approach models the spatial covariance function of the underlying field using linear combinations of basis functions of fixed size. Approaches based on kriging require the inversion of very large spatial covariance matrices, and this is usually done by making simplifying assumptions about spatial covariance structure that simply do not hold for geophysical variables. In contrast, this method does not require these assumptions, and is also computationally much faster. This method is fundamentally different than other approaches to data fusion for remote sensing data because it is inferential rather than merely descriptive. All approaches combine data in a way that minimizes some specified loss function. Most of these are more or less ad hoc criteria based on what looks good to the eye, or some criteria that relate only to the data at hand.

Braverman, Amy J.↗
DOE OSTI2025

Data and scripts from: “Denoising autoencoder for reconstructing sensor observation data and predicting evapotranspiration: noisy and missing values repair and uncertainty quantification”

This data package includes data and scripts from the manuscript “Denoising autoencoder for reconstructing sensor observation data and predicting evapotranspiration: noisy and missing values repair and uncertainty quantification”.The study addressed common challenges faced in environmental sensing and modeling, including uncertain input data, missing sensor observations, and high-dimensional datasets with interrelated but redundant variables. Point-scaled meteorological and soil sensor observations were perturbed with noises and missing values, and denoising autoencoder (DAE) neural networks were developed to reconstruct the perturbed data and further predict evapotranspiration. This study concluded that (1) the reconstruction quality of each variable depends on its cross-correlation and alignment to the underlying data structure, (2) uncertainties from the models were overall stronger than those from the data corruption, and (3) there was a tradeoff between reducing bias and reducing variance when evaluating the uncertainty of the machine learning models.This package includes:(1) Four ipython scripts (.ipynb): “DAE_train.ipynb” trains and evaluates DAE neural networks, “DAE_predict.ipynb” makes predictions from the trained DAE models, “ET_train.ipynb” trains and evaluates ET prediction neural networks, and “ET_predict.ipynb” makes predictions from trained ET models.(2) One python file (.py): “methods.py” includes all user-defined functions and python codes used in the ipython scripts.(3) A “sub_models” folder that includes five trained DAE neural networks (in pytorch format, .pt), which could be used to ingest input data before being fed to the downstream ET models in ‘ET_train.ipynb” or ‘ET_predict.ipynb’.(4) Two data files (.csv). Daily meteorological, vegetation, and soil data is in “df_data.csv”, where “df_meta.csv” contains the location and time information of “df_data.csv”. Each row (index) in “df_meta.csv” corresponds to each row in “df_data.csv”. These data files are formatted to follow the data structure requirements and be directly used in the ipython scripts, and they have been shuffled chronologically to train machine learning models. The meteorological and soil data was collected using point sensors between 2019-2023 at(4.a) Three shrub-dominated field sites in East River, Colorado (named “ph1”, “ph2” and “sg5” in “df_meta.csv”, where “ph1” and “ph2” were located at PumpHouse Hillslopes, and “sg5” was at Snodgrass Mountain meadow) and(4.b) One outdoor, mesoscale, and herbaceous-dominated experiment in Berkeley, California (named “tb” in “df_meta.csv”, short for Smartsoils Testbed at Lawrence Berkeley National Lab).- See "df_data_dd.csv" and "df_meta_dd.csv" for variable descriptions and the Methods section for additional data processing steps. See "flmd.csv" and "README.txt" for brief file descriptions.- All ipython scripts and python files are written in and require PYTHON language software.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1983

The fundamental structure function of oscillator noise models

Continuous-time models of oscillator phase noise x(t) usually have stationary nth differences, for some n. The covariance structure of such a model can be characterized in the time domain by the structure function: D sub n (t;gamma sub 1, gamma sub 2) = E delta (n) sub gamma sub 1 x(s+t) delta(n) sub gamma sub 2 x (s). Although formulas for the special case D sub 2 (0;gamma,gamma) (the Allan variance times 2 gamma(2)) exist for power-law spectral models, certain estimation problems require a more complete knowledge of (0). Exhibited is a much simpler function of one time variable, D(t), from which (0) can easily be obtained from the spectral density by uncomplicated integrations. Believing that D(t) is the simplest function of time that holds the same information as (0), D(t) is called the fundamental structure function. D(t) is computed for several power-law spectral models. Two examples are D(t) = K/t/(3) for random walk FM, D(t) = Kt(2) 1n/t/ for flicker FM. Then, to demonstrate its use, a BASIC program is given that computes means and variances of two Allan variance estimators, one of which incorporates a method of frequency drift estimation and removal.

Greenhall, C. A.↗
NASA NTRS1985

Statistical methods for efficient design of community surveys of response to noise: Random coefficients regression models

Research studies of residents' responses to noise consist of interviews with samples of individuals who are drawn from a number of different compact study areas. The statistical techniques developed provide a basis for those sample design decisions. These techniques are suitable for a wide range of sample survey applications. A sample may consist of a random sample of residents selected from a sample of compact study areas, or in a more complex design, of a sample of residents selected from a sample of larger areas (e.g., cities). The techniques may be applied to estimates of the effects on annoyance of noise level, numbers of noise events, the time-of-day of the events, ambient noise levels, or other factors. Methods are provided for determining, in advance, how accurately these effects can be estimated for different sample sizes and study designs. Using a simple cost function, they also provide for optimum allocation of the sample across the stages of the design for estimating these effects. These techniques are developed via a regression model in which the regression coefficients are assumed to be random, with components of variance associated with the various stages of a multi-stage sample design.

Tomberlin, T. J.↗