Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63

Median statistics estimate of the galactic rotational velocity

We compile a complete collection of 18 recent (from 2000 to 2017) measurements of Θ 0 , the rotational velocity of the Milky Way at R 0 (the radial distance of the Sun from the Galactic center). These measurements use tracers that are believed to more accurately reflect the systematic rotation of the Milky Way. Unlike other recent compilations of Θ 0 , our collection includes only independent measurements. We find that these 18 measurements are distributed in a mildly non-Gaussian fashion and a median statistics estimate indicates Θ 0 = 220 ± 10 kms –1 (2σ error) as the most reliable summary, at R 0 = 8.0 ± 0.3 kpc (2σ error).

(cosmology:) cosmological parameters↗

Advanced Water Vapor Lidar Detection System

In the present water vapor lidar system, the detected signal is sent over long cables to a waveform digitizer in a CAMAC crate. This has the disadvantage of transmitting analog signals for a relatively long distance, which is subjected to pickup noise, leading to a decrease in the signal to noise ratio. Generally, errors in the measurement of water vapor with the DIAL method arise from both random and systematic sources. Systematic errors in DIAL measurements are caused by both atmospheric and instrumentation effects. The selection of the on-line alexandrite laser with a narrow linewidth, suitable intensity and high spectral purity, and its operation at the center of the water vapor lines, ensures minimum influence in the DIAL measurement that are caused by the laser spectral distribution and avoid system overloads. Random errors are caused by noise in the detected signal. Variability of the photon statistics in the lidar return signal, noise resulting from detector dark current, and noise in the background signal are the main sources of random error. This type of error can be minimized by maximizing the signal to noise ratio. The increase in the signal to noise ratio can be achieved by several ways. One way is to increase the laser pulse energy, by increasing its amplitude or the pulse repetition rate. Another way, is to use a detector system with higher quantum efficiency and lower noise, on the other hand, the selection of a narrow band optical filter that rejects most of the day background light and retains high optical efficiency is an important issue. Following acquisition of the lidar data, we minimize random errors in the DIAL measurement by averaging the data, but this will result in the reduction of the vertical and horizontal resolutions. Thus, a trade off is necessary to achieve a balance between the spatial resolution and the measurement precision. Therefore, the main goal of this research effort is to increase the signal to noise ratio by a factor of 10 over the current system, using a newly evaluated, very low noise avalanche photo diode detector and constructing a 10 MHz waveform digitizer which will replace the current CAMAC system.

Elsayed-Ali, Hani↗

Statistical Projections for Multi-resolution, Multi-dimensional Visual Data Exploration and Analysis

An ongoing challenge in visual exploration and analysis of large, multi-dimensional datasets is how to present useful, concise information to a user for some specific visualization tasks. Typical approaches to this problem have proposed either reduced-resolution versions of data, or projections of data, or both. These approaches still have some limitations such as consuming high computation or suffering from errors. In this work, we explore the use of a statistical metric as the basis for both projections and reduced-resolution versions of data, with a particular focus on preserving one key trait in data, namely variation. We use two different case studies to explore this idea, one that uses a synthetic dataset, and another that uses a large ensemble collection produced by an atmospheric modeling code to study long-term changes in global precipitation. The primary findings of our work are that in terms of preserving the variation signal inherent in data, that using a statistical measure more faithfully preserves this key characteristic across both multi-dimensional projections and multi-resolution representations than a methodology based upon averaging.

54 ENVIRONMENTAL SCIENCES↗

Spatial Statistical Data Fusion (SSDF)

As remote sensing for scientific purposes has transitioned from an experimental technology to an operational one, the selection of instruments has become more coordinated, so that the scientific community can exploit complementary measurements. However, tech nological and scientific heterogeneity across devices means that the statistical characteristics of the data they collect are different. The challenge addressed here is how to combine heterogeneous remote sensing data sets in a way that yields optimal statistical estimates of the underlying geophysical field, and provides rigorous uncertainty measures for those estimates. Different remote sensing data sets may have different spatial resolutions, different measurement error biases and variances, and other disparate characteristics. A state-of-the-art spatial statistical model was used to relate the true, but not directly observed, geophysical field to noisy, spatial aggregates observed by remote sensing instruments. The spatial covariances of the true field and the covariances of the true field with the observations were modeled. The observations are spatial averages of the true field values, over pixels, with different measurement noise superimposed. A kriging framework is used to infer optimal (minimum mean squared error and unbiased) estimates of the true field at point locations from pixel-level, noisy observations. A key feature of the spatial statistical model is the spatial mixed effects model that underlies it. The approach models the spatial covariance function of the underlying field using linear combinations of basis functions of fixed size. Approaches based on kriging require the inversion of very large spatial covariance matrices, and this is usually done by making simplifying assumptions about spatial covariance structure that simply do not hold for geophysical variables. In contrast, this method does not require these assumptions, and is also computationally much faster. This method is fundamentally different than other approaches to data fusion for remote sensing data because it is inferential rather than merely descriptive. All approaches combine data in a way that minimizes some specified loss function. Most of these are more or less ad hoc criteria based on what looks good to the eye, or some criteria that relate only to the data at hand.

Braverman, Amy J.↗

Leveraging interpolation models and error bounds for verifiable scientific machine learning

Effective verification and validation techniques for modern scientific machine learning workflows are challenging to devise. Statistical methods are abundant and easily deployed, but often rely on speculative assumptions about the data and methods involved. Error bounds for classical interpolation techniques can provide mathematically rigorous estimates of accuracy, but often are difficult or impractical to determine computationally. Here, in this work, we present a best-of-both-worlds approach to verifiable scientific machine learning by demonstrating that (1) multiple standard interpolation techniques have informative error bounds that can be computed or estimated efficiently; (2) comparative performance among distinct interpolants can aid in validation goals; (3) deploying interpolation methods on latent spaces generated by deep learning techniques enables some interpretability for black-box models. We present a detailed case study of our approach for predicting lift-drag ratios from airfoil images. Code developed for this work is available in a public Github repository.

97 MATHEMATICS AND COMPUTING↗

Study of different filtering techniques applied to spectra from airborne gamma spectrometry

One of the features of spectra obtained by airborne gamma spectrometry is low counting statistics due to the short acquisition time (1 s) and the large source-detector distance (40 m). It leads to considerable uncertainty in radionuclide identification and determination of their respective activities from the windows method recommended by the IAEA, especially for low-level radioactivity. The present work compares the results obtained with filters in terms of errors of the filtered spectra with the window method and over the whole gamma energy range. The results are used to determine which filtering technique is the most suitable in combination with some method for total stripping of the spectrum. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Scale Dependence of Statistics of Spatially Averaged Rain Rate Seen in TOGA COARE Comparison with Predictions from a Stochastic Model

A characteristic feature of rainfall statistics is that they in general depend on the space and time scales over which rain data are averaged. As a part of an earlier effort to determine the sampling error of satellite rain averages, a space-time model of rainfall statistics was developed to describe the statistics of gridded rain observed in GATE. The model allows one to compute the second moment statistics of space- and time-averaged rain rate which can be fitted to satellite or rain gauge data to determine the four model parameters appearing in the precipitation spectrum - an overall strength parameter, a characteristic length separating the long and short wavelength regimes and a characteristic relaxation time for decay of the autocorrelation of the instantaneous local rain rate and a certain 'fractal' power law exponent. For area-averaged instantaneous rain rate, this exponent governs the power law dependence of these statistics on the averaging length scale $L$ predicted by the model in the limit of small $L$. In particular, the variance of rain rate averaged over an $L \times L$ area exhibits a power law singularity as $L \rightarrow 0$. In the present work the model is used to investigate how the statistics of area-averaged rain rate over the tropical Western Pacific measured with ship borne radar during TOGA COARE (Tropical Ocean Global Atmosphere Coupled Ocean Atmospheric Response Experiment) and gridded on a 2 km grid depends on the size of the spatial averaging scale. Good agreement is found between the data and predictions from the model over a wide range of averaging length scales.

Kundu, Prasun K.↗

Unsteady Pressure-Sensitive-Paint Shot Noise Reduction

In the study of unsteady Pressure-Sensitive Paint (uPSP) image data sets, pixel intensity values collected by Phantom cameras from multiple perspectives are used to calculate the surface pressure of an experimental model. This paper focuses on mitigation of shot noise which is introduced into the image data set by the cameras. Shot noise impacts the quality of data collected, increasing the system error in its pressure value calculations. This paper characterises statistical methods to reduce shot noise within experimental data by taking an average or weighted average across an area of pixels of their respective counts. Each combined-pixel has a higher total effective intensity value and therefore exhibits reduced noise throughout its time history. This is demonstrated by calculating the standard deviations of the combined pixel values through time, which decrease as the combined pixel area increases. Finally, these methods are compared across experimental wind tunnel conditions to examine their effectiveness at different Mach numbers. Ultimately, the results are used to recommend a blur filter type and size which will be applied to the raw image data prior to processing, as well as a minimum camera resolution for future experiments. Downstream of the filter application, the software to convert the 2D image data sets into surface pressure readings on a 3D grid use a ratio of decimation that assigns multiple pixels to each 3D grid node. This decimation ratio will also be aligned with the size of the blur filter, resulting in a more manageable data set size and compromised spatial resolution. Combined with the effect of the blur filter, the resulting pixel intensity readings will exhibit significantly reduced shot noise, reducing the magnitude of uncertainty and error in the final calculated pressure. For future tests, the camera spatial resolution must be sufficient to capture small flow and model features even after the recommended blur filter is applied. The image data set is taken from a uPSP experiment of the Space Launch System Block 1 cargo vehicle model in September 2019.

Lucy Tang↗

Unsteady Pressure-Sensitive Paint (UPSP) Shot Noise Reduction

In the study of unsteady Pressure-Sensitive Paint (uPSP) image data sets, pixel intensity values collected by Phantom cameras from multiple perspectives are used to calculate the surface pressure of an experimental model. This paper focuses on mitigation of shot noise which is introduced into the image data set by the cameras. Shot noise impacts the quality of data collected, increasing the system error in its pressure value calculations. This paper characterises statistical methods to reduce shot noise within experimental data by taking an average or weighted average across an area of pixels of their respective counts. Each combined-pixel has a higher total effective intensity value and therefore exhibits reduced noise throughout its time history. This is demonstrated by calculating the standard deviations of the combined pixel values through time, which decrease as the combined pixel area increases. Finally, these methods are compared across experimental wind tunnel conditions to examine their effectiveness at different Mach numbers. Ultimately, the results are used to recommend a blur filter type and size which will be applied to the raw image data prior to processing, as well as a minimum camera resolution for future experiments. Downstream of the filter application, the software to convert the 2D image data sets into surface pressure readings on a 3D grid use a ratio of decimation that assigns multiple pixels to each 3D grid node. This decimation ratio will also be aligned with the size of the blur filter, resulting in a more manageable data set size and compromised spatial resolution. Combined with the effect of the blur filter, the resulting pixel intensity readings will exhibit significantly reduced shot noise, reducing the magnitude of uncertainty and error in the final calculated pressure. For future tests, the camera spatial resolution must be sufficient to capture small flow and model features even after the recommended blur filter is applied. The image data set is taken from a uPSP experiment of the Space Launch System Block 1 cargo vehicle model in September 2019.

Lucy Tang↗

Analytical Assessment of Simultaneous Parallel Approach Feasibility from Total System Error

In a simultaneous paired approach to closely-spaced parallel runways, a pair of aircraft flies in close proximity on parallel approach paths. The aircraft pair must maintain a longitudinal separation within a range that avoids wake encounters and, if one of the aircraft blunders, avoids collision. Wake avoidance defines the rear gate of the longitudinal separation. The lead aircraft generates a wake vortex that, with the aid of crosswinds, can travel laterally onto the path of the trail aircraft. As runway separation decreases, the wake has less distance to traverse to reach the path of the trail aircraft. The total system error of each aircraft further reduces this distance. The total system error is often modeled as a probability distribution function. Therefore, Monte-Carlo simulations are a favored tool for assessing a "safe" rear-gate. However, safety for paired approaches typically requires that a catastrophic wake encounter be a rare one-in-a-billion event during normal operation. Using a Monte-Carlo simulation to assert this event rarity with confidence requires a massive number of runs. Such large runs do not lend themselves to rapid turn-around during the early stages of investigation when the goal is to eliminate the infeasible regions of the solution space and to perform trades among the independent variables in the operational concept. One can employ statistical analysis using simplified models more efficiently to narrow the solution space and identify promising trades for more in-depth investigation using Monte-Carlo simulations. These simple, analytical models not only have to address the uncertainty of the total system error but also the uncertainty in navigation sources used to alert an abort of the procedure. This paper presents a method for integrating total system error, procedure abort rates, avionics failures, and surveillance errors into a statistical analysis that identifies the likely feasible runway separations for simultaneous paired approaches.

Madden, Michael M.↗

Prospects for in vivo estimation of photon linear attenuation coefficients using postprocessing dual-energy CT imaging on a commercial scanner: Comparison of analytic and polyenergetic statistical reconstruction algorithms

Purpose: Accurate patient-specific photon cross-section information is needed to support more accurate model-based dose calculation for low energy photon-emitting modalities in medicine such as brachytherapy and kilovoltage x-ray imaging procedures. A postprocessing dual-energy CT (pDECT) technique for noninvasivein vivo estimation of photon linear attenuation coefficients has been experimentally implemented on a commercial CT scanner and its accuracy assessed in idealized phantom geometries. Methods: Eight test materials of known composition and density were used to compare pDECT-estimated linear attenuation coefficients to NIST reference values over an energy range from 10 keV to 1 MeV. As statistical image reconstruction (SIR) has been shown to reconstruct images with less random and systematic error than conventional filtered backprojection (FBP), the pDECT technique was implemented with both an in-house polyenergetic SIR algorithm, alternating minimization (AM), as well as a conventional FBP reconstruction algorithm. Improvement from increased spectral separation was also investigated by filtering the high-energy beam with an additional 0.5 mm of tin. The law of propagated uncertainty was employed to assess the sensitivity of the pDECT process to errors in reconstructed images. Results: Mean pDECT-estimated linear attenuation coefficients for the eight test materials agreed within 1% of NIST reference values for energies from 1 MeV down to 30 keV, with mean errors rising to between 3% and 6% at 10 keV, indicating that the method is unbiased when measurement and calibration phantom geometries are matched. Reconstruction with FBP and AM algorithms conferred similar mean pDECT accuracy. However, single-voxel pDECT estimates reconstructed on a 1 × 1 × 3 mm{sup 3} grid are shown to be highly sensitive to reconstructed image uncertainty; in some cases pDECT attenuation coefficient estimates exhibited standard deviations on the order of 20% around the mean. Reconstruction with the statistical AM algorithm led to standard deviations roughly 40% to 60% less than FBP reconstruction. Additional tin filtration of the high energy beam exhibits similar pDECT estimation accuracy as the unfiltered beam, even when scanning with only 25% of the dose. Using the law of propagated uncertainty, low Z materials are found to be more sensitive to image reconstruction errors than high Z materials. Furthermore, it is estimated that reconstructed CT image uncertainty must be limited to less than 0.25% to achieve a target linear-attenuation coefficient estimation uncertainty of 3% at 28 keV. Conclusions: That pDECT supports mean linear attenuation coefficient measurement accuracies of 1% of reference values for energies greater than 30 keV is encouraging. However, the sensitivity of the pDECT measurements to noise and systematic errors in reconstructed CT images warrants further investigation in more complex phantom geometries. The investigated statistical reconstruction algorithm, AM, reduced random measurement uncertainty relative to FBP owing to improved noise performance. These early results also support efforts to increase DE spectral separation, which can further reduce the pDECT sensitivity to measurement uncertainty.

61 RADIATION PROTECTION AND DOSIMETRY↗

Isovector Axial Charge and Form Factors of Nucleons from Lattice QCD

A survey of the calculations of the isovector axial vector form factor of the nucleon using lattice QCD is presented. Attention is paid to statistical and systematic uncertainties, in particular those due to excited state contributions. Based on a comparison of results from various collaborations, a case is made that lattice results are consistent within 10%. A similar level of uncertainty is in the axial charge gAu−d, the mean squared axial charge radius ⟨rA2⟩, the induced pseudoscalar charge gP∗, and the pion–nucleon coupling gπNN. Even with the current methodology, a significant reduction in errors is expected over the next few years with higher statistics data on more ensembles closer to the physical point. Lattice QCD results for the form factor GA(Q2) are compatible with those obtained from the recent MINERνA experiment but lie 2–3σ higher than the phenomenological extraction from the old ν–deuterium bubble chamber scattering data for Q2>0.3 GeV2. Current data show that the dipole ansatz does not have enough parameters to fit the form factor over the range 0≤Q2≤1 GeV2, whereas even a z2 truncation of the z expansion or a low order Padé are sufficient. Looking ahead, lattice QCD calculations will provide increasingly precise results over the range 0≤Q2≤1 GeV2, and MINERνA-like experiments will extend the range to Q2∼2 GeV2 or higher. Nevertheless, improvements in lattice methods to (i) further control excited state contributions and (ii) extend the range of Q2 are needed.

Astronomy & Astrophysics↗

On the Statistical Calibration of Physical Models

ABSTRACT We introduce a novel statistical calibration framework for physical models, relying on probabilistic embedding of model discrepancy error within the model. For clarity of illustration, we take the measurement errors out of consideration, calibrating a chemical model of interest with respect to a more detailed model, considered as “truth” for the present purpose. We employ Bayesian statistical methods for such model‐to‐model calibration and demonstrate their capabilities on simple synthetic models, leading to a well‐defined parameter estimation problem that employs approximate Bayesian computation. The method is then demonstrated on two case studies for calibration of kinetic rate parameters for methane air chemistry, where ignition time information from a detailed elementary‐step kinetic model is used to estimate rate coefficients of a simple chemical mechanism. We show that the calibrated model predictions fit the data and that uncertainty in these predictions is consistent in a mean‐square sense with the discrepancy from the detailed model data.

Sargsyan, K.↗

At least some errors are randomly generated (Freud was wrong)

An experiment was carried out to expose something about human error generating mechanisms. In the context of the experiment, an error was made when a subject pressed the wrong key on a computer keyboard or pressed no key at all in the time allotted. These might be considered, respectively, errors of substitution and errors of omission. Each of seven subjects saw a sequence of three digital numbers, made an easily learned binary judgement about each, and was to press the appropriate one of two keys. Each session consisted of 1,000 presentations of randomly permuted, fixed numbers broken into 10 blocks of 100. One of two keys should have been pressed within one second of the onset of each stimulus. These data were subjected to statistical analyses in order to probe the nature of the error generating mechanisms. Goodness of fit tests for a Poisson distribution for the number of errors per 50 trial interval and for an exponential distribution of the length of the intervals between errors were carried out. There is evidence for an endogenous mechanism that may best be described as a random error generator. Furthermore, an item analysis of the number of errors produced per stimulus suggests the existence of a second mechanism operating on task driven factors producing exogenous errors. Some errors, at least, are the result of constant probability generating mechanisms with error rate idiosyncratically determined for each subject.

Sellen, A. J.↗

Examining the Impact of Local Constraint Violations on Energy Computations in DFT

ABSTRACT This work examines the impact of locally imposed constraints in Density Functional Theory (DFT). Using a metric referred to as the extent of violation index (EVI), we quantify how well exchange‐correlation functionals adhere to local constraints. Applying EVIs to a diverse set of molecules for GGA functionals reveals constraint violations, particularly for semi‐empirical functionals. We leverage EVIs to explore potential connections between these violations and errors in chemical properties. While no correlation is observed for atomization energies, a significant statistical correlation emerges between EVIs and total energies. Similarly, the analysis of reaction energies suggests weak positive correlations for specific constraints. However, definitive conclusions about error cancellation mechanisms cannot be made at this time. These observations revealed by EVIs may be useful for consideration when designing future generations of semilocal functionals.

Khanna, Vaibhav [Department of Chemistry Universit↗

The Influence of Observation Errors on Analysis Error and Forecast Skill Investigated with an Observing System Simulation Experiment

The Global Modeling and Assimilation Office (GMAO) observing system simulation experiment (OSSE) framework is used to explore the response of analysis error and forecast skill to observation quality. In an OSSE, synthetic observations may be created that have much smaller error than real observations, and precisely quantified error may be applied to these synthetic observations. Three experiments are performed in which synthetic observations with magnitudes of applied observation error that vary from zero to twice the estimated realistic error are ingested into the Goddard Earth Observing System Model (GEOS-5) with Gridpoint Statistical Interpolation (GSI) data assimilation for a one-month period representing July. The analysis increment and observation innovation are strongly impacted by observation error, with much larger variances for increased observation error. The analysis quality is degraded by increased observation error, but the change in root-mean-square error of the analysis state is small relative to the total analysis error. Surprisingly, in the 120 hour forecast increased observation error only yields a slight decline in forecast skill in the extratropics, and no discernable degradation of forecast skill in the tropics.

Observation Error↗