Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,801 records · Page 100
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

Adverse Events Involving Radiation Oncology Medical Devices: Comprehensive Analysis of US Food and Drug Administration Data, 1991 to 2015

Purpose: Radiation oncology relies on rapidly evolving technology and highly complex processes. The US Food and Drug Administration collects reports of adverse events related to medical devices. We sought to characterize all events involving radiation oncology devices (RODs) from the US Food and Drug Administration's postmarket surveillance Manufacturer and User Facility Device Experience (MAUDE) database, comparing these with non–radiation oncology devices. Methods and Materials: MAUDE data on RODs from 1991 to 2015 were sorted into 4 product categories (external beam, brachytherapy, planning systems, and simulation systems) and 5 device problem categories (software, mechanical, electrical, user error, and dose delivery impact). Outcomes included whether the device was evaluated by the manufacturer, adverse event type, remedial action, problem code, device age, and time since 510(k) approval. Descriptive statistics were performed with linear regression of time-series data. Results for RODs were compared with those for other devices by the Pearson χ{sup 2} test for categorical data and 2-sample Kolmogorov-Smirnov test for distributions. Results: There were 4234 ROD and 4,985,698 other device adverse event reports. Adverse event reports increased over time, and events involving RODs peaked in 2011. Most ROD reports involved external beam therapy (50.8%), followed by brachytherapy (24.9%) and treatment planning systems (21.6%). The top problem types were software (30.4%), mechanical (20.9%), and user error (20.4%). RODs differed significantly from other devices in each outcome (P<.001). RODs were more likely to be evaluated by the manufacturer after an event (46.9% vs 33.0%) but less likely to be recalled (10.5% vs 37.9%) (P<.001). Device age and time since 510(k) approval were shorter among RODs (P<.001). Conclusions: Compared with other devices, RODs may experience adverse events sooner after manufacture and market approval. Close postmarket surveillance, improved software design, and manufacturer–user training may help mitigate these events.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2018

Effects of exposure estimation errors on estimated exposure-response relations for PM2.5

Highlights: • Recent literature has identified associations between concentrations of fine particulate matter (PM2.5) in ambient air and adverse health effects at estimated exposure concentrations below current air ambient quality standards. • The models and analyses used do not usually quantify uncertainty about exposure estimates. • Realistic errors in exposure estimates can be estimated from available air quality monitoring stations by predicting concentrations at each station from concentrations at neighboring stations. • Exposure estimation errors are large enough to obscure low-dose nonlinearities or thresholds in the true concentration-response (C-R) function, artificially making them appear to be linear at low doses. • Better estimates of C-R functions will require modeling exposure distributions and estimation errors, rather than just estimating average exposure concentrations. Associations between fine particulate matter (PM2.5) exposure concentrations and a wide variety of undesirable outcomes, from autism and auto theft to elderly mortality, suicide, and violent crime, have been widely reported. Influential articles have argued that reducing National Ambient Air Quality Standards for PM2.5 is desirable to reduce these outcomes. Yet, other studies have found that reducing black smoke and other particulate matter by as much as 70% and dozens of micrograms per cubic meter has not detectably affected all-cause mortality rates even after decades, despite strong, statistically significant positive exposure concentration-response (C-R) associations between them. This paper examines whether this disconnect between association and causation might be explained in part by ignored estimation errors in estimated exposure concentrations. We use EPA air quality monitor data from the Los Angeles area of California to examine the shapes of estimated C-R functions for PM2.5 when the true C-R functions are assumed to be step functions with well-defined response thresholds. The estimated C-R functions mistakenly show risk as smoothly increasing with concentrations even well below the response thresholds, thus incorrectly predicting substantial risk reductions from reductions in concentrations that do not affect health risks. We conclude that ignored estimation errors obscure the shapes of true C-R functions, including possible thresholds, possibly leading to unrealistic predictions of the changes in risk caused by changing exposures. Instead of estimating improvements in public health per unit reduction (e.g., per 10 µg/m{sup 3} decrease) in average PM2.5 concentrations, it may be essential to consider how interventions change the distributions of exposure concentrations.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2015

Decomposition of Sources of Errors in Seasonal Streamflow Forecasting over the U.S. Sunbelt

Seasonal streamflow forecasts, contingent on climate information, can be utilized to ensure water supply for multiple uses including municipal demands, hydroelectric power generation, and for planning agricultural operations. However, uncertainties in the streamflow forecasts pose significant challenges in their utilization in real-time operations. In this study, we systematically decompose various sources of errors in developing seasonal streamflow forecasts from two Land Surface Models (LSMs) (Noah3.2 and CLM2), which are forced with downscaled and disaggregated climate forecasts. In particular, the study quantifies the relative contributions of the sources of errors from LSMs, climate forecasts, and downscaling/disaggregation techniques in developing seasonal streamflow forecast. For this purpose, three month ahead seasonal precipitation forecasts from the ECHAM4.5 general circulation model (GCM) were statistically downscaled from 2.8deg to 1/8deg spatial resolution using principal component regression (PCR) and then temporally disaggregated from monthly to daily time step using kernel-nearest neighbor (K-NN) approach. For other climatic forcings, excluding precipitation, we considered the North American Land Data Assimilation System version 2 (NLDAS-2) hourly climatology over the years 1979 to 2010. Then the selected LSMs were forced with precipitation forecasts and NLDAS-2 hourly climatology to develop retrospective seasonal streamflow forecasts over a period of 20 years (1991-2010). Finally, the performance of LSMs in forecasting streamflow under different schemes was analyzed to quantify the relative contribution of various sources of errors in developing seasonal streamflow forecast. Our results indicate that the most dominant source of errors during winter and fall seasons is the errors due to ECHAM4.5 precipitation forecasts, while temporal disaggregation scheme contributes to maximum errors during summer season.

Decomposition↗
DOE OSTI2014

Brown dwarf photospheres are patchy: A Hubble space telescope near-infrared spectroscopic survey finds frequent low-level variability

Condensate clouds strongly impact the spectra of brown dwarfs and exoplanets. Recent discoveries of variable L/T transition dwarfs argued for patchy clouds in at least some ultracool atmospheres. This study aims to measure the frequency and level of spectral variability in brown dwarfs and to search for correlations with spectral type. We used Hubble Space Telescope/Wide Field Camera 3 to obtain spectroscopic time series for 22 brown dwarfs of spectral types ranging from L5 to T6 at 1.1-1.7 μm for ≈40 minutes per object. Using Bayesian analysis, we find six brown dwarfs with confident (p > 95%) variability in the relative flux in at least one wavelength region at sub-percent precision, and five brown dwarfs with tentative (p > 68%) variability. We derive a minimum variability fraction f{sub min}=27{sub −7}{sup +11}% over all covered spectral types. The fraction of variables is equal within errors for mid-L, late-L, and mid-T spectral types; for early-T dwarfs we do not find any confident variable but the sample is too small to derive meaningful limits. For some objects, the variability occurs primarily in the flux peak in the J or H band, others are variable throughout the spectrum or only in specific absorption regions. Four sources may have broadband peak-to-peak amplitudes exceeding 1%. Our measurements are not sensitive to very long periods, inclinations near pole-on and rotationally symmetric heterogeneity. The detection statistics are consistent with most brown dwarf photospheres being patchy. While multiple-percent near-infrared variability may be rare and confined to the L/T transition, low-level heterogeneities are a frequent characteristic of brown dwarf atmospheres.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Unfolding quantum computer readout noise

Abstract In the current era of noisy intermediate-scale quantum computers, noisy qubits can result in biased results for early quantum algorithm applications. This is a significant challenge for interpreting results from quantum computer simulations for quantum chemistry, nuclear physics, high energy physics (HEP), and other emerging scientific applications. An important class of qubit errors are readout errors. The most basic method to correct readout errors is matrix inversion, using a response matrix built from simple operations to probe the rate of transitions from known initial quantum states to readout outcomes. One challenge with inverting matrices with large off-diagonal components is that the results are sensitive to statistical fluctuations. This challenge is familiar to HEP, where prior-independent regularized matrix inversion techniques (“unfolding”) have been developed for years to correct for acceptance and detector effects, when performing differential cross section measurements. We study one such method, known as iterative Bayesian unfolding, as a potential tool for correcting readout errors from universal gate-based quantum computers. This method is shown to avoid pathologies from commonly used matrix inversion and least squares methods.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

A Markov chain Monte Carlo (MCMC) Bayesian inference approach to analyze apparent activation barriers and reaction orders from microreactor data

Statistical analysis of steady-state catalytic kinetic data is often limited by data sparsity due to the slow pace at which the data is collected. Data sparsity and limitations in statistical analysis make it difficult to differentiate between mechanistic models and catalytic sites. A Bayesian inference tool is reported for catalysis researchers to estimate error in the determination of reaction orders from steady state microreactor data. The benefits of a Bayesian inference approach are discussed, as an alternative to the more common frequentist approach. The approach incorporates prior knowledge of the system and the data collected to form an error estimate on reaction orders. We investigated the effects of three distinct data treatments—individual fitting of trials, pooled analysis, and constrained regression methods—on the precision and uncertainty of reaction order determinations. To assess the robustness of our findings, we conducted sensitivity analyses to evaluate the influence of Bayesian parameters on uncertainty estimation. Additionally, we utilized synthetic data to illustrate how data quality impacts the precision of uncertainty assessments. We show Bayesian analysis can obtain a more precise estimation of error with a sparse data set than a frequentist analysis. Finally, this work provides strong evidence that the adoption of Bayesian analysis of kinetic data may help researchers make more precise arguments as to the strength of their evidence for a particular mechanistic hypothesis, or in comparing across different catalysts.

42 ENGINEERING↗
DOE OSTI2022

Viscosity in water from first-principles and deep-neural-network simulations

Abstract We report on an extensive study of the viscosity of liquid water at near-ambient conditions, performed within the Green-Kubo theory of linear response and equilibrium ab initio molecular dynamics (AIMD), based on density-functional theory (DFT). In order to cope with the long simulation times necessary to achieve an acceptable statistical accuracy, our ab initio approach is enhanced with deep-neural-network potentials (NNP). This approach is first validated against AIMD results, obtained by using the Perdew–Burke–Ernzerhof (PBE) exchange-correlation functional and paying careful attention to crucial, yet often overlooked, aspects of the statistical data analysis. Then, we train a second NNP to a dataset generated from the Strongly Constrained and Appropriately Normed (SCAN) functional. Once the error resulting from the imperfect prediction of the melting line is offset by referring the simulated temperature to the theoretical melting one, our SCAN predictions of the shear viscosity of water are in very good agreement with experiments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Thinking Bayesian for plasma physicists

Bayesian statistics offers a powerful technique for plasma physicists to infer knowledge from the heterogeneous data types encountered. To explain this power, a simple example, Gaussian Process Regression, and the application of Bayesian statistics to inverse problems are explained. The likelihood is the key distribution because it contains the data model, or theoretic predictions, of the desired quantities. By using prior knowledge, the distribution of the inferred quantities of interest based on the data given can be inferred. Because it is a distribution of inferred quantities given the data and not a single prediction, uncertainty quantification is a natural consequence of Bayesian statistics. The benefits of machine learning in developing surrogate models for solving inverse problems are discussed, as well as progress in quantitatively understanding the errors that such a model introduces.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Probabilistic inversion of circular phase spectra: application to two-station phase-velocity dispersion estimation in western Canada

SUMMARY Periodic directional and temporal measurements are common in seismology, and necessitate specific statistical analyses that are appropriate for circular quantities. In this work, we explore the use of a von Mises distribution as a representation of errors on circular seismological observations. Specifically, we automate the estimation of surface-wave phase-velocity dispersion for the teleseismic two-station method, which generally suffers from a 2π phase ambiguity. The use of Bayesian inverse techniques, which aim to rigorously quantify model parameter uncertainty, have become widespread throughout seismology over the last decade. Here, we apply Bayesian inversion to measurements of surface-wave phase spectra in order to estimate 1-D, path-averaged Earth structure between station pairs. The dispersion curve and associated uncertainties are additional results of the inversion, which can then be used as input for subsequent analyses (e.g. tomography). We demonstrate this technique through application to surface-wave recordings from long-running seismic stations throughout western Canada. Our results for over 10 000 station pairs reveal first-order tectonic features consistent with previous studies, which provides confidence in our approach as well as an initial step towards resolving a full 3-D seismic velocity model for the region. This work also presents a foundation for the inversion of surface-wave phase spectra to estimate 3-D Earth structure directly. Finally, the ideas presented in this work are not limited to the inversion of surface-wave phase spectra, but can also be considered for Bayesian geophysical inversion of any circular quantities.

Gosselin, Jeremy M. (ORCID:0000000203754102)↗
DOE OSTI2016

Data on photoneutron reactions from various experiments for {sup 133}Cs, {sup 138}Ba and {sup 209}Bi nuclei

Basic methods for determining cross sections for photoneutron partial reactions are examined. They are obtained directly in experiments with quasimonoeneregetic annihilation photons or from the cross section for the (γ, xn) = (γ, 1n) + 2(γ, 2n) + 3(γ, 3n) +... neutron-yield reaction in experiments with bremsstrahlung photons by introducing corrections based on statistical nuclear-reaction theory. The difference in the conditions of these experiments, which leads to discrepancies between their results because of sizable systematic errors, is analyzed. Physical criteria are used to study the reliability of data on the photodisintegration of {sup 133}Cs, {sup 138}Ba, and {sup 209}Bi nuclei. The cross sections for partial and total reactions satisfying the reliability criteria are evaluated within the experimental–theoretical method (σ{sup eval}(γ, in) = F{sub i}{sup theor} × σ{sup expt}(γ, xn)) on the basis of the experimental cross sections σ{sup expt}(γ, xn) and the results of the calculations within the combined model of photonuclear reactions.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2020

Uncertainty Quantification in Scientific ML

The intricate interactions between data sampling, model selection and the inherent randomness in complex systems strongly emphasize the need for a rigorous characterization of ML algorithms. In conventional statistics, uncertainty quantification (UQ) provides this characterization by measuring how accurately a model reflects the physical reality and by studying the impact of different error sources on the prediction.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1981

The Theory and Practice of Estimating the Accuracy of Dynamic Flight-Determined Coefficients

Means of assessing the accuracy of maximum likelihood parameter estimates obtained from dynamic flight data are discussed. The most commonly used analytical predictors of accuracy are derived and compared from both statistical and simplified geometrics standpoints. The accuracy predictions are evaluated with real and simulated data, with an emphasis on practical considerations, such as modeling error. Improved computations of the Cramer-Rao bound to correct large discrepancies due to colored noise and modeling error are presented. The corrected Cramer-Rao bound is shown to be the best available analytical predictor of accuracy, and several practical examples of the use of the Cramer-Rao bound are given. Engineering judgement, aided by such analytical tools, is the final arbiter of accuracy estimation.

Maine, R. E.↗
NASA NTRS1993

Statistical fitting accuracy in photon correlation spectroscopy

Continuing our experimental investigation of the fitting accuracy associated with photon correlation spectroscopy, we collect 150 correlograms of light scattered at 90 deg from a thermostated sample of 91-nm-diameter, polystyrene latex spheres in water. The correlograms are taken with two correlators: one with linearly spaced channels and one with geometrically spaced channels. Decay rates are extracted from the single-exponential correlograms with both nonlinear least-squares fits and second-order cumulant fits. We make several statistical comparisons between the two fitting techniques and verify an earlier result that there is no sample-time dependence in the decay rate errors. We find, however, that the two fitting techniques give decay rates that differ by 1 percent.

Shaumeyer, J. N.↗
NASA NTRS1998

An Extended Objective Evaluation of the 29-km Eta Model for Weather Support to the United States Space Program

This report describes the Applied Meteorology Unit's objective verification of the National Centers for Environmental Prediction 29-km eta model during separate warm and cool season periods from May 1996 through January 1998. The verification of surface and upper-air point forecasts was performed at three selected stations important for 45th Weather Squadron, Spaceflight Meteorology Group, and National Weather Service, Melbourne operational weather concerns. The statistical evaluation identified model biases that may result from inadequate parameterization of physical processes. Since model biases are relatively small compared to the random error component, most of the total model error results from day-to-day variability in the forecasts and/or observations. To some extent, these nonsystematic errors reflect the variability in point observations that sample spatial and temporal scales of atmospheric phenomena that cannot be resolved by the model. On average, Meso-Eta point forecasts provide useful guidance for predicting the evolution of the larger scale environment. A more substantial challenge facing model users in real time is the discrimination of nonsystematic errors that tend to inflate the total forecast error. It is important that model users maintain awareness of ongoing model changes. Such changes are likely to modify the basic error characteristics, particularly near the surface.

Nutter, Paul↗
NASA NTRS2000

Preliminary Results from an Assimilation of Saharan Dust Using TOMS Radiances and the GOCART Model

At NASA Goddard we are developing a global aerosol data assimilation system that combines advances in remote sensing and modeling of atmospheric aerosols. The goal is to provide high resolution, 3-D aerosol distributions to the research community. Our first step is to develop a simple assimilation system for Saharan mineral aerosol. The Goddard Chemistry and Aerosol Radiation model (GOCART) provides accurate 3-D mineral aerosol size distributions. Surface mobilization, wet and dry deposition, convective and long-range transport are all driven by assimilated fields from the Goddard Earth Observing System Data Assimilation System, GEOS-DAS. Our version of GOCART transports sizes from .08-10 microns and only simulates Saharan dust. We draw the assimilation to two observables in this study: the TOMS aerosol index (Al) which is directly related to the ratio of the 340 and 380 radiances and the 380 radiance alone. The forward model that simulates the observables requires the aerosol optical thickness, the single scattering albedo and the height of the aerosol layer from the GOCART fields. The forward model also requires a refractive index for the dust. We test three index values to see which best fits the TOMS observables. These are 1) for Saharan dust reported by Patterson, 2) for a mixture of Saharan dust and a highly reflective material (sea salt or sulfate) and 3) for pure illite. The assimilation works best assuming either pure illite or the dust mixture. Our assimilation cycle first determines values of the aerosol index (Al) and the radiance at 380 nm based on the GOCART aerosol fields. Differences between the observed and GOCART model calculated Al and 380 nm radiance are first analyzed horizontally using the Physical-space Statistical Analysis System (PSAS). A quasi-Newton iteration is then performed to produce analyzed 3D aerosol fields according to parameterized background and observation error covariances. We only assimilate observations into the the GOCART model over regions of Africa and the Atlantic where mineral aerosols are dominant and carbonaceous aerosols are minimal.

Weaver, C. J.↗
NASA NTRS2003

First Year Wilkinson Microwave Anisotropy Probe(WMAP) Observations: Data Processing Methods and Systematic Errors Limits

We describe the calibration and data processing methods used to generate full-sky maps of the cosmic microwave background (CMB) from the first year of Wilkinson Microwave Anisotropy Probe (WMAP) observations. Detailed limits on residual systematic errors are assigned based largely on analyses of the flight data supplemented, where necessary, with results from ground tests. The data are calibrated in flight using the dipole modulation of the CMB due to the observatory's motion around the Sun. This constitutes a full-beam calibration source. An iterative algorithm simultaneously fits the time-ordered data to obtain calibration parameters and pixelized sky map temperatures. The noise properties are determined by analyzing the time-ordered data with this sky signal estimate subtracted. Based on this, we apply a pre-whitening filter to the time-ordered data to remove a low level of l/f noise. We infer and correct for a small (approx. 1 %) transmission imbalance between the two sky inputs to each differential radiometer, and we subtract a small sidelobe correction from the 23 GHz (K band) map prior to further analysis. No other systematic error corrections are applied to the data. Calibration and baseline artifacts, including the response to environmental perturbations, are negligible. Systematic uncertainties are comparable to statistical uncertainties in the characterization of the beam response. Both are accounted for in the covariance matrix of the window function and are propagated to uncertainties in the final power spectrum. We characterize the combined upper limits to residual systematic uncertainties through the pixel covariance matrix.

Hinshaw, G.↗
NASA NTRS2003

Sensitivity of the Assimilated Ozone in the UTLS to Model and Data Selection Changes

This presentation will discuss the sensitivity of assimilated ozone fields in the upper troposphere and lower stratosphere (UTLS) to a number of factors, focusing mainly on aspects of data selection and the prediction model. This is important, because assimilation represents an attempt to construct our best estimates of the true ozone field; however, inaccuracies in the UTLS ozone distribution translate into an uncertainty in factors such as the calculated radiative forcing of climate or the inferred stratosphere-troposphere exchange (STE) of ozone. The 3D ozone data assimilation system, from NASA's Global Modeling and Assimilation Office (GMAO), combines observations of total ozone column and stratospheric profiles with predictions from an off-line, parameterized chemistry and transport model (pCTM) to produce six-hourly, global analyses. The first experiments discussed assimilate ozone retrievals from the Earth-Probe Total Ozone Mapping Spectrometer (EPTOMS) and stratospheric profiles from the Solar Backscatter UltraViolet/2 (SBUV/2) instrument. The SBUV/2 ozone data have a coarse vertical resolution, with increased uncertainty below the ozone maximum, and TOMS provides only total ozone columns. Thus, the assimilated ozone profiles in the UTLS region are only weakly constrained by the incoming SBUV and TOMS data. Consequently, the assimilated ozone distribution should be sensitive to changes in inputs to the statistical analysis scheme. Sensitivity studies have been conducted to examine the responses to TOMS and SBUV/2 data selection, modifications of the forecast and observation error covariance models, and the model formulation (turning off chemistry or using different wind analyses in the pCTM). The second set of experiments includes an additional data type: ozone retrieved from infrared limb-emission by MIPAS on Envisat. These data offer not only improved vertical resolution in the stratosphere, but also give measurements in the polar night. Comparisons of the assimilated ozone fields from both sets of experiments with independent observations, primarily ozone sondes, are used to determine the impact of each of these changes. It is shown that many of the changes have a significant impact on the UTLS ozone estimates. Implications for interpretation of STE and radiative forcing of climate are discussed.

Pawson, Steven↗

Refine your search to explore more results.