Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

A Phenomenon-Based Decomposition of Model-Based Estimates of Boreal Winter ENSO Variability

Climate models are now routinely being used to simulate and predict climate variability on time scales ranging from sub-seasonal to seasonal and longer. As such, there are now long histories of such simulations and predictions spanning multiple decades and multiple ensemble members, both of which are crucial for separating climate signal from climate noise. A key focus of such runs has been the El Niño-Southern Oscillation (ENSO), spurred by recent improvements in our ability to predict such events, though questions remain as to how well climate models do beyond simply always predicting the “canonical” atmospheric response to an ENSO event—something simple statistical models already do reasonably well. This is a critical issue that needs addressing, given the importance of event-to-event differences for predicting regional impacts of ENSO teleconnections, and the need to justify the expense of running sophisticated climate models. Unfortunately, current diagnostic tools are not well suited for quantifying the different sources of variability associated with specific phenomena such as ENSO. More generally, while much effort has focused on addressing model bias, less has been done to address errors in second moment statistics—an issue whose importance is gaining increased attention particularly as we build climate prediction systems capable of taking advantage of forecasts of opportunity—a capability that requires reliable estimates of forecast uncertainty. In this report, we outline a phenomenon-based statistical decomposition of climate variance(in essence a detailed variance budget)that is specifically tailored to address the above questions by separating the variability (both the signal and noise) into that tied to the long-term average impact of a particular phenomenon(the composite mean) and the event-to-event(E2E) variability about the composite mean. In addition, we provide related decompositions of the correlations that allow us to quantify how much of the agreement with observations (the skill) comes from the composite mean as opposed to from the E2Evariability. As an example, we present the results of such a decomposition for ENSO based on simulations with the GEOS atmospheric general circulation model (AGCM), with a focus on the monthly mean impacts over North America during boreal winter(December –March). Here we take advantage of existing GEOS AGCM simulations that were produced as companion simulations to MERRA-2for the period 1980-2016. Comparisons are made throughout with MERRA-2.

ENSO↗

Distance-preserving rigidity penalty on deformable image registration of multiple skeletal components in the neck

Purpose: This study aims at developing and testing a novel rigidity penalty suitable for the deformable registration of tightly located skeletal components in the head and neck from planning computed tomography (CT) and daily cone-beam CT (CBCT) scans of patients undergoing radiotherapy. Methods: The proposed rigidity penalty is designed to preserve intervoxel distances within each bony structure. This penalty was tested in the intensity-based B-spline deformable registration of five cervical vertebral bodies (C1–C5). The displacement vector fields (DVFs) from the registrations were compared to the DVFs generated by using rigid body motions of the cervical vertebrae, measured by the surface registration of vertebrae delineated on CT and CBCT images. Twenty five pairs of planning CT (reference) and treatment CBCTs (target) from five patients were aligned without and with the penalty. An existing penalty based on the orthonormality of the deformation gradient tensor was also tested and the effects of the penalties compared. Results: The mean magnitude of the maximum registration error with the proposed distance-preserving penalty was (0.86, 1.12, 1.33) mm compared to (2.11, 2.49, 2.46) without penalty and (1.53, 1.64, 1.64) with the existing orthonormality-based penalty. The improvement in the accuracy of the deformable image registration was also verified by comparing the Procrustes distance between the DVFs. With the proposed penalty, the average distance was 0.11 (σ 0.03 mm) which is smaller than 0.53 (0.1 mm) without penalty and 0.28 (0.04 mm) with the orthonormality-based penalty. Conclusions: The accuracy of aligning multiple bony elements was improved by using the proposed distance-preserving rigidity penalty. The voxel-based statistical analysis of the registration error shows that the proposed penalty improved the integrity of the DVFs within the vertebral bodies.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Closed-Loop Analysis of Soft Decisions for Serial Links

We describe the benefit of using closed-loop measurements for a radio receiver paired with a counterpart transmitter. We show that real-time analysis of the soft decision output of a receiver can provide rich and relevant insight far beyond the traditional hard-decision bit error rate (BER) test statistic. We describe a Soft Decision Analyzer (SDA) implementation for closed-loop measurements on single- or dual- (orthogonal) channel serial data communication links. The analyzer has been used to identify, quantify, and prioritize contributors to implementation loss in live-time during the development of software defined radios. This test technique gains importance as modern receivers are providing soft decision symbol synchronization as radio links are challenged to push more data and more protocol overhead through noisier channels, and software-defined radios (SDRs) use error-correction codes that approach Shannon's theoretical limit of performance.

Lansdowne, Chatwin A.↗

Soft Decision Analyzer

We describe the benefit of using closed-loop measurements for a radio receiver paired with a counterpart transmitter. We show that real-time analysis of the soft decision output of a receiver can provide rich and relevant insight far beyond the traditional hard-decision bit error rate (BER) test statistic. We describe a Soft Decision Analyzer (SDA) implementation for closed-loop measurements on single- or dual- (orthogonal) channel serial data communication links. The analyzer has been used to identify, quantify, and prioritize contributors to implementation loss in live-time during the development of software defined radios. This test technique gains importance as modern receivers are providing soft decision symbol synchronization as radio links are challenged to push more data and more protocol overhead through noisier channels, and software-defined radios (SDRs) use error-correction codes that approach Shannon's theoretical limit of performance.

Lansdowne, Chatwin↗

Methods, software and datasets to verify DVH calculations against analytical values: Twenty years late(r)

Purpose: The authors designed data, methods, and metrics that can serve as a standard, independent of any software package, to evaluate dose-volume histogram (DVH) calculation accuracy and detect limitations. The authors use simple geometrical objects at different orientations combined with dose grids of varying spatial resolution with linear 1D dose gradients; when combined, ground truth DVH curves can be calculated analytically in closed form to serve as the absolute standards. Methods: DICOM RT structure sets containing a small sphere, cylinder, and cone were created programmatically with axial plane spacing varying from 0.2 to 3 mm. Cylinders and cones were modeled in two different orientations with respect to the IEC 1217 Y axis. The contours were designed to stringently but methodically test voxelation methods required for DVH. Synthetic RT dose files were generated with 1D linear dose gradient and with grid resolution varying from 0.4 to 3 mm. Two commercial DVH algorithms—PINNACLE (Philips Radiation Oncology Systems) and PlanIQ (Sun Nuclear Corp.)—were tested against analytical values using custom, noncommercial analysis software. In Test 1, axial contour spacing was constant at 0.2 mm while dose grid resolution varied. In Tests 2 and 3, the dose grid resolution was matched to varying subsampled axial contours with spacing of 1, 2, and 3 mm, and difference analysis and metrics were employed: (1) histograms of the accuracy of various DVH parameters (total volume, D{sub max}, D{sub min}, and doses to % volume: D99, D95, D5, D1, D0.03 cm{sup 3}) and (2) volume errors extracted along the DVH curves were generated and summarized in tabular and graphical forms. Results: In Test 1, PINNACLE produced 52 deviations (15%) while PlanIQ produced 5 (1.5%). In Test 2, PINNACLE and PlanIQ differed from analytical by >3% in 93 (36%) and 18 (7%) times, respectively. Excluding D{sub min} and D{sub max} as least clinically relevant would result in 32 (15%) vs 5 (2%) scored deviations for PINNACLE vs PlanIQ in Test 1, while Test 2 would yield 53 (25%) vs 17 (8%). In Test 3, statistical analyses of volume errors extracted continuously along the curves show PINNACLE to have more errors and higher variability (relative to PlanIQ), primarily due to PINNACLE’s lack of sufficient 3D grid supersampling. Another major driver for PINNACLE errors is an inconsistency in implementation of the “end-capping”; the additional volume resulting from expanding superior and inferior contours halfway to the next slice is included in the total volume calculation, but dose voxels in this expanded volume are excluded from the DVH. PlanIQ had fewer deviations, and most were associated with a rotated cylinder modeled by rectangular axial contours; for coarser axial spacing, the limited number of cross-sectional rectangles hinders the ability to render the true structure volume. Conclusions: The method is applicable to any DVH-calculating software capable of importing DICOM RT structure set and dose objects (the authors’ examples are available for download). It includes a collection of tests that probe the design of the DVH algorithm, measure its accuracy, and identify failure modes. Merits and applicability of each test are discussed.

60 APPLIED LIFE SCIENCES↗

Satellite Sampling and Retrieval Errors in Regional Monthly Rain Estimates from TMI AMSR-E, SSM/I, AMSU-B and the TRMM PR

Passive and active microwave rain sensors onboard earth-orbiting satellites estimate monthly rainfall from the instantaneous rain statistics collected during satellite overpasses. It is well known that climate-scale rain estimates from meteorological satellites incur sampling errors resulting from the process of discrete temporal sampling and statistical averaging. Sampling and retrieval errors ultimately become entangled in the estimation of the mean monthly rain rate. The sampling component of the error budget effectively introduces statistical noise into climate-scale rain estimates that obscure the error component associated with the instantaneous rain retrieval. Estimating the accuracy of the retrievals on monthly scales therefore necessitates a decomposition of the total error budget into sampling and retrieval error quantities. This paper presents results from a statistical evaluation of the sampling and retrieval errors for five different space-borne rain sensors on board nine orbiting satellites. Using an error decomposition methodology developed by one of the authors, sampling and retrieval errors were estimated at 0.25 resolution within 150 km of ground-based weather radars located at Kwajalein, Marshall Islands and Melbourne, Florida. Error and bias statistics were calculated according to the land, ocean and coast classifications of the surface terrain mask developed for the Goddard Profiling (GPROF) rain algorithm. Variations in the comparative error statistics are attributed to various factors related to differences in the swath geometry of each rain sensor, the orbital and instrument characteristics of the satellite and the regional climatology. The most significant result from this study found that each of the satellites incurred negative longterm oceanic retrieval biases of 10 to 30%.

Fisher, Brad↗

A STATISTICAL STUDY OF THE SOLAR WIND TURBULENCE AT ION KINETIC SCALES USING THE K-FILTERING TECHNIQUE AND CLUSTER DATA

Plasma turbulence at ion kinetic scales in the solar wind is investigated using the multi-point magnetometer data from the Cluster spacecraft. By applying the k-filtering method, we are able to estimate the full three-dimensional power spectral density P(ω{sub sc}, k) at a certain spacecraft frequency ω{sub sc} in wavevector (k) space. By using the wavevector at the maximum power in P(ω{sub sc}, k) at each sampling frequency ω{sub sc} and the Doppler shifted frequency ω{sub pla} in the solar wind frame, the dispersion plot ω{sub pla} = ω{sub pla}(k) is found. Previous studies have been limited to very few intervals and have been hampered by large errors, which motivates a statistical study of 52 intervals of solar wind. We find that the turbulence is predominantly highly oblique to the magnetic field k >> k {sub ∥}, and propagates slowly in the plasma frame with most points having frequencies smaller than the proton gyrofrequency ω{sub pla} < Ω{sub p}. Weak agreement is found that turbulence at the ion kinetic scales consists of kinetic Alfvén waves and coherent structures advected with plasma bulk velocity plus some minor more compressible components. The results suggest that anti-sunward and sunward propagating magnetic fluctuations are of similar nature in both the fast and slow solar wind at ion kinetic scales. The fast wind has significantly more anti-sunward flux than sunward flux and the slow wind appears to be more balanced.

79 ASTRONOMY AND ASTROPHYSICS↗

Preliminary Statistical Maneuver Analysis for A Low-Thrust NRHO to DRO Transfer

To understand practical implications of implementing transfers that leverage multibody dynamics, a statistical analysis is performed on an Earth-Moon Near Rectilinear Halo Orbit (NRHO) to distant retrograde orbit (DRO) transfer using solar electric propulsion. The statistical analysis includes perturbations due to maneu- ver execution and orbit determination error to understand operational character- istics of the transfer such as statistical ∆V and statistical state targeting errors at the final DRO. We explore the need for low-thrust trajectory correction maneuver (TCM) opportunities as well as the delivery accuracy to the final target. Finally, we explore options for long-term-stable target DROs.

low thrust↗

Impact of Satellite Viewing-Swath Width on Global and Regional Aerosol Optical Thickness Statistics and Trends

We use the Moderate Resolution Imaging Spectroradiometer (MODIS) satellite aerosol optical thickness (AOT) product to assess the impact of reduced swath width on global and regional AOT statistics and trends. Alongtrack and across-track sampling strategies are employed, in which the full MODIS data set is sub-sampled with various narrow-swath (approximately 400-800 km) and single pixel width (approximately 10 km) configurations. Although view-angle artifacts in the MODIS AOT retrieval confound direct comparisons between averages derived from different sub-samples, careful analysis shows that with many portions of the Earth essentially unobserved, spatial sampling introduces uncertainty in the derived seasonal-regional mean AOT. These AOT spatial sampling artifacts comprise up to 60%of the full-swath AOT value under moderate aerosol loading, and can be as large as 0.1 in some regions under high aerosol loading. Compared to full-swath observations, narrower swath and single pixel width sampling exhibits a reduced ability to detect AOT trends with statistical significance. On the other hand, estimates of the global, annual mean AOT do not vary significantly from the full-swath values as spatial sampling is reduced. Aggregation of the MODIS data at coarse grid scales (10 deg) shows consistency in the aerosol trends across sampling strategies, with increased statistical confidence, but quantitative errors in the derived trends are found even for the full-swath data when compared to high spatial resolution (0.5 deg) aggregations. Using results of a model-derived aerosol reanalysis, we find consistency in our conclusions about a seasonal-regional spatial sampling artifact in AOT Furthermore, the model shows that reduced spatial sampling can amount to uncertainty in computed shortwave top-ofatmosphere aerosol radiative forcing of 2-3 W m(sup−2). These artifacts are lower bounds, as possibly other unconsidered sampling strategies would perform less well. These results suggest that future aerosol satellite missions having significantly less than full-swath viewing are unlikely to sample the true AOT distribution well enough to obtain the statistics needed to reduce uncertainty in aerosol direct forcing of climate.

remote sensing↗

Impact of non-Maxwellian electron velocity distribution functions on inferred plasma parameters in collective Thomson scattering

Optical collective Thomson scattering provides precise density and temperature measurements in numerous plasma-physics experiments. The accuracy of such measurements depends on the core assumption that the underlying electron distribution functions in under-dense laser-produced plasmas are Maxwellian. A statistically based, quantitative analysis of the errors in the measured electron density and temperature is presented when synthetic data calculated using a non-Maxwellian electron distribution function is fit assuming a Maxwellian electron distribution. Such analysis can lead to errors of up to 50% in temperature and 30% in density, in the specific case of super-Gaussian distributions characteristic of inverse bremsstrahlung heating. Furthermore including the proper family of non-Maxwellian electron distribution functions, as a fitting parameter, in Thomson-scattering analysis removes the model-dependent errors in the inferred parameters at a minimal cost to the statistical uncertainty.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Sampling errors in satellite estimates of tropical rain

The GATE rainfall data set is used in a statistical study to estimate the sampling errors that might be expected for the type of snapshot sampling that a low earth-orbiting satellite makes. For averages over the entire 400-km square and for the duration of several weeks, strong evidence is found that sampling errors less than 10 percent can be expected in contributions from each of four rain rate categories which individually account for about one quarter of the total rain.

Mcconnell, Alan↗

An analysis of the Kalman filter in the Gamma Ray Observatory (GRO) onboard attitude determination subsystem

The Gamma Ray Observatory (GRO) spacecraft needs a highly accurate attitude knowledge to achieve its mission objectives. Utilizing the fixed-head star trackers (FHSTs) for observations and gyroscopes for attitude propagation, the discrete Kalman Filter processes the attitude data to obtain an onboard accuracy of 86 arc seconds (3 sigma). A combination of linear analysis and simulations using the GRO Software Simulator (GROSS) are employed to investigate the Kalman filter for stability and the effects of corrupted observations (misalignment, noise), incomplete dynamic modeling, and nonlinear errors on Kalman filter. In the simulations, on-board attitude is compared with true attitude, the sensitivity of attitude error to model errors is graphed, and a statistical analysis is performed on the residuals of the Kalman Filter. In this paper, the modeling and sensor errors that degrade the Kalman filter solution beyond mission requirements are studied, and methods are offered to identify the source of these errors.

Snow, Frank↗

Quasi-Static Probabilistic Structural Analyses Process and Criteria

Current deterministic structural methods are easily applied to substructures and components, and analysts have built great design insights and confidence in them over the years. However, deterministic methods cannot support systems risk analyses, and it was recently reported that deterministic treatment of statistical data is inconsistent with error propagation laws that can result in unevenly conservative structural predictions. Assuming non-nal distributions and using statistical data formats throughout prevailing stress deterministic processes lead to a safety factor in statistical format, which integrated into the safety index, provides a safety factor and first order reliability relationship. The embedded safety factor in the safety index expression allows a historically based risk to be determined and verified over a variety of quasi-static metallic substructures consistent with the traditional safety factor methods and NASA Std. 5001 criteria.

Goldberg, B.↗

Error modeling for differential GPS

Differential Global Positioning System (DGPS) positioning is used to accurately locate a GPS receiver based upon the well-known position of a reference site. In utilizing this technique, several error sources contribute to position inaccuracy. This thesis investigates the error in DGPS operation and attempts to develop a statistical model for the behavior of this error. The model for DGPS error is developed using GPS data collected by Draper Laboratory. The Marquardt method for nonlinear curve-fitting is used to find the parameters of a first order Markov process that models the average errors from the collected data. The results show that a first order Markov process can be used to model the DGPS error as a function of baseline distance and time delay. The model's time correlation constant is 3847.1 seconds (1.07 hours) for the mean square error. The distance correlation constant is 122.8 kilometers. The total process variance for the DGPS model is 3.73 sq meters.

Blerman, Gregory S.↗

Sampling errors for satellite-derived tropical rainfall - Monte Carlo study using a space-time stochastic model

Estimates of monthly average rainfall based on satellite observations from a low earth orbit will differ from the true monthly average because the satellite observes a given area only intermittently. This sampling error inherent in satellite monitoring of rainfall would occur even if the satellite instruments could measure rainfall perfectly. The size of this error is estimated for a satellite system being studied at NASA, the Tropical Rainfall Measuring Mission (TRMM). First, the statistical description of rainfall on scales from 1 to 1000 km is examined in detail, based on rainfall data from the Global Atmospheric Research Project Atlantic Tropical Experiment (GATE). A TRMM-like satellite is flown over a two-dimensional time-evolving simulation of rainfall using a stochastic model with statistics tuned to agree with GATE statistics. The distribution of sampling errors found from many months of simulated observations is found to be nearly normal, even though the distribution of area-averaged rainfall is far from normal. For a range of orbits likely to be employed in TRMM, sampling error is found to be less than 10 percent of the mean for rainfall averaged over a 500 x 500 sq km area.

Bell, Thomas L.↗

A Workflow for Accelerating Multimodal Data Collection for Electrodeposited Films

Abstract Future machine learning strategies for materials process optimization will likely replace human capital-intensive artisan research with autonomous and/or accelerated approaches. Such automation enables accelerated multimodal characterization that simultaneously minimizes human errors, lowers costs, enhances statistical sampling, and allows scientists to allocate their time to critical thinking instead of repetitive manual tasks. Previous acceleration efforts to synthesize and evaluate materials have often employed elaborate robotic self-driving laboratories or used specialized strategies that are difficult to generalize. Herein we describe an implemented workflow for accelerating the multimodal characterization of a combinatorial set of 915 electroplated Ni and Ni–Fe thin films resulting in a data cube with over 160,000 individual data files. Our acceleration strategies do not require manufacturing-scale resources and are thus amenable to typical materials research facilities in academic, government, or commercial laboratories. The workflow demonstrated the acceleration of six characterization modalities: optical microscopy, laser profilometry, X-ray diffraction, X-ray fluorescence, nanoindentation, and tribological (friction and wear) testing, each with speedup factors ranging from 13–46x. In addition, automated data upload to a repository using FAIR data principles was accelerated by 64x.

36 MATERIALS SCIENCE↗

Snowmass2021 - Letter of interest cosmology intertwined IV: The age of the universe and its curvature

A precise measurement of the curvature of the Universe is of prime importance for cosmology since it could not only confirm the paradigm of primordial inflation but also help in discriminating between different early-Universe scenarios. Recent observations, while broadly consistent with a spatially flat standard Λ Cold Dark Matter ( Λ CDM) model, show tensions that still allow (and, in some cases, even suggest) a few percent deviations from a flat universe. In particular, the Planck Cosmic Microwave Background power spectra, assuming the nominal likelihood, prefer a closed universe at more than 99% confidence level. While new physics could be at play, this anomaly may be the result of an unresolved systematic error or just a statistical fluctuation. However, since positive curvature allows a larger age of the Universe, an accurate determination of the age of the oldest objects provides a smoking gun in confirming or falsifying the current flat Λ CDM model.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗