Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Galileo maneuver analysis

In the maneuver analysis of the Galileo spacecraft, analytic models have been developed to assess the performance of an interplanetary dual spin spacecraft. These models take into account all the important effects of dual spin and flexible body dynamics to determine the spacecraft capability to achieve precise velocity changes for a variety of maneuver modes, as dictated by the requirements and as are tested and verified by computer simulation. Proportional velocity change magnitude accuracies as small as 0.34%, proportional velocity change pointing accuracies as little as 10 milliradians and fixed velocity change accuracies as precise as 0.015 m/sec are indicative of the stringency of these requirements. Error sources considered in the statistical analysis include probabilistic uncertainties due to wobble, plume impingement, nutation, thruster and accelerometer misalignments and radial offsets, gyro drift, burn timing, mass properties and algorithm errors. With its twelve thrusters, the versatility of the spacecraft to maneuver among the Galilean moons for eleven encounters after delivering a probe into the Jovian atmosphere provides a new level of challenge in the area of maneuver analysis.

Longuski, J. M.↗

Model for redundant-sensor signal errors

Report describes application of order statistics to analysis of failure modes in redundant systems. Report provides detailed mathematical discussion of approach, accompanied by graphs and equations. Techniques are relevant to process that demand high reliability, such as manufacture of dangerous chemicals. It also includes discussion of quad-redundant system.

Sowada, D. J.↗

Distance Estimate Method for Asymptotic Giant Branch Stars Using Infrared Spectral Energy Distributions

We present a method to estimate distances to asymptotic giant branch (AGB) stars in the Galaxy, using spectral energy distributions (SEDs) in the near- and mid-infrared. By assuming that a given set of source properties (initial mass, stellar temperature, composition, and evolutionary stage) will provide a typical SED shape and brightness, sources are color matched to a distance-calibrated template and thereafter scaled to extract the distance. The method is tested by comparing the distances obtained to those estimated from very long baseline interferometry or Gaia parallax measurements, yielding a strong correlation in both cases. Additional templates are formed by constructing a source sample likely to be close to the Galactic center, and thus with a common, typical distance for calibration of the templates. These first results provide statistical distance estimates to a set of almost 15,000 Milky Way AGB stars belonging to the Bulge Asymmetries and Dynamical Evolution (BAaDE) survey, with typical distance errors of ±35%. With these statistical distances, a map of the intermediate-age population of stars traced by AGBs is formed, and a clear bar structure can be discerned, consistent with the previously reported inclination angle of 30° to the GC–Sun direction vector. These results motivate deeper studies of the AGB population to tease out the intermediate-age stellar distribution throughout the Galaxy, as well as determining statistical properties of the AGB population luminosity and mass-loss-rate distributions.

79 ASTRONOMY AND ASTROPHYSICS↗

The impact of neglecting ice phase on cloud optical depth retrievals from AERONET cloud mode observations

Clouds present many challenges to climate modelling. To develop and verify the parameterisations needed to allow climate models to represent cloud structure and processes, there is a need for high-quality observations of cloud optical depth from locations around the world.Retrievals of cloud optical depth are obtainable from radiances measured by Aerosol Robotic Network (AERONET) radiometers in “cloud mode” using a two-wavelength retrieval method. However, the method is unable to detect cloud phase, and hence assumes that all of the cloud in a profile is liquid.This assumption has the potential to introduce errors into long-term statistics of retrieved optical depth for clouds that also contain ice.Using a set of idealised cloud profiles we find that, for optical depths above 20, the fractional error in retrieved optical depth is a linear function of the fraction of the optical depth that is due to the presence ofice cloud (“ice fraction”). Clouds that are entirely ice have positive errors with magnitudes of the order of 55 % to 70 %. We derive a simple linear equation that can be used as a correction at AERONET sites where ice fraction can be independently estimated. Using this linear equation, we estimate the magnitude of the error for a set of cloud profiles from five sites of the Atmospheric Radiation Measurement programme. The dataset contains separate retrievals of ice and liquid retrievals; hence ice fraction can be estimated. The magnitude of the error at each location was related to the relative frequencies of occurrence in thick frontal cloud at the mid-latitude sites and of deep convection at the tropical sites – that is, of deep cloud containing both ice and liquid particles. The long-term mean optical depth error at the five locations spans the range 2–4, which we show to be small enough to allow calculation of top-of-atmosphere flux to within 10 % and surface flux to about 15 %.

54 ENVIRONMENTAL SCIENCES↗

Interval Management with Spacing to Parallel Dependent Runways (IMSPIDR) Experiment and Results

An area in aviation operations that may offer an increase in efficiency is the use of continuous descent arrivals (CDA), especially during dependent parallel runway operations. However, variations in aircraft descent angle and speed can cause inaccuracies in estimated time of arrival calculations, requiring an increase in the size of the buffer between aircraft. This in turn reduces airport throughput and limits the use of CDAs during high-density operations, particularly to dependent parallel runways. The Interval Management with Spacing to Parallel Dependent Runways (IMSPiDR) concept uses a trajectory-based spacing tool onboard the aircraft to achieve by the runway an air traffic control assigned spacing interval behind the previous aircraft. This paper describes the first ever experiment and results of this concept at NASA Langley. Pilots flew CDAs to the Dallas Fort-Worth airport using airspeed calculations from the spacing tool to achieve either a Required Time of Arrival (RTA) or Interval Management (IM) spacing interval at the runway threshold. Results indicate flight crews were able to land aircraft on the runway with a mean of 2 seconds and less than 4 seconds standard deviation of the air traffic control assigned time, even in the presence of forecast wind error and large time delay. Statistically significant differences in delivery precision and number of speed changes as a function of stream position were observed, however, there was no trend to the difference and the error did not increase during the operation. Two areas the flight crew indicated as not acceptable included the additional number of speed changes required during the wind shear event, and issuing an IM clearance via data link while at low altitude. A number of refinements and future spacing algorithm capabilities were also identified.

Baxley, Brian T.↗

Analysis of temperature-dependent neutron transmission and self-indication measurements on tantalum at 2-keV neutron energy

The method of pseudo-resonance cross sections is used to analyze published temperature-dependent neutron transmission and self-indication measurements on tantalum in the unresolved region. In the energy region analyzed, 1825.0 to 2017.0 eV, a direct application of the pseudo-resonance approach using a customary average strength function will not provide effective cross sections which fit the measured cross section behavior. Rather a local value of the strength function is required, and a set of resonances which model the measured behavior of the effective cross sections is derived. This derived set of resonance parameters adequately represents the observed resonance hehavior in this local energy region. Similar analyses for the measurements in other unresolved energy regions are necessary to obtain local resonance parameters for improved reactor calculations. This study suggests that Doppler coefficients calculated by sampling from grand average statistical distributions over the entire unresolved resonance region can be in error, since significant local variations in the statistical distributions are not taken into consideration.

Semler, T. T.↗

Analysis of faults in an N-version software experiment

The authors have conducted a large-scale experiment in N-version programming. A total of 27 versions of a program were prepared independently from the same specification at two universities. The results of executing the versions revealed that the versions were individually extremely reliable but that the number of input cases in which more than one failed was substantially more than would be expected if they were statistically independent. After the versions had been executed, the failures of each version were examined and the associated faults located. The analysis showed that in some cases the programmers made equivalent logical errors, indicating that some parts of the problem were simply more difficult than others. The authors also found cases in which apparently different logical errors yielded faults that caused statistically correlated failures, indicating that there are special cases in the input space that present difficulty in various parts of the solution. A formal model is presented to explain this phenomenon. It appears that minor differences in the software development environment would not have a major impact in reducing the incidence of faults that cause correlated failures.

Brilliant, Susan S.↗

Robust measurement of microbial reduction of graphene oxide nanoparticles using image analysis

ABSTRACT Shewanella oneidensis ( S. oneidensis ) has the capacity to reduce electron acceptors within a medium and is thus used frequently in microbial fuel generation, pollutant breakdown, and nanoparticle fabrication. Microbial fuel setups, however, often require costly or labor-intensive components, thus making optimization of their performance onerous. For rapid optimization of setup conditions, a model reduction assay can be employed to allow simultaneous, large-scale experiments at lower cost and effort. Since S. oneidensis uses different extracellular electron transfer pathways depending on the electron acceptor, it is essential to use a reduction assay that mirrors the pathways employed in the microbial fuel system. For microbial fuel setups that use nanoparticles to stimulate electron transfer, reduction of graphene oxide provides a more accurate model than other commonly used assays as it is a bulk material that forms flocculates in solutions with a large ionic component. However, graphene oxide flocculates can interfere with traditional absorbance-based measurement techniques. This study introduces a novel image analysis method for quantifying graphene oxide reduction, showing improved performance and statistical accuracy over traditional methods. A comparative analysis shows that the image analysis method produces smaller errors between replicates and reveals more statistically significant differences between samples than traditional plate reader measurements under conditions causing graphene oxide flocculation. Image analysis can also detect reduction activity at earlier time points due to its use of larger solution volumes, enhancing color detection. These improvements in accuracy make image analysis a promising method for optimizing microbial fuel cells that use nanoparticles or bulk substrates. IMPORTANCE Shewanella oneidensis ( S. oneidensis ) is widely used in reduction processes such as microbial fuel generation due to its capacity to reduce electron acceptors. Often, these setups are labor-intensive to operate and require days to produce results, so use of a model assay would reduce the time and expenses needed for optimization. Our research developed a novel digital analysis method for analysis of graphene oxide flocculates that may be utilized as a model assay for reduction platforms featuring nanoparticles. Use of this model reduction assay will enable rapid optimization and drive improvements in the microbial fuel generation sector.

Bennett, Danielle T. (ORCID:0009000188748827)↗

A statistical study of the differential very long baseline interferometry delay rate error budget

The delta differential one-way Doppler (delta-DOD) error budget is assessed by analyzing 12 years of dual-frequency Deep Space Network very long baseline interferometry data. A typical delta-DOD observation is outlined, and the Magellan error budget along with tropospheric effects are considered. Formation of quasar-quasar observables, RMS delta-DOD residual, angular source separation and time separation between observations are discussed, along with elevation angle and atmospheric pathlength dependence, solar-plasma and ionospheric effects. It is concluded that the weak dependence of the delta-DOD error on angular source separation can mean that quasars with larger angular separation from a spacecraft may be used as navigation reference with little increase in the delta-DOD error. It is also indicated that the delta-DOD errors are dominated by wet troposphere fluctuations, and the results of numerical integrations for the single-station RMS delay rate at different elevation angles are presented.

Edwards, Charles D.↗

Composite model of a 3-D image

This paper presents a composite model of a moving (3-D) image especially useful for the sequential image processing and encoding. A non-linear predictor based on the composite model is described. The performance of this predictor is used as a measure of the validity of the model for a real image source. The minimization of a total mean square prediction error provides an inequality which determines a condition for the profitable use of the composite model and can serve as a decision device for the selection of the number of subsources within the model. The paper also describes statistical properties of the prediction error and contains results of computer simulation of two non-linear predictors in the case of perfect classification between subsources.

Dukhovich, I. J.↗

A Non-Intrusive Algorithm for Sensitivity Analysis of Chaotic Flow Simulations

We demonstrate a novel algorithm for computing the sensitivity of statistics in chaotic flow simulations to parameter perturbations. The algorithm is non-intrusive but requires exposing an interface. Based on the principle of shadowing in dynamical systems, this algorithm is designed to reduce the effect of the sampling error in computing sensitivity of statistics in chaotic simulations. We compare the effectiveness of this method to that of the conventional finite difference method.

Blonigan, Patrick J.↗

Short-term electricity load forecasting: Application-driven evaluation of machine learning models across spatial and temporal scales

As we transition towards a decarbonized economy, the integration of variable renewable energy resources and new demands (e.g., electric vehicles, heat pumps) into the electricity grid places unprecedented pressure on grid operators to effectively anticipate and manage peak load. In this context, machine learning algorithms are proving to be indispensable for accurate short-term load forecasting, a crucial task to address these challenges. This study benchmarks 6 machine learning algorithms, including three neural networks and three tree-based algorithms, across various levels of spatial aggregation and time horizons (1, 4, 8, 24, and 48 h). The central contribution of this work is the comparison and analysis of load forecasting models not only based on statistical metrics, but also based on a novel error metric, which evaluates the cost implications of forecast errors for power system stakeholders. Results show that tree-based models outperform neural networks, based on statistical metrics, and yield less skewed error distributions for most spatial scales. However, through the lens of the novel error metric, neural networks are the more competitive choice, especially for forecast horizons that exceed 8 h. The study concludes with actionable recommendations to grid operators and highlights the need for the development of error metrics that link forecasting accuracy to operational costs. To promote transparency and open science, the datasets and Python code are open-sourced via a supplementary repository.

Houben, Nikolaus↗

Modeling and measurement of error propagation in a multimodule computing system

An error propagation model has been developed for multimodule computing systems in which the main parameters are the distribution functions of error propagation times. A digraph model is used to represent a multimodule computing system, and error propagation in the system is modeled by general distributions of error propagation times between all pairs of modules. Two algorithms are developed to compute systematically and efficiently the distributions of error propagation times. Experiments are also conducted to measure the distributions of error propagation times with the fault-tolerant microprocessor (FTMP). Statistical analysis of experimental data shows that the error propagation times in FTMP do not follow a well-known distribution, thus justifying the use of general distributions in the present model.

Shin, Kang G.↗

Synoptic scale forecast skill and systematic errors in the MASS 2.0 model

The synoptic scale performance characteristics of MASS 2.0 are determined by comparing filtered 12-24 hr model forecasts to same-case forecasts made by the National Meteorological Center's synoptic-scale Limited-area Fine Mesh model. Characteristics of the two systems are contrasted, and the analysis methodology used to determine statistical skill scores and systematic errors is described. The overall relative performance of the two models in the sample is documented, and important systematic errors uncovered are presented.

Koch, S. E.↗

Is There A Relationship Between Cornered-Hat Methods and A Residual Approach to Estimate System Uncertainty?

Recently a relationship has been established between a now traditional residual diagnostic used to estimate observation, background and analysis error covariances of interest to data assimilation and the three-cornered hat (3CH) method. An existing extension of the traditional residual diagnostic uses residuals from a fixed lag-1 Kalman smoother to retrieve system (model) error covariance. It is thus natural to ask if an additional relationship can be established between this extended residual method and some form of cornered--hat method. The answer might seem straightforward. Unlike in the standard residual estimation case, attempting to estimate model error amounts to estimating the statistics of a residual quantity itself. As shown in this presentation, in such cases the 3CH method becomes trivial: the sought out uncertainty can be derived directly from the covariance of the residual quantity at hand. In the particular case of estimating model error, one of the corners would have to be composed of vectors providing estimates of model error; these are not typically available in practice. Therefore, at first glance the present work finds no relationship between the lag-1 smoother residual diagnostic for system error estimation and cornered--hat methods. However, the work suggests that a two-tiered 3CH might be all that is necessary for system uncertainty to be obtained with 3CH.

Ricardo Todling↗

Deep nonparametric estimation of intrinsic data structures by chart autoencoders: Generalization error and robustness

Autoencoders have demonstrated remarkable success in learning low-dimensional latent features of high-dimensional data across various applications. Assuming that data are sampled near a low-dimensional manifold, we employ chart autoencoders, which encode data into low-dimensional latent features on a collection of charts, preserving the topology and geometry of the data manifold. Our paper establishes statistical guarantees on the generalization error of chart autoencoders, and we demonstrate their denoising capabilities by considering n noisy training samples, along with their noise-free counterparts, on a d-dimensional manifold. By training autoencoders, we show that chart autoencoders can effectively denoise the input data with normal noise. We prove that, under proper network architectures, chart autoencoders achieve a squared generalization error in the order of n–$\frac{2}{d+2}$log 4 n, which depends on the intrinsic dimension of the manifold and only weakly depends on the ambient dimension and noise level. We further extend our theory on data with noise containing both normal and tangential components, where chart autoencoders still exhibit a denoising effect for the normal component. As a special case, our theory also applies to classical autoencoders, as long as the data manifold has a global parametrization. Furthermore, our results provide a solid theoretical foundation for the effectiveness of autoencoders, which is further validated through several numerical experiments.

97 MATHEMATICS AND COMPUTING↗

Model validation and error attribution for a drifting qubit

Qubit performance is often reported in terms of a variety of single-value metrics, each providing a facet of the underlying noise mechanism limiting performance. However, the value of these metrics may drift over long timescales, and reporting a single number for qubit performance fails to account for the low-frequency noise processes that give rise to this drift. Here, in this work, we demonstrate how we can use the distribution of these values to validate or invalidate candidate noise models. We focus on the case of randomized benchmarking (RB), where typically a single error rate is reported but this error rate can drift over time when multiple passes of RB are performed. We show that using a statistical test as simple as the Kolmogorov-Smirnov statistic on the distribution of RB error rates can be used to rule out noise models, assuming the experiment is performed over a long enough time interval to capture relevant low frequency noise. With confidence in a noise model, we show how care must be exercised when performing error attribution using the distribution of drifting RB error rate.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Adaptation of the CVT algorithm for catheter optimization in high dose rate brachytherapy

Purpose: An innovative, simple, and fast method to optimize the number and position of catheters is presented for prostate and breast high dose rate (HDR) brachytherapy, both for arbitrary templates or template-free implants (such as robotic templates).Methods: Eight clinical cases were chosen randomly from a bank of patients, previously treated in our clinic to test our method. The 2D Centroidal Voronoi Tessellations (CVT) algorithm was adapted to distribute catheters uniformly in space, within the maximum external contour of the planning target volume. The catheters optimization procedure includes the inverse planning simulated annealing algorithm (IPSA). Complete treatment plans can then be generated from the algorithm for different number of catheters. The best plan is chosen from different dosimetry criteria and will automatically provide the number of catheters and their positions. After the CVT algorithm parameters were optimized for speed and dosimetric results, it was validated against prostate clinical cases, using clinically relevant dose parameters. The robustness to implantation error was also evaluated. Finally, the efficiency of the method was tested in breast interstitial HDR brachytherapy cases.Results: The effect of the number and locations of the catheters on prostate cancer patients was studied. Treatment plans with a better or equivalent dose distributions could be obtained with fewer catheters. A better or equal prostate V100 was obtained down to 12 catheters. Plans with nine or less catheters would not be clinically acceptable in terms of prostate V100 and D90. Implantation errors up to 3 mm were acceptable since no statistical difference was found when compared to 0 mm error (p > 0.05). No significant difference in dosimetric indices was observed for the different combination of parameters within the CVT algorithm. A linear relation was found between the number of random points and the optimization time of the CVT algorithm. Because the computation time decrease with the number of points and that no effects were observed on the dosimetric indices when varying the number of sampling points and the number of iterations, they were respectively fixed to 2500 and to 100. The computation time to obtain ten complete treatments plans ranging from 9 to 18 catheters, with the corresponding dosimetric indices, was 90 s. However, 93% of the computation time is used by a research version of IPSA. For the breast, on average, the Radiation Therapy Oncology Group recommendations would be satisfied down to 12 catheters. Plans with nine or less catheters would not be clinically acceptable in terms of V100, dose homogeneity index, and D90.Conclusions: The authors have devised a simple, fast and efficient method to optimize the number and position of catheters in interstitial HDR brachytherapy. The method was shown to be robust for both prostate and breast HDR brachytherapy. More importantly, the computation time of the algorithm is acceptable for clinical use. Ultimately, this catheter optimization algorithm could be coupled with a 3D ultrasound system to allow real-time guidance and planning in HDR brachytherapy.

61 RADIATION PROTECTION AND DOSIMETRY↗