Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Error analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66

Navigation Requirements Development and Performance Assessment of a Martian Ascent Vehicle

To support development of Martian Ascent Vehicles, analysis tools are needed to support the development of Guidance, Navigation, and Control requirements. This paper presents a focused approach to Navigation analysis to capture development of requirements on initial state knowledge and inertial sensor capabilities. A simulation and analysis framework was used to assess the capability of a range of sensors to operate inertially along a range of launch trajectories. The baseline Martian Ascent Vehicle was used as the input for optimizing a set of trajectories from each launch site. These trajectories were used to perform Monte Carlo analysis dispersing error sensor terms and their effects on integrated vehicle performance. Additionally, this paper provides insight into the use of optical navigation techniques to assess state determination and the potential to use observations of local extraplanetary bodies to estimate state. This paper provides an initial level of performance assessment of navigation components to support continued requirements development of a Martian Ascent Vehicle with applications to both crew and sample return missions.

Anzalone, Evan J.↗

Validation of Carbon Trace Gas Profile Retrievals from the NOAA-Unique Combined Atmospheric Processing System for the Cross-Track Infrared Sounder

This paper provides an overview of the validation of National Oceanic and Atmospheric Administration (NOAA) operational retrievals of atmospheric carbon trace gas profiles, specifically carbon monoxide (CO), methane (CH4) and carbon dioxide (CO2), from the NOAA-Unique Combined Atmospheric Processing System (NUCAPS), a NOAA enterprise algorithm that retrieves atmospheric profile environmental data records (EDRs) under global non-precipitating (clear to partly cloudy) conditions. Vertical information about atmospheric trace gases is obtained from the Cross-track Infrared Sounder (CrIS), an infrared Fourier transform spectrometer that measures high resolution Earth radiance spectra from NOAA operational low earth orbit (LEO) satellites, including the Suomi National Polar-orbiting Partnership (SNPP) and follow-on Joint Polar Satellite System (JPSS) series beginning with NOAA-20. The NUCAPS CO, CH4, and CO2 profile EDRs are rigorously validated in this paper using well-established independent truth datasets, namely total column data from ground-based Total Carbon Column Observing Network (TCCON) sites, and in situ vertical profile data obtained from aircraft and balloon platforms via the NASA Atmospheric Tomography (ATom) mission and NOAA AirCore sampler, respectively. Statistical analyses using these datasets demonstrate that the NUCAPS carbon gas profile EDRs generally meet JPSS Level 1 global performance requirements, with the absolute accuracy and precision of CO 5% and 15%, respectively, in layers where CrIS has vertical sensitivity; CH4 and CO2 product accuracies are both found to be within ±1%, with precisions of ≈1.5% and ⪅0.5%, respectively, throughout the tropospheric column.

satellite cal/val; error analysis; greenhouse gase↗

Underlying Fundamentals of Kalman Filtering for River Network Modeling

The grand challenge of producing hydrometeorological estimates every time and everywhere has motivated the fusion of sparse observations with dense numerical models, with a particular interest on discharge in river modeling. Ensemble methods are largely preferred as they enable the estimation of error properties, but at the expense of computational load and generally with underestimations. These imperfect stochastic estimates motivate the use of correction methods, that is, error localization and inflation, although the physical justifications for their optimality are limited. The purpose of this study is to use one of the simplest forms of data assimilation when applied to river modeling and reveal the underlying mechanisms impacting its performance. Our framework based on assimilating daily averaged in situ discharge measurements to correct daily averaged runoff was tested over a 4-yr case study of two rivers in Texas. Results show that under optimal conditions of inflation and localization, discharge simulations are consistently improved such that the mean values of Nash–Sutcliffe efficiency are enhanced from211.32 to 0.55 at observed gauges and from212.24 to21.10 at validation gauges. Yet, parameters controlling the inflation and the localization have a large impact on the performance. Further investigations of these sensitivities showed that optimal inflation occurs when compensating exactly for discrepancies in the magnitude of errors while optimal localization matches the distance traveled during one assimilation window. These results may be applicable to more advanced data assimilation methods as well as for larger applications motivated by upcoming river-observing satellite missions, such as NASA’s Surface Water and Ocean Topography mission.

Streamflow↗

SNPP and NOAA-20 VIIRS On-Orbit Geolocation Trending and Improvements

Two Visible Infrared Imaging Radiometer Suite (VIIRS) sensors have been in operations for more than 8.5 and 2.5 years since they were launched in October 2011 on SNPP satellite and in November 2017 on NOAA-20 satellite, respectively. These are two satellites in the Join Polar Satellite System (JPSS) constellation, of which Suomi National Polar-orbiting Partnership (SNPP) is a risk reduction satellite and NOAA-20 is the first of four JPSS satellites(JPSS-1 became NOAA-20 after launch). Accurate geolocation is a critical element in data calibration for accurate retrieval of global biogeophysical parameters. In this paper, we describe the latest trends in the continuously improved geolocation accuracy in VIIRS Collection-1 (C1) and C2 re-processing. We implemented a VIIRS instrument geometric model update (VIGMU)for both sensors that correct for geolocation error oscilations in the scan direction. We borrowed code from Moderate Resolution Imaging Spectroradiometer (MODIS) geolocation software to correct for time-dependent pointing variations, that are particularly acute in NOAA-20 VIIRS, and some pointing anomalies in SNPP VIIRS. We developed a Kalman Filter using gyrodata to correct for attitude errors due to the degradation of the star trackers performance from the SNPP satellite. We also present an improved ground control point matching (CPM) tool, in which the ground control point (GCP) chips library is refreshed using recently launched Landsat-8 images.

SNPP↗

The Gmao Hybrid 4d-Envar Observing System Simulation Experiment Framework.

This work describes the extension of the Global Modeling and Assimilation Office (GMAO) Observing System Simulation Experiment (OSSE) framework to use a hybrid 4D-EnVar scheme instead of 3D-Var. The original 3D-Var and hybrid 4D-EnVar OSSEs use the same version of the data assimilation system (DAS) so that a direct comparison is possible in terms of the validation with respect to their corresponding real cases. Rather than quantifying the differences between the two data assimilation methodologies, a short inter-comparison of upgrading from a 3D- to a 4D-OSSE is provided to highlight aspects where this change matters to the OSSE community and to identify features of data assimilation that can only be explored in a four-dimensional OSSE framework. A short validation of the hybrid 4D-EnVar OSSE shows that conclusions from previous assessments of the 3D-Var OSSE in its ability to mimic the behavior of the real system still hold with the same caveats. Furthermore, some aspects of the ensemble configuration and behavior are discussed along with forecast sensitivity to observation impacts (FSOI). Estimates of error standard deviations are shown to be smaller in the hybrid 4D-EnVar OSSE but with little impact on the character of the error. A discussion on future work directions focuses on exploring the four-dimensional aspect such as the error distribution within the assimilation window or four-dimensional handling of high-temporal density observations.

Data assimilation↗

Comparison of Detector Based and Source Based Absolute Radiance Standards

A detailed comparison of two separate radiometric calibration standards was conducted with analysis of error sources for each. One is a detector based standard, with radiance traceable to fundamental units using the electrical substitution method. The other is based on a calibrated field emission lamp (FEL) generating blackbody radiation. This study was motivated by the discontinuance of the FEL lamps by the manufacturer and a desire to calibrate sensors using non-blackbody spectral profiles. Three spectrometers were calibrated simultaneously by both methods to separate spectrometer artifacts from differences in the radiometric standards and error in the irradiance to radiance conversion procedure needed for the FEL. Conducting this study now is important to provide continuity between the extensive prior FEL based calibration database with a replacement method while calibrated FEL lamps are still available. This also begins a longer term repeatability study of the spectrometers used in this work for evaluation as calibrated transfer standards, usable with both monochromatic and broad spectrum radiance sources. Eliminating the tie to the FEL blackbody spectrum with a detector based standard allows for flexibility in the illumination source. In particular, for Earth science sensors intended for use with sunlit scenes, augmenting traditional tungsten halogen lighting with blue and ultraviolet light emitting diodes allows for a better match to the solar spectrum during laboratory testing.

radiometry↗

Comparison of Detector Based and Source Based Absolute Radiance Standards

A detailed comparison of two separate radiometric calibration standards was conducted with analysis of error sources for each. One is a detector based standard, with radiance traceable to fundamental units using the electrical substitution method. The other is based on a calibrated field emission lamp (FEL) generating blackbody radiation. This study was motivated by the discontinuance of the FEL lamps by the manufacturer and a desire to calibrate sensors using non-blackbody spectral profiles. Three spectrometers were calibrated simultaneously by both methods to separate spectrometer artifacts from differences in the radiometric standards and error in the irradiance to radiance conversion procedure needed for the FEL. Conducting this study now is important to provide continuity between the extensive prior FEL based calibration database with a replacement method while calibrated FEL lamps are still available. This also begins a longer term repeatability study of the spectrometers used in this work for evaluation as calibrated transfer standards, usable with both monochromatic and broad spectrum radiance sources. Eliminating the tie to the FEL blackbody spectrum with a detector based standard allows for flexibility in the illumination source. In particular, for Earth science sensors intended for use with sunlit scenes, augmenting traditional tungsten halogen lighting with blue and ultraviolet light emitting diodes allows for a better match to the solar spectrum during laboratory testing.

radiometry↗

Deep Nonparametric Estimation of Operators between Infinite Dimensional Spaces

Learning operators between infinitely dimensional spaces is an important learning task arising in machine learning, imaging science, mathematical modeling and simulations, etc. This paper studies the nonparametric estimation of Lipschitz operators using deep neural networks. Non-asymptotic upper bounds are derived for the generalization error of the empirical risk minimizer over a properly chosen network class. Under the assumption that the target operator exhibits a low dimensional structure, our error bounds decay as the training sample size increases, with an attractive fast rate depending on the intrinsic dimension in our estimation. Our assumptions cover most scenarios in real applications and our results give rise to fast rates by exploiting low dimensional structures of data in operator estimation. We also investigate the influence of network structures (e.g., network width, depth, and sparsity) on the generalization error of the neural network estimator and propose a general suggestion on the choice of network structures to maximize the learning efficiency quantitatively.

97 MATHEMATICS AND COMPUTING↗

A Monte Carlo analysis of the effects of instrumentation errors on aircraft parameter identification

An output error estimation algorithm was used to evaluate the effects of both static and dynamic instrumentation errors on the estimation of aircraft stability and control parameters. A Monte Carlo analysis, using simulated cruise flight data, was performed for a high performance military aircraft, a large commercial transport, and a small general-aviation aircraft. The effects of variations in the information content of the flight data, resulting from two different choices of control input maneuvers, were also determined. The results indicate that unmodeled instrumentation errors can cause inaccuracies in the estimated parameters which are comparable to their nominal values. Control input errors and angular accelerometer lags were found to be most significant of the instrumentation errors evaluated, and the perturbations they produce are much larger than those arising from the combined effects of static errors and white noise in the output response measurements.

Bryant, W. H.↗

Modelling the impact of quasar redshift errors on the full-shape analysis of correlations in the Lyman-α forest.

In preparation for the first cosmological measurements from the full shape of the Lyman-α (Lyα) forest from DESI, we must carefully model all relevant systematics that might bias our analysis. It was shown in Youles et al. (2022) that random quasar redshift errors produce a smoothing effect on the mean quasar continuum in the Lyα forest region. This, in turn, gives rise to spurious features in the Lyα autocorrelation and its cross-correlation with quasars. Using synthetic data sets based on the DESI survey, we confirm that the impact on BAO measurements is small, but that a bias is introduced to parameters which depend on the full shape of our correlations. We combine a model of this contamination in the cross-correlation (Youles et al. 2022) with a new model we introduce here for the auto-correlation. These are parametrised by 3 parameters, which, when included in a joint fit to both correlation functions, successfully eliminate any impact of redshift errors on our full-shape constraints. We also present a strategy for removing this contamination from real data, by removing ∼0.3% of correlating pairs.

cosmology↗

Assessment of the frequency and nature of erroneous x-ray photoelectron spectroscopy analyses in the scientific literature

Here, this study was undertaken to understand the extent and nature of problems in x-ray photoelectron spectroscopy (XPS) data reported in the literature. It first presents an assessment of the XPS data in three high-quality journals over a six-month period. This analysis of 409 publications showing XPS spectra provides insight into how XPS is being used, identifies the common mistakes or errors in XPS analysis, and reveals which elements are most commonly analyzed. More than 65% of the 409 papers showed fitting of XP spectra. An ad hoc group (herein identified as “the committee”) of experienced XPS analysts reviewed these spectra and found that peak fitting was a common source of significant errors. The papers were ranked based on the perceived seriousness of the errors, which ranged from minor to major. Major errors, which, in the opinion of the ad hoc committee, can render the interpretation of the data meaningless, occurred when fitting protocols ignored underlying physics and chemistry or contained major errors in the analysis. Consistent with other materials analysis data, ca. 30% of the XPS data or analysis was identified as having major errors. Out of the publications with fitted spectra, ca. 40% had major errors. The most common elements analyzed by XPS in the papers sampled and researched at an online database, include carbon, oxygen, nitrogen, sulfur, and titanium. A scrutiny of the papers showing carbon and oxygen XPS spectra revealed the classes of materials being studied and the extent of problems in these analyses. As might be expected, C 1s and O 1s analyses are most often performed on sp2-type materials and inorganic oxides, respectively. These findings have helped focus a series of XPS guides and tutorials that deal with common analysis issues. The extent of problematic data is larger than the authors had expected. Quantification of the problem, examination of some of the common problem areas, and the development of targeted guides and tutorials may provide both the motivation and resources that enable the community to improve the overall quality and reliability of XPS analysis reported in the literature.

Major, George H.↗

Influence of Tooth Spacing Error on Gears With and Without Profile Modifications

A computer simulation was conducted to investigate the effectiveness of profile modification for reducing dynamic loads in gears with different tooth spacing errors. The simulation examined varying amplitudes of spacing error and differences in the span of teeth over which the error occurs. The modification considered included both linear and parabolic tip relief. The analysis considered spacing error that varies around most of the gear circumference (similar to a typical sinusoidal error pattern) as well as a shorter span of spacing errors that occurs on only a few teeth. The dynamic analysis was performed using a revised version of a NASA gear dynamics code, modified to add tooth spacing errors to the analysis. Results obtained from the investigation show that linear tip relief is more effective in reducing dynamic loads on gears with small spacing errors but parabolic tip relief becomes more effective as the amplitude of spacing error increases. In addition, the parabolic modification is more effective for the more severe error case where the error is spread over a longer span of teeth. The findings of this study can be used to design robust tooth profile modification for improving dynamic performance of gear sets with different tooth spacing errors.

Padmasolala, Giri↗

Data Analysis & Statistical Methods for Command File Errors

This paper explains current work on modeling for managing the risk of command file errors. It is focused on analyzing actual data from a JPL spaceflight mission to build models for evaluating and predicting error rates as a function of several key variables. We constructed a rich dataset by considering the number of errors, the number of files radiated, including the number commands and blocks in each file, as well as subjective estimates of workload and operational novelty. We have assessed these data using different curve fitting and distribution fitting techniques, such as multiple regression analysis, and maximum likelihood estimation to see how much of the variability in the error rates can be explained with these. We have also used goodness of fit testing strategies and principal component analysis to further assess our data. Finally, we constructed a model of expected error rates based on the what these statistics bore out as critical drivers to the error rate. This model allows project management to evaluate the error rate against a theoretically expected rate as well as anticipate future error rates.

Correlation Analysis↗

ARETE: Accurate Error Assessment via Machine Learning-Guided Dynamic-Timing Analysis

Nanometer circuits are increasingly prone to timing errors, escalating the need for fault injection frameworks to accurately evaluate their impact on applications. Here in this paper, we propose ARETE, a novel cross-layer, fault-injection framework that combines dynamic-binary instrumentation with machine learning-guided dynamic-timing analysis. ARETE enables accurate fault-injection into any application by estimating the location of the injecting errors via dynamic-timing analysis. To accelerate fault-injection, we develop a novel, data-aware, machine learning-based mechanism that dynamically pre-selects the error-prone instructions and limits the application of the costly dynamic-timing analysis only to them. To evaluate ARETE's accuracy, our fully automated toolflow is configured to support fault-injection based on detailed post-layout gate-level simulations as well as via existing workload-agnostic error models. Our results for various workloads, including an autonomous-driving library, show that the location and time of injected errors performed by ARETE, is 89.9% consistent with fault-injection based on full gate-level simulation. On average, ARETE executes 84.6x faster than gate-level simulation and at a cost of 3.4% loss in the program output quality estimation. When compared to the existing statistical fault-injection tools that are based on workload-agnostic error models, ARETE improves the accuracy of fault-injection rate and output quality estimation by 143.9% and 40.4% on average, respectively.

97 MATHEMATICS AND COMPUTING↗

Error Estimation and h-Adaptivity for Optimal Finite Element Analysis

The objective of adaptive meshing and automatic error control in finite element analysis is to eliminate the need for the application engineer from re-meshing and re-running design simulations to verify numerical accuracy. The user should only need to enter the component geometry and a coarse finite element mesh. The software will then autonomously and adaptively refine this mesh where needed, reducing the error in the fields to a user prescribed value. The ideal end result of the simulation is a measurable quantity (e.g. scattered field, input impedance), calculated to a prescribed error, in less time and less machine memory than if the user applied typical uniform mesh refinement by hand. It would also allow for the simulation of larger objects since an optimal mesh is created.

Cwik, Tom↗