Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error estimates”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,495 records · Page 83

The inverse problem of constructing a gravimetric geoid

Computation of a single geoidal height from gravity acceleration data formally requires that the latter be known everywhere on the earth. A computational procedure based on linear inverse theory for estimating geoidal heights from incomplete sets of data is presented. The same scheme can be used to estimate gravity accelerations from altimetry-derived geoids. The systematic error owing to lack of data and the choice of a particular inverse operator is described by using resolution functions and their spherical harmonic expansions. An rms value of this error is also estimated by assuming a spectrum for the unknown geoid. The influence of the size of the data region, the spacing between data, the filtering applied to the data, and the model weighting function chosen are all quantified in a spherical geometry. The examples presented show that when low degree spherical harmonic coefficients are available - from satellite orbit analysis - a band-passed version of the geoid can be constructed from local gravity data, even with a relatively restricted data set.

Zlotnicki, V.↗

Quantifying parameters for Bayesian prior assumptions when estimating the probability of failure of software

Software reliability has become increasingly important, especially in life-critical situations. The ability to measure the results of testing and to quantify software reliability is needed. If this is accomplished, a certain minimum amount of reliability for a piece of software can be specified, and testing and/or other analysis may be done until that minimum number has been attained. There are many models for estimating software reliability. The accuracy of these models has been challenged and many revisions for the models and recalibration techniques have been devised. Of particular interest is the method of estimating the probability of failure of software when no failures have yet occurred in its current version as described by Miller. This model uses black box testing with formulae based on Bayesian estimation. The focus is on three interrelated issues: estimating the probability of failure when testing has revealed no errors; modifying this estimation when the input use distribution does not match the test distribution; and combining the results from random testing with other relevant information to obtain a possibly more accurate estimate of the probability of failure. Obtaining relevant information about the software and combining the results for a better estimate for the Miller model are discussed.

Long, Jacquelyn E.↗

A Variational Method for Analyzing Vortex Flows in Radar-Scanned Tornadic Mesocyclones. Part III: Sensitivities to Vortex Center Location Errors

Abstract When the vortex center location is estimated from a radar-scanned tornadic mesocyclone, the estimated location is not error-free. This raises an important issue concerning the sensitivities of analyzed vortex flow (VF) fields by the VF-Var (formulated in Part I of this paper series and tested in Part II) to vortex center location errors, denoted by Δ x c . Numerical experiments are performed to address this issue with the following findings: The increase of |Δ x c | from zero to a half of vortex core radius causes large analysis error increases in the vortex core but the increased analysis errors decrease rapidly away from the vortex core especially for dual-Doppler analyses. The increased horizontal-velocity errors in the vortex core are mainly in the Δ x c -normal component, because this component varies much more rapidly than the other component along the Δ x c direction in the vortex core. The vertical variations of Δ x c distort the vertical correlation structure of Δ x c -dislocated VF-dependent background error covariance, which can increase the analysis errors in the vortex core. The dual-Doppler analyses have adequate accuracies outside the vortex core even when |Δ x c | increases to a half of vortex core radius, while single-Doppler analyses can also have adequate accuracies outside the vortex core mainly for the single-Doppler-observed velocity component. The sensitivities to Δ x c are largely unaffected by the vortex slanting. The above findings are important and useful for assessing the accuracies of analyzed VFs for real radar-observed tornadic mesocyclones. Significance Statement When the vortex center location is estimated from a radar-scanned tornadic mesocyclone, the estimated location is not error-free. This raises an issue concerning the sensitivity of analyzed vortex flow (VF) by the VF-Var (formulated in Part I of this paper series and tested with simulated radar observations in Part II) to vortex center location error. This issue and its required investigations are very important for the VF-Var to be applied to real radar-observed tornadic mesocyclones, especially in an operational setting with the WSR-88Ds. Numerical experiments are performed to address this issue. The findings from these experiments are important and useful for assessing the accuracies of VF-Var analyzed VF fields for real radar-observed tornadic mesocyclones.

Xu, Qin↗

LACIE performance predictor FOC users manual

The LACIE Performance Predictor (LPP) is a computer simulation of the LACIE process for predicting worldwide wheat production. The simulation provides for the introduction of various errors into the system and provides estimates based on these errors, thus allowing the user to determine the impact of selected error sources. The FOC LPP simulates the acquisition of the sample segment data by the LANDSAT Satellite (DAPTS), the classification of the agricultural area within the sample segment (CAMS), the estimation of the wheat yield (YES), and the production estimation and aggregation (CAS). These elements include data acquisition characteristics, environmental conditions, classification algorithms, the LACIE aggregation and data adjustment procedures. The operational structure for simulating these elements consists of the following key programs: (1) LACIE Utility Maintenance Process, (2) System Error Executive, (3) Ephemeris Generator, (4) Access Generator, (5) Acquisition Selector, (6) LACIE Error Model (LEM), and (7) Post Processor.

Source record↗

Intercomparison of UT1 measurements during the MERIT campaign period

Universal time (UT1) measurements obtained using VLBI, lunar laser ranging (LLR), and BIH optical astronomy are compared. The JPL Kalman filter for the earth rotation and the polar motion is utilized to smooth one data set or combine data sets for intercomparison. The differences between raw UT1 data and independently smoothed data are employed to assess the accuracy of the measured series and the sufficiency of the error budget. Systematic errors in periodic signatures and length of day estimates are analyzed. The data reveal that the techniques of LLR and VLBI agree to within their formal errors. It is determined that the residual error for the LLR is too large and the residual error estimated for the BIH data is too small.

Spieth, M. A.↗

A robust estimator of rainfall rate using differential reflectivity

Conventional estimator of rainfall rate using reflectivity factor and differential reflectivity Z(sub DR) becomes unstable when the measured values of Z(sub DR) are small due to measurement errors. An alternate estimator of rainfall rate using reflectivity factor and Z(sub DR) is derived, so that this estimator is fairly robust over the full dynamic range of reflectivity factor and Z(sub DR). Simulations are used to study the error structure of this robust estimator in comparison with the conventional estimator of rainfall rate. It is shown that the alternate estimator performs better than the conventional estimator of rainfall rate at all rainfall values. In particular the largest improvement of this estimator is proved to be in light rain. The robust estimator is obtained as a direct regression of rainfall rate against reflectivity factor and Z(sub DR) instead of solving for the drop size distribution.

Gorgucci, Eugenio↗

Advanced Multimission Operations System (ATMO)

The HiiHat toolbox developed for CAT/ENVI provides principal investigators direct, immediate, flexible, and seamless interaction with their instruments and data from any location. Offering segmentation and neutral region division, it facilitates the discovery of key endmembers and regions of interest larger than a single pixel. Crucial to the analysis of hyperspectral data from Mars or Earth is the removal of unwanted atmospheric signatures. For Mars and the Compact Reconnaissance Imaging Spectrometer for Mars (CRISM), residual atmospheric CO2 absorption is both directly problematic and indicative of processing errors with implications to the scientific utility of any particular image region. Estimating this residual error becomes key both in selecting regions of low distortion, and also to select mitigating methods, such as neutral region division. This innovation, the ATMO estimator, provides a simple, 0-1 normalized scalar that estimates this distortion (see figure). The metric is defined as the coefficient of determination of a quadratic fit in the region of distorting atmospheric absorption (approx 2 micron). This mimics the behavior of existing CRISM team mineralogical indices to estimate the presence of known, interesting mineral signatures. This facilitates the ATMO metric's assimilation into existing planetary geology workflows.

Mandrake, Lucas↗

Dynamic Method for Identifying Collected Sample Mass

G-Sample is designed for sample collection missions to identify the presence and quantity of sample material gathered by spacecraft equipped with end effectors. The software method uses a maximum-likelihood estimator to identify the collected sample's mass based on onboard force-sensor measurements, thruster firings, and a dynamics model of the spacecraft. This makes sample mass identification a computation rather than a process requiring additional hardware. Simulation examples of G-Sample are provided for spacecraft model configurations with a sample collection device mounted on the end of an extended boom. In the absence of thrust knowledge errors, the results indicate that G-Sample can identify the amount of collected sample mass to within 10 grams (with 95-percent confidence) by using a force sensor with a noise and quantization floor of 50 micrometers. These results hold even in the presence of realistic parametric uncertainty in actual spacecraft inertia, center-of-mass offset, and first flexibility modes. Thrust profile knowledge is shown to be a dominant sensitivity for G-Sample, entering in a nearly one-to-one relationship with the final mass estimation error. This means thrust profiles should be well characterized with onboard accelerometers prior to sample collection. An overall sample-mass estimation error budget has been developed to approximate the effect of model uncertainty, sensor noise, data rate, and thrust profile error on the expected estimate of collected sample mass.

Carson, John↗

Estimation and identification study for flexible vehicles

Techniques are studied for the estimation of rigid body and bending states and the identification of model parameters associated with the single-axis attitude dynamics of a flexible vehicle. This problem is highly nonlinear but completely observable provided sufficient attitude and attitude rate data is available and provided all system bending modes are excited in the observation interval. A sequential estimator tracks the system states in the presence of model parameter errors. A batch estimator identifies all model parameters with high accuracy.

Jazwinski, A. H.↗

Maximum likelihood estimation of label imperfections and its use in the identification of mislabeled patterns

The problem of estimating label imperfections and the use of the estimation in identifying mislabeled patterns is presented. Expressions for the maximum likelihood estimates of classification errors and a priori probabilities are derived from the classification of a set of labeled patterns. Expressions also are given for the asymptotic variances of probability of correct classification and proportions. Simple models are developed for imperfections in the labels and for classification errors and are used in the formulation of a maximum likelihood estimation scheme. Schemes are presented for the identification of mislabeled patterns in terms of threshold on the discriminant functions for both two-class and multiclass cases. Expressions are derived for the probability that the imperfect label identification scheme will result in a wrong decision and are used in computing thresholds. The results of practical applications of these techniques in the processing of remotely sensed multispectral data are presented.

Chittineni, C. B.↗

A study of examiner accuracy in cartridge case comparisons. Part 1: Examiner error rates

This report describes a study undertaken to estimate examiner (not laboratory) error rates for false Identifications and false Eliminations when comparing an unknown to a collection of three known cartridge cases. Volunteer active examiners with Association of Firearm and Toolmark Examiners (AFTE) membership or working in laboratories that participate in the Association of Crime Laboratory Directors (ASCLD) were provided with 15 sets of three known and one questioned cartridge cases fired from a collection of 25 new Ruger SR9 handguns. Remington 9-mm Luger (manufacturer designation L9MM3) ammunition was used and comparison sets were made up of cartridge cases fired within 100 cartridges of each other for each gun. Examiners were provided with a background survey, an answer sheet allowing for the AFTE Range of Conclusions, and return shipping materials. In addition to determining whether the known and questioned cartridge cases were fired with the same handgun, examiners were also asked to assess how many of the three knowns in each set were suitable for comparison, providing an estimated rate of how often each firearm used in the study produces useable, quality marks. The participating examiners were provided with both same-source and different-source comparison sets allowing the study to assess both error rates. Responses were received from 218 participating examiners. The overall rate of false Eliminations was estimated as 0.367% from comparisons known to be from the same firearm but reported as Eliminations. The overall rate of false Identifications was estimated as 1.01% from comparisons known to be from different firearms but reported as Identifications. The rates are not uniform across the sample population with a few examiners providing most of the false Identification responses. Rates of poor-quality mark production varied across the 25 sample handguns; those rates were 2.3% (±1.4%). Both false Elimination and false Identification rates are comparable to or lower than the rate of production of poor-quality marks by the firearms used in this study.

99 GENERAL AND MISCELLANEOUS↗

High-Pressure Apparatus for Monitoring Solid–Liquid Phase Transitions

This work presents a new technique for observing the solid–liquid phase transformations in complex diesel fuel blends and diesel surrogates under high-pressure conditions intended to simulate those occurring in vehicle fuel injectors. A high-pressure apparatus based on a visual identification of freezing and thawing has been designed and built to monitor phase behavior and determine the crystallization temperature of complex fuels to predict wax precipitation. The proposed methodology was validated using pure substances—n-hexadecane (C16H34), cyclohexane (C6H12), and a binary cyclohexane/n-hexadecane mixture—all of which have been well-characterized previously. The crystallization temperatures of these compounds were measured from atmospheric pressure to 400 MPa for temperatures varying from 290 to 363 K and compared to those reported in the literature. The standard error of the estimated temperatures, based on a given pressure, between the experimental data obtained in this work was compared to data in the literature from Domanska et al. This methodology is being extended to investigate the properties of more complex fuel mixtures.

High-Pressure, phase change, diesel, solidificatio↗

Advances in Land Data Assimilation at the NASA Goddard Space Flight Center

Research in land surface data assimilation has grown rapidly over the last decade. In this presentation we provide a brief overview of key research contributions by the NASA Goddard Space Flight Center (GSFC). The GSFC contributions to land assimilation primarily include the continued development and application of the Land Information System (US) and the ensemble Kalman filter (EnKF). In particular, we have developed a method to generate perturbation fields that are correlated in space, time, and across variables and that permit the flexible modeling of errors in land surface models and observations, along with an adaptive filtering approach that estimates observation and model error input parameters. A percentile-based scaling method that addresses soil moisture biases in model and observational estimates opened the path to the successful application of land data assimilation to satellite retrievals of surface soil moisture. Assimilation of AMSR-E surface soil moisture retrievals into the NASA Catchment model provided superior surface and root zone assimilation products (when validated against in situ measurements and compared to the model estimates or satellite observations alone). The multi-model capabilities of US were used to investigate the role of subsurface physics in the assimilation of surface soil moisture observations. Results indicate that the potential of surface soil moisture assimilation to improve root zone information is higher when the surface to root zone coupling is stronger. Building on this experience, GSFC leads the development of the Level 4 Surface and Root-Zone Soil Moisture (L4_SM) product for the planned NASA Soil-Moisture-Active-Passive (SMAP) mission. A key milestone was the design and execution of an Observing System Simulation Experiment that quantified the contribution of soil moisture retrievals to land data assimilation products as a function of retrieval and land model skill and yielded an estimate of the error budget for the SMAP L4_SM product. Terrestrial water storage observations from GRACE satellite system were also successfully assimilated into the NASA Catchment model and provided improved estimates of groundwater variability when compared to the model estimates alone. Moreover, satellite-based land surface temperature (LST) observations from the ISCCP archive were assimilated using a bias estimation module that was specifically designed for LST assimilation. As with soil moisture, LST assimilation provides modest yet statistically significant improvements when compared to the model or satellite observations alone. To achieve the improvement, however, the LST assimilation algorithm must be adapted to the specific formulation of LST in the land model. An improved method for the assimilation of snow cover observations was also developed. Finally, the coupling of LIS to the mesoscale Weather Research and Forecasting (WRF) model enabled investigations into how the sensitivity of land-atmosphere interactions to the specific choice of planetary boundary layer scheme and land surface model varies across surface moisture regimes, and how it can be quantified and evaluated against observations. The on-going development and integration of land assimilation modules into the Land Information System will enable the use of GSFC software with a variety of land models and make it accessible to the research community.

Reichle, Rolf↗

Machine Learning Derived Dynamic Operating Reserve Requirements in High-Renewable Power Systems

Accurately forecasting wind and solar power output poses challenges for deeply decarbonized electricity systems. Grid operators must commit resources to provide reserves to ensure reliable operations in the face of forecast errors, a process which can increase fuel consumption and emissions. We apply neural network-based machine learning to expand the usefulness of median point forecast data by creating probabilistic distributions of short-term uncertainty in demand, wind, and solar forecasts that adapt to prevailing grid conditions. Machine learning derived estimates of forecast errors compare favorably to estimates based on incumbent methods. Reserves derived from machine learning are usually smaller than values derived using incumbent methods, which enables fuel savings during most hours. Machine learning reserves are generally larger than incumbent reserves during times of higher forecast error, potentially improving system reliability. Performance is tested using multi-stage production simulation modeling of the California Independent System Operator (CAISO) system. Machine learning reserves provide production cost and greenhouse gas (GHG) emission reductions of approximately 0.3% relative to historical 2019 requirements. Savings in the 2030 timeframe are highly dependent on battery storage capacity. At lower levels of battery capacity, savings of 0.4% from machine learning reserves are shown. Significant quantities of battery storage are expected to be added to meet California's resource adequacy needs and GHG reduction targets. Addition of these batteries saturate reserve needs and results in minimal within-hour balancing costs in 2030.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A probability density function model describing height estimation uncertainty due to image pixel intensity noise in digital fringe projection measurements

Digital fringe projection is a surface-profiling technique used for highly accurate non-contact measurements. As with any measurement technique, a variety of sources degrade to the measurement accuracy of the method. Here, this paper presents an analytically-derived probability density function that explicitly models the surface height measurement error due to inevitable phase measurement error, and it includes the specific case of pixel noise inducing the phase measurement error that ultimately leads to the height estimation error. The accuracy of the model was validated through Monte-Carlo simulations of resultant height distributions subject to arbitrarily correlated pixel intensity noise and experimental digital fringe projection measurements where the pixel-by-pixel height uncertainty estimations were compared to the predictions of the derived model.

42 ENGINEERING↗

Enter Gaussian Mixture Modeling Extensions for Improved False Discovery Rate Estimation in GC-MS Metabolomics

Identifying small molecules (e.g., metabolites) is key towards driving scientific advancement in metabolomics, and gas chromatography–mass spectrometry (GC-MS) is an analytic method that may be applied to facilitate this process. The typical GC-MS identification workflow involves quantifying the similarity of an observed sample spectrum and other features (e.g. retention index) to that of several references, noting the compound of the best-matching reference spectrum as the identified metabolite. While a deluge of similarity metrics exists, none characterize the error rate of generated identifications, thereby presenting an unknown risk of false identification or discovery. To quantify this unknown risk, we propose a model-based framework for estimating the false discovery rate (FDR) among a set of identifications. Extending the traditional mixture modeling framework, our method incorporates both similarity score and experimental information in estimating the FDR. We apply these models to identification lists derived from across 548 samples of varying complexity and sample type (e.g., fungal species, standard mixtures, etc.), comparing their performance to that of the traditional Gaussian mixture model (GMM). Through simulation, we additionally assess the impact of reference library size on the accuracy of FDR estimates. In comparing the best performing model extensions to the GMM, our results indicate relative decreases in median absolute estimation error (MAE) ranging from 12% to 70%, based on comparisons of the median MAEs across all hit-lists. Results indicate that these relative performance improvements generally hold despite library size, however FDR estimation error typically worsens as the set of reference compounds diminishes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Comparison of Precision of Biomass Estimates in Regional Field Sample Surveys and Airborne LiDAR-Assisted Surveys in Hedmark County, Norway

Airborne scanning LiDAR (Light Detection and Ranging) has emerged as a promising tool to provide auxiliary data for sample surveys aiming at estimation of above-ground tree biomass (AGB), with potential applications in REDD forest monitoring. For larger geographical regions such as counties, states or nations, it is not feasible to collect airborne LiDAR data continuously ("wall-to-wall") over the entire area of interest. Two-stage cluster survey designs have therefore been demonstrated by which LiDAR data are collected along selected individual flight-lines treated as clusters and with ground plots sampled along these LiDAR swaths. Recently, analytical AGB estimators and associated variance estimators that quantify the sampling variability have been proposed. Empirical studies employing these estimators have shown a seemingly equal or even larger uncertainty of the AGB estimates obtained with extensive use of LiDAR data to support the estimation as compared to pure field-based estimates employing estimators appropriate under simple random sampling (SRS). However, comparison of uncertainty estimates under SRS and sophisticated two-stage designs is complicated by large differences in the designs and assumptions. In this study, probability-based principles to estimation and inference were followed. We assumed designs of a field sample and a LiDAR-assisted survey of Hedmark County (HC) (27,390 km2), Norway, considered to be more comparable than those assumed in previous studies. The field sample consisted of 659 systematically distributed National Forest Inventory (NFI) plots and the airborne scanning LiDAR data were collected along 53 parallel flight-lines flown over the NFI plots. We compared AGB estimates based on the field survey only assuming SRS against corresponding estimates assuming two-phase (double) sampling with LiDAR and employing model-assisted estimators. We also compared AGB estimates based on the field survey only assuming two-stage sampling (the NFI plots being grouped in clusters) against corresponding estimates assuming two-stage sampling with the LiDAR and employing model-assisted estimators. For each of the two comparisons, the standard errors of the AGB estimates were consistently lower for the LiDAR-assisted designs. The overall reduction of the standard errors in the LiDAR-assisted estimation was around 40-60% compared to the pure field survey. We conclude that the previously proposed two-stage model-assisted estimators are inappropriate for surveys with unequal lengths of the LiDAR flight-lines and new estimators are needed. Some options for design of LiDAR-assisted sample surveys under REDD are also discussed, which capitalize on the flexibility offered when the field survey is designed as an integrated part of the overall survey design as opposed to previous LiDAR-assisted sample surveys in the boreal and temperate zones which have been restricted by the current design of an existing NFI.

Comparison↗

Extensions of the space trajectories error analysis programs

A generalized covariance analysis technique which permits the study of the sensitivity of linear estimation algorithms to errors in a priori statistics has been developed and programed. Several sample cases are presented to illustrate the use of this technique. Modifications to the Simulated Trajectories Error Analysis Program (STEAP) to enable targeting a multiprobe mission of the Planetary Explorer type are discussed. The logic for the mini-probe targeting is presented. Finally, the initial phases of the conversion of the Viking mission Lander Trajectory Reconstruction (LTR) program for use on Venus missions is discussed. An integrator instability problem is discussed and a solution proposed.

Adams, G. L.↗