SEARCH · Engineering Papers

Results for “Statistical accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

All sources NASA NTRS DOE OSTI

NASA NTRS1981

Incorporating spatial context into statistical classification of multidimensional image data

Compound decision theory is employed to develop a general statistical model for classifying image data using spatial context. The classification algorithm developed from this model exploits the tendency of certain ground-cover classes to occur more frequently in some spatial contexts than in others. A key input to this contextural classifier is a quantitative characterization of this tendency: the context function. Several methods for estimating the context function are explored, and two complementary methods are recommended. The contextural classifier is shown to produce substantial improvements in classification accuracy compared to the accuracy produced by a non-contextural uniform-priors maximum likelihood classifier when these methods of estimating the context function are used. An approximate algorithm, which cuts computational requirements by over one-half, is presented. The search for an optimal implementation is furthered by an exploration of the relative merits of using spectral classes or information classes for classification and/or context function estimation.

Bauer, M. E.↗

NASA NTRS1982

On the detection of other planetary systems by astrometric techniques

A quantitative method for astrometrically detecting perturbations induced in a star's motion by the presence of a planetary object is described. A periodogram is defined, wherein signals observed from a star show exactly periodic variations, which can be extracted from observational data using purely statistical methods. A detection threshold is defined for the frequency of occurrence of some detectable signal, e.g., the Nyquist frequency. Possible effects of a stellar orbital eccentricity and multiple companions are discussed, noting that assumption of a circular orbit assures the spectral purity of the signal described. The periodogram technique was applied to 12 yr of astrometric data from the U.S. Naval Observatory for three stars with low mass stellar companions. Periodic perturbations were confirmed. A comparison of the accuracy of different astrometric systems shows that the detection accuracy of a system is determined by the measurement accuracy and the number of observations, although the detection efficiency can be maximized by minimizing the number of data points for the case when observational errors are proportional to the square root of the number of data points. It is suggested that a space-based astrometric telescope is best suited to take advantage of the method.

Black, D. C.↗

NASA NTRS2000

Evaluation of the Applicability of Solar and Lamp Radiometric Calibrations of a Precision Sun Photometer Operating Between 300 and 1025 nm

Over a period of 3 year a precision Sun photometer (SPM) operating between 300 and 1025 nm was calibrated four times at three different high-mountain sites in Switzerland, Germany, and the United States by means of the Langley-plot technique. We found that for atmospheric window wavelengths the total error (2 sigma-statistical plus systematic errors) of the calibration constants V(sub 0)(lambda), the SPM voltage in the absence of any attenuating atmosphere, can be kept below 1.60% in the UV-A and blue, 0.9% in the mid-visible, and 0.6% in the near-infra red spectral region. For SPM channels within strong water-vapor or ozone absorption bands a modified Langley-plot technique was used to determine V(sub 0)(lambda) with a lower accuracy. Within the same period of time, we calibrated the SPM five times using irradiance standard lamps in the optical labs of the Physikalisch-Meteorologisches Observatorium Davos and World Radiation Center, Switzerland, and of the Remote Sensing Group of the Optical Sciences Center, University of Arizona, Tucson, Arizona. The lab calibration method requires knowledge of the extraterrestrial spectral irradiance. When we refer the standard lamp results to the World Radiation Center extraterrestrial solar irradiance spectrum, they agree with the Langley results within 2% at 6 or 13 SPM wavelengths. The largest disagreement (4.4%) is found for the channel centered at 610 nm. The results of these intercomparisons change significantly when the lamp results are referred to two different extraterrestrial solar irradiance spectra that have become recently available.

Schmid, Beat↗

NASA NTRS1995

Application of Different Statistical Techniques in Integrated Logistics Support of the International Space Station Alpha

The process to predict the values of the maintenance time dependent variable parameters such as mean time between failures (MTBF) over time must be one that will not in turn introduce uncontrolled deviation in the results of the ILS analysis such as life cycle cost spares calculation, etc. A minor deviation in the values of the maintenance time dependent variable parameters such as MTBF over time will have a significant impact on the logistics resources demands, International Space Station availability, and maintenance support costs. It is the objective of this report to identify the magnitude of the expected enhancement in the accuracy of the results for the International Space Station reliability and maintainability data packages by providing examples. These examples partially portray the necessary information hy evaluating the impact of the said enhancements on the life cycle cost and the availability of the International Space Station.

Sepehry-Fard, F.↗

DOE OSTI2025

A cross-dimensional analysis of data-driven short-term load forecasting methods with large-scale smart meter data

Electricity load forecasting is essential to utility operation and power grid stability. A wide spectrum of data-driven methods, ranging from linear regression models to more recent deep learning models have been adopted to forecast electric load over the years. However, there still lacks a holistic evaluation of the applicability of conventional statistical and machine learning based algorithms with respect to different temporal and spatial scopes, computational requirements, and sensitivity of model-tuning. Enabled by a large-scale electricity load profile dataset of over 40,000 residential customers in a utility region, we conducted a cross-dimensional analysis of data-driven load forecasting methods. Three regression-based and seven deep learning algorithms with different model configurations were evaluated in terms of their overall and peak load prediction accuracy, and training burdens, across spatial aggregation levels ranging from the transformer, feeder, substation, to neighborhood. We found, first, the load forecasting accuracy is constrained by a predictability boundary, influenced by the forecasting horizon and spatial aggregation level. Specifically, RandomForest, XGBoost, TFT, TSMixer, and TiDE models achieved less than 10 % prediction error for up to 96-h ahead forecasting for district, substation, and feeder levels, while other models struggle at long-horizon predictions; Second, for winter and summer peak load dates, most models were able to predict the peak demand timing within ± 1 h, but the prediction percentage error varied by models, with TFT and TiDE models being the top performers; Third, models with similar prediction accuracy can differ in training burden by an order of magnitude. Therefore, choosing model configurations that balance prediction performance and computational resource is an important practical consideration for large-scale deployment of the machine learning based load forecasting. The outcome of this study can guide researchers and practitioners to choose the proper load forecasting algorithms based on their problem scope, required accuracy, and available resources. The predictability boundary can serve as a benchmark for electricity load forecasting problems with new algorithms and datasets.

Li, Han↗

NASA NTRS1945

A method of analysis of v-g records from transport operations

A method has been developed for interpreting v-g records taken during the course of commercial transport operation. This method involves the utilization of fairly simple statistical procedures to obtain "flight envelopes," which predict that, on the average, in a stated number of flight hours, one value of airspeed will exceed the envelope, and one positive and one negative acceleration increment will exceed the envelope with equal probability of being experienced at any airspeed. Comparison with the actual data obtained from various airplanes and from various airlines indicates that these envelopes predict the occurrences of large values of acceleration and airspeed with a high degree of accuracy.

Peiser, A M↗

NASA NTRS1997

Timing the Geminga Pulsar with High-Energy Gamma-Rays

This is a continuing program to extend and refine the ephemeris of the Geminga pulsar with annual observations for the remaining lifetime of EGRET. The data show that every revolution of Geminga is accounted for during the EGRET epoch, and that a coherent timing solution linking the phase between EGRET, COS-B, amd SAS-2, observations has now been achieved. The accuracy of the gamma-ray timing is such that the proper motion of the pulsar can now be detected, consistent with the optical determination. The measured braking index over the 24.2 yr baseline is 17 +/- 1. Further observation is required to ascertain whether this very large braking index truly represents the energy loss mechanism, perhaps related to the theory in which Geminga is near its gamma-ray death line, or whether it is a manifestation of timing noise. Statistically significant timing residuals are detected in the EGRET data; they depart from the cubic ephemeris at a level of 23 milliperiods. The residuals appear to have a sinusoidal modulation with a period of about 5.1 yr. This could simply be a manifestation of timing noise, or it could be consistent with a planet of mass 1.7/sin i solar mass orbiting Geminga at a radius of 3.3/sin i AU.

Halpern, Jules P.↗

NASA NTRS1945

A Method of Analysis of V-G Records from Transport Operations

A method has been developed for interpreting V-G records taken during the course of commercial transport operation. This method involves the utilization of fairly simple statistical procedures to obtain "flight envelopes," which predict that, on the average, in a stated number of flight hours, one value of airspeed will exceed the envelope, and one positive and one negative acceleration increment will exceed the envelope with equal probability of being experienced at any airspeed. Comparison with the actual data obtained from various airplanes and from various airlines indicates that these envelopes predict the occurrences of large values of acceleration and airspeed with a high degree of accuracy.

Peiser, A. M.↗

NASA NTRS2018

Soil Moisture Active Passive (SMAP) Project Assessment Report for Version 4 of the L4_SM Data Product

This report provides an assessment of Version 4 of the SMAP Level 4 Surface and Root Zone Soil Moisture (L4_SM) product, released on 14 June 2018. The assessment includes comparisons of L4_SM soil moisture and temperature estimates with in situ measurements from core validation sites and sparse networks. The assessment further includes a global evaluation of the internal diagnostics from the ensemble-based data assimilation system that is used to generate the L4_SM product, including observation-minus-forecast (O-F) brightness temperature residuals and soil moisture analysis increments.Together, the core validation site comparisons and the statistics of the assimilation diagnostics areconsidered primary validation methodologies for the L4_SM product. Comparisons against in situ measurements from regional-scale sparse networks are considered a secondary validation methodology because such in situ measurements are subject to upscaling errors from the point-scale to the grid-cell scale of the data product.The Version 4 L4_SM product benefits from an improved land surface modeling system and from retrospective surface meteorological forcing data that are as consistent as possible with the present-day datain terms of their climatology. Specifically, the model changes include revised parameters and parameterizations for (i) the surface energy balance, (ii) recharge from below of the model's surface excess reservoir, and (iii) the snow depletion curve. Updated ancillary inputs include improved datasets for landcover, topography, and vegetation height. The Version 4 algorithm further includes a revised approach to precipitation corrections that improves the precipitation climatology in Africa and the high-latitudes. Moreover, for system calibration the model is forced retrospectively with MERRA-2 reanalysis data, which are more consistent with the near-real time GEOS forward processing (FP) data used during the SMAP period than the retrospective GEOS data that were available for previous L4_SM versions. An analysis of the time-average surface and root zone soil moisture shows that the global pattern ofarid and humid regions is captured by the Version 4 L4_SM estimates. Owing to the changes in the landsurface modeling system, surface soil moisture is typically drier by several volumetric percent in Version 4 compared to Version 3, whereas root zone soil moisture is wetter in Version 4 in some regions and drierin others. Because of these climatological differences, the Version 3 and Version 4 products should not be combined into a single dataset for use in applications.Results from the core validation site comparisons indicate that Version 4 of the L4_SM data product meets the self-imposed L4_SM accuracy requirement, which is formulated in terms of the RMSE after removal of the long-term mean difference (ubRMSE). The overall ubRMSE of the 3-hourly L4_SM dataat the 9 km scale is 0.039 m3 m-3 for surface soil moisture and 0.029 m3 m-3 for root zone soil moisture,below the 0.04 m3 m-3 requirement. The L4_SM estimates are an improvement over estimates from a model-only Nature Run version 7.2 (NRv7.2), which demonstrates the beneficial impact of the SMAP brightness temperature data. Overall, L4_SM surface and root zone soil moisture estimates are more skillful than NRv7.2 estimates, with statistically significant improvements at the 5% level for surface soil moisture R and anomaly R values. Results from comparisons of the L4_SM product to i

Reichle, Rolf H.↗

DOE OSTI2021

Statistically bias-corrected and downscaled climate models underestimate the adverse effects of extreme heat on U.S. maize yields

Abstract Efforts to understand and quantify how a changing climate can impact agriculture often rely on bias-corrected and downscaled climate information, making it important to quantify potential biases of this approach. Here, we use a multi-model ensemble of statistically bias-corrected and downscaled climate models, as well as the corresponding parent models from the Coupled Model Intercomparison Project Phase 5 (CMIP5), to drive a statistical panel model of U.S. maize yields that incorporates season-wide measures of temperature and precipitation. We analyze uncertainty in annual yield hindcasts, finding that the CMIP5 models considerably overestimate historical yield variability while the bias-corrected and downscaled versions underestimate the largest weather-induced yield declines. We also find large differences in projected yields and other decision-relevant metrics throughout this century, leaving stakeholders with modeling choices that require navigating trade-offs in resolution, historical accuracy, and projection confidence.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

A Bayesian Approach for Characterizing and Mitigating Gate and Measurement Errors

Various noise models have been developed in quantum computing study to describe the propagation and effect of the noise that is caused by imperfect implementation of hardware. Identifying parameters such as gate and readout error rates is critical to these models. We use a Bayesian inference approach to identify posterior distributions of these parameters such that they can be characterized more elaborately. By characterizing the device errors in this way, we can further improve the accuracy of quantum error mitigation. Experiments conducted on IBM’s quantum computing devices suggest that our approach provides better error mitigation performance than existing techniques used by the vendor. Also, our approach outperforms the standard Bayesian inference method in some scenarios.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1987

Variational approach to probabilistic finite elements

Probabilistic finite element method (PFEM), synthesizing the power of finite element methods with second-moment techniques, are formulated for various classes of problems in structural and solid mechanics. Time-invariant random materials, geometric properties, and loads are incorporated in terms of their fundamental statistics viz. second-moments. Analogous to the discretization of the displacement field in finite element methods, the random fields are also discretized. Preserving the conceptual simplicity, the response moments are calculated with minimal computations. By incorporating certain computational techniques, these methods are shown to be capable of handling large systems with many sources of uncertainties. By construction, these methods are applicable when the scale of randomness is not very large and when the probabilistic density functions have decaying tails. The accuracy and efficiency of these methods, along with their limitations, are demonstrated by various applications. Results obtained are compared with those of Monte Carlo simulation and it is shown that good accuracy can be obtained for both linear and nonlinear problems. The methods are amenable to implementation in deterministic FEM based computer codes.

Belytschko, T.↗

NASA NTRS1991

Variational approach to probabilistic finite elements

Probabilistic finite element methods (PFEM), synthesizing the power of finite element methods with second-moment techniques, are formulated for various classes of problems in structural and solid mechanics. Time-invariant random materials, geometric properties and loads are incorporated in terms of their fundamental statistics viz. second-moments. Analogous to the discretization of the displacement field in finite element methods, the random fields are also discretized. Preserving the conceptual simplicity, the response moments are calculated with minimal computations. By incorporating certain computational techniques, these methods are shown to be capable of handling large systems with many sources of uncertainties. By construction, these methods are applicable when the scale of randomness is not very large and when the probabilistic density functions have decaying tails. The accuracy and efficiency of these methods, along with their limitations, are demonstrated by various applications. Results obtained are compared with those of Monte Carlo simulation and it is shown that good accuracy can be obtained for both linear and nonlinear problems. The methods are amenable to implementation in deterministic FEM based computer codes.

Belytschko, T.↗

NASA NTRS2014

The Development of a Long-Term, Continually Updated Global Solar Resource at 10 km Resolution: Preliminary Results From Test Processing and Continuing Plans

Background: Considering the likelihood of global climatic weather pattern changes and the global competition for energy resources, there is an increasing need to provide improved and continuously updated global Earth surface solar resource information. Toward this end, a project was funded under the NASA Applied Science program involving the National Aeronautics and Space Administration (NASA) Langley Research Center (LaRC), National Renewable Energy Laboratory (NREL), the State University of New York/Albany (SUNY) and the NOAA National Climatic Data Center (NCDC) to provide NREL with a global long-term advanced global solar mapping production system for improved depiction of historical solar resources and variability and to provide a mechanism for continual updates of solar resource information. This new production system is made possible by the efforts of NOAA and NASA to completely reprocess the International Satellite Cloud Climatology Project (ISCCP) data set that provides satellite visible and infrared radiances together with retrieved cloud and surface properties on a 3-hourly basis beginning from July 1983. The old version of the ISCCP data provided this information for all the world TMs available geosynchronous satellite systems and NOAA TMs AVHRR data sets at a 30 km effective resolution. This new version aims to provide a new and improved satellite calibration at an effective 10 km resolution. Thus, working with SUNY, NASA will develop and test an improved production system that will enable NREL to continually update the Earth TM solar resource. Objective and Methods: In this presentation, we provide a general overview of this project together with samples of the new solar irradiance mapped data products and comparisons to surface measurements at various locations across the world. An assessment of the solar resource values relative to calibration uncertainty and assumptions are presented. Errors resulting assumptions in snow cover and background aerosol amount are described. These uncertainties and the statistics of the agreement between the measurements and new satellite estimates are also reviewed and compared to other solar data sets. Findings and Conclusions: Preliminary results show that insolation values show an overall small bias (less than 1%) with a RMS of 25% relative to surface measurements. Exceptions at certain locations were found and will be discussed relative to the uncertainties identified above. Lastly, we will identify the next steps in the development and improvement of this production system including some accuracy goals in preparation for ultimate delivery to NREL.

Stackhouse, P.↗

NASA NTRS1988

Interpreting forest biome productivity and cover utilizing nested scales of image resolution and biogeographical analysis

The objective was to relate spectral imagery of varying resolution with ground-based data on forest productivity and cover, and to create models to predict regional estimates of forest productivity and cover with a quantifiable degree of accuracy. A three stage approach was outlined. In the first stage, a model was developed relating forest cover or productivity to TM surface reflectance values (TM/FOREST models). The TM/FOREST models were more accurate when biogeographic information regarding the landscape was either used to stratigy the landscape into more homogeneous units or incorporated directly into the TM/FOREST model. In the second stage, AVHRR/FOREST models that predicted forest cover and productivity on the basis of AVHRR band values were developed. The AVHRR/FOREST models had statistical properties similar to or better than those of the TM/FOREST models. In the third stage, the regional predictions were compared with the independent U.S. Forest Service (USFS) data. To do this regional forest cover and forest productivity maps were created using AVHRR scenes and the AVHRR/FOREST models. From the maps the county values of forest productivity and cover were calculated. It is apparent that the landscape has a strong influence on the success of the approach. An approach of using nested scales of imagery in conjunction with ground-based data can be successful in generating regional estimates of variables that are functionally related to some variable a sensor can detect.

Iverson, Louis R.↗

NASA NTRS1993

Feature extraction and classification algorithms for high dimensional data

Feature extraction and classification algorithms for high dimensional data are investigated. Developments with regard to sensors for Earth observation are moving in the direction of providing much higher dimensional multispectral imagery than is now possible. In analyzing such high dimensional data, processing time becomes an important factor. With large increases in dimensionality and the number of classes, processing time will increase significantly. To address this problem, a multistage classification scheme is proposed which reduces the processing time substantially by eliminating unlikely classes from further consideration at each stage. Several truncation criteria are developed and the relationship between thresholds and the error caused by the truncation is investigated. Next an approach to feature extraction for classification is proposed based directly on the decision boundaries. It is shown that all the features needed for classification can be extracted from decision boundaries. A characteristic of the proposed method arises by noting that only a portion of the decision boundary is effective in discriminating between classes, and the concept of the effective decision boundary is introduced. The proposed feature extraction algorithm has several desirable properties: it predicts the minimum number of features necessary to achieve the same classification accuracy as in the original space for a given pattern recognition problem; and it finds the necessary feature vectors. The proposed algorithm does not deteriorate under the circumstances of equal means or equal covariances as some previous algorithms do. In addition, the decision boundary feature extraction algorithm can be used both for parametric and non-parametric classifiers. Finally, some problems encountered in analyzing high dimensional data are studied and possible solutions are proposed. First, the increased importance of the second order statistics in analyzing high dimensional data is recognized. By investigating the characteristics of high dimensional data, the reason why the second order statistics must be taken into account in high dimensional data is suggested. Recognizing the importance of the second order statistics, there is a need to represent the second order statistics. A method to visualize statistics using a color code is proposed. By representing statistics using color coding, one can easily extract and compare the first and the second statistics.

Lee, Chulhee↗

NASA NTRS1998

Efficient Methods to Assimilate Satellite Retrievals Based on Information Content: Suboptimal Retrieval Assimilation - Part 2

One of the outstanding problems in data assimilation has been and continues to be how best to utilize satellite data while balancing the tradeoff between accuracy and computational cost. A number of weather prediction centers have recently achieved remarkable success in improving their forecast skill by changing the method by which satellite data are assimilated into the forecast model from the traditional approach of assimilating retrievals to the direct assimilation of radiances in a variational framework. The operational implementation of such a substantial change in methodology involves a great number of technical details, e.g., pertaining to quality control procedures, systematic error correction techniques, and tuning of the statistical parameters in the analysis algorithm. Although there are clear theoretical advantages to the direct radiance assimilation approach, it is not obvious at all to what extent the improvements that have been obtained so far can be attributed to the change in methodology, or to various technical aspects of the implementation. The issue is of interest because retrieval assimilation retains many practical and logistical advantages which may become even more significant in the near future when increasingly high-volume data sources become available. The central question we address here is: how much improvement can we expect from assimilating radiances rather than retrievals, all other things being equal? We compare the two approaches in a simplified one-dimensional theoretical framework, in which problems related to quality control and systematic error correction are conveniently absent. By assuming a perfect radiative transfer model and perfect knowledge of radiance and background error covariances, we are able to formulate a nonlinear local error analysis for each assimilation method. Direct radiance assimilation is optimal in this idealized context, while the traditional method of assimilating retrievals is suboptimal because it ignores the cross-covariances between background errors and retrieval errors. We show that interactive retrieval assimilation (where the same background used for assimilation is also used in the retrieval step) is equivalent to direct assimilation of radiances with suboptimal analysis weights. We illustrate and extend these theoretical arguments with several one-dimensional assimilation experiments, where we estimate vertical atmospheric profiles using simulated data from both the High-resolution InfraRed Sounder 2 (HIRS2) and the future Atmospheric InfraRed Sounder (AIRS).

Joiner, J.↗

DOE OSTI2023

Reconstructing large-scale temperature profiles around z ∼ 6 quasars

ABSTRACT High-redshift quasars ionize He ii into He iii around them, heating the intergalactic medium in the process and creating large regions with elevated temperature. In this work, we demonstrate a method based on a convolutional neural network (CNN) to recover the spatial profile for T0, the temperature at the mean cosmic density, in quasar proximity zones. We train the neural network with synthetic spectra drawn from a Cosmic Reionization on Computers simulation. We discover that the simple CNN is able to recover the temperature profile with an accuracy of ≈1400 K in an idealized case of negligible observational uncertainties. We test the robustness of the CNN and discover that it is robust against the uncertainties in quasar host halo mass, quasar continuum, and ionizing flux. We also find that the CNN has good generality with regard to the hardness of quasar spectra. This shows that with noiseless spectra, one could use a simple CNN to distinguish gas inside or outside the He iii region created by the quasar. Because the size of the He iii region is closely related to the total quasar lifetime, this method has great potential in constraining the quasar lifetime on ∼Myr time-scales. However, noise poses a big problem for accuracy and could downgrade the accuracy to ≈2340 K even for very high signal-to-noise (≳50) spectra. Future studies are needed to reduce the error associated with noise to constrain the lifetimes of reionization epoch quasars with currently available data.

79 ASTRONOMY AND ASTROPHYSICS↗