Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Classifying northern forests using Thematic Mapper Simulator data

Thematic Mapper Simulator data were collected over a 23,200 hectare forested area near Baxter State Park in north-central Maine. Photointerpreted ground reference information was used to drive a stratified random sampling procedure for waveband discriminant analyses and to generate training statistics and test pixel accuracies. Stepwise discriminant analyses indicated that the following bands best differentiated the thirteen level II - III cover types (in order of entry): near infrared (0.77 to 0.90 micron), blue (0.46 0.52 micron), first middle infrared (1.53 to 1.73 microns), second middle infrared (2.06 to 2.33 microsn), red (0.63 to 0.69 micron), thermal (10.32 to 12.33 microns). Classification accuracies peaked at 58 percent for thirteen level II-III land-cover classes and at 65 percent for ten level II classes.

Nelson, R. F.↗

Landsat Thematic Mapper studies of land cover spatial variability related to hydrology

Past accomplishments involving remote sensing based land-cover analysis for hydrologic applications are reviewed. Ongoing research in exploiting the increased spatial, radiometric, and spectral capabilities afforded by the TM on Landsats 4 and 5 is considered. Specific studies to compare MSS and TM for urbanizing watersheds, wetlands, and floodplain mapping situations show that only a modest improvement in classification accuracy is achieved via statistical per pixel multispectral classifiers. The limitations of current approaches to multispectral classification are illustrated. The objectives, background, and progress in the development of an alternative analysis approach for defining inputs to urban hydrologic models using TM are discussed.

Wharton, S.↗

Experimental characterization of the perceptron laser rangefinder

In this report, we characterize experimentally a scanning laser rangefinder that employs active sensing to acquire three-dimensional images. We present experimental techniques applicable to a wide variety of laser scanners, and document the results of applying them to a device manufactured by Perceptron. Nominally, the sensor acquires data over a 60 deg x 60 deg field of view in 256 x 256 pixel images at 2 Hz. It digitizes both range and reflectance pixels to 12 bits, providing a maximum range of 40 m and a depth resolution of 1 cm. We present methods and results from experiments to measure geometric parameters including the field of view, angular scanning increments, and minimum sensing distance. We characterize qualitatively problems caused by implementation flaws, including internal reflections and range drift over time, and problems caused by inherent limitations of the rangefinding technology, including sensitivity to ambient light and surface material. We characterize statistically the precision and accuracy of the range measurements. We conclude that the performance of the Perceptron scanner does not compare favorably with the nominal performance, that scanner modifications are required, and that further experimentation must be conducted.

Kweon, I. S.↗

JSC almanac

During America's space shuttle flights, press and public attention focuses on the Johnson Space Center in Houston. The press and public often put questions to JSC technical and management staff. This fourth JSC Almanac supplies answers for many such questions, and provide an informational resource for speeches to general interest groups. This Almanac is not necessarily comprehensive or definitive. It is not intended as a statement of JSC or NASA policy. However, it does provide a much needed compilation of information from diverse sources. These sources are given as references, permitting the reader to obtain additional information as required. While every effort has been made to ensure accuracy and to reconcile statistics, users requiring the most up-to-date and accurate information should contact the office supplying the information at issue. The Almanac is updated periodically as needed. The following offices were responsible for supplying material for this update.

Source record↗

Influence of Computational Drop Representation in LES of a Droplet-Laden Mixing Layer

Multiphase turbulent flows are encountered in many practical applications including turbine engines or natural phenomena involving particle dispersion. Numerical computations of multiphase turbulent flows are important because they provide a cheaper alternative to performing experiments during an engine design process or because they can provide predictions of pollutant dispersion, etc. Two-phase flows contain millions and sometimes billions of particles. For flows with volumetrically dilute particle loading, the most accurate method of numerically simulating the flow is based on direct numerical simulation (DNS) of the governing equations in which all scales of the flow including the small scales that are responsible for the overwhelming amount of dissipation are resolved. DNS, however, requires high computational cost and cannot be used in engineering design applications where iterations among several design conditions are necessary. Because of high computational cost, numerical simulations of such flows cannot track all these drops. The objective of this work is to quantify the influence of the number of computational drops and grid spacing on the accuracy of predicted flow statistics, and to possibly identify the minimum number, or, if not possible, the optimal number of computational drops that provide minimal error in flow prediction. For this purpose, several Large Eddy Simulation (LES) of a mixing layer with evaporating drops have been performed by using coarse, medium, and fine grid spacings and computational drops, rather than physical drops. To define computational drops, an integer NR is introduced that represents the ratio of the number of existing physical drops to the desired number of computational drops; for example, if NR=8, this means that a computational drop represents 8 physical drops in the flow field. The desired number of computational drops is determined by the available computational resources; the larger NR is, the less computationally intensive is the simulation. A set of first order and second order flow statistics, and of drop statistics are extracted from LES predictions and are compared to results obtained by filtering a DNS database. First order statistics such as Favre averaged stream-wise velocity, Favre averaged vapor mass fraction, and the drop stream-wise velocity, are predicted accurately independent of the number of computational drops and grid spacing. Second order flow statistics depend both on the number of computational drops and on grid spacing. The scalar variance and turbulent vapor flux are predicted accurately by the fine mesh LES only when NR is less than 32, and by the coarse mesh LES reasonably accurately for all NR values. This is attributed to the fact that when the grid spacing is coarsened, the number of drops in a computational cell must not be significantly lower than that in the DNS.

Bellan, Josette↗

Using Federated Learning to Overcome Data Gravity in Space

Humans intend to take longer missions to outer space. Understanding the impact that space has on human health is paramount to the success of these missions. Controlled experiments with model organisms are run to infer the impact of space conditions on human health, but the data these experiments generate are too large to transfer to Earth for building models. The same is true for space-relevant data generated on Earth. Ideally, these datasets should be combined to improve statistical power and model accuracy without having to transfer data. Federated learning is such a method which trains an algorithm across decentralized computing systems, each of which has their own local copy of training and testing data. In this research, made possible by NASA@Work, the AI for Life in Space group at NASA demonstrates the use of federated learning to train an ensemble of causality inference models on a combination of data residing on the International Space Station (ISS) and in the cloud. Our work leverages CRISP, a causal inference platform developed during the 2020 Frontier Development Lab’s “Astronaut Health Challenge.” We also leverage the OpenFL federated learning library which was collaboratively developed at Intel and UPenn. We used publicly available data from the NASA Ames Life Sciences Data Archive to identify features in ionizing radiation experiments as causal of changes in cardiac blood velocity. This research demonstrates, for the first time, the possibility of running machine learning algorithms on datasets separated by astronomical distances. In this experiment, all the data were generated in terra, half of which were transferred to the ISS and analyzed on the Spaceborne Computer. In the future, our research will leverage federated learning on data generated in situ on the ISS with data generated terrestrially to predict the impact of spaceflight on mammalian female reproductive capacity.

James Casaletto↗

NASA Engineering and Safety Center Technical Bulletin No. 22-04: Uncertainty Quantification of Reduced Order Structural Dynamic Models

Uncertainty quantification (UQ) provides statistical bounds on prediction accuracy based on finite element model (FEM) uncertainty. An alternate method for UQ, called the Hybrid Parametric Variation (HPV) combines a parametric variation of the Hurty/Craig-Bampton (HCB) fixed-interface (FI) modal frequencies with a nonparametric variation (NPV) method. This provides a UQ method that can be traced to test data, which can be updated as additional data and improved correlated models become available.

Uncertainty Quantification↗

Evaluation of the 29-km Eta Model: Objective Verification at Three Selected Stations - Part 1

This paper describes an objective verification of the National Centers for Environmental Prediction (NCEP) 29-km eta model from May 1996 through January 1998. The evaluation was designed to assess the model's surface and upper-air point forecast accuracy at three selected locations during separate warm (May - August) and cool (October - January) season periods. In order to enhance sample sizes available for statistical calculations, the objective verification includes two consecutive warm and cool season periods. Systematic model deficiencies comprise the larger portion of the total error in most of the surface forecast variables that were evaluated. The error characteristics for both surface and upper-air forecasts vary widely by parameter, season, and station location. At upper levels, a few characteristic biases are identified. Overall however, the upper-level errors are more nonsystematic in nature and could be explained partly by observational measurement uncertainty. With a few exceptions, the upper-air results also indicate that 24-h model error growth is not statistically significant. In February and August 1997, NCEP implemented upgrades to the eta model's physical parameterizations that were designed to change some of the model's error characteristics near the surface. The results shown in this paper indicate that these upgrades led to identifiable and statistically significant changes in forecast accuracy for selected surface parameters. While some of the changes were expected, others were not consistent with the intent of the model updates and further emphasize the need for ongoing sensitivity studies and localized statistical verification efforts. Objective verification of point forecasts is a stringent measure of model performance, but when used alone, is not enough to quantify the overall value that model guidance may add to the forecast process. Therefore, results from a subjective verification of the meso-eta model over the Florida peninsula are discussed in the companion paper by Manobianco and Nutter. Overall verification results presented here and in part two should establish a reasonable benchmark from which model users and developers may pursue the ongoing eta model verification strategies in the future.

Nutter, Paul A.↗

Area estimation of crops by digital analysis of Landsat data

The study for which the results are presented had these objectives: (1) to use Landsat data and computer-implemented pattern recognition to classify the major crops from regions encompassing different climates, soils, and crops; (2) to estimate crop areas for counties and states by using crop identification data obtained from the Landsat identifications; and (3) to evaluate the accuracy, precision, and timeliness of crop area estimates obtained from Landsat data. The paper describes the method of developing the training statistics and evaluating the classification accuracy. Landsat MSS data were adequate to accurately identify wheat in Kansas; corn and soybean estimates for Indiana were less accurate. Systematic sampling of entire counties made possible by computer classification methods resulted in very precise area estimates at county, district, and state levels.

Bauer, M. E.↗

Prognostic significance of electrical alternans versus signal averaged electrocardiography in predicting the outcome of electrophysiological testing and arrhythmia-free survival

OBJECTIVE: To investigate the accuracy of signal averaged electrocardiography (SAECG) and measurement of microvolt level T wave alternans as predictors of susceptibility to ventricular arrhythmias. DESIGN: Analysis of new data from a previously published prospective investigation. SETTING: Electrophysiology laboratory of a major referral hospital. PATIENTS AND INTERVENTIONS: 43 patients, not on class I or class III antiarrhythmic drug treatment, undergoing invasive electrophysiological testing had SAECG and T wave alternans measurements. The SAECG was considered positive in the presence of one (SAECG-I) or two (SAECG-II) of three standard criteria. T wave alternans was considered positive if the alternans ratio exceeded 3.0. MAIN OUTCOME MEASURES: Inducibility of sustained ventricular tachycardia or fibrillation during electrophysiological testing, and 20 month arrhythmia-free survival. RESULTS: The accuracy of T wave alternans in predicting the outcome of electrophysiological testing was 84% (p < 0.0001). Neither SAECG-I (accuracy 60%; p < 0.29) nor SAECG-II (accuracy 71%; p < 0.10) was a statistically significant predictor of electrophysiological testing. SAECG, T wave alternans, electrophysiological testing, and follow up data were available in 36 patients while not on class I or III antiarrhythmic agents. The accuracy of T wave alternans in predicting the outcome of arrhythmia-free survival was 86% (p < 0.030). Neither SAECG-I (accuracy 65%; p < 0.21) nor SAECG-II (accuracy 71%; p < 0.48) was a statistically significant predictor of arrhythmia-free survival. CONCLUSIONS: T wave alternans was a highly significant predictor of the outcome of electrophysiological testing and arrhythmia-free survival, while SAECG was not a statistically significant predictor. Although these results need to be confirmed in prospective clinical studies, they suggest that T wave alternans may serve as a non-invasive probe for screening high risk populations for malignant ventricular arrhythmias.

Non-NASA Center↗

Statistical temperature profile retrievals in clear-air using passive 118-GHz O2 observations

The clean-air temperature profile accuracy yielded by a localized linear statistical retrieval operator applied to passive aircraft-based 118-GHz spectra is demonstrated. A comparison of the statistically and physically derived correlation coefficients of antenna temperature and kinetic temperature furnishes a physical justification of the statistical retrieval technique. The atmospheric temperature mean and covariance significantly depend on such geophysical parameters as latitude, longitude, local season, and time, as well as the prevailing meteorological state and orographic effects.

Gasiewski, A. J.↗

Performance results of a digital test signal generator

Performance results of a digital test signal-generator hardware-demonstration unit are reported. Capabilities available include baseband and intermediate frequency (IF) spectrum generation, for which test results are provided. Repeatability in the setting of a given signal-to-noise ratio (SNR) when a baseband or an IF spectrum is being generated ranges from 0.01 dB at high SNR's or high data rates to 0.3 dB at low data rates or low SNR's. Baseband symbol SNR and carrier SNR (Pc/No) accuracies of 0.1 dB were verified with the built-in statistics circuitry. At low SNR's that accuracy remains to be fully verified. These results were confirmed with measurements from a demodulator synchronizer assembly for the baseband spectrum generation, and with a digital receiver (Pioneer 10 receiver) for the IF spectrum generation.

Gutierrez-Luaces, B. O.↗

Assessment of Computer-based Geologic Mapping of Rock Units in the LANDSAT-4 Scene of Northern Death Valley, California

Results from a series of geologic classifications conducted on a thematic mapper subscene of the northern Death Valley, California are reported. Measurements of accuracy are made through comparison with the 1977 edition of the Death Valley geologic sheet. This employs a simplified map version which is registered by computer to the image data base, allowing a pixel by pixel match with the classified scene. The results show accuracy ranges from 36 to 79% depending on the type of classifier used and the statistical adjustments made to the data. Accuracy values in identifying geologic units were 2 to 3 times higher for those in the relatively flat valleys than for units in the rugged mountainous terrain. Improvements in accuracy will be sought by correcting for slope/aspect variations in mountainous terrain using topographic data recorded in Defense Mapping Agency (DMA) tapes. The above classification results will also be compared with ratio and principal component image classifications made from the same scene.

Short, N. M.↗

Compositional Solution Space Quantification for Probabilistic Software Analysis

Probabilistic software analysis aims at quantifying how likely a target event is to occur during program execution. Current approaches rely on symbolic execution to identify the conditions to reach the target event and try to quantify the fraction of the input domain satisfying these conditions. Precise quantification is usually limited to linear constraints, while only approximate solutions can be provided in general through statistical approaches. However, statistical approaches may fail to converge to an acceptable accuracy within a reasonable time. We present a compositional statistical approach for the efficient quantification of solution spaces for arbitrarily complex constraints over bounded floating-point domains. The approach leverages interval constraint propagation to improve the accuracy of the estimation by focusing the sampling on the regions of the input domain containing the sought solutions. Preliminary experiments show significant improvement on previous approaches both in results accuracy and analysis time.

Monte Carlo Methods↗

Photon statistical limitations for daytime optical tracking

Tracking of interplanetary spacecraft equipped with optical communication systems by using astrometric instruments is being investigated by JPL. Existing instruments are designed to work at night and, for bright sources, are limited by tropospheric errors. To provide full coverage of the solar system, astrometric tracking instruments must either be capable of daytime operation or be space-based. The integration times necessary for the ground-based daytime photon statistical errors to reach a given accuracy level (5 to 50 nanoradians) were computed for an ideal astrometric instrument. The required photon statistical integration times are found to be shorter than the tropospheric integrations times for the ideal detector. Since the astrometric need not be limited by photon statistics even under daytime conditions, it may be fruitful to investigate instruments for daytime optical tracking.

Folkner, W. M.↗

Verification of the accuracy of GEM-L2 in response to criticism by Lambeck and Coleman

The objective was to evaluate the accuracy of the Goddard Earth Model (GEM)-L2 and its improvement in estimating Lageos orbits in order to provide better baselines for plate tectonics, improved polar motion and Earth rotation. Analyses and comparisons with other models are made to verify accuracy in contrast to the Lambeck and Coleman result which denied the authors' accuracy estimates. The analysis presented completely verifies the accuracy of the GEM-L2 model and disproves the statistical methods of Lambeck and Coleman rejecting the accuracy of GEM-L2 as published in their report. The baselines derived from Lageos with GEM-L2 were estimated to have a 2 cm uncertainty due to the errors in the GEM-L2 gravity model which is supported by the results given. The calibration tests indicate that the errors in GEM-L2 should be reduced by about 30 percent which is in the opposite direction to the result obtained by Lambeck and Coleman.

Lerch, F. J.↗

Continental land cover assessment using Landsat MSS data

A statistical procedure to assess level-II continental resources using Landsat MSS digital data is presented. The statistical procedure involves a two-stage cluster sample within a stratified random sample. The utility of this procedure is assessed by using it to estimate the areal extent of the conifer and hardwood resources of the continental U.S. National estimates of conifer and hardwood derived using this sampling procedure were within 3 percent of U.S. Forest Service (USFS) figures. According to the Landsat-based study, 11 percent of the country is conifer forest and 12 percent is hardwood. The corresponding USFS figures are 13 and 15 percent, respectively. Comparison of the MSS classification products and airphotos showed that the conifer cover class was correctly identified 74 percent of the time and hardwood 80 percent of the time. The average classification accuracy countrywide for the four cover types considered (conifer, hardwood, water, and 'other') is 74 percent, and the overall accuracy is 85 percent. The statistical procedure provides a method of incorporating Landsat MSS digital data as a second state for level-II continental resource assessment. Alternate data sources, e.g., satellite and aircraft photographic imagery, may also be used in conjunction with this statistical model.

Nelson, Ross↗