Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49
All sourcesNASA NTRSDOE OSTI
NASA NTRS1985

The Use of AIS Data for Identifying and Mapping Calcareous Soils in Western Nebraska

The identification of calcareous soils, through unique spectral responses of the vegetation to the chemical nature of calcareous soils, can improve the accuracy of delineating the boundaries of soil mapping units over conventional field techniques. The objective of this experiment is to evaluate the use of the Airborne Imaging Spectrometer (AIS) in the identification and delineation of calcareous soils in the western Sandhills of Nebraska. Based upon statistical differences found in separating the spectral curves below 1.3 microns, calcareous and non-calcareous soils may be identified by differences in species of vegetation. Additional work is needed to identify biogeochemical differences between the two soils.

Samson, S. A.↗
NASA NTRS2007

Overview of Aircraft Noise Prediction Tools Assessment

The acoustic assessment task for both the Subsonic Fixed Wing and the Supersonic projects under NASA s Fundamental Aeronautics Program was designed to assess the current state-of-the-art in noise prediction capability and to establish baselines for gauging future progress. The documentation of our current capabilities included quantifying the differences between predictions of noise from computer codes and measurements of noise from experimental tests. Quantifying the accuracy of both the computed and experimental results further enhanced the credibility of the assessment. This presentation gives sample results from codes representative of NASA s capabilities in aircraft noise prediction at the system level and at the component level. These include semi-empirical, statistical, analytical, and numerical codes. An example of system level results is shown for an aircraft. Component level results are shown for airframe flaps and landing gear, for jet noise from a variety of nozzles, and for broadband fan noise. Additional results are shown for modeling of the acoustic behavior of duct acoustic lining and the attenuation of sound in lined ducts with flow.

Dahl, Milo D.↗
NASA NTRS2022

Solar Temperature Variations Computed from SORCE SIM Irradiances Observed During 2003-2020

NASA’s Solar Radiation and Climate Experiment (SORCE) Spectral Irradiance Monitor (SIM) instrument produced about 17 years of daily average Spectral Solar Irradiance ( SSI ) data for wavelengths 240 nm – 2416 nm. We choose a day of minimal solar activity, 2008-08-24, during the 2008 − 2009 minimum between cycles 23 and 24, and compute the brightness temperature (𝑇 o ) from that day’s solar spectral irradiance (𝑆𝑆𝐼 o ). We consider small variations of T and SSI about these reference values, and derive linear and quadratic analytic approximations by Taylor expansion about the reference day values. To determine approximation accuracy, we compare to exact brightness temperatures T computed from the Planck spectrum, by solving analytically for T , or equivalent root-finding in Wolfram Mathematica. We find that the linear analytic approximation overestimates, while the quadratic underestimates the exact result. This motivates search for statistical “fit” models “in between” the two analytic models, with minimum root-mean-square-error RMSE. We make this search using open-source statistical R software, determine coefficients for linear and quadratic fit models, and compare statistical with analytic RMSE’s. When only linear analytic and fit models are compared, the fit model is superior at ultraviolet, visible, and near infrared wavelengths. This again holds true when comparing only quadratic models. Quadratic is superior to linear for both analytic and statistical models, and statistical fits give smallest RMSE’s. Lastly, we use linear analytic and fit models to find an interpolating function in wavelength, useful in case the SIM results need adjustment to another choices of wavelengths, to compare or extend to any other instrument.

SORCE↗
DOE OSTI2021

FY21 Progress Report: SRNL Analysis of ICCWR LCM and WAMS data for Corrosion and Cracking

The development of algorithms for machine learning and data analysis for the 3013 Surveillance Program is a collaborative effort by the Savannah River National Laboratory (SRNL) and the University of South Carolina (USC). For corrosion detection, Laser Confocal Microscope (LCM) or Wide Area 3D Measurement System (WAMS) data is extracted from large binary files, with software written to convert the data to physical attributes (e.g., height, color and grayscale values; all as functions of a location in a plane projection). A user-friendly Matlab Graphical User Interface (GUI) that reads data from either LCM or WAMS files was developed to integrate input data with software developed for processing and evaluation. The GUI can selectively download binary data, interrogate data attributes, label data, flag significant features, execute Machine Learning (ML) algorithms, output parameters for trained ML algorithms, report ML model accuracy with respect to labeled data, and generate graphical representations for various analyses. Features can be called out by user-specified thresholds, manual labeling or machine learning algorithms when they have been completed. The ability to rapidly label data is important because of the volume of data required for training machine learning algorithms. The GUI has the flexibility to allow addition of improved ML algorithms, methods for data visualization, and statistical computations. Statistical analyses via the GUI include areas of pits within a defined range of pit depths, correlations between Red-Green-Blue (RGB) or grayscale intensity and relative surface height, covariances between values associated with features, and feature histograms. The development of supervised machine learning algorithms, however, has been hindered by a lack of training data. The machine learning algorithms for crack identification are being refined but require improvements to the true positive rate for crack detection. This shortcoming is an artifact of the limited training data currently available, perhaps more so than the structure of the neural networks. At present, the best results are had from a consensus over an ensemble of randomly generated Deep Neural Network (DNN) or Convolutional Neural Network (CNN) algorithms. Although the consensus accuracy method has yielded optimum true positive and true negative rates in excess of 80%, additional validation testing is necessary. In addition to the suite of LCM data that was initially used, and which represents the majority of the work presented in this report, WAMS image data was also reviewed at a preliminary level. The review included a comparison between image resolution and dynamic range for each method. WAMS (ZON file) image data was found to have a pixel pitch of 3.69μm compared to 1 μm for the LCM (vk4 file) data, which implies a lower resolution for the WAMS images. Conversely, the ratio of dynamic range of the WAMS data to the LCM data was approximately 41:20 for height data, suggesting that information from WAMS should more accurately determine the depth of pits. At present, the significance of the greater dynamic range of the WAMS data relative to the LCM data has not yet been evaluated.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

Evaluating the location capabilities of a regional infrasonic network in Utah, US, using both ray tracing-derived and empirical-derived celerity-range and backazimuth models

SUMMARY More realistic models for infrasound signal propagation across a region can be used to improve the precision and accuracy of spatial and temporal source localization estimates. Motivated by incomplete infrasound event bulletins in the Western US, the location capabilities of a regional infrasonic network of stations located between 84–458 km from the Utah Test and Training Range, Utah, USA, is assessed using a series of near-surface explosive events with complementary ground truth (GT) information. Signal arrival times and backazimuth estimates are determined with an automatic F-statistic based signal detector and manually refined by an analyst. This study represents the first application of three distinct celerity-range and backazimuth models to an extensive suite of realistic signal detections for event location purposes. A singular celerity and backazimuth deviation model was previously constructed using ray tracing analysis based on an extensive archive of historical atmospheric specifications and is applied within this study to test location capabilities. Similarly, a set of multivariate, season and location specific models for celerity and backazimuth are compared to an empirical model that depends on the observations across the infrasound network and the GT events, which accounts for atmospheric propagation variations from source to receiver. Discrepancies between observed and predicted signal celerities result in locations with poor accuracy. Application of the empirical model improves both spatial localization precision and accuracy; all but one location estimates retain the true GT location within the 90 per cent confidence bounds. Average mislocation of the events is 15.49 km and average 90 per cent error ellipse areas are 4141 km2. The empirical model additionally reduces origin time residuals; origin time residuals from the other location models are in excess of 160 s while residuals produced with the empirical model are within 30 s of the true origin time. We demonstrate that event location accuracy is driven by a combination of signal propagation model and the azimuthal gap of detecting stations. A direct relationship between mislocation, error ellipse area and increased station azimuthal gaps indicate that for sparse networks, detection backazimuths may drive location biases over traveltime estimates.

58 GEOSCIENCES↗
DOE OSTI2021

Polishing the Gold Standard: The Role of Orbital Choice in CCSD(T) Vibrational Frequency Prediction

While CCSD(T) with spin-restricted Hartree-Fock (RHF) orbitals has long been lauded for its ability to accurately describe closed-shell interactions, the performance of CCSD(T) on open-shell species is much more erratic, especially when using a spin-unrestricted HF (UHF) reference. Previous studies have shown improved treatment of open-shell systems when a non-HF set of molecular orbitals, like Brueckner or Kohn-Sham density functional theory (DFT) orbitals, is used as a reference. Inspired by the success of regularized orbital-optimized second-order Møller-Plesset perturbation theory (κ-OOMP2) orbitals as reference orbitals for MP3, we investigate the use of κ-OOMP2 orbitals and various DFT orbitals as reference orbitals for CCSD(T) calculations of the corrected ground-state harmonic vibrational frequencies of a set of 36 closed-shell (29 neutrals, 6 cations, 1 anion) and 59 open-shell diatomic species (38 neutrals, 15 cations, 6 anions). The aug-cc-pwCVTZ basis set is used for all calculations. The use of κ-OOMP2 orbitals in this context alleviates difficult cases observed for both UHF orbitals and OOMP2 orbitals. Removing two multireference systems and 12 systems with ambiguous experimental data leaves a pruned data set. Overall performance on the pruned data set highlights CCSD(T) with a B97 orbital reference (CCSD(T):B97), CCSD(T) with a κ-OOMP2 orbital reference (CCSD(T):κ-OOMP2), and CCSD(T) with a B97M-rV orbital reference (CCSD(T):B97M-rV) with RMSDs of 8.48 cm -1 , and 8.50 cm -1 , and 8.75 cm -1 respectively, outperforming CCSD(T):UHF by nearly a factor of 5. Moreover, the performance on the closed- and open-shell subsets shows these methods are able to treat open-shell and closed-shell systems with comparable accuracy and robustness. CCSD(T) with RHF orbitals is seen to improve upon UHF for the closed-shell species, while spatial symmetry breaking in a number of restricted open-shell HF (ROHF) references leads CCSD(T) with ROHF reference orbitals to exhibit the poorest statistical performance of all methods surveyed for open-shell species. The use of κ-OOMP2 orbitals has also proven useful in diagnosing multireference character that can hinder the reliability of CCSD(T).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Experimental and Computational Characterization of a Modified Sioutas Cascade Impactor for Respirable Radioactive Aerosols

Oak Ridge National Laboratory is collecting and characterizing aerosols released when spent nuclear fuel (SNF) rods are fractured in bending. An aerosol collection system was designed and tested to collect respirable sized (<10 μm aerodynamic diameter [AED]) particulates inside a hot cell facility. The setup is a modified version of the commercially available Sioutas cascade impactor, to which additional stages were added to expand the aerosol collection range from 2.5 to ~15 μm AED. To accommodate the additional stages and specific test conditions, the operating flow rate for aerosol collection was reduced, and testing was conducted by using pressure drop measurements, surrogate dust collection, and particle size characterization. The fluid flow distribution within the cascade and its stages was simulated in STAR-CCM+, and the stage-wise pressure drops obtained using the computational fluid dynamics model were then compared to experimental data. Lagrangian particle simulations were also performed, and stage-wise collection statistics were obtained from the simulation for comparison with the experimental data obtained using SNF-surrogate dust particles. The results provide valuable insights into the stage-wise particle collection characteristics of the modified cascade impactor and can also be used to improve the prediction accuracy of the manufacturer-determined analytical correlations.

aerosol modeling↗
NASA NTRS1972

Star scanner attitude determination for the OSO-7 spacecraft.

Calculation of the inertial orientation of the OSO-7 spacecraft from the times at which known stars or planets transit planes fixed in the spacecraft. Both the reference planes and the timing information are provided by the star scanner instrument aboard the spacecraft, while the star identification and the statistical estimation of a set of parameters describing the spacecraft attitude are accomplished in a ground station computer facility. A recursive least-squares determination is made of a vector of first-order differential corrections to the attitude state vector. Preliminary analysis indicates the system accuracy to be 3 arc min in each attitude Euler angle.

Mackison, D. L.↗
NASA NTRS1972

Estimating trajectory correction requirements for multiple outer planet missions.

General approach to the problem of estimating trajectory correction requirements for multiple outer planet flyby missions when the navigation system uses onboard optical measurements made during approach to each target planet to complement the ground-based radio measurements. The accuracy and reliability of the onboard measurement system plays a critical role in sizing the trajectory correction capability required. An illustration of the combined use of radio and optical measurements is provided for the particular case of a Jupiter-Uranus-Neptune mission. Use of the statistical technique developed for computing the trajectory correction margin required to account for uncertainties in subsystem performance, permits trajectory correction savings of 100 to 20 m/sec over 'worst case' designs. This represents weight savings of about 50% of the science payload. For the example case trajectory correction requirements are estimated for two candidate optical systems and the radio alone case. The use of onboard measurements allows a trajectory correction savings of approximately 140 m/sec.

Friedman, L. D.↗
NASA NTRS1977

Fundamental Analysis of the Linear Multiple Regression Technique for Quantification of Water Quality Parameters from Remote Sensing Data

Constituents with linear radiance gradients with concentration may be quantified from signals which contain nonlinear atmospheric and surface reflection effects for both homogeneous and non-homogeneous water bodies provided accurate data can be obtained and nonlinearities are constant with wavelength. Statistical parameters must be used which give an indication of bias as well as total squared error to insure that an equation with an optimum combination of bands is selected. It is concluded that the effect of error in upwelled radiance measurements is to reduce the accuracy of the least square fitting process and to increase the number of points required to obtain a satisfactory fit. The problem of obtaining a multiple regression equation that is extremely sensitive to error is discussed.

Whitlock, C. H., III↗
NASA NTRS1981

Analysis of soil moisture extraction algorithm using data from aircraft experiments

A soil moisture extraction algorithm is developed using a statistical parameter inversion method. Data sets from two aircraft experiments are utilized for the test. Multifrequency microwave radiometric data surface temperature, and soil moisture information are contained in the data sets. The surface and near surface ( or = 5 cm) soil moisture content can be extracted with accuracy of approximately 5% to 6% for bare fields and fields with grass cover by using L, C, and X band radiometer data. This technique is used for handling large amounts of remote sensing data from space.

Burke, H. H. K.↗
NASA NTRS1999

Cross-Sensor Validation of the Optical Transient Detector (OTD)

Lightning data from the U.S. National Lightning Detection Network (NLDN) is used to perform preliminary validation of the satellite-based Optical Transient Detector (OTD). Sensor precision, accuracy, detection efficiency and biases of the deployed instrument are considered. We estimate the sensor to have, on average, better than 30 km spatial and 100 ms temporal accuracy. The detection efficiency for cloud-to-ground lightning is about 45-70%, slightly higher for intracloud lightning. There are only marginal day/night biases in the dataset, although 55 day averaging is required to remove sampling-based diurnal lightning cycle biases. The sensor detects statistically significant differences in the optical characteristics of intracloud, negative cloud-to-ground and positive cloud-to-ground lightning, although it cannot a priori determine flash types.

Boccippio, D. J.↗
NASA NTRS2003

Estimation of Model Error Variances During Data Assimilation

Data assimilation is all about understanding the error characteristics of the data and models that are used in the assimilation process. Reliable error estimates are needed to implement observational quality control, bias correction of observations and model fields, and intelligent data selection. Meaningful covariance specifications are obviously required for the analysis as well, since the impact of any single observation strongly depends on the assumed structure of the background errors. Operational atmospheric data assimilation systems still rely primarily on climatological background error covariances. To obtain error estimates that reflect both the character of the flow and the current state of the observing system, it is necessary to solve three problems: (1) how to account for the short-term evolution of errors in the initial conditions; (2) how to estimate the additional component of error caused by model defects; and (3) how to compute the error reduction in the analysis due to observational information. Various approaches are now available that provide approximate solutions to the first and third of these problems. However, the useful accuracy of these solutions very much depends on the size and character of the model errors and the ability to account for them. Model errors represent the real-world forcing of the error evolution in a data assimilation system. Clearly, meaningful model error estimates and/or statistics must be based on information external to the model itself. The most obvious information source is observational, and since the volume of available geophysical data is growing rapidly, there is some hope that a purely statistical approach to model error estimation can be viable. This requires that the observation errors themselves are well understood and quantifiable. We will discuss some of these challenges and present a new sequential scheme for estimating model error variances from observations in the context of an atmospheric data assimilation system.

Dee, Dick↗
NASA NTRSDate not supplied

Analysis of Hypervelocity-Impacted Thin Films for Space Applications

Exposure to the harsh space environment and hypervelocity impacts from micrometeoroids and small orbital debris can affect space operations through long-term degradation of spacecraft materials, surfaces, or systems. Multi-layer insulation (MLI) and coated, polyimide films are spacecraft materials commonly found on the external surfaces of spacecraft for thermal control and protection. Characterizing the damage to these exposed materials with in situ and laboratory measurements can better inform spacecraft designers and operators in understanding and mitigating surface or system degradation. In this paper, we examine flown Hubble Space Telescope (HST) Equipment Bay 5 MLI and coated, polyimide ground test articles to characterize hypervelocity impact damage. Impact feature cavities are inspected to identify damage, which can validate long-term degradation models, improve thermal management systems, or improve accuracy of damage predictions. An overview of the impact characterization using optical microscopy, narrowband spectroscopy, and Scanning Election Microscopy/Energy Dispersive X- ray (SEM/EDX) of the two materials is presented. Observations of robustness in the space environment, as well as a detailed assessment of cratering and penetration statistics for the space-exposed sample, also are discussed.

Melissa A. Ward↗
DOE OSTI2022

Classification of Cloud Particle Imagery from Aircraft Platforms Using Convolutional Neural Networks

Abstract A vast amount of ice crystal imagery exists from a variety of field campaign initiatives that can be utilized for cloud microphysical research. Here, nine convolutional neural networks are used to classify particles into nine regimes on over 10 million images from the Cloud Particle Imager probe, including liquid and frozen states and particles with evidence of riming. A transfer learning approach proves that the Visual Geometry Group (VGG-16) network best classifies imagery with respect to multiple performance metrics. Classification accuracies on a validation dataset reach 97% and surpass traditional automated classification. Furthermore, after initial model training and preprocessing, 10 000 images can be classified in approximately 35 s using 20 central processing unit cores and two graphics processing units, which reaches real-time classification capabilities. Statistical analysis of the classified images indicates that a large portion (57%) of the dataset is unusable, meaning the images are too blurry or represent indistinguishable small fragments. In addition, 19% of the dataset is classified as liquid drops. After removal of fragments, blurry images, and cloud drops, 38% of the remaining ice particles are largely intersecting the image border (≥10% cutoff) and therefore are considered unusable because of the inability to properly classify and dimensionalize. After this filtering, an unprecedented database of 1 560 364 images across all campaigns is available for parameter extraction and bulk statistics on specific particle types in a wide variety of storm systems, which can act to improve the current state of microphysical parameterizations.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1972

Mars gravitational field estimation error

The error covariance matrices associated with a weighted least-squares differential correction process have been analyzed for accuracy in determining the gravitational coefficients through degree and order five in the Mars gravitational potential junction. The results are presented in terms of standard deviations for the assumed estimated parameters. The covariance matrices were calculated by assuming Doppler tracking data from a Mars orbiter, a priori statistics for the estimated parameters, and model error uncertainties for tracking-station locations, the Mars ephemeris, the astronomical unit, the Mars gravitational constant (G sub M), and the gravitational coefficients of degrees six and seven. Model errors were treated by using the concept of consider parameters.

Compton, H. R.↗
NASA NTRS1975

Study of on-board compression of earth resources data

The current literature on image bandwidth compression was surveyed and those methods relevant to compression of multispectral imagery were selected. Typical satellite multispectral data was then analyzed statistically and the results used to select a smaller set of candidate bandwidth compression techniques particularly relevant to earth resources data. These were compared using both theoretical analysis and simulation, under various criteria of optimality such as mean square error (MSE), signal-to-noise ratio, classification accuracy, and computational complexity. By concatenating some of the most promising techniques, three multispectral data compression systems were synthesized which appear well suited to current and future NASA earth resources applications. The performance of these three recommended systems was then examined in detail by all of the above criteria. Finally, merits and deficiencies were summarized and a number of recommendations for future NASA activities in data compression proposed.

Habibi, A.↗
NASA NTRS1982

Crop classification using airborne radar and Landsat data

NASA 13.3 GHz airborne radar data from a soil moisture measurement analysis is used to investigate the statistical nature of the radar backscattering coefficient for bare ground and three different crop types, and to evaluate the crop classification rates using Landsat data alone or combined with the airborne survey. The scatterometer was a fan-beam Doppler system, VV polarized, and is considered only for 50 deg angles of incidence. A total of 36 fields were covered a week apart by the aircraft and Landsat, and Rayleigh statistics were used in the frequency averaging to eliminate fluctuations due to random fluctuations. Within-field variances were calculated for the Landsat and the radar data and used to design optimum crop classification procedures. The Landsat Band 4 readings were 67% accurate, and an increase in accuracy of 10% was achieved by the addition of the radar data.

Ulaby, F. T.↗