Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Accuracy assessment: The statistical approach to performance evaluation in LACIE

A statistical methodology was developed to check the accuracy of the products of the experimental operations throughout crop growth and to determine whether the procedures are adequate to accomplish the desired accuracy and reliability goals. It has allowed the identification and isolation of key problems in wheat area yield estimation, some of which have been corrected and some of which remain to be resolved. The major unresolved problem in accuracy assessment is that of precisely estimating the bias of the LACIE production estimator. Topics covered include: (1) evaluation techniques; (2) variance and bias estimation for the wheat production estimate; (3) the 90/90 evaluation; (4) comparison of the LACIE estimate with reference standards; and (5) first and second order error source investigations.

Houston, A. G.↗

Estimated Accuracy of Three Common Trajectory Statistical Methods

Three well-known trajectory statistical methods (TSMs), namely concentration field (CF), concentration weighted trajectory (CWT), and potential source contribution function (PSCF) methods were tested using known sources and artificially generated data sets to determine the ability of TSMs to reproduce spatial distribution of the sources. In the works by other authors, the accuracy of the trajectory statistical methods was estimated for particular species and at specified receptor locations. We have obtained a more general statistical estimation of the accuracy of source reconstruction and have found optimum conditions to reconstruct source distributions of atmospheric trace substances. Only virtual pollutants of the primary type were considered. In real world experiments, TSMs are intended for application to a priori unknown sources. Therefore, the accuracy of TSMs has to be tested with all possible spatial distributions of sources. An ensemble of geographical distributions of virtual sources was generated. Spearman s rank order correlation coefficient between spatial distributions of the known virtual and the reconstructed sources was taken to be a quantitative measure of the accuracy. Statistical estimates of the mean correlation coefficient and a range of the most probable values of correlation coefficients were obtained. All the TSMs that were considered here showed similar close results. The maximum of the ratio of the mean correlation to the width of the correlation interval containing the most probable correlation values determines the optimum conditions for reconstruction. An optimal geographical domain roughly coincides with the area supplying most of the substance to the receptor. The optimal domain s size is dependent on the substance decay time. Under optimum reconstruction conditions, the mean correlation coefficients can reach 0.70 0.75. The boundaries of the interval with the most probable correlation values are 0.6 0.9 for the decay time of 240 h and 0.5 0.95 for the decay time of 12 h. The best results of source reconstruction can be expected for the trace substances with a decay time on the order of several days. Although the methods considered in this paper do not guarantee high accuracy they are computationally simple and fast. Using the TSMs in optimum conditions and taking into account the range of uncertainties, one can obtain a first hint on potential source areas.

Kabashnikov, Vitaliy P.↗

A Statistical Analysis of the Accuracy of the Digitized Magnitudes of Photometric Plates on the Timescale of Decades with an Application to the Century-Long Light Curve of KIC 8462852

We present a statistical analysis of the accuracy of the digitized magnitudes of photometric plates on the timescale of decades. In our examination of archival Johnson B photometry from the Harvard DASCH archive, we find a median rt mean square scatter of light curves of the order of 0.15 magnitude over the range B approximately equal to 9-17 for all calibrations. Slight underlying systematics (trends or flux discontinuities) are on a level of less than or equal to 0.2 magnitudes per century (1889–1990) for the majority of constant stars. These historic data can be unambiguously used for processes that happen on scales of magnitudes, and need to be carefully examined in cases approaching the noise floor. The characterization of these limits in photometric stability may guide future studies in their use of plate archives. We explain these limitations for the example case of KIC 8462852, which has been claimed to dim by 0.16 magnitudes per century, and show that this trend cannot be considered as significant.

digitized magnitudes of photometric plates↗

A statistical study of the surface accuracy of a planar truss beam

Surface error statistics for single-layer and double-layer planar truss beams with random member-length errors were calculated using a Monte-Carlo technique in conjunction with finite-element analysis. Surface error was calculated in terms of the normal distance from a regression line to the surface nodes of the distorted beam. Results for both single-layer and double-layer beams indicate that a minimum root-mean-square surface error can be achieved by optimizing the depth-to-length ratio of a truss beam. The statically indeterminate double-layer beams can provide greater surface accuracy, though at the expense of significantly greater complexity.

Kenner, W. Scott↗

Proceedings of the 2004 High Spatial Resolution Commercial Imagery Workshop

Topics covered include: NASA Applied Sciences Program; USGS Land Remote Sensing: Overview; QuickBird System Status and Product Overview; ORBIMAGE Overview; IKONOS 2004 Calibration and Validation Status; OrbView-3 Spatial Characterization; On-Orbit Modulation Transfer Function (MTF) Measurement of QuickBird; Spatial Resolution Characterization for QuickBird Image Products 2003-2004 Season; Image Quality Evaluation of QuickBird Super Resolution and Revisit of IKONOS: Civil and Commercial Application Project (CCAP); On-Orbit System MTF Measurement; QuickBird Post Launch Geopositional Characterization Update; OrbView-3 Geometric Calibration and Geopositional Accuracy; Geopositional Statistical Methods; QuickBird and OrbView-3 Geopositional Accuracy Assessment; Initial On-Orbit Spatial Resolution Characterization of OrbView-3 Panchromatic Images; Laboratory Measurement of Bidirectional Reflectance of Radiometric Tarps; Stennis Space Center Verification and Validation Capabilities; Joint Agency Commercial Imagery Evaluation (JACIE) Team; Adjacency Effects in High Resolution Imagery; Effect of Pulse Width vs. GSD on MTF Estimation; Camera and Sensor Calibration at the USGS; QuickBird Geometric Verification; Comparison of MODTRAN to Heritage-based Results in Vicarious Calibration at University of Arizona; Using Remotely Sensed Imagery to Determine Impervious Surface in Sioux Falls, South Dakota; Estimating Sub-Pixel Proportions of Sagebrush with a Regression Tree; How Do YOU Use the National Land Cover Dataset?; The National Map Hazards Data Distribution System; Recording a Troubled World; What Does This-Have to Do with This?; When Can a Picture Save a Thousand Homes?; InSAR Studies of Alaska Volcanoes; Earth Observing-1 (EO-1) Data Products; Improving Access to the USGS Aerial Film Collections: High Resolution Scanners; Improving Access to the USGS Aerial Film Collections: Phoenix Digitizing System Product Distribution; System and Product Characterization: Issues Approach; Innovative Approaches to Analysis of Lidar Data for the National Map; Changes in Imperviousness near Military Installations; Geopositional Accuracy Evaluations of QuickBird and OrbView-3: Civil and Commercial Applications Project (CCAP); Geometric Accuracy Assessment: OrbView ORTHO Products; QuickBird Radiometric Calibration Update; OrbView-3 Radiometric Calibration; QuickBird Radiometric Characterization; NASA Radiometric Characterization; Establishing and Verifying the Traceability of Remote-Sensing Measurements to International Standards; QuickBird Applications; Airport Mapping and Perpetual Monitoring Using IKONOS; OrbView-3 Relative Accuracy Results and Impacts on Exploitation and Accuracy Improvement; Using Remotely Sensed Imagery to Determine Impervious Surface in Sioux Falls, South Dakota; Applying High-Resolution Satellite Imagery and Remotely Sensed Data to Local Government Applications: Sioux Falls, South Dakota; Automatic Co-Registration of QuickBird Data for Change Detection Applications; Developing Coastal Surface Roughness Maps Using ASTER and QuickBird Data Sources; Automated, Near-Real Time Cloud and Cloud Shadow Detection in High Resolution VNIR Imagery; Science Applications of High Resolution Imagery at the USGS EROS Data Center; Draft Plan for Characterizing Commercial Data Products in Support of Earth Science Research; Atmospheric Correction Prototype Algorithm for High Spatial Resolution Multispectral Earth Observing Imaging Systems; Determining Regional Arctic Tundra Carbon Exchange: A Bottom-Up Approach; Using IKONOS Imagery to Assess Impervious Surface Area, Riparian Buffers and Stream Health in the Mid-Atlantic Region; Commercial Remote Sensing Space Policy Civil Implementation Update; USGS Commercial Remote Sensing Data Contracts (CRSDC); and Commercial Remote Sensing Space Policy (CRSSP): Civil Near-Term Requirements Collection Update.

Source record↗

Coherent Uncertainty Analysis of Aerosol Measurements from Multiple Satellite Sensors

Aerosol retrievals from multiple spaceborne sensors, including MODIS (on Terra and Aqua), MISR, OMI, POLDER, CALIOP, and SeaWiFS altogether, a total of 11 different aerosol products were comparatively analyzed using data collocated with ground-based aerosol observations from the Aerosol Robotic Network (AERONET) stations within the Multi-sensor Aerosol Products Sampling System (MAPSS, http://giovanni.gsfc.nasa.gov/mapss/ and http://giovanni.gsfc.nasa.gov/aerostat/). The analysis was performed by comparing quality-screened satellite aerosol optical depth or thickness (AOD or AOT) retrievals during 2006-2010 to available collocated AERONET measurements globally, regionally, and seasonally, and deriving a number of statistical measures of accuracy. We used a robust statistical approach to detect and remove possible outliers in the collocated data that can bias the results of the analysis. Overall, the proportion of outliers in each of the quality-screened AOD products was within 12%. Squared correlation coefficient (R2) values of the satellite AOD retrievals relative to AERONET exceeded 0.6, with R2 for most of the products exceeding 0.7 over land and 0.8 over ocean. Root mean square error (RMSE) values for most of the AOD products were within 0.15 over land and 0.09 over ocean. We have been able to generate global maps showing regions where the different products present advantages over the others, as well as the relative performance of each product over different landcover types. It was observed that while MODIS, MISR, and SeaWiFS provide accurate retrievals over most of the landcover types, multi-angle capabilities make MISR the only sensor to retrieve reliable AOD over barren and snow / ice surfaces. Likewise, active sensing enables CALIOP to retrieve aerosol properties over bright-surface shrublands more accurately than the other sensors, while POLDER, which is the only one of the sensors capable of measuring polarized aerosols, outperforms other sensors in certain smoke-dominated regions, including broadleaf evergreens in Brazil and South-East Asia.

remote sensing↗

Evaluation of two statistical models using the shock structure problem.

The accuracy of two statistical models for the collision integral of the Boltzmann equation has been evaluated by applying the models to the solution of the problem of shock structure in a monatomic gas and then comparing the theoretical results with available ex perimental data. The two models considered here are the Bhatnagar-Gross-Krook and ellipsoidal statistical models. The Mach number range covered is 1.59-10.7 and profiles for density and, where available, temperature are compared. The method of numerical solution is the discrete ordinate technique which looks quite promising for application to more complicated models. The results indicate that the ellipsoidal statistical model, which gives a correct value for the Prandtl number, gives accurate results for a low Mach number shock. However, the accuracy degenerates as the Mach number increases. The Bhatnagar-Gross-Krook model gives poorer agreement with experimental data in all cases examined.

Giddens, D. P.↗

The Radio/Gamma-Ray Connection in Active Galactic Nuclei in the Era of the Fermi Large Area Telescope

We present a detailed statistical analysis of the correlation between radio and gamma-ray emission of the active galactic nuclei (AGNs) detected by Fermi during its first year of operation, with the largest data sets ever used for this purpose.We use both archival interferometric 8.4 GHz data (from the Very Large Array and ATCA, for the full sample of 599 sources) and concurrent single-dish 15 GHz measurements from the OwensValley RadioObservatory (OVRO, for a sub sample of 199 objects). Our unprecedentedly large sample permits us to assess with high accuracy the statistical significance of the correlation, using a surrogate data method designed to simultaneously account for common-distance bias and the effect of a limited dynamical range in the observed quantities. We find that the statistical significance of a positive correlation between the centimeter radio and the broadband (E > 100 MeV) gamma-ray energy flux is very high for the whole AGN sample, with a probability of <10(exp -7) for the correlation appearing by chance. Using the OVRO data, we find that concurrent data improve the significance of the correlation from 1.6 10(exp -6) to 9.0 10(exp -8). Our large sample size allows us to study the dependence of correlation strength and significance on specific source types and gamma-ray energy band. We find that the correlation is very significant (chance probability < 10(exp -7)) for both flat spectrum radio quasars and BL Lac objects separately; a dependence of the correlation strength on the considered gamma-ray energy band is also present, but additional data will be necessary to constrain its significance.

Ackermann, M.↗

Linear and nonlinear analysis of orbital telescope/space shuttle dynamics and control

Work completed on the design and study of an annular suspension and pointing (ASP) system for the space shuttle was presented. This system makes use of a magnetically suspended vernier pointing assembly. The following objectives were pursued in this study: (1) development of a detailed mathematical model of the Space Shuttle/ASP system, (2) design of control laws in order to obtain the desired pointing performance, and (3) prediction of the statistical pointing accuracies in the presence of stochastic disturbances such as crew-motion, and sensor and actuator noise. The first two of these objectives are documented in this report.

Roberts, A. S., Jr.↗

Apperception of Clouds in AIRS Data

Our capacity to simulate the radiative characteristics of the Earth system has advanced greatly over the past decade. However, new space based measurements show that idealized simulations might not adequately represent the complexity of nature. For example, AIRS simulated multi-layer cloud clearing research provides an excellent groundwork for early Atmospheric Infra-Red Sounder (AIRS) operational cloud clearing and atmospheric profile retrieval. However, it doesn't reflect the complicated reality of clouds over land and coastal areas. Thus far, operational AIRS/AMSU (Advanced Microwave Sounding Unit) cloud clearing is not only of low yield but also of unsatisfying quality. This is not an argument for avoiding this challenging task, rather a powerful argument for exploring other synergistic approaches, and for adapting these strategies toward improving both indirect and direct use of cloudy infrared sounding data. Ample evidence is shown in this paper that the indirect use of cloudy sounding data by way of cloud clearing is sub-optimal for data assimilation. Improvements are needed in quality control, retrieval yield, and overall cloud clearing retrieval performance. For example, cloud clearing over land, especially over the desert surface, has led to much degraded retrieval quality and often a very low yield of quality controlled cloud cleared radiances. If these indirect cloud cleared radiances are instead to be directly assimilated into NWP models, great caution must be used. Our limited and preliminary cloud clearing results from AIRS/AMSU (with the use of MODIS data) and an AIRS/MODIS synergistic approach have, however, shown that higher spatial resolution multispectral imagery data can provide much needed quality control of the AIRS/AMSU cloud clearing retrieval. When AIRS and Moderate Resolution Imaging Spectroradiometer (MODIS) are used synergistically, a higher spatial resolution over difficult terrain (especially desert areas) can be achieved and with a much improved accuracy. Preliminary statistical analyses of cloud cleared radiances derived from (1) operational AIRS/AMSU, (2) operational AIRS/AMSU plus the use of MODIS data as quality control, and (3) AIRS/MODIS synergistic single channel and two field of views cloud clearing are Our capacity to simulate the radiative characteristics of the Earth system has

Huang, Hung-Lung↗

Multi-Axis Identifiability Using Single-Surface Parameter Estimation Maneuvers on the X-48B Blended Wing Body

The problem of parameter estimation on hybrid-wing-body type aircraft is complicated by the fact that many design candidates for such aircraft involve a large number of aero- dynamic control effectors that act in coplanar motion. This fact adds to the complexity already present in the parameter estimation problem for any aircraft with a closed-loop control system. Decorrelation of system inputs must be performed in order to ascertain individual surface derivatives with any sort of mathematical confidence. Non-standard control surface configurations, such as clamshell surfaces and drag-rudder modes, further complicate the modeling task. In this paper, asymmetric, single-surface maneuvers are used to excite multiple axes of aircraft motion simultaneously. Time history reconstructions of the moment coefficients computed by the solved regression models are then compared to each other in order to assess relative model accuracy. The reduced flight-test time required for inner surface parameter estimation using multi-axis methods was found to come at the cost of slightly reduced accuracy and statistical confidence for linear regression methods. Since the multi-axis maneuvers captured parameter estimates similar to both longitudinal and lateral-directional maneuvers combined, the number of test points required for the inner, aileron-like surfaces could in theory have been reduced by 50%. While trends were similar, however, individual parameters as estimated by a multi-axis model were typically different by an average absolute difference of roughly 15-20%, with decreased statistical significance, than those estimated by a single-axis model. The multi-axis model exhibited an increase in overall fit error of roughly 1-5% for the linear regression estimates with respect to the single-axis model, when applied to flight data designed for each, respectively.

Ratnayake, Nalin A.↗

Hawai'i Water Resources: Utilizing NASA Earth Observations to Assess Ocean Conditions Leading to the Spread of the Nuisance Red Algae (Chondria tumulosa) in Papahānaumokuākea Marine National Monument, Hawai’i

Chondria tumulosa, a newly discovered red alga, was observed in low abundance in 2016 but has since proliferated and is now smothering and decimating vast expanse of coral reefs in Manawai, located in Papahānaumokuākea Marine National Monument (PMNM). If the spread persists, the outbreak of this cryptogenic species could potentially cause region-wide ecosystem degradation. In coordination with the U.S. Fish and Wildlife Service, Marine National Monuments of the Pacific and the National Oceanographic and Atmospheric Administration (NOAA) Office of National Marine Sanctuaries’ Papahānaumokuākea Marine National Monument, this project created a tool to analyze oceanographic conditions (sea surface temperature (SST), chlorophyll-a, water velocity, salinity, turbidity) across the Monument that could potentially be driving the algal spread. The Google Earth Engine tool enabled the partners to visualize oceanographic conditions and gather time-series graphs utilizing Aqua and Terra Moderate Resolution Imaging Spectroradiometer (MODIS), Suomi National Polar-orbiting Partnership (NPP) Visible Infrared Imaging Radiometer Suite (VIIRS), Sentinel-3 Ocean and Land Colour Instrument (OLCI), Hybrid Coordinate Ocean Model (HYCOM) and NOAA's Climate Data Record in a user-friendly interface. The team used in situ SST data from subsurface temperature recorders provided by the partners to validate the tool's accuracy. Preliminary statistical analysis of MODIS data found warming trends in SST in Manawai as well as increased chlorophyll-a levels during the summer months in contrast to the control (non-infected) Lalo atoll. The tool did not aim to classify algal presence due to limited availability of higher resolution satellite imagery but instead enabled PMNM managers to monitor conditions that may be conducive to algal growth around the monument to make informed decisions and mitigation practices.

DEVELOP Project Summary↗

Evaluation criteria for software classification inventories, accuracies, and maps

Statistical criteria are presented for modifying the contingency table used to evaluate tabular classification results obtained from remote sensing and ground truth maps. This classification technique contains information on the spatial complexity of the test site, on the relative location of classification errors, on agreement of the classification maps with ground truth maps, and reduces back to the original information normally found in a contingency table.

Jayroe, R. R., Jr.↗

Determining the accuracy of maximum likelihood parameter estimates with colored residuals

An important part of building high fidelity mathematical models based on measured data is calculating the accuracy associated with statistical estimates of the model parameters. Indeed, without some idea of the accuracy of parameter estimates, the estimates themselves have limited value. In this work, an expression based on theoretical analysis was developed to properly compute parameter accuracy measures for maximum likelihood estimates with colored residuals. This result is important because experience from the analysis of measured data reveals that the residuals from maximum likelihood estimation are almost always colored. The calculations involved can be appended to conventional maximum likelihood estimation algorithms. Simulated data runs were used to show that the parameter accuracy measures computed with this technique accurately reflect the quality of the parameter estimates from maximum likelihood estimation without the need for analysis of the output residuals in the frequency domain or heuristically determined multiplication factors. The result is general, although the application studied here is maximum likelihood estimation of aerodynamic model parameters from flight test data.

Morelli, Eugene A.↗

Determining the Accuracy of Aerodynamic Model Parameters Estimated from Flight Test Data

An important part of building mathematical models based on measured data is calculating the accuracy associated with statistical estimates of the model parameters. Indeed, without some idea of this accuracy, the parameter estimates themselves have limited value. In this work, an expression for computing quantitatively correct parameter accuracy measures for maximum likelihood parameter estimates with colored residuals is developed and validated. This result is important because experience in analyzing flight test data reveals that the output residuals from maximum likelihood estimation are almost always colored. The calculations involved can be appended to conventional maximum likelihood estimation algorithms. Monte Carlo simulation runs were used to show that parameter accuracy measures from the new technique accurately reflect the quality of the parameter estimates from maximum likelihood estimation without the need for correction factors or frequency domain analysis of the output residuals. The technique was applied to flight test data from repeated maneuvers flown on the F-18 High Alpha Research Vehicle (HARV). As in the simulated cases, parameter accuracy measures from the new technique were in agreement with the scatter in the parameter estimates from repeated maneuvers, while conventional parameter accuracy measures were optimistic.

Morelli, Eugene A.↗

Accuracy of Aerodynamic Model Parameters Estimated from Flight Test Data

An important put of building mathematical models based on measured date is calculating the accuracy associated with statistical estimates of the model parameters. Indeed, without some idea of this accuracy, the parameter estimates themselves have limited value. An expression is developed for computing quantitatively correct parameter accuracy measures for maximum likelihood parameter estimates when the output residuals are colored. This result is important because experience in analyzing flight test data reveals that the output residuals from maximum likelihood estimation are almost always colored. The calculations involved can be appended to conventional maximum likelihood estimation algorithms. Monte Carlo simulation runs were used to show that parameter accuracy measures from the new technique accurately reflect the quality of the parameter estimates from maximum likelihood estimation without the need for correction factors or frequency domain analysis of the output residuals. The technique was applied to flight test data from repeated maneuvers flown on the F-18 High Alpha Research Vehicle. As in the simulated cases, parameter accuracy measures from the new technique were in agreement with the scatter in the parameter estimates from repeated maneuvers, whereas conventional parameter accuracy measures were optimistic.

Morelli, Eugene A.↗