Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

Autonomous Navigation Performance During The Hartley 2 Comet Flyby

On November 4, 2010, the EPOXI spacecraft performed a 700-km flyby of the comet Hartley 2 as follow-on to the successful 2005 Deep Impact prime mission. EPOXI, an extended mission for the Deep Impact Flyby spacecraft, returned a wealth of visual and infrared data from Hartley 2, marking the fifth time that high-resolution images of a cometary nucleus have been captured by a spacecraft. The highest resolution science return, captured at closest approach to the comet nucleus, was enabled by use of an onboard autonomous navigation system called AutoNav. AutoNav estimates the comet-relative spacecraft trajectory using optical measurements from the Medium Resolution Imager (MRI) and provides this relative position information to the Attitude Determination and Control System (ADCS) for maintaining instrument pointing on the comet. For the EPOXI mission, AutoNav was tasked to enable continuous tracking of a smaller, more active Hartley 2, as compared to Tempel 1, through the full encounter while traveling at a higher velocity. To meet the mission goal of capturing the comet in all MRI science images, position knowledge accuracies of +/- 3.5 km (3-?) cross track and +/- 0.3 seconds (3-?) time of flight were required. A flight-code-in-the-loop Monte Carlo simulation assessed AutoNav's statistical performance under the Hartley 2 flyby dynamics and determined optimal configuration. The AutoNav performance at Hartley 2 was successful, capturing the comet in all of the MRI images. The maximum residual between observed and predicted comet locations was 20 MRI pixels, primarily influenced by the center of brightness offset from the center of mass in the observations and attitude knowledge errors. This paper discusses the Monte Carlo-based analysis that led to the final AutoNav configuration and a comparison of the predicted performance with the flyby performance.

flyby↗
NASA NTRS2015

Navigation and Dispersion Analysis of the First Orion Exploration Mission

This paper seeks to present the Orion EM-1 Linear Covariance Analysis for the DRO mission. The delta V statistics for each maneuver are presented. Included in the memo are several sensitivity analyses: variation in the time of OTC-1 (the first outbound correction maneuver), variation in the accuracy of the trans-Lunar injection, and variation in the length of the optical navigation passes.

Zanetti, Renato↗
NASA NTRS2007

Efficient Implementation of an Optimal Interpolator for Large Spatial Data Sets

Interpolating scattered data points is a problem of wide ranging interest. A number of approaches for interpolation have been proposed both from theoretical domains such as computational geometry and in applications' fields such as geostatistics. Our motivation arises from geological and mining applications. In many instances data can be costly to compute and are available only at nonuniformly scattered positions. Because of the high cost of collecting measurements, high accuracy is required in the interpolants. One of the most popular interpolation methods in this field is called ordinary kriging. It is popular because it is a best linear unbiased estimator. The price for its statistical optimality is that the estimator is computationally very expensive. This is because the value of each interpolant is given by the solution of a large dense linear system. In practice, kriging problems have been solved approximately by restricting the domain to a small local neighborhood of points that lie near the query point. Determining the proper size for this neighborhood is a solved by ad hoc methods, and it has been shown that this approach leads to undesirable discontinuities in the interpolant. Recently a more principled approach to approximating kriging has been proposed based on a technique called covariance tapering. This process achieves its efficiency by replacing the large dense kriging system with a much sparser linear system. This technique has been applied to a restriction of our problem, called simple kriging, which is not unbiased for general data sets. In this paper we generalize these results by showing how to apply covariance tapering to the more general problem of ordinary kriging. Through experimentation we demonstrate the space and time efficiency and accuracy of approximating ordinary kriging through the use of covariance tapering combined with iterative methods for solving large sparse systems. We demonstrate our approach on large data sizes arising both from synthetic sources and from real applications.

Memarsadeghi, Nargess↗
NASA NTRS1992

Energetic and magnetosheath energy particle signatures of the low-latitude boundary layer at low altitudes near noon

The low-latitude boundary layer (LBL) and its separation from the cusp have previously been identified using observations of particle precipitation at magnetosheath energies. Using S3-3 satellite observations, we have determined that these identifications can also be made from energetic particle observations on polar-orbiting satellites. It is found that the equatorward boundary of the LBL is identifiable as an approximately discontinuous decrease in 33-keV electron fluxes from low to high latitudes. Both the energetic ion and electron fluxes decrease discontinuously at the boundary between the LBL and the cusp or polar cap. A distinct LBL is nearly always identifiable in energetic particle measurements in the 10-14 MLT region when counting rates are statistically significant. The identifications obtained using the energetic particle measurements have been compared to those obtained using criteria developed by Newell and Meng (1988, 1989) for magnetosheath energy particle precipitation. In this way, we have evaluated the accuracy of both techniques and used the energetic particle measurements to supplement the identifications obtained using the Newell and Meng criteria. We propose that the Newell and Meng threshold on ion energy flux can be reduced by a factor of 6. This modification provides identification of the LBL for lower ion intensity levels than has previously been thought possible. Source, acceleration, and scattering processes have also been studied within and in the vicinity of the LBL. Observed trapped pitch angle distributions of energetic electrons imply that the LBL is at least partially on closed field lines. Strong scattering of energetic protons is found within and equatorward of the LBL and thus must occur at least partially along closed field lines. Field-aligned electron acceleration by parallel electric fields can be discerned within and poleward of the LBL, but a more detailed analysis is necessary for a statistical study. Conical ion acceleration was seen relatively frequently within the LBL and about half as often poleward of the LBL. Neither acceleration process could be identified anywhere equatorward of the LBL.

Roeder, J. L.↗
DOE OSTI2026

Selecting Critical Scenarios of DER Adoption in Distribution Grids Using Bayesian Optimization

We develop a new methodology to select scenarios of DER adoption most critical for distribution grids. Anticipating risks of future voltage and line flow violations due to additional PV adopters is central for utility investment planning but continues to rely on deterministic or ad hoc scenario selection. We propose a highly efficient search framework based on multi-objective Bayesian Optimization. We treat underlying grid stress metrics as computationally expensive black-box functions, approximated via Gaussian Process surrogates and design an acquisition function based on probability of scenarios being Pareto-critical across a collection of line- and bus-based violation objectives. Our approach provides a statistical guarantee and offers an order of magnitude speed-up relative to a conservative exhaustive search. Case studies on realistic feeders with 200-400 buses demonstrate the effectiveness and accuracy of our approach.

Mulkin, Olivier↗
NASA NTRS1973

Preliminary assessment of the microwave landing system requirements for STOL operations

The results of an investigation made to assess the Microwave Landing System (MLS) Requirements for use by civil STOL aircraft are described. The principal MLS characteristics investigated in the report were signal accuracy and volume of coverage. The study utilized a nonlinear six-degree-of-freedom digital simulation of a De Havilland Buffalo C-8A aircraft. Fully automatic control of timed curve flight down to touchdown was simulated. Selected MLS accuracy and coverage parameters for the azimuth, primary elevation, flare evelation and DME signals were varied. The resulting STOL aircraft system performance in following a representative curved flight path was statistically determined. Coverage requirements for STOL aircraft operating in the terminal area environment were also investigated.

Burrous, C. N.↗
NASA NTRS1976

Soil, water, and vegetation conditions in south Texas

The author has identified the following significant results. Software development for a computer-aided crop and soil survey system is nearing completion. Computer-aided variety classification accuracies using LANDSAT-1 MSS data for a 600 hectare citrus farm were 83% for Redblush grapefruit and 91% for oranges. These accuracies indicate that there is good potential for computer-aided inventories of grapefruit and orange citrus orchards with LANDSAT-type MSS data. Mean digital values of clouds differed statistically from those for crop, soil, and water entities, and those for cloud shadows were enough lower than sunlit crop and soil to be distinguishable. The standard errors of estimate for the calibration of computer compatible tape coordinate system (pixel and record) to earth coordinate system (longitude and latitude) for 6 LANDSAT scenes ranged from 0.72 to 1.50 pixels and from 0.58 to 1.75 records.

Wiegand, C. L.↗
NASA NTRS1978

An evaluation of electrochemical concentration Cell (ECC) sonde measurements of atmospheric ozone

Using Dobson spectrophotometer measurements of total ozone as a comparison, an analysis of the electrochemical concentration cell (ECC) ozonesonde's measurement accuracy is presented. Days of conjunctive ECC-Dobson observations (from 1970 to 1976 at Wallops Flight Center) provide a set of 123 pairs of total ozone values. Sample set statistics are generated with means and standard deviations of total ozone values and differences being noted. An in-depth study of factors such as time assumptions used in calculating residual ozone, and other possible sources of errors are examined. A study of ECC ozone profiles is also presented with an evaluation of sonde measurement of seasonal trends, altitude or peak ozone concentration, and other important ozone parameters. Short-period changes in total ozone using Dobson data during the observational period are also described.

Geraci, M. J.↗
NASA NTRS1978

An evaluation of electrochemical concentration cell sonde measurements of atmospheric ozone

Using Dobson spectrophotometer measurements of total ozone as a comparison, an analysis of the Electrochemical Concentration Cell (ECC) ozonesonde's measurement accuracy is presented. Days of conjunctive ECC-Dobson observations (from 1970 to 1976 at Wallops Flight Center) provide a set of 123 pairs of total ozone values. Sample set statistics are generated with means and standard deviations of total ozone values and differences being noted. An in-depth study of factors such as time differences between associated observations, integration techniques used, assumptions used in calculating residual ozone and other possible sources of errors are examined. Short-period changes in total ozone using Dobson data during the observational period are also described.

Geraci, M. J.↗
NASA NTRS2004

Variability in Tropical Tropospheric Ozone as Observed by SHADOZ

The SHADOZ (Southern Hemisphere Additional Ozonesondes) ozone sounding network was initiated in 1998 to improve the coverage of tropical in-situ ozone measurements for satellite validation, algorithm development and related process studies. Over 2000 soundings have been archived at the central website, , for 12 stations: Ascension Island; Nairobi and Malindi, Kenya; Irene, South Africa; Reunion Island; Watukosek, Java; Fiji; Tahiti; American Samoa; San Cristobal, Galapagos; Natal, Brazil; Paramaribo, Surinam. Some results to date indicate reliability of the measurement and highly variable interactions between ozone and tropical meteorology. For example: 1. By using ECC sondes with similar procedures, 5-10% accuracy and precision (1-sigma) of the sonde total ozone measurement was achieved [Thompson et al., 2003al; 2. Week-to-week variability in tropospheric ozone is so great that statistics are frequently not Gaussian and most stations vary up to a factor of 3 in column amount over the course of a year [Thompson et al., 2002b]. 3. Longitudinal variability in tropospheric ozone profiles is a consistent feature, with a 10- 15 DU column-integrated difference between Atlantic and Pacific sites; this is the cause of the zonal wave-one feature in total ozone [Shiotani, 1992]. The ozone record from Paramaribo, Surinam (6N, 55W) is a marked contrast to southern tropical ozone because Surinam is often north of the Intertropical Convergence Zone. Interpretations of SHADOZ time-series and approaches to classification suggested by SHADOZ data over Africa and the Indian Ocean will be described.

Thompson, Anne M.↗
NASA NTRS2003

Analysis of ETMS Data Quality for Traffic Flow Management Decisions

The data needed for air traffic flow management decision support tools is provided by the Enhanced Traffic Management System (ETMS). This includes both the tools that are in current use and the ones being developed for future deployment. Since the quality of decision support provided by all these tools will be influenced by the quality of the input ETMS data, an assessment of ETMS data quality is needed. Motivated by this desire, ETMS data quality is examined in this paper in terms of the unavailability of flight plans, deviation from the filed flight plans, departure delays, altitude errors and track data drops. Although many of these data quality issues are not new, little is known about their extent. A goal of this paper is to document the magnitude of data quality issues supported by numerical analysis of ETMS data. Guided by this goal, ETMS data for a 24-hour period were processed to determine the number of aircraft with missing flight plan messages at any given instant of time. Results are presented for aircraft above 18,000 feet altitude and also at all altitudes. Since deviation from filed flight plan is also a major cause of trajectory-modeling errors, statistics of deviations are presented. Errors in proposed departure times and ETMS-generated vertical profiles are also shown. A method for conditioning the vertical profiles for improving demand prediction accuracy is described. Graphs of actual sector counts obtained using these vertical profiles are compared with those obtained using the Host data for sectors in the Fort Worth Center to demonstrate the benefit of preprocessing. Finally, results are presented to quantify the extent of data drops. A method for propagating track positions during ETMS data drops is also described.

Chatterji, Gano B.↗
NASA NTRS2011

MesoNAM Verification Phase II

The 45th Weather Squadron Launch Weather Officers use the 12-km resolution North American Mesoscale model (MesoNAM) forecasts to support launch weather operations. In Phase I, the performance of the model at KSC/CCAFS was measured objectively by conducting a detailed statistical analysis of model output compared to observed values. The objective analysis compared the MesoNAM forecast winds, temperature, and dew point to the observed values from the sensors in the KSC/CCAFS wind tower network. In Phase II, the AMU modified the current tool by adding an additional 15 months of model output to the database and recalculating the verification statistics. The bias, standard deviation of bias, Root Mean Square Error, and Hypothesis test for bias were calculated to verify the performance of the model. The results indicated that the accuracy decreased as the forecast progressed, there was a diurnal signal in temperature with a cool bias during the late night and a warm bias during the afternoon, and there was a diurnal signal in dewpoint temperature with a low bias during the afternoon and a high bias during the late night.

Watson, Leela R.↗
DOE OSTI2024

Testing biasedness of self-reported microbusiness innovation in the annual business survey

This study tests for potential bias in self-reported innovation due to the inclusion of a research and development (R&D) module that only microbusinesses (less than 10 employees) receive in the Annual Business Survey (ABS). Previous research found that respondents to combined innovation/R&D surveys reported innovation at lower rates than respondents to innovation-only surveys. A regression discontinuity design is used to test whether microbusinesses, which constitute a significant portion of U.S. firms with employees, are less likely to report innovation compared to other small businesses. In the vicinity of the 10-employee threshold, the study does not detect statistically significant biases for new-to-market and new-to-business product innovation. Statistical power analysis confirms the nonexistence of biases with a high power. Comparing the survey design of ABS to earlier combined innovation/R&D surveys provides valuable insights for the proposed integration of multiple Federal surveys into a single enterprise platform survey. The findings also have important implications for the accuracy and reliability of innovation data used as an input to policymaking and business development strategies in the United States.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

A Statistical Evaluation of WRF-LES Trace Gas Dispersion Using Project Prairie Grass Measurements

In recent years, new measurement systems have been deployed to monitor and quantify methane emissions from the natural gas sector. Large-eddy simulation (LES) has complemented measurement campaigns by serving as a controlled environment in which to study plume dynamics and sampling strategies. However, with few comparisons with controlled-release experiments, the accuracy of LES for modeling natural gas emissions is poorly characterized. In this paper, we evaluate LES from the Weather Research and Forecasting (WRF) Model against Project Prairie Grass campaign measurements and surface layer similarity theory. Using WRF-LES, we simulate continuous emissions from 30 near-surface trace gas sources in two stability regimes: strong convection and weak convection. We examine the impact of grid resolutions ranging from 6.25 to 52 m in the horizontal dimension on model results. We evaluate performance in a statistical framework, calculating fractional bias and conducting Welch’s t tests. WRF-LES accurately simulates observed surface concentrations at 100 m and beyond under strong convection; simulated concentrations pass t tests in this region irrespective of grid resolution. However, in weakly convective conditions with strong winds, WRF-LES substantially overpredicts concentrations—the magnitude of fractional bias often exceeds 30%, and all but one t test fails. The good performance of WRF-LES under strong convection correlates with agreement with local free convection theory and a minimal amount of parameterized turbulent kinetic energy. The poor performance under weak convection corresponds to misalignment with Monin–Obukhov similarity theory and a significant amount of parameterized turbulent kinetic energy.

17 WIND ENERGY↗
NASA NTRS2010

Lunar Pole Illumination and Communications Statistics Computed from GSSR Elevation Data

The Goldstone Solar System RADAR (GSSR) group at JPL produced a Digital Elevation Model (DEM) of the lunar south pole using data obtained in 2006. This model has 40-meter horizontal resolution and about 5-meter relative vertical accuracy. This paper uses that Digital Elevation Model to compute average solar illumination and Earth visibility near the lunar south pole. This data quantifies solar power and Earth communications resources at proposed lunar base locations. The elevation data were converted into local terrain horizon masks, then converted into selenographic latitude and longitude coordinates. The horizon masks were compared to latitude, longitude regions bounding the maximum Sun and Earth motions relative to the moon. Proposed lunar south pole base sites were examined in detail, with the best site showing multi-year averages of solar power availability of 92% and Direct-To-Earth (DTE) communication availability of about 50%. Results are compared with a theoretical model, and with actual sun and Earth visibility averaged over the years 2009 to 2028. Results for the lunar North pole were computed using the GSSR DEM of the lunar North pole produced in 1997. The paper also explores using a heliostat to reduce the photovoltaic power system mass and complexity.

Lunar base↗
DOE OSTI2025

Leveraging interpolation models and error bounds for verifiable scientific machine learning

Effective verification and validation techniques for modern scientific machine learning workflows are challenging to devise. Statistical methods are abundant and easily deployed, but often rely on speculative assumptions about the data and methods involved. Error bounds for classical interpolation techniques can provide mathematically rigorous estimates of accuracy, but often are difficult or impractical to determine computationally. Here, in this work, we present a best-of-both-worlds approach to verifiable scientific machine learning by demonstrating that (1) multiple standard interpolation techniques have informative error bounds that can be computed or estimated efficiently; (2) comparative performance among distinct interpolants can aid in validation goals; (3) deploying interpolation methods on latent spaces generated by deep learning techniques enables some interpretability for black-box models. We present a detailed case study of our approach for predicting lift-drag ratios from airfoil images. Code developed for this work is available in a public Github repository.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Generating high-resolution total canopy SIF emission from TROPOMI data: Algorithm and application

Solar-induced chlorophyll fluorescence (SIF) is a rapidly advancing front in modeling global terrestrial gross primary production (GPP). Canopy total SIF emissions (SIF total ) are mechanistically linked to the plant photosynthesis, and can be estimated from satellite observed SIF (SIF obs ) through radiative transfer modeling. However, the current satellite SIF obs and thus SIF total are available only at coarse spatial resolutions from several kilometers to tens of kilometers, inhibiting the application at fine spatial scales. Here, in this work, we proposed an algorithm to generate both global high-resolution SIF total (HSIF total ) and high-resolution SIF obs (HSIF obs ) at 1 km from low-resolution SIF obs (LSIF obs ) from the TROPOspheric Monitoring Instrument (TROPOMI), which has a spatial resolution at nadir of 3.5 km by 5.6–7 km. Our statistical method is based on the law of energy conservation and uses satellite derived fraction of absorbed photosynthetically active radiation, fluorescence efficiency, and the escape probability of fluorescence. We evaluated the accuracy of our HSIF total using the Orbiting Carbon Observatory-2 SIF (R 2 = 0.78). We found that the spatial resolution had clear effects on the relationship between HSIF total and GPP. We also compared HSIF total to 8-day averaged tower GPP from 135 flux sites and found that they were better correlated when HSIF total was averaged over a 1-km radius around the tower than when averaged over a larger radius. Our study provided a unique high-resolution HSIF total product, which will advance the estimation of GPP by extrapolating site-level relationships to the global scale.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Tula: Optimizing Time, Cost, and Generalization in Distributed Large-Batch Training

Distributed training increases the number of batches processed per iteration either by scaling-out (adding more nodes) or scaling-up (increasing the batch-size). However, the largest configuration does not necessarily yield the best performance. Horizontal scaling introduces additional communication overhead, while vertical scaling is constrained by computation cost and device memory limits. Thus, simply increasing the batch-size leads to diminishing returns: training time and cost decrease initially but eventually plateaus, creating a knee-point in the time/cost vs. batch-size pareto curve. The optimal batch-size therefore depends on the underlying model, data and available compute resources. Large batches also suffer from worse model quality due to the well-known “generalization gap”. In this paper, we present Tula, an online service that automatically optimizes time, cost, and convergence quality for large-batch training of convolutional models. It combines parallel-systems modeling with statistical performance prediction to identify the optimal batchsize. Tula predicts training time and cost within 7.5−14% error across multiple models, and achieves up to 20× overall speedup and improves test accuracy by ≈9% on average over standard large-batch training on various vision tasks, thus successfully mitigating the generalization gap and accelerating training at the same time.

Tyagi, Sahil [ORNL] (ORCID:0009000783144745)↗