Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Atmosphere variability at Mars Reconnaissance Orbiter science orbit altitudes based on Mars Express Reconstructions

This paper describes the orbit reconstruction of Mars Express (MEX) with the specific goal of estimating the atmospheric density near periapsis and evaluating its variability and predictability. The desired outcome is to validate the covariance analysis assumption of atmospheric variability for the 2005 NASA Mars Reconnaissance Orbiter (MRO), as well as evaluate the accuracy of the density estimates output from the atmosphere model used by MRO. Topics covered include the MRO atmosphere model, MEX orbit determination and post-fit Doppler residuals, and atmosphere trending statistics gleaned from the orbit reconstructions.

Higas, Earl↗

Using Trajectory Smoothness Metrics to Identify Drones in Radar Track Data

The identification of unmanned aircraft systems (UAS) using trajectory data is considered. Specifically, a number of smoothness metrics are proposed, which can be used to distinguish UAS from other aerial objects even when they are engaged in accelerative maneuvers (non-constant-velocity flight). The metrics are evaluated on a data set from a UAS sense-and-avoid field test, which contains track data of aerial objects recorded by a vehicle-board radar system during a flight test. The metrics are found to effectively differentiate UAS from other objects such as birds for this data set. In addition, an initial statistical performance analysis of one of the smoothness metrics is undertaken, using 15 data sets deriving from multiple flight tests. The smoothness metric is shown to identify the target UAS with 95% accuracy (95% true positive rate), while achieving a false positive rate of less than 9%.

Sandip Roy↗

Proposed Analytical Methods for Determining Filter Media Properties

High Efficiency Particulate Air (HEPA) filters, commonly used in nuclear filtration applications, are an integral part of the waste management processes in nuclear plants. HEPA filters are 99.97% efficient filtration devices characterized by their high resistance to air flow, or pressure drop. From theoretical models, the initial pressure drop across a clean filter is proven to be a function of the filter media fiber diameters and porosity of the media. These filter properties are relatively difficult to obtain with traditional manual methods; therefore, there is a need to develop analytical methods to find the fiber diameter and porosity to determine the pressure drop. Typically, these values can be found by substituting a calculated representative value based upon measured values, such as equivalent fiber diameter based upon a clean pressure drop. However, these values may also be directly recorded and measured by incorporating Scanning Electron Microscope (SEM) image analysis and other measurement methods to analyze the filter media and determine its physical properties without the need for media testing. DiameterJ, an open source Java plug-in, used with ImageJ, can process images of filter media taken by an SEM to find statistical data such as mean fiber diameter and porosity. To produce the raw data, SEM images of two filter media type samples are taken and segmented in DiameterJ using the traditional and statistical region merging segmentation algorithms. Manual segmentation is necessary after the initial segmentation by the algorithms as the images tend to be too complex for the algorithms to output with the necessary accuracy. However, complications exist in the manual segmentation process as these methods can be time intensive and prone to the individual bias of the user. This in turn can skew the final mean fiber diameter result, and lead to either an over or under prediction of the pressure drop. It was also discovered that the porosity data produced by DiameterJ is inaccurate, as the SEM analyzes the three-dimensional filter media by projecting its geometry onto a plane and analyzing it as a two-dimensional binary image. Thus, the porosity is artificially inflated through the segmentation process, rendering this result incorrect. Alternatively, density determination, gravimetric analysis, and thickness testing of the filter media is collectively used to determine the filter fiber porosity. Together, the SEM image analysis and analytical lab methods produce results through direct measurements which allow for the prediction of the initial pressure drop from clean filter media without the need for prior media testing to collect pressure data. By improving upon this proposed analytical method in the future, there is potential to streamline the process of finding these filter properties into a more direct methodology for determining the pressure drop across HEPA filters.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Comparison of Iterative and Non-Iterative Strain-Gage Balance Load Calculation Methods

The accuracy of iterative and non-iterative strain-gage balance load calculation methods was compared using data from the calibration of a force balance. Two iterative and one non-iterative method were investigated. In addition, transformations were applied to balance loads in order to process the calibration data in both direct read and force balance format. NASA's regression model optimization tool BALFIT was used to generate optimized regression models of the calibration data for each of the three load calculation methods. This approach made sure that the selected regression models met strict statistical quality requirements. The comparison of the standard deviation of the load residuals showed that the first iterative method may be applied to data in both the direct read and force balance format. The second iterative method, on the other hand, implicitly assumes that the primary gage sensitivities of all balance gages exist. Therefore, the second iterative method only works if the given balance data is processed in force balance format. The calibration data set was also processed using the non-iterative method. Standard deviations of the load residuals for the three load calculation methods were compared. Overall, the standard deviations show very good agreement. The load prediction accuracies of the three methods appear to be compatible as long as regression models used to analyze the calibration data meet strict statistical quality requirements. Recent improvements of the regression model optimization tool BALFIT are also discussed in the paper.

Ulbrich, N.↗

Experimentally validated high-fidelity simulations of a liquid jet in supersonic crossflow

Here, utilizing recent advancements in computational schemes for compressible, multiphase flows, this work features a parametric study of a pure liquid jet in supersonic crossflow that involves simulating the atomization process for four values of momentum-flux ratio. These simulations are validated against experimental results measured with high-speed X-ray imaging, which confirm the accuracy of the numerical approach. Also, the effect of numerical resolution on some flow behavior is investigated, revealing convergence of the jet shape and surface instability wavelength. Analysis of the resulting sprays includes statistical descriptions of the liquid distribution, liquid structures created through breakup, interfacial instabilities, and dominant flow features. As the flowrate increases, the spray penetrates further, it becomes more disperse, and less liquid impacts the wall, but the droplet size distribution changes little. The wavelength of instabilities on the windward side of the jet diverges from measured trends in subsonic crossflows. In a visualization of the time-averaged flow, counter-rotating vortices are observed along the jet core and in the wake, affecting the process of primary atomization and early droplet trajectories.

42 ENGINEERING↗

Cluster-Graph Fingerprinting: A Framework for Quantitative Analysis of Machine-Learned Interatomic Model Training and Simulation Data

Machine-learned interatomic models represent a significant advancement in simulation methods, extending the predictive ability of first-principles methods to previously inaccessible length and time scales. However, the data-driven nature of these models can lead to difficult-to-detect errors that can compromise prediction accuracy. To address this challenge, we introduce a novel fingerprinting approach based on the Chebyshev Interaction Model for Efficient Simulation (ChIMES) ML-IAM graph-based descriptor. Our strategy enables efficient and statistically rigorous analysis of system configurations used in ML-IAM training and those generated by their application, e.g., in molecular dynamics simulations. We demonstrate that these fingerprints can effectively assess novelty of a configuration relative to an existing data set and determine dissimilarity among individual configurations, which are two key tasks in workflows for active learning-based ML-IAM training, data set curation, and on-the-fly uncertainty quantification.

36 MATERIALS SCIENCE↗

Validation and parameterization of a novel physics-constrained neural dynamics model applied to turbulent fluid flow

We report, in fluid physics, data-driven models to enhance or accelerate time to solution are becoming increasingly popular for many application domains, such as alternatives to turbulence closures, system surrogates, or for new physics discovery. In the context of reduced order models of high-dimensional time-dependent fluid systems, machine learning methods grant the benefit of automated learning from data, but the burden of a model lies on its reduced-order representation of both the fluid state and physical dynamics. In this work, we build a physics-constrained, data-driven reduced order model for Navier–Stokes equations to approximate spatiotemporal fluid dynamics in the canonical case of isotropic turbulence in a triply periodic box. The model design choices mimic numerical and physical constraints by, for example, implicitly enforcing the incompressibility constraint and utilizing continuous neural ordinary differential equations for tracking the evolution of the governing differential equation. We demonstrate this technique on a three-dimensional, moderate Reynolds number turbulent fluid flow. In assessing the statistical quality and characteristics of the machine-learned model through rigorous diagnostic tests, we find that our model is capable of reconstructing the dynamics of the flow over large integral timescales, favoring accuracy at the larger length scales. More significantly, comprehensive diagnostics suggest that physically interpretable model parameters, corresponding to the representations of the fluid state and dynamics, have attributable and quantifiable impact on the quality of the model predictions and computational complexity.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Validation of semi-analytical, semi-empirical covariance matrices for two-point correlation function for early DESI data

ABSTRACT We present an extended validation of semi-analytical, semi-empirical covariance matrices for the two-point correlation function (2PCF) on simulated catalogs representative of luminous red galaxies (LRGs) data collected during the initial 2 months of operations of the Stage-IV ground-based Dark Energy Spectroscopic Instrument (DESI). We run the pipeline on multiple effective Zel’dovich (EZ) mock galaxy catalogs with the corresponding cuts applied and compare the results with the mock sample covariance to assess the accuracy and its fluctuations. We propose an extension of the previously developed formalism for catalogs processed with standard reconstruction algorithms. We consider methods for comparing covariance matrices in detail, highlighting their interpretation and statistical properties caused by sample variance, in particular, non-trivial expectation values of certain metrics even when the external covariance estimate is perfect. With improved mocks and validation techniques, we confirm a good agreement between our predictions and sample covariance. This allows one to generate covariance matrices for comparable data sets without the need to create numerous mock galaxy catalogs with matching clustering, only requiring 2PCF measurements from the data itself. The code used in this paper is publicly available at https://github.com/oliverphilcox/RascalC.

79 ASTRONOMY AND ASTROPHYSICS↗

Online Detection of Inter-Turn Winding Faults in Single-Phase Distribution Transformers Using Smart Meter Data

Turn-to-turn faults between primary windings due to insulation degradation are a major cause of distribution transformer failure, and occur due to high levels of stress such as overloading and overheating. An additional consequence of these faults is an increased voltage on the transformer secondary due to effective change in turns ratio. This paper develops a novel method for early detection of insulation degradation and subsequent inter-turn winding failure by monitoring the transformer secondary voltage. The algorithm is based on a cumulative sum (CUSUM) statistic and compares voltages on neighbouring transformers to flag degrading assets. Results obtained from simulation as well as experimental data show that smart meter measurements can be utilized to achieve very high detection accuracy while keeping costs low. Here, the paper also demonstrates the validity of the algorithm in the presence of measurement noise, residential solar power injection etc.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Kansas environmental and resource study: A Great Plains model. Extraction of agricultural statistics from ERTS-1 data of Kansas

The author has identified the following significant results. Wheat area, yield, and production statistics as derived from satellite image analysis, combined with a weather model, are presented for a ten county area in southwest Kansas. The data (representing the 1972-73 crop year) are compared for accuracy against both the USDA August estimate and its final (official) tabulation. The area estimates from imagery for both dryland and irrigated winter wheat were within 5% of the official figures for the same area, and predated them by almost one year. Yield on dryland wheat was estimated by the Thompson weather model to within 0.1% of the observed yield. A combined irrigated and dryland wheat production estimate for the ten county area was completed in July, 1973 and was within 1% of the production reported by USDA in February, 1974.

Morain, S. A.↗

Computer-implemented land use classification with pattern recognition software and ERTS digital data

Significant progress has been made in the classification of surface conditions (land uses) with computer-implemented techniques based on the use of ERTS digital data and pattern recognition software. The supervised technique presently used at the NASA Earth Resources Laboratory is based on maximum likelihood ratioing with a digital table look-up approach to classification. After classification, colors are assigned to the various surface conditions (land uses) classified, and the color-coded classification is film recorded on either positive or negative 9 1/2 in. film at the scale desired. Prints of the film strips are then mosaicked and photographed to produce a land use map in the format desired. Computer extraction of statistical information is performed to show the extent of each surface condition (land use) within any given land unit that can be identified in the image. Evaluations of the product indicate that classification accuracy is well within the limits for use by land resource managers and administrators. Classifications performed with digital data acquired during different seasons indicate that the combination of two or more classifications offer even better accuracy.

Joyce, A. T.↗

Identification of USSR Indicator Regions

Potential indicator regions were determined by comparing the statistics for barley and wheat at the lowest administrative levels for which published statistics were available. Fourteen were selected for review based on their relative abundances of wheat and barely. These potential indicator regions were grouped according to three conditions that could affect labeling and classification accuracies: (1) high-barley content; (2) presence of barley and spring wheat; and (3) presence of barley and winter wheat. Each region was further evaluated based on the availability of crop calendars, LANDSAT acquisitions, and ancillary data. Based on the relative abundance of wheat and barley and the availability of data, three indicator regions were recommended. Within each region, individual oblasts and/or krays were selected according to segment availability and segment acquisition histories for potential barley separation.

Disler, J.↗

The construction of life prediction models for the design of Stirling engine heater components

The service life of Stirling-engine heater structures of Fe-based high-temperature alloys is predicted using a numerical model based on a linear-damage approach and published test data (engine test data for a Co-based alloy and tensile-test results for both the Co-based and the Fe-based alloys). The operating principle of the automotive Stirling engine is reviewed; the economic and technical factors affecting the choice of heater material are surveyed; the test results are summarized in tables and graphs; the engine environment and automotive duty cycle are characterized; and the modeling procedure is explained. It is found that the statistical scatter of the fatigue properties of the heater components needs to be reduced (by decreasing the porosity of the cast material or employing wrought material in fatigue-prone locations) before the accuracy of life predictions can be improved.

Petrovich, A.↗

Characterization of Global Near-Nadir Backscatter for Remote Sensing Radar Design

In order to evaluate side-lobe contamination from the near-nadir region for Ku-Band radars, a statistical characterization of global near-nadir backscatter is constructed. This characterization is performed for a variety of surface types using data from TRMM, Seasat, and Topex. An assessment of the relative calibration accuracy of these sensors is also presented.

Spencer, Michael W.↗

Characterization of Global Near-Nadir Backscatter for Remote Sensing Radar Design

In order to evaluate side-lobe contamination from the near-nadir region for Ku-Band radars, a statistical characterization of global near-nadir backscatter is constructed. This characterization is performed for a variety of surface types using data from TRMM, Seasat, and Topex. An assessment of the relative calibration accuracy of them sensors is also presented.

Spencer, Michael W.↗

Evaluation of the Regional Atmospheric Modeling System in the Eastern Range Dispersion Assessment System

The Applied Meteorology Unit is conducting an evaluation of the Regional Atmospheric Modeling System (RAMS) contained within the Eastern Range Dispersion Assessment System (ERDAS). ERDAS provides emergency response guidance for operations at the Cape Canaveral Air Force Station and the Kennedy Space Center in the event of an accidental hazardous material release or aborted vehicle launch. The prognostic data from RAMS is available to ERDAS for display and is used to initialize the 45th Range Safety (45 SW/SE) dispersion model. Thus, the accuracy of the 45 SW/SE dispersion model is dependent upon the accuracy of RAMS forecasts. The RAMS evaluation task consists of an objective and subjective component for the Florida warm and cool seasons of 1999-2000. The objective evaluation includes gridded and point error statistics at surface and upper-level observational sites, a comparison of the model errors to a coarser grid configuration of RAMS, and a benchmark of RAMS against the widely accepted Eta model. The warm-season subjective evaluation involves a verification of the onset and movement of the Florida east coast sea breeze and RAMS forecast precipitation. This interim report provides a summary of the RAMS objective and subjective evaluation for the 1999 Florida warm season only.

Case, Jonathan↗

Upper-Stratospheric Ozone Trends 1979-1998

Extensive analyses of ozone observations between 1978 and 1998 measured by Dobson Umkehr, Stratospheric Aerosol and Gas Experiment (SAGE) I and II, and Solar Backscattered Ultraviolet (SBUV) and (SBUV)/2 indicate continued significant ozone decline throughout the extratropical upper stratosphere from 30-45 km altitude. The maximum annual linear decline of -0.8 +/- 0.2 %/yr(2sigma) occurs at 40 km and is well described in terms of a linear decline modulated by the 11-year solar variation. The minimum decline of -0.110.1% yr-1(2o) occurs at 25 km in midlatitudes, with remarkable symmetry between the Northern and Southern Hemispheres at 40 km altitude. Midlatitude upper-stratospheric zonal trends exhibit significant seasonal variation (+/- 30% in the Northern Hemisphere, +/- 40% in the Southern Hemisphere) with the most negative trends of -1.2%/yr occurring in the winter. Significant seasonal trends of -0.7 to -0.9%/yr occur at 40 km in the tropics between April and September. Subjecting the statistical models used to calculate the ozone trends to intercomparison tests on a variety of common data sets yields results that indicate the standard deviation between trends estimated by 10 different statistical models is less than 0.1%/yr in the annual-mean trend for SAGE data and less than 0.2%/yr in the most demanding conditions (seasons with irregular, sparse data) [World Meteorological Organization (WMO), 1998]. These consistent trend results between statistical models together with extensive consistency between the independent measurement-system trend observations by Dobson Umkehr, SAGE I and II, and SBUV and SBUV/2 provide a high degree of confidence in the accuracy of the declining ozone amounts reported here. Additional details of ozone trend results from 1978 to 1996 (2 years shorter than reported here) along with lower-stratospheric and tropospheric ozone trends, extensive intercomparisons to assess relative instrument drifts, and retrieval algorithm details are given by WMO [1998].

Newchurch, M. J.↗

The (55)Fe X-ray Energy Response of Mercury Cadmium Telluride Near-Infrared Detector Arrays

The accurate determination of a detector's fundamental parameters, including read noise, dark current, and QE, relies on a proper measurement of a detector's conversion gain (e- ADU(exp -1)). Charge coupling effects, such as interpixel capacitance, attenuate photon shot noise and result in an overestimation of conversion gain when implementing the photon transfer technique. An approach involving (55)Fe X-rays provides a potentially straightforward measurement of conversion gain by comparing the observed instrumental counts (ADU) to the known charge (e-) liberated by the X-ray. This technique is already preferred within the CCD community, as the pair production energy for silicon is well established. In contrast, to date the pair production energy is unknown for HgCdTe, a material commonly used for near-infrared detectors. In this paper, we derive a preliminary calibration of the (55)Fe X-ray energy response of HgCdTe using 8 HST WFC3 1.7 micrometers flight grade detectors. Our conversion of the X-ray intensities from counts into electrons implements a technique that restores the 'true' gain via classical propagation of errors. For these detectors, our analysis yields preliminary results of good statistical precision: each Ka event generates 1849 +/- 46 electrons, which corresponds to a pair production energy of 3.21+/-f 0.08 eV. We are continuing to assess potential systematic effects to further refine the accuracy of this result.

Fox, Ori↗