Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “testing statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Deep Convective Cloud Calibration Sensitivity Studies in Support of Radiometrically Scaling GEO Imagers With VIIRS

The NASA CERES SYN1deg product provides the scientific community regional hourly TOA and surface broadband fluxes and clouds. For consistent geostationary (GEO) derived fluxes and clouds the GEO imagers are radiometrically scaled to the Aqua-MODIS calibration reference. The CERES project utilizes GEO and MODIS or VIIRS analogous channel coincident, collocated, and co-angled radiance pairs as the primary method to inter-calibrate the GEO imagers. Tropical deep convective clouds (DCC) are bright, near Lambertian, top of atmosphere pseudo invariant Earth targets that do not rely on coincident ray-matched radiance pairs to radiometrically scale sensors to a common calibration reference. The DCC invariant target (DCC-IT) methodology collectively analyzes all tropical DCC identified pixel radiances by way of probability density function (PDF) distributions. Perfectly inter-calibrated sensor pairs should reveal nearly identical PDF distributions given the same DCC identification criterion. The PDF median, mean, mode, and inflection point statistics were tested as a function of DCC identification criterion using SNPP-VIIRS and Himawari-8 AHI 0.65μm channel radiances during January 2019. It was found that the PDF inflection point provided inter-calibration factors within 0.25% that were nearly independent of DCC identification criterion. The PDF median provided inter-calibration factors within 0.25% for the coldest BT and most stringent homogeneity factors. The PDF mean and mode statistics were inadequate under any DCC conditions. It is critical for the DCC pixel radiances to be anisotropically corrected. The DCC-IT methodology will also be tested for other visible and SWIR bands.

DCC↗
DOE OSTI2019

Percent-Level Test of Isotropic Expansion Using Type Ia Supernovae

We propose and implement a novel, robust, and nonparametric test of statistical isotropy of the expansion of the Universe and apply it to around 1000 type Ia supernovae from the Pantheon sample. We calculate the angular clustering of supernova magnitude residuals and compare it to the noise expected under the isotropic assumption. We also test for systematic effects and demonstrate that their effects are negligible or are already accounted for in our procedure. Here, we express our constraints as an upper limit on the rms spatial variation in the Hubble parameter at late times. For the sky smoothed with a Gaussian with FWHM = 60°, less than 1% rms spatial variation in the Hubble parameter is allowed at 99.7% confidence.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Bayesian optimized collection strategies for fatigue strength testing

Abstract A statistical framework is presented enabling optimal sampling and analysis of constant life fatigue data. Protocols using Bayesian maximum entropy sampling are built based on conventional staircase and stress step methods, reducing the requirement of prior knowledge for data collection. The Bayesian Staircase method shows improved parameter estimation efficiency, and the Bayesian Stress Step method shows equal accuracy to the standard method at larger step size allowing experimentalists to lessen concerns of loading history. Statistical methods for determining model suitability are shown, highlighting the influence of protocol. Experimental validation is performed, showing the applicability of the methods in laboratory testing.

36 MATERIALS SCIENCE↗
NASA NTRS2010

Development of an Uncertainty Model for the National Transonic Facility

This paper introduces an uncertainty model being developed for the National Transonic Facility (NTF). The model uses a Monte Carlo technique to propagate standard uncertainties of measured values through the NTF data reduction equations to calculate the combined uncertainties of the key aerodynamic force and moment coefficients and freestream properties. The uncertainty propagation approach to assessing data variability is compared with ongoing data quality assessment activities at the NTF, notably check standard testing using statistical process control (SPC) techniques. It is shown that the two approaches are complementary and both are necessary tools for data quality assessment and improvement activities. The SPC approach is the final arbiter of variability in a facility. Its result encompasses variation due to people, processes, test equipment, and test article. The uncertainty propagation approach is limited mainly to the data reduction process. However, it is useful because it helps to assess the causes of variability seen in the data and consequently provides a basis for improvement. For example, it is shown that Mach number random uncertainty is dominated by static pressure variation over most of the dynamic pressure range tested. However, the random uncertainty in the drag coefficient is generally dominated by axial and normal force uncertainty with much less contribution from freestream conditions.

Walter, Joel A.↗
NASA NTRS1996

BATSE Observations of the Large-Scale Isotropy of Gamma-Ray Bursts

We use dipole and quadrupole statistics to test the large-scale isotropy of the first 1005 gamma-ray bursts observed by the Burst and Transient Source Experiment (BATSE). In addition to the entire sample of 1005 gamma-ray bursts, many subsets are examined. We use a variety of dipole and quadrupole statistics to search for Galactic and other predicted anisotropies and for anisotropies in a coordinate-system independent manner. We find the gamma-ray burst locations to be consistent with isotropy, e.g., for the total sample the observed Galactic dipole moment (cos theta) differs from the value predicted for isotropy by 0.9 sigma and the observed Galactic quadrupole moment (sin(exp 2) b - 1/3) by 0.3 sigma. We estimate for various models the anisotropies that could have been detected. If one-half of the locations were within 86 deg of the Galactic center, or within 28 deg of the Galactic plane, the ensuing dipole or quadrupole moment would have typically been detected at the 99% confidence level. We compare the observations with the dipole and quadrupole moments of various Galactic models. Several Galactic gamma-ray bursts models have moments within 2 sigma of the observations; most of the Galactic models proposed to date are no longer in acceptable agreement with the data. Although a spherical dark matter halo distribution could be consistent with the data, the required core radius is larger than the core radius of the dark matter halo used to explain the Galaxy's rotation curve. Gamma-ray bursts are much more isotropic than any observed Galactic population, strongly favoring but not requiring an origin at cosmological distances.

Briggs, Michael S.↗
NASA NTRS2008

Simulation Evaluation of Synthetic Vision as an Enabling Technology for Equivalent Visual Operations

Enhanced Vision (EV) and synthetic vision (SV) systems may serve as enabling technologies to meet the challenges of the Next Generation Air Transportation System (NextGen) Equivalent Visual Operations (EVO) concept ? that is, the ability to achieve or even improve on the safety of Visual Flight Rules (VFR) operations, maintain the operational tempos of VFR, and even, perhaps, retain VFR procedures independent of actual weather and visibility conditions. One significant challenge lies in the definition of required equipage on the aircraft and on the airport to enable the EVO concept objective. A piloted simulation experiment was conducted to evaluate the effects of the presence or absence of Synthetic Vision, the location of this information during an instrument approach (i.e., on a Head-Up or Head-Down Primary Flight Display), and the type of airport lighting information on landing minima. The quantitative data from this experiment were analyzed to begin the definition of performance-based criteria for all-weather approach and landing operations. Objective results from the present study showed that better approach performance was attainable with the head-up display (HUD) compared to the head-down display (HDD). A slight performance improvement in HDD performance was shown when SV was added, as the pilots descended below 200 ft to a 100 ft decision altitude, but this performance was not tested for statistical significance (nor was it expected to be statistically significant). The touchdown data showed that regardless of the display concept flown (SV HUD, Baseline HUD, SV HDD, Baseline HDD) a majority of the runs were within the performance-based defined approach and landing criteria in all the visibility levels, approach lighting systems, and decision altitudes tested. For this visual flight maneuver, RVR appeared to be the most significant influence in touchdown performance. The approach lighting system clearly impacted the pilot's ability to descend to 100 ft height above touchdown based on existing Federal Aviation Regulation (FAR) 91.175 using a 200 ft decision height, but did not appear to influence touchdown performance or approach path maintenance

Kramer, Lynda J.↗
DOE OSTI2018

A kernel machine method for detecting higher order interactions in multimodal datasets: Application to schizophrenia

Technological advances are enabling us to collect multimodal datasets at an increasing depth and resolution while with decreasing labors. Understanding complex interactions among multimodal datasets, however, is challenging. Here in this study, we tested the interaction effect of multimodal datasets using a novel method called the kernel machine for detecting higher order interactions among biologically relevant multimodal data. Using a semiparametric method on a reproducing kernel Hilbert space, we formulated the proposed method as a standard mixed-effects linear model and derived a score-based variance component statistic to test higher order interactions between multimodal datasets. The method was evaluated using extensive numerical simulation and real data from the Mind Clinical Imaging Consortium with both schizophrenia patients and healthy controls. Our method identified 13-triplets that included 6 gene-derived SNPs, 10 ROIs, and 6 gene-specific DNA methylations that are correlated with the changes in hippocampal volume, suggesting that these triplets may be important for explaining schizophrenia-related neurodegeneration. The performance of the proposed method is compared with the following methods: test based on only first and first few principal components followed by multiple regression, and full principal component analysis regression, and the sequence kernel association test. With strong evidence (p-value ≤0.000001), the triplet (MAGI2, CRBLCrus1.L, FBXO28) is a significant biomarker for schizophrenia patients. This novel method can be applicable to the study of other disease processes, where multimodal data analysis is a common task.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

A review of imputation strategies for isobaric labeling-based shotgun proteomics

The throughput efficiency and increased depth of coverage provided by isobaric-labeled proteomics measurements have led to increased usage of these techniques. However, the structure of missing data is uniquely different than unlabeled studies. In this review, we compare the efficacy of nine imputation methods on a CPTAC proteomics iTRAQ dataset. Imputation methods were evaluated with regard to accuracy, variability, statistical hypothesis test inference and run time over datasets consisting of varying number of iTRAQ plexes and percentages of missing data. In general, expectation maximization and random forest imputation methods yielded the best performances, and constant-based methods performed poorly consistently across all dataset sizes and percentages of missing values. For datasets with small sample sizes and higher percentages of missing data, results indicate that statistical inference with no imputation may be preferable. Based on the findings in this review, there are core imputation methods that perform higher for isobaric-labeled proteomics data, but great care and consideration as to whether imputation should be used should be given for datasets comprised of a small number of samples, as well as to factors such as computational time and reproducibility of imputation values.

Bramer, Lisa M.↗
DOE OSTI2024

Estimating the CO 2 Fertilization Effect on Extratropical Forest Productivity From Flux‐Tower Observations

Abstract The land sink of anthropogenic carbon emissions, a crucial component of mitigating climate change, is primarily attributed to the CO 2 fertilization effect on global gross primary productivity (GPP). However, direct observational evidence of this effect remains scarce, hampered by challenges in disentangling the CO 2 fertilization effect from other long‐term confounding drivers, particularly climatic changes. Here, we introduce a novel statistical approach to separate the CO 2 fertilization effect on photosynthetic carbon uptake using eddy covariance (EC) records across 38 extratropical forest sites. We find the median stimulation rate of GPP to be 3.2 ± 0.9 gC m −2 yr −1 ppm −1 (or 16.4 ± 4.2% per 100 ppm) under increasing atmospheric CO 2 across these sites, respectively. To validate the robustness of our findings, we test our statistical method using factorial simulations of an ensemble of process‐based land surface models. We address additional factors, including nitrogen deposition and land management, that may impact plant productivity, potentially confounding the attribution to the CO 2 fertilization effect. Assuming these site‐specific effects offset to some extent across sites as random factors, the estimated median value still reflects the strength of the CO 2 fertilization effect. However, disentanglement of these long‐term effects, often inseparable by timescale, requires further causal research. Our study provides direct evidence that the photosynthetic stimulation is maintained under long‐term CO 2 fertilization across multiple EC sites. Such observation‐based quantification is key to constraining the long‐standing uncertainties in the land carbon cycle under rising CO 2 concentrations.

Environmental Sciences & Ecology↗
DOE OSTI2022

Angular systematics-free cosmological analysis of galaxy clustering in configuration space

ABSTRACT Galaxy redshift surveys are subject to incompleteness and inhomogeneous sampling due to the various constraints inherent to spectroscopic observations. This can introduce systematic errors on the summary statistics of interest, which need to be mitigated in cosmological analysis to achieve high accuracy. Standard practices involve applying weighting schemes based on completeness estimates across the survey footprint, possibly supplemented with additional weighting schemes accounting for density-dependent effects. In this work, we concentrate on pure angular systematics and describe an alternative approach consisting in analysing the galaxy two-point correlation function where angular modes are nulled. By construction, this procedure removes all possible known and unknown sources of angular observational systematics, but also part of the cosmological signal. We use a modified Landy–Szalay estimator for the two-point correlation function that relies on an additional random catalogue where angular positions are randomly drawn from the galaxy catalogue, and provide an analytical model to describe this modified statistic. We test the model by performing an analysis of the full anisotropic clustering in mock catalogues of luminous red and emission-line galaxies at 0.43 < z < 1.1. We find that the model fully accounts for the modified correlation function in redshift space, without introducing new nuisance parameters. The derived cosmological parameters from the analysis of baryon acoustic oscillations and redshift-space distortions display slightly larger statistical uncertainties, mostly for the growth rate of structure parameter fσ8 that exhibits a $50{{\ \rm per\ cent}}$ statistical error increase, but free from angular systematic error.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2018

Screening Fuels for Autoignition with Small-Volume Experiments and Gaussian Process Classification

Partially reacting candidate fuels under highly dilute conditions across a range of temperatures provides a means to classify the candidates based on traditional ignition characteristics using much lower quantities (sub-mL) than the full octane tests. Using a classifier based on a Gaussian Process model, synthetic species profiles obtained by plug flow reactor simulations at seven temperatures are used to demonstrate that the configuration can be used to classify 95% of the samples correctly for autoignition sensitivity exceeding a threshold (S = 8) and 100%of the samples correctly for research octane number exceeding a threshold (RON = 90). Molecular beam mass spectrometry (MBMS) experimental data at four temperatures is then used as the model input in a real-world test. Despite the nontrivial relationship between the MBMS measurements and speciation as well as experimental noise it is still possible to classify 95% of the samples correctly for RON and 85% of the samples correctly for S in a 'leave-one-out' cross validation exercise. The test data set consists of 45 fuels and includes a variety of primary reference fuels, ethanol blends and other oxygenates.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2021

Preventing Failures By Dataset Shift Detection in Safety-Critical Graph Applications

Dataset shift refers to the problem where the input data distribution may change over time (e.g., between training and test stages). Since this can be a critical bottleneck in several safety-critical applications such as healthcare, drug-discovery, etc., dataset shift detection has become an important research issue in machine learning. Though several existing efforts have focused on image/video data, applications with graph-structured data have not received sufficient attention. Therefore, in this paper, we investigate the problem of detecting shifts in graph structured data through the lens of statistical hypothesis testing. Specifically, we propose a practical two-sample test based approach for shift detection in large-scale graph structured data. Our approach is very flexible in that it is suitable for both undirected and directed graphs, and eliminates the need for equal sample sizes. Using empirical studies, we demonstrate the effectiveness of the proposed test in detecting dataset shifts. We also corroborate these findings using real-world datasets, characterized by directed graphs and a large number of nodes.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1976

Assessment of NDE Reliability Data

Twenty sets of relevant Nondestructive Evaluation (NDE) reliability data have been identified, collected, compiled, and categorized. A criterion for the selection of data for statistical analysis considerations has been formulated. A model to grade the quality and validity of the data sets has been developed. Data input formats, which record the pertinent parameters of the defect/specimen and inspection procedures, have been formulated for each NDE method. A comprehensive computer program has been written to calculate the probability of flaw detection at several confidence levels by the binomial distribution. This program also selects the desired data sets for pooling and tests the statistical pooling criteria before calculating the composite detection reliability. Probability of detection curves at 95 and 50 percent confidence levels have been plotted for individual sets of relevant data as well as for several sets of merged data with common sets of NDE parameters.

Yee, B. G. W.↗
NASA NTRS1974

A Statistical Approach to Establishing Subsystem Environmental Test Specifications

Results are presented of a research task to evaluate structural responses at various subsystem mounting locations during spacecraft level test exposures to the environments of mechanical shock, acoustic noise, and random vibration. This statistical evaluation is presented in the form of recommended subsystem test specifications for these three environments as normalized to a reference set of spacecraft test levels and are thus suitable for extrapolation to a set of different spacecraft test levels. The recommendations are dependent upon a subsystem's mounting location in a spacecraft, and information is presented on how to determine this mounting zone for a given subsystem.

Keegan, W. B.↗
NASA NTRS1994

Spherical disharmonics in the Earth sciences and the spatial solution: Ridges, hotspots, slabs, geochemistry and tomography correlations

There is increasing use of statistical correlations between geophysical fields and between geochemical and geophysical fields in attempts to understand how the Earth works. Typically, such correlations have been based on spherical harmonic expansions. The expression of functions on the sphere as spherical harmonic series has many pitfalls, especially if the data are nonuniformly and/or sparsely sampled. Many of the difficulties involved in the use of spherical harmonic expansion techniques can be avoided through the use of spatial domain correlations, but this introduces other complications, such as the choice of a sampling lattice. Additionally, many geophysical and geochemical fields fail to satisfy the assumptions of standard statistical significance tests. This is especially problematic when the data values to be correlated with a geophysical field were collected at sample locations which themselves correlate with that field. This paper examines many correlations which have been claimed in the past between geochemistry and mantle tomography and between hotspot, ridge, and slab locations and tomography using both spherical harmonic coefficient correlations and spatial domain correlations. No conclusively significant correlations are found between isotopic geochemistry and mantle tomography. The Crough and Jurdy (short) hotspot location list shows statistically significant correlation with lowermost mantle tomography for degree 2 of the spherical harmonic expansion, but there are no statistically significant correlations in the spatial case. The Vogt (long) hotspot location list does not correlate with tomography anywhere in the mantle using either technique. Both hotspot lists show a strong correlation between hotspot locations and geoid highs when spatially correlated, but no correlations are revealed by spherical harmonic techniques. Ridge locations do not show any statistically significant correlations with tomography, slab locations, or the geoid; the strongest correlation is with lowermost mantle tomography, which is probably spurious. The most striking correlations are between mantle tomography and post-Pangean subducted slabs. The integrated locations of slabs correlate strongly with fast areas near the transition zone and the core-mantle boundary and with slow regions from 1022-1248 km depth. This seems to be consistent with the 'avalanching' downwellings which have been indicated by models of the mantle which include an endothermic phase transition at the 670-km discontinuity, although this is not a unique interpretation. Taken as a whole, these results suggest that slabs and associated cold downwellings are the dominant feature of mantle convection. Hotspot locations are no better correlated with lower mantle tomography than are ridge locations.

Ray, Terrill W.↗
DOE OSTI2019

Quantified fracture (joint) clustering in Archean basement, Wyoming: application of the normalized correlation count method

We demonstrate statistically significant self-organized clustering over a length scale range from 10 -2 to 10 1 m for north-striking opening-mode fractures (joints) in Late Archean Mount Owen Quartz Monzonite. Spatial arrangement is a critical fracture network attribute that until recently has only been assessed qualitatively. We use normalized fracture intensity plots and the normalized correlation count (NCC) method of Marrett et al. to discriminate clustered from randomly placed or evenly spaced patterns quantitatively over a wide range of length scales and to test the statistical significance of the resulting patterns. We propose a procedure for interpreting cluster patterns on NCC diagrams generated by the freely available spatial analysis software CorrCount. Results illustrate the efficacy of NCC to measure fracture clustering patterns in texturally homogeneous Archean granitic rock in a setting distant (>2 km) from folds or faults. In their current geological setting, these regional fractures are conduits for water flow and their patterns – and the NCC approach to defining clusters – may be useful guides to the spatial arrangement style and clustering magnitude of conductive fractures in other, less accessible fractured basement rocks.

02 PETROLEUM↗