Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “testing statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Hanford Double Shell Waste Tank Corrosion Studies - Final Report FY2017

Corrosion studies of Hanford Double-Shell Tanks (DSTs) at Savannah River National Laboratory (SRNL) were focused on New Limits testing using statistically design matrices for a high concentration of hydroxide (1.2 M) and testing at various interior points to establish corrosion control guidelines towards pitting corrosion. Ammonia was also added into the statistical design to determine inhibition effects. Additional electrochemical studies of individual organic species and nitrous oxide were tested in a AN-102 based simulant with no organics to compare inhibiting properties of a specific specie and measure any electrochemical improvement towards pitting corrosion.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A neural network for the identification of measured helicopter noise

The results of a preliminary study of the components of a novel acoustic helicopter identification system are described. The identification system uses the relationship between the amplitudes of the first eight harmonics in the main rotor noise spectrum to distinguish between helicopter types. Two classification algorithms are tested; a statistically optimal Bayes classifier, and a neural network adaptive classifier. The performance of these classifiers is tested using measured noise of three helicopters. The statistical classifier can correctly identify the helicopter an average of 67 percent of the time, while the neural network is correct an average of 65 percent of the time. These results indicate the need for additional study of the envelope of harmonic amplitudes as a component of a helicopter identification system. Issues concerning the implementation of the neural network classifier, such as training time and structure of the network, are discussed.

Cabell, R. H.↗

Peak-acceleration limiter

Statistical limiter, which protects test specimens during random vibration testing, differentiates between peak acceleration levels that are normal components of vibration signal and those that exhibit damaging characteristics. Device aborts test only when statistical properties of vibration signal change significantly or when catastrophic transient occurs.

Woodbury, R. C.↗

ExMASS: A viable model for authentic student-scientist research partnerships

The Exploration of the Moon and Asteroids by Secondary Students (ExMASS) program provides students the opportunity to conduct authentic, student-led, open-inquiry research with assistance from their teacher and a scientist. One goal of the program is to enhance participants’ attitudes toward science. Most students enter the ExMASS program with positive attitudes toward science. However, the attitude survey developed for ExMASS measured small but statistically significant increases in attitudes. This paper discusses the ExMASS program, an attitude towards science survey designed for the program’s specific audience, and the results of statistical analyses of the survey. The validity of the attitudes survey was tested with an exploratory factor analysis (EFA). The results of the EFA revealed two salient factors measured by the survey: 1) Personal Importance of Science and 2) Importance of Science to Society. A reliability analysis revealed a Cronbach alpha value of 0.89. Paired t-tests revealed statistically significant differences in students’ attitudes before and after the program. For Factor 1, participants’ before scores were statistically significantly lower than their post scores, t(88) = 3.16, p<0.05. For Factor 2, participants’ before scores were statistically significantly lower than their post scores, t(88) = 4.47, p<0.05. ExMASS has been shown to be a practical model for programs designed to increase high school student attitudes toward science. More information on the ExMASS program is available at https://www.lpi.usra.edu/exploration/education/hsResearch/.

science↗

Probing the consistency of cosmological contours for supernova cosmology

As the scale of cosmological surveys increases, so does the complexity in the analyses. This complexity can often make it difficult to derive the underlying principles, necessitating statistically rigorous testing to ensure the results of an analysis are consistent and reasonable. This is particularly important in multi-probe cosmological analyses like those used in the Dark Energy Survey (DES) and the upcoming Legacy Survey of Space and Time, where accurate uncertainties are vital. In this paper, we present a statistically rigorous method to test the consistency of contours produced in these analyses and apply this method to the Pippin cosmological pipeline used for type Ia supernova cosmology with the DES. We make use of the Neyman construction, a frequentist methodology that leverages extensive simulations to calculate confidence intervals, to perform this consistency check. A true Neyman construction is too computationally expensive for supernova cosmology, so we develop a method for approximating a Neyman construction with far fewer simulations. We find that for a simulated dataset, the 68% contour reported by the Pippin pipeline and the 68% confidence region produced by our approximate Neyman construction differ by less than a percent near the input cosmology; however, they show more significant differences far from the input cosmology, with a maximal difference of 0.05 in $Ω$ M and 0.07 in w. In conclusion, this divergence is most impactful for analyses of cosmological tensions, but its impact is mitigated when combining supernovae with other cross-cutting cosmological probes, such as the cosmic microwave background.

79 ASTRONOMY AND ASTROPHYSICS↗

Statistical corrections to numerical predictions. IV

The National Meteorological Center Barotropic-Mesh Model has been used to test a statistical correction procedure, designated as M-II, that was developed in Schemm et al. (1981). In the present application, statistical corrections at 12 h resulted in significant reductions of the mean-square errors of both vorticity and the Laplacian of thickness. Predictions to 48 h demonstrated the feasibility of applying corrections at every 12 h in extended forecasts. In addition to these improvements, however, the statistical corrections resulted in a shift of error from smaller to larger-scale motions, improving the smallest scales dramatically but deteriorating the largest scales. This effect is shown to be a consequence of randomization of the residual errors by the regression equations and can be corrected by spatially high-pass filtering the field of corrections before they are applied.

Schemm, Jae-Kyung↗

Fault detection using a two-model test for changes in the parameters of an autoregressive time series

This article describes an investigation of a statistical hypothesis testing method for detecting changes in the characteristics of an observed time series. The work is motivated by the need for practical automated methods for on-line monitoring of Deep Space Network (DSN) equipment to detect failures and changes in behavior. In particular, on-line monitoring of the motor current in a DSN 34-m beam waveguide (BWG) antenna is used as an example. The algorithm is based on a measure of the information theoretic distance between two autoregressive models: one estimated with data from a dynamic reference window and one estimated with data from a sliding reference window. The Hinkley cumulative sum stopping rule is utilized to detect a change in the mean of this distance measure, corresponding to the detection of a change in the underlying process. The basic theory behind this two-model test is presented, and the problem of practical implementation is addressed, examining windowing methods, model estimation, and detection parameter assignment. Results from the five fault-transition simulations are presented to show the possible limitations of the detection method, and suggestions for future implementation are given.

Scholtz, P.↗

Linear Mixed-Effects Models for Human-in-the-Loop Tracking Experiment Data

Linear mixed-effects models provide several benefits over more traditional statistical inference tests that are particularly useful for most human-in-the-loop tracking experiment data. However, surprisingly, mixed models are virtually not used for the analysis of tracking experiment data. This paper uses of linear mixed-effects models to analyze combined tracking data from two previous human-in-the-loop roll tracking experiments that compared control behavior metrics collected in both a research aircraft and a motion-base simulator. In the experiments, pilots' behavior under 10 different motion configurations with varying motion filter gains and break frequencies was evaluated and compared to that in the real aircraft. The linear mixed-effects model analysis on the combined dataset confirmed the main statistical outcomes of the individual experiments. The main benefits of mixed models for this type of data were demonstrated by successfully combining data from two experiments that used different experimental conditions and of which one had an additional apparatus and the other a missing participant. Finally, the mixed-model analysis was able to explicitly test for scientifically relevant statistical differences in the dependent measures between the aircraft and simulator, as well as both experiments.

manual control↗

Combined dietary and exercise intervention for control of serum cholesterol in the workplace

PURPOSE: To elucidate a potential combined dietary and exercise intervention affect on cardiovascular risk reduction of the National Aeronautics and Space Administration Headquarters employees. DESIGN: A nonexperimental, longitudinal, clinical-chart review study (1987 to 1996) of an identified intervention group and a reference (not a control) group. SETTING: The study group worked in an office environment and participated in the annual medical examinations. SUBJECTS: An intervention group of 858 people with initially elevated serum cholesterol, and a reference group of 963 people randomly sampled from 10% of the study group. MEASURES: Serum cholesterol data were obtained for both groups, respectively, from pre- and postintervention and annual examinations. The reference group was adjusted by statistical exclusion of potential intervention participants. Regression equations (cholesterol vs. study years) for the unadjusted/adjusted reference groups were tested for statistical significance. INTERVENTION: An 8-week individualized, combined dietary and exercise program was instituted with annual follow-ups and was repeated where warranted. RESULTS: Only the unadjusted (but not the adjusted) reference group with initial mean total serum cholesterol levels above 200 mg/dL shows a significant 9-year decline trend and significant beta coefficient tests. An intervention effect is suggested. Mean high density lipoprotein cholesterol rose slightly in the intervention group but was maintained in the reference group. CONCLUSION: With potential design limitations, the NASA intervention program focusing on a high risk group may be associated to some degree, if not fully, with an overall cardiovascular risk profile improvement.

Occupational Health Services↗

Shuttle payload vibroacoustic test plan evaluation

Statistical decision theory is used to evaluate seven alternate vibro-acoustic test plans for Space Shuttle payloads; test plans include component, subassembly and payload testing and combinations of component and assembly testing. The optimum test levels and the expected cost are determined for each test plan. By including all of the direct cost associated with each test plan and the probabilistic costs due to ground test and flight failures, the test plans which minimize project cost are determined. The lowest cost approach eliminates component testing and maintains flight vibration reliability by performing subassembly tests at a relatively high acoustic level.

Stahle, C. V.↗

A simple test of independence for truncated data with applications to redshift surveys

This paper presents an easily applied permutation test for H0, closely related to Lyden-Bell's (1971) estimate of the marginal distribution of truncated data. The test is applied to two redshift-magnitude surveys, one of galaxies and one of quasars. Assuming statistical independence, testing H0 amounts to testing validity of the cosmological model. Segal's (1986) chronomatic cosmological model is rejected under H0. On the other hand, for the quasar sample H0 is rejected strongly in a conventional cosmological model (and in a chronomatic model as well) indicating either incorrectness of the models or, as is more commonly assumed, indicating strong luminosity evolution.

Efron, Bradley↗

Determination of the Corrosive Conditions Present within Aircraft Lap-Splice Joints

The complexity of airframe structure lends itself to damage resulting from crevice corrosion. Fuselage lap-splice joints are a particularly important structural detail in this regard because of the difficulty associated with detection and measurement of corrosion in these occluded regions. The objective of this work is to develop a laboratory corrosion test protocol to identify the chemistry to which lap joints are exposed and to develop a model of the corrosion within the joints. A protocol for collecting and identifying the chemistry of airframe crevice corrosion has been developed. Capillary electrophoresis (CE) is used to identify the ionic species contained in corrosion product samples removed from fuselage lap splice joints. CE analysis has been performed on over sixty corrosion product samples removed from both civilian and military aircraft. Over twenty different ions have been detected. Measurements of pH of wetted corroded surfaces indicated an alkaline occluded solution. After determining the species present and their relative concentrations, the resultant solution was reproduced in bulk and electrochemical tests were performed to determine the corrosion rate. Electrochemical analyses of the behavior of AA2024-T3 in these solutions gave corrosion rates of up to 250 microns per year (10 mpy). Additional tests have determined the relative importance of each of the detected ions in model solutions used for future predictive tests. The statistically significant ions have been used to create a second generation solution. Laboratory studies have also included exposure tests involving artificial lap joints exposed to various simulated bulk and crevice environments. The extent and morphology of the attack in artificial lap joints has been compared to studies of corroded samples from actual aircraft. Other effects, such as temperature and potential, as well as the impact of the environment on fatigue crack growth have also been studied.

Lewis, Karen S.↗

Evaluation of dose recalculation vs dose deformation in a commercial platform for deformable image registration with a computational phantom

Deformable image registration (DIR) is an important tool for mapping both dose and contours of a new set of planning images when recurrent, that is, adaptive radiotherapy, or further treatment, that is, re-treatment, is required. The aim of this study was to evaluate the need for plan recalculation in deformed anatomies and to develop a reliable workflow for validating the DIR algorithm to be applied to dose warping such as dose accumulation (DA) for adaptive radiation therapy, and dose summation (DS) in the case of re-treatment. A set of 3 computational phantoms was developed to validate the application of B-Spline-based registrations for dose mapping among the various computed tomography image data sets. Two different versions were defined for each phantom to simulate clinical needs: adaptive radiotherapy and re-treatment; a DIR was performed to obtain a displacement vector field (DVF) for dose applications. Comparison of calculated and deformed doses was carried out by means of known markers inside the virtual phantoms. The differences were evaluated using a 3% dose index as acceptance criteria. A paired Wilcoxon signed-rank test was carried out to test the statistical significance of differences within the markers. Significant differences were only observed for the deformed dose in the DA test; no significant differences were observed for recalculated dose values in the DA and DS tests. The dose index is in accordance with these results. The warping dose process obtained by registering various sets of images was validated; a recalculation approach seems to be more accurate for DA purposes and image-guided adaptive radiation therapy (IGART) applications.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Evaluating User Errors and Temporal Trends in Marine Fish Communities Using 360-Degree Underwater Photography

The use of environmental DNA (eDNA) sampling has been proposed as a complementary method to monitor fish species in marine environments, offering a non-invasive and potentially more efficient approach to marine species observations. eDNA monitoring could be especially useful in and around sites targeted for marine energy generation as these regions need regular monitoring that would be impractical with traditional techniques. Before we can fully rely upon eDNA, we must first verify its accuracy against other proven methods, such as the use of underwater photography. In this study, I deployed a 360-degree camera in the tidal channel of Sequim Bay once a month during several hours overlapping slack tide. I investigated how having multiple people identify and count fish on underwater images could affect the overall results. Using chi square tests in R, I compared my fish identifications and counts to those made by another intern on the same images recorded in August. I found significant differences in the number of species identified and the total individual counts between the two different datasets. I also tested the statistical differences in both Shannon diversity and Pielou evenness indices between the August, September, and November camera deployments using a Hutcheson t-test. Only one significant difference was found in the Shannon index comparisons, and none were found between the Pielou evenness comparisons. These findings show that if multiple identifiers are used to process underwater images, quality control checks must be made to reduce the potential for error. This also points toward the possibility to leverage more advanced image analysis processes, such as automated image analysis software. The findings from this study also show that the dynamics of marine fish communities can vary over a few months; however, further analysis is needed to determine the extent of the seasonal changes in Sequim Bay.

59 BASIC BIOLOGICAL SCIENCES↗

Hypothesis testing of scientific Monte Carlo calculations

The steadily increasing size of scientific Monte Carlo simulations and the desire for robust, correct, and reproducible results necessitates rigorous testing procedures for scientific simulations in order to detect numerical problems and programming bugs. However, the testing paradigms developed for deterministic algorithms have proven to be ill suited for stochastic algorithms. In this paper we demonstrate explicitly how the technique of statistical hypothesis testing, which is in wide use in other fields of science, can be used to devise automatic and reliable tests for Monte Carlo methods, and we show that these tests are able to detect some of the common problems encountered in stochastic scientific simulations. We argue that hypothesis testing should become part of the standard testing toolkit for scientific simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

JAN transistor and diode characterization test program

A statistical summary of electrical characterization was performed on JAN diodes and transistors. Parameters are presented with test conditions, mean, standard deviation, lowest reading, 10% point, 90% point and highest reading.

Takeda, H.↗

CMB low multipole alignments across WMAP and Planck data releases

ABSTRACT The first observations of the cosmic microwave background (CMB) from NASA's Wilkinson Microwave Anisotropy Probe (WMAP) led to finding ‘alignment’ anomalies not expected from fluctuations in the isotropic cosmological model. We study the data of all 8 full-sky public releases since then to test for anomalous alignments and shapes of the first 60 multipoles, i.e. over the range $2\le l \le 61$. We use rotationally invariant and covariant statistics to test isotropy of all subsequent WMAP data releases, along with those from the ESA’s Planck mission. Anomalous alignments among the multipoles $l=1, 2, 3$ are very consistent and robust. More alignments are detected, some of them new, while significance is diluted by the large range of the search. Power entropy, a measure of the randomness of the multipoles, is consistently anomalous at about $2\sigma$ level or better across all data releases. It appears that the CMB is not as random as the cosmological principle predicts on large angular scales.

Patel, Sanjeet Kumar↗