Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “testing statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Performance Evaluation of a Respirator Vortex Cooling Device

The United States Department of Energy's Savannah River Site (SRS) in Aiken, South Carolina, is dedicated to promoting site-level, risk-based inspection practices to maintain a safe and productive work environment. Protective suits are worn by personnel working in contaminated environments. These suits require that cooling be applied to keep the interior temperature within safe and comfortable limits. A vortex tube, also known as the Ranque-Hilsch vortex tube (RHVT), can provide the necessary cooling. As mechanical devices void of moving components, vortex tubes separate a compressed gas into hot and cold streams—the air emerging from the “hot” end reaching a temperature of 433.2 K and the air emerging from the “cold” end reaching a temperature of 241.5 K (Hilsch, 1946, “Die Expansion Von Gasen Im Zentrifugalfeld Als Kälteprozeß,” Z. Für Naturforsch., 1, pp. 208–214). Routing the cold stream of the vortex tube to the user's protective suit facilitates the required cooling. Vortex tubes currently in use at SRS are preset, through modification solely by and within the SRS respiratory equipment facility (REF), to provide a temperature reduction between 22.2 and 25.0 K. When a new model of vortex tube capable of user adjustment during operation recently became available, prototype testing was conducted for product comparison. Ultimately, it was identified that similar cooling performance between the old and new models is achievable. Production units were acquired to be subjected to complete product analysis at SRS utilizing a statistical test plan. Finally, the statistical test plan, data, thermodynamic calculations, and conclusions were reviewed to determine acceptability for site use.

47 OTHER INSTRUMENTATION↗

Steady-state supercritical CO 2 and brine relative permeability in Berea sandstone at different temperature and pressure conditions

In this study, we measure steady-state two-phase supercritical CO 2 -brine relative permeabilities in a 61 cm-long Berea sandstone core at three different conditions (408C and 12.41 MPa, 408C and 8.27 MPa, and 608C and 12.41 MPa) under primary drainage. We use pressure taps to obtain pressure drops of individual sections of the core, and X-ray Computed Tomography (CT) to obtain in situ saturation profiles, which together help to mitigate the capillary end effect. We include previously measured relative permeabilities at 208C and 10.34 MPa, and compare all the data using both an eye-test and a statistical test. We find no appreciable temperature and pressure dependence of CO 2 relative permeability within 20–608C and 8.27–12.41 MPa. We find slight changes in the brine relative permeability between supercritical CO 2 conditions (40–608C and 8.27–12.41 MPa) and the liquid CO 2 condition (208C and 10.34 MPa). The temperature and pressure independence of CO 2 relative permeability has been previously recognized and reassured in this work using a capillary-effect-free method. This allows one to use a single CO 2 relative permeability curve in modeling two-phase CO 2 flow within 20–608C and 8.27–12.41 MPa.

58 GEOSCIENCES↗

High-speed quantum-random number generation by continuous measurement of arrival time of photons

We demonstrate a novel high speed and multi-bit optical quantum random number generator by continuously measuring arrival time of photons with a common starting point. To obtain the unbiased and post-processing free random bits, the measured photon arrival time is converted into the sum of integral multiple of a fixed period and a phase time. Theoretical and experimental results show that the phase time is an independent and uniform random variable. A random bit extraction method by encoding the phase time is proposed. An experimental setup has been built and the unbiased random bit generation rate could reach 128 Mb/s, with random bit generation efficiency of 8 bits per detected photon. The random numbers passed all tests in the statistical test suite.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DETECTING UNSPECIFIED STRUCTURE IN LOW-COUNT IMAGES

Unexpected structure in images of astronomical sources often presents itself upon visual inspection of the image, but such apparent structure may either correspond to true features in the source or be due to noise in the data. This paper presents a method for testing whether inferred structure in an image with Poisson noise represents a significant departure from a baseline (null) model of the image. To infer image structure, we conduct a Bayesian analysis of a full model that uses a multiscale component to allow flexible departures from the posited null model. As a test statistic, we use a tail probability of the posterior distribution under the full model. This choice of test statistic allows us to estimate a computationally efficient upper bound on a p-value that enables us to draw strong conclusions even when there are limited computational resources that can be devoted to simulations under the null model. We demonstrate the statistical performance of our method on simulated images. Applying our method to an X-ray image of the quasar 0730+257, we find significant evidence against the null model of a single point source and uniform background, lending support to the claim of an X-ray jet.

79 ASTRONOMY AND ASTROPHYSICS↗

REMARKS ON THE METHODS OF INVESTIGATIONS OF ALIGNMENT OF GALAXIES

In the 1975 Hawley and Peebles proposed the use of three statistical tests for investigations of galaxy orientations in the large structures. Nowadays, it is considered as the standard method of searching for galactic alignments. In the present paper we analyzed the tests in detail and proposed a few improvements. Based on the improvements, a new method of analysis of the alignment of galaxies in clusters is proposed. The power of this method is demonstrated on the sample of 247 Abell clusters with at least 100 objects in each. The distributions of the position angles for galaxies in each cluster are analyzed using statistical tests: {chi}{sup 2}, Fourier, autocorrelation, and Kolmogorov test. The mean value of analyzed statistics is compared with theoretical predictions as well as with results obtained from numerical simulations. We performed 1000 simulations of 247 fictitious clusters, each with the numbers of galaxies the same as in the real clusters. We found that orientations of galaxies in analyzed clusters are not random, i.e., that there exists an alignment of galaxies in rich Abell galaxy clusters.

79 ASTRONOMY AND ASTROPHYSICS↗

Toward extracting $$\gamma $$ from $$B\rightarrow DK$$ without binning

Abstract $$B^\pm \rightarrow DK^\pm $$ B ± → D K ± transitions are known to provide theoretically clean information about the CKM angle $$\gamma $$ γ , with the most precise available methods exploiting the cascade decay of the neutral D into CP self-conjugate states. Such analyses currently require binning in the D decay Dalitz plot, while a recently proposed method replaces this binning with the truncation of a Fourier series expansion. In this paper, we present a proof of principle of a novel alternative to these two methods, in which no approximations at the level of the data representation are required. In particular, our new strategy makes no assumptions about the amplitude and strong phase variation over the Dalitz plot. This comes at the cost of a degree of ambiguity in the choice of test statistic quantifying the compatibility of the data with a given value of $$\gamma $$ γ , with improved choices of test statistic yielding higher sensitivity. While our current proof-of-principle implementation does not demonstrate optimal sensitivity to $$\gamma $$ γ , its conceptually novel approach opens the door to new strategies for $$\gamma $$ γ extraction. More studies are required to see if these can be competitive with the existing methods.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Visual Sample Plan Version 7.0 User's Guide

User's guide for VSP 7.0 This user's guide describes Visual Sample Plan (VSP) Version 7.0 and provides instructions for using the software. VSP selects the appropriate number and location of environmental samples to ensure that the results of statistical tests performed to provide input to risk decisions have the required confidence and performance. VSP Version 7.0 provides sample-size equations or algorithms needed by specific statistical tests appropriate for specific environmental sampling objectives. It also provides data quality assessment and statistical analysis functions to support evaluation of the data and determine whether the data support decisions regarding sites suspected of contamination. The easy-to-use program is highly visual and graphic. VSP runs on personal computers with Microsoft Windows operating systems (XP, Vista, Windows 7, and Windows 8). Designed primarily for project managers and users without expertise in statistics, VSP is applicable to two- and three-dimensional populations to be sampled (e.g., rooms and buildings, surface soil, a defined layer of subsurface soil, water bodies, and other similar applications) for studies of environmental quality. VSP is also applicable for designing sampling plans for assessing chem/rad/bio threat and hazard identification within rooms and buildings, and for designing geophysical surveys for unexploded ordnance (UXO) identification.

97 MATHEMATICS AND COMPUTING↗

WE-E-201-01: Use and Abuse of Common Statistics in Radiological Physics

Physicists are often expected to have a solid grounding in experimental design and statistical analysis, sometimes filling in when biostatisticians or other experts are not available for consultation. Unfortunately, graduate education on these topics is seldom emphasized and few opportunities for continuing education exist. Clinical physicists incorporate new technology and methods into their practice based on published literature. A poor understanding of experimental design and analysis could Result in inappropriate use of new techniques. Clinical physicists also improve current practice through quality initiatives that require sound experimental design and analysis. Academic physicists with a poor understanding of design and analysis may produce ambiguous (or misleading) results. This can Result in unnecessary rewrites, publication rejection, and experimental redesign (wasting time, money, and effort). This symposium will provide a practical review of error and uncertainty, common study designs, and statistical tests. Instruction will primarily focus on practical implementation through examples and answer questions such as: where would you typically apply the test/design and where is the test/design typically misapplied (i.e., common pitfalls)? An analysis of error and uncertainty will also be explored using biological studies and associated modeling as a specific use case. Learning Objectives: Understand common experimental testing and clinical trial designs, what questions they can answer, and how to interpret the results Determine where specific statistical tests are appropriate and identify common pitfalls Understand the how uncertainty and error are addressed in biological testing and associated biological modeling.

60 APPLIED LIFE SCIENCES↗

Data-directed search for new physics based on symmetries of the SM

We propose exploiting symmetries (exact or approximate) of the Standard Model (SM) to search for physics Beyond the Standard Model (BSM) using the data-directed paradigm (DDP). Symmetries are very powerful because they provide two samples that can be compared without requiring simulation. Focusing on the data, exclusive selections which exhibit significant asymmetry can be identified efficiently and marked for further study. Using a simple and generic test statistic which compares two matrices already provides good sensitivity, only slightly worse than that of the profile likelihood ratio test statistic which relies on the exact knowledge of the signal shape. This can be exploited for rapidly scanning large portions of the measured data, in an attempt to identify regions of interest. We also demonstrate that weakly supervised Neural Networks could be used for this purpose as well.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

THE YOUNG SOLAR ANALOGS PROJECT. I. SPECTROSCOPIC AND PHOTOMETRIC METHODS AND MULTI-YEAR TIMESCALE SPECTROSCOPIC RESULTS

This is the first in a series of papers presenting methods and results from the Young Solar Analogs Project, which began in 2007. This project monitors both spectroscopically and photometrically a set of 31 young (300–1500 Myr) solar-type stars with the goal of gaining insight into the space environment of the Earth during the period when life first appeared. From our spectroscopic observations we derive the Mount Wilson S chromospheric activity index (S{sub MW}), and describe the method we use to transform our instrumental indices to S{sub MW} without the need for a color term. We introduce three photospheric indices based on strong absorption features in the blue-violet spectrum—the G-band, the Ca i resonance line, and the Hydrogen-γ line—with the expectation that these indices might prove to be useful in detecting variations in the surface temperatures of active solar-type stars. We also describe our photometric program, and in particular our “Superstar technique” for differential photometry which, instead of relying on a handful of comparison stars, uses the photon flux in the entire star field in the CCD image to derive the program star magnitude. This enables photometric errors on the order of 0.005–0.007 magnitude. We present time series plots of our spectroscopic data for all four indices, and carry out extensive statistical tests on those time series demonstrating the reality of variations on timescales of years in all four indices. We also statistically test for and discover correlations and anti-correlations between the four indices. We discuss the physical basis of those correlations. As it turns out, the “photospheric” indices appear to be most strongly affected by emission in the Paschen continuum. We thus anticipate that these indices may prove to be useful proxies for monitoring emission in the ultraviolet Balmer continuum. Future papers in this series will discuss variability of the program stars on medium (days–months) and short (minutes to hours) timescales.

79 ASTRONOMY AND ASTROPHYSICS↗

U.S. residential consumer product information: Validation of methods for post-stratification weighting of Amazon Mechanical Turk surveys

We present two post-stratification weighting methods to validate survey data collected using Amazon Mechanical Turk (AMT). Two surveys focused on appliance and consumer electronics devices were administered in the spring and summer of 2012 to each of approximately 3,000 U.S. households. Specifically, the surveys asked questions about residential refrigeration products, televisions (TVs) and set-top boxes (STBs). Filtered data were assigned weights using each of two weighting methods, termed “sequential” and “simultaneous,” by examining up to eight demographic variables (income, education, gender, race, Hispanic origin, number of occupants, ages of occupants, and geographic region) in comparison to reference U.S. demographic data from the 2009 Residential Energy Consumption Survey (RECS). Five key questions from the surveys (number of refrigerators, number of freezers, number of TVs, number of STBs and primary service provider) were evaluated with a set of statistical tests to determine whether either method improved the agreement of AMT with reference data, and if so, which method was better. The statistical tests used were: differences in proportions, distributions of proportions (using Pearson’s chi-squared test), and differences in average numbers of devices as functions of all demographic variables. The results indicated that both methods generally improved the agreement between AMT and reference data, sometimes greatly, but that the simultaneous method was usually superior to the sequential method. Some differences in sample populations were found between the AMT and reference data. Differences in the proportion of STBs reflected large changes in the STB market since the time our reference data was acquired in 2009. Differences in the proportions of some primary service providers suggested real sample bias, with the possible explanation that AMT user are more likely to subscribe to providers who also provide home internet service. Differences in other variables, while statistically significant in some cases, were nonetheless considered to be minor. Depending on the intended purpose of the data collected using AMT, these biases may or may not be important; to correct them, additional questions and/or further post-survey adjustments could be employed. In general, based on the analysis methods and the sample datasets used in this study, AMT surveys appeared to provide useful data on appliance and consumer electronics devices.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Precision test of statistical dynamics with state-to-state ultracold chemistry

Chemical reactions represent a class of quantum problems that challenge both the current theoretical understanding and computational capabilities1. Reactions that occur at ultralow temperatures provide an ideal testing ground for quantum chemistry and scattering theories, because they can be experimentally studied with unprecedented control, yet display dynamics that are highly complex. Here we report the full product state distribution for the reaction 2KRb → K 2 + Rb 2 . Ultracold preparation of the reactants allows us complete control over their initial quantum degrees of freedom, whereas state-resolved, coincident detection of both products enables the probability of scattering into each of the 57 allowed rotational state-pairs to be measured. Our results show an overall agreement with a state-counting model based on statistical theory, but also reveal several deviating state-pairs. In particular, we observe a strong suppression of population in the state-pair closest to the exoergicity limit as a result of the long-range potential inhibiting the escape of products. Finally, the completeness of our measurements provides a benchmark for quantum dynamics calculations beyond the current state of the art.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A dual model HU conversion from MRI intensity values within and outside of bone segment for MRI-based radiotherapy treatment planning of prostate cancer

Purpose: The lack of electron density information in magnetic resonance images (MRI) poses a major challenge for MRI-based radiotherapy treatment planning (RTP). In this study the authors convert MRI intensity values into Hounsfield units (HUs) in the male pelvis and thus enable accurate MRI-based RTP for prostate cancer patients with varying tissue anatomy and body fat contents. Methods: T{sub 1}/T{sub 2}*-weighted MRI intensity values and standard computed tomography (CT) image HUs in the male pelvis were analyzed using image data of 10 prostate cancer patients. The collected data were utilized to generate a dual model HU conversion technique from MRI intensity values of the single image set separately within and outside of contoured pelvic bones. Within the bone segment local MRI intensity values were converted to HUs by applying a second-order polynomial model. This model was tuned for each patient by two patient-specific adjustments: MR signal normalization to correct shifts in absolute intensity level and application of a cutoff value to accurately represent low density bony tissue HUs. For soft tissues, such as fat and muscle, located outside of the bone contours, a threshold-based segmentation method without requirements for any patient-specific adjustments was introduced to convert MRI intensity values into HUs. The dual model HU conversion technique was implemented by constructing pseudo-CT images for 10 other prostate cancer patients. The feasibility of these images for RTP was evaluated by comparing HUs in the generated pseudo-CT images with those in standard CT images, and by determining deviations in MRI-based dose distributions compared to those in CT images with 7-field intensity modulated radiation therapy (IMRT) with the anisotropic analytical algorithm and 360° volumetric-modulated arc therapy (VMAT) with the Voxel Monte Carlo algorithm. Results: The average HU differences between the constructed pseudo-CT images and standard CT images of each test patient ranged from −2 to 5 HUs and from 22 to 78 HUs in soft and bony tissues, respectively. The average local absolute value differences were 11 HUs in soft tissues and 99 HUs in bones. The planning target volume doses (volumes 95%, 50%, 5%) in the pseudo-CT images were within 0.8% compared to those in CT images in all of the 20 treatment plans. The average deviation was 0.3%. With all the test patients over 94% (IMRT) and 92% (VMAT) of dose points within body (lower than 10% of maximum dose suppressed) passed the 1 mm and 1% 2D gamma index criterion. The statistical tests (t- and F-tests) showed significantly improved (p ≤ 0.05) HU and dose calculation accuracies with the soft tissue conversion method instead of homogeneous representation of these tissues in MRI-based RTP images. Conclusions: This study indicates that it is possible to construct high quality pseudo-CT images by converting the intensity values of a single MRI series into HUs in the male pelvis, and to use these images for accurate MRI-based prostate RTP dose calculations.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Neutron/Gamma-ray discrimination through measures of fit

Statistical tests and their underlying measures of fit can be utilized to separate neutron/gamma-ray pulses in a mixed radiation field. In this article, first the application of a sample statistical test is explained. Fit measurement-based methods require true pulse shapes to be used as reference for discrimination. This requirement makes practical implementation of these methods difficult; typically another discrimination approach should be employed to capture samples of neutrons and gamma-rays before running the fit-based technique. In this article, we also propose a technique to eliminate this requirement. These approaches are applied to several sets of mixed neutron and gamma-ray pulses obtained through different digitizers using stilbene scintillator in order to analyze them and measure their discrimination quality. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Biological Optimization in Volumetric Modulated Arc Radiotherapy for Prostate Carcinoma

Purpose: To investigate the potential benefits achievable with biological optimization for modulated volumetric arc (VMAT) treatments of prostate carcinoma. Methods and Materials: Fifteen prostate patient plans were studied retrospectively. For each case, planning target volume, rectum, and bladder were considered. Three optimization schemes were used: dose-volume histogram (DVH) based, generalized equivalent uniform dose (gEUD) based, and mixed DVH/gEUD based. For each scheme, a single or dual 6-MV, 356 Degree-Sign VMAT arc was used. The plans were optimized with Pinnacle{sup 3} (v. 9.0 beta) treatment planning system. For each patient, the optimized dose distributions were normalized to deliver the same prescription dose. The quality of the plans was evaluated by dose indices (DIs) and gEUDs for rectum and bladder. The tallied DIs were D{sub 1%}, D{sub 15%}, D{sub 25%}, and D{sub 40%}, and the tallied gEUDs were for a values of 1 and 6. Statistical tests were used to quantify the magnitude and the significance of the observed differences. Monitor units and treatment times for each optimization scheme were also assessed. Results: All optimization schemes generated clinically acceptable plans. The statistical tests indicated that biological optimization yielded increased organs-at-risk sparing, ranging from {approx}1% to more than {approx}27% depending on the tallied DI, gEUD, and anatomical structure. The increased sparing was at the expense of longer treatment times and increased number of monitor units. Conclusions: Biological optimization can significantly increase the organs-at-risk sparing in VMAT optimization for prostate carcinoma. In some particular cases, however, the DVH-based optimization resulted in superior treatment plans.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Quantifying (dis)agreement between direct detection experiments in a halo-independent way

We propose an improved method to study recent and near-future dark matter direct detection experiments with small numbers of observed events. Our method determines in a quantitative and halo-independent way whether the experiments point towards a consistent dark matter signal and identifies the best-fit dark matter parameters. To achieve true halo independence, we apply a recently developed method based on finding the velocity distribution that best describes a given set of data. For a quantitative global analysis we construct a likelihood function suitable for small numbers of events, which allows us to determine the best-fit particle physics properties of dark matter considering all experiments simultaneously. Based on this likelihood function we propose a new test statistic that quantifies how well the proposed model fits the data and how large the tension between different direct detection experiments is. We perform Monte Carlo simulations in order to determine the probability distribution function of this test statistic and to calculate the p-value for both the dark matter hypothesis and the background-only hypothesis.

79 ASTRONOMY AND ASTROPHYSICS↗

Optimization of energy window for {sup 90}Y bremsstrahlung SPECT imaging for detection tasks using the ideal observer with model-mismatch

Purpose: In yttrium-90 ({sup 90}Y) microsphere brachytherapy (radioembolization) of unresectable liver cancer, posttherapy {sup 90}Y bremsstrahlung single photon emission computed tomography (SPECT) has been used to document the distribution of microspheres in the patient and to help predict potential side effects. The energy window used during projection acquisition can have a significant effect on image quality. Thus, using an optimal energy window is desirable. However, there has been great variability in the choice of energy window due to the continuous and broad energy distribution of {sup 90}Y bremsstrahlung photons. The area under the receiver operating characteristic curve (AUC) for the ideal observer (IO) is a widely used figure of merit (FOM) for optimizing the imaging system for detection tasks. The IO implicitly assumes a perfect model of the image formation process. However, for {sup 90}Y bremsstrahlung SPECT there can be substantial model-mismatch (i.e., difference between the actual image formation process and the model of it assumed in reconstruction), and the amount of the model-mismatch depends on the energy window. It is thus important to account for the degradation of the observer performance due to model-mismatch in the optimization of the energy window. The purpose of this paper is to optimize the energy window for {sup 90}Y bremsstrahlung SPECT for a detection task while taking into account the effects of the model-mismatch. Methods: An observer, termed the ideal observer with model-mismatch (IO-MM), has been proposed previously to account for the effects of the model-mismatch on IO performance. In this work, the AUC for the IO-MM was used as the FOM for the optimization. To provide a clinically realistic object model and imaging simulation, the authors used a background-known-statistically and signal-known-statistically task. The background was modeled as multiple compartments in the liver with activity parameters independently following a Gaussian distribution; the signal was modeled as a tumor with a Gaussian-distributed activity parameter located randomly with equal probability at one of three positions. The IO test statistics (i.e., likelihood ratios) were estimated using Markov-chain Monte Carlo methods. The authors realistically modeled human anatomy using a digital phantom code, and realistically simulated {sup 90}Y bremsstrahlung SPECT imaging with a clinical SPECT system and typical imaging parameters using a previously validated Monte Carlo bremsstrahlung simulation method. Model-mismatch was included by modeling image formation process in the calculation of IO test statistics using an analytic modeling method previously developed for quantitative {sup 90}Y bremsstrahlung SPECT. To demonstrate the effects of the model-mismatch on the detection task, the authors optimized the energy window both with and without model-mismatch included in the IO. Results: For all the energy windows, the AUC values for the IO-MM were smaller than that for the IO. The optimal windows for the IO-MM and the IO were 80-180 and 60-400 keV, respectively. Conclusions: The authors have demonstrated the degradation of the ideal performance due to model-mismatch and optimized the energy window for {sup 90}Y bremsstrahlung SPECT for detection tasks by accounting for the effects of the model-mismatch. The obtained optimal window was much narrower when taking into account the model-mismatch and similar to that obtained previously for estimation tasks.

61 RADIATION PROTECTION AND DOSIMETRY↗

Statistical Hypothesis Testing using CNN Features for Synthesis of Adversarial Counterexamples to Human and Object Detection Vision Systems

Validating the correctness of human detection vision systems is crucial for safety applications such as pedestrian collision avoidance in autonomous vehicles. The enormous space of possible inputs to such an intelligent system makes it difficult to design test cases for such systems. In this report, we present our tool MAYA that uses an error model derived from a convolutional neural network (CNN) to explore the space of images similar to a given input image, and then tests the correctness of a given human or object detection system on such perturbed images. We demonstrate the capability of our tool on the pre-trained Histogram-of-Oriented-Gradients (HOG) human detection algorithm implemented in the popular OpenCV toolset and the Caffe object detection system pre-trained on the ImageNet benchmark. Our tool may serve as a testing resource for the designers of intelligent human and object detection systems.

97 MATHEMATICS AND COMPUTING↗