Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical Testing Approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

Initial Evaluation of a Conflict Detection Tool in the Terminal Area

Despite the recent economic recession and its adverse impact on air travel, the Federal Aviation Administration (FAA) continues to forecast an increase in air traffic demand that may see traffic double or triple by the year 2025. Increases in air traffic will burden the air traffic management system, and higher levels of safety and efficiency will be required. The air traffic controllers primary task is to ensure separation between aircraft in their airspace and keep the skies safe. As air traffic is forecasted to increase in volume and complexity [1], there is an increased likelihood of conflicts between aircraft, which adds risk and inefficiency to air traffic management and increases controller workload. To attenuate these factors, recent ATM research has shown that air and ground-based automation tools could reduce controller workload, especially if the automation is focused on conflict detection and resolution. Conflict Alert is a short time horizon conflict detection tool deployed in the Terminal Radar Approach Control (TRACON), which has limited utility due to the high number of false alerts generated and its use of dead reckoning to predict loss of separation between aircraft. Terminal Tactical Separation Assurance Flight Environment (T-TSAFE) is a short time horizon conflict detection tool that uses both flight intent and dead reckoning to detect conflicts. Results of a fast time simulation experiment indicated that TTSAFE provided a more effective alert lead-time and generated less false alerts than Conflict Alert [2]. TSAFE was previously tested in a Human-In-The-Loop (HITL) simulation study that focused on the en route phase of flight [3]. The current study tested the T-TSAFE tool in an HITL simulation study, focusing on the terminal environment with current day operations. The study identified procedures, roles, responsibilities, information requirements and usability, with the help of TRACON controllers who participated in the experiment. Metrics such as lead alert time, alert response time, workload, situation awareness and other measures were statistically analyzed. These metrics were examined from an overall perspective and comparisons between conditions (altitude resolutions via keyboard entry vs. ADS-B entry) and controller positions (two final approach sectors and two feeder sectors) were also examined. Results of these analyses and controller feedback provided evidence of T-TSAFE s potential promise as a useful air traffic controller tool. Heuristic analysis also provided information on ways in which the T-TSAFE tool can be improved. Details of analyses results will be presented in the full paper.

Verma Savita Arora↗
DOE OSTI2016

An efficient computational approach to model statistical correlations in photon counting x-ray detectors

Purpose: To introduce and evaluate an increment matrix approach (IMA) describing the signal statistics of energy-selective photon counting detectors including spatial–spectral correlations between energy bins of neighboring detector pixels. The importance of the occurring correlations for image-based material decomposition is studied. Methods: An IMA describing the counter increase patterns in a photon counting detector is proposed. This IMA has the potential to decrease the number of required random numbers compared to Monte Carlo simulations by pursuing an approach based on convolutions. To validate and demonstrate the IMA, an approximate semirealistic detector model is provided, simulating a photon counting detector in a simplified manner, e.g., by neglecting count rate-dependent effects. In this way, the spatial–spectral correlations on the detector level are obtained and fed into the IMA. The importance of these correlations in reconstructed energy bin images and the corresponding detector performance in image-based material decomposition is evaluated using a statistically optimal decomposition algorithm. Results: The results of IMA together with the semirealistic detector model were compared to other models and measurements using the spectral response and the energy bin sensitivity, finding a good agreement. Correlations between the different reconstructed energy bin images could be observed, and turned out to be of weak nature. These correlations were found to be not relevant in image-based material decomposition. An even simpler simulation procedure based on the energy bin sensitivity was tested instead and yielded similar results for the image-based material decomposition task, as long as the fact that one incident photon can increase multiple counters across neighboring detector pixels is taken into account. Conclusions: The IMA is computationally efficient as it required about 10{sup 2} random numbers per ray incident on a detector pixel instead of an estimated 10{sup 8} random numbers per ray as Monte Carlo approaches would need. The spatial–spectral correlations as described by IMA are not important for the studied image-based material decomposition task. Respecting the absolute photon counts and thus the multiple counter increases by a single x-ray photon, the same material decomposition performance could be obtained with a simpler detector description using the energy bin sensitivity.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2018

Enhancing statistical moment calculations for stochastic Galerkin solutions with Monte Carlo techniques

Here, we provide a method for enhancing stochastic Galerkin moment calculations to the linear elliptic equation with random diffusivity using an ensemble of Monte Carlo solutions. This hybrid approach combines the accuracy of low-order stochastic Galerkin and the computational efficiency of Monte Carlo methods to provide statistical moment estimates which are significantly more accurate than performing each method individually. The hybrid approach involves computing a low-order stochastic Galerkin solution, after which Monte Carlo techniques are used to estimate the residual. We show that the combined stochastic Galerkin solution and residual is superior in both time and accuracy for a one-dimensional test problem and a more computational intensive two-dimensional linear elliptic problem for both the mean and variance quantities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Evaluation of dose recalculation vs dose deformation in a commercial platform for deformable image registration with a computational phantom

Deformable image registration (DIR) is an important tool for mapping both dose and contours of a new set of planning images when recurrent, that is, adaptive radiotherapy, or further treatment, that is, re-treatment, is required. The aim of this study was to evaluate the need for plan recalculation in deformed anatomies and to develop a reliable workflow for validating the DIR algorithm to be applied to dose warping such as dose accumulation (DA) for adaptive radiation therapy, and dose summation (DS) in the case of re-treatment. A set of 3 computational phantoms was developed to validate the application of B-Spline-based registrations for dose mapping among the various computed tomography image data sets. Two different versions were defined for each phantom to simulate clinical needs: adaptive radiotherapy and re-treatment; a DIR was performed to obtain a displacement vector field (DVF) for dose applications. Comparison of calculated and deformed doses was carried out by means of known markers inside the virtual phantoms. The differences were evaluated using a 3% dose index as acceptance criteria. A paired Wilcoxon signed-rank test was carried out to test the statistical significance of differences within the markers. Significant differences were only observed for the deformed dose in the DA test; no significant differences were observed for recalculated dose values in the DA and DS tests. The dose index is in accordance with these results. The warping dose process obtained by registering various sets of images was validated; a recalculation approach seems to be more accurate for DA purposes and image-guided adaptive radiation therapy (IGART) applications.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2017

Description of the LASSO Alpha 1 Release

The Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Climate Research Facility began a pilot project in May 2015 to design a routine, high-resolution modeling capability to complement ARM’s extensive suite of measurements. This modeling capability has been named the Large-Eddy Simulation (LES) ARM Symbiotic Simulation and Observation (LASSO) project. The availability of LES simulations with concurrent observations will serve many purposes. LES helps bridge the scale gap between DOE ARM observations and models, and the use of routine LES adds value to observations. It provides a self-consistent representation of the atmosphere and a dynamical context for the observations. Further, it elucidates unobservable processes and properties. LASSO will generate a simulation library for researchers that enables statistical approaches beyond a single-case mentality. It will also provide tools necessary for modelers to reproduce the LES and conduct their own sensitivity experiments. Many different uses are envisioned for the combined LASSO LES and observational library. For an observationalist, LASSO can help inform instrument remote-sensing retrievals, conduct Observation System Simulation Experiments (OSSEs), and test implications of radar scan strategies or flight paths. For a theoretician, LASSO will help calculate estimates of fluxes and co-variability of values, and test relationships without having to run the model yourself. For a modeler, LASSO will help one know ahead of time which days have good forcing, have co-registered observations at high-resolution scales, and have simulation inputs and corresponding outputs to test parameterizations. Further details on the overall LASSO project are available at http://www.arm. gov/science/themes/lasso.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1993

Digital test signal generation: An accurate SNR calibration approach for the DSN

In support of the on-going automation of the Deep Space Network (DSN) a new method of generating analog test signals with accurate signal-to-noise ratio (SNR) is described. High accuracy is obtained by simultaneous generation of digital noise and signal spectra at the desired bandwidth (base-band or bandpass). The digital synthesis provides a test signal embedded in noise with the statistical properties of a stationary random process. Accuracy is dependent on test integration time and limited only by the system quantization noise (0.02 dB). The monitor and control as well as signal-processing programs reside in a personal computer (PC). Commands are transmitted to properly configure the specially designed high-speed digital hardware. The prototype can generate either two data channels modulated or not on a subcarrier, or one QPSK channel, or a residual carrier with one biphase data channel. The analog spectrum generated is on the DC to 10 MHz frequency range. These spectra may be up-converted to any desired frequency without loss on the characteristics of the SNR provided. Test results are presented.

Gutierrez-Luaces, Benito O.↗
DOE OSTI2022

Extreme variation in fatigue: Fatigue life prediction and dependence on build volume location in laser powder bed fusion of 17-4 stainless steel

Laser powder bed fusion (LPBF), a metal additive manufacturing technology, is well-suited for design optimization but fatigue life is limited by manufacturing defects. In this work, 17-4 stainless steel components were manufactured in densely populated build volumes, simulating at-scale LPBF production. Tests revealed extreme variability in fatigue life data, analyzed via rigorous statistical tools. The El-Haddad model, modified for finite-life, enabled defect-based life prediction. Specimen location within the build volume correlated to life, which was heteroscedastic. Investigating defect concentration over the build volume explained typical life and scatter. Finally, these findings argue for qualification approaches which acknowledge high material lot variability.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Quantitative cross-species translators of cardiac myocyte electrophysiology: Model training, experimental validation, and applications

Animal experimentation is key in the evaluation of cardiac efficacy and safety of novel therapeutic compounds. However, interspecies differences in the mechanisms regulating excitation-contraction coupling can limit the translation of experimental findings from animal models to human physiology and undermine the assessment of drugs’ efficacy and safety. Here, we built a suite of translators for quantitatively mapping electrophysiological responses in ventricular myocytes across species. We trained these statistical operators using a broad dataset obtained by simulating populations of our biophysically detailed computational models of action potential and Ca 2+ transient in mouse, rabbit, and human. We then tested our translators against experimental data describing the response to stimuli, such as ion channel block, change in beating rate, and β-adrenergic challenge. We demonstrate that this approach is well suited to predicting the effects of perturbations across different species or experimental conditions and suggest its integration into mechanistic studies and drug development pipelines.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

Comparison of Statistical Methods for Detector Testing Programs

A typical goal for any detector testing program is to ascertain not only the performance of the detector systems under test, but also the confidence that systems accepted using that testing program’s acceptance criteria will exceed a minimum acceptable performance (which is usually expressed as the minimum acceptable success probability, p). A similar problem often arises in statistics, where we would like to ascertain the fraction, p, of a population of items that possess a property that may take one of two possible values. Typically, the problem is approached by drawing a fixed sample of size n, with the number of items out of n that possess the desired property, x, being termed successes. The sample mean gives an estimate of the population mean p ≈ x/n, although usually it is desirable to accompany such an estimate with a statement concerning the range within which p may fall and the confidence associated with that range. Procedures for establishing such ranges and confidence limits are described in detail by Clopper, Brown, and Agresti for two-sided symmetric confidence intervals.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Description of the LASSO Data Bundles Product

The U. S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility began a pilot project in May 2015 to design a routine, high-resolution modeling capability to complement ARM’s extensive suite of measurements. This modeling capability has evolved into the Large-Eddy Simulation (LES) ARM Symbiotic Simulation and Observation (LASSO) datastream. The datastream, broadly termed data bundles, contains high-resolution model output, input files, observations for evaluation, and skill scores for the simulations. The initial focus of LASSO is on shallow convection at the ARM Southern Great Plains (SGP) atmospheric observatory. The availability of LES simulations with concurrent observations serves many purposes. LES helps bridge the scale gap between DOE ARM observations and models, and the use of routine LES adds value to observations. It provides a self-consistent representation of the atmosphere and a dynamical context for the observations. Further, it elucidates unobservable processes and properties. LASSO generates a simulation library for researchers that enables statistical approaches beyond a single-case mentality. It also provides tools necessary for modelers to reproduce the LES and conduct their own sensitivity experiments. The LASSO library of data bundles is designed to facilitate a wide range of research. For an observationalist, LASSO can help inform instrument remote-sensing retrievals, conduct observation system simulation experiments (OSSEs), and test implications of radar scan strategies or flight paths. For a theoretician, LASSO can help calculate estimates of fluxes and co-variability of values, and test relationships without having to run the model personally. For a modeler, LASSO can help one know ahead of time which days have good forcing, have co-registered observations at high-resolution scales, and have simulation inputs and corresponding outputs to test parameterizations. Further details on the overall LASSO project are available at https://www.arm.gov/capabilities/modeling/lasso.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1975

Reliability approach to rotating-component design

A probabilistic methodology for designing rotating mechanical components using reliability to relate stress to strength is explained. The experimental test machines and data obtained for steel to verify this methodology are described. A sample mechanical rotating component design problem is solved by comparing a deterministic design method with the new design-by reliability approach. The new method shows that a smaller size and weight can be obtained for specified rotating shaft life and reliability, and uses the statistical distortion-energy theory with statistical fatigue diagrams for optimum shaft design. Statistical methods are presented for (1) determining strength distributions for steel experimentally, (2) determining a failure theory for stress variations in a rotating shaft subjected to reversed bending and steady torque, and (3) relating strength to stress by reliability.

Kececioglu, D. B.↗
NASA NTRS1982

Quantiles, parametric-select density estimation, and bi-information parameter estimators

A quantile-based approach to statistical analysis and probability modeling of data is presented which formulates statistical inference problems as functional inference problems in which the parameters to be estimated are density functions. Density estimators can be non-parametric (computed independently of model identified) or parametric-select (approximated by finite parametric models that can provide standard models whose fit can be tested). Exponential models and autoregressive models are approximating densities which can be justified as maximum entropy for respectively the entropy of a probability density and the entropy of a quantile density. Applications of these ideas are outlined to the problems of modeling: (1) univariate data; (2) bivariate data and tests for independence; and (3) two samples and likelihood ratios. It is proposed that bi-information estimation of a density function can be developed by analogy to the problem of identification of regression models.

Parzen, E.↗
DOE OSTI2017

Behavior-based approach to misuse detection of a simulated SCADA system - 339

This paper presents the initial findings in applying a behavior-based approach for detection of unauthorized activities in a simulated Supervisory Control and Data Acquisition (SCADA) system. Misuse detection of this type utilizes fault-free system telemetry to develop empirical models that learn normal system behavior. Future monitored telemetry sources that show statistically significant deviations from this learned behavior may indicate an attack or other unwanted actions. The experimental test bed consists of a set of Linux based enterprise servers that were isolated from a larger university research cluster. All servers are connected to a private network and simulate several components and tasks seen in a typical SCADA system. Telemetry sources included kernel statistics, resource usages and internal system hardware measurements. For this study, the Auto Associative Kernel Regression (AAKR) and Auto Associative Multivariate State Estimation Technique (AAMSET) are employed to develop empirical models. Prognostic efficacy of these methods for computer security used several groups of signals taken from available telemetry classes. The Sequential Probability Ratio Test (SPRT) is used along with these models for intrusion detection purposes. The different intrusion types shown include host/network discovery, DoS, brute force login, privilege escalation and malicious exfiltration actions. For this study, all intrusion types tested displayed alterations in the residuals of much of the monitored telemetry and were able to be detected in all signal groups used by both model types. The methods presented can be extended and implemented to industries besides nuclear that use SCADA or business-critical networks. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1975

The application of satellite data in the determination of ocean temperatures and cloud characteristics and statistics

The author has identified the following significant results. The major shortcoming of the data was the loss of the infrared radiances from the S191 spectrometer. The cloud thermodynamic phase determination procedure was derived and tested with the data collected by the S192 multispectral scanner. Results of the test indicate a large fraction of the data could be classified thermodynamically. An added bonus was the inclusion of snow in the classification approach. The conclusion to be drawn from this portion of the effort is that in most cases considered ice clouds, liquid water droplet clouds, and snow fields can be spectroscopically separated to a high degree of accuracy.

Curran, R. J.↗
DOE OSTI2019

Debiasing cosmic gravitational wave sirens

ABSTRACT Accurate estimation of the Hubble constant, and other cosmological parameters, from distances measured by cosmic gravitational wave sirens requires sufficient allowance for the dark energy evolution. We demonstrate how model-independent statistical methods, specifically Gaussian process regression, can remove bias in the reconstruction of H(z), and can be combined to model independently with supernova distances. This allows stringent tests of both H0 and Λ cold dark matter, and can detect unrecognized systematics. We also quantify the redshift systematic control necessary for the use of dark sirens, showing that it must approach spectroscopic precision to avoid significant bias.

Keeley, Ryan E.↗
DOE OSTI2015

Modeling the Dispersibility of Single Walled Carbon Nanotubes in Organic Solvents by Quantitative Structure-Activity Relationship Approach

Here, the knowledge of physico-chemical properties of carbon nanotubes, including behavior in organic solvents is very important for design, manufacturing and utilizing of their counterparts with improved properties. In the present study a quantitative structure-activity/property relationship (QSAR/QSPR) approach was applied to predict the dispersibility of single walled carbon nanotubes (SWNTs) in various organic solvents. A number of additive descriptors and quantum-chemical descriptors were calculated and utilized to build QSAR models. The best predictability is shown by a 4-variable model. The model showed statistically good results ( R 2 training = 0.797, Q 2 = 0.665, R 2 test = 0.807), with high internal and external correlation coefficients. Presence of the X0Av descriptor and its negative term suggest that small size solvents have better SWCNTs solubility. Mass weighted descriptor ATS6m also indicates that heavier solvents (and small in size) most probably are better solvents for SWCNTs. The presence of the Dipole Z descriptor indicates that higher polarizability of the solvent molecule increases the solubility. In conclusion, the developed model and contributed descriptors can help to understand the mechanism of the dispersion process and predictorganic solvents that improve the dispersibility of SWNTs.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
NASA NTRS1978

Filtration effects on ball bearing life and condition in a contaminated lubricant

Ball bearings were fatigue tested with a noncontaminated lubricant and with a contaminated lubricant under four levels of filtration. The test filters had absolute particle removal ratings of 3, 30, 49, and 105 microns. Aircraft turbine engine contaminants were injected into the filter's supply line at a constant rate of 125 milligrams per bearing hour. Bearing life and running track condition generally improved with finer filtration. The experimental lives of 3 and 30 micron filter bearings were statistically equivalent, approaching those obtained with the noncontaminated lubricant bearings. Compared to these bearings, the lives of the 49 micron bearings were statistically lower. The 105 micron bearings experienced gross wear. The degree of surface distress, weight loss, and probable failure mode were dependent on filtration level, with finer filtration being clearly beneficial.

Loewenthal, S. H.↗
NASA NTRS1978

Filtration effects on ball bearing life and condition in a contaminated lubricant

Ball bearings were fatigue tested with a noncontaminated MIL-L-23699 lubricant and with a contaminated MIL-L-23699 lubricant under four levels of filtration. The test filters had absolute particle removal ratings of 3, 30, 49, and 105 microns. Aircraft turbine engine contaminants were injected into the filter's supply line at a constant rate of 125 milligrams per bearing hour. Bearing life and running track condition generally improved with finer filtration. The experimental lives of 3- and 30-micron filter bearings were statistically equivalent, approaching those obtained with the noncontaminated lubricant bearings. Compared to these bearings, the lives of the 49-micron bearings were statistically lower. The 105-micron bearings experienced gross wear. The degree of surface distress, weight loss, and probable failure mode were dependent on filtration level, with finer filtration being clearly beneficial.

Loewenthal, S. H.↗