Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “testing statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60

Calibration improvements to electronically scanned pressure systems and preliminary statistical assessment

Orifice-to-orifice inconsistencies in data acquired with an electronically-scanned pressure system at the beginning of a wind tunnel experiment forced modifications to the standard, instrument calibration procedures. These modifications included a large increase in the number of calibration points which would allow a critical examination of the calibration curve-fit process, and a subsequent post-test reduction of the pressure data. Evaluation of these data has resulted in an improved functional representation of the pressure-voltage signature for electronically-scanned pressures sensors, which can reduce the errors due to calibration curve fit to under 0.10 percent of reading compared to the manufacturer specified 0.10 percent of full scale. Application of the improved calibration function allows a more rational selection of the calibration set-point pressures. These pressures should be adjusted to achieve a voltage output which matches the physical shape of the pressure-voltage signature of the sensor. This process is conducted in lieu of the more traditional approach where a calibration pressure is specified and the resulting sensor voltage is recorded. The fifteen calibrations acquired over the two-week duration of the wind tunnel test were further used to perform a preliminary, statistical assessment of the variation in the calibration process. The results allowed the estimation of the bias uncertainty for a single instrument calibration; and, they form the precursor for more extensive and more controlled studies in the laboratory.

Everhart, Joel L.↗

Upper-Stratospheric Ozone Trends 1979-1998

Extensive analyses of ozone observations between 1978 and 1998 measured by Dobson Umkehr, Stratospheric Aerosol and Gas Experiment (SAGE) I and II, and Solar Backscattered Ultraviolet (SBUV) and (SBUV)/2 indicate continued significant ozone decline throughout the extratropical upper stratosphere from 30-45 km altitude. The maximum annual linear decline of -0.8 +/- 0.2 %/yr(2sigma) occurs at 40 km and is well described in terms of a linear decline modulated by the 11-year solar variation. The minimum decline of -0.110.1% yr-1(2o) occurs at 25 km in midlatitudes, with remarkable symmetry between the Northern and Southern Hemispheres at 40 km altitude. Midlatitude upper-stratospheric zonal trends exhibit significant seasonal variation (+/- 30% in the Northern Hemisphere, +/- 40% in the Southern Hemisphere) with the most negative trends of -1.2%/yr occurring in the winter. Significant seasonal trends of -0.7 to -0.9%/yr occur at 40 km in the tropics between April and September. Subjecting the statistical models used to calculate the ozone trends to intercomparison tests on a variety of common data sets yields results that indicate the standard deviation between trends estimated by 10 different statistical models is less than 0.1%/yr in the annual-mean trend for SAGE data and less than 0.2%/yr in the most demanding conditions (seasons with irregular, sparse data) [World Meteorological Organization (WMO), 1998]. These consistent trend results between statistical models together with extensive consistency between the independent measurement-system trend observations by Dobson Umkehr, SAGE I and II, and SBUV and SBUV/2 provide a high degree of confidence in the accuracy of the declining ozone amounts reported here. Additional details of ozone trend results from 1978 to 1996 (2 years shorter than reported here) along with lower-stratospheric and tropospheric ozone trends, extensive intercomparisons to assess relative instrument drifts, and retrieval algorithm details are given by WMO [1998].

Newchurch, M. J.↗

Thermal shock resistance of additively manufactured alumina

The mechanical behavior and cracking patterns of thermally-shocked additively manufactured alumina were investigated. The flexural strength of test specimens that had been heated to temperatures ranging from 200°C to 1000°C and then rapidly quenched in water was determined at ambient temperature by four-point bending. Results indicated that the surface cracking patterns had a multifractal structure and that an increase in the thermal shock temperature led to an increase in the density and uniformity of the crack network. Further, the flexural strength results were analyzed with Weibull statistics, where the Weibull moduli for most of the thermal shock conditions tested were found to be statistically indistinguishable. It was also found that a significant decrease (~50%) in flexural strength occurred for heating temperatures ≥300°C. The effect of the manufacturing method on cracking patterns is discussed, as well as the implication of the material behavior for practical applications of these materials.

36 MATERIALS SCIENCE↗

An approach to estimate the areal rain-rate distribution from spaceborne radar by the use of multiple thresholds

Estimates of rain rate derived from a spaceborne weather radar will be most reliable over an intermediate range of values. In forming an area average of the rain rate, an alternative to the averaging of the high-resolution estimates, irrespective of their individual accuracies, is a multiple threshold approach. The method is based on the fact that the fractional area above a particular rain-rate threshold R(j) is related to the cumulative distribution of rain rates evaluated at R(j). Varying the threshold over the effective dynamic range of the radar yields the cumulative distribution function over this range. To obtain the distribution at all rain rates, a lognormal or gamma test function is selected such that the mean-square error between the test function and the measured values is minimized. Once the unknown parameters are determined, the first-order statistics of the areawide rain-rate distribution can be found. Tests of the method with data from the SPANDAR radar provide comparisons between it and the single threshold and the direct averaging approaches.

Meneghini, R.↗

Statistical Wind-Tunnel Experimentation Advancements for eVTOL Aircraft Aero-Propulsive Model Development

Compared to many conventional aircraft, electric vertical takeoff and landing (eVTOL) vehicle designs present greater aero-propulsive complexity and many interacting factors requiring development of novel testing and model development strategies. This paper describes several advances in statistically-rigorous experiment design methods for wind-tunnel testing of eVTOL aircraft enabling accurate aero-propulsive model development. The techniques are applied to a subscale tilt-rotor eVTOL aircraft configuration built at NASA Langley Research Center that has 24 independent control effectors. The general testing approach, leveraging design of experiments and response surface methodology, is outlined and followed by a detailed description of the experiment design and modeling approach employed for different phases of the wind-tunnel testing. A new approach for gravitational tare modeling is developed and validated, which reduces the required wind-tunnel test time by nearly 50%. A mostly automated trim envelope determination approach is formulated to rapidly determine the aircraft flight envelope to inform transition testing for aero-propulsive model development. Efficient powered-airframe characterization tests are conducted using a nested I-optimal design approach formulated in previous simulation-based testing. The collective wind-tunnel testing approach facilitates rapid characterization of eVTOL aircraft configurations and produces accurate aero-propulsive models that can be used in flight dynamics simulations.

design of experiments↗

Roles of Engineering Correlations in Hypersonic Entry Boundary Layer Transition Prediction

Efforts to design and operate hypersonic entry vehicles are constrained by many considerations that involve all aspects of an entry vehicle system. One of the more significant physical phenomenon that affect entry trajectory and thermal protection system design is the occurrence of boundary layer transition from a laminar to turbulent state. During the Space Shuttle Return To Flight activity following the loss of Columbia and her crew of seven, NASA's entry aerothermodynamics community implemented an engineering correlation based framework for the prediction of boundary layer transition on the Orbiter. The methodology for this implementation relies upon similar correlation techniques that have been is use for several decades. What makes the Orbiter boundary layer transition correlation implementation unique is that a statistically significant data set was acquired in multiple ground test facilities, flight data exists to assist in establishing a better correlation and the framework was founded upon state of the art chemical nonequilibrium Navier Stokes flow field simulations. Recent entry flight testing performed with the Orbiter Discovery now provides a means to validate this engineering correlation approach to higher confidence. These results only serve to reinforce the essential role that engineering correlations currently exercise in the design and operation of entry vehicles. The framework of information related to the Orbiter empirical boundary layer transition prediction capability will be utilized to establish a fresh perspective on this role, and to discuss the characteristics which are desirable in a next generation advancement. The details of the paper will review the experimental facilities and techniques that were utilized to perform the implementation of the Orbiter RTF BLT Vsn 2 prediction capability. Statistically significant results for multiple engineering correlations from a ground testing campaign will be reviewed in order to describe why only certain correlations were selected for complete implementation to support the Shuttle Program. Historical Orbiter flight data on early boundary layer transition due to protruding gap fillers will be described in relation to the selected empirical correlations. In addition, Orbiter entry flight testing results from the BLT Flight Experiment will be discussed in relation to these correlations. Applicability of such correlations to the entry design problem will be reviewed, and finally a perspective on the desirable characteristics for a next generation capability based on high fidelity physical models will be provided.

Campbell, Charles H.↗

A Method for Validating Causal Diagrams of Human Health Risk in Space Flight

The complexity of cause-and-effect relationships between spaceflight hazards and resulting health conditions clouds understanding of the totality of human system risk in space. In response, NASA has introduced Directed Acyclic Graphs (causal diagrams) into the human systems risk management process. These diagrams allow for a common understanding of the mechanisms that lead from unique hazards of spaceflight to the health outcomes important to agencies and astronauts. However, the paucity of available biomedical data from spaceflight creates a need for methods of validating causal models that can accommodate data from spaceflight model analogs. Here we outline one approach utilizing open-access rodent bone datasets from the Ames Life Sciences Data Archive. The properties of directed acyclic graphs themselves can provide an epistemological and statistical framework for validation of a priori causal representations of human system risk in space flight. The assumed causal connections on the graph creates sets of logical implications: variables that – if the causal diagram is correct – should be correlated, as well as sets that should be conditionally independent. By testing these implied correlations and conditional independencies both statistically and heuristically, we can provide evidence for or against specific causal pathways on the causal diagram. In addition to validation of expert-generated causal diagrams, machine learning techniques can learn the most likely structure of a causal diagram from a given dataset. Comparison with and reconciliation between machine-learned causal diagrams and expert-generated diagrams is another technique for challenging assumptions and improving our understanding of causal mechanisms. Accurately representing complex causation is essential to systemic understanding of human health risks in space travel. Having a robust system of validating causal diagrams helps us arrive at more accurate representations of causal systems. This process will be integral to developing the countermeasures necessary for extended exploration of the moon and Mars.

Robert Reynolds↗

VADER: A Tool for Criticality Safety Validation

The purpose of criticality safety is to prevent any inadvertent criticality from occurring during the handling or storage of fissile material. Calculations are frequently used to demonstrate that a sufficient subcritical margin exists. Validation is a key aspect of the evaluation process, establishing the suitability, accuracy, and associated uncertainty of the computational method and data to be used for the intended application. The validation process is performed by comparing the results of critical experiments with the calculated results from models of the experiments using the computational method to be validated. Laboratory critical experiments are controlled systems that achieve a k eff of approximately 1 in order to investigate the parameters at which such a critical condition is achieved. The validation parameters that are traditionally applied to safety analysis calculations are the bias and the bias uncertainty . The bias is the deviation of the average k eff of the validation suite from unity. The bias uncertainty accounts for the statistical uncertainty in the bias based on the standard deviation, sample size, and distribution of k eff values of the validation suite. The values of bias and bias uncertainty ensure that the systems predicted to be subcritical by the computational method will indeed be subcritical. The bias and bias uncertainty are often combined to determine an upper subcritical limit (USL) or computational margin that can then be applied to safety analysis calculations. Many methods have been developed by different organizations to calculate the bias and bias uncertainty for various types of criticality analyses. Each of these methods typically requires that the validity of various underpinning statistical assumptions be confirmed to demonstrate that the method is appropriate for the analysis of a given validation suite. An example of the validation decision making flow is shown in Fig.1. As shown in Fig. 1, the analyst performing the validation fits a trend line to the data and performs a test to determine if the trend was a statistically better representation of the data than if it were treated as an uncorrelated sample. If the trend line is a better representation of the data, then the analyst uses any one of a number of trending techniques to determine the bias and bias uncertainty. If a trend is not an appropriate representation of the data, then the analyst proceeds to perform a normality assessment for the data. If the normal assumption can be shown to be acceptable, then the analyst calculates the bias and bias uncertainty with the parametric technique. If the assumption of normality cannot be justified, then the nonparametric technique is used. Once the decision flow has been followed and the appropriate technique has been selected, the bias and bias uncertainty is typically combined with an administrative margin to determine a USL below which calculated values of k eff for safety analysis models can be considered subcritical. The calculations used in each decision are often performed with spreadsheets or with small programs available at various sites performing criticality analyses. Expertise in understanding and interpreting the results must be maintained to perform these calculations. This can often be an error-prone process. Oak Ridge National Laboratory (ORNL) is currently developing the Validation and Data Evaluation Resource (VADER) to simplify and automate the criticality safety validation process and to provide a software quality assurance pedigree to the calculational methods used. This paper discusses the use of the Fulcrum user interface with VADER, the anticipated initial capabilities of VADER to perform validation analyses, and the output from the code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Load sequence effects on graphite/epoxy /+, -35/2s laminates

Load sequence effects on composite material fatigue behavior are due to the difference in residual strength when fatigue occurs, or the 'boundary effect', and the 'material money effect' due to previous loads. The present model, which allows the isolation of the effects of memory from those of boundary, has been investigated through a test program for the case of /+, -35/2s graphite/epoxy laminates under high-low and low-high load sequences which generated statistical residual strength data. As predicted by the model, the memory effect is present and a good correlation is obtained between test results and the theoretical predictions for both median residual strength and the expected percentage of fatigue failures under dual loading. It is noted, however, that the statistical dispersion of the residual strength test results is much smaller than that of the static ultimate strength.

Yang, J. N.↗

Bayes Analysis and Reliability Implications of Stress-Rupture Testing a Kevlar/Epoxy COPV using Temperature and Pressure Acceleration

Composite Overwrapped Pressure Vessel (COPVs) that have survived a long service time under pressure generally must be recertified before service is extended. Sometimes lifetime testing is performed on an actual COPV in service in an effort to validate the reliability model that is the basis for certifying the continued flight worthiness of its sisters. Currently, testing of such a Kevlar49(registered TradeMark)/epoxy COPV is nearing completion. The present paper focuses on a Bayesian statistical approach to analyze the possible failure time results of this test and to assess the implications in choosing between possible model parameter values that in the past have had significant uncertainty. The key uncertain parameters in this case are the actual fiber stress ratio at operating pressure, and the Weibull shape parameter for lifetime; the former has been uncertain due to ambiguities in interpreting the original and a duplicate burst test. The latter has been uncertain due to major differences between COPVs in the data base and the actual COPVs in service. Any information obtained that clarifies and eliminates uncertainty in these parameters will have a major effect on the predicted reliability of the service COPVs going forward. The key result is that the longer the vessel survives, the more likely the more optimistic stress ratio is correct. At the time of writing, the resulting effect on predicted future reliability is dramatic, increasing it by about one nine , that is, reducing the probability of failure by an order of magnitude. However, testing one vessel does not change the uncertainty on the Weibull shape parameter for lifetime since testing several would be necessary.

Phoenix, S. Leigh↗

Response Variability in Commercial MOSFET SEE Qualification

Single-event effects (SEE) evaluation of five different part types of next generation, commercial trench MOSFETs indicates large part-to-part variation in determining a safe operating area (SOA) for drain-source voltage (V DS ) following a test campaign that exposed >50 samples per part type to heavy ions. These results suggest a determination of a SOA using small sample sizes may fail to capture the full extent of the part-to-part variability. An example method is discussed for establishing a Safe Operating Area using a one-sided statistical tolerance limit based on the number of test samples. Finally, burn-in is shown to be a critical factor in reducing part-to-part variation in part response. Implications for radiation qualification requirements are also explored.

43 PARTICLE ACCELERATORS↗

Learning likelihood ratios with neural network classifiers

The likelihood ratio is a crucial quantity for statistical inference in science that enables hypothesis testing, construction of confidence intervals, reweighting of distributions, and more. Many modern scientific applications, however, make use of data- or simulation-driven models for which computing the likelihood ratio can be very difficult or even impossible. By applying the so-called “likelihood ratio trick,” approximations of the likelihood ratio may be computed using clever parametrizations of neural network-based classifiers. A number of different neural network setups can be defined to satisfy this procedure, each with varying performance in approximating the likelihood ratio when using finite training data. We present a series of empirical studies detailing the performance of several common loss functionals and parametrizations of the classifier output in approximating the likelihood ratio of two univariate and multivariate Gaussian distributions as well as simulated high-energy particle physics datasets.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Characteristics of a New X-Ray Imaging System for Interventional Procedures: Improved Image Quality and Reduced Radiation Dose

PurposeTo compare image quality and radiation exposure between a new angiographic imaging system and the preceding generation system during uterine artery embolization (UAE).Materials and MethodsIn this retrospective, IRB-approved two-arm study, 54 patients with symptomatic uterine fibroids were treated with UAE on two different angiographic imaging systems. The new system includes optimized acquisition parameters and real-time image processing algorithms. Air kerma (AK), dose area product (DAP) and acquisition time for digital fluoroscopy (DF) and digital subtraction angiography (DSA) were recorded. Body mass index was noted as well. DF image quality was assessed objectively by image noise measurements. DSA image quality was rated by two blinded, independent readers on a four-rank scale. Statistical differences were assessed with unpaired t tests and Wilcoxon rank-sum tests.ResultsThere was no significant difference between the patients treated on the new (n = 36) and the old system (n = 18) regarding age (p = 0.10), BMI (p = 0.18), DF time (p = 0.35) and DSA time (p = 0.17). The new system significantly reduced the cumulative AK and DAP by 64 and 72%, respectively (median 0.58 Gy and 145.9 Gy*cm{sup 2} vs. 1.62 Gy and 526.8 Gy*cm{sup 2}, p < 0.01 for both). Specifically, DAP for DF and DSA decreased by 59% (75.3 vs. 181.9 Gy*cm{sup 2}, p < 0.01) and 78% (67.6 vs. 312.2 Gy*cm{sup 2}, p < 0.01), respectively. The new system achieved a significant decrease in DF image noise (p < 0.01) and a significantly better DSA image quality (p < 0.01).ConclusionsThe new angiographic imaging system significantly improved image quality and reduced radiation exposure during UAE procedures.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Deep Learning for Subgrid‐Scale Turbulence Modeling in Large‐Eddy Simulations of the Convective Atmospheric Boundary Layer

Abstract In large‐eddy simulations, subgrid‐scale (SGS) processes are parameterized as a function of filtered grid‐scale variables. First‐order, algebraic SGS models are based on the eddy‐viscosity assumption, which does not always hold for turbulence. Here we apply supervised deep neural networks (DNNs) to learn SGS stresses from a set of neighboring coarse‐grained velocity from direct numerical simulations of the convective boundary layer at friction Reynolds numbers Re τ up to 1243 without invoking the eddy‐viscosity assumption. The DNN model was found to produce higher correlation between SGS stresses compared to the Smagorinsky model and the Smagorinsky‐Bardina mixed model in the surface and mixed layers and can be applied to different grid resolutions and various stability conditions ranging from near neutral to very unstable. The DNN model can capture key statistics of turbulence in a posteriori (online) tests when applied to large‐eddy simulations of the atmospheric boundary layer.

54 ENVIRONMENTAL SCIENCES↗

Comparing generalized ensemble methods for sampling of systems with many degrees of freedom

Here, we compare two standard replica exchange methods using temperature and dielectric constant as the scaling variables for independent replicas against two new corresponding enhanced sampling methods based on non-equilibrium statistical cooling (temperature) or descreening (dielectric). We test the four methods on a rough 1D potential as well as for alanine dipeptide in water, for which their relatively small phase space allows for the ability to define quantitative convergence metrics. We show that both dielectric methods are inferior to the temperature enhanced sampling methods, and in turn show that temperature cool walking (TCW) systematically outperforms the standard temperature replica exchange (TREx) method. We extend our comparisons of the TCW and TREx methods to the 5 residue met-enkephalin peptide, in which we evaluate the Kullback-Leibler divergence metric to show that the rate of convergence between two independent trajectories is faster for TCW compared to TREx. Finally we apply the temperature methods to the 42 residue amyloid-β peptide in which we find non-negligible differences in the disordered ensemble using TCW compared to the standard TREx. All four methods have been made available as software through the OpenMM Omnia software consortium.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The impact of anisotropic redshift distributions on angular clustering

A leading way to constrain physical theories from cosmological observations is to test their predictions for the angular clustering statistics of matter tracers, a technique that is set to become ever more central with the next generation of large imaging surveys. Interpretation of this clustering requires knowledge of the projection kernel, or the redshift distribution of the sources, and the typical assumption is an isotropic redshift distribution for the objects. However, variations in the kernel are expected across the survey footprint due to photometric variations and residual observational systematic effects. Here, we develop the formalism for anisotropic projection and present several limiting cases that elucidate the key aspects. We quantify the impact of anisotropies in the redshift distribution on a general class of angular two-point statistics. In particular, we identify a mode-coupling effect that can add power to auto-correlations, including galaxy clustering and cosmic shear, and remove it from certain cross-correlations. If the projection anisotropy is primarily at large scales, the mode-coupling depends upon its variance as a function of redshift; furthermore, it is often of similar shape to the signal. In contrast, the cross-correlation of a field whose selection function is anisotropic with another one featuring no such variations — such as CMB lensing — is immune to these effects. We discuss explicitly several special cases of the general formalism including galaxy clustering, galaxy-galaxy lensing, cosmic shear and cross-correlations with CMB lensing, and publicly release a code to compute the biases.

79 ASTRONOMY AND ASTROPHYSICS↗

Probing neutrino emission at GeV energies from compact binary mergers with the IceCube Neutrino Observatory

The advent of multimessenger astronomy has allowed for new types of source searches by neutrino detectors. Here, we present the results of the search for 0.5–100 GeV astrophysical neutrinos detected with IceCube and emitted from compact binary mergers detected by the LIGO, Virgo, and KAGRA interferometers from their first run of observation (O1) to the end of the first part of the fourth (O4a). An innovative approach is used to lower the energy threshold to 0.5 GeV and to search for an excess of GeV neutrinos in time coincidence with astrophysical transient events. Furthermore, we use a statistical combination of all observations, a binomial test, to search for a subpopulation of neutrino emitters. No significant excess was found from the studied mergers, with a best post-trial 𝑝-value of 40%, and there is currently no hint of a population of GeV neutrino emitters found in the IceCube data (post-trial 𝑝−value=81%).

Abbasi, R. [Loyola University Chicago]↗

At-wavelength characterization of X-ray wavefronts in Bragg diffraction from crystals

The advent of next-generation synchrotron radiation sources and X-ray free-electron lasers calls for high-quality Bragg-diffraction crystal optics to preserve the X-ray beam coherence and wavefront. This requirement brings new challenges in characterizing crystals in Bragg diffraction in terms of Bragg-plane height errors and wavefront phase distortions. Here, a quantitative methodology to characterize crystal optics using a state-of-the-art at-wavelength wavefront sensing technique and statistical analysis is proposed. The method was tested at the 1-BM-B optics testing beamline at the Advanced Photon Source for measuring silicon and diamond crystals in a self-referencing single-crystal mode and an absolute double-crystal mode. The phase error sensitivity of the technique is demonstrated to be at the λ/100 level required by most applications, such as the characterization of diamond crystals for cavity-based X-ray free-electron lasers.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗