Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical Testing Approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Statistics for Testing Under Adverse Conditions

Here we develop a statistical basis for limited adverse testing. This type of testing simultaneously evaluates system performances against minimum requirements and minimizes costs, particularly for large scale engineering projects. Because testing is often expensive and narrow in scope, the data obtained is relatively limited—precisely the opposite of the recent “large data” movement but no less compelling. Although a remarkably common approach for industrial and large-scale government projects, a statistical basis for adverse testing remains poorly explored. Here we prove mathematically, under specific conditions, that setting each independent variable to an adverse condition leads to a similar level of adversity in the dependent variable. For example, setting all normally distributed independent variables to at least their 95th percentile values leads to a result at the 95th percentile. The analysis considers sample size estimates to clarify the value of replicates in this type of testing, determines how many of the independent variables must be set to adverse condition values, and highlights the essential assumptions, so that engineers, statisticians, and subject matter experts know when this statistical framework may be applied successfully.

42 ENGINEERING↗
DOE OSTI2016

Statistical Sampling Plan for AGR-5/6/7 Fuel Materials

Kernels, coated particles, and compacts will be manufactured to predefined specifications for irradiation in the AGR 5/6/7 experiments. Many tests will be performed for quality assurance and most of these tests correspond to criteria that have to be met with 95% confidence, based on random samples. This report describes the statistical acceptance testing methods and gives minimum sample sizes for kernels to achieve 95% confidence. Coated particles and compacts will be addressed in revisions to this report. The methods used for sample size determination are described in detail in INL/EXT 05 00349, Statistical Methods Handbook for Advanced Gas Reactor Fuel Materials (Einerson 2005). The statistical approach is to collect a representative sample, apply an acceptance test to the sample, and accept or reject the product based on this test for each criterion. The criteria or “product specifications” are contained in SPC-1352, “AGR 5/6/7 Fuel Specification,” Revision 1 and are duplicated in this plan.

+↗
NASA NTRS1981

Lessons from NASA

Particular requirements related to the design and the operation of spacecraft have forced NASA to take a reliability approach that differs somewhat from that used in many other applications. NASA has found that some of the traditional tools of reliability engineering, such as life testing, reliability demonstration testing, maintainability analysis, and direct failure analysis, are impractical for spacecraft. In place of a statistical approach, the space agency uses an engineering approach to mission reliability. Reliability is to be obtained with the aid of three different approaches, including the application of effective design principles, the control and screening of all parts, and the testing of the entire spacecraft or its prototype for predicted capabilities. Attention is given to failure-mode analysis, the enhancement of Voyager reliability by autonomous operation, the redundancy in Shuttle design, the weeding out of bad hardware, and the preference for off-the-shelf devices.

Williams, W. C.↗
NASA NTRS2006

Validating Coherence Measurements Using Aligned and Unaligned Coherence Functions

This paper describes a novel approach based on the use of coherence functions and statistical theory for sensor validation in a harsh environment. By the use of aligned and unaligned coherence functions and statistical theory one can test for sensor degradation, total sensor failure or changes in the signal. This advanced diagnostic approach and the novel data processing methodology discussed provides a single number that conveys this information. This number as calculated with standard statistical procedures for comparing the means of two distributions is compared with results obtained using Yuen's robust statistical method to create confidence intervals. Examination of experimental data from Kulite pressure transducers mounted in a Pratt & Whitney PW4098 combustor using spectrum analysis methods on aligned and unaligned time histories has verified the effectiveness of the proposed method. All the procedures produce good results which demonstrates how robust the technique is.

Miles, Jeffrey Hilton↗
DOE OSTI2022

Probing the role of solids loading and mix procedure on the properties of acoustically mixed materials for additive manufacturing

We report resonant acoustic mixing has been of particular interest for use in additive manufacturing since viscous, solids-loaded materials can be difficult to mix and inhomogeneity has adverse effects on print quality. In this study, we detail a method to iterate through different formulations and mix procedures and assess mixture quality. The approach utilizes a constant pressure-driven flow test to collect statistics on flow rate through a standard geometry. This test is first applied to well mixed formulations containing particulate solids and find that the results are sensitive to viscosity produced by solids content. We then consider the formulations at various stages of mixing and find that the spread in the volume measurements is indicative of the mixing quality; poorly mixed material yields measurements with wide distributions. We believe this testing approach can be useful when screening new formulations, developing mixing processes, or for quality control.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Criticality analysis of nuclear binding energy neural networks

Machine learning methods, in particular deep learning methods such as artificial neural networks (ANNs) with many layers, have become widespread and useful tools in nuclear physics. However, these ANNs are typically treated as ‘black boxes’, with their architecture (width, depth, and weight/bias initialization) and the training algorithm and parameters chosen empirically by optimizing learning based on limited exploration. We test a non-empirical approach to understanding and optimizing nuclear physics ANNs by adapting a criticality analysis based on renormalization group flows in terms of the hyperparameters for weight/bias initialization, training rates, and the ratio of depth to width. This treatment utilizes the statistical properties of neural network initialization to find a generating functional for network outputs at any layer, allowing for a path integral formulation of the ANN outputs as a Euclidean statistical field theory. We use a prototypical example to test the applicability of this approach: a simple ANN for nuclear binding energies. We find that with training using a stochastic gradient descent optimizer, the predicted criticality behavior is realized, and optimal performance is found with critical tuning. However, the use of an adaptive learning algorithm leads to somewhat superior results without concern for tuning and thus obscures the analysis. Nevertheless, the criticality analysis offers a way to look within the black box of ANNs, which is a first step towards potential improvements in network performance beyond using adaptive optimizers.

artificial neural network↗
DOE OSTI2021

Proteomic Profiling of the Substantia Nigra to Identify Determinants of Lewy Body Pathology and Dopaminergic Neuronal Loss

Proteinaceous aggregates containing ?-synuclein protein called Lewy bodies in the substantia nigra is a hallmark of Parkinson’s disease. The molecular mechanisms of Lewy body formation and associated neuronal loss remain largely unknown. To gain insights on proteins and pathways associated with Lewy body pathology, we performed quantitative profiling of the proteome. We analyzed substantia nigra tissue from 51 subjects arranged into three groups: cases with Lewy body pathology, Lewy body-negative controls with matching neuronal loss and controls with no neuronal loss. Using label-free LC-MS/MS approach we quantified the 2,963 most abundant proteins. Statistical testing for differential protein abundance, followed by pathway enrichment and Bayesian learning of the causal network structure were performed to identify likely drivers of Lewy body formation and dopaminergic neuronal loss. The identified pathways include (1) Arp2/3 complex-mediated actin nucleation; (2) synaptic function; (3) poly(A) RNA binding; (4) basement membrane and endothelium; and (5) hydrogen peroxide metabolic process. According to the data, the endothelial/basement membrane pathway is tightly connected with both pathologies and likely to be one of the drivers of the neuronal loss. The poly(A) RNA-binding proteins, including the ones relevant to other neurodegenerative disorders (e.g. TDP-43 and FUS) have strong inverse correlation with Lewy bodies and may reflect alternative mechanism of nigral neurodegeneration.

Petyuk, Vladislav A.↗
NASA NTRS1988

QUEST/Ada (Query Utility Environment for Software Testing) of Ada: The development of a program analysis environment for Ada

A history of the Query Utility Environment for Software Testing (QUEST)/Ada is presented. A fairly comprehensive literature review which is targeted toward issues of Ada testing is given. The definition of the system structure and the high level interfaces are then presented. The design of the three major components is described. The QUEST/Ada IORL System Specifications to this point in time are included in the Appendix. A paper is also included in the appendix which gives statistical evidence of the validity of the test case generation approach which is being integrated into QUEST/Ada.

Brown, David B.↗
NASA NTRSDate not supplied

SLS Integrated Modal Test Uncertainty Quantification using the Hybrid Parametric Variation Method

Uncertainty in structural loading during launch is a significant concern in the development of spacecraft and launch vehicles. Small variations in launch vehicle and payload mode shapes and their interaction can result in significant variation in system loads. In many cases involving large aerospace systems it is difficult, not economical, or impossible to perform a system modal test. However, it is still vital to obtain test results that can be compared with analytical predictions to validate models. Instead, the “Building Block Approach” is used in which system components are tested individually. Component models are correlated and updated to agree as best they can with test results. The Space Launch System consists of a number of components that are assembled into a launch vehicle. Finite element models of the components are developed, reduced to Hurty/Craig-Bampton models and assembled to represent different phases of flight. The only opportunity to obtain modal test data from an assembled Space Launch System will be during the Integrated Modal Test. There is always uncertainty in every model, which flows into uncertainty in predicted system results. Uncertainty Quantification is used to determine statistical bounds on prediction accuracy based on model uncertainty. For the Space Launch System, model uncertainty is at the Hurty/Craig-Bampton component level. Uncertainty in the Hurty/Craig-Bampton components is quantified using the hybrid parametric variation approach that combines parametric and nonparametric uncertainty. Uncertainty in model form is one of the biggest contributors to uncertainty in complex built-up structures. This type of uncertainty cannot be represented by variations infinite element model input parameters and thus cannot be included in a parametric approach. However, model-form uncertainty can be modeled using a nonparametric approach based on random matrix theory. The hybrid parametric variation method requires the selection of dispersion values for the Hurty/Craig-Bampton fixed-interface eigenvalues, and the Hurty/Craig-Bampton stiffness matrices. Component test/analysis frequency error is used to identify the fixed-interface eigenvalue dispersions, while test/analysis cross-orthogonality is used to identify stiffness dispersion values. The hybrid parametric variation uncertainty quantification approach is applied to the Space Launch System Integrated Modal Test configuration. Monte Carlo analysis is performed, and statistics are determined for modal correlation metrics, frequency response from Integrated Modal Test shakers to selected accelerometers, as well as other metrics for determining how well target modes are excited and identified. If the predicted uncertainty envelopes future Integrated Modal Test results, then there will be increased confidence in the utility of the component-based hybrid parametric variation uncertainty quantification approach.

Uncertainty Quantification↗
NASA NTRS2023

Statistical Approach on Utilizing Ground-Based Experiments to Model Break-Up Events

Two laboratory-based impact tests have been conducted to develop and extend the capability of NASA satellite breakup models. The first experiment, the Satellite Orbital Debris Characterization Impact Test (SOCIT), was conducted by the U.S. Department of Defense and NASA in 1992. It employed a fully functional U.S. Navy Transit spacecraft, fabricated from materials commonly used in the 1960s. SOCIT fragmentation data formed the basis of the current NASA Standard Satellite Breakup Model (SSBM). A second experiment, DebriSat, was conducted in 2014 by the DebriSat consortium: the NASA Orbital Debris Program Office, the United States Space Force Space Systems Command, formerly the Air Force Space and Missile Systems Center, the Air Force Arnold Engineering Development Complex, and the University of Florida. This impact test was performed on a high-fidelity mock-up satellite assembled from modern components. Data from both experiments are expected to contribute to the next-generation models for on-orbit breakup analyses, long-term environment predictions, and debris risk assessment. This paper uses the direct statistical sampling of the SOCIT and DebriSat data ensembles to model an on-orbit breakup event, rather than the analytic expressions estimated from the samples in the SSBM and its predecessor. This direct method involves drawing fragments (i.e., sampling with replacement) from each fragmentation data-subset containing mass, shape category, material density, characteristic length, mass, and cross-sectional area. As part of the sampling process, the properties of sampled fragment data (e.g., area-to-mass ratios) are numerically checked to ensure they do not contain unrealistic quantities. The process to simulate a breakup cloud composed of fragments from SOCIT and DebriSat datasets is discussed. The methodology for ensuring that conservation of overall mass of the sampled fragment cloud under this sampling approach is highlighted. Finally, the results are compared with simulated clouds generated from SSBM for specific historical breakup events.

Andrew Vavrin↗
NASA NTRSDate not supplied

Statistical Approach on Utilizing Ground-based Experiments to Model Break-up Events

Two laboratory-based impact tests have been conducted to develop and extend the capability of NASA satellite breakup models. The first experiment, the Satellite Orbital Debris Characterization Impact Test (SOCIT), was conducted by the U.S. Department of Defense and NASA in 1992. It employed a fully functional U.S. Navy Transit spacecraft, fabricated from materials commonly used in the 1960s. SOCIT fragmentation data formed the basis of the current NASA Standard Satellite Breakup Model (SSBM). A second experiment, DebriSat, was conducted in 2014 by the DebriSat consortium: the NASA Orbital Debris Program Office; the United States Space Force Space Systems Command, formerly the Air Force Space and Missile Systems Center, the Air Force Arnold Engineering Development Complex, and the University of Florida. This impact test was performed on a high-fidelity mock-up satellite assembled from modern components. Data from both experiments are expected to contribute to the next-generation models for on-orbit breakup analyses, long-term environment predictions, and debris risk assessment. This paper uses the direct statistical sampling of the SOCIT and DebriSat data ensembles to model an on-orbit breakup event, rather than the analytic expressions estimated from the samples as with as with the NASA SSBM and its predecessor. This direct method involves drawing fragments (i.e., sampling with replacement) from each fragmentation data-subset containing mass, shape category, material density, characteristic length, mass, and cross-sectional area. As part of the sampling process, the properties of sampled fragment data (e.g., area-to-mass ratios) are numerically checked to ensure they do not contain unrealistic quantities. The process to simulate a breakup cloud composed of fragments from SOCIT and DebriSat datasets is discussed. The methodology for ensuring that conservation of overall mass of the sampled fragment cloud under this sampling approach is highlighted. Finally, the results are compared with simulated clouds generated from SSBM for specific historical breakup events.

Andrew Vavrin↗
NASA NTRS2008

A Statistical Filtering Approach for Gravity Recovery and Climate Experiment (GRACE) Gravity Data

We describe and analyze a statistical filtering approach for GRACE data that uses a parametrized model for the temporal evolution of the GRACE coefficients. After least-squares adjustment, a statistical test is performed to assess the significance of the estimated parameters. If the test is passed, the parameters are used by the filter in the reconstruction of the field; otherwise they are rejected. The test is performed, and the filter is formed, separately for annual components of the model and the trend. This new approach is distinct from Gaussian smoothing since it uses the data themselves to test for specific components of the time-varying gravity field. The statistical filter appears inherently to remove most of the "stripes" present in the GRACE fields, although destriping the fields prior to filtering seems to help the trend recovery. We demonstrate that the statistical filter produces reasonable maps for the annual components and trend. We furthermore assess the statistical filter for the annual components using ground-based GPS data in South America by assuming that the annual component of the gravity signal is associated only with groundwater storage. The un-destriped, statistically filtered field has a X2 value relative to the GPS data consistent with the best result from smoothing. In the space domain, the statistical filters are qualitatively similar to Gaussian smoothing. Unlike Gaussian smoothing, however, the statistical filter has significant sidelobes, including large negative sidelobes on the north-south axis, potentially revealing information on the errors, and the correlations among the errors, for the GRACE coefficients.

Davis. J. L.↗
NASA NTRS1997

Determining Functional Reliability of Pyrotechnic Mechanical Devices

This paper describes a new approach for evaluating mechanical performance and predicting the mechanical functional reliability of pyrotechnic devices. Not included are other possible failure modes, such as the initiation of the pyrotechnic energy source. The requirement of hundreds or thousands of consecutive, successful tests on identical components for reliability predictions, using the generally accepted go/no-go statistical approach routinely ignores physics of failure. The approach described in this paper begins with measuring, understanding and controlling mechanical performance variables. Then, the energy required to accomplish the function is compared to that delivered by the pyrotechnic energy source to determine mechanical functional margin. Finally, the data collected in establishing functional margin is analyzed to predict mechanical functional reliability, using small-sample statistics. A careful application of this approach can provide considerable cost improvements and understanding over that of go/no-go statistics. Performance and the effects of variables can be defined, and reliability predictions can be made by evaluating 20 or fewer units. The application of this approach to a pin puller used on a successful NASA mission is provided as an example.

Bement, Laurence J.↗
DOE OSTI2023

A data driven approach for cross-slip modelling in continuum dislocation dynamics

Cross-slip is a thermally activated process by which screw dislocation changes its glide plane to another slip plane sharing the same Burgers vector. The rate at which this process happens is determined by a Boltzmann type expression that is a function of the screw segment length and the stress acting on the dislocation. In continuum dislocation dynamics (CDD), the information regarding the length of the screw dislocation segment and local stress state on dislocations are lost due to the coarse-grained representation of the density. Here, in this work, a data driven approach to characterize the lost information by analyzing the discrete dislocation configurations is proposed to enable cross-slip modeling in the CDD framework in terms of the coarse-grained dislocation density and stress fields. The analysis showed that the screw segment length follows an exponential distribution, and the stress fluctuations, defined as the difference between the stress on the dislocations and the mean field stress in CDD, follows a Lorentzian distribution. A novel approach for cross slip implementation in CDD employing the screw segment length and stress fluctuation statistics was proposed and rigorously tested by comparing the CDD cross-slip rates with discrete dislocation dynamics (DDD) rates. This approach has been applied in conjunction with three cross-slip models used in DDD simulations differing mainly in the functional form of cross slip activation energy. It was found that different cross-slip activation energy formulations yielded different cross-slip rates, yet the effect on mechanical stress-strain response and dislocation density evolution was minimal for the [001] type loading.

42 ENGINEERING↗
DOE OSTI2014

TU-A-17A-02: In Memoriam of Ben Galkin: Virtual Tools for Validation of X-Ray Breast Imaging Systems

This symposium will explore simulation methods for the preclinical evaluation of novel 3D and 4D x-ray breast imaging systems – the subject of AAPM taskgroup TG234. Given the complex design of modern imaging systems, simulations offer significant advantages over long and costly clinical studies in terms of reproducibility, reduced radiation exposures, a known reference standard, and the capability for studying patient and disease subpopulations through appropriate choice of simulation parameters. Our focus will be on testing the realism of software anthropomorphic phantoms and virtual clinical trials tools developed for the optimization and validation of breast imaging systems. The symposium will review the stateof- the-science, as well as the advantages and limitations of various approaches to testing realism of phantoms and simulated breast images. Approaches based upon the visual assessment of synthetic breast images by expert observers will be contrasted with approaches based upon comparing statistical properties between synthetic and clinical images. The role of observer models in the assessment of realism will be considered. Finally, an industry perspective will be presented, summarizing the role and importance of virtual tools and simulation methods in product development. The challenges and conditions that must be satisfied in order for computational modeling and simulation to play a significantly increased role in the design and evaluation of novel breast imaging systems will be addressed. Learning Objectives: Review the state-of-the science in testing realism of software anthropomorphic phantoms and virtual clinical trials tools; Compare approaches based upon the visual assessment by expert observers vs. the analysis of statistical properties of synthetic images; Discuss the role of observer models in the assessment of realism; Summarize the industry perspective to virtual methods for breast imaging.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2005

Program for Weibull Analysis of Fatigue Data

A Fortran computer program has been written for performing statistical analyses of fatigue-test data that are assumed to be adequately represented by a two-parameter Weibull distribution. This program calculates the following: (1) Maximum-likelihood estimates of the Weibull distribution; (2) Data for contour plots of relative likelihood for two parameters; (3) Data for contour plots of joint confidence regions; (4) Data for the profile likelihood of the Weibull-distribution parameters; (5) Data for the profile likelihood of any percentile of the distribution; and (6) Likelihood-based confidence intervals for parameters and/or percentiles of the distribution. The program can account for tests that are suspended without failure (the statistical term for such suspension of tests is "censoring"). The analytical approach followed in this program for the software is valid for type-I censoring, which is the removal of unfailed units at pre-specified times. Confidence regions and intervals are calculated by use of the likelihood-ratio method.

Krantz, Timothy L.↗
NASA NTRS2008

SEE Rate Estimation: Model Complexity and Data Requirements

Statistical Methods outlined in [Ladbury, TNS20071 can be generalized for Monte Carlo Rate Calculation Methods Two Monte Carlo Approaches: a) Rate based on vendor-supplied (or reverse-engineered) model SEE testing and statistical analysis performed to validate model; b) Rate calculated based on model fit to SEE data Statistical analysis very similar to case for CREME96. Information Theory allows simultaneous consideration of multiple models with different complexities: a) Model with lowest AIC usually has greatest predictive power; b) Model averaging using AIC weights may give better performance if several models have similar good performance; and c) Rates can be bounded for a given confidence level over multiple models, as well as over the parameter space of a model.

Ladbury, Ray↗