Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “analysis and statistical methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68

Assuring the Quality of Test Results in the Field of Nuclear Techniques and Ionizing Radiation. The Practical Implementation of Section 5.9 of the EN ISO/IEC 17025 Standard

The paper aims to present a practical approach for testing laboratories to ensure the quality of their test results. It is based on the experience gained in assessing a large number of testing laboratories, discussing with management and staff, reviewing results obtained in national and international PTs and ILCs and exchanging information in the EA laboratory committee.According to EN ISO/IEC 17025, an accredited laboratory has to implement a programme to ensure the quality of its test results for each measurand. Pre-analytical, analytical and post-analytical measures shall be applied in a systematic manner. They shall include both quality control and quality assurance measures.When designing the quality assurance programme a laboratory should consider pre-analytical activities (like personnel training, selection and validation of test methods, qualifying equipment), analytical activities ranging from sampling, sample preparation, instrumental analysis and post-analytical activities (like decoding, calculation, use of statistical tests or packages, management of results).Designed on different levels (analyst, quality manager and technical manager), including a variety of measures, the programme shall ensure the validity and accuracy of test results, the adequacy of the management system, prove the laboratory's competence in performing tests under accreditation and last but not least show the comparability of test results.Laboratory management should establish performance targets and review periodically QC/QA results against them, implementing appropriate measures in case of non-compliance.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Integrating biological knowledge into variable selection: an empirical Bayes approach with an application in cancer biology

Background: An important question in the analysis of biochemical data is that of identifying subsets of molecular variables that may jointly influence a biological response. Statistical variable selection methods have been widely used for this purpose. In many settings, it may be important to incorporate ancillary biological information concerning the variables of interest. Pathway and network maps are one example of a source of such information. However, although ancillary information is increasingly available, it is not always clear how it should be used nor how it should be weighted in relation to primary data. Results: We put forward an approach in which biological knowledge is incorporated using informative prior distributions over variable subsets, with prior information selected and weighted in an automated, objective manner using an empirical Bayes formulation. We employ continuous, linear models with interaction terms and exploit biochemically-motivated sparsity constraints to permit exact inference. We show an example of priors for path way and network-based information and illustrate our proposed method on both synthetic response data and by an application to cancer drug response data. Comparisons are also made to alternative Bayesian and frequentist penalised-likelihood methods for incorporating network-based information. Conclusions: The empirical Bayes method proposed here can aid prior elicitation for Bayesian variable selection studies and help to guard against mis-specification of priors. Empirical Bayes, together with the proposed pathway-based priors, results in an approach with a competitive variable selection performance. In addition, the overall procedure is fast, deterministic, and has very few user-set parameters, yet is capable of capturing interplay between molecular players. The approach presented is general and readily applicable in any setting with multiple sources of biological prior knowledge.

59 BASIC BIOLOGICAL SCIENCES↗

Protein Co-Expression Network Analysis (ProCoNA)

Biological networks are important for elucidating disease etiology due to their ability to model complex high dimensional data and biological systems. Proteomics provides a critical data source for such models, but currently lacks robust de novo methods for network construction, which could bring important insights in systems biology. We have evaluated the construction of network models using methods derived from weighted gene co-expression network analysis (WGCNA). We show that approximately scale-free peptide networks, composed of statistically significant modules, are feasible and biologically meaningful using two mouse lung experiments and one human plasma experiment. Within each network, peptides derived from the same protein are shown to have a statistically higher topological overlap and concordance in abundance, which is potentially important for inferring protein abundance. The module representatives, called eigenpeptides, correlate significantly with biological phenotypes. Furthermore, within modules, we find significant enrichment for biological function and known interactions (gene ontology and protein-protein interactions). Biological networks are important tools in the analysis of complex systems. In this paper we evaluate the application of weighted co-expression network analysis to quantitative proteomics data. Protein co-expression networks allow novel approaches for biological interpretation, quality control, inference of protein abundance, a framework for potentially resolving degenerate peptide-protein mappings, and a biomarker signature discovery.

Environmental Molecular Sciences Laboratory↗

Exploring variability in seasonal average and extreme precipitation using unsupervised machine learning.

Focal Area(s): We will use unsupervised machine learning methods to identify and quantify the influence of large scale natural modes of climate variability to gain insight into the observed and simulated seasonal average and extreme precipitation changes. Science Challenge: A recent paper, led by co-PI Mark Risser, finds that although much of the variability in seasonal average and extreme precipitation over CONUS is unforced, the effect of large-scale modes of circulation variability (such as ENSO, AMO, PNA, etc.) can be detected and attributed. However, it is unclear whether or not unsupervised learning methods can (a) replicate this finding or (b) yield insight into possible nonlinear behavior that was not captured in the initial statistical analysis. Further work would entail extending this framework to other global land areas.

54 ENVIRONMENTAL SCIENCES↗

Risk-Adaptive Experimental Design for High-Consequence Systems: LDRD Final Report

Constructing accurate statistical models of critical system responses typically requires an enormous amount of data from physical experiments or numerical simulations. Unfortunately, data generation is often expensive and time consuming. To streamline the data generation process, optimal experimental design determines the 'best' allocation of experiments with respect to a criterion that measures the ability to estimate some important aspect of an assumed statistical model. While optimal design has a vast literature, few researchers have developed design paradigms targeting tail statistics, such as quantiles. In this project, we tailored and extended traditional design paradigms to target distribution tails. Our approach included (i) the development of new optimality criteria to shape the distribution of prediction variances, (ii) the development of novel risk-adapted surrogate models that provably overestimate certain statistics including the probability of exceeding a threshold, and (iii) the asymptotic analysis of regression approaches that target tail statistics such as superquantile regression. To accompany our theoretical contributions, we released implementations of our methods for surrogate modeling and design of experiments in two complementary open source software packages, the ROL/OED Toolkit and PyApprox.

97 MATHEMATICS AND COMPUTING↗

Clinical applications of a quantitative analysis of regional lift ventricular wall motion

Observations were summarized which may have clinical application. These were obtained from a quantitative analysis of wall motion that was used to detect both hypokinesis and tardokinesis in left ventricular cineangiograms. The method was based on statistical comparisons with normal values for regional wall motion derived from the cineangiograms of patients who were found not to have heart disease.

Leighton, R. F.↗

Efficiency degradation due to tracking errors for point focusing solar collectors

An important parameter in the design of point focusing solar collectors is the intercept factor which is a measure of efficiency and of energy available for use in the receiver. Using statistical methods, an expression of the expected value of the intercept factor is derived for various configurations and control law implementations. The analysis assumes that a radially symmetric flux distribution (not necessarily Gaussian) is generated at the focal plane due to the sun's finite image and various reflector errors. The time-varying tracking errors are assumed to be uniformly distributed within the threshold limits and allows the expected value calculation.

Hughes, R. O.↗

Effect of Random Geometric Uncertainty on the Computational Design of a 3-D Flexible Wing

The effect of geometric uncertainty due to statistically independent, random, normally distributed shape parameters is demonstrated in the computational design of a 3-D flexible wing. A first-order second-moment statistical approximation method is used to propagate the assumed input uncertainty through coupled Euler CFD aerodynamic / finite element structural codes for both analysis and sensitivity analysis. First-order sensitivity derivatives obtained by automatic differentiation are used in the input uncertainty propagation. These propagated uncertainties are then used to perform a robust design of a simple 3-D flexible wing at supercritical flow conditions. The effect of the random input uncertainties is shown by comparison with conventional deterministic design results. Sample results are shown for wing planform, airfoil section, and structural sizing variables.

Gumbert, C. R.↗

Model Assisted Probability of Detection for NASA Space Missions

Model assisted probability of detection (MAPOD) uses data from simulations to improve a traditional probability of detection (POD) study. This could include extending the parameter space to reduce uncertainty or substituting experimental data with simulated data to reduce the time and cost of a POD study. In the past MAPOD was difficult due to limited computational resources, but recent innovations in simulation tools and high-performance computing have made this type of high-degree-of-freedom modeling possible, and complex structures have made it necessary. This presentation will summarize the work done by the computational nondestructive evaluation (CNDE) specialists within the Nondestructive Evaluation Sciences branch at NASA Langley Research Center (LaRC) to complete a MAPOD study for phased array ultrasound testing (PAUT) of a friction stir welding (FSW) method to be used on Space Launch System (SLS) structures. The three critical needs for a MAPOD study are a validated and verified model of the inspection technique for the structure being inspected, some experimental POD data, and an uncertainty model for both the model and the experimental data. PAUT was simulated using Extende CIVA’s UT module. The model was validated using laboratory inspection data from NASA Marshall Space Flight Center (MSFC) for a Hit/Miss POD for FSW in 2219-T87 aluminum panels representative of those used in the SLS. This model was then used to simulate flaw sizes that were originally omitted from the original POD study. The results of this new MAPOD study will be presented along with a discussion of the methods and processes used to analyze the original data, selected simulation parameters, and development of the uncertainty model used for the statistical analysis. The goal of this effort is not just to improve the POD study but to demonstrate the value of MAPOD and provide a roadmap for application of MAPOD on future projects.

Elizabeth Gregory↗

Model Assisted Probability of Detection for NASA Space Missions

Model assisted probability of detection (MAPOD) uses data from simulations to improve a traditional probability of detection (POD) study. This could include extending the parameter space to reduce uncertainty or substituting experimental data with simulated data to reduce the time and cost of a POD study. In the past MAPOD was difficult due to limited computational resources, but recent innovations in simulation tools and high-performance computing have made this type of high-degree-of-freedom modelling possible, and complex structures have made it necessary. This presentation will summarize the work done by the computational nondestructive evaluation (CNDE) group at NASA Langley Research Center (LaRC) to complete a MAPOD study for phased array ultrasound testing (PAUT) of a friction stir welding (FSW) method to be used on Space Launch System (SLS) structures. The three critical needs for a MAPOD study are a validated and verified model of the inspection technique for the structure being inspected, some experimental POD data, and an uncertainty model for both the model and the experimental data. PAUT was simulated using Extende CIVA’s UT module. The model was validated using laboratory inspection data from NASA Marshall Space Flight Center (MSFC) for a Hit/Miss POD for FSW in 2219-T87 aluminum panels representative of those used in the SLS. This model was then used to simulate flaw sizes that were originally omitted from the original POD study. The results of this new MAPOD study will be presented along with a discussion of the methods and processes used to analyze the original data, selected simulation parameters, and development of the uncertainty model used for the statistical analysis. The goal of this effort is not just to improve the POD study but to demonstrate the value of MAPOD and provide a roadmap for application of MAPOD on future projects.

Elizabeth Gregory↗

Collecting sensor data in a high-performance computing environment: a case-study

Many research questions remain open with regard to improving reliability in exascale systems. Among others, statistics-based analysis has been used to find anomalies, to isolate root causes, and attempt to predict failures. But well-understood methods and best practices for collecting reliability data in a uniform way are still lacking, which impedes analysis. We report our experience with collecting these data from heterogeneous sources on a testbed cluster and present our data collection tool. This case illustrates the fact that reported metrics largely depend upon individual system configuration. We then investigate standards and specifications in manufacturing and desktop computing to identify concepts that may be useful for representing High Performance Computing (HPC) data and present a taxonomy that utilizes these concepts.

99 GENERAL AND MISCELLANEOUS↗

Molecular-based analysis of nanoparticle solvation: Classical density functional approach

Proper statistical mechanics understanding of nanoparticle solvation processes requires an accurate description of the molecular structure of the solvent. Achieving this goal with standard molecular dynamics (MD) simulation methods is challenging due to large length scales. An alternative approach to this problem can be formulated using classical density functional theory (cDFT), where a full configurational description of the positions of all the atoms is replaced by collective atomic site densities in the molecule. Using an example of the negatively charged silica-like system in an aqueous polar environment represented by a two-site water model, we demonstrate here that cDFT can reproduce MD data at a fraction of the computational cost. An important implication of this result is the ability to understand how the solvent molecular features may affect the system’s properties at the macroscopic scale. A concrete example highlighted in this work is the analysis of nanoparticle interactions with sizes of up to 100 nm in diameter.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A simple, objective analysis scheme for scatterometer data

A simple economical objective analysis scheme is devised and tested on real scatterometer data. It is designed to treat dense data such as those of the Seasat A Satellite Scatterometer (SASS) for individual or multiple passes, and preserves subsynoptic scale features. Errors are evaluated with the aid of sampling ('bootstrap') statistical methods. In addition, sensitivity tests have been performed which establish qualitative confidence in calculated fields of divergence and vorticity. The SASS wind algorithm could be improved; however, the data at this point are limited by instrument errors rather than analysis errors. The analysis error is typically negligible in comparison with the instrument error, but amounts to 30 percent of the instrument error in areas of strong wind shear. The scheme is very economical, and thus suitable for large volumes of dense data such as SASS data.

Levy, G.↗

Statistical Methods and Tools for Hanford Staged Feed Tank Sampling

This report summarizes work conducted by Pacific Northwest National Laboratory to technically evaluate the current approach to staged feed sampling of high-level waste (HLW) sludge to meet waste acceptance criteria (WAC) for transfer from tank farms to the Hanford Waste Treatment and Immobilization Plant (WTP). The current sampling and analysis approach is detailed in the document titled Initial Data Quality Objectives for WTP Feed Acceptance Criteria, 24590-WTP-RPT-MGT-11-014, Revision 0 (Arakali et al. 2011). The goal of this current work is to evaluate and provide recommendations to support a defensible, technical and statistical basis for the staged feed sampling approach that meets WAC data quality objectives (DQOs).

97 MATHEMATICS AND COMPUTING↗

A variation of the Davis-Smith method for in-flight determination of spacecraft magnetic fields.

A variation of a procedure developed by Davis and Smith (1968) is presented for the in-flight determination of spacecraft magnetic fields. Both methods take statistical advantage of the observation that fluctuations in the interplanetary magnetic field over short periods of time are primarily changes in direction rather than in magnitude. During typical solar wind conditions between 0.8 and 1.0 AU, a statistical analysis of 2-3 days of continuous interplanetary field measurements yields an estimate of a constant spacecraft field with an uncertainty of plus or minus 0.25 gamma in the direction radial to the sun and plus or minus 15 gammas in the directions transverse to the radial. The method is also of use in estimating variable spacecraft fields with gradients of the order of 0.1 gamma/day and less and in other special circumstances.

Belcher, J. W.↗

Entropy-based feature selection for capturing impacts in Earth system models with abrupt forcing

This paper presents the development of a new entropy-based feature selection method for identifying and quantifying impacts. Here, impacts are defined as statistically significant differences in spatio-temporal fields when comparing datasets with and without an external forcing in an Earth system model. Temporal feature selection is performed by first computing the cross-fuzzy entropy to quantify similarity of patterns between two datasets and then applying changepoint detection to identify regions of statistically constant entropy. The method is used to capture temperate north surface cooling from a 9-member simulation ensemble of the Mt. Pinatubo volcanic eruption, which injected 10 Tg of SO 2 into the stratosphere. The results estimate a mean difference decrease in near surface air temperature of -0.560 K with a 99% confidence interval between -0.864 K and -0.257 K between April and November of 1992, one year following the eruption. A sensitivity analysis with decreasing SO 2 injection revealed that the impact is statistically significant at 5 Tg but not at 3 Tg. Using identified features, a dependency graph model based on a 9-day lag had significantly fewer nodes than a graph based on monthly means. Furthermore, this demonstrates our method’s ability to perform dimension reduction while still uncovering source-to-impact pathways.

Changepoint detection↗

Statistical Analysis of Large Simulated Yield Datasets for Studying Climate Effects

Many studies have been carried out during the last decade to study the effect of climate change on crop yields and other key crop characteristics. In these studies, one or several crop models were used to simulate crop growth and development for different climate scenarios that correspond to different projections of atmospheric CO2 concentration, temperature, and rainfall changes (Semenov et al., 1996; Tubiello and Ewert, 2002; White et al., 2011). The Agricultural Model Intercomparison and Improvement Project (AgMIP; Rosenzweig et al., 2013) builds on these studies with the goal of using an ensemble of multiple crop models in order to assess effects of climate change scenarios for several crops in contrasting environments. These studies generate large datasets, including thousands of simulated crop yield data. They include series of yield values obtained by combining several crop models with different climate scenarios that are defined by several climatic variables (temperature, CO2, rainfall, etc.). Such datasets potentially provide useful information on the possible effects of different climate change scenarios on crop yields. However, it is sometimes difficult to analyze these datasets and to summarize them in a useful way due to their structural complexity; simulated yield data can differ among contrasting climate scenarios, sites, and crop models. Another issue is that it is not straightforward to extrapolate the results obtained for the scenarios to alternative climate change scenarios not initially included in the simulation protocols. Additional dynamic crop model simulations for new climate change scenarios are an option but this approach is costly, especially when a large number of crop models are used to generate the simulated data, as in AgMIP. Statistical models have been used to analyze responses of measured yield data to climate variables in past studies (Lobell et al., 2011), but the use of a statistical model to analyze yields simulated by complex process-based crop models is a rather new idea. We demonstrate herewith that statistical methods can play an important role in analyzing simulated yield data sets obtained from the ensembles of process-based crop models. Formal statistical analysis is helpful to estimate the effects of different climatic variables on yield, and to describe the between-model variability of these effects.

climate↗

A numerical study of the meso-structure variability in the compaction process of prepreg platelet molded composites

Compaction deformations in a thermoplastic composite system molded from chopped prepreg platelets were analyzed to obtain statistical distributions of local distortions that define the final consolidated meso-structure. This study provides an insight into and allows quantification of the intrinsic geometric variability of the composite meso-structure that controls the variability of the effective composite mechanical properties. A two-phase viscoelastic finite element model was utilized to treat the behavior of molten prepreg platelets, which were assumed to be incompressible and inextensible in the fiber direction during processing. A two-step simulation procedure with discretely modeled platelets and platelet-to-platelet contacts is proposed. The analysis begins with a drop simulation of the uncontrolled material deposition followed by a 3D finite element analysis of the preform compaction and bulk material flow. The proposed model provides a method for generating a composite meso-structure ab initio starting from a statistical sampling of the initial conditions for platelet deposition. The predicted platelet thickness distribution, intra-platelet fiber waviness and out-of-plane platelet undulations were found to be in good agreement with experimental measurements. An estimate of the volume of resin pockets was inferred from the compaction simulation.

36 MATERIALS SCIENCE↗