Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “analysis and statistical methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Missing Data and Multiple Imputation: An Unbiased Approach

The default method of dealing with missing data in statistical analyses is to only use the complete observations (complete case analysis), which can lead to unexpected bias when data do not meet the assumption of missing completely at random (MCAR). For the assumption of MCAR to be met, missingness cannot be related to either the observed or unobserved variables. A less stringent assumption, missing at random (MAR), requires that missingness not be associated with the value of the missing variable itself, but can be associated with the other observed variables. When data are truly MAR as opposed to MCAR, the default complete case analysis method can lead to biased results. There are statistical options available to adjust for data that are MAR, including multiple imputation (MI) which is consistent and efficient at estimating effects. Multiple imputation uses informing variables to determine statistical distributions for each piece of missing data. Then multiple datasets are created by randomly drawing on the distributions for each piece of missing data. Since MI is efficient, only a limited number, usually less than 20, of imputed datasets are required to get stable estimates. Each imputed dataset is analyzed using standard statistical techniques, and then results are combined to get overall estimates of effect. A simulation study will be demonstrated to show the results of using the default complete case analysis, and MI in a linear regression of MCAR and MAR simulated data. Further, MI was successfully applied to the association study of CO2 levels and headaches when initial analysis showed there may be an underlying association between missing CO2 levels and reported headaches. Through MI, we were able to show that there is a strong association between average CO2 levels and the risk of headaches. Each unit increase in CO2 (mmHg) resulted in a doubling in the odds of reported headaches.

Foy, M.↗

Uncertainty Analysis of the CE-22 Advanced Nozzle Test Facility

This paper presents methods and results of a detailed measurement uncertainty analysis that was performed for the Advanced Nozzle Test Facility, CE-22, located at the NASA Glenn Research Center. Results for the uncertainty in thrust and flow coefficients, in addition to other variables of interest, are provided. Results are presented separately as random uncertainty (characterizing errors inherent to instrument or measurement environment, impacting repeatability), systematic uncertainty (capturing inaccuracies due to measurement process, calibration, installation effects or other sources which may introduce bias), and total combined uncertainty. The statistical methods and engineering judgments used to estimate elemental uncertainties are described. The analysis tool MANTUS (Measurement Analysis Tool for Uncertainty in Systems) was used to quantify instrumentation system uncertainty, and statistical analysis and engineering judgment were used to quantify other random and systematic uncertainty sources. The Monte Carlo method was used to propagate systematic and random elemental uncertainties to determine the uncertainties of various calculated variables of interest.

data quality↗

Systematic Review of Radiation Therapy Toxicity Reporting in Randomized Controlled Trials of Rectal Cancer: A Comparison of Patient-Reported Outcomes and Clinician Toxicity Reporting

The use of multimodal treatments for rectal cancer has improved cancer-related outcomes but makes monitoring toxicity challenging. Optimizing future radiation therapy regimens requires collection and publication of detailed toxicity data. This review evaluated the quality of toxicity information provided in randomized controlled trials (RCTs) of radiation therapy in rectal cancer and focused on the difference between clinician-reported and patient-reported toxicity. Medline, EMBASE, and the Cochrane Library were searched (January 1995-July 2013) for RCTs reporting late toxicity in patients treated with regimens including preoperative (chemo)radiation therapy. Data on toxicity measures and information on toxicity reported were extracted using Quantitative Analyses of Normal Tissue Effects in the Clinic recommendations. International Society for Quality of Life Research standards on patient-reported outcomes (PROs) were used to evaluate the quality of patient-reported toxicity. Twenty-one RCT publications met inclusion criteria out of 4144 articles screened. All PRO studies reported higher rates of toxicity symptoms than clinician-reported studies and reported on a wider range and milder symptoms. No clinician-reported study published data on sexual dysfunction. Of the clinician-reported studies, 55% grouped toxicity data related to an organ system together (eg “Bowel”), and 45% presented data only on more-severe (grade ≥3) toxicity. In comparison, all toxicity grades were reported in 79% of PRO publications, and all studies (100%) presented individual symptom toxicity data (eg bowel urgency). However, PRO reporting quality was variable. Only 43% of PRO studies presented baseline data, 28% did not use any psychometrically validated instruments, and only 29% of studies described statistical methods for managing missing data. Analysis of these trials highlights the lack of reporting standards for adverse events and reveals the differences between clinician and patient reporting of toxicity. Recommendations for improving the quality of adverse event data collection are provided, with the aim of improving critical appraisal of outcomes for future studies.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Predicting battery capacity from impedance at varying temperature and state of charge using machine learning

Prediction of battery health from electrochemical impedance spectroscopy (EIS) data can enable rapid measurement of battery state in real-world applications without using additional sensors or time-consuming performance measurements. However, deconvoluting the effect of capacity, state of charge, and temperature on EIS response is complicated analytically. Here, various machine-learning models, such as linear, Gaussian process, random forest, and artificial neural network regression, are utilized to predict capacity from EIS using hundreds of capacity, direct current (DC) resistance, and EIS measurements recorded under varying conditions of health, temperature, and state of charge (SOC). Several feature extraction and selection methods from traditional electrochemical analysis and statistical modeling are explored using machine-learning pipelines. EIS data from just two frequencies can accurately predict capacity, and interrogation shows that the optimal set of frequencies is not usually intuitive. Best results are achieved with an ensemble model, which predicts battery capacity with a mean absolute error of 1.9% on data from unobserved cells.

25 ENERGY STORAGE↗

Unsupervised word embeddings capture latent knowledge from materials science literature

The overwhelming majority of scientific knowledge is published as text, which is difficult to analyse by either traditional statistical analysis or modern machine learning methods. By contrast, the main source of machine-interpretable data for the materials research community has come from structured property databases, which encompass only a small fraction of the knowledge present in the research literature. Beyond property values, publications contain valuable knowledge regarding the connections and relationships between data items as interpreted by the authors. To improve the identification and use of this knowledge, several studies have focused on the retrieval of information from scientific literature using supervised natural language processing, which requires large hand-labelled datasets for training. Here we show that materials science knowledge present in the published literature can be efficiently encoded as information-dense word embeddings (vector representations of words) without human labelling or supervision. Without any explicit insertion of chemical knowledge, these embeddings capture complex materials science concepts such as the underlying structure of the periodic table and structure-property relationships in materials. Furthermore, we demonstrate that an unsupervised method can recommend materials for functional applications several years before their discovery. This suggests that latent knowledge regarding future discoveries is to a large extent embedded in past publications. Lastly, our findings highlight the possibility of extracting knowledge and relationships from the massive body of scientific literature in a collective manner, and point towards a generalized approach to the mining of scientific literature.

36 MATERIALS SCIENCE↗

Dipole-Strength Distributions Below the Giant Dipole Resonance in the Stable Even-Mass Molybdenum Isotopes

Dipole-strength distributions in the stable even-mass molybdenum isotopes up to the neutron-separation energies have been studied in photon-scattering experiments with bremsstrahlung at the superconducting electron accelerator ELBE at the Research Center Dresden-Rossendorf, Germany, and with mono-energetic photon beams at the High Intensity Gamma-ray Source facility at Triangle Universities Nuclear Laboratory. In order to determine the dipole-strength distribution, statistical methods were developed for the analysis of the measured spectra. The data obtained for the stable even-mass molybdenum isotopes from the present ({gamma},{gamma}') experiments are combined with ({gamma},n) cross sections from the literature resulting in a photoabsorption cross section covering the full range from about 4 to 15 MeV, which is of interest for nuclear structure as well as for nuclear astrophysics network calculations. Novel information about the low-energy tail of the Giant Dipole Resonance and the energy spreading of its strength is derived.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Comparing Mitigations under Uncertainty in Simulated Influenza Outbreak [Slides]

Consequences of an influenza outbreak and effects of factors determining mitigation strategies were studied by computer simulation using statistical design and analysis of experiments methods. Twelve input variables that specify differing degrees of disease mitigation were selected to be evaluated within the context of nine uncertain inputs that characterize influenza expression, e. g., reproductive number, case mortality rate, duration of infective period. Variables were characterized with probability distributions based on assessments of low, high, and typical values from expert opinion and literature review. An approach to experiment design called dispersion array based experiment was developed that incorporates orthogonal array based Latin hypercube sampling. The simulation experiment consisted of 128 combinations of mitigation factors each evaluated over 16 distinct disease characterizations and allowed a quick assessment of simulation results, particularly mitigation efficacy. Sensitivity evaluation of the mitigation factors showed effectiveness against the range of influenza expressions with little stress on the health care system.

60 APPLIED LIFE SCIENCES↗

Toward Better Understanding of Microphysical Processes and Resulting Precipitation Physics: A Merger Of Observations and Cloud Models (Final Report)

A large database of global disdrometer observations and a diverse set of simulations from the Regional Atmospheric Modeling System (RAMS) were compared using principal component analysis (PCA) in order to better understand warm and ice-based precipitation processes. The analysis demonstrated that six distinct precipitation groups (PGs) with common characteristics were revealed in both the observations and model simulations. These PGs were defined by similar co-variability of rain parameters. However, the model showed large concentrations of drops with a given size compared to the observations. Detailed investigations determined the parameterization of drop breakup was forcing the drops to an equilibrium size with a stronger constraint than was indicated by the observations. A series of sensitivity studies permutating the rain shape parameter in the RAMS 2-moment bulk scheme demonstrated how the assumed shape of the rain distribution influences the microphysics as well as precipitation characteristics. Results were compared to the same simulations performed with a bin microphysics scheme where the rain shape parameter is freely evolving. In the bin scheme, a wide range of shape parameters were found, with horizontal and vertical variability, in addition to being a function of storm lifetime. The results of this study highlight the limitations of a fixed assumed rain distribution in 2-moment microphysics schemes. Model simulations were used to probe the microphysical origins of the six PGs. Rain budgets from a supercell case showed that several of the groups hypothesized to be associated with strong ice microphysical processes had significant contributions from melting hail, but the complexity of ice and warm-rain processes in the supercell precluded definitive determination of microphysical origins for many of the PGs. A case study from the Mid-latitude Continental Convection and Clouds Experiment (MC3E) compared the model PGs to disdrometer observations, and demonstrated the spatial and temporal variability of the PGs which is not possible from disdrometer point measurements alone. The analyses performed during this project demonstrated how statistical analysis can provide a robust method for comparing model simulations and observations, which ultimately resulted identification of limitations in some current microphysics parameterizations as well as insights into precipitation variability which ultimately benefits both observations and modeling efforts.

54 ENVIRONMENTAL SCIENCES↗

The application of LANDSAT-1 imagery for monitoring strip mines in the new river watershed in northeast Tennessee, part 2

The author has identified the following significant results. LANDSAT imagery and supplementary aircraft photography of the New River drainage basin were subjected to a multilevel analysis using conventional photointerpretation methods, densitometric techniques, multispectral analysis, and statistical tests to determine the accuracy of LANDSAT-1 imagery for measuring strip mines of common size. The LANDSAT areas were compared with low altitude measurements. The average accuracy over all the mined land sample areas mapped from LANDSAT-1 was 90%. The discrimination of strip mine subcategories is somewhat limited on LANDSAT imagery. A mine site, whether active or inactive, can be inferred by lack of vegetation, by shape, or image texture. Mine ponds are difficult or impossible to detect because of their small size and turbidity. Unless bordered and contrasted with vegetation, haulage roads are impossible to delineate. Preparation plants and refuge areas are not detectable. Density slicing of LANDSAT band 7 proved most useful in the detection of reclamation progress within the mined areas. For most state requirements for year-round monitoring of surface mined land, LANDSAT is of limited value. However, for periodic updating of regional surface maps, LANDSAT may provide sufficient accuracies for some users.

Shahrokhi, F.↗

Knowledge acquisition for expert systems using statistical methods

A common problem in the design of expert systems is the definition of rules from data obtained in system operation or simulation. A statistical method for generating rule bases from numerical data, motivated by an example based on aircraft navigation with multiple sensors is presented. The specific objective is to design an expert system that selects a satisfactory suite of measurements from a dissimilar, redundant set, given an arbitrary navigation geometry and possible sensor failures. The systematic development of a Navigation Sensor Management (NSM) Expert System from Kalman Filter covariance data is described. The development method invokes two statistical techniques: Analysis-of-Variance (ANOVA) and the ID3 algorithm. The ANOVA technique indicates whether variations of problem parameters give statistically different covariance results, and the ID3 algorithm identifies the relationships between the problem parameters using probabilistic knowledge extracted from a simulation example set.

Belkin, Brenda L.↗

Role of metabolic gases in bubble formation during hypobaric exposures

Our hypothesis is that metabolic gases play a role in the initial explosive growth phase of bubble formation during hypobaric exposures. Models that account for optimal internal tensions of dissolved gases to predict the probability of occurrence of venous gas emboli were statistically fitted to 426 hypobaric exposures from National Aeronautics and Space Administration tests. The presence of venous gas emboli in the pulmonary artery was detected with an ultrasound Doppler detector. The model fit and parameter estimation were done by using the statistical method of maximum likelihood. The analysis results were as follows. 1) For the model without an input of noninert dissolved gas tissue tension, the log likelihood (in absolute value) was 255.01. 2) When an additional parameter was added to the model to account for the dissolved noninert gas tissue tension, the log likelihood was 251.70. The significance of the additional parameter was established based on the likelihood ratio test (P < 0.012). 3) The parameter estimate for the dissolved noninert gas tissue tension participating in bubble formation was 19. 1 kPa (143 mmHg). 4) The additional gas tissue tension, supposedly due to noninert gases, did not show an exponential decay as a function of time during denitrogenation, but it remained constant. 5) The positive sign for this parameter term in the model is characteristic of an outward radial pressure of gases in the bubble. This analysis suggests that dissolved gases other than N2 in tissues may facilitate the initial explosive bubble-growth phase.

NASA Center JSC↗

Searches for New Physics With Muon Conversion at Fermilab and Triboson Production at the LHC

We report on several efforts to search for physics beyond the standard model of particle physics at broad energy scales. The Mu2e experiment at Fermilab will search for charged lepton flavor violation via the muon to electron conversion process, which is suppressed in the Standard Model. Mu2e will be operated at a low energy, yet can probe New Physics at very high mass scales (O(1e3 - 1e4 ) TeV). At high energies, the CMS experiment at the CERN LHC continues to deliver an impressive suite of Standard Model measurements and limits on a variety of New Physics signatures. Mu2e is under construction and slated to collect its first physics data in the coming years. This thesis describes work done during the construction phase of Mu2e and focuses on two critical areas: magnetic field modeling and statistical analysis. We describe a novel method for field modeling which we validate using a simulated dataset representing the expected magnetic field in the Detector Solenoid. This method blends a standard least-squares fitting technique that utilizes physically motivated analytical model functions with a novel physics informed network that is constructed to obey Maxwell’s equations. We show the technique can model the field with an accuracy of 10−7 despite the presence of injected noise in the pseudo-measurements at the 10−5 level. We then present preliminary results of the calibration of 3D Hall probes at the sub-10−4 level. These probes will be used to directly measure the Mu2e Detector Solenoid magnetic field on a sparse grid; these measurements serve as the input to the field model fitting. Finally, we describe the first implementation of both an unbinned shape analysis and a Bayesian interpretation applied to Mu2e pseudo-data. Up to 20% tighter limits can be set by the shape analysis compared to a standard cut & count analysis. The AlCap experiment collected data at PSI in 2015 to measure several important quantities related to nuclear muon capture on an aluminum target, which is a significant background process for Mu2e. The neutron emission from muon capture can introduce background hits in the Mu2e detectors and can increase radiation damage in various elements of the apparatus. We present measurements of the neutron group fluence and mean neutron multiplicity for muon capture on aluminum nuclei. Finally, we discuss an analysis of triboson production at CMS using an Effective Field Theory framework. Standard Model triboson production, which was first observed at CMS in 2020, has a relatively small cross section and provides direct access to both anomalous triple gauge couplings and quartic gauge couplings. These couplings, interpreted in the Standard Model Effective Field Theory, are studied in the present work. We target the boosted regime where the background rate is low and yields are enhanced when dimension-6 and dimension-8 Wilson coefficients are non-zero. We do not observe an excess in the data and therefore set bounds on the Wilson coefficients. For dimension-6 coefficients the tightest observed (expected) bounds are set on cW /Λ2 where Λ is the mass scale of new physics; the bounds are [−0.13, 0.12] TeV−2 ([−0.12, 0.12] TeV−2 ) at 95% CL. The tightest bounds in dimension-8 are set on fT,0 / Λ4 ; the observed (expected) bounds at 95% CL are [−0.63, 0.69] TeV−4 ([−0.54, 0.62] TeV−4 ). Additional results are presented which include scenarios where multiple Wilson coefficients are non-zero, the application of signal model clipping to address unitarity violation in Effective Field Theories, and a novel template fit developed for easier reinterpretation of our results.

Kampa, Cole Erik [Northwestern U. (main)] (ORCID:0↗

Likelihood non-Gaussianity in large-scale structure analyses

The standard present-day large-scale structure (LSS) analyses make a major assumption in their Bayesian parameter inference – that the likelihood has a Gaussian form. For summary statistics currently used in LSS, this assumption, even if the underlying density field is Gaussian, cannot be correct in detail. We investigate the impact of this assumption on two recent LSS analyses: the Beutler et al. power spectrum multipole ($P_ℓ$) analysis and the Sinha et al. group multiplicity function ($ζ$) analysis. Using non-parametric divergence estimators on mock catalogues originally constructed for covariance matrix estimation, we identify significant non-Gaussianity in both the $P_ℓ$ and $ζ$ likelihoods. We then use Gaussian mixture density estimation and independent component analysis on the same mocks to construct likelihood estimates that approximate the true likelihood better than the Gaussian pseudo-likelihood. Using these likelihood estimates, we accurately estimate the true posterior probability distribution of the Beutler et al. and Sinha et al. parameters. Likelihood non-Gaussianity shifts the fσ8 constraint by -0.44σ, but otherwise does not significantly impact the overall parameter constraints of Beutler et al. For the $ζ$ analysis, using the pseudo-likelihood significantly underestimates the uncertainties and biases the constraints of the Sinha et al. halo occupation parameters. For log $M_1$ and α, the posteriors are shifted by +0.43σ and -0.51σ and broadened by 42 per cent and 66 per cent, respectively. The divergence and likelihood estimation methods we present provide a straightforward framework for quantifying the impact of likelihood non-Gaussianity and deriving more accurate parameter constraints.

79 ASTRONOMY AND ASTROPHYSICS↗

An alternative to Monte Carlo.

Histogram construction via algebraic Monte Carlo method, determining simultaneous effect of several input statistical variables on output variable

PROBABILITY THEORY↗

Estimation of process steady state with autoregressive models and Bayesian inference

To improve efficiency, separations engineers will typically design process circuits containing recirculating streams, which mix one or more of the process outputs with the feed material. Doing so can improve efficiency, but will cause a delay in the system reaching steady state conditions until the recirculating load mass flows stabilize. In testing separation circuits, engineers will often test a variety of factors and complete an analysis from sample results. Knowledge of if a process is at steady state, as well as the steady state conditions of a process, is essential for a valid techno-economic analysis. However, the definition of process steady state is often poorly defined, or does not include uncertainty quantification. If the performance of a process operating under two different sets of conditions are compared, an engineer who does not test for steady state or quantify steady state conditions risks producing a faulty analysis. In this work, a Bayesian statistical method for testing if all streams are at steady state is further motivated and then derived. Then after testing for steady state, the same model is used with a prior distribution that enforces a steady state assumption to estimate steady state conditions. Further, these methods were validated in a solvent extraction pilot plant where steady state conditions for all outflows were inferred with uncertainty quantification. Analysis is completed with functions available to the reader as part of the BayesMassBal (V 1.1.0) software package written in R.

01 COAL, LIGNITE, AND PEAT↗

Experiences using DAKOTA stochastic expansion methods in computational simulations

Uncertainty quantification (UQ) methods bring rigorous statistical connections to the analysis of computational and experiment data, and provide a basis for probabilistically assessing margins associated with safety and reliability. The DAKOTA toolkit developed at Sandia National Laboratories implements a number of UQ methods, which are being increasingly adopted by modeling and simulation teams to facilitate these analyses. This report disseminates results as to the performance of DAKOTA's stochastic expansion methods for UQ on a representative application. Our results provide a number of insights that may be of interest to future users of these methods, including the behavior of the methods in estimating responses at varying probability levels, and the expansion levels for the methodologies that may be needed to achieve convergence.

99 GENERAL AND MISCELLANEOUS↗

Advanced Statistical Methods in Spacecraft Flight Software Cost Estimation: Bayesian Regression and Nonlinear Principal Components Analysis to Support System Engineering in the Early Project Lifecycle

This paper provides an overview of the new features and model updates in the upcoming release of the NASA Analogy Software Cost Tool (ASCoT). ASCoT, hosted within the Online NASA Space Estimation Tools (ONSET) on the One NASA Cost Engineering (ONCE) Database, is a web-based tool that provides a suite of estimation tools to support early lifecycle NASA flight software cost analysis. In addition to the traditional parametric flight software costing method COCOMO II, ASCoT contains a Bayesian linear regression to predict total flight software development cost as a function of total spacecraft cost, as well as four analogic methods: k-Nearest Neighbors (kNN) and Clustering models to predict Effort (in work-months) and total source lines of code (SLOC). These methods are designed to work primarily with system-level inputs such as mission type (orbiter, lander, etc.), mission destination (Earth, Inner Planetary, etc.), and the number of instruments and deployables. Nonlinear principal components analysis (NLPCA) is performed to find the principal features of the data composed of both categorical and numerical variables and is necessary prior to defining our analogic methods. Sensitivity analyses and in- and out-of-sample model performance results are presented for the Bayesian CER and the analogic models.

Johnson, James K.↗