Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,621 records · Page 90

Modelling stellar activity with Gaussian process regression networks

ABSTRACT Stellar photospheric activity is known to limit the detection and characterization of extrasolar planets. In particular, the study of Earth-like planets around Sun-like stars requires data analysis methods that can accurately model the stellar activity phenomena affecting radial velocity (RV) measurements. Gaussian Process Regression Networks (GPRNs) offer a principled approach to the analysis of simultaneous time series, combining the structural properties of Bayesian neural networks with the non-parametric flexibility of Gaussian Processes. Using HARPS-N solar spectroscopic observations encompassing three years, we demonstrate that this framework is capable of jointly modelling RV data and traditional stellar activity indicators. Although we consider only the simplest GPRN configuration, we are able to describe the behaviour of solar RV data at least as accurately as previously published methods. We confirm the correlation between the RV and stellar activity time series reaches a maximum at separations of a few days, and find evidence of non-stationary behaviour in the time series, associated with an approaching solar activity minimum.

Camacho, J. D. (ORCID:0000000151215560)↗

Bayesian Linear Regression for Hugoniot Data

This repository provides the code and datasets used in the paper Bayesian Analysis of Linear Shock Compression Data. This paper analyzes publicly available shock compression datasets on copper, argon, and nickel from Marsh (1980) using Bayesian linear regression, and compares the results with those obtained using bootstrapping methods. References: - Marsh, S. P. (1980). LASL shock Hugoniot data (Vol. 5). Univ of California Press.

Bernstein, JasonA [Lawrence Livermore National Lab↗

Photometry on Structured Backgrounds: Local Pixel-wise Infilling by Regression

Photometric pipelines struggle to estimate both the flux and flux uncertainty for stars in the presence of structured backgrounds such as filaments or clouds. However, it is exactly stars in these complex regions that are critical to understanding star formation and the structure of the interstellar medium. We develop a method, similar to Gaussian process regression, which we term local pixel-wise infilling (LPI). Using a local covariance estimate, we predict the background behind each star and the uncertainty of that prediction in order to improve estimates of flux and flux uncertainty. We show the validity of our model on synthetic data and real dust fields. We further demonstrate that the method is stable even in the crowded field limit. While we focus on optical-IR photometry, this method is not restricted to those wavelengths. We apply this technique to the 34 billion detections in the second data release of the Dark Energy Camera Plane Survey. In addition to removing many >3σ outliers and improving uncertainty estimates by a factor of ~2–3 on nebulous fields, we also show that our method is well behaved on uncrowded fields. The entirely post-processing nature of our implementation of LPI photometry allows it to easily improve the flux and flux uncertainty estimates of past as well as future surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Dose-Volume Analysis of Predictors for Gastrointestinal Toxicity After Concurrent Full-Dose Gemcitabine and Radiotherapy for Locally Advanced Pancreatic Adenocarcinoma

Purpose: To identify dosimetric predictors for the development of gastrointestinal (GI) toxicity in patients with locally advanced pancreatic adenocarcinoma (LAPC) treated with concurrent full-dose gemcitabine and radiotherapy (GemRT). Methods and Materials: From June 2002 to June 2009, 46 LAPC patients treated with definitive GemRT were retrospectively analyzed. The stomach and duodenum were retrospectively contoured separately to determine their dose-volume histogram (DVH) parameters. GI toxicity was defined as Grade 3 or higher GI toxicity. The follow-up time was calculated from the start of RT to the date of death or last contact. Univariate analysis (UVA) and multivariate analysis (MVA) using Kaplan-Meier and Cox regression models were performed to identify risk factors associated with GI toxicity. The receiver operating characteristic curve and the area under the receiver operating characteristic curve (AUC) were used to determine the best DVH parameter to predict for GI toxicity. Results: Of the patients, 28 (61%) received concurrent gemcitabine alone, and 18 (39%) had concurrent gemcitabine with daily erlotinib. On UVA, only the V{sub 20Gy} to V{sub 35Gy} of duodenum were significantly associated with GI toxicity (all p {<=} 0.05). On MVA, the V{sub 25Gy} of duodenum and the use of erlotinib were independent risk factors for GI toxicity (p = 0.006 and 0.02, respectively). For the entire cohort, the V{sub 25Gy} of duodenum is the best predictor for GI toxicity (AUC = 0.717), and the 12-month GI toxicity rate was 8% vs. 48% for V{sub 25Gy} {<=} 45% and V{sub 25Gy} > 45%, respectively (p = 0.03). However, excluding the erlotinib group, the V{sub 35Gy} is the best predictor (AUC = 0.725), and the 12-month GI toxicity rate was 0% vs. 41% for V{sub 35Gy} {<=} 20% and V{sub 35Gy} > 20%, respectively (p = 0.04). Conclusions: DVH parameters of duodenum may predict Grade 3 GI toxicity after GemRT for LAPC. Concurrent use of erlotinib during GemRT may increase GI toxicity.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Determination of airplane model structure from flight data by using modified stepwise regression

The linear and stepwise regressions are briefly introduced, then the problem of determining airplane model structure is addressed. The MSR was constructed to force a linear model for the aerodynamic coefficient first, then add significant nonlinear terms and delete nonsignificant terms from the model. In addition to the statistical criteria in the stepwise regression, the prediction sum of squares (PRESS) criterion and the analysis of residuals were examined for the selection of an adequate model. The procedure is used in examples with simulated and real flight data. It is shown that the MSR performs better than the ordinary stepwise regression and that the technique can also be applied to the large amplitude maneuvers.

Klein, V.↗

Finite Element Analysis and Machine Learning Guided Design of Carbon Fiber Organosheet-Based Battery Enclosures for Crashworthiness

Carbon fiber composite can be a potential candidate for replacing metal-based battery enclosures of current electric vehicles (E.V.s) owing to its better strength-to-weight ratio and corrosion resistance. However, the strength of carbon fiber-based structures depends on several parameters that should be carefully chosen. Here, in this work, we implemented high throughput finite element analysis (FEA) based thermoforming simulation to virtually manufacture the battery enclosure using different design and processing parameters. Subsequently, we performed virtual crash simulations to mimic a side pole crash to evaluate the crashworthiness of the battery enclosures. This high throughput crash simulation dataset was utilized to build predictive models to understand the crashworthiness of an unknown set. Our machine learning (ML) models showed excellent performance (R 2 > 0.97) in predicting the crashworthiness metrics, i.e., crush load efficiency, absorbed energy, intrusion, and maximum deceleration during a crash. We believe that this FEA-ML work framework will be helpful in down select process parameters for carbon fiber-based component design and can be transferrable to other manufacturing technologies.

36 MATERIALS SCIENCE↗

Projection-based multifidelity linear regression for data-scarce applications

Surrogate modeling for systems with high-dimensional quantities of interest remains challenging, particularly when training data are costly to acquire. This work develops multifidelity methods for multiple-input multiple-output linear regression targeting data-limited applications with high-dimensional outputs. Multifidelity methods integrate many inexpensive low-fidelity model evaluations with limited, costly high-fidelity evaluations. We introduce two projection-based multifidelity linear regression approaches with linear and nonlinear features that leverage principal component basis vectors for dimensionality reduction and combine multifidelity data through: (i) a direct data augmentation using low-fidelity data, and (ii) a data augmentation incorporating explicit linear corrections between low-fidelity and high-fidelity data. The data augmentation approaches combine high-fidelity and low-fidelity data into a unified training set and train the linear regression model through weighted least squares with fidelity-specific weights. We introduce a proximity-based weighting scheme with automatic weight selection strategy through cross-validation. Here, the proposed multifidelity linear regression methods are demonstrated on approximating the surface pressure field of a hypersonic vehicle in flight and the temperature field on an aircraft disc braking system. In an ultra low-data regime of no more than twelve high-fidelity samples, multifidelity linear regression achieves approximately 2% – 12% improvement in median accuracy and a higher R 2 score relative to single-fidelity methods at comparable computational cost.

data augmentation↗

Novel method for accurately estimating membrane transport properties and mass transfer coefficients in reverse osmosis

Here, we present a simple and robust method to simultaneously characterize the water and salt permeability (A, B) of reverse osmosis (RO) membranes and mass transfer coefficient (k) in membrane modules. The proposed methodology comprises a set of RO experiments performed at different operating pressures or stages. The measured water and salt fluxes in each stage are simultaneously fitted to the RO transport equations by performing a non-linear regression, using A, B, and k as regression parameters. We first perform a systematic accuracy analysis of the proposed method across the full operational range of RO. The assessment shows that the method accuracy is substantially higher than current methods and increases with number of experimental stages and driving forces. This assessment is used to inform the design of an experimental protocol that minimizes errors in estimated A, B, and k. We then evaluate two commercial RO membranes following the new protocol. For both membranes, A and B parameters decrease by 17% and 15% from the dilute solution to seawater concentrations, whereas the k parameter remains constant. Our study demonstrates that the proposed method, informed by data-driven experimental designs, provides a new approach for accurately characterizing transport phenomenon in membrane processes with feeds of less than 100 g/L total dissolved solids.

36 MATERIALS SCIENCE↗

Clinical knowledge extraction via sparse embedding regression (KESER) with multi-center large scale electronic health record data

The increasing availability of electronic health record (EHR) systems has created enormous potential for translational research. However, it is difficult to know all the relevant codes related to a phenotype due to the large number of codes available. Traditional data mining approaches often require the use of patient-level data, which hinders the ability to share data across institutions. In this project, we demonstrate that multi-center large-scale code embeddings can be used to efficiently identify relevant features related to a disease of interest. We constructed large-scale code embeddings for a wide range of codified concepts from EHRs from two large medical centers. We developed knowledge extraction via sparse embedding regression (KESER) for feature selection and integrative network analysis. We evaluated the quality of the code embeddings and assessed the performance of KESER in feature selection for eight diseases. Besides, we developed an integrated clinical knowledge map combining embedding data from both institutions. The features selected by KESER were comprehensive compared to lists of codified data generated by domain experts. Features identified via KESER resulted in comparable performance to those built upon features selected manually or with patient-level data. The knowledge map created using an integrative analysis identified disease-disease and disease-drug pairs more accurately compared to those identified using single institution data. Analysis of code embeddings via KESER can effectively reveal clinical knowledge and infer relatedness among codified concepts. KESER bypasses the need for patient-level data in individual analyses providing a significant advance in enabling multi-center studies using EHR data.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Method for estimating the density of high-level nuclear waste glass

A database of over 1100 silicate glass compositions and densities was compiled and used to evaluate the efficacy of an algorithm for estimating the density of silicate glass compositions. We sought to develop a parsimonious algorithm based on the additivity of partial molar volumes of individual oxide components weighted by their mole fraction in a glass composition. Bound molar volumes were used for oxides in which the density of the oxide bound in a glass matrix was previously determined. The bound molar volumes were known for oxides covering 97.5 mole percent of the database compositional space. The measured glass densities were plotted against the estimated glass densities and a linear regression yielded an R 2 adj. = 0.95 and a slope and intercept of approximately one and zero, respectively. This regression suggests that glass densities estimated by the algorithm, within analysis uncertainty, are equal to the measured densities of the glasses. In addition to the development of the density estimation, we corroborated many of the referenced bound molar volume data used in the parameterization of the estimation algorithm via linear regression of the individual partial molar volumes versus the inverse measured densities (specific volumes) of the glasses in the database.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Nonparametric Method for Genomics-Based Prediction of Performance of Quantitative Traits Involving Epistasis in Plant Breeding

Genomic selection (GS) procedures have proven useful in estimating breeding value and predicting phenotype with genome-wide molecular marker information. However, issues of high dimensionality, multicollinearity, and the inability to deal effectively with epistasis can jeopardize accuracy and predictive ability. We, therefore, propose a new nonparametric method, pRKHS, which combines the features of supervised principal component analysis (SPCA) and reproducing kernel Hilbert spaces (RKHS) regression, with versions for traits with no/low epistasis, pRKHS-NE, to high epistasis, pRKHS-E. Instead of assigning a specific relationship to represent the underlying epistasis, the method maps genotype to phenotype in a nonparametric way, thus requiring fewer genetic assumptions. SPCA decreases the number of markers needed for prediction by filtering out low-signal markers with the optimal marker set determined by cross-validation. Principal components are computed from reduced marker matrix (called supervised principal components, SPC) and included in the smoothing spline ANOVA model as independent variables to fit the data. The new method was evaluated in comparison with current popular methods for practicing GS, specifically RR-BLUP, BayesA, BayesB, as well as a newer method by Crossa et al., RKHS-M, using both simulated and real data. Results demonstrate that pRKHS generally delivers greater predictive ability, particularly when epistasis impacts trait expression. Beyond prediction, the new method also facilitates inferences about the extent to which epistasis influences trait expression.

54 ENVIRONMENTAL SCIENCES↗

Statistical methods for astronomical data with upper limits. II - Correlation and regression

Statistical methods for calculating correlations and regressions in bivariate censored data where the dependent variable can have upper or lower limits are presented. Cox's regression and the generalization of Kendall's rank correlation coefficient provide significant levels of correlations, and the EM algorithm, under the assumption of normally distributed errors, and its nonparametric analog using the Kaplan-Meier estimator, give estimates for the slope of a regression line. Monte Carlo simulations demonstrate that survival analysis is reliable in determining correlations between luminosities at different bands. Survival analysis is applied to CO emission in infrared galaxies, X-ray emission in radio galaxies, H-alpha emission in cooling cluster cores, and radio emission in Seyfert galaxies.

Isobe, T.↗

Earth Oblateness and Relative Sun Motion Considerations in the Determination of an Ideal Orbit for the Nimbus Meteorological Satellite

It is desired that the Nimbus meteorological satellite always cross the equator around local noon and, half-an-orbit later, cross the equator in the other direction around local midnight. The application of the phenomenon of nodal regression toward this end is discussed, and an analysis of the parameters angles of inclination, periods, and heights of such "ideal" circular orbits is presented. Also, the relative motion of the apparent versus the fictitious mean sun is briefly discussed.

Bandeen, William R.↗

Feature Extraction of Event-Related Potentials Using Wavelets: An Application to Human Performance Monitoring

This report describes the development and evaluation of mathematical models for predicting human performance from discrete wavelet transforms (DWT) of event-related potentials (ERP) elicited by task-relevant stimuli. The DWT was compared to principal components analysis (PCA) for representation of ERPs in linear regression and neural network models developed to predict a composite measure of human signal detection performance. Linear regression models based on coefficients of the decimated DWT predicted signal detection performance with half as many f ree parameters as comparable models based on PCA scores. In addition, the DWT-based models were more resistant to model degradation due to over-fitting than PCA-based models. Feed-forward neural networks were trained using the backpropagation,-, algorithm to predict signal detection performance based on raw ERPs, PCA scores, or high-power coefficients of the DWT. Neural networks based on high-power DWT coefficients trained with fewer iterations, generalized to new data better, and were more resistant to overfitting than networks based on raw ERPs. Networks based on PCA scores did not generalize to new data as well as either the DWT network or the raw ERP network. The results show that wavelet expansions represent the ERP efficiently and extract behaviorally important features for use in linear regression or neural network models of human performance. The efficiency of the DWT is discussed in terms of its decorrelation and energy compaction properties. In addition, the DWT models provided evidence that a pattern of low-frequency activity (1 to 3.5 Hz) occurring at specific times and scalp locations is a reliable correlate of human signal detection performance.

Trejo, Leonard J.↗

Sub-problem Optimization With Regression and Neural Network Approximators

Design optimization of large systems can be attempted through a sub-problem strategy. In this strategy, the original problem is divided into a number of smaller problems that are clustered together to obtain a sequence of sub-problems. Solution to the large problem is attempted iteratively through repeated solutions to the modest sub-problems. This strategy is applicable to structures and to multidisciplinary systems. For structures, clustering the substructures generates the sequence of sub-problems. For a multidisciplinary system, individual disciplines, accounting for coupling, can be considered as sub-problems. A sub-problem, if required, can be further broken down to accommodate sub-disciplines. The sub-problem strategy is being implemented into the NASA design optimization test bed, referred to as "CometBoards." Neural network and regression approximators are employed for reanalysis and sensitivity analysis calculations at the sub-problem level. The strategy has been implemented in sequential as well as parallel computational environments. This strategy, which attempts to alleviate algorithmic and reanalysis deficiencies, has the potential to become a powerful design tool. However, several issues have to be addressed before its full potential can be harnessed. This paper illustrates the strategy and addresses some issues.

Guptill, James D.↗

Multidisciplinary Design Optimization for Aeropropulsion Engines and Solid Modeling/Animation via the Integrated Forced Methods

The grant closure report is organized in the following four chapters: Chapter describes the two research areas Design optimization and Solid mechanics. Ten journal publications are listed in the second chapter. Five highlights is the subject matter of chapter three. CHAPTER 1. The Design Optimization Test Bed CometBoards. CHAPTER 2. Solid Mechanics: Integrated Force Method of Analysis. CHAPTER 3. Five Highlights: Neural Network and Regression Methods Demonstrated in the Design Optimization of a Subsonic Aircraft. Neural Network and Regression Soft Model Extended for PX-300 Aircraft Engine. Engine with Regression and Neural Network Approximators Designed. Cascade Optimization Strategy with Neural network and Regression Approximations Demonstrated on a Preliminary Aircraft Engine Design. Neural Network and Regression Approximations Used in Aircraft Design.

Source record↗

Feature extraction of event-related potentials using wavelets: an application to human performance monitoring

This report describes the development and evaluation of mathematical models for predicting human performance from discrete wavelet transforms (DWT) of event-related potentials (ERP) elicited by task-relevant stimuli. The DWT was compared to principal components analysis (PCA) for representation of ERPs in linear regression and neural network models developed to predict a composite measure of human signal detection performance. Linear regression models based on coefficients of the decimated DWT predicted signal detection performance with half as many free parameters as comparable models based on PCA scores. In addition, the DWT-based models were more resistant to model degradation due to over-fitting than PCA-based models. Feed-forward neural networks were trained using the backpropagation algorithm to predict signal detection performance based on raw ERPs, PCA scores, or high-power coefficients of the DWT. Neural networks based on high-power DWT coefficients trained with fewer iterations, generalized to new data better, and were more resistant to overfitting than networks based on raw ERPs. Networks based on PCA scores did not generalize to new data as well as either the DWT network or the raw ERP network. The results show that wavelet expansions represent the ERP efficiently and extract behaviorally important features for use in linear regression or neural network models of human performance. The efficiency of the DWT is discussed in terms of its decorrelation and energy compaction properties. In addition, the DWT models provided evidence that a pattern of low-frequency activity (1 to 3.5 Hz) occurring at specific times and scalp locations is a reliable correlate of human signal detection performance. Copyright 1999 Academic Press.

Evoked Potentials↗

Identification and Quantification of Carbon Phases in Conversion Fuel for the Transient Reactor Test Facility

As part of an overall effort to convert US research reactors to low-enriched uranium (LEU) fuel use, a LEU conversion fuel is being designed for the Transient Reactor Test Facility (TREAT) at the Idaho National Laboratory. TREAT fuel compacts are comprised of UO2 fuel particles in a graphitic matrix material. In order to refine heat transfer modeling, as well as determine other physical and nuclear characteristics of the fuel, the amount and type of graphite and non-graphite phases within the fuel matrix must be known. In this study, we performed a series of complementary analyses, designed to allow detailed characterization of the graphite and phenolic resin based fuel matrix. Methods included Scanning Electron and Transmission Electron Microscopies, Raman spectroscopy, X-ray Diffraction, and Dual-Beam Focused Ion Beam Tomography. Our results indicate that no single characterization technique will yield all of the desired information; however, through the use of statistical and empirical data analysis, such as curve fitting, partial least squares regression, volume extrapolation and spectra peak ratios, a degree of certainty for the quantity of each phase can be obtained.

10 SYNTHETIC FUELS↗