Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Linear Regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Lithium-Ion Battery Diagnostics Using Electrochemical Impedance via Machine-Learning

Diagnosing battery states such as health, state-of-charge, or temperature is crucial for ensuring the safety and reliability of electrochemical energy storage systems. While some states, such as temperature, may be measured using cheap sensors, accurate diagnosis of battery health metrics usually requires time-consuming performance measurements, making them infeasible for use in real-world operation. These health metrics can be measured during lab-testing and then estimated on-line using predictive life models or via state observer algorithms such as Kalman filters, but these predictive methods should be supplemented by actual measurement of battery health whenever possible to ensure reliability. Rapid measurement of battery health may be done by various types of fast diagnostic techniques such as electrochemical impedance spectroscopy (EIS), which can be performed in only a few minutes and require only a fraction of the energy and power needed for a full charge and discharge measurement. But there is a substantial challenge for estimating battery health using EIS data, as EIS is sensitive to cell temperature, state-of-charge, current, and resting time in addition to health. Thus, utilizing EIS data to predict battery capacity requires correcting for all these additional variables, a task that is extremely difficult to handle analytically. This talk utilizes machine-learning methods to estimate the effectiveness of battery capacity prediction from EIS data, leveraging a data set of hundreds of EIS measurements recorded at varying temperature and state-of-charge throughout a 500-day aging study of 32 commercial, large-format NMC-Graphite lithium-ion batteries. Using EIS as input to machine-learning models is complicated by the nonlinear response of impedance to battery health, temperature, and state-of-charge, as well as the collinearity between the impedance response at neighboring frequencies, which can easily lead to overfit models. To train robust models, features from EIS data need to be extracted from the data or some subset of critical frequencies selected. Many approaches for extracting and selecting features from EIS data from electrochemical analysis and machine-learning fields were identified for analysis: using the entire raw spectra; selection of one, two, or many frequencies from the entire spectra; selecting interesting points from the EIS measurement using domain knowledge; fitting EIS with an equivalent-circuit model; calculating statistics on the raw impedance values; and reducing the dimensionality of the data using unsupervised linear (principal component analysis) and non-linear (uniform manifold approximation and projection) methods. These approaches were rigorously compared using a machine-learning pipeline approach, training linear, Gaussian process, and random forest regression models and quantifying performance using cross-validation as well as a held-out test set. An artificial neural network model trained on the raw spectra was also tested. Promising pipelines were fine-tuned via Bayesian hyperparameter optimization using cross-validation loss and training with class-specific weights to counter data set imbalance. The most reliable method for utilizing impedance in this work was the selection of two optimal frequencies through an exhaustive search, resulting in about 2% mean absolute error on test data for both Gaussian process and random forest model architectures. Interrogation of a variety of models reveals critical frequencies of 100 Hz and 103 Hz for this data set, though the optimal set of frequencies is not necessarily intuitive, i.e., the best performing models are not simply those that use impedance at frequencies that have the highest correlation to the relative discharge capacity. The best performing model is an ensemble model, which is able to predict battery capacity with 1.9% mean absolute error for unseen cells using impedance recorded at a variety of temperatures and states-of-charge.

battery↗

Delegated Regressor, A Robust Approach for Automated Anomaly Detection in the Soil Radon Time Series Data

We propose a new method based on the idea of delegating regressors for predicting the soil radon gas concentration (SRGC) and anomalies in radon or any other time series data. The proposed method is compared to different traditional boosting e.g., Extreme Gradient Boosting (EGB) and simple regression methods e.g., support vector regressors with linear kernel and radial kernel in terms of accurate predictions. R language has been used for the statistical analysis of radon time series (RTS) data. The results obtained show that the proposed methodology predicts SRGC more accurately when compared to different traditional boosting and regression methods. The best correlation is found between the actual and predicted radon concentration for window size of 2 i.e., two days before and after the start of seismic activities. RTS data was collected from 05 February 2017 to 16 February 2018, including 7 seismic events recorded during the study period. Findings of study show that the proposed methodology predicts the SRGC with more precision, for all the window sizes, by overlapping predicted with the actual radon time series concentrations.

54 ENVIRONMENTAL SCIENCES↗

Consistent and reproducible computation of the glass transition temperature from molecular dynamics simulations

In many fields, from semiconductors for opto-electronic applications to ionic liquids (ILs) for separations, the glass transition temperature (Tg) of a material is a useful gauge for its potential use in practical settings. As a result, there is a great deal of interest in predicting Tg using molecular simulations. However, the uncertainty and variation in the trend shift method, a common approach in simulations to predict Tg, can be high. This is due to the need for human intervention in defining a fitting range for linear fits of density with temperature assumed for the liquid and glass phases across the simulated cooling. The definition of such fitting ranges then defines the estimate for the Tg as the intersection of linear fits. We eliminate this need for human intervention by leveraging the Shapiro–Wilk normality test and proposing an algorithm to define the fitting ranges and, consequently, Tg. Through this integration, we incorporate into our automated methodology that residuals must be normally distributed around zero for any fit, a requirement that must be met for any regression problem. Consequently, fitting ranges for realizing linear fits for each phase are statistically defined rather than visually inferred, obtaining an estimate for Tg without any human intervention. The method is also capable of finding multiple linear regimes across density vs temperature curves. We compare the predictions of our proposed method across multiple IL and semiconductor molecular dynamics simulation results from the literature and compare other proposed methods for automatically detecting Tg from density–temperature data. We believe that our proposed method would allow for more consistent predictions of Tg. We make this methodology available and open source through GitHub.

Chemistry↗

An investigation of the detection of tornadic thunderstorms by observing storm top features using geosynchronous satellite imagery

The number of tornado outbreak cases studied in detail was increased from the original 8. Detailed ground and aerial studies were carried out of two outbreak cases of considerable importance. It was demonstrated that multiple regression was able to predict the tornadic potential of a given thunderstorm cell by its cirrus anvil plume characteristics. It was also shown that the plume outflow intensity and the deviation of the plume alignment from storm relative winds at anvil altitude could account for the variance in tornadic potential for a given cell ranging from 0.37 to 0.82 for linear to values near 0.9 for quadratic regression. Several predictors were used in various discriminant analysis models and in censored regression models to obtain forecasts of whether a cell is tornadic and how strong tornadic it could be potentially. The experiments were performed with the synoptic scale vertical shear in the horizontal wind and with synoptic scale surface vorticity in the proximity of the cell.

Anderson, Charles E.↗

Hidden Connections between Regression Models of Strain-Gage Balance Calibration Data

Hidden connections between regression models of wind tunnel strain-gage balance calibration data are investigated. These connections become visible whenever balance calibration data is supplied in its design format and both the Iterative and Non-Iterative Method are used to process the data. First, it is shown how the regression coefficients of the fitted balance loads of a force balance can be approximated by using the corresponding regression coefficients of the fitted strain-gage outputs. Then, data from the manual calibration of the Ames MK40 six-component force balance is chosen to illustrate how estimates of the regression coefficients of the fitted balance loads can be obtained from the regression coefficients of the fitted strain-gage outputs. The study illustrates that load predictions obtained by applying the Iterative or the Non-Iterative Method originate from two related regression solutions of the balance calibration data as long as balance loads are given in the design format of the balance, gage outputs behave highly linear, strict statistical quality metrics are used to assess regression models of the data, and regression model term combinations of the fitted loads and gage outputs can be obtained by a simple variable exchange.

Ulbrich, Norbert↗

Emissions Relationships in Western Forest Fire Plumes: I. Reducing the Effect of Mixing Errors on Emission Factors

Studies of emission factors from biomass burning using aircraft data complement the results of lab studies and extend them to conditions of immense hot conflagrations. We illustrate and discuss emission relationships for 422 individual samples from many forest-fire plumes in the Western US. The samples are from two NASA investigations: ARCTAS (Arctic Research of the Composition of the Troposphere from Aircraft and Satellites) and SEAC4RS (Studies of Emissions and Atmospheric Composition, Clouds, and Climate Coupling by Regional Surveys). This work provides sample-by-sample enhancement ratios (EnRs) for 23 gases and particulate properties. Many EnRs provide candidates for emission ratios (ERs, corresponding to the EnR at the source) when the origin and degree of transformation is understood and appropriate. From these, emission factors (EFs) can be estimated when the fuel dry mass consumed is known or can be estimated using the carbon mass budget approach. This analysis requires understanding the interplay of mixing of the plume with surrounding air. Some initial examples emphasize that measured C(tot) = CO2 + CO in a fire plume does not necessarily describe the emissions of the total carbon liberated in the flames, C(burn). Rather, it represents C(tot) = C(burn) + C(bkgd), which includes possibly varying background concentrations for entrained air. Consequently, we present a simple theoretical description for plume entrainment for multiple tracers from flame to hundreds of kilometers downwind and illustrate some intrinsic linear behaviors. The analysis suggests a Mixed Effects Regression Emission Technique (MERET), which can eliminate occasional strong biases associated with the commonly used normalized excess mixing ratio (NEMR) method. MERET splits C(tot) to reveal C(burn) by exploiting the fact that C(burn) and all tracers respond linearly to dilution, while each tracer has consistent EnR behavior (slope of tracer concentration with respect to C(burn)). The two effects are separable. Two or three or preferably more emission indicators are required as a minimum; here we used ten. Limited variations in the EnRs for each tracer can be incorporated and the variations and co-variations analyzed. The percentage CO yield (or the modified combustion efficiency) plays some role. Other co-relationships involving nitrogen and organic classes are more prominent; these have strong relationships to the C(burn) to O3 emission relationship. In summary, MERET allows fine spatial resolution (EnRs for individual observations) and comparison of similar plumes distant in time and space. Alkene ratios provide us with an approximate photochemical timescale. This allows discrimination and definition, by fire situation, of ERs, allowing us to estimate emission factors.

Chatfield, Robert B.↗

Regression of exchangeable relational arrays

Relational arrays represent measures of association between pairs of actors, often in varied contexts or over time. Trade flows between countries, financial transactions between individuals, contact frequencies between school children in classrooms and dynamic protein-protein interactions are all examples of relational arrays. Elements of a relational array are often modelled as a linear function of observable covariates. Uncertainty estimates for regression coefficient estimators, and ideally the coefficient estimators themselves, must account for dependence between elements of the array, e.g., relations involving the same actor. Existing estimators of standard errors that recognize such relational dependence rely on estimating extremely complex, heterogeneous structure across actors. This paper develops a new class of parsimonious coefficient and standard error estimators for regressions of relational arrays. Here we leverage an exchangeability assumption to derive standard error estimators that pool information across actors, and are substantially more accurate than existing estimators in a variety of settings. This exchangeability assumption is pervasive in network and array models in the statistics literature, but not previously considered when adjusting for dependence in a regression setting with relational data. We demonstrate improvements in inference theoretically, via a simulation study, and by analysis of a dataset involving international trade.

97 MATHEMATICS AND COMPUTING↗

Preliminary evidence for the influence of physiography and scale upon the autocorrelation function of remotely sensed data

Previously established results demonstrate that LANDSAT data are autocorrelated and can be described by a univariate linear stochastic process known as auto-regressive-integrated-moving-average model of degree 1, 0, 1 or ARIMA (1, 0, 1). This model has two coefficients of interest for interpretation phi(1) and theta(1). In a comparison of LANDSAT thematic mapper simulator (TMS) data and LANDSAT MSS data several results were established: (1) The form of the relatedness as described by this model is not dependent upon system look angle or pixel size. (2) The phi(1) coefficient increases with decreasing pixel size and increasing topographic complexity. (3) Changes in topography have a greater influence upon phi(1) than changes in land cover class. (4) The theta(1) seems to vary with the amount of atmospheric haze. These patterns of variation in phi(1) and theta(1) are potentially exploitable by the remote sensing community to yield stochastically independent sets of observations, characterize topography, and reduce the number of bytes needed to store remotely sensed data.

Labovitz, M. L.↗

Evaluation, Analysis, and Application of Internal Strain-Gage Balance Data

Experimental processes, analytical methods, and numerical algorithms are described that may be used to predict the forces and moments of an internal strain-gage balance during a wind tunnel test. First, the control volume model of a strain-gage balance and the concepts of load state, load space, and output space are introduced. These important abstractions provide a better understanding of fundamental characteristics of different balance load prediction approaches. Then, the description of strain-gage balance data and the definition of the primary gage sensitivity is discussed. Afterwards, basic elements of the calibration of a typical six-component balance are reviewed. Two fundamentally different balance load prediction methods, the processing of check loads, and related topics are also discussed. Three real-world balance data examples are reviewed in great detail to illustrate typical analysis results for a variety of strain-gage balance designs. Finally, important observations are summarized and recommendations are provided. Additional information and detailed mathematical derivations can be found in the appendices of the document. They include the following topics: balance terminology, definitions of important statistical metrics, balance axis system conventions, balance load transformations, the combined load diagram, electrical output format options, bi-directional gage output characteristics, determination of the natural zeros, derivation of two balance load prediction methods, description of two tare load iteration algorithms, modeling of balance temperature effects, basics of three-component moment balances, definition of the percent contribution, detection of linear and near-linear dependencies in balance calibration data, a regression model term selection algorithm, and other related topics.

wind tunnel test↗

Evaluation, Analysis, and Application of Internal Strain-Gage Balance Data

Experimental processes, analytical methods, and numerical algorithms are described that may be used to predict the forces and moments of an internal strain–gage balance during a wind tunnel test. First, the control volume model of a strain–gage balance and the concepts of load state, load space, and output space are introduced. These important abstractions provide a better understanding of fundamental characteristics of different balance load prediction approaches. Then, the description of strain–gage balance data and the definition of the primary bridge sensitivity are discussed. Afterwards, basic elements of the calibration of a typical six–component balance are reviewed. Two fundamentally different balance load prediction methods, the processing of check loads, and related topics are also discussed. Three real–world balance data examples are reviewed in great detail to illustrate typical analysis results for a variety of strain–gage balance designs. Finally, important observations are summarized and recommendations are provided. – Additional information and detailed mathematical derivations can be found in the appendices of the document. They include the following topics: balance terminology, definitions of important statistical metrics, balance axis system conventions, balance load transformations, the combined load diagram, electrical output format options, bi–directional output characteristics, determination of the natural zeros, derivation of two balance load prediction methods, description of two tare load iteration algorithms, modeling of balance temperature effects, basics of three–component moment balances, definition of the percent contribution, detection of linear and near–linear dependencies in balance calibration data, a regression model search algorithm, balance interactions, and other related information.

strain-gage balance↗

Computationally Efficient Frequency Domain Method for Dynamic Control Derivative Estimation with Application to Transonic Truss-Braced Wing

This paper presents a computationally efficient method for dynamic control derivative estimation technique via control surface oscillation numerical experiments. Unsteady RANS CFD simulations in FUN3D are performed to simulate the control surface oscillations with a prescribed truncated square wave containing sufficient frequencies of interest. The truncated square wave oscillation offers the computational efficiency which reduces the computational cost by almost an order of magnitude compared to a sine wave oscillation. The nonlinear effect of large control surface oscillation amplitudes creates a spillover effect whereby the frequency response at the same input frequencies contains not only the linear aerodynamic response but also nonlinear aerodynamic response. A correction procedure is developed to remove the spillover effect from the linear aerodynamic response. A frequency-domain regression is performed to estimate the dynamic control derivatives after the correction. The results generally agree with the previous results obtained from the sine wave oscillation.

Stability and Control↗

Summary and Annotated Bibliography of Measurement Error Corrections with Potential Application in Future Quesst Mission Community Noise Studies

This document is motivated by likely needs of the Quesst mission community response tests, which will culminate in data collection and estimation of dose-response regression relationships for consideration by domestic and international aviation regulators. Furthermore, basic research questions evaluating interactions between rates of community annoyance, dose levels, and indicators of the presence of rattle, vibration, and startle hinge on hypothesis testing in the context of regression models. For a variety of reasons, noise doses may be known only imprecisely and may not reflect the actual level experienced by responding subjects. These differences between true dose and estimated dose, be they systematic or random, constitute covariate measurement error. Available statistics literature speaks to the impacts of measurement error on regression models, both in terms of bias in estimated coefficients and predicted values, and in terms of the loss of statistical power for hypothesis testing. Given the particulars of a categorical annoyance response variable and a continuous noise dose predictor variable subject to measurement error during testing, the emphasis of this report is on findings and methods pertinent to generalized linear (and mixed) models likely to be employed during the Quesst mission community tests. We reach the following conclusions: 1. Of four reviewed methods, structural Bayesian measurement error models and simulation extrapolation (SIMEX) may be the most readily applicable to Quesst mission community noise study objectives. 2. If warranted, a linear measurement model can help model systematic sources of measurement error that the classical measurement error does not. 3. For its ready implementation and small additional input requirements, simulation extrapolation may be ideally suited for addressing secondary research questions involving interactions between annoyance, noise dose, and other factors through hypothesis testing. 4. For their flexibility and ability to propagate uncertainty, structural Bayesian hierarchical models have great appeal for mission purposes; some care may be needed in developing appropriate probability models describing actual noise exposure during testing. An annotated bibliography logs additional papers and resources that may be of value to analysts in other projects and disciplines.

Dose-Response Model↗

Analysis of overlapping count data

Counts of a specific characteristic were obtained within regions defined on an object that was manufactured in a proprietary setting. The count regions were altered during production and resulted in misaligned or overlapping count data. A closed-formula maximum likelihood estimator (MLE) of the new region means is derived using all of the available count data and an independent Poisson model. The MLE is shown to be preferable to estimators constructed using generalized linear models for the overlapping data setting. This closed-form estimator extends to over-dispersed overlapping count data as the quasi-MLE and also performs well with correlated overlapping count data. Standard errors for the estimator are approximated and are validated with a simulation study. Additionally, the methods are extended to overlapping multinomial data. Illustrative examples of the methods are provided throughout the paper and are reproducible with the supplemental R code. Additionally, proofs of the paper’s results are also included in the supplemental material.

97 MATHEMATICS AND COMPUTING↗

Three-Stage Adjusted Regression Forecasting for Software Defect Prediction

In this paper, a three-stage adjusted regression forecasting model is proposed to forecast the local regression model [6]. This is a growth curve approximation model that predicts the parameters for a future linear model based on a sliding window of previous linear models. The three stages of the model are as follows: • Initial fit: train regression models on a sliding window of the date and record model coefficients. • Prediction: fit new regression models to the coefficient lists and predict the value of the next coefficient. • Error correction: correct coefficient prediction error using the residual of the last point of the coefficient list and moving average. The resulting model from the multi-stage process is a forecast of the local regression model that represents the future window of data and is referred to as the predicted line. Results suggest the three-stage model demonstrates better prediction capability compared to existing solutions.

Pritchard, Shadow↗

Gaussian process regression constrained by boundary value problems

We develop a framework for Gaussian processes regression constrained by boundary value problems. The framework may be applied to infer the solution of a well-posed boundary value problem with a known second-order differential operator and boundary conditions, but for which only scattered observations of the source term are available. Scattered observations of the solution may also be used in the regression. The framework combines co-kriging with the linear transformation of a Gaussian process together with the use of kernels given by spectral expansions in eigenfunctions of the boundary value problem. Furthermore, it benefits from a reduced-rank property of covariance matrices. We demonstrate that the resulting framework yields more accurate and stable solution inference as compared to physics-informed Gaussian process regression without boundary condition constraints.

42 ENGINEERING↗

Nonlinear Logistic Regression Mixture Experiment Modeling for Binary Data Using Dimensionally Reduced Components

This article presents and illustrates an approach using nonlinear logistic regression for modeling binary response data from a mixture experiment when the components can be partitioned into groups used to form dimensionally-reduced pseudocomponents (DRPs). A DRP is a linear combination of the components in a group, where the linear combinations over all groups are normalized so that the DRP proportions sum to unity. Nonlinear logistic regression is required because, after normalization of the linear combinations, the model expressed in terms of the DRPs is nonlinear in the parameters that specify the linear combinations. A method for obtaining nonparametric tolerance limits on the probability of a “success” for the binary response variable using a bootstrap approach is also presented. Having three DRPs enables viewing data and modeling results on a ternary plot even though there may be many more than three mixture components. A real database, involving whether or not nepheline crystals form in simulated nuclear waste glass after cooling, is used to illustrate the nonlinear logistic regression modeling and nonparametric tolerance limit approaches when there are three DRPs.

Waste glass, Nepheline, Mixture experiment, Logist↗

Machine learning without a processor: Emergent learning in a nonlinear analog network

Standard deep learning algorithms require differentiating large nonlinear networks, a process that is slow and power-hungry. Electronic contrastive local learning networks (CLLNs) offer potentially fast, efficient, and fault-tolerant hardware for analog machine learning, but existing implementations are linear, severely limiting their capabilities. These systems differ significantly from artificial neural networks as well as the brain, so the feasibility and utility of incorporating nonlinear elements have not been explored. Here, we introduce a nonlinear CLLN—an analog electronic network made of self-adjusting nonlinear resistive elements based on transistors. We demonstrate that the system learns tasks unachievable in linear systems, including XOR (exclusive or) and nonlinear regression, without a computer. We find our decentralized system reduces modes of training error in order (mean, slope, curvature), similar to spectral bias in artificial neural networks. The circuitry is robust to damage, retrainable in seconds, and performs learned tasks in microseconds while dissipating only picojoules of energy across each transistor. This suggests enormous potential for fast, low-power computing in edge systems like sensors, robotic controllers, and medical devices, as well as manufacturability at scale for performing and studying emergent learning.

Science & Technology - Other Topics↗

A Comfort Model Simplification for Tight Integration with Grid Service Optimizations

Localized generation, storage, and intelligent power electronics are increasingly being integrated into building. The excess storage, thermal, and generation capacity can be used to develop new markets for ancillary services such as peak reduction, voltage and frequency support, or load flattening. Widespread participation in these markets will make the power grid more resilient. However, widespread participation in these markets will require a simple and intuitive control over the excess capacity by the building occupants. Most importantly for adopting these technologies, participation in these markets should not require sacrificing occupant comfort. Many of the proposed control and optimization technologies for supplying the ancillary services do not explicitly incorporate occupant comfort into their models and when they do, generally utilize a rigid constraint on the indoor air temperature set a priori. This reduces flexibility in using excess thermal capacity. It also cannot take into account uncertainties in local factors that affect thermal comfort such as clothing insulation or relative humidity. In this paper we present and justify some assumptions that simplify the standard predictors of thermal comfort. We also develop a regression model of the thermal comfort that is linear with respect to the indoor air temperature. Next we develop the concept of thermal comfort variation that eliminates the dependence of the thermal comfort on uncertain thermal comfort factors. Then, we present a quadratic program utilizing the thermal comfort variation in both the objective function and as a constraint. Finally, we show the results of a time-of-use cost optimization that utilizes the simplified thermal comfort model.

Melin, Alexander↗