Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “simple linear regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Hidden Connections between Regression Models of Strain-Gage Balance Calibration Data

Hidden connections between regression models of wind tunnel strain-gage balance calibration data are investigated. These connections become visible whenever balance calibration data is supplied in its design format and both the Iterative and Non-Iterative Method are used to process the data. First, it is shown how the regression coefficients of the fitted balance loads of a force balance can be approximated by using the corresponding regression coefficients of the fitted strain-gage outputs. Then, data from the manual calibration of the Ames MK40 six-component force balance is chosen to illustrate how estimates of the regression coefficients of the fitted balance loads can be obtained from the regression coefficients of the fitted strain-gage outputs. The study illustrates that load predictions obtained by applying the Iterative or the Non-Iterative Method originate from two related regression solutions of the balance calibration data as long as balance loads are given in the design format of the balance, gage outputs behave highly linear, strict statistical quality metrics are used to assess regression models of the data, and regression model term combinations of the fitted loads and gage outputs can be obtained by a simple variable exchange.

Ulbrich, Norbert↗

Meteorological adjustment of yearly mean values for air pollutant concentration comparison

Using multiple linear regression analysis, models which estimate mean concentrations of Total Suspended Particulate (TSP), sulfur dioxide, and nitrogen dioxide as a function of several meteorologic variables, two rough economic indicators, and a simple trend in time are studied. Meteorologic data were obtained and do not include inversion heights. The goodness of fit of the estimated models is partially reflected by the squared coefficient of multiple correlation which indicates that, at the various sampling stations, the models accounted for about 23 to 47 percent of the total variance of the observed TSP concentrations. If the resulting model equations are used in place of simple overall means of the observed concentrations, there is about a 20 percent improvement in either: (1) predicting mean concentrations for specified meteorological conditions; or (2) adjusting successive yearly averages to allow for comparisons devoid of meteorological effects. An application to source identification is presented using regression coefficients of wind velocity predictor variables.

Sidik, S. M.↗

On the Observed Changes in Upper Stratospheric and Mesospheric Temperatures from UARS HALOE

Temperature versus pressure or T(p) time series from the Halogen Occultation Experiment (HALOE) on the Upper Atmosphere Research Satellite (UARS) have been extended and re-analyzed for the period of 1991-2005 and for the upper stratosphere and mesosphere in 10-degree wide latitude zones from 60S to 60N. Even though sampling from a solar occultation experiment is somewhat limited, it is shown to be quite adequate for developing both the seasonal and longer-term variations in T(p). Multiple linear regression (MLR) techniques were used in the re-analyses for the seasonal and the significant interannual, solar cycle (SC-like or decadal-scale), and linear trend terms. A simple SC-like term of 11-yr period was fitted to the time series residuals after accounting for the seasonal and interannual terms. Highly significant SC-like responses were found for both the upper mesosphere and the upper stratosphere. The phases of these SC-like terms were checked for their continuity with latitude and pressure-altitude, and in almost all cases they are directly in-phase with that of standard proxies for the solar flux variations. The analyzed, max minus min, responses at low latitudes are of order 1 K, while at middle latitudes they are as large as 3 K in the upper mesosphere. Highly significant, linear cooling trends were found at middle latitudes of the middle to upper mesosphere (about -2 K/decade), at tropical latitudes of the middle mesosphere (about -1 K/decade), and at 2 hPa (or order -1 K/decade).

Remsberg, Ellis E.↗

Linear Least Squares for Correlated Data

Throughout the literature authors have consistently discussed the suspicion that regression results were less than satisfactory when the independent variables were correlated. Camm, Gulledge, and Womer, and Womer and Marcotte provide excellent applied examples of these concerns. Many authors have obtained partial solutions for this problem as discussed by Womer and Marcotte and Wonnacott and Wonnacott, which result in generalized least squares algorithms to solve restrictive cases. This paper presents a simple but relatively general multivariate method for obtaining linear least squares coefficients which are free of the statistical distortion created by correlated independent variables.

Dean, Edwin B.↗

The Global Precipitation Climatology Project: First Algorithm Intercomparison Project

The Global Precipitation Climatology Project (GPCP) was established by the World Climate Research Program to produce global analyses of the area- and time-averaged precipitation for use in climate research. To achieve the required spatial coverage, the GPCP uses simple rainfall estimates derived from IR and microwave satellite observations. In this paper, we describe the GPCP and its first Algorithm Intercomparison Project (AIP/1), which compared a variety of rainfall estimates derived from Geostationary Meteorological Satellite visible and IR observations and Special Sensor Microwave/Imager (SSM/I) microwave observations with rainfall derived from a combination of radar and raingage data over the Japanese islands and the adjacent ocean regions during the June and mid-July through mid-August periods of 1989. To investigate potential improvements in the use of satellite IR data for the estimation of large-scale rainfall for the GPCP, the relationship between rainfall and the fractional coverage of cold clouds in the AIP/1 dataset is examined. Linear regressions between fractional coverage and rainfall are analyzed for a number of latitude-longitude areas and for a range of averaging times. The results show distinct differences in the character of the relationship for different portions of the area. These results suggest that the simple IR-based estimation technique currently used in the GPCP can be used to estimate rainfall for global tropical and subtropical areas, provided that a method for adjusting the proportional coefficient for varying areas and seasons can be determined.

Arkin, Phillip A.↗

When less is more: How increasing the complexity of machine learning strategies for geothermal energy assessments may not lead toward better estimates

Previous moderate- and high-temperature geothermal resource assessments of the western United States utilized data-driven methods and expert decisions to estimate resource favorability. Although expert decisions can add confidence to the modeling process by ensuring reasonable models are employed, expert decisions also introduce human and, thereby, model bias. This bias can present a source of error that reduces the predictive performance of the models and confidence in the resulting resource estimates. Our study aims to develop robust data-driven methods with the goals of reducing bias and improving predictive ability. We present and compare nine favorability maps for geothermal resources in the western United States using data from the U.S. Geological Survey's 2008 geothermal resource assessment. Two favorability maps are created using the expert decision-dependent methods from the 2008 assessment (i.e., weight-of-evidence and logistic regression). With the same data, we then create six different favorability maps using logistic regression (without underlying expert decisions), XGBoost, and support-vector machines paired with two training strategies. The training strategies are customized to address the inherent challenges of applying machine learning to the geothermal training data, which have no negative examples and severe class imbalance. We also create another favorability map using an artificial neural network. We demonstrate that modern machine learning approaches can improve upon systems built with expert decisions. We also find that XGBoost, a non-linear algorithm, produces greater agreement with the 2008 results than linear logistic regression without expert decisions, because the expert decisions in the 2008 assessment rendered the otherwise linear approaches non-linear despite the fact that the 2008 assessment used only linear methods. The F1 scores for all approaches appear low (F1 score < 0.10), do not improve with increasing model complexity, and, therefore, indicate the fundamental limitations of the input features (i.e., training data). Until improved feature data are incorporated into the assessment process, simple non-linear algorithms (e.g., XGBoost) perform equally well or better than more complex methods (e.g., artificial neural networks) and remain easier to interpret.

15 GEOTHERMAL ENERGY↗

Inverse sequential procedures for the monitoring of time series

When one or more new values are added to a developing time series, they change its descriptive parameters (mean, variance, trend, coherence). A 'change index (CI)' is developed as a quantitative indicator that the changed parameters remain compatible with the existing 'base' data. CI formulate are derived, in terms of normalized likelihood ratios, for small samples from Poisson, Gaussian, and Chi-Square distributions, and for regression coefficients measuring linear or exponential trends. A substantial parameter change creates a rapid or abrupt CI decrease which persists when the length of the bases is changed. Except for a special Gaussian case, the CI has no simple explicit regions for tests of hypotheses. However, its design ensures that the series sampled need not conform strictly to the distribution form assumed for the parameter estimates. The use of the CI is illustrated with both constructed and observed data samples, processed with a Fortran code 'Sequitor'.

Radok, Uwe↗

Very High Resolution, Altitude-Corrected, TMPA-Based Monthly Satellite Precipitation Product Over the CONUS

The Tropical Rainfall Measuring Mission (TRMM) Multisatellite Precipitation Analysis (TMPA) product provided over 17 years of gridded precipitation datasets. However, the accuracy and spatial resolution of TMPA limits the applicability in hydrometeorological applications. We present a dataset that enhances the accuracy and spatial resolution of the TMPA monthly product (3B43). We resample the TMPA data to a 1 km grid and apply a correction function derived from the Parameter-elevation Regressions on Independent Slopes Model (PRISM) to reduce bias in the data. We confirm a linear relationship between bias and elevation above 1,500 meters where TMPA underestimates measured precipitation, providing a proof-of-concept of how simple linear scaling can be used to augment existing satellite datasets. The result of the correction is the High-Resolution Altitude-Corrected Precipitation product (HRAC-Precip) for the CONUS. Using 9,200 precipitation stations from the Global Historical Climatology Network (GHCN), we compare the accuracy of TMPA 3B43 versus the new HRAC-Precip product. The results show an improvement of the mean absolute error of 12.98% on average.

Hossein Hashemi↗

Application of stepwise multiple regression techniques to inversion of Nimbus 'IRIS' observations.

Exploratory studies with Nimbus-3 infrared interferometer-spectrometer (IRIS) data indicate that, in addition to temperature, such meteorological parameters as geopotential heights of pressure surfaces, tropopause pressure, and tropopause temperature can be inferred from the observed spectra with the use of simple regression equations. The technique of screening the IRIS spectral data by means of stepwise regression to obtain the best radiation predictors of meteorological parameters is validated. The simplicity of application of the technique and the simplicity of the derived linear regression equations - which contain only a few terms - suggest usefulness for this approach. Based upon the results obtained, suggestions are made for further development and exploitation of the stepwise regression analysis technique.

Ohring, G.↗

Seismicity and the subduction process

There is considerable variation between subduction zones in the largest characteristic earthquake within each zone. Assuming that coupling between downgoing and upper plates is directly related to characteristic earthquake size, tests for correlations between variation in coupling and other physical features of subduction zones are conducted: the lateral extent and penetration depth of Benioff zones, age of subducting lithosphere, convergence rate, and back-arc spreading. Using linear multivariate regression, coupling is correlated with two variables: convergence rate and lithosphere age. Secondary correlations within the data set are penetration depth versus lithosphere age, and lateral extent versus convergence rate. Taken together, the observed correlations suggest a simple qualitative model where convergence rate and lithosphere age determine the horizontal and sinking rates, respectively, of slabs: these parameters influence the seismic coupling in the subduction zone. In the limit of a fast sinking rate and slow convergence rate, back-arc spreading occurs and thereby appears to be a passive process.

Ruff, L.↗

Accurate parameterization of the kinetic energy functional

The absence of a reliable formulation of kinetic energy density functional has hindered the development of orbital free density functional theory. Using the data-aided learning paradigm, we propose a simple prescription to accurately model the kinetic energy density of any system. Our method relies on a dictionary of functional forms for local and nonlocal contributions which have been proposed in the literature and the appropriate coefficients are calculated via a linear regression framework. To model the nonlocal contributions, we explore two new nonlocal functionals - a functional that captures fluctuations in electronic density and a functional that incorporates gradient information. Since, the analytical functional forms of the kernels present in these nonlocal terms are not known from theory, we propose a basis function expansion to model these seemingly difficult nonlocal quantities. This allows us to easily reconstruct kernels for any system using only a few structures. The proposed method is able to learn kinetic energy densities and total kinetic energies of molecular and periodic systems, such as H 2 , LiH, LiF and a one-dimensional chain of 8 hydrogens using data from Kohn-Sham density functional theory calculations for only a few structures. For the ease of reproduction, codes used to generate the models are provided in the supporting materials.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Parameter inference from event ensembles and the top-quark mass

One of the key tasks of any particle collider is measurement. In practice, this is often done by fitting data to a simulation, which depends on many parameters. Sometimes, when the effects of varying different parameters are highly correlated, a large ensemble of data may be needed to resolve parameter-space degeneracies. An important example is measuring the top-quark mass, where other physical and unphysical parameters in the simulation must be profiled when fitting the top-quark mass parameter. We compare four different methodologies for top-quark mass measurement: a classical histogram fit similar to one commonly used in experiment augmented by soft-drop jet grooming; a 2D profile likelihood fit with a nuisance parameter; a machine-learning method called DCTR; and a linear regression approach, either using a least-squares fit or with a dense linearly-activated neural network. Despite the fact that individual events are totally uncorrelated, we find that the linear regression methods work most effectively when we input an ensemble of events sorted by mass, rather than training them on individual events. Although all methods provide robust extraction of the top-quark mass parameter, the linear network does marginally best and is remarkably simple. For the top study, we conclude that the Monte-Carlo-based uncertainty on current extractions of the top-quark mass from LHC data can be reduced significantly (by perhaps a factor of 2) using networks trained on sorted event ensembles. More generally, machine learning from ensembles for parameter estimation has broad potential for collider physics measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Machine learning elastic constants of multi-component alloys

The present manuscript explores application of machine learning methods for determining elastic constants and other derived mechanical properties of multi-component alloys. Here, a number of machine learning models, including linear regression, neural network and random forest based models, are trained and tested on a dataset of binary alloys generated using density functional theory (DFT) calculations and spanning over a large number of elemental species in the periodic table. Starting with a wide range of simple and easily accessible compositionally-averaged elemental features, a correlation-based feature selection strategy was used to systematically down-select a set of most relevant features towards the prediction of the elasticity tensor components. The true predictive performance and the associated uncertainties of the models were established by testing on unseen data and bootstrapping, respectively. A single and pair-wise feature partial dependence analysis was performed to visualize the average property trends in the multi-dimensional feature space in order to further understand the achieved predictive performance. The utility of the trained model is further demonstrated by obtaining sufficiently accurate yet highly efficient approximations for bulk modulus, Young’s modulus, shear modulus and Poisson’s ratio for alloys beyond the binary space (i.e., two-component alloys) on which the model was originally trained. More importantly, we test and validate the predictive performance of the developed model directly against the experimentally measured elastic constants of technologically relevant multi-component alloys (such as, Ni- and Ti-based alloys). Finally, utility of such a data-enabled route is demonstrated by predicting the possible range of various elastic properties for vast composition space available within the five component Ni-Cr-Fe-Mo-W alloy system in a high-throughput manner.

36 MATERIALS SCIENCE↗

The Fringe-Imaging Skin Friction Technique PC Application User's Manual

A personal computer application (CXWIN4G) has been written which greatly simplifies the task of extracting skin friction measurements from interferograms of oil flows on the surface of wind tunnel models. Images are first calibrated, using a novel approach to one-camera photogrammetry, to obtain accurate spatial information on surfaces with curvature. As part of the image calibration process, an auxiliary file containing the wind tunnel model geometry is used in conjunction with a two-dimensional direct linear transformation to relate the image plane to the physical (model) coordinates. The application then applies a nonlinear regression model to accurately determine the fringe spacing from interferometric intensity records as required by the Fringe Imaging Skin Friction (FISF) technique. The skin friction is found through application of a simple expression that makes use of lubrication theory to relate fringe spacing to skin friction.

Zilliac, Gregory G.↗

Association Between Injection and Microseismicity in Geothermal Fields With Multiple Wells: Data-Driven Modeling of Rotokawa, New Zealand, and Húsmúli, Iceland

Understanding injection-induced microseismicity in geothermal systems can provide insight into reservoir connectedness. However, fault and reservoir complexity are difficult to represent in simple analytical models, which makes it difficult to discern clear relationships from incidental associations. Here, we have used data-driven models to study how fluid injection and microseismicity are related in the Rotokawa (New Zealand) and Hellisheiði (Iceland) geothermal fields. We tested two classes of model: (a) lagged linear regression of seismicity rate as a function of well injection rates; and (b) systematic extraction of injection time series features that are then evaluated for associations with the seismicity. These models allowed us to determine which wells had the greatest correlation with microseismicity and to explain this association in a reservoir context. Finally, exploring different data types and transformations, we were unable to establish a link between rapid changes in injection rate and seismicity spikes, as suggested by some theoretical models.

15 GEOTHERMAL ENERGY↗

High performance liquid chromatographic assay for the quantitation of total glutathione in plasma

A simple and widely used homocysteine HPLC procedure was applied for the HPLC identification and quantitation of glutathione in plasma. The method, which utilizes SBDF as a derivatizing agent utilizes only 50 microl of sample volume. Linear quantitative response curve was generated for glutathione over a concentration range of 0.3125-62.50 micromol/l. Linear regression analysis of the standard curve exhibited correlation coefficient of 0.999. Limit of detection (LOD) and limit of quantitation (LOQ) values were 5.0 and 15 pmol, respectively. Glutathione recovery using this method was nearly complete (above 96%). Intra-assay and inter-assay precision studies reflected a high level of reliability and reproducibility of the method. The applicability of the method for the quantitation of glutathione was demonstrated successfully using human and rat plasma samples.

Non-NASA Center↗

Effects of porosity on weld-joint tensile strength of aluminum alloys

Tensile properties in defect-free weldments of aluminum alloys 2014-T6 and 2219-T87 (sheet and plate) are shown to be related to the level or concentration of induced simulated porosity. The scatter diagram shows that the ultimate tensile strength of the weldments displays the most pronounced linear relationship with the level of porosity. The relationships between yield strength or elongation and porosity are either trivial or inconsequential in the lower and intermediate levels of porosity content. In highly concentrated levels of porosity, both yield strength and elongation values decrease markedly. Correlation coefficients were obtained by simple straight line regression analysis between the variables of ultimate tensile strength and pore level. The coefficients were greater, indicating a better correlation, using a pore area accumulation concept or pore volume accumulation than the accumulation of the pore diameters. These relationships provide a useful tool for assessing the existing aerospace radiographic acceptance standards with respect to permissible porosity. In addition, these relationships, in combination with known design load requirements, will serve as an engineering guideline in determining when a weld repair is necessary based on accumulative pore level as detected by radiographic techniques.

Lovoy, C. V.↗

Canopy reflectance modelling of semiarid vegetation

Three different types of remote sensing algorithms for estimating vegetation amount and other land surface biophysical parameters were tested for semiarid environments. These included statistical linear models, the Li-Strahler geometric-optical canopy model, and linear spectral mixture analysis. The two study areas were the National Science Foundation's Jornada Long Term Ecological Research site near Las Cruces, NM, in the northern Chihuahuan desert, and the HAPEX-Sahel site near Niamey, Niger, in West Africa, comprising semiarid rangeland and subtropical crop land. The statistical approach (simple and multiple regression) resulted in high correlations between SPOT satellite spectral reflectance and shrub and grass cover, although these correlations varied with the spatial scale of aggregation of the measurements. The Li-Strahler model produced estimated of shrub size and density for both study sites with large standard errors. In the Jornada, the estimates were accurate enough to be useful for characterizing structural differences among three shrub strata. In Niger, the range of shrub cover and size in short-fallow shrublands is so low that the necessity of spatially distributed estimation of shrub size and density is questionable. Spectral mixture analysis of multiscale, multitemporal, multispectral radiometer data and imagery for Niger showed a positive relationship between fractions of spectral endmembers and surface parameters of interest including soil cover, vegetation cover, and leaf area index.

Franklin, Janet↗