Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Linear Regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Analysis of regression methods for solar activity forecasting

The paper deals with the potential use of the most recent solar data to project trends in the next few years. Assuming that a mode of solar influence on weather can be identified, advantageous use of that knowledge presumably depends on estimating future solar activity. A frequently used technique for solar cycle predictions is a linear regression procedure along the lines formulated by McNish and Lincoln (1949). The paper presents a sensitivity analysis of the behavior of such regression methods relative to the following aspects: cycle minimum, time into cycle, composition of historical data base, and unnormalized vs. normalized solar cycle data. Comparative solar cycle forecasts for several past cycles are presented as to these aspects of the input data. Implications for the current cycle, No. 21, are also given.

Lundquist, C. A.↗

Noninvasive assessment of left atrial maximum dP/dt by a combination of transmitral and pulmonary venous flow

OBJECTIVES: The study assessed whether hemodynamic parameters of left atrial (LA) systolic function could be estimated noninvasively using Doppler echocardiography. BACKGROUND: Left atrial systolic function is an important aspect of cardiac function. Doppler echocardiography can measure changes in LA volume, but has not been shown to relate to hemodynamic parameters such as the maximal value of the first derivative of the pressure (LA dP/dt(max)). METHODS: Eighteen patients in sinus rhythm were studied immediately before and after open heart surgery using simultaneous LA pressure measurements and intraoperative transesophageal echocardiography. Left atrial pressure was measured with a micromanometer catheter, and LA dP/dt(max) during atrial contraction was obtained. Transmitral and pulmonary venous flow were recorded by pulsed Doppler echocardiography. Peak velocity, and mean acceleration and deceleration, and the time-velocity integral of each flow during atrial contraction was measured. The initial eight patients served as the study group to derive a multilinear regression equation to estimate LA dP/dt(max) from Doppler parameters, and the latter 10 patients served as the test group to validate the equation. A previously validated numeric model was used to confirm these results. RESULTS: In the study group, LA dP/dt(max) showed a linear relation with LA pressure before atrial contraction (r = 0.80, p < 0.005), confirming the presence of the Frank-Starling mechanism in the LA. Among transmitral flow parameters, mean acceleration showed the strongest correlation with LA dP/dt(max) (r = 0.78, p < 0.001). Among pulmonary venous flow parameters, no single parameter was sufficient to estimate LA dP/dt(max) with an r2 > 0.30. By stepwise and multiple linear regression analysis, LA dP/dt(max) was best described as follows: LA dP/dt(max) = 0.1 M-AC +/- 1.8 P-V - 4.1; r = 0.88, p < 0.0001, where M-AC is the mean acceleration of transmitral flow and P-V is the peak velocity of pulmonary venous flow during atrial contraction. This equation was tested in the latter 10 patients of the test group. Predicted and measured LA dP/dt(max) correlated well (r = 0.90, p < 0.0001). Numerical simulation verified that this relationship held across a wide range of atrial elastance, ventricular relaxation and systolic function, with LA dP/dt(max) predicted by the above equation with r = 0.94. CONCLUSIONS: A combination of transmitral and pulmonary venous flow parameters can provide a hemodynamic assessment of LA systolic function.

NASA Discipline Cardiopulmonary↗

Rapid subsurface analysis of frequency-domain thermoreflectance images with K-means clustering

K-means clustering analysis is applied to frequency-domain thermoreflectance (FDTR) hyperspectral image data to rapidly screen the spatial distribution of thermophysical properties at material interfaces. Performing FDTR while raster scanning a sample consisting of 8.6 μm of doped-silicon (Si) bonded to a doped-Si substrate identifies spatial variation in the subsurface bond quality. Routine thermal analysis at select pixels quantifies this variation in bond quality and allows assignment of bonded, partially bonded, and unbonded regions. Performing this same routine thermal analysis across the entire map, however, becomes too computationally demanding for rapid screening of bond quality. To address this, K-means clustering was used to reduce the dimensionality of the dataset from more than 20 000 pixel spectra to just K = 3 component spectra. The three component spectra were then used to express every pixel in the image through a least-squares minimized linear combination providing continuous interpolation between the components across spatially varying features, e.g., bonded to unbonded transition regions. Fitting the component spectra to the thermal model, thermal properties for each K cluster are extracted and then distributed according to the weighting established by the regressed linear combination. Thermophysical property maps are then constructed and capture significant variation in bond quality over 25 μm length scales. The use of K-means clustering to achieve these thermal property maps results in a 74-fold speed improvement over explicit fitting of every pixel.

36 MATERIALS SCIENCE↗

Validation and application of single breath cardiac output determinations in man

The results of a procedure for estimating cardiac output by a single-breath technique (Qsb), obtained in healthy males during supine rest and during exercise on a bicycle ergometer, were compared with the results on cardiac output obtained by the direct Fick method (QF). The single breath maneuver consisted of a slow exhalation to near residual volume following an inspiration somewhat deeper than normal. The Qsb calculations incorporated an equation of the CO2 dissociation curve and a 'moving spline' sequential curve-fitting technique to calculate the instantaneous R from points on the original expirogram. The resulting linear regression equation indicated a 24-percent underestimation of QF by the Qsb technique. After applying a correction, the Qsb-QF relationship was improved. A subsequent study during upright rest and exercise to 80 percent of VO2(max) in 6 subjects indicated a close linear relationship between Qsb and VO2 for all 95 values obtained, with slope and intercept close to those in published studies in which invasive cardiac output measurements were used.

Loeppky, J. A.↗

Chapter 5: Extravehicular Activity Metabolic Rate Model: Metabolic Rate Estimated from Heart Rate

In-flight monitoring of crew metabolic rates during extravehicular activity (EVA) provides crucial information in mitigating injury. The purpose of this study was to investigate the relationship of crewmember heart rate (HR) and metabolic rate (MR) during EVA operations to develop a predictive linear model. HR and MR data was collected from 132 EVAs from Shuttle and International Space Station (ISS) missions. MR was collected every 2-min from portable life support system delta oxygen decay, while HR was collected every 20-sec via electrocardiogram. HR was down sampled to every 2-min to match MR during EVA for evaluation. Further, a new metric was observed from direct relations between metabolic rate with HR over EVA time (MR/HR) measured as a BTU/beat. A range of BTU/beat was collected as a conversion scale between MR and HR at different EVA workloads categorized by increased MR. Both HR and MR values were observed to decrease through the duration of EVA. Similarly, HR and MR slopes decreased at start of EVA compared to end of EVA. MR/HR values were used to predict MR from HR over the entire duration of EVA with root mean square error less than 200 BTU/Hr. Additionally, MR was predicted based on HR values during EVA via a calculated simple linear regression. A regression equation was found for each EVA drawing relations between HR and MR (F (2923.84) and P<0.0001) with an R(sup 2) value of 0.402. Individual crew regressions improved prediction and R(sup 2) to greater than 0.82. Two models are presented to determine metabolic rate from heart rate during EVA. Results draw correlations for heart rate and metabolic rate fluctuations during EVA for individualized crew predictions during future operations. The linear models correlate to Apollo prediction data during historic EVAs.

Metabolic rate predictions↗

Neural Network and Regression Approximations in High Speed Civil Transport Aircraft Design Optimization

Nonlinear mathematical-programming-based design optimization can be an elegant method. However, the calculations required to generate the merit function, constraints, and their gradients, which are frequently required, can make the process computational intensive. The computational burden can be greatly reduced by using approximating analyzers derived from an original analyzer utilizing neural networks and linear regression methods. The experience gained from using both of these approximation methods in the design optimization of a high speed civil transport aircraft is the subject of this paper. The Langley Research Center's Flight Optimization System was selected for the aircraft analysis. This software was exercised to generate a set of training data with which a neural network and a regression method were trained, thereby producing the two approximating analyzers. The derived analyzers were coupled to the Lewis Research Center's CometBoards test bed to provide the optimization capability. With the combined software, both approximation methods were examined for use in aircraft design optimization, and both performed satisfactorily. The CPU time for solution of the problem, which had been measured in hours, was reduced to minutes with the neural network approximation and to seconds with the regression method. Instability encountered in the aircraft analysis software at certain design points was also eliminated. On the other hand, there were costs and difficulties associated with training the approximating analyzers. The CPU time required to generate the input-output pairs and to train the approximating analyzers was seven times that required for solution of the problem.

Patniak, Surya N.↗

How analytic choices can affect the extraction of electromagnetic form factors from elastic electron scattering cross section data

Scientists often try to incorporate prior knowledge into their regression algorithms, such as a particular analytic behavior or a known value at a kinematic endpoint. Unfortunately, there is often no unique way to make use of this prior knowledge, and thus, different analytic choices can lead to very different regression results from the same set of data. In this paper, to illustrate this point in the context of the proton electromagnetic form factors, we use the Mainz elastic data with its 1422 cross section points and 31 normalization parameters. Starting with a complex unbound non-linear regression, we will show how the addition of a single theory-motivated constraint removes an oscillation from the magnetic form factor and shifts the extracted proton charge radius. We then repeat both regressions using the same algorithm, but with a rebinned version of the Mainz dataset. These examples illustrate how analytic choices, such as the function that is being used or even the binning of the data, can dramatically affect the results of a complex regression. These results also demonstrate why it is critical when using regression algorithms to have either a physical model in mind or a firm mathematical basis

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

pnnl/simple-building-calculator

The Simple Building Calculator is a web application that estimates annual energy use using regression models that have been fit to simulation results for the DOE Commercial Prototype Building Models. The tool is a single-page application that will allow a user to rapidly analyze the impact of energy efficiency measures and design options on building performance. As it uses linear regression models rather than more complicated machine learning models or physics based simulation, the tool can deploy easily and run client-side.

Xu, Weili↗

Optimal Estimation-Based Algorithm to Retrieve Aerosol Optical Properties for GEMS Measurements Over Asia

The Geostationary Environment Monitoring Spectrometer (GEMS) is scheduled to be in orbit in 2019 onboard the GEO-KOMPSAT 2B satellite and will continuously monitor air quality over Asia. The GEMS will make measurements in the UV spectrum (300-500 nm) with 0.6 nm resolution. In this study, an algorithm is developed to retrieve aerosol optical properties from UV-visible measurements for the future satellite instrument and is tested using 3 years of existing OMI L1B data. This algorithm provides aerosol optical depth (AOD), single scattering albedo (SSA) and aerosol layer height (ALH) using an optimized estimation method. The retrieved AOD shows good correlation with Aerosol Robotic Network (AERONET) AOD with correlation coefficients of 0.83, 0.73 and 0.80 for heavy-absorbing fine (HAF) particles, dust and non-absorbing (NA) particles, respectively. However, regression tests indicate underestimation and overestimation of HAF and NA AOD, respectively. In comparison with AOD from the OMI/Aura Near-UV Aerosol Optical Depth and Single Scattering Albedo 1-orbit L2 Swath 13 km x 24 km V003 (OMAERUV) algorithm, the retrieved AOD has a correlation coefficient of 0.86 and linear regression equation, AOD(sub GEMS) = 1.18AOD(sub OMAERUV) + 0.09. An uncertainty test based on a reference method, which estimates retrieval error by applying the algorithm to simulated radiance data, revealed that assumptions in the spectral dependency of aerosol absorptivity in the UV cause significant errors in aerosol property retrieval, particularly the SSA retrieval. Consequently, retrieved SSAs did not show good correlation with AERONET values. The ALH results were qualitatively compared with the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) products and were found to be well correlated for highly absorbing aerosols. The difference between the attenuated-backscatter-weighted height from CALIOP and retrieved ALH were mostly closed to zero when the retrieved AOD is higher than 0.8 and SSA is lower than 0.93. Although retrieval accuracy was not significantly improved, the simultaneous consistent retrieval of AOD, SSA and ALH alone demonstrates the value of this stand-alone algorithm, given their nature for error using other methods. The use of these properties as input parameters for the air mass factor calculation is expected to improve the retrieval of other trace gases over Asia.

Geostationary Environment Monitoring Spectrometer ↗

Regression Analysis of Long-Term Profile Ozone Data Set from BUV Instruments

We have produced a profile merged ozone data set (MOD) based on the SBUV/SBUV2 series of nadir-viewing satellite backscatter instruments, covering the period from November 1978 - December 2003. In 2004, data from the Nimbus 7 SBUV and NOAA 9, ll, and 16 SBUV/2 instruments were reprocessed using the Version 8 (V8) algorithm and most recent calibrations. More recently, data from the Nimbus 4 BUT instrument, which was operational from 1970 - 1977, were also reprocessed using the V8 algorithm. As part of the V8 profile calibration, the Nimbus 7 and NOAA 9 (1993-1997 only) instrument calibrations have been adjusted to match the NOAA 11 calibration, which was established based on comparisons with SSBUV shuttle flight data. Differences between NOAA 11, Nimbus 7 and NOAA 9 profile zonal means are within plus or minus 5% at all levels when averaged over the respective periods of data overlap. NOAA 16 SBUV/2 data have insufficient overlap with NOAA 11, so its calibration is based on pre-flight information. Mean differences over 4 months of overlap are within plus or minus 7%. Given the level of agreement between the data sets, we simply average the ozone values during periods of instrument overlap to produce the MOD profile data set. Initial comparisons of coincident matches of N4 BUV and Arosa Umkehr data show mean differences of 0.5 (0.5)% at 30km; 7.5 (0.5)% at 35 km; and 11 (0.7)% at 40 km, where the number in parentheses is the standard error of the mean. In this study, we use the MOD profile data set (1978-2003) to estimate the change in profile ozone due to changing stratospheric chlorine levels. We use a standard linear regression model with proxies for the seasonal cycle, solar cycle, QBO, and ozone trend. To account for the non-linearity of stratospheric chlorine levels since the late 1990s, we use a time series of Effective Chlorine, defined as the global average of Chlorine + 50 * Bromine at 1 hPa, as the trend proxy. The Effective Chlorine data are taken from the 3-D Goddard CTM. We will show the latest trend results using this statistical model. In addition, the Nimbus 4 BUV data offer an opportunity to test the physical properties of our statistical model. From ground-based comparisons we will establish an uncertainty range for the Nimbus 4 data. We then extrapolate our statistical model fit backwards in time and compare to the Nimbus 4 data. We compare the characteristics of the residual, defined as the difference between the data and statistical regression fit, during the Nimbus 4 time period and the 1978-2003 period over which the statistical model coefficients were estimated, and present these results.

Stolarski, Richard S.↗

ASP (Adaptive Splines for Prediction) [SWR-22-66]

This software package provides functionality to fit piecewise cubic splines to model the relationship between a univariate X (independent variable) and a univariate Y (dependent variable). The output is akin to linear regression but has higher "capacity" in that it can learn more complicated relationships despite leveraging only a single predictor. It thus can learn very reasonable relationships between X and Y with minimal effort. The canonical intended use case is for predicting electric demand (Y) from temperature (X). There can be complicated, non-linear relationships between these two variables, but these can be reasonably approximated by the sum of: 1) an "aggregate" relationship between daily average temperature and daily average demand, and 2) intra-day patterns represented as hourly offsets from the daily average load. The spline functionality is used for learning a robust "aggregate" relationship without the inconvenience of manual feature engineering while still ensuring robust results. The model fitting workhorse is R's built-in smooth.spline. This package provides a suite of options for controlling how smooth.spline fits a spline to the data. In particular, it is designed to return a model with a single critical point (i.e., a single location along the domain/support where the first derivative is zero). This is to ensure that predicted changes in electric demand are always positive as temperatures become more extreme. This helps to prevent overfitting, particularly when the input data has few observations or has significant uncertainty from other sources.

Murphy, Sinnott↗

Primordial non-Gaussianity from the completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey – I: Catalogue preparation and systematic mitigation

ABSTRACT We investigate the large-scale clustering of the final spectroscopic sample of quasars from the recently completed extended Baryon Oscillation Spectroscopic Survey (eBOSS). The sample contains 343 708 objects in the redshift range 0.8 < z < 2.2 and 72 667 objects with redshifts 2.2 < z < 3.5, covering an effective area of $4699\, {\rm deg}^{2}$. We develop a neural network-based approach to mitigate spurious fluctuations in the density field caused by spatial variations in the quality of the imaging data used to select targets for follow-up spectroscopy. Simulations are used with the same angular and radial distributions as the real data to estimate covariance matrices, perform error analyses, and assess residual systematic uncertainties. We measure the mean density contrast and cross-correlations of the eBOSS quasars against maps of potential sources of imaging systematics to address algorithm effectiveness, finding that the neural network-based approach outperforms standard linear regression. Stellar density is one of the most important sources of spurious fluctuations, and a new template constructed using data from the Gaia spacecraft provides the best match to the observed quasar clustering. The end-product from this work is a new value-added quasar catalogue with the improved weights to correct for non-linear imaging systematic effects, which will be made public. Our quasar catalogue is used to measure the local-type primordial non-Gaussianity in a companion paper.

79 ASTRONOMY AND ASTROPHYSICS↗

Engine With Regression and Neural Network Approximators Designed

At the NASA Glenn Research Center, the NASA engine performance program (NEPP, ref. 1) and the design optimization testbed COMETBOARDS (ref. 2) with regression and neural network analysis-approximators have been coupled to obtain a preliminary engine design methodology. The solution to a high-bypass-ratio subsonic waverotor-topped turbofan engine, which is shown in the preceding figure, was obtained by the simulation depicted in the following figure. This engine is made of 16 components mounted on two shafts with 21 flow stations. The engine is designed for a flight envelope with 47 operating points. The design optimization utilized both neural network and regression approximations, along with the cascade strategy (ref. 3). The cascade used three algorithms in sequence: the method of feasible directions, the sequence of unconstrained minimizations technique, and sequential quadratic programming. The normalized optimum thrusts obtained by the three methods are shown in the following figure: the cascade algorithm with regression approximation is represented by a triangle, a circle is shown for the neural network solution, and a solid line indicates original NEPP results. The solutions obtained from both approximate methods lie within one standard deviation of the benchmark solution for each operating point. The simulation improved the maximum thrust by 5 percent. The performance of the linear regression and neural network methods as alternate engine analyzers was found to be satisfactory for the analysis and operation optimization of air-breathing propulsion engines (ref. 4).

Patnaik, Surya N.↗

Machine learning models for estimating contamination across different curbside collection strategies

Contaminated recyclables, which are frequently discarded as waste, pose a significant challenge to the implementation of a circular economy. These contaminated recyclables impede the circulation of resources, resulting in higher processing costs at material recovery facilities (MRFs). Over the past few decades, machine learning (ML) models such as linear regression (LR), support vector machine (SVM), and random forest (RF) have evolved to provide new methods for predicting inbound contamination rates in addition to traditional statistical models. In this study, we applied ML models to predict inbound contamination rates using demographic features from 15 counties in the U.S. with different curbside collection strategies. In general, we found that ML models outperformed linear mixed models. Specifically, SVM models had the highest performance (R 2 = 0.75; mean absolute error (MAE) = 0.06), which may be due to their ability to model nonlinear relationships between features and inbound contamination rates. Further, the key predictor was population, with poverty rate being positively correlated and median age negatively correlated with inbound contamination rates. To improve the management of contamination and enhance the implementation of a circular economy, better models are needed to understand and estimate inbound contamination rates as well as identify critical factors in the present and future.

54 ENVIRONMENTAL SCIENCES↗

Intercomparison of sensible and latent heat flux measurements from combined eddy covariance, energy balance, and Bowen ratio methods above a grassland prairie

We present a comparison of four different methods of measuring sensible (H) and latent (LE) heat fluxes for a year over a mixed grass prairie ecosystem in the Nebraska SandHills [eddy covariance (EC), energy balance/Bowen ratio (EBBR), residual energy (RES), modified Bowen ratio (MBR) methods]. Additionally, we developed a set of quality control criteria for each method and present a simplification to the traditional EBBR setup. Using EC as reference, all methods yielded similar estimates of yearly H (regression slopes (m) ~ 2% from unity; H EC > H EBBR , H RES , and H MBR ). For yearly LE, EBBR and RES yielded similar estimates with EC (m ~ 2% from unity; LE EC < LE EBBR and LE RES ), while a larger bias was found from MBR (m ~ 8% from unity; LE EC > LE MBR ). At shorter time scales (~ hourly), moderate scatter was found about linear regression fits for H between EBBR and EC (R 2 = 0.81), with smaller scatter between RES and MBR, and EC (R 2 = 0.91). For LE, smaller scatter was also measured between EC, and EBBR and RES (R 2 = 0.89 and 0.87, respectively), with the larger scatter between EC and MBR (R 2 = 0.65). This suggests methods other than EC may be well suited to longer-term applications (≥ yearly), but have larger uncertainty on individual measurements.

54 ENVIRONMENTAL SCIENCES↗

Regression and ratio estimators to integrate AVHRR and MSS data

Regression and ratio estimators are used to integrate AVHRR-Global Area Coverage (GAC) and Landsat MSS digital data to estimate forest area in the continental United States. Forestlands are enumerated for the 48 contiguous states using five different AVHRR-GAC data sets. Results indicated that the GAC and MSS forest estimates were not highly correlated. Although the ratio of means and linear regression corrections were, on the average, closer to national U.S. Forest Service forest area estimates, these correction procedures did not consistently improve GAC estimates of forest area. GAC forest area estimates tended to be high in densely forested regions such as the northeast and low in sparsely forested areas.

Nelson, Ross↗

Designing clay-polymer nanocomposite sorbents for water treatment: A review and meta-analysis of the past decade

Clay-polymer nanocomposites (CPNs) have been studied for two decades as sorbents for water pollutants, but their applicability remains limited. Our aim in this review is to present the latest progress in CPN research using a meta-analysis approach and identify key steps necessary to bridge the gap between basic research and CPN application. Based on results extracted from 99 research articles on CPNs and 8 review articles on other widely studies sorbents, CPNs had higher adsorption capacities for several inorganic and organic pollutant classes (including heavy metals, oxyanions, and dyes, n = 308 observations). We applied principal component analysis, analysis of variance, and multiple linear regressions to test how CPN and pollutant properties correlated with Langmuir adsorption model coefficients. While adsorption was, surprisingly, not influenced by mineral properties, it was influenced by CPN fabrication method, polymer functional groups, and pollutant properties. For example, among the pollutant classes, heavy metals had the highest adsorption capacity but the lowest adsorption affinity. Conversely, dyes had high adsorption affinities, as reflected by the linear correlation between adsorption affinity and pollutant molecular weight. Scaling from ‘basic research’ to ‘technological application’ requires testing CPN performance in real water, application in columns, comparison to commercial sorbents, regeneration, and cost evaluation. However, our survey indicates that of the 158 observations, only 20 compared the CPN's performance to that of a commercial sorbent. We anticipate that this review will promote the design of smart and functional CPNs, which can then evolve into an effective water treatment technology.

42 ENGINEERING↗

Exploring the use of structural models to improve remote sensing agricultural estimates

Satellite estimates of agricultural characteristics often are not sufficiently precise for reliable use in small geographical regions. The precision of estimates of agricultural characteristics such as crop proportions and leaf area indexes can be increased by modeling ground observations as a function of satellite estimates. Linear regression models using least squares estimators of the model parameters are most often advocated as an appropriate methodology; however, least squares estimation requires that the predictor variables are measured without error, an unreasonable assumption for this application. An alternative estimation methodology which assumes that both the response variables (ground observations) and the predictor variables (satellite estimates) are measured with error involves the use of linear structural models. The application of linear structural models to the estimation of agricultural characteristics using satellite spectral measurements is examined.

Gunst, R. F.↗