Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Linear Regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56
All sourcesNASA NTRSDOE OSTI
NASA NTRS1988

Linear Least Squares for Correlated Data

Throughout the literature authors have consistently discussed the suspicion that regression results were less than satisfactory when the independent variables were correlated. Camm, Gulledge, and Womer, and Womer and Marcotte provide excellent applied examples of these concerns. Many authors have obtained partial solutions for this problem as discussed by Womer and Marcotte and Wonnacott and Wonnacott, which result in generalized least squares algorithms to solve restrictive cases. This paper presents a simple but relatively general multivariate method for obtaining linear least squares coefficients which are free of the statistical distortion created by correlated independent variables.

Dean, Edwin B.↗
DOE OSTI2022

Use of machine learning for a helium line intensity ratio method in Magnum-PSI

Optical emission spectroscopy (OES) of helium (He) line intensities has been used to measure the electron density, ne, and temperature, Te, in various plasma devices. In this study, a neural network with five hidden layers is introduced to model the relation between the OES data and ne/Te from laser Thomson scattering in the linear plasma device Magnum-PSI and compared to multiple regression analysis. It is shown that the neural network reduces the residual errors of prediction values (ne and Te) less than half those of the multiple regression analysis. We checked two different data splitting methods for training and validation data, i.e., with and without considering the unit of discharge. A comparison of the splitting methods suggests that the residual error will decrease to ~10% even for a new discharge data when accumulating a sufficient data set.

Kajita, Shin↗
DOE OSTI2026

A data-driven approach to real-time vertical position estimation for NSTX-U vertical stability control

In this paper, a database of 77 996 plasma equilibrium reconstructions from 727 discharges during the initial operation of the NSTX-U spherical tokamak is analyzed to develop a statistically robust model of the plasma vertical position for real-time control. A variety of regression models are developed and tested, ranging in complexity from linear models to deep neural networks, and including input signals ranging from the four pairs of flux loops used historically on NSTX-U up to the full set of 389 real-time signals available to the plasma control system. A linear model based on 140 real-time magnetics signals is found to offer excellent accuracy, with a coefficient of determination R 2 = 0.906. The robustness of this model to limited training data, new operating scenarios, and signal errors is tested, and a procedure is demonstrated to tune the model parameters to optimize its robustness. A time-dependent plasma equilibrium solver, TokaMaker, is used to simulate vertical stability control in NSTX-U, demonstrating that it should be possible to iteratively tune the parameters of a linear vertical position model to stabilize both positive and negative triangularity plasmas in future experiments.

magnetic diagnostics↗
NASA NTRS1990

Ridge Regression Signal Processing

The introduction of the Global Positioning System (GPS) into the National Airspace System (NAS) necessitates the development of Receiver Autonomous Integrity Monitoring (RAIM) techniques. In order to guarantee a certain level of integrity, a thorough understanding of modern estimation techniques applied to navigational problems is required. The extended Kalman filter (EKF) is derived and analyzed under poor geometry conditions. It was found that the performance of the EKF is difficult to predict, since the EKF is designed for a Gaussian environment. A novel approach is implemented which incorporates ridge regression to explain the behavior of an EKF in the presence of dynamics under poor geometry conditions. The basic principles of ridge regression theory are presented, followed by the derivation of a linearized recursive ridge estimator. Computer simulations are performed to confirm the underlying theory and to provide a comparative analysis of the EKF and the recursive ridge estimator.

Kuhl, Mark R.↗
NASA NTRS1994

Effects of Body Orientation and Retinal Image Pitch on the Perception of Gravity-Referenced Eye Level (GREL)

It has been asserted that the pitch orientation of a visual array and of an observer's body jointly determine the perception of GREL. The current study formally tests this assertion over an extended range with multiple combinations of visual and body pitch orientations. Ten subjects were individually secured in a Circolectric bed surrounded by a room (pitchroom) with walls that could be pitched at various angles with respect to gravity. The bed and the walls of the room were independently adjusted to each of five positions relative to gravitational vertical: -15, -7.5, 0, +7.5, and +15 degrees, yielding 25 combinations of body x room pitch angles, and retinal image pitch (RIP) conditions ranging from -30 to +30 degrees. Each subject set a target to apparent GREL while viewing it against a background of two electroluminescent strips on the outer edges of the far wall of the room. As determined by ANOVA, the orientation of the room, and its interaction with that of the observer, significantly altered GREL (p less than 0.01). Regression analysis showed that GREL was best described as a linear summation of the weighted independent contributions from a body-referenced mechanism (B) and a visual mechanism given by the orientation of the background array on the retina (RIP). The equation for this relationship is: GREL = .74 (B) +.64 (RIP) - 1.42; r-squared = .994.

Cohen, Malcolm M.↗
DOE OSTI2026

Poisson Log-Normal Process for Count Data Prediction

Modeling count data is important in physics and other scientific disciplines, where measurements often involve discrete, non-negative quantities such as photon or neutrino detection events. Traditional parametric approaches can be trained to generate integer-count predictions but may struggle with capturing complex, non-linear dependencies often observed in the data. Gaussian process (GP) regression provides a robust non-parametric alternative to modeling continuous data; however, it cannot generate integer outputs. We propose the Poisson Log-Normal (PoLoN) process, a framework that employs GP to model Poisson log-rates. As in GP regression, our approach relies on the correlations between data points captured via GP kernel structure rather than explicit functional parameterizations. We demonstrate that the PoLoN predictive distribution is Poisson-LogNormal and provide an algorithm for optimizing kernel hyperparameters. Furthermore, we adapt the PoLoN approach to the problem of detecting weak localized signals superimposed on a smoothly varying background - a task of considerable interest in many areas of science and engineering. Our framework allows us to predict the strength, location and width of the detected signals. We evaluate PoLoN's performance using both synthetic and real-world datasets, including the open dataset from CERN which was used to detect the Higgs boson at the Large Hadron Collider. Our results indicate that the PoLoN process can be used as a non-parametric alternative for analyzing, predicting, and extracting signals from integer-valued data.

Saha, Anushka [Rutgers U., Piscataway]↗
NASA NTRS1987

Toward comparing experiment and theory for corroborative research on hingeless rotor stability in forward flight

For flap lag stability of isolated rotors, experimental and analytical investigations were conducted in hover and forward flight on the adequacy of a linear quasisteady aerodynamics theory with dynamic flow. Forward flight effects on lag regressing mode were emphasized. A soft inplane hingeless rotor with three blades was tested at advance ratios as high as 0.55 and at shaft angles as high as 20 deg. The 1.62 m model rotor was untrimmed with an essentially unrestricted tilt of the tip path plane. In combination with lag natural frequencies, collective pitch settings and flap lag coupling parameters, the data base comprises nearly 1200 test points (damping and frequency) in forward flight and 200 test points in hover. By computerized symbolic manipulation, a linear model was developed in substall to predict stability margins with mode identification. To help explain the correlation between theory and data it also predicted substall and stall regions of the rotor disk from equilibrium values. The correlation showed both the strengths and weaknesses of the theory in substall ((angle of attack) equal to or less than 12 deg).

Gaonkar, G.↗
NASA NTRS1986

Toward comparing experiment and theory for corroborative research on hingeless rotor stability in forward flight (an experimental and analytical investigation of isolated rotor-flap-lag stability in forward flight)

For flap-lag stability of isolated rotors, experimental and analytical investigations are conducted in hover and forward flight on the adequacy of a linear quasisteady aerodynamics theory with dynamic inflow. Forward flight effects on lag regressing mode are emphasized. Accordingly, a soft inplane hingeless rotor with three blades is tested at advance ratios as high as 0.55 and at shaft angles as high as 20 degrees. The 1.62 m model rotor is untrimmed with an essentially unrestricted tilt of the tip path plane. In combination with lag natural frequencies, collective pitch settings and flap-lag coupling parameters, the data base comprises nearly 1200 test points (damping and frequency) in forward flight and 200 test points in hover. By computerized symbolic manipulation, a linear analytical model is developed in substall to predict stability margins with mode identificaton. To help explain the correlation between theory and data it also predicts substall and stall regions of the rotor disk from equilibrium values. The correlation shows both the strengthts and weaknesses of the theory in substall.

Gaonkar, G.↗
NASA NTRS2004

Subsonic Aircraft With Regression and Neural-Network Approximators Designed

At the NASA Glenn Research Center, NASA Langley Research Center's Flight Optimization System (FLOPS) and the design optimization testbed COMETBOARDS with regression and neural-network-analysis approximators have been coupled to obtain a preliminary aircraft design methodology. For a subsonic aircraft, the optimal design, that is the airframe-engine combination, is obtained by the simulation. The aircraft is powered by two high-bypass-ratio engines with a nominal thrust of about 35,000 lbf. It is to carry 150 passengers at a cruise speed of Mach 0.8 over a range of 3000 n mi and to operate on a 6000-ft runway. The aircraft design utilized a neural network and a regression-approximations-based analysis tool, along with a multioptimizer cascade algorithm that uses sequential linear programming, sequential quadratic programming, the method of feasible directions, and then sequential quadratic programming again. Optimal aircraft weight versus the number of design iterations is shown. The central processing unit (CPU) time to solution is given. It is shown that the regression-method-based analyzer exhibited a smoother convergence pattern than the FLOPS code. The optimum weight obtained by the approximation technique and the FLOPS code differed by 1.3 percent. Prediction by the approximation technique exhibited no error for the aircraft wing area and turbine entry temperature, whereas it was within 2 percent for most other parameters. Cascade strategy was required by FLOPS as well as the approximators. The regression method had a tendency to hug the data points, whereas the neural network exhibited a propensity to follow a mean path. The performance of the neural network and regression methods was considered adequate. It was at about the same level for small, standard, and large models with redundancy ratios (defined as the number of input-output pairs to the number of unknown coefficients) of 14, 28, and 57, respectively. In an SGI octane workstation (Silicon Graphics, Inc., Mountainview, CA), the regression training required a fraction of a CPU second, whereas neural network training was between 1 and 9 min, as given. For a single analysis cycle, the 3-sec CPU time required by the FLOPS code was reduced to milliseconds by the approximators. For design calculations, the time with the FLOPS code was 34 min. It was reduced to 2 sec with the regression method and to 4 min by the neural network technique. The performance of the regression and neural network methods was found to be satisfactory for the analysis and design optimization of the subsonic aircraft.

Patnaik, Surya N.↗
NASA NTRS1993

Spatial structure, sampling design and scale in remotely-sensed imagery of a California savanna woodland

This article describes research related to sampling techniques for establishing linear relations between land surface parameters and remotely-sensed data. Predictive relations are estimated between percentage tree cover in a savanna environment and a normalized difference vegetation index (NDVI) derived from the Thematic Mapper sensor. Spatial autocorrelation in original measurements and regression residuals is examined using semi-variogram analysis at several spatial resolutions. Sampling schemes are then tested to examine the effects of autocorrelation on predictive linear models in cases of small sample sizes. Regression models between image and ground data are affected by the spatial resolution of analysis. Reducing the influence of spatial autocorrelation by enforcing minimum distances between samples may also improve empirical models which relate ground parameters to satellite data.

Mcgwire, K.↗
DOE OSTI2022

Recent progress in L-H transition studies at JET: Tritium, Helium, Hydrogen and Deuterium

In this report we present an overview of results from a series of L-H transition experiments undertaken at JET since the installation of the ITER-like-wall (JET-ILW), with Beryllium wall tiles and a Tungsten divertor. Tritium, Helium and Deuterium plasmas have been investigated. Initial results in Tritium show ohmic L-H transitions at low density and the power threshold for the L-H transition (P LH ) is lower in Tritium plasmas than in Deuterium ones at low densities, while we still lack contrasted data to provide a scaling at high densities. In Helium plasmas there is a notable shift of the density at which the power threshold is minimum (n e,min ) to higher values relative to Deuterium and Hydrogen references. Above n e,min (He) the L-H power threshold at high densities is similar for D and He plasmas. Transport modelling in slab geometry shows that in Helium neoclassical transport competes with interchange-driven transport, unlike in Hydrogen isotopes. Measurements of the radial electric field in Deuterium plasmas show that E r shear is not a good indicator of proximity to the L-H transition. Transport analysis of ion heat flux in Deuterium plasmas show a non-linearity as density is decreased below n e,min . Lastly, a regression of the JET-ILW Deuterium data is compared to the 2008 ITPA scaling law.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Recent evolution of risk analyses in atomic bomb survivor studies: new methods and applications

Abstract Several decades ago a dramatic leap forward occurred in the development and application of statistical methods for modeling radiation risk at the Radiation Effects Research Foundation (RERF). Poisson regression analysis for grouped person-year cohort data and the linear excess relative risk model were introduced, and subsequently a devoted software system, Epicure® (https://www.hirosoft.com), was developed by researchers at RERF and at the U.S. National Cancer Institute. Numerous advancements in understanding radiation effects on humans were made possible with these methods, which are still the state-of-the-art for risk assessment at RERF and have remained part of the standard toolbox for radiation—and other environmental—epidemiological studies worldwide. Nevertheless, as our understanding of radiation risk has increased, so have the breadth and depth of questions that require answers based on emerging data that are not amenable to these conventional methods. This overview briefly recounts the conventional methods and then describes our recent diversification into the use or development of new statistical approaches to meet the challenges of burgeoning biological data and emerging mechanistic information. We briefly discuss the development and application of new methods, current and planned, that are part of the RERF Statistics Department’s role in supporting institution-wide research, especially in our collaborations involving the Life Span Study, Adult Health Study, and First-generation Offspring Clinical Study. Some approaches to modeling and assessing radiation risk with newer methods mentioned herein have already been published, while some are still in development or are only beginning at the proposal stage.

Oncology↗
NASA NTRS1997

Analysis of Forest Foliage Using a Multivariate Mixture Model

Data with wet chemical measurements and near infrared spectra of ground leaf samples were analyzed to test a multivariate regression technique for estimating component spectra which is based on a linear mixture model for absorbance. The resulting unmixed spectra for carbohydrates, lignin, and protein resemble the spectra of extracted plant starches, cellulose, lignin, and protein. The unmixed protein spectrum has prominent absorption spectra at wavelengths which have been associated with nitrogen bonds.

Hlavka, C. A.↗
NASA NTRSDate not supplied

A Novel Machine Learning Method for Surface PM2.5 Estimations from Geostationary Satellites

Particulate matter (PM) with a diameter of less or equal to 2.5 μm, known as PM , affects human health as it penetrates the respiratory system. The Environmental Protection Agency (EPA) measures the atmospheric concentration of PM using air quality monitors stationed throughout the Continental United States (CONUS). Such measurements are points on a spatial domain and therefore, might not be representative of the air quality at nearby areas considering that the composition of the atmosphere is highly variable from place to place. Satellite based AOD permits a spatially uniform means of estimating PM and new geostationary satellites provide high temporal and spatial resolution estimation of AOD. However, the concentration of PM is non-linearly dependent on other atmospheric parameters that include relative humidity, temperature, and height of the planetary boundary layer. This information may be estimated at similar spatial and temporal resolutions as AOD from numerical modeling such as from the National Oceanic and Atmospheric Administration’s (NOAA) High Resolution Rapid Refresh (HRRR) model which resolves near real-time atmospheric conditions over the CONUS. The estimation of PM concentration is a multi-parametric problem that considers the effect of temporal dependencies among the different parameters. Deep learning approaches are appropriate for such complex estimation problems as they intrinsically capture relations among multiple non-linear parameters. This study compares deep-learning methods to traditional regression analysis to demonstrate the capabilities of these methods in predicting PM2.5 concentrations. Additionally, a novel ensemble learning approach is employed to identify scientific processes that could further improve the estimation of PM concentration. Utilizing Long Short-Term Memory (LSTM) neural networks, which are suitable for multivariate time series estimation problems as they are capable of learning long-term dependencies, individual models are created for each EPA station and trained on the aforementioned dataset collocated over each station. Individual station models are merged if the model's performance is improved by reducing the root mean squared error (RMSE) metric. This ensemble training method ultimately reduces the RMSE value. Evaluation of these results provide insights into physical processes and related observable parameters that may contribute to PM concentrations. Identified parameters evaluated to be statistically different between the merged and unmerged models are expected to improve overall performance. These new parameters are then utilized for reevaluation of the deep learning methods with an extreme gradient boosting model with an RMSE of 5.5 providing the best results.

George Priftis↗
NASA NTRS1975

Solar and atmospheric effects on satellite imagery derived from aircraft reflectance measurements

Solar and atmospheric effects on satellite imagery were investigated by measuring terrain reflectance from low-flying aircraft. Radiometric data were recorded over three test sites in California, Georgia, and South Dakota. Radiance from Skylab (EREP) S190A and ERTS-1 (Landsat-1) sensors was linearly correlated with wide-band terrain reflectance. The results support the proposition that the coefficients of the regression equation are the path radiance and a quantity representing the product of total irradiance and beam transmittance at the time of satellite overflight. These coefficients should be useful as linear conversion coefficients for extending spectral signatures in computer-aided classification work on satellite imagery.

Dana, R. W.↗
NASA NTRS1981

Determination of model structure and parameters of an airplane from pre- and post-stall flight data

A procedure for airplane model structure determination from flight data based on modified stepwise regression (MSR), several decision criteria and postulated aerodynamic model equations is presented. The MSR is constructed to force a linear model for the aerodynamic coefficient first, then select significant nonlinear terms and reject nonsignificant terms from the model. In addition to the statistical criteria in the stepwise regression, the prediction sum of squares (PRESS) criterion and analysis of residuals are examined for the selection of an adequate model. The procedure is used in examples with simulated and real flight data. It is shown that the MSR performs better than the ordinary stepwise regression and that the technique can be also applied to the large amplitude maneuvers.

Klein, V.↗
DOE OSTI2020

An Evolve-Then-Correct Reduced Order Model for Hidden Fluid Dynamics

In this paper, we put forth an evolve-then-correct reduced order modeling approach that combines intrusive and nonintrusive models to take hidden physical processes into account. Specifically, we split the underlying dynamics into known and unknown components. In the known part, we first utilize an intrusive Galerkin method projected on a set of basis functions obtained by proper orthogonal decomposition. We then present two variants of correction formula based on the assumption that the observed data are a manifestation of all relevant processes. The first method uses a standard least-squares regression with a quadratic approximation and requires solving a rank-deficient linear system, while the second approach employs a recurrent neural network emulator to account for the correction term. We further enhance our approach by using an orthonormality conforming basis interpolation approach on a Grassmannian manifold to address off-design conditions. The proposed framework is illustrated here with the application of two-dimensional co-rotating vortex simulations under modeling uncertainty. The results demonstrate highly accurate predictions underlining the effectiveness of the evolve-then-correct approach toward real-time simulations, where the full process model is not known a priori.

long short-term memory↗