Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “noisy regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

14 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS1990

Estimating the exceedance probability of rain rate by logistic regression

Recent studies have shown that the fraction of an area with rain intensity above a fixed threshold is highly correlated with the area-averaged rain rate. To estimate the fractional rainy area, a logistic regression model, which estimates the conditional probability that rain rate over an area exceeds a fixed threshold given the values of related covariates, is developed. The problem of dependency in the data in the estimation procedure is bypassed by the method of partial likelihood. Analyses of simulated scanning multichannel microwave radiometer and observed electrically scanning microwave radiometer data during the Global Atlantic Tropical Experiment period show that the use of logistic regression in pixel classification is superior to multiple regression in predicting whether rain rate at each pixel exceeds a given threshold, even in the presence of noisy data. The potential of the logistic regression technique in satellite rain rate estimation is discussed.

Chiu, Long S.↗
NASA NTRS2002

Locally-Based Kernal PLS Smoothing to Non-Parametric Regression Curve Fitting

We present a novel smoothing approach to non-parametric regression curve fitting. This is based on kernel partial least squares (PLS) regression in reproducing kernel Hilbert space. It is our concern to apply the methodology for smoothing experimental data where some level of knowledge about the approximate shape, local inhomogeneities or points where the desired function changes its curvature is known a priori or can be derived based on the observed noisy data. We propose locally-based kernel PLS regression that extends the previous kernel PLS methodology by incorporating this knowledge. We compare our approach with existing smoothing splines, hybrid adaptive splines and wavelet shrinkage techniques on two generated data sets.

Rosipal, Roman↗
NASA NTRS1973

A model of the human in a cognitive prediction task.

The human decision maker's behavior when predicting future states of discrete linear dynamic systems driven by zero-mean Gaussian processes is modeled. The task is on a slow enough time scale that physiological constraints are insignificant compared with cognitive limitations. The model is basically a linear regression system identifier with a limited memory and noisy observations. Experimental data are presented and compared to the model.

Rouse, W. B.↗
NASA NTRSDate not supplied

Application of a Bayesian Framework for Plasticity Model Selection

Interpretable Machine Learning (IML) has performed well when tasked with deriving constitutive material models. However, IML has been shown to prefer models that overfit noise in data, which tends to lead to bloat and a decrease in interpretability. Due to these issues, the ability of IML to reliably derive models that fit the data and are both interpretable and generalizable is limited. A method developed recently has shown promise to improve upon traditional IML by using a Bayesian fitness definition for the evolution of free-form models with non-deterministic parameters. This framework was developed for genetic-programming-based symbolic regression(GPSR) and involves model parameter estimation using Sequential Monte Carlo sampling (SMC).The method has demonstrated a reduction in bloat when dealing with noisy data in comparison to conventional GPSR. The results of this framework applied to stress-strain data for copper show models that more effectively predict the experimental data better than was previously shown with GPSR.

plasticity↗
NASA NTRS1988

Satellite/radiosonde comparison

Collocated measurements of radiosonde and TIROS Operational Vertical Sounder (TOVS) data are compared to determine whether significant latitudinal, seasonal, or instrumental biases exist. Long-wave structure determined by each system is being examined for correlation. Because U.S. radiosonde data are archived uncorrected, an effort to correct the measurements is being considered. These corrections will be applied to 7 years of measurements. New comparisons will then be made using corrected radiosonde and TOVS data. A regression method is used to retrieve temperatures, and radiosonde zonal means are used to update the regression coefficients. Preliminary results of auto-correlation analysis indicate that detection of long-wave structure in each set of data is slightly different with some levels and locations experiencing different wave periods or amplitudes. Scatter diagrams and linear regression for each layer show bias in the mean temperatures. Winter-time measurements show poorer correlations due to noisy measurements.

Schmidlin, F. J.↗
NASA NTRS2019

Comparing Ice Jam Hindcasting Models with Tree Scar Data

Hindcasting models can use historic ice jam observations and hydroclimatic data to identify conditions that form ice jams.However, historic ice jam records are often sparse or incomplete. New sources of historic ice jam data could improve hindcasting models, leading to better ice jam forecasting and flood warning systems. Because ice jams damage riparian trees, marker rings associated with historic scars include information about ice jam frequency and severity. This study examined marker rings from 56 trees along the Muskegon River to supplement the historic ice jam data on this system. The study team compared tree ring data to results from hindcasting models, which were independently validated with newspaper reports on 1,500 separate days. Logistic regression converted the marker ring data into annual ice jam probabilities. Ice jam dates from the dendrochronology data were too noisy to train or validate a hindcasting model. However, the marker ring data did confirm that ice jams on the Muskegon are nonstationary. Ice jams are significantly more likely now than they were before 1966.The marker rings also helped to distinguish between false-negatives and nondetects in the hindcasting model.

Stanford Gibson↗
NASA NTRS1990

Error analysis for reducing noisy wide-gap concentric cylinder rheometric data for nonlinear fluids - Theory and applications

This work discusses the propagation of errors for the recovery of the shear rate from wide-gap concentric cylinder viscometric measurements of non-Newtonian fluids. A least-square regression of stress on angular velocity data to a system of arbitrary functions is used to propagate the errors for the series solution to the viscometric flow developed by Krieger and Elrod (1953) and Pawlowski (1953) ('power-law' approximation) and for the first term of the series developed by Krieger (1968). A numerical experiment shows that, for measurements affected by significant errors, the first term of the Krieger-Elrod-Pawlowski series ('infinite radius' approximation) and the power-law approximation may recover the shear rate with equal accuracy as the full Krieger-Elrod-Pawlowski solution. An experiment on a clay slurry indicates that the clay has a larger yield stress at rest than during shearing, and that, for the range of shear rates investigated, a four-parameter constitutive equation approximates reasonably well its rheology. The error analysis presented is useful for studying the rheology of fluids such as particle suspensions, slurries, foams, and magma.

Borgia, Andrea↗
NASA NTRS1999

Determination of Radiative Forcing of Saharan Dust using Combined TOMS and ERBE Data

The direct radiative forcing of Saharan dust aerosols has been determined by combining aerosol information derived from Nimbus-7 TOMS with radiation measurements observed at the top of atmosphere (TOA) by NOAA-9 ERBE made during February-July 1985. Cloud parameters and precipitable water derived from the NOAA-9 HIRS2 instrument were used to aid in screening for clouds and water vapor in the analyses. Our results indicate that under "cloud-free" and "dry" conditions there is a good correlation between the ERBE TOA outgoing longwave fluxes and the TOMS aerosol index measurements over both land and ocean in areas under the influence of airborne Saharan dust. The ERBE TOA outgoing shortwave fluxes were also found to correlate well with the dust loading derived from TOMS over ocean. However, the calculated shortwave forcing of Saharan dust aerosols is very weak and noisy over land for the range of solar zenith angle viewed by the NOAA-9 ERBE in 1985. Sensitivity factors of the TOA outgoing fluxes to changes in aerosol index were estimated using a linear regression fit to the ERBE and TOMS measurements. The ratio of the shortwave-to-longwave response to changes in dust loading over the ocean is found to be roughly 2 to 3, but opposite in sign. The monthly averaged "clear-sky" TOA direct forcing of airborne Saharan dust was also calculated by multiplying these sensitivity factors by the TOMS monthly averaged "clear-sky" aerosol index. Both the observational and theoretical analyses indicate that the dust layer height, ambient moisture content as well as the presence of cloud all play an important role in determining the TOA direct radiative forcing due to mineral aerosols.

Hsu, N. Christina↗
NASA NTRS1979

Modern estimation techniques applied to microwave sensing of the marine boundary layer

Previous efforts in the area of satellite microwave sensing of the marine boundary layer have relied upon linear regression techniques to extract geophysical parameters from the microwave measurement data. The approach used in the present paper shifts emphasis away from the generation of regression weighting matrices which implicitly assume that the data are linear in the parameters to be determined and that the problem is statistically stationary. The idea is simply to employ modern computational estimation techniques to obtain parameter estimates from nonlinear noisy measurements. The approach is limited only to the region of validity of Grody's (1976) model. Attention is focused on documenting how estimation techniques, in particular the square root information filter (SRIF), are used to solve a nonlinear function optimization problem.

Bierman, G. J.↗
NASA NTRS2022

MLtool: Universal Supervised Machine Learning Tool to Model Tabulated Data

Machine Learning (ML) is a subfield of Artificial Intelligence that gives computers the ability to learn from past data without being explicitly programmed. The predictive capabilities of ML models have already been used to facilitate several scientific breakthroughs. However, the practical application of ML is often limited due to the gaps in technical knowledge of its users. The common issue faced by many scientific researchers is the inability to choose the appropriate ML pipelines that are needed to treat real-world data, which is often sparse and noisy. To solve this problem, we have developed an automated Machine Learning tool (MLtool) that includes a set of ML algorithms and approaches to aid scientific researchers. The current version of MLtool is implemented as an object-oriented Python code that is easily extensible. It includes 44 different regression algorithms used to model data. MLtool helps users select the best model for their data, based on the scoring metrics used. Besides regression algorithms, MLtool also includes a suite of pre- and post-processing techniques such as missing value imputation, categorical variable encoding, input feature normalization, uncertainty quantification, exploratory data analysis (EDA), etc. MLtool was tested on several publicly available multi-dimensional data sets and was found capable of making accurate predictions.

Machine learning↗
NASA NTRS2022

MLtool Python Code

Machine Learning (ML) is a subfield of Artificial Intelligence that gives computers the ability to learn from past data without being explicitly programmed. The predictive capabilities of ML models have already been used to facilitate several scientific breakthroughs. However, the practical application of ML is often limited due to the gaps in technical knowledge of its users. The common issue faced by many scientific researchers is the inability to choose the appropriate ML pipelines that are needed to treat real-world data, which is often sparse and noisy. To solve this problem, we have developed an automated Machine Learning tool (MLtool) that includes a set of ML algorithms and approaches to aid scientific researchers. The current version of MLtool is implemented as an object-oriented Python code that is easily extensible. It includes 44 different regression algorithms used to model data. MLtool helps users select the best model for their data, based on the scoring metrics used. Besides regression algorithms, MLtool also includes a suite of pre- and post-processing techniques such as missing value imputation, categorical variable encoding, input feature normalization, uncertainty quantification, exploratory data analysis (EDA), etc. MLtool was tested on several publicly available multi-dimensional data sets and was found capable of making accurate predictions.

Machine Learning↗
NASA NTRS1979

Temperature profile retrievals with extended Kalman-Bucy filters

The Extended Kalman-Bucy Filter is a powerful technique for estimating non-stationary random parameters in situations where the received signal is a noisy non-linear function of those parameters. A practical causal filter for retrieving atmospheric temperature profiles from radiances observed at a single scan angle by the Scanning Microwave Spectrometer (SCAMS) carried on the Nimbus 6 satellite typically shows approximately a 10-30% reduction in rms error about the mean at almost all levels below 70 mb when compared with a regression inversion.

Ledsham, W. H.↗
NASA NTRS2000

Potential Subjective Effectiveness of Active Interior Noise Control in Propeller Airplanes

Active noise control technology offers the potential for weight-efficient aircraft interior noise reduction, particularly for propeller aircraft. However, there is little information on how passengers respond to this type of interior noise control. This paper presents results of two experiments that use sound quality engineering practices to determine the subjective effectiveness of hypothetical active noise control (ANC) systems in a range of propeller aircraft. The two experiments differed by the type of judgments made by the subjects: pair comparisons based on preference in the first and numerical category scaling of noisiness in the second. Although the results of the two experiments were in general agreement that the hypothetical active control measures improved the interior noise environments, the pair comparison method appears to be more sensitive to subtle changes in the characteristics of the sounds which are related to passenger preference. The reductions in subjective response due to the ANC conditions were predicted with reasonable accuracy by reductions in measured loudness level. Inclusion of corrections for the sound quality characteristics of tonality and fluctuation strength in multiple regression models improved the prediction of the ANC effects.

Powell, Clemans A.↗
NASA NTRSDate not supplied

Differential Equation Approximation Using Gradient-Boosted Quantile Regression

The operation of cyber-physical-human (CPH) systems is subject to various epistemic and aleatory uncertainties. Overall trustworthiness of CPH systems relies on the trustworthiness of its components and their interactions. It is important that computational models comprising the cyber component of CPH provide predictions accompanied by a measure of confidence in model outcomes. Uncertainty quantification (UQ) and propagation are especially important in safety critical CPH systems. Gradient-boosted trees is a modeling approach capable both of learning the dynamics of a system and performing UQ. In this paper, we devise a method for using gradient boosting to learn the dynamics of a second order differential equation and estimate uncertainty at the same time. We do this by creating a custom loss function that trains the model to approximate the second derivative of a noisy time series, and to penalize based on a parameter that corresponds to the desired quantile. The resulting gradient boosting model can simulate stochastic trajectories of the system given a single starting point, that is, it can estimate both the expected trajectory and its uncertainty. We show that the uncertainty estimation is well calibrated and that the model can learn the dynamics even in the presence of noise. We demonstrate the approach on a simple cartpole system.

Autonomous systems↗