Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multivariate adaptive regression splines”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2014

An efficient Bayesian inversion of a geothermal prospect using a multivariate adaptive regression spline method

In this study, an efficient Bayesian framework equipped with a multivariate adaptive regression spline (MARS) technique is developed to alleviate computational burdens encountered in a conventional Bayesian inversion of a geothermal prospect. Fast MARS models are developed from training dataset generated by CPU-intensive hydrothermal models and used as surrogate of high-fidelity physical models in Markov Chain Monte Carlo (MCMC) sampling. This Bayesian inference with MARS-enabled MCMC method is used to reduce prior estimates of uncertainty in structural or characteristic hydrothermal flow parameters of the model to posterior distributions. A geothermal prospect near Superstition Mountain in Imperial County of California in USA is used to illustrate the proposed framework and demonstrate the computational efficiency of MARS-based Bayesian inversion. The developed MARS models are also used to efficiently drive calculation of Sobol’ total sensitivity indices. Furthermore, only top sensitive parameters are included in Bayesian inference to further improve the computational efficiency of inversion. Sensitivity analysis also confirms that water circulation through high permeable structures, rather than heat conduction through impermeable granite, is the primary heat transfer method. The presented framework is demonstrated an efficient tool to update knowledge of geothermal prospects by inversing field data. Although only thermal data is used in this study, other type of data, such as flow and transport observations, can be jointly used in this method for underground hydrocarbon reservoirs.

15 GEOTHERMAL ENERGY↗
NASA NTRS1991

G/SPLINES: A hybrid of Friedman's Multivariate Adaptive Regression Splines (MARS) algorithm with Holland's genetic algorithm

G/SPLINES are a hybrid of Friedman's Multivariable Adaptive Regression Splines (MARS) algorithm with Holland's Genetic Algorithm. In this hybrid, the incremental search is replaced by a genetic search. The G/SPLINE algorithm exhibits performance comparable to that of the MARS algorithm, requires fewer least squares computations, and allows significantly larger problems to be considered.

Rogers, David↗
DOE OSTI2025

Multiclass Classification Using Bayesian Multivariate Adaptive Regression Splines

We present a new Bayesian model for the problem of multiclass classification. In this model, the probabilities of class membership of a given observation are determined by the mean of a latent Gaussian distribution. The mean functions of this latent distribution consist of combinations of highly flexible basis functions of the inputs: multivariate adaptive regression splines (MARS), first developed for multiple regression. We use reversible jump Markov chain Monte Carlo to make inference on the classification model, including the number of basis functions. We compare the probabilistic classification performance of our proposed approach to existing methods on simulated and benchmark data, and compare uncertainty estimates on simulated data. Our proposed method compares favorably with existing Bayesian and frequentist multiclass classification methods in out-of-sample probabilistic classification, and uncertainty estimation of these probabilistic classifications. We examine the fit of the proposed method to a data set of hurricane storm surge levels near Delaware Bay, US, and conclude that sea level rise is a key contributor to damage delivered by storm surge.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Data-driven fuel consumption estimation: A multivariate adaptive regression spline approach

Providing guidance and information to drivers to help them make fuel-efficient route choices remains an important and effective strategy in the near term to reduce fuel consumption from the transportation sector. One key component in implementing this strategy is a fuel-consumption estimation model. In this paper, we developed a mesoscopic fuel consumption estimation model that can be implemented into an eco-routing system. Our proposed model presents a framework that utilizes large-scale, real-world driving data, clusters road links by free-flow speed and fits one statistical model for each of cluster. This model includes predicting variables that were rarely or never considered before, such as free-flow speed and number of lanes. We applied the model to a real-world driving data set based on a global positioning system travel survey in the Philadelphia-Camden-Trenton metropolitan area. Results from the statistical analyses indicate that the independent variables we chose influence the fuel consumption rates of vehicles. But the magnitude and direction of the influences are dependent on the type of road links, specifically free-flow speeds of links. Here, a statistical diagnostic is conducted to ensure the validity of the models and results. Although the real-world driving data we used to develop statistical relationships are specific to one region, the framework we developed can be easily adjusted and used to explore the fuel consumption relationship in other regions.

30 DIRECT ENERGY CONVERSION↗
NASA NTRS1993

Modeling of topographic effects on Antarctic sea ice using multivariate adaptive regression splines

The role of seafloor topography in the spatial variations of the southern ocean sea ice cover as observed (every other day) by the Nimbus 7 scanning multichannel microwave radiometer satellite in the years 1980, 1983, and 1984 is studied. Bottom bathymetry can affect sea ice surface characteristics because of the basically barotropic circulation of the ocean south of the Antarctic Circumpolar current. The main statistical tool used to quantify this effect is a local nonparametric regression model of sea ice concentration as a function of the depth and its first two derivatives in both meridional and zonal directions. First, we model the relationship of bathymetry to sea ice concentration in two sudy areas, one over the Maud Rise and the other over the Ross Sea shelf region. The multiple correlation coefficient is found to average 44% in the Maud Rise study area and 62% in the Ross Sea study area over the years 1980, 1983, and 1984. Second, a strategy of dividing the entire Antarctic region into an overlapping mosaic of small areas, or windows is considered. Keeping the windows small reduces the correlation of bathymetry with other factors such as wind, sea temperature, and distance to the continent. We find that although the form of the model varies from window to window due to the changing role of other relevant environmental variables, we are left with a spatially consistent ordering of the relative importance of the topographic predictors. For a set of three representative days in the Austral winter of 1980, the analysis shows that an average of 54% of the spatial variation in sea ice concentration over the entire ice cover can be attributed to topographic variables. The results thus support the hypothesis that there is a sea ice to bottom bathymetry link. However this should not undermine the considerable influence of wind, current, and temperature which affect the ice distribution directly and are partly responsible for the observed bathymetric effects.

De Veaux, Richard D.↗
DOE OSTI2019

Surrogate Model Selection for Design Space Approximation And Surrogatebased Optimization

Surrogate models are used to map input data to output data when the actual relationship between the two is unknown or computationally expensive to evaluate for sensitivity analysis, uncertainty propagation and surrogate based optimization. This work evaluates the performance of eight surrogate modeling techniques for design space approximation and surrogate based optimization applications over a set of generated datasets with known characteristics. With this work, we aim to provide general rules for selecting an appropriate surrogate model form solely based on the characteristics of the data being modeled. Furthermore, the computational experiments revealed that, in general, multivariate adaptive regression spline models (MARS) and single hidden layer feed forward neural networks (ANN) yielded the most accurate predictions over the design space while Random Forest (RF) models most reliably identified the locations of the optimums when used for surrogate-based optimization.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Sensitivity Analysis and Emulation for Functional Data using Bayesian Adaptive Splines

When a computer code is used to simulate a complex system, one of the fundamental tasks is to assess the sensitivity of the simulator to the different input parameters. In the case of computationally expensive simulators, this is often accomplished via a surrogate statistical model, a statistical output emulator. An effective emulator is one that provides good approximations to the computer code output for wide ranges of input values. In addition, an emulator should be able to handle large dimensional simulation output for a relevant number of inputs; it should flexibly capture heterogeneities in the variability of the response surface; it should be fast to evaluate for arbitrary combinations of input parameters, and it should provide an accurate quantification of the emulation uncertainty. In this paper we discuss the Bayesian approach to multivariate adaptive regression splines (BMARS) as an emulator for a computer model that outputs curves. We introduce modifications to traditional BMARS approaches that allow for fitting large amounts of data and allow for more efficient MCMC sampling. We emphasize the ease with which sensitivity analysis can be performed in this situation. We present a sensitivity analysis of a computer model of the deformation of a protective plate used in pressure-driven experiments. Our example serves as an illustration of the ability of BMARS emulators to fulfill all the necessities of computability, flexibility and reliable calculation on relevant measures of sensitivity.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Generalized Bayesian MARS: Tools for Stochastic Computer Model Emulation

The multivariate adaptive regression spline (MARS) approach of Friedman and its Bayesian counterpart are effective approaches for the emulation of computer models. The traditional assumption of Gaussian errors limits the usefulness of MARS, and many popular alternatives, when dealing with stochastic computer models. Here, we propose a generalized Bayesian MARS (GBMARS) framework which admits the broad class of generalized hyperbolic distributions as the induced likelihood function. This allows us to develop tools for the emulation of stochastic simulators which are parsimonious, scalable, and interpretable and require minimal tuning, while providing powerful predictive and uncertainty quantification capabilities. GBMARS is capable of robust regression with t distributions, quantile regression with asymmetric Laplace distributions, and a general form of “Normal-Wald” regression in which the shape of the error distribution and the structure of the mean function are learned simultaneously. We demonstrate the effectiveness of GBMARS on various stochastic computer models, and we show that it compares favorably to several popular alternatives.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Integrating Reanalysis and Satellite Cloud Information to Estimate Surface Downward Long-Wave Radiation

The estimation of downward long-wave radiation (DLR) at the surface is very important for the understanding of the Earth’s radiative budget with implications in surface–atmosphere exchanges, climate variability, and global warming. Theoretical radiative transfer and observationally based studies identify the crucial role of clouds in modulating the temporal and spatial variability of DLR. In this study, a new machine learning algorithm that uses multivariate adaptive regression splines (MARS) and the combination of near-surface meteorological data with satellite cloud information is proposed. The new algorithm is compared with the current operational formulation used by the European Organization for the Exploitation of Meteorological Satellites (EUMETSAT) Satellite Application Facility on Land Surface Analysis (LSA-SAF). Both algorithms use near-surface temperature and dewpoint temperature along with total column water vapor from the latest European Centre for Medium-range Weather Forecasts (ECMWF) reanalysis ERA5 and satellite cloud information from the Meteosat Second Generation. The algorithms are trained and validated using both ECMWF-ERA5 and DLR acquired from 23 ground stations as part of the Baseline Surface Radiation Network (BSRN) and the Atmospheric Radiation Measurement (ARM) user facility. Results show that the MARS algorithm generally improves DLR estimation in comparison with other model estimates, particularly when trained with observations. When considering all the validation data, root mean square errors (RMSEs) of 18.76, 23.55, and 22.08 W·m –2 are obtained for MARS, operational LSA-SAF, and ERA5, respectively. The added value of using the satellite cloud information is accessed by comparing with estimates driven by ERA5 total cloud cover, showing an increase of 17% of the RMSE. The consistency of MARS estimate is also tested against an independent dataset of 52 ground stations (from FLUXNET2015), further supporting the good performance of the proposed model.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

BASS: An R Package for Fitting and Performing Sensitivity Analysis of Bayesian Adaptive Spline Surfaces

In this work, we present the R package BASS as a tool for nonparametric regression. The primary focus of the package is fitting fully Bayesian adaptive spline surface (BASS) models and performing global sensitivity analyses of these models. The BASS framework is similar to that of Bayesian multivariate adaptive regression splines (BMARS) from Denison, Mallick, and Smith (1998), but with many added features. The software is built to efficiently handle significant amounts of data with many continuous or categorical predictors and with functional response. Under our Bayesian framework, most priors are automatic but these can be modified by the user to focus on parsimony and the avoidance of overfitting. If directed to do so, the software uses parallel tempering to improve the reversible jump Markov chain Monte Carlo (RJMCMC) methods used to perform inference. We discuss the implementation of these features and present the performance of BASS in a number of analyses of simulated and real data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

TBASS: A Robust Adaptation of Bayesian Adaptive Spline Surfaces

The R package TBASS is an extension of the BASS package created by Francom and Sansó (2019). The package is used to fit a Bayesian multivariate adaptive spline to a dataset that either follows a Student’s t-distribution or has outliers. Much of the framework for TBASS is adapted from the concepts of Bayesian Multivariate Adaptive Regression Splines (BMARS), specifically the work done by Denison, Mallick, and Smith (1998). The spline function is fit using a Reversible-Jump Markov Chain Monte Carlo algorithm,. By including this more robust generalization, a dataset with outliers can be accurately fit using the BMARS model, without the possibility of overfitting or variance inflation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2013

Physics-based dimension reduction in uncertainty quantification for radiative transfer

We present a physics-based methodology for quantifying the uncertainty in a given quantity of interest (QOI) that is contributed by uncertainties in opacities in radiation transport problems. Typically, opacities are tabulated as a function of density, temperature, and photon energy group. The size of this table makes a study of uncertainties at this level challenging because of the well-known 'curse of dimensionality.' We address this by studying uncertain parameters in the underlying physical model that generates the opacity tables. At this level, there are fewer uncertain parameters but still too many to analyze directly through computationally expensive radiation transport simulations. In order to explore this large uncertain parameter space, we develop two simplified radiation transport problems that are much less computationally demanding than the target problem of interest. An emulator is created for each QOI for each simplified problem using Bayesian Multivariate Adaptive Regression Splines (BMARS). This emulator is used to create a functional relationship between the QOIs and the uncertain parameters. Sensitivity analysis is performed using the emulator to determine which parameters contribute significantly to the uncertainty. This physics-based screening process reduces the dimension of the parameter space that is then studied via the computationally expensive radiation transport calculation to generate distributions of quantities of interest. Results of this research demonstrate that the QOIs for the target problem agree for varying screening criteria determined by the sensitivity analysis, and the QOIs agree well for varying Latin Hypercube Design (LHD) sample sizes for the uncertain space. (authors)

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Predicting concrete compressive strength using hybrid ensembling of surrogate machine learning models

This study aims to implement a hybrid ensemble surrogate machine learning technique in predicting the compressive strength (CS) of concrete, an important parameter used for durability design and service life prediction of concrete structures in civil engineering projects. For this purpose, an experimental database consisting of 1030 records has been compiled from the machine learning repository of the University of California, Irvine. The database was used to train and validate four conventional machine learning (CML) models, namely Artificial Neural Network (ANN), Linear and Non-Linear Multivariate Adaptive Regression Splines (MARS-L and MARS-C), Gaussian Process Regression (GPR), and Minimax Probability Machine Regression (MPMR). Subsequently, the predicted outputs of CML models were combined and trained using ANN to construct the Hybrid Ensemble Model (HENSM). It is observed that the proposed HENSM produces higher predictive accuracy compared to the CML models used in the present study. The predictive performance of all models for CS prediction was compared using the testing dataset and it is found that the HENSM model attained the highest predictive accuracy in both phases. Based on the experimental results, the newly constructed HENSM model is very potential to be a new alternative in handling the overfitting issues of CML models and hence, can be used to predict the concrete CS, including the design of less polluting and more sustainable concrete constructions.

36 MATERIALS SCIENCE↗
DOE OSTI2016

Statistical-learning strategies generate only modestly performing predictive models for urinary symptoms following external beam radiotherapy of the prostate: A comparison of conventional and machine-learning methods

Purpose: Given the paucity of available data concerning radiotherapy-induced urinary toxicity, it is important to ensure derivation of the most robust models with superior predictive performance. This work explores multiple statistical-learning strategies for prediction of urinary symptoms following external beam radiotherapy of the prostate. Methods: The performance of logistic regression, elastic-net, support-vector machine, random forest, neural network, and multivariate adaptive regression splines (MARS) to predict urinary symptoms was analyzed using data from 754 participants accrued by TROG03.04-RADAR. Predictive features included dose-surface data, comorbidities, and medication-intake. Four symptoms were analyzed: dysuria, haematuria, incontinence, and frequency, each with three definitions (grade ≥ 1, grade ≥ 2 and longitudinal) with event rate between 2.3% and 76.1%. Repeated cross-validations producing matched models were implemented. A synthetic minority oversampling technique was utilized in endpoints with rare events. Parameter optimization was performed on the training data. Area under the receiver operating characteristic curve (AUROC) was used to compare performance using sample size to detect differences of ≥0.05 at the 95% confidence level. Results: Logistic regression, elastic-net, random forest, MARS, and support-vector machine were the highest-performing statistical-learning strategies in 3, 3, 3, 2, and 1 endpoints, respectively. Logistic regression, MARS, elastic-net, random forest, neural network, and support-vector machine were the best, or were not significantly worse than the best, in 7, 7, 5, 5, 3, and 1 endpoints. The best-performing statistical model was for dysuria grade ≥ 1 with AUROC ± standard deviation of 0.649 ± 0.074 using MARS. For longitudinal frequency and dysuria grade ≥ 1, all strategies produced AUROC>0.6 while all haematuria endpoints and longitudinal incontinence models produced AUROC<0.6. Conclusions: Logistic regression and MARS were most likely to be the best-performing strategy for the prediction of urinary symptoms with elastic-net and random forest producing competitive results. The predictive power of the models was modest and endpoint-dependent. New features, including spatial dose maps, may be necessary to achieve better models.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2013

Liver proteomics in progressive alcoholic steatosis

Fatty liver is an early stage of alcoholic and nonalcoholic liver disease (ALD and NALD) that progresses to steatohepatitis and other irreversible conditions. In this study, we identified proteins that were differentially expressed in the livers of rats fed 5% ethanol in a Lieber–DeCarli diet daily for 1 and 3 months by discovery proteomics (two-dimensional gel electrophoresis and mass spectrometry) and non-parametric modeling (Multivariate Adaptive Regression Splines). Hepatic fatty infiltration was significantly higher in ethanol-fed animals as compared to controls, and more pronounced at 3 months of ethanol feeding. Discovery proteomics identified changes in the expression of proteins involved in alcohol, lipid, and amino acid metabolism after ethanol feeding. At 1 and 3 months, 12 and 15 different proteins were differentially expressed. Of the identified proteins, down regulation of alcohol dehydrogenase (− 1.6) at 1 month and up regulation of aldehyde dehydrogenase (2.1) at 3 months could be a protective/adaptive mechanism against ethanol toxicity. In addition, betaine-homocysteine S-methyltransferase 2 a protein responsible for methionine metabolism and previously implicated in fatty liver development was significantly up regulated (1.4) at ethanol-induced fatty liver stage (1 month) while peroxiredoxin-1 was down regulated (− 1.5) at late fatty liver stage (3 months). Nonparametric analysis of the protein spots yielded fewer proteins and narrowed the list of possible markers and identified D-dopachrome tautomerase (− 1.7, at 3 months) as a possible marker for ethanol-induced early steatohepatitis. The observed differential regulation of proteins have potential to serve as biomarker signature for the detection of steatosis and its progression to steatohepatitis once validated in plasma/serum. -- Graphical abstract: The figure shows the Hierarchial cluster analysis of differentially expressed protein spots obtained after ethanol feeding for 1 (1–3) and 3 (4–6) months. C and E represent pair-fed control and ethanol-fed rats, respectively. Highlights: ► Proteins related to ethanol-induced steatosis and mild steatohepatitis are identified. ► ADH1C and ALDH2 involved in alcohol metabolism are differentially expressed at 1 and 3 months. ► Discovery proteomics identified a group of proteins to serve as potential biomarkers. ► Using nonparametric analysis DDT is identified as a possible marker for liver damage.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2018

Efficient Surrogate Model Development: Impact of Sample Size and Underlying Model Dimensions

This study compares eight surrogate-model construction approaches using computational experiments. Here, the construction approaches considered include: Artificial Neural Networks (ANNs), Automated Learning of Algebraic Models using Optimization (ALAMO), Radial Basis Networks (RBNs), Extreme Learning Machines (ELMs), Gaussian Progress Regression (GPR), Random Forests (RFs), Support Vector Regression (SVR), and Multivariate Adaptive Regression Splines. Each approach is used to construct surrogate models for predicting the outputs of thirty-four test functions. The data used to construct surrogate models were generated using Latin Hypercube Sampling (LHS), Halton and Sobol sampling methods. We studied the impact of sampling method, sample size, and challenge function characteristics on the accuracy of surrogate model predictions. Our results revealed that for smaller sample sizes, on average, surrogate models trained using the data points generated by Sobol sequences provided the best estimation for all surrogate model construction approaches. As the sample size increased, the impact of sampling methods diminished. The comparison of surrogate-modeling construction approaches at large sample sizes revealed that surrogate models trained using ANN, ALAMO, and ELM yielded smaller root mean squared error and higher adjusted R-squared values than the models trained using the rest of the approaches.

42 ENGINEERING↗