SEARCH · Engineering Papers

Results for “regression models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64

All sources NASA NTRS DOE OSTI

NASA NTRS2010

Model Robust Calibration: Method and Application to Electronically-Scanned Pressure Transducers

This article presents the application of a recently developed statistical regression method to the controlled instrument calibration problem. The statistical method of Model Robust Regression (MRR), developed by Mays, Birch, and Starnes, is shown to improve instrument calibration by reducing the reliance of the calibration on a predetermined parametric (e.g. polynomial, exponential, logarithmic) model. This is accomplished by allowing fits from the predetermined parametric model to be augmented by a certain portion of a fit to the residuals from the initial regression using a nonparametric (locally parametric) regression technique. The method is demonstrated for the absolute scale calibration of silicon-based pressure transducers.

Walker, Eric L.↗

NASA NTRS1974

Chain pooling to minimize prediction errors in subset regression

The existing theory of subset regression is examined, taking into account optimality criteria, small experiments, nonlinear models, colinearities, and special techniques. Approaches based on chain pooling coupled with principal components regression are discussed, giving attention to a comparison of half-normal plotting with chain pooling, a procedure based on prior ordering, deletion under the F-test, the largest of a set of chi-square variates, and principal components regression and model deletion. The choice of a true (population) model for simulations is considered along with the evaluation of the decision procedure and suitable computer programs.

Holms, A. G.↗

DOE OSTI2023

Using electronic health record metadata to predict housing instability amongst veterans

Housing instability is considered a significant life stressor and preemptive screening should be applied to identify those at risk for homelessness as early as possible so that they can be targeted for specialized care. We developed models to classify patient outcomes for an established VA Homelessness Screening Clinical Reminder (HSCR), which identifies housing instability, in the two months prior to its administration. Logistic Regression and Random Forest models were fit to classify responses using the last 18 months of document activity. We measure concentration of risk across stratifications of predicted probability and observe an enriched likelihood of finding confirmed false negative responses from veterans with diagnosed housing instability. Positive responses were 34 times more likely to be detected within the top 1 % of patients predicted at risk than from those randomly selected. There is a 1 in 4 chance of detecting false negatives within the top 1 % of predicted risk. Machine learning methods can classify between episodes of housing instability using a data-driven approach that does not rely on variables curated from domain experts. This method has the potential to improve clinicians’ ability to identify veterans who are experiencing housing instability but are not captured by HSCR.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2025

Uncertainty quantification for neural network potential foundation models

Abstract For neural network potentials (NNPs) to gain widespread use, researchers must be able to trust model outputs. However, the blackbox nature of neural networks and their inherent stochasticity are often deterrents, especially for foundation models trained over broad swaths of chemical space. Uncertainty information provided at the time of prediction can help reduce aversion to NNPs. In this work, we detail two uncertainty quantification (UQ) methods. Readout ensembling, by finetuning the readout layers of an ensemble of foundation models, provides information about model uncertainty, while quantile regression, by replacing point predictions with distributional predictions, provides information about uncertainty within the underlying training data. We demonstrate our approach with the MACE-MP-0 model, applying UQ to the foundation model and a series of finetuned models. The uncertainties produced by the readout ensemble and quantile methods are demonstrated to be distinct measures by which the quality of the NNP output can be judged.

36 MATERIALS SCIENCE↗

NASA NTRS1980

A model for the burning rates of composite propellants

An analytical model of the steady-state burning of composite solid propellants is presented. An improved burning rate model is achieved by incorporating an improved AP monopropellant model, a separate energy balance for the binder in which a portion of the diffusion flame is used to heat the binder, proper use of the binder regression rate in the model, and a model for the combustion of the energetic binder component of CMDB propellants. Also, an improved correlation and model of aluminum agglomeration is developed which properly describes compositional trends.

Cohen, N. S.↗

NASA NTRSDate not supplied

Quantifying radiation quality for space relevant radiation types: Fitting excess risk models to three combined HZE-irradiated mouse datasets

Radiation health risks are predominantly derived from low linear energy transfer (LET) terrestrial exposures; however, space radiation includes exposure to high-LET and high-charge, high-energy (HZE) particles. Accurately quantifying the differences in radiation quality between the space and terrestrial radiation environments is important for assessing and predicting health risks for astronauts. Weil et al. 2009 and 2014 used two different inbred mouse strains to study differences in hepatocellular carcinoma (HCC) tumorigenesis after exposures to low- and high- LET radiation. More recently, Edmundson et al. 2020 provided valuable new tumor data in outbred mice that were exposed to low- and high-LET radiation. The present study aims to rigorously investigate a relative biological effectiveness (RBE) factor by leveraging the HCC tumor data from Weil et al. 2009, Weil et al. 2014, and Edmundson et al. 2020. The three experiments were similarly designed, allowing the raw data to be combined into a pooled dataset to estimate excess relative risk (ERR) and excess absolute risk (EAR) models using Bayesian Poisson regression. These effect estimates from the pooled data provide greater power to calculate a data driven RBE. Extensive sensitivity analyses test the robustness of RBE estimates to various model assumptions. The following questions will be explored through the sensitivity analyses: • Is the shape of the dose response different for low-LET radiation and HZE radiation, indicating that RBE is a function of dose? • Does attained age modify the effect estimates differently for low-LET radiation and HZE radiation, indicating RBE is a function of attained age? • Are the effect estimates and RBE estimates different for inbred mouse strains and outbred mouse strains? • Do assumptions about differences in ERR models and EAR models change the estimated RBE? Additional studies would be needed to validate the findings from these exploratory analyses.

Lori J. Chappell↗

NASA NTRSDate not supplied

Bayesian Model Selection for Reducing Bloat and Overfitting in Genetic Programming for Symbolic Regression

When performing symbolic regression using genetic programming, overfitting and bloat can negatively impact generalizability and interpretability of the resulting equations as well as increase computation times. A Bayesian fitness metric is introduced and its impact on bloat and overfitting during population evolution is studied and compared to common alternatives in the literature. The proposed approach was found to be more robust to noise and data sparsity in numerical experiments, guiding evolution to a level of complexity appropriate to the dataset. Further evolution of the population resulted not in overfitting or bloat, but rather in slight simplifications in model form. The ability to identify an equation of complexity appropriate to the scale of noise in the training data was also demonstrated. In general, the Bayesian model selection algorithm was shown to be an effective means of regularization which resulted in less bloat and overfitting when any amount of noise was present in the training data.

Uncertainty quantification↗

DOE OSTI2022

Uncertainty Aware Deep Learning for Particle Accelerators

Standard deep learning models for classification and regression applications are ideal for capturing complex system dynamics. However, their predictions can be arbitrarily inaccurate when the input samples are not similar to the training data. Implementation of distance aware uncertainty estimation can be used to detect these scenarios and provide a level of confidence associated with their predictions. In this paper, we present results from using Deep Gaussian Process Approximation (DGPA) methods for errant beam prediction at Spallation Neutron Source (SNS) accelerator (classification) and we provide an uncertainty aware surrogate model for the Fermi National Accelerator Lab (FNAL) Booster Accelerator Complex (regression).

Rajput, Kishansingh↗

DOE OSTI2023

Association Between Injection and Microseismicity in Geothermal Fields With Multiple Wells: Data-Driven Modeling of Rotokawa, New Zealand, and Húsmúli, Iceland

Understanding injection-induced microseismicity in geothermal systems can provide insight into reservoir connectedness. However, fault and reservoir complexity are difficult to represent in simple analytical models, which makes it difficult to discern clear relationships from incidental associations. Here, we have used data-driven models to study how fluid injection and microseismicity are related in the Rotokawa (New Zealand) and Hellisheiði (Iceland) geothermal fields. We tested two classes of model: (a) lagged linear regression of seismicity rate as a function of well injection rates; and (b) systematic extraction of injection time series features that are then evaluated for associations with the seismicity. These models allowed us to determine which wells had the greatest correlation with microseismicity and to explain this association in a reservoir context. Finally, exploring different data types and transformations, we were unable to establish a link between rapid changes in injection rate and seismicity spikes, as suggested by some theoretical models.

15 GEOTHERMAL ENERGY↗

DOE OSTI2022

Machine-Learning of Nonlocal Kernels for Anomalous Subsurface Transport from Breakthrough Curves

Anomalous behavior is ubiquitous in subsurface solute transport due to the presence of high degrees of heterogeneity at different scales in the media. Although fractional models have been extensively used to describe the anomalous transport in various subsurface applications, their application is hindered by computational challenges. Simpler nonlocal models characterized by integrable kernels and finite interaction length represent a computationally feasible alternative to fractional models; yet, the informed choice of their kernel functions still remains an open problem. We propose a general data-driven framework for the discovery of optimal kernels on the basis of very small and sparse data sets in the context of anomalous subsurface transport. Using spatially sparse breakthrough curves recovered from fine-scale particle-density simulations, we learn the best coarse-scale nonlocal model using a nonlocal operator regression technique. Predictions of the breakthrough curves obtained using the optimal nonlocal model show good agreement with fine-scale simulation results even at locations and time intervals different from the ones used to train the kernel, confirming the excellent generalization properties of the proposed algorithm. A comparison with trained classical models and with black-box deep neural networks confirms the superiority of the predictive capability of the proposed model.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2022

MLtool: Universal Supervised Machine Learning Tool to Model Tabulated Data

Machine Learning (ML) is a subfield of Artificial Intelligence that gives computers the ability to learn from past data without being explicitly programmed. The predictive capabilities of ML models have already been used to facilitate several scientific breakthroughs. However, the practical application of ML is often limited due to the gaps in technical knowledge of its users. The common issue faced by many scientific researchers is the inability to choose the appropriate ML pipelines that are needed to treat real-world data, which is often sparse and noisy. To solve this problem, we have developed an automated Machine Learning tool (MLtool) that includes a set of ML algorithms and approaches to aid scientific researchers. The current version of MLtool is implemented as an object-oriented Python code that is easily extensible. It includes 44 different regression algorithms used to model data. MLtool helps users select the best model for their data, based on the scoring metrics used. Besides regression algorithms, MLtool also includes a suite of pre- and post-processing techniques such as missing value imputation, categorical variable encoding, input feature normalization, uncertainty quantification, exploratory data analysis (EDA), etc. MLtool was tested on several publicly available multi-dimensional data sets and was found capable of making accurate predictions.

Machine learning↗

NASA NTRS2022

MLtool Python Code

Machine Learning↗

DOE OSTI2020

Metamodeling Time-Temperature Creep Parameters

Abstract There exist many time-temperature parameter (TTP) models for creep rupture prediction of components including the Larson–Miller (LM), Manson–Haferd (MH), Manson–Brown (MB), Orr–Sherby–Dorn (OSD), Manson–Succop (MS), Graham–Walles (GW), Chitty–Duval (CD), Goldhoff–Sherby (GS) models. It remains a challenge to determine which model is “best”, capable of accurate interpolation and physically realistic extrapolation of creep rupture data for a given material. In this study, metamodeling is applied to create a unified TTP metamodel that combines and regresses into twelve TTP models (eight existing and four newly derived). An analysis of the mathematical problems that exist in TTP models is provided. A matlab code is written that can: (1) calibrate the material constants of any of the twelve TTP models (using the metamodel); (2) determine the most suitable stress-parameter function; (3) and report the normalized mean square error (NMSE) of rupture predictions for a given material database. Using the metamodel, and code, a design engineer can make an intelligent selection of the “best” TTP model for creep resistant design. This process is demonstrated using four isotherms of alloy P91 creep rupture data. To assess the influence of material, further validation is performed on alloys Hastelloy X, 304SS, and 316SS. It is determined that the “best” model is dependent on material type and the quality and quantity of available data.

Engineering↗

NASA NTRS1984

Brazil soybean yield covariance model

A model based on multiple regression was developed to estimate soybean yields for the seven soybean-growing states of Brazil. The meteorological data of these seven states were pooled and the years 1975 to 1980 were used to model since there was no technological trend in the yields during these years. Predictor variables were derived from monthly total precipitation and monthly average temperature.

Callis, S. L.↗

NASA NTRSDate not supplied

Bayesian Symbolic Regression: Addressing Challenges in Estimating Fractional Bayes Factors and Application to Fatigue Crack Growth Modeling

This research pioneers advancements in computational mechanics by integrating Bayesian-based uncertainty quantification into symbolic regression, specifically focusing on the critical task of accurately estimating the fractional Bayes factor for selecting arbitrary equations. In our exploration, we rigorously study two prominent methods—sequential Monte Carlo and the Laplace approximation—employed for computing the fractional Bayes factor. Our findings underscore the limitations of the Laplace approximation, revealing its diminished accuracy in nonlinear and multimodal scenarios. Specifically, the Laplace approximation is shown to underpredict fractional Bayes factor on a wide set of equations associated with a symbolic regression benchmark. This comparative analysis sheds light on the nuanced performance of these techniques, guiding researchers toward more informed choices in uncertainty quantification within symbolic regression. Furthermore, we showcase the practical utility of these enhanced symbolic regression tools through their application to a real-world problem in fatigue crack growth modeling, emphasizing their efficacy in capturing the complexities of mechanical systems.

Geoffrey Bomarito↗

DOE OSTI2024

A Data-Driven Methodology for Contextual Unit Commitment Using Regression Residuals

Day after day, system operators are faced with the challenge of taking unit commitment (UC) decisions under uncertain net load conditions. The standard operating procedure for taking UC decisions begins by leveraging auxiliary data on covariates (such as the day of the week or latest weather information) to generate a point prediction for net load, which is used in solving a deterministic UC problem. Such an approach, however, is known to deliver a notoriously poor out-of-sample (OOS) performance, as it completely disregards the stochastic nature of net load. While stochastic programming models explicitly represent uncertainty, they mostly do so using a generic set of scenarios that neglect covariate observations, squandering useful auxiliary data that could be harnessed to glean insights into uncertainty. In this article, we discuss a contextual stochastic optimization approach to UC, which effectively exploits covariate observations while explicitly assessing uncertainty so as to boost the OOS performance of UC decisions. The key thrust of our approach is to leverage regression models, along with their empirical residuals, to set up and solve sample average approximation problems. Not only do we prove that our approach satisfies the requisite conditions for asymptotic optimality and consistency laid out in (Kannan et al., 2022), but we also assess its performance on several case studies conducted using real-world data collected in California ISO and New York ISO grids. In conclusion, results show that the proposed approach can significantly improve OOS performance compared to alternative methods proposed in the literature under varying dataset sizes.

Yurdakul, Ogun↗

NASA NTRS1984

Argentina wheat yield model

Five models based on multiple regression were developed to estimate wheat yields for the five wheat growing provinces of Argentina. Meteorological data sets were obtained for each province by averaging data for stations within each province. Predictor variables for the models were derived from monthly total precipitation, average monthly mean temperature, and average monthly maximum temperature. Buenos Aires was the only province for which a trend variable was included because of increasing trend in yield due to technology from 1950 to 1963.

Callis, S. L.↗

NASA NTRS1984

Argentina soybean yield model

A model based on multiple regression was developed to estimate soybean yields for the country of Argentina. A meteorological data set was obtained for the country by averaging data for stations within the soybean growing area. Predictor variables for the model were derived from monthly total precipitation and monthly average temperature. A trend variable was included for the years 1969 to 1978 since an increasing trend in yields due to technology was observed between these years.

Callis, S. L.↗