Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Deep-learning-enhanced assessment of wellbore barrier effectiveness in geologic storage systems with intermediate aquifers

For geologic systems where carbon dioxide (CO 2 ) is injected underground, existing wells represent potential pathways for fluid migration. Here, this study introduces a novel deep learning model to quantify the likelihood and potential magnitude of fluid migration through wellbores at sites with intermediate aquifers or thief zones between the injection units and underground drinking water sources. Synthetic datasets, generated using reservoir simulations, captured a wide range of subsurface conditions, well attributes, operational parameters, and fluid migration scenarios. Among the regression models developed to predict brine and CO 2 leakage rates and CO 2 saturations along leaky wellbores, convolutional neural network (CNN) outperformed both Light Gradient Boosting Machine and deep neural network. Additionally, a CNN-based classification model was created to predict whether brine and CO 2 would leak along a wellbore, further improving performance over regression alone. The best models were integrated into the National Risk Assessment Partnership Open-source Integrated Assessment Model for rapid, stochastic assessment of storage system containment and leakage risks. A case study demonstrated the model’s ability to simulate fluid migration through existing wells with multiple intermediate aquifers. This computationally efficient wellbore model offers value in support of site performance evaluation and risk-informed decision making by stakeholders.

CO2 leakage↗
NASA NTRS2014

A New Hybrid Spatio-temporal Model for Estimating Daily Multi-year PM2.5 Concentrations Across Northeastern USA Using High Resolution Aerosol Optical Depth Data

The use of satellite-based aerosol optical depth (AOD) to estimate fine particulate matter PM(sub 2.5) for epidemiology studies has increased substantially over the past few years. These recent studies often report moderate predictive power, which can generate downward bias in effect estimates. In addition, AOD measurements have only moderate spatial resolution, and have substantial missing data. We make use of recent advances in MODIS satellite data processing algorithms (Multi-Angle Implementation of Atmospheric Correction (MAIAC), which allow us to use 1 km (versus currently available 10 km) resolution AOD data.We developed and cross validated models to predict daily PM(sub 2.5) at a 1X 1 km resolution across the northeastern USA (New England, New York and New Jersey) for the years 2003-2011, allowing us to better differentiate daily and long term exposure between urban, suburban, and rural areas. Additionally, we developed an approach that allows us to generate daily high-resolution 200 m localized predictions representing deviations from the area 1 X 1 km grid predictions. We used mixed models regressing PM(sub 2.5) measurements against day-specific random intercepts, and fixed and random AOD and temperature slopes. We then use generalized additive mixed models with spatial smoothing to generate grid cell predictions when AOD was missing. Finally, to get 200 m localized predictions, we regressed the residuals from the final model for each monitor against the local spatial and temporal variables at each monitoring site. Our model performance was excellent (mean out-of-sample R(sup 2) = 0.88). The spatial and temporal components of the out-of-sample results also presented very good fits to the withheld data (R(sup 2) = 0.87, R(sup)2 = 0.87). In addition, our results revealed very little bias in the predicted concentrations (Slope of predictions versus withheld observations = 0.99). Our daily model results show high predictive accuracy at high spatial resolutions and will be useful in reconstructing exposure histories for epidemiological studies across this region.

Air pollution↗
DOE OSTI2020

System-level performance and degradation of 21 GWDC of utility-scale PV plants in the United States

We assess the performance of a fleet of 411 utility-scale (i.e., >5 MWAC and ground-mounted) photovoltaic (PV) projects totaling 21.1 GWDC (16.3 GWAC) of capacity, which achieved commercial operations in the United States from 2007 to 2016. This fleet of projects contributed more than 50% of all solar electricity generated in the United States in 2017. Using detailed information on individual project characteristics, in conjunction with modeled irradiance data, we assess the extent to which actual first-year performance has lived up to both modeled and stated expectations. We then analyze system-level performance degradation in subsequent years by employing a “fixed effects” regression model to statistically isolate the impact of age on system performance. We find that this fleet of utility-scale PV projects has generally lived up to ex ante expectations for first-year performance but that subsequent system-level degradation—found to be −1.3%/year (±0.2%)—has, on average, been worse than both ex ante expectations (commonly −0.5%/year) and results from past studies (ranging from −0.8%/year to −1.0%/year). We emphasize that −1.3%/year is a system-level estimate that captures more than just module degradation (e.g., including soiling, balance of plant degradation, and downtime for maintenance and/or other events). A side analysis of a variety of project characteristics suggests that system-level degradation rates tend to be of lower magnitude among newer projects and larger projects and at sites with lower long-term average temperatures.

14 SOLAR ENERGY↗
DOE OSTI2021

Radiation effects on atherosclerosis in atomic bomb survivors: a cross-sectional study using structural equation modeling

Past reports indicated that total-body irradiation at low to moderate doses could be responsible for cardiovascular disease risks, but the mechanism remains unclear. The purpose of this study was to investigate the association between radiation exposure and atherosclerosis, an underlying pathology of cardiovascular diseases, in the Japanese atomic bomb survivors. We performed a cross-sectional study measuring 14 clinical-physiological atherosclerosis indicators during clinical exams from 2010 to 2014 in 3274 participants of the Adult Health Study cohort. Multivariable analyses were performed by using a structural equation model with latent factors representing underlying atherosclerotic pathologies: (1) arterial stiffness, (2) calcification, and (3) plaque as measured with indicators chosen a priori on the basis of clinical-physiological knowledge. Radiation was linearly associated with calcification (standardized coefficient per Gy 0.15, 95 % confidence interval: CI [0.070, 0.23]) and plaque (0.11, 95 % CI [0.029, 0.20]), small associations that were comparable to about 2 years of aging per Gy of radiation exposure, but not with arterial stiffness (0.036, 95 % CI [-0.025, 0.095]). The model fitted better and had narrower confidence intervals than separate ordinary regression models explaining individual indicators independently. The associations were less evident when the dose range was restricted to a maximum of 2 or 1 Gy. By combining individual clinical-physiological indicators that are correlated because of common, underlying atherosclerotic pathologies, we found a small, but significant association of radiation with atherosclerosis.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Heuristic Computational Model for Predicting Lignin Solubility in Tailored Organic Solvents

Lignin is a random heteropolymer that has been extensively studied as a renewable source of aromatic precursors for high-value chemicals, biofuels, and bioplastics. A key challenge in lignin valorization is the structural and compositional heterogeneity of lignin feedstocks. Solvent-based approaches are commonly used to fractionate lignin to reduce this heterogeneity, but solvent selection can be challenging due to variability in lignin composition. In this work, we developed computational methods to predict good and poor organic solvents as a function of lignin composition. We analyzed 28 different linear pentamer structures, 18 from known libraries and 10 hypothetical polymers, and calculated their activity coefficients in 50 different organic solvents by using the conductor-like screening model for realistic solvents. We used these data to train a regression model that enabled the extensive investigation of the impact of solvent and monolignol compositions on predicted lignin solubility. The exhaustive exploration of solubility trends using model predictions revealed sets of solvents, identified using Kamlet–Taft parameters, that are predicted to promote lignin dissolution regardless of lignin composition. We further identified solvents expected to selectively isolate lignin fractions enriched in certain subunits. Furthermore, these results establish heuristic guidelines for solvent selection that can be used to tailor fractionation processes for lignin feedstocks of distinct composition or to design new processes that isolate fractions with higher proportions of selected subunits.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1974

Geometrical geodesy techniques in Goddard earth models

The method for combining geometrical data with satellite dynamical and gravimetry data for the solution of geopotential and station location parameters is discussed. Geometrical tracking data (simultaneous events) from the global network of BC-4 stations are currently being processed in a solution that will greatly enhance of geodetic world system of stations. Previously the stations in Goddard earth models have been derived only from dynamical tracking data. A linear regression model is formulated from combining the data, based upon the statistical technique of weighted least squares. Reduced normal equations, independent of satellite and instrumental parameters, are derived for the solution of the geodetic parameters. Exterior standards for the evaluation of the solution and for the scale of the earth's figure are discussed.

Lerch, F. J.↗
NASA NTRS1975

Optimal selection of passes

Preliminary numerical results obtained from the application of a linear feature selection technique to the determination of combinations of passes which best discriminate between a given set of crops in a given area of interest, are reported. The results obtained are not purported to hold in a general situation, but only for the given set of crops and the given, but unknown, levels of several factors-such as soil type, and fertilizer practice, holding in the area of interest. However, by identifying the various factors affecting the spectral signatures, and by formulating a regression model one could use the feature selection technique to determine the regression coefficients for predicting optimal passes for a given set of crops. Another use of the feature selection technique as applied to multiple pass registered data is the generation of enhanced grey scale displays by using a single linear combination of all channels of all designated passes as opposed to a single channel within a single pass.

Guseman, L. F., Jr.↗
NASA NTRS2002

Extreme Weather Events and Their Relationship to Low Frequency Teleconnection Patterns

A new method for identifying the structure and other characteristics of extreme weather events is introduced and applied to both model simulations and observations. The approach is based on a linear regression model that links daily extreme precipitation amounts for a particular point on the globe to precipitation and related quantities at all other points. We present here some initial results of our analysis of extreme precipitation events over the United States, including how they are influenced by ENSO and various large-scale teleconnection patterns such as the PNA. The results are based on simulations made with the NASA/NCAR AGCM (Lin and Rood 1996). The quality of the simulated climate for the NASA/NCAR AGCM forced with observed SSTs is described in Chang et al. (2001). The runs analyzed here consist of three 20-year runs forced with idealized cold, neutral and warm ENSO SST anomalies (superimposed on the mean seasonal cycle of SST). The idealized warm or cold SST anomalies are fixed throughout each 20- year simulation and consist of the first EOF (+/- 3 standard deviations) of monthly SST data. Comparisons are made with the results obtained from a similar analysis that uses daily NOAA precipitation observations (Higgins et al. 1996) over the United States and NCEP/NCAR reanalysis data for the period 1949-1998.

Chang, Yehui↗
DOE OSTI2024

Performance Comparison of Machine Learning Models for Ultrasonic Nondestructive Evaluation of Alkali-Silica Reaction in Concrete

Alkali-silica reaction (ASR) causes concrete degradation, leading to cracking, rebar corrosion, and reduced structural integrity, which raises safety concerns. Ultrasonic nondestructive evaluation (NDE) effectively assesses concrete properties and monitors ASR progression. However, its deployment and analysis require specialized expertise and subjective interpretation. As computational power increases, artificial intelligence (AI) and machine learning (ML) algorithms are increasingly being used to automate NDE data analysis across various industries for AI-assisted automation. Regulatory agencies are adapting to this technological shift, prompting a need to evaluate current ML technologies’ capabilities and limitations in assessing concrete material properties and damage. This report presents a comparative analysis of four ML regression models for predicting concrete material damage induced by ASR expansion using long-term ultrasonic data monitoring. The models investigated include linear regression (LR), support vector regression (SVR), shallow neural networks (NN), and deep neural networks (DNN). LR, SVR, and shallow NN models use features extracted from ultrasonic signals, whereas the DNN model processes time-domain ultrasonic signals and frequency spectra directly. The study systematically compared the models’ performance from various perspectives, including model input, prediction performance, and generalization ability. The findings indicate significant variability in model performance, with some ML algorithms achieving very high or very low prediction accuracy depending on the preprocessing and feature engineering (extraction and selection) applied. Key insights include the observation that shallow ML models (LR, SVR, and shallow NNs) require meticulous preprocessing and feature extraction to achieve high accuracy. In contrast, the DNN model, although it bypasses the need for feature engineering, necessitates extensive preprocessing to mitigate noise and computational demands. The SVR model emerged as the top performer among the shallow models, and the DNN model exhibited superior performance on specific datasets but struggled with generalization across specimens from different batches. Additionally, the SVR model is sensitive to temperature variations, whereas the DNN model is robust in this regard. Using recurrent neural networks is recommended for future ASR expansion prediction studies. Recurrent neural networks’ inherent ability to capture temporal dependencies and long-term patterns makes them well suited for analyzing sequential ultrasonic monitoring data. Overall, the results and conclusions of this study could provide insights into the capabilities and effectiveness of ML when applied to ultrasonic NDE data and help identify best practices for using ML for ultrasonic NDE of concrete material properties.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Predicting Initial Trans-Membrane Pressure for Optimized Operations in UF Unit Using Random Forest

With the growing scarcity of freshwater, innovative process design mechanisms like Reverse Osmosis (RO) are increasingly gaining attention among water treatment utilities to address the rising demand. Ensuring reliable water production necessitates efficient resource utilization, minimizing downtime in (ultra-filtration) UF systems. Recent advancements in machine learning (ML) have enabled the development of accurate data-driven models for Model Predictive Control (MPC), often requiring minimal prior knowledge of underlying physical processes. In this study, we present predictive regression models based on Random Forest (RF) and Auto-Regressive (AR) approaches to forecast the initial Trans-Membrane Pressure (TMP) for each filtration cycle in data generated by Direct Potable Reuse (DPR) systems. The proposed RF-based model demonstrates superior performance compared to baseline methods, including historical mean, Last Observation Carried Forward (LOCF), and naïve AR models, across various forecasting horizons in terms of root mean square error (RMSE) metric. To evaluate how different classes of process variables contribute to TMP dynamics over time, we examine the feature importance of independent covariates across multiple forecast horizons. This analysis provides insight into the temporal relevance of operational and sensor-derived features, guiding control and monitoring strategies. Additionally, the impact of hyperparameter tuning on TMP prediction performance is studied for both direct and recursive RF modelling approaches across increasing forecast horizons. Accurate prediction of initial TMP is critical for optimizing RO operations, as it enables the development of robust modelling frameworks by accurately estimating membrane fouling trends, thereby enhancing process efficiency and long-term reliability. The demonstrated efficacy of the RF-based approach highlights its potential as a tool for real-time decision-making in water treatment systems, paving the way for advanced process optimization and sustainable water resource management.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗
DOE OSTI2025

Predicting Initial Trans-Membrane Pressure for Optimized Operations in UF Unit Using Random Forest

With the growing scarcity of freshwater, innovative process design mechanisms like Ultra-filtration(UF) units are increasingly gaining attention among water treatment utilities to address the rising demand. Ensuring reliable water production necessitates efficient resource utilization, minimizing downtime in UF systems. Recent advancements in machine learning (ML) have enabled the development of accurate data-driven models for Model Predictive Control (MPC), often requiring minimal prior knowledge of underlying physical processes. In this study, we present predictive regression models based on Random Forest (RF) and Auto-Regressive (AR) approaches to forecast the initial Trans-Membrane Pressure (TMP) for each filtration cycle in data generated by Direct Potable Reuse (DPR) systems. The proposed RF-based model demonstrates superior performance compared to baseline methods, including historical mean, Last Observation Carried Forward (LOCF), and naïve AR models, across various forecasting horizons in terms of root mean square (RMSE) metric. Accurate prediction of initial TMP is critical for optimizing CCRO operations, as it enables the development of robust modelling frameworks that enhance process efficiency and reliability. The demonstrated efficacy of the RF-based approach highlights its potential as a tool for real-time decision-making in water treatment systems, paving the way for advanced process optimization and sustainable water resource management.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗
DOE OSTI2022

Utilizing machine learning to improve the precision of fluorescence imaging of cavity-generated spin squeezed states

We present a supervised learning model to calibrate the photon collection rate during the fluorescence imaging of cold atoms. The linear regression model finds the collection rate at each location on the sensor such that the atomic population difference equals that of a highly precise optical cavity measurement. This 192 variable regression results in a measurement variance 27% smaller than our previous single variable regression calibration. The measurement variance is now in agreement with the theoretical limit due to other known noise sources. This model efficiently trains in less than a minute on a standard personal computer's CPU and requires less than 10 min of data collection. Furthermore, the model is applicable across a large change in population difference and across data collected on different days.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

A Deep Neural Network for Accurate and Robust Prediction of the Glass Transition Temperature of Polyhydroxyalkanoate Homo- and Copolymers

The purpose of this study was to develop a data-driven machine learning model to predict the performance properties of polyhydroxyalkanoates (PHAs), a group of biosourced polyesters featuring excellent performance, to guide future design and synthesis experiments. A deep neural network (DNN) machine learning model was built for predicting the glass transition temperature, Tg, of PHA homo- and copolymers. Molecular fingerprints were used to capture the structural and atomic information of PHA monomers. The other input variables included the molecular weight, the polydispersity index, and the percentage of each monomer in the homo- and copolymers. The results indicate that the DNN model achieves high accuracy in estimation of the glass transition temperature of PHAs. In addition, the symmetry of the DNN model is ensured by incorporating symmetry data in the training process. The DNN model achieved better performance than the support vector machine (SVD), a nonlinear ML model and least absolute shrinkage and selection operator (LASSO), a sparse linear regression model. The relative importance of factors affecting the DNN model prediction were analyzed. Sensitivity of the DNN model, including strategies to deal with missing data, were also investigated. Compared with commonly used machine learning models incorporating quantitative structure–property (QSPR) relationships, it does not require an explicit descriptor selection step but shows a comparable performance. The machine learning model framework can be readily extended to predict other properties.

quantitative structure–property relationship (QSPR↗
DOE OSTI2023

Empirical radius formulas for canonical neutron stars from bidirectionally selecting features of equations of state in extended Bayesian analyses of observational data

Significant advancement in Bayesian inference of nuclear equation of state (EOS) from gravitational wave and x-ray observations of neutron stars (NSs) has been made by the nuclear astrophysics community especially since GW170817. By extending the traditional Bayesian analysis which normally ends at presenting the marginalized posterior probability distribution functions (PDFs) of individual EOS parameters and their correlations (or sometimes only the Pearson correlation coefficients which are only reliably useful when the variables are linearly correlated while they are actually often not), we search for a data-driven and robust empirical formula for the radius 𝑅 1.4 of canonical NSs in terms of the characteristic EOS parameters (features). We also identify the single most important but currently poorly known EOS parameter for determining the 𝑅 1.4 . Using three regression-model-building methodologies: bidirectional stepwise feature selection, least absolute shrinkage selection operator (LASSO) regression, and neural network regression on a large set of posterior EOSs and the corresponding 𝑅 1.4 values inferred from earlier comprehensive Bayesian analyses of NS observational data, we systematically and rigorously develop the most probable 𝑅 1.4 formulas with varying statistical accuracy and technical complexity. Here, the most important EOS parameters for determining 𝑅 1.4 are found consistently in each of the feature selection processes to be (in order of decreasing importance): curvature 𝐾 sym , slope 𝐿, skewness 𝐽 sym of nuclear symmetry energy, skewness 𝐽 0 , incompressibility 𝐾 0 of symmetric nuclear matter, and the magnitude 𝐸 sym ⁡(𝜌 0 ) of symmetry energy at the saturation density 𝜌 0 of nuclear matter.

Bayesian methods↗
NASA NTRS1992

Estimation of Kalman filter gain from output residuals

This paper presents a procedure for estimating the Kalman filter gain from output residuals. The system state space model is assumed to be known, but the process and noise covariance are unknown. The proposed procedure consists of three basic steps. First, the output residuals are computed from the given model and a given set of input-output data. Second, a linear regression model for this part of the response is computed by a least squares solution. Third, the Kalman filter gain is then estimated from the coefficients of this model. Numerical results using experimental data are presented to illustrate the validity of the developed procedure.

Juang, Jer-Nan↗
NASA NTRS2005

Hypersonic Wind Tunnel Calibration Using the Modern Design of Experiments

A calibration of a hypersonic wind tunnel has been conducted using formal experiment design techniques and response surface modeling. Data from a compact, highly efficient experiment was used to create a regression model of the pitot pressure as a function of the facility operating conditions as well as the longitudinal location within the test section. The new calibration utilized far fewer design points than prior experiments, but covered a wider range of the facility s operating envelope while revealing interactions between factors not captured in previous calibrations. A series of points chosen randomly within the design space was used to verify the accuracy of the response model. The development of the experiment design is discussed along with tactics used in the execution of the experiment to defend against systematic variation in the results. Trends in the data are illustrated, and comparisons are made to earlier findings.

Rhode, Matthew N.↗
NASA NTRS2021

Argentina Food Security & Agriculture: Crop Monitoring and Forecasting for Argentina using NASA Satellite Observations

Early harvest information helps guide agricultural commodity assessments in Argentina, providing valuable planning information to identify potentially food-insecure regions, anticipate transportation and storage demands, predict price fluctuations, and project commodity trends. However, crop yield estimates are currently subjective, based on interviews with qualified informants (i.e., farmers, agribusiness actors). In partnership with the Buenos Aires Grain Exchange, we leveraged Terra Moderate Resolution Imaging Spectroradiometer (MODIS), Soil Moisture Active Passive (SMAP), and Integrated Multi-satellitE Retrievals for Global Precipitation Measurement (GPM IMERG) NASA Earth observations to develop a Google Earth Engine (GEE) toolset to monitor vegetation growth. The first component of the toolset produces spatial and temporal maps of temperature, precipitation, soil moisture, and the Normalized Difference Vegetation Index (NDVI), allowing users to visualize the influence of the region’s climate and weather. Next, we developed an autoregressive model to predict NDVI several months in advance. Lastly, we created a linear regression model of crop yield and NDVI for soybeans, corn, and wheat, and input the forecasted NDVI to generate a predicted crop yield output. The NDVI forecasting model produced accurate predictions at two, four, and six months when examining the most recent growing season. In the crop yield model, soybeans exhibited moderately strong correlation, wheat had consistent weak correlation, and corn varied from weak to strong correlation depending on zone. This information is vital for vegetation growth monitoring by identifying areas of high growth and allocating resources to areas of lower growth to efficiently maximize crop yields.

DEVELOP Tech Paper↗
NASA NTRS1977

An empirical model for ocean radar backscatter and its application in inversion routine to eliminate wind speed and direction effects

Several regression models were tested to explain the wind direction dependence of the 1975 JONSWAP (Joint North Sea Wave Project) scatterometer data. The models consider the radar backscatter as a harmonic function of wind direction. The constant term accounts for the major effect of wind speed and the sinusoidal terms for the effects of direction. The fundamental accounts for the difference in upwind and downwind returns, while the second harmonic explains the upwind-crosswind difference. It is shown that a second harmonic model appears to adequately explain the angular variation. A simple inversion technique, which uses two orthogonal scattering measurements, is also described which eliminates the effect of wind speed and direction. Vertical polarization was shown to be more effective in determining both wind speed and direction than horizontal polarization.

Dome, G. J.↗