Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Guiding the design of oxidation-resistant Fe-based single atom alloy catalysts with insights from configurational space

The high activity and selectivity of Fe-based heterogeneous catalysts toward a variety of reactions that require the breaking of strong bonds are offset in large part by their considerable instability with respect to oxidative deactivation. While it has been shown that the stability of Fe catalysts is considerably enhanced by alloying them with precious metals (even at the single-atom limit), rational design criteria for choosing such secondary metals are still missing. Since oxidative deactivation occurs due to the strong binding of oxygen to Fe and reduction by adsorbed hydrogen mitigates the deactivation, we propose here to use the binding affinity of oxygen and hydrogen adatoms as the basis for rational design. As it would also be beneficial to use cheaper secondary metals, we have scanned over a large subset of 3d–5d mid-to late transition metal single atoms and computationally determined their effect on the oxygen and hydrogen adlayer binding as a function of chemical potential and adsorbate coverage. We further determine the underlying chemical origins that are responsible for these effects and connect them to experimentally tunable quantities. Our results reveal a reliable periodic trend wherein oxygen binding is weakened greatest as one moves right and down the periodic table. Hydrogen binding shows the same trend only at high (but relevant) coverages and otherwise tends to have its binding slightly increased in all systems. Trends with secondary metal coverage are also uncovered and connected to experimentally tunable parameters.

Hensley, Alyssa↗
DOE OSTI2025

D–MOPH–25: diverse MOF–molecule pairs for Henry’s constants prediction

Computational methods like grand-canonical Monte Carlo simulations and machine learning (ML) have accelerated metal–organic frameworks (MOF) exploration but are typically limited to a narrow range of adsorbates due to data availability and force field constraints. In this study, we introduce a dataset of diverse MOF–molecule pairs for Henry’s constant prediction, D–MOPH–25, which systematically explores a diverse chemical space by combining 113 molecular adsorbates with over 5000 MOF structures through an active learning process. D–MOPH–25 constitutes the most diverse adsorbate dataset used in any ML study of molecular adsorption in MOFs to date. Our workflow builds a benchmark for predicting Henry’s constants at 300 K, leveraging conformal prediction for uncertainty quantification. Assessment through Shannon entropy and uniform manifold approximation and projection confirms the comprehensiveness of D–MOPH–25 while highlighting the importance of robust classification to filter out unphysical data points in regression tasks. Although future enhancements in model architecture and sampling criteria could improve predictive performance, our dataset already spans the target space using only 2.31% of total possibilities. This comprehensive dataset facilitates assessment of model generalizability across adsorbate species and can establish a foundation for high-throughput MOF screening and ML-driven separation processes.

active learning↗
DOE OSTI2022

Size-Dependent Nucleation in Crystal Phase Transition from Machine Learning Metadynamics

In this Letter, we present a framework that combines machine learning potential (MLP) and metadynamics to investigate solid-solid phase transition. Here, based on the spectral descriptors and neural networks regression, we develop a scalable MLP model to warrant an accurate interpolation of the energy surface where two phases coexist. Applying it to the simulation of B4–B1 phase transition of GaN under 50 GPa with different model sizes, we observe sequential change of the phase transition mechanism from collective modes to nucleation and growths. When the size is at or below 128 000 atoms, the nucleation and growth appear to follow a preferred direction. At larger sizes, the nuclei occur at multiple sites simultaneously and grow to microstructures by passing the critical size. The observed change of the atomistic mechanism manifests the importance of statistical sampling with large system size in phase transition modeling.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Decentralized Voltage Control of Large-Scale Distribution System with PVs Based on MADRL

This paper proposes a model-free decentralized control framework for the voltage regulation of large-scale distribution systems through the coordinated control of PV inverters. This is achieved by developing a novel interaction mechanism between the surrogate model and the centralized training and decentralized execution multiagent deep reinforcement learning framework. Specifically, the sparse Gaussian processes regression method is first utilized to develop the surrogate model of the original distribution system for reward calculation during the training stage, where each agent represents a sub-region in the centralized fashion for coordination strategy learning. After that, the learned control rules are used to inform controllers within each sub-region for real-time decisions with only local measurements. Comparative tests among various methods on the EPRI Ckt5 test system demonstrate the effectiveness of the proposed method.

distribution system↗
DOE OSTI2026

Discovery of BBO-11818, a Potent and Selective Noncovalent Inhibitor of (ON) and (OFF) KRAS with Activity against Multiple Oncogenic Mutants

Although KRAS G12C -specific inhibitors have been introduced, no approved targeted therapies exist for other clinically significant KRAS mutants, including KRAS G12D and KRAS G12V . We discovered BBO-11818, a potent, selective, orally bioavailable noncovalent pan-KRAS inhibitor capable of targeting multiple KRAS mutants in both the inactive GDP-bound (OFF) and active GTP-bound (ON) states. BBO-11818 binds in the Switch-II/Helix 3 pocket, inducing conformational changes incompatible with effector binding, and demonstrates high-affinity binding to mutant KRAS with strong selectivity over NRAS and HRAS. BBO-11818 potently inhibited MAPK signaling and cellular viability specifically in KRAS-driven lines and produced tumor regressions in KRAS-mutant xenograft models. Combination studies with anti–PD-1, anti-EGFR antibodies, and a RAS:PI3Kα breaker compound showed enhanced efficacy. BBO-11818 has entered phase I clinical trials for patients with various KRAS mutations in colorectal, pancreatic, and lung cancers (NCT06917079).

Stahlhut, Carlos [BridgeBio Oncology Therapeutics,↗
DOE OSTI2026

Substitution or Shared Utilization? Intrahousehold Vehicle Use in Mixed-Powertrain Households

While previous research has focused heavily on understanding the factors deriving alternative fuel vehicle adoption rates, there remains a significant gap in understanding how households distribute mileage across different powertrains. This study utilizes data from the 2022 Next Generation National Household Travel Survey to investigate vehicle miles traveled within a sample of 150 plug-in electric vehicle (PEV)-owning households (in which at least one battery electric vehicle is present), characterizing how different powertrains are integrated into daily mobility. Leveraging a Seemingly Unrelated Regression (SUR) framework the study jointly models the utilization of PEVs, hybrid electric vehicles (HEV), and internal combustion engine vehicles (ICEVs) while accounting for household-level substitution effects. The results provide evidence of an asymmetric substitution effect. In households with mixed-powertrain configurations, the ICEV captures a substantially higher share of household miles (compared with the PEV), acting as a utility sponge. Conversely, the model identifies specific socioeconomic and geographic cohorts that prioritize PEV as the primary household workhorse, indicating a systematic sorting effect. Although the sample size limits broader generalizability, these findings suggest that PEVs are used for frequent, specific routine-intensive roles, whereas the ICEV remains a specialized utility vehicle. These insights highlight distinct intrahousehold vehicle use behaviors that are often obscured by aggregate fleetwide statistics.

25 ENERGY STORAGE↗
DOE OSTI2024

Modeling dynamics of acute HIV infection incorporating density-dependent cell death and multiplicity of infection

Understanding the dynamics of acute HIV infection can offer valuable insights into the early stages of viral behavior, potentially helping uncover various aspects of HIV pathogenesis. The standard viral dynamics model explains HIV viral dynamics during acute infection reasonably well. However, the model makes simplifying assumptions, neglecting some aspects of HIV infection. For instance, in the standard model, target cells are infected by a single HIV virion. Yet, cellular multiplicity of infection (MOI) may have considerable effects in pathogenesis and viral evolution. Further, when using the standard model, we take constant infected cell death rates, simplifying the dynamic immune responses. Here, we use four models—1) the standard viral dynamics model, 2) an alternate model incorporating cellular MOI, 3) a model assuming density-dependent death rate of infected cells and 4) a model combining (2) and (3)—to investigate acute infection dynamics in 43 people living with HIV very early after HIV exposure. We find that all models qualitatively describe the data, but none of the tested models is by itself the best to capture different kinds of heterogeneity. Instead, different models describe differing features of the dynamics more accurately. For example, while the standard viral dynamics model may be the most parsimonious across study participants by the corrected Akaike Information Criterion (AICc), we find that viral peaks are better explained by a model allowing for cellular MOI, using a linear regression analysis as analyzed by R 2 . These results suggest that heterogeneity in within-host viral dynamics cannot be captured by a single model. Depending on the specific aspect of interest, a corresponding model should be employed.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Analysis of Waste Material Feedstocks Using Laser-Induced Breakdown Spectroscopy and Machine Learning

Predicting properties such as heating value, ash fusion temperature, and mineral ash composition from Laser-Induced Breakdown Spectroscopy (LIBS) data can make gasifiers more flexible to different feedstocks. Understanding these feedstock properties in-situ improves feedstock conversion modelling methods that allow for consistent operation, higher carbon conversion, and reduced fouling and erosion rates. The purpose of this study is to demonstrate methods for model creation that take LIBS data as predictor features and estimate higher order material properties as a function of feedstock material properties. Six samples were chosen to represent a mixture of abundant and carbon rich waste materials. LIBS measurements were performed on these samples for elemental wavelengths and intensity values. Laboratory analytical results were obtained for each sample’s heating value, proximate and ultimate analysis, mineral ash composition, ash fusion temperatures, and viscosity temperatures. Thermal conductivity was measured using a HotDisk TPS 2500S. LIBS measurements were processed and used as predictor features for machine learning (ML) models to predict the sample’s material properties. Predictor feature selection algorithms, particularly minimum redundancy maximum relevance (mRMR), reduced the dimensionality of ML models. Many modelling methods such as Gaussian process regression (GPR), regression tree, neural networks (NN), and support vector machines (SVM) were demonstrated to be effective at predicting higher order properties; however, mRMR with GPR stood out as a clear winning combination.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2023

Intra-hour Solar Irradiance Forecast in Multiple Locations using Deep Transfer Learning

In recent years, solar power system installation imposes several challenges on the operations of local and regional power grids due to the inherent variability of ground-level solar irradiance. This work proposes a novel real-time solar forecast methodology for intra-hour solar irradiance based on deep transfer learning from ground-based sky imager for time horizons ranging from 5-15 min. There are three unique aspects of the proposed methodology: (1) a Deep Learning based algorithm development which is modeled as a classification approach rather than a traditional regression approach; (2) the use of the Transfer Learning technique to show generalization capability, robustness, and portability of baseline model in the newly deployed location where availability of enough data for training is typically scarce, and (3) redefinition of point-based irradiation forecast error estimation technique with a window-based one that is more intuitive and user-friendly. The system is developed using multiple years of irradiance and sky image recording in New Jersey and one-year data from Colorado, USA. The method is validated against ground telemetry from these two locations of diverse geographic and climatic conditions. Results show that the forecasting method proposed in this work is robust and highly accurate (8% MAPE error) for multiple locations deployment.

Deep Learning, Convolution Neural Networks, transf↗
DOE OSTI2024

Evaluation of the Planetary Boundary Layer Height From ERA5 Reanalysis With MOSAiC Observations Over the Arctic Ocean

The planetary boundary layer height (PBLH) is a crucial indicator reflecting the region of the atmosphere characterized by continuous turbulence. Here, we use radiosonde and surface meteorological observations (4–7 times per day, year-round measurements) during the Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) expedition to derive the PBLH (PBLH MOSAiC ), and further evaluate the PBLH from the ERA5 reanalysis (PBLH ERA5 ). Comparisons between PBLH MOSAiC and PBLH ERA5 from different perspectives reveal that: (a) The overestimation of PBLH ERA5 when the sea ice concentration is >90% is significant with the centered root mean squared error reaching up to 201 m; (b) The difference between the two products is notably pronounced in cold seasons, while it is comparatively diminished in warm seasons; (c) In neutral boundary layers, differences in PBLH ERA5 are larger compared with stable and convective boundary layers. In addition, the analysis of error sources indicates that the bias of PBLH ERA5 is sensitive to the bias of vertical thermal structure and wind speed profiles in ERA5 data sets in all conditions. Finally, we find a Random Forest model effectively reduces the bias of PBLH ERA5 with the index of agreement reaching up to 0.71 in the test data set, while a multiple linear regression demonstrates comparable performance to the Random Forest model.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Effect of vaccination on the case fatality rate for COVID-19 infections 2020–2021: multivariate modelling of data from the US Department of Veterans Affairs

Objectives: To evaluate the benefits of vaccination on the case fatality rate (CFR) for COVID-19 infections. Design, setting and participants: The US Department of Veterans Affairs has 130 medical centres. We created multivariate models from these data—339 772 patients with COVID-19—as of 30 September 2021. Outcome measures: The primary outcome for all models was death within 60 days of the diagnosis. Logistic regression was used to derive adjusted ORs for vaccination and infection with Delta versus earlier variants. Models were adjusted for confounding factors, including demographics, comorbidity indices and novel parameters representing prior diagnoses, vital signs/baseline laboratory tests and outpatient treatments. Patients with a Delta infection were divided into eight cohorts based on the time from vaccination to diagnosis. A common model was used to estimate the odds of death associated with vaccination for each cohort relative to that of unvaccinated patients. Results: 9.1% of subjects were vaccinated. 21.5% had the Delta variant. 18 120 patients (5.33%) died within 60 days of their diagnoses. The adjusted OR for a Delta infection was 1.87±0.05, which corresponds to a relative risk (RR) of 1.78. The overall adjusted OR for prior vaccination was 0.280±0.011 corresponding to an RR of 0.291. Raw CFR rose steadily after 10–14 weeks. The OR for vaccination remained stable for 10–34 weeks. Conclusions: Our CFR model controls for the severity of confounding factors and priority of vaccination, rather than solely using the presence of comorbidities. Our results confirm that Delta was more lethal than earlier variants and that vaccination is an effective means of preventing death. After adjusting for major selection biases, we found no evidence that the benefits of vaccination on CFR declined over 34 weeks. We suggest that this model can be used to evaluate vaccines designed for emerging variants.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

A Comparative Study of Machine Learning Algorithms for Industry-Specific Freight Generation Model

According to Bureau of Transportation Statistics, the U.S. transportation system handled 14,329 million ton-miles of freight per day in 2020. Understanding the generation of these freight shipments is crucial for transportation researchers, planners, and policymakers to design and plan for a more efficient and connected freight transportation system. Traditionally, the freight generation modeling has been based on Ordinary Least Square (OLS) regression, although more advanced Machine Learning (ML) algorithms have been evaluated and proven to have excellent performance in various transportation applications in recent years. Furthermore, one modeling approach applied for one industry might not always be applicable for another as their freight generation logics can be quite different. The objective of this study is to apply and evaluate alternative ML algorithms in the estimation of freight generation for each of 45 industry types. Seven alternative ML algorithms, along with the base OLS regression, were evaluated and compared. In addition, the study considered different combinations of variables in both the original and logarithmic form as well as hyperparameters of those ML algorithms in the model selection for each industry type. The results showed statistically significant improvements in the root mean square error reduction by the alternative ML algorithms over the OLS for over 80% of cases. The study suggests utilizing the alternative ML algorithms can reduce the root mean square error by about 30%, depending on industry types.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

How analytic choices can affect the extraction of electromagnetic form factors from elastic electron scattering cross section data

Scientists often try to incorporate prior knowledge into their regression algorithms, such as a particular analytic behavior or a known value at a kinematic endpoint. Unfortunately, there is often no unique way to make use of this prior knowledge, and thus, different analytic choices can lead to very different regression results from the same set of data. In this paper, to illustrate this point in the context of the proton electromagnetic form factors, we use the Mainz elastic data with its 1422 cross section points and 31 normalization parameters. Starting with a complex unbound non-linear regression, we will show how the addition of a single theory-motivated constraint removes an oscillation from the magnetic form factor and shifts the extracted proton charge radius. We then repeat both regressions using the same algorithm, but with a rebinned version of the Mainz dataset. These examples illustrate how analytic choices, such as the function that is being used or even the binning of the data, can dramatically affect the results of a complex regression. These results also demonstrate why it is critical when using regression algorithms to have either a physical model in mind or a firm mathematical basis

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Probing Signal-Based Inertia and Frequency Response Estimation for Power Systems With High Levels of Inverter-Based Resources

Power system inertia is the inherent capability of a power system to resist changes in its frequency during disturbances. Real-time inertia estimation technology has become more important due to the low-inertia issues caused by the increasing integration levels of inverter-based resources (IBRs) from renewable energy; however, existing inertia estimation methods hardly consider multiple frequency response controls that act within the same time frame as conventional inertial response, thus making measured inertia values vary under different testing conditions. To resolve this issue, this paper proposes a novel real-time estimation method to simultaneously estimate a power system's inertia constant and frequency response droop constant using a well-designed probing signal. First, we formulate the inertia and frequency response model of a power system with IBRs. Second, through the integration and manipulation of the developed model, we propose a multivariate linear regression-based estimation method that is resilient to measurement noise. Third, we design a probing signal that can be injected by IBRs to incite the required transients for estimation. Finally, we validate the proposed estimation method through comprehensive power-hardware-in-the-loop experiments using inverter hardware and a realistic island power system model. The results demonstrate that the proposed method can accurately estimate the inertia and droop value of the power system with grid-following IBRs and grid-forming IBRs with virtual synchronous machine control.

frequency response↗
DOE OSTI2025

Convolutional Neural Networks Trained on Internal Variability Predict Forced Response of TOA Radiation by Learning the Pattern Effect

Abstract Predicting forced, long‐term radiative feedbacks from internal climate variability has been a decades‐long quest in climate science. We train a convolutional neural network (CNN) to predict annual‐ and global‐mean top of the atmosphere radiation anomalies from time‐varying maps of near‐surface temperature in climate models. Trained on internal variability alone, the nonlinear CNN can predict radiation under strong climate change, outperforms a regularized linear regression approach, and works within and across different climate models. We show with explainable artificial intelligence methods that the CNN draws predictive skill from physically meaningful regions but at much smaller spatial scales than currently assumed.

Rugenstein, Maria [Colorado State University Fort ↗
DOE OSTI2020

Little influence of Arctic amplification on mid-latitude climate

Observations and model simulations show enhanced warming in the Arctic under increasing greenhouse gases, a phenomenon known as the Arctic amplification (AA), that is likely caused by sea-ice loss. AA reduces meridional temperature gradients linked to circulation, thus mid-latitude weather and climate changes have been attributed to AA, often on the basis of regression analysis and atmospheric simulations. However, other modelling studies show only a weak link. This inconsistency may result from deficiencies in separating the effects of AA from those of natural variability or background warming. In this work, using coupled model simulations with and without AA, we show that cold-season precipitation, snowfall and circulation changes over northern mid-latitudes come mostly from background warming. AA and sea-ice loss increase precipitation and snowfall above ~60° N and reduce meridional temperature gradients above ~45° N in the lower–mid troposphere. However, minimal impact on the mean climate is seen below ~60° N, with weak reduction in zonal wind over 50°–70° N and 150–700 hPa, mainly over the North Atlantic and northern central Asia. These results suggest that the climatic impacts of AA are probably small outside the high latitudes, thus caution is needed in attributing mid-latitude changes to AA and sea-ice loss on the basis of statistical analyses that cannot distinguish the impact of AA from other correlated changes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Regressing Nuclear Reactor Power Level Using Low-Cost Sensor Network Data

Multisensor networks deployed at nuclear facilities can be leveraged to collect data used as inputs to machine learning models predicting nuclear safeguard relevant information. This work demonstrates an application of this idea by regressing nuclear reactor power levels, a key indicator for nuclear safeguard verification, at the McClellan Nuclear Research Center using data collected by five Merlyn multisensor platforms with LASSO and LSTM models. This work also demonstrates the use of Leave One Node Out to measure the importance of each multisensor for this regression problem providing insight into model explainability and allowing inferential hypotheses about the nuclear facility to be made. This work can be used as a starting point for future development of methods for regression on reactor power levels at nuclear facilities using multisensor network data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2026

Poisson Log-Normal Process for Count Data Prediction

Modeling count data is important in physics and other scientific disciplines, where measurements often involve discrete, non-negative quantities such as photon or neutrino detection events. Traditional parametric approaches can be trained to generate integer-count predictions but may struggle with capturing complex, non-linear dependencies often observed in the data. Gaussian process (GP) regression provides a robust non-parametric alternative to modeling continuous data; however, it cannot generate integer outputs. We propose the Poisson Log-Normal (PoLoN) process, a framework that employs GP to model Poisson log-rates. As in GP regression, our approach relies on the correlations between data points captured via GP kernel structure rather than explicit functional parameterizations. We demonstrate that the PoLoN predictive distribution is Poisson-LogNormal and provide an algorithm for optimizing kernel hyperparameters. Furthermore, we adapt the PoLoN approach to the problem of detecting weak localized signals superimposed on a smoothly varying background - a task of considerable interest in many areas of science and engineering. Our framework allows us to predict the strength, location and width of the detected signals. We evaluate PoLoN's performance using both synthetic and real-world datasets, including the open dataset from CERN which was used to detect the Higgs boson at the Large Hadron Collider. Our results indicate that the PoLoN process can be used as a non-parametric alternative for analyzing, predicting, and extracting signals from integer-valued data.

Saha, Anushka [Rutgers U., Piscataway]↗