Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A seamless multiscale operator neural network for inferring bubble dynamics

Modelling multiscale systems from nanoscale to macroscale requires the use of atomistic and continuum methods and, correspondingly, different computer codes. Here, we develop a seamless method based on DeepONet, which is a composite deep neural network (a branch and a trunk network) for regressing operators. In particular, we consider bubble growth dynamics, and we model tiny bubbles of initial size from 100 nm to 10 $\mathrm {\mu }\textrm {m}$ , modelled by the Rayleigh–Plesset equation in the continuum regime above 1 $\mathrm {\mu }\textrm {m}$ and the dissipative particle dynamics method for bubbles below 1 $\mathrm {\mu }\textrm {m}$ in the atomistic regime. After an offline training based on data from both regimes, DeepONet can make accurate predictions of bubble growth on-the-fly (within a fraction of a second) across four orders of magnitude difference in spatial scales and two orders of magnitude in temporal scales. The framework of DeepONet is general and can be used for unifying physical models of different scales in diverse multiscale applications.

Mechanics↗
DOE OSTI2021

Modeling freight mode choice using machine learning classifiers: a comparative study using Commodity Flow Survey (CFS) data

This study explores the usefulness of machine learning classifiers for modeling freight mode choice. We investigate eight commonly used machine learning classifiers, namely Naïve Bayes, Support Vector Machine, Artificial Neural Network, K-Nearest Neighbors, Classification and Regression Tree, Random Forest, Boosting and Bagging, along with the classical Multinomial Logit model. US 2012 Commodity Flow Survey data are used as the primary data source; we augment it with spatial attributes from secondary data sources. The performance of the classifiers is compared based on prediction accuracy results. The current research also examines the role of sample size and training-testing data split ratios on the predictive ability of the various approaches. In addition, the importance of variables is estimated to determine how the variables influence freight mode choice. The results show that the tree-based ensemble classifiers perform the best. Specifically, Random Forest produces the most accurate predictions, closely followed by Boosting and Bagging. With regard to variable importance, shipment characteristics, such as shipment distance, industry classification of the shipper and shipment size, are the most significant factors for freight mode choice decisions.

42 ENGINEERING↗
DOE OSTI2020

Probabilistic neural networks for fluid flow surrogate modeling and data recovery

We consider the use of probabilistic neural networks for fluid flow surrogate modeling and data recovery. This framework is constructed by assuming that the target variables are sampled from a Gaussian distribution conditioned on the inputs. Consequently, the overall formulation sets up a procedure to predict the hyperparameters of this distribution which are then used to compute an objective function given training data. We demonstrate that this framework has the ability to provide for prediction confidence intervals based on the assumption of a probabilistic posterior, given an appropriate model architecture and adequate training data. The applicability of the present framework to cases with noisy measurements and limited observations is also assessed. To demonstrate the capabilities of this framework, we consider canonical regression problems of fluid dynamics from the viewpoint of reduced-order modeling and spatial data recovery for four canonical data sets. The examples considered in this study arise from (i) the shallow-water equations, (ii) a two-dimensional cylinder flow, (iii) the wake of a NACA0012 airfoil with a Gurney flap, and (iv) the NOAA sea surface temperature data set. Furthermore, the present results indicate that the probabilistic neural network not only produces a machine-learning-based fluid flow surrogate model but also systematically quantifies the uncertainty therein to assist with model interpretability.

42 ENGINEERING↗
DOE OSTI2020

Comparison of linear regression, k-nearest neighbour and random forest methods in airborne laser-scanning-based prediction of growing stock

Abstract In this study, for five sites around the world, we look at the effects of different model types and variable selection approaches on forest yield modelling performances in an area-based approach (ABA). We compared ordinary least squares regression (OLS), k-nearest neighbours (kNN) and random forest (RF). Our objective was to test if there are systematic differences in accuracy between OLS, kNN and RF in ABA predictions of growing stock volume. The analyses are based on a 5-fold cross-validation at five study sites: an eucalyptus plantation, a temperate forest and three different boreal forests. Two completely independent validation datasets were also available for two of the boreal sites. For the kNN, we evaluated multiple measures of distance including Euclidean, Mahalanobis, most similar neighbour (MSN) and an RF-based distance metric. The variable selection approaches we examined included a heuristic approach (for OLS, kNN and RF), exhaustive search among all combinations (OLS only) and all variables together (RF only). Performances varied by model type and variable selection approaches among sites. OLS and RF had similar accuracies and were more efficient than any of the kNN variants. Variable selection did not affect RF performance. Heuristic and exhaustive variable selection performed similarly for OLS. kNN fared the poorest amongst model types, and kNN with RF distance was prone to overfitting when compared with a validation dataset. Additional caution is therefore required when building kNN models for volume prediction though ABA, being preferable instead to opt for models based on OLS with some variable selection, or RF with all variables together.

Cosenza, Diogo N.↗
DOE OSTI2023

Effects of Aluminum and Molybdenum on the Phase Stability of Iron-Chromium Alloys: A First-Principles Study

The interaction between solute atoms is critical to the thermodynamic behavior of Fe-Cr alloys, but the effects of non-dilute Al and Mo on the Fe-Cr phase stability and vacancy formation energy are not clearly understood. In this study, density functional theory, cluster expansion, and Monte Carlo simulation are used to predict the effects of ternary solute elements on the thermodynamic properties in multicomponent Fe-Cr alloys. The machine learning regression approach is applied to train and construct energy models that accurately describe the complex chemical interactions. The computational outcomes include the prediction of the partial ternary phase diagram, mixing enthalpy, and vacancy formation energy for different compositions. The phase boundary calculation predicts a pronounced change of Cr solubility in bcc Fe by the addition of Al and the rejection of Al atoms from a’ precipitates. The mixing enthalpy calculation shows that Mo may also reduce the Cr solubility in bcc Fe. Additionally, the simulations show that non-dilute Cr decreases the vacancy formation energy in bcc Fe, while adding Al results in a less significant effect. Finally, the results demonstrate important applications of using machine learning energy models to study model or commercial alloys with multicomponent solute species and point defects.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Degradation and Modeling of Large-Format Commercial Lithium-Ion Cells as a Function of Chemistry, Design, and Aging Conditions

Demand for large-format (>10 Ah) lithium-ion batteries has increased substantially in recent years, due to the growth of both electric vehicle and stationary energy storage markets. The economics of these applications is sensitive to the lifetime of the batteries, and end-of-life can either be due to energy or power limitations. Despite this, there is little information from cell manufacturers on the sensitivity of cell degradation to environmental conditions or battery use. This work reports accelerated aging test data from four commercial large-format lithium-ion batteries from three manufacturers, with varying design (thickness, casings, ...), chemistry (lithium-iron-phosphate (LFP) or lithium-nickel-manganese-cobalt-oxide positive electrodes (NMC), with graphite (Gr) negative electrodes), and capacity (50 to 250 Amp hours). The tested LFP|Gr cell is found to be relatively insensitive to cycling conditions like temperature or voltage window, while NMC|Gr cells have varying sensitivity. Degradation trends are further investigated by training predictive models: simple polynomial trend lines, a semi-empirical reduced-order model, and an empirical reduced-order model identified using machine-learning based on symbolic regression. Calendar and cycle life are simulated over a variety of conditions to directly compare the various batteries. Cell size and thickness are found to substantially impact sensitivity to temperature during cycle aging, while electrode chemistry impacts depth-of-discharge sensitivity. Real-world battery lifetime is evaluated by simulating residential energy storage and commercial frequency containment reserve systems in several U.S. climate regions. Predicted lifetime across cell types varies from 7 years to 20+ years, though all cells are predicted to have at least 10 year life in certain conditions.

battery lifetime↗
DOE OSTI2021

Statistical Uncertainty in Paleoclimate Proxy Reconstructions

A quantitative analysis of any environment older than the instrumental record relies on proxies. Uncertainties associated with proxy reconstructions are often underestimated, which can lead to artificial conflict between different proxies, and between data and models. In this paper, using ordinary least squares linear regression as a common example, we describe a simple, robust and generalizable method for quantifying uncertainty in proxy reconstructions. We highlight the primary controls on the magnitude of uncertainty, and compare this simple estimate to equivalent estimates from Bayesian, nonparametric and fiducial statistical frameworks. We discuss when it may be possible to reduce uncertainties, and conclude that the unexplained variance in the calibration must always feature in the uncertainty in the reconstruction. This directs future research toward explaining as much of the variance in the calibration data as possible. We also advocate for a “data-forward” approach, that clearly decouples the presentation of proxy data from plausible environmental inferences.

58 GEOSCIENCES↗
DOE OSTI2026

Conditional diffusion machine-learning framework for mapping valence electron distribution from convergent beam electron diffraction

Quantitative convergent beam electron diffraction (CBED) enables determination of aspherical valence electron distributions through refinement of low-order structure factors, which are highly sensitive to chemical bonding and charge density variations. However, conventional quantitative CBED (QCBED) requires solving a highly nonlinear inverse problem with many coupled parameters, and computationally intensive dynamical diffraction calculations, making it time-consuming and difficult to apply to complex systems. More broadly, reconstructing charge density and orbital electron distribution from diffraction data has long been a central challenge in both x-ray and electron crystallography. Here, in this study, we introduce an artificial-intelligence (AI)-based framework that replaces traditional refinement with a data-driven inverse solver. Using a large synthetic CBED dataset generated by Bloch-wave simulations, we train a conditional diffusion model to directly infer crystal structural parameters and multipole density formalism parameters, and hence valence electron distributions, from CBED patterns alone. By learning from forward simulations across realistic parameter space, the model effectively solves the inverse problem. Compared with direct regression approaches, the diffusion-based framework provides posterior parameter distributions for rigorous uncertainty quantification while preserving quantitative fidelity and reducing analysis time by orders of magnitude. By eliminating the need for external single-crystal x-ray diffraction data and complex nonlinear refinement, this approach enables practical, high-throughput, and in situ quantitative CBED, enabling real-time mapping of valence electron distributions and their correlation with functional responses in quantum and energy materials.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Targeting KDM4 for treating PAX3-FOXO1–driven alveolar rhabdomyosarcoma

Chimeric transcription factors drive lineage-specific oncogenesis but are notoriously difficult to target. Alveolar rhabdomyosarcoma (RMS) is an aggressive childhood soft tissue sarcoma transformed by the pathognomonic Paired Box 3–Forkhead Box O1 (PAX3-FOXO1) fusion protein, which governs a core regulatory circuitry transcription factor network. Here, we show that the histone lysine demethylase 4B (KDM4B) is a therapeutic vulnerability for PAX3-FOXO1 + RMS. Genetic and pharmacologic inhibition of KDM4B substantially delayed tumor growth. Suppression of KDM4 proteins inhibited the expression of core oncogenic transcription factors and caused epigenetic alterations of PAX3-FOXO1–governed superenhancers. Combining KDM4 inhibition with cytotoxic chemotherapy led to tumor regression in preclinical PAX3-FOXO1 + RMS subcutaneous xenograft models. In summary, we identified a targetable mechanism required for maintenance of the PAX3-FOXO1–related transcription factor network, which may translate to a therapeutic approach for fusion-positive RMS.

Cell Biology↗
DOE OSTI2021

The proton charge radius extracted from the initial-state radiation experiment at MAMI

Abstract We report on a comprehensive reinterpretation of the existing cross-section data for elastic electron-proton scattering obtained by the initial-state radiation technique, resulting in a significantly improved accuracy of the extracted proton charge radius. By refining the external energy corrections we have achieved an outstanding description of the radiative tail, essential for a detailed investigation of the proton finite-size effects on the measured cross sections. This development, together with a novel framework for determining the radius, based on a regression analysis of the cross sections employing a polynomial model for the form factor, led us to a new value for the charge radius, which is $$(0.878 \pm 0.011_\mathrm {stat.}\pm 0.031_\mathrm {sys.}\pm 0.002_\mathrm {mod.})\,\mathrm {fm}$$ ( 0.878 ± 0 . 011 stat . ± 0 . 031 sys . ± 0 . 002 mod . ) fm

Physics↗
DOE OSTI2023

The Cross-sectional and Longitudinal Association Between Thyroid Function and Depression: A Population-Based Study

Abstract Context An association of thyroid function with mood disorders has been widely suggested, but very few studies have examined this association longitudinally. Objective We assessed the cross-sectional and longitudinal association between thyroid function and depression in a population-based cohort. Methods A total of 9471 individuals were included in cross-sectional analyses, of whom 8366 had longitudinal data. At baseline, we assessed thyroid function using serum samples (thyrotropin [TSH], free thyroxine (FT4), and thyroid peroxidase antibodies) and depressive symptoms using the Centre for Epidemiologic Studies Depression (CES-D) scale. Incident depressive events (n = 1366) were continuously followed up with the CES-D and clinical interviews. We analyzed the cross-sectional association of thyroid function and thyroid disease with depressive symptoms using linear and logistic regression, and the longitudinal association with Cox proportional hazard models for depressive events. Results Lower TSH levels and lower and higher FT4 levels were cross-sectionally associated with more depressive symptoms with a B value of −0.07 per 1 unit increase of natural log-transformed TSH (95% CI −0.11; −0.04). Furthermore, hypothyroidism was cross-sectionally associated with less depressive symptoms and hyperthyroidism with more depressive symptoms. Longitudinally, there was a U-shaped association between FT4 and incident depressive events but only in euthyroid participants. Conclusion We show a cross-sectional association between thyroid (dys)function with depressive symptoms, and a U-shaped association between FT4 and incident depressive events in euthyroid individuals. Our findings suggest an association of thyroid function with the risk of developing depression, albeit small. Reverse causation and additional underlying factors may also contribute to the association.

Roa Dueñas, Oscar Hernando (ORCID:0000000207522261↗
DOE OSTI2024

Inferring the Focal Depths of Small Earthquakes in Southern California Using Physics-Based Waveform Features

Determining the depths of small crustal earthquakes is challenging in many regions of the world, because most seismic networks are too sparse to resolve trade-offs between depth and origin time with conventional arrival-time methods. Precise and accurate depth estimation is important, because it can help seismologists discriminate between earthquakes and explosions, which is relevant to monitoring nuclear test ban treaties and producing earthquake catalogs that are uncontaminated by mining blasts. Here, we examine the depth sensitivity of several physics-based waveform features for ~8000 earthquakes in southern California that have well-resolved depths from arrival-time inversion. We focus on small earthquakes (2 < M L < 4) recorded at local distances (<150 km), for which depth estimation is especially challenging. We find that differential magnitudes (M w /M L –M c ) are positively correlated with focal depth, implying that coda wave excitation decreases with focal depth. We analyze a simple proxy for relative frequency content, Φ≡log 10 (M 0 )+3log 10 (f c ), and find that source spectra are preferentially enriched in high frequencies, or “blue-shifted,” as focal depth increases. Here, we also find that two spectral amplitude ratios Rg 0.5–2 Hz/Sg 0.5–8 Hz and Pg/Sg at 3–8 Hz decrease as focal depth increases. Using multilinear regression with these features as predictor variables, we develop models that can explain 11%–59% of the variance in depths within 10 subregions and 25% of the depth variance across southern California as a whole. We suggest that incorporating these features into a machine learning workflow could help resolve focal depths in regions that are poorly instrumented and lack large databases of well-located events. Some of the waveform features we evaluate in this study have previously been used as source discriminants, and our results imply that their effectiveness in discrimination is partially because explosions generally occur at shallower depths than earthquakes.

58 GEOSCIENCES↗
DOE OSTI2026

Interpretable and flexible non-intrusive reduced-order models using reproducing kernel Hilbert spaces

This paper develops an interpretable, non-intrusive reduced-order modeling technique using regularized kernel interpolation. Existing non-intrusive approaches approximate the dynamics of a reduced-order model (ROM) by solving a data-driven least-squares regression problem for low-dimensional matrix operators. Our approach instead leverages regularized kernel interpolation, which yields an optimal approximation of the ROM dynamics from a user-defined reproducing kernel Hilbert space. We show that our kernel-based approach can produce interpretable ROMs whose structure mirrors full-order model structure by embedding judiciously chosen feature maps into the kernel. The approach is flexible and allows a combination of informed structure through feature maps and closure terms via more general nonlinear terms in the kernel. We also derive a computable a posteriori error bound that combines standard error estimates for intrusive projection-based ROMs and kernel interpolants. In conclusion, the approach is demonstrated in several numerical experiments that include comparisons to operator inference using both proper orthogonal decomposition and quadratic manifold dimension reduction.

Data-driven model reduction↗
DOE OSTI2026

Calibration and Rapid-Adoption Forecasting Techniques

CRAFT (Calibration and Rapid-Adoption Forecasting Techniques) CRAFT is a Python-based project for processing, analyzing, and modeling atmospheric or environmental data. It uses machine learning techniques, specifically Random Forest Regression, to create emulators for various environmental variables such as gross primary production and soil water content. It then uses these emulators to robustly test the parameter space of mechanistic models to provide posterior estimations of the free parameters.

Robins, Zachary↗
DOE OSTI2024

Enhancing Solar Power Forecasting with Regularized Constrained Quantile Regression Averaging and Bootstrapping Techniques

Probabilistic solar power forecasting (SPF) plays an essential role in optimizing power-grid operations by quantifying the forecast uncertainty. To improve the accuracy and robustness of probabilistic SPF, this paper introduces the regularized constrained quantile regression averaging (rCQRA) method to combine outputs from multiple PSPF models. In addition, a bootstrapping method was used to quantify model uncertainty, providing insights into the reliability and significance of each ensemble component. To evaluate its efficacy, the proposed rCQRA method is used to integrate four PSPF methods. The resulting SPF models are trained and validated using a real-world six-year dataset from a rooftop solar plant in the USA. The performance of the proposed rCQRA method is evaluated and compared with two benchmark methods under three categories of weather conditions. It is shown that the rCQRA method has superior performance in its forecast reliability, sharpness, and accuracy.

Ensemble learning, probabilistic solar power forec↗
DOE OSTI2024

Online Learning of Effective Turbine Wind Speed in Wind Farms

To develop better wind farm controllers that can meet more complex objectives, methods of modeling the wind turbine wakes at low computational expense are needed. Gaussian process (GP) regression offers a computationally inexpensive framework for learning complex functions from noisy measurements with very few datapoints. In this work, an online learning approach is presented to learn the rotor-averaged wind velocity at downstream wind turbines with GPs, using the available datastream of wind field measurements and wind turbine control set-points. This framework can readily be integrated into model-based controls methods because the model a) is updated online at low computational expense, b) assumes a mathematically favorable Gaussian form, and c) explicitly quantifies the stochastic nature of the wake field so that the trade-off between exploration and exploitation, and the uncertainty in the prediction, can be utilized. We show that a GP-learned model can match true values with errors within 0.5% on average, with as few as 5 training data points.

Gaussian process↗
DOE OSTI2022

Qualitative trend analysis based on a mixed-integer representation

Shape constrained spline fitting is a useful method to impose prior knowledge onto flexible semi-parametric models during parameter estimation. Most typically, the function shape is imposed through order restrictions on the regression coefficients. The intended shape is considered known or selected based on heuristic rules. In this study, we present a method to estimate the optimal set of order restrictions to segment a univariate data series into episodes with distinct shapes. This is also known as the qualitative trend analysis (QTA) problem. The obtained solution uses a trade-off between lack-of-fit and model complexity. Further, our practical implementation takes inspiration from the generalized order restricted information criterion (GORIC) for inequality-constrained model selection. From this, one learns (a) that QTA can be formulated as a mixed-integer quadratic program (MIQP) and (b) that the newly proposed mixed order restricted information criterion (MORIC) enables optimal segmentation. This is illustrated through didactic case studies.

42 ENGINEERING↗
DOE OSTI2024

Harmonizing tau positron emission tomography in Alzheimer's disease: The CenTauR scale and the joint propagation model

Abstract INTRODUCTION Tau‐positron emission tomography (PET) outcome data of patients with Alzheimer's disease (AD) cannot currently be meaningfully compared or combined when different tracers are used due to differences in tracer properties, instrumentation, and methods of analysis. METHODS Using head‐to‐head data from five cohorts with tau PET radiotracers designed to target tau deposition in AD, we tested a joint propagation model (JPM) to harmonize quantification (units termed “CenTauR” [CTR]). JPM is a statistical model that simultaneously models the relationships between head‐to‐head and anchor point data. JPM was compared to a linear regression approach analogous to the one used in the amyloid PET Centiloid scale. RESULTS A strong linear relationship was observed between CTR values across brain regions. Using the JPM approach, CTR estimates were similar to, but more accurate than, those derived using the linear regression approach. DISCUSSION Preliminary findings using the JPM support the development and adoption of a universal scale for tau‐PET quantification. Highlights Tested a novel joint propagation model (JPM) to harmonize quantification of tau PET. Units of common scale are termed “CenTauRs”. Tested a Centiloid‐like linear regression approach. Using five cohorts with head‐to‐head tau PET, JPM outperformed linearregressionbased approach. Strong linear relationship was observed between CenTauRs values across brain regions.

Neurosciences & Neurology↗