Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Stability Analysis of Substituted Cobaltocenium [Bis(cyclopentadienyl)cobalt(III)] Employing Chemistry-Informed Neural Networks

Cobaltocenium derivatives are promising components of the anion exchange membranes due to their excellent thermal and alkaline stability under the operating conditions of a fuel cell. Here we present an efficient modeling approach of assessing the chemical stability of substituted cobaltocenium CoCp 2 + based on the computed electronic structure enhanced by machine learning techniques. Within the aqueous environment, the positive charge of the metal cation is balanced by the hydroxide anion through formation of the CoCp 2 + OH¯ complexes, whose dissociation is studied within the implicit solvent employing density functional theory. The data set of about 118 species based on 42 substituent groups characterized by a range of electron- donating (ED) and electron-withdrawing (EW) properties is constructed and analyzed. Given 12 carefully chosen chemistry-informed descriptors of the complexes and relevant fragments, the stability of the complexes is found to strongly correlate with the energies of the highest occupied and lowest unoccupied molecular orbitals, modulated by a switching function of the Hirshfeld charge. The latter is used as a measure of the electron withdrawing-donating character of the substituents. Based on this observation from the conventional regression analysis, two fully connected, feed-forward neural network (FNN) models with different unit structures, called the chemistry-informed (CINN) and the quadratic (QNN) neural networks, are developed. Both models predict the bond dissociation energies of the cobaltocenium complexes with mean relative errors less than 5.40% and average absolute errors less than 0.94 kcal/mol. The results show the potential of QNN to efficiently capture more complex relationships. Here, the concept of incorporating the domain (chemical) knowledge/insight into the neural network structure paves the way to applications of machine learning techniques with small data sets, ultimately leading to better predictive models compared to the conventional regression analysis.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Accurate Machine Learning for Predicting the Viscosities of Deep Eutectic Solvents

Deep eutectic solvents (DESs) are emerging as environmentally friendly designer solvents for mass transport and heat transfer processes in industrial applications; however, the lack of accurate tools to predict and thus control their viscosities under both a range of environmental factors and formulations hinders their general application. While DESs may serve as designer solvents, with nearly unlimited combinations, this unfortunately makes it experimentally infeasible to comprehensively measure the viscosities of all DESs of potential industrial interest. To assist in the design of DESs, we have developed several new machine learning (ML) models that accurately and rapidly predict the viscosities of a diverse group of DESs at different temperatures and molar ratios using, to date, one of the most comprehensive data sets containing the properties of over 670 DESs over a wide range of temperatures (278.15–385.25 K). Three ML models, including support vector regression (SVR), feed forward neural networks (FFNNs), and categorical boosting (CatBoost), were developed to predict DES viscosity as a function of temperature and molar ratio and contrasted with multilinear and two-factor polynomial regression baselines. Further, quantum chemistry-based, COSMO-RS-derived sigma profile (σ-profile) features were used as inputs for the ML models. The CatBoost model is excellent at externally predicting DES viscosity, as indicated by high R 2 (0.99) and low root-mean-square-error (RMSE) and average absolute relative deviations (AARD) (5.22%) values for the testing data sets, and 98% of the data points lie within the 15% of AARD deviations. Furthermore, SHapley additive explanation (SHAP) analysis was employed to interpret the ML results and rationalize the viscosity predictions. The result is an ML approach that accurately predicts viscosity and will aid in accelerating the design of appropriate DESs for industrial applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Chemical Robotics Enabled Exploration of Stability in Multicomponent Lead Halide Perovskites via Machine Learning

Metal halide perovskites have attracted immense interest as a promising material for a variety of optoelectronic and sensing applications. However, issues regarding long-term stability have emerged as the key bottleneck for commercialization. Here, we develop an automated experimental workflow based on combinatorial synthesis and rapid throughput characterization to explore long-term stability of these materials in ambient conditions. We apply it to four model perovskite systems: MA x FA y Cs 1–x–y PbBr 3 , MA x FA y Cs 1–x–y PbI 3 , Cs x FA y MA 1–x–y Pb(Br x+y I 1–x–y ) 3 , and Cs x MA y FA 1–x–y Pb(I x+y Br 1–x–y ) 3 . Non-negative matrix factorization and Gaussian process regression are used to interpolate the photoluminescent behavior of the phase diagram. This interpolative regression analysis helps to distinguish mixtures that form solid solutions from those that segregate into multiple materials, pointing out the most stable regions of the phase diagram. Here, we find stability dependence on composition to be nonuniform within the composition space, suggesting the presence of potential preferential compositional regions. This proposed workflow is universal and can be applied to other solution-processable materials.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Array-Based Machine Learning for Functional Group Detection in Electron Ionization Mass Spectrometry

Mass spectrometry is a ubiquitous technique capable of complex chemical analysis. The fragmentation patterns that appear in mass spectrometry are an excellent target for artificial intelligence methods to automate and expedite the analysis of data to identify targets such as functional groups. To develop this approach, we trained models on electron ionization (a reproducible hard fragmentation technique) mass spectra so that not only the final model accuracies but also the reasoning behind model assignments could be evaluated. The convolutional neural network (CNN) models were trained on 2D images of the spectra using transfer learning of Inception V3, and the logistic regression models were trained using array-based data and Scikit Learn implementation in Python. Our training dataset consisted of 21,166 mass spectra from the United States’ National Institute of Standards and Technology (NIST) Webbook. The data was used to train models to identify functional groups, both specific (e.g., amines, esters) and generalized classifications (aromatics, oxygen-containing functional groups, and nitrogen-containing functional groups). We found that the highest final accuracies on identifying new data were observed using logistic regression rather than transfer learning on CNN models. It was also determined that the mass range most beneficial for functional group analysis is 0–100 m/z. We also found success in correctly identifying functional groups of example molecules selected from both the NIST database and experimental data. Beyond functional group analysis, we also have developed a methodology to identify impactful fragments for the accurate detection of the models’ targets. The results demonstrate a potential pathway for analyzing and screening substantial amounts of mass spectral data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Insights into Tetravalent Np Speciation in HNO 3 through Spectroelectrochemistry and Multivariate Analysis

In situ optical spectroscopy, spectropotentiometry, and multivariate analysis were applied to the Np(IV) nitrate system to better understand speciation and quantify HNO 3 concentration. Thin-layer spectropotentiometry, or spectroelectrochemistry, was leveraged to isolate and stabilize Np(IV) without compromising the solution conditions and generate representative Vis-NIR absorption spectra from 0.5 to 10 M HNO 3 and benchmark the corresponding Np(IV) molar absorptivity coefficients. Spectra were described with principal component analysis (PCA) to identify the purest Np(IV) absorbance spectra among other oxidation states [e.g., Np(V/VI)] at each acid concentration and then to identify the primary sources of variance within each Np(IV) spectrum with respect to Np(IV) nitrate complexes. Then, partial least-squares regression (PLSR) and support vector regression (SVR) models were built to predict HNO 3 concentration from the Np(IV) spectral data. The nonlinear SVR model outperformed the linear PLSR model for the HNO 3 concentration predictions. Finally, the inclusion of spectra collected in edge and center point HNO 3 concentrations in the calibration set was determined to be crucial for producing models with strong predictive capabilities. The multivariate approach used in this study makes it possible to quantify HNO 3 concentration solely based on Np(IV) absorption spectra, which is essential to quantifying processing streams in various online monitoring applications.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2022

Data-Centric Development of Lignin Structure–Solubility Relationships in Deep Eutectic Solvents Using Molecular Simulations

Lignin is a natural source of aromatic chemicals with significant potential as an abundant, renewable feedstock for value-added products. Deep eutectic solvents (DES)–solvents composed of a hydrogen bond donor (HBD) and acceptor (HBA) in varying ratios–have emerged as a highly tunable class of solvents for lignin solubilization. However, the variety of possible DES compositions and limited molecular-scale understanding of lignin solubility makes solvent selection a challenge without laborious trial-and-error experimentation. To address these challenges, we use classical molecular dynamics (MD) simulations to study the interactions of lignin model compounds with various DES–water systems. Quantitative parameters (descriptors) were calculated by postprocessing the MD results and used to train a regression model that predicts experimentally determined solubilities of lignin model compounds. This approach revealed that the most important descriptors of solubility are the system temperature, solute hydrophilicity, and metrics quantifying hydrogen bonding. Maximizing the interactions between solute–HBD (hydrophobic group), water–HBD (hydrophilic group), and water–HBA molecules led to the highest model compound solubility. Our results support a hydrotropic mechanism in which extensive DES–water hydrogen bonding and favorable HBD interactions with the solute promote high solubility. We applied the regression model derived using model compounds to predict the solubility of representative lignin oligomers. The model predicted lignin oligomers’ solubilities in good agreement with experiments, indicating that the simulations of model compounds can be extended to predict the solubility of larger lignin compounds across a range of solvent compositions and temperatures. Furthermore, these findings provide new molecular-scale insight into lignin solubilization mechanisms and a new method for computationally screening potential solvent systems for lignin valorization.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

High-Throughput Screening and Accurate Prediction of Ionic Liquid Viscosities Using Interpretable Machine Learning

Ionic liquids (ILs) are a novel group of green solvents with great promise for various industrial applications, including carbon capture and lignocellulosic biomass deconstruction. However, the use of ILs at the industrial scale remains challenging due to their high viscosities at ambient temperatures. To develop ILs with lower viscosities, a systematic study of their quantitative structure–property relationship (QSPR) is desirable. Here, we developed four machine learning (ML) models to predict viscosity at various temperature and pressure ranges, trained over a wide range of ILs consisting of various cationic and anionic families. ML methods including two-factor polynomial regression (two-factor PR), support vector regression (SVR), feed-forward neural networks (FFNN), and categorical boosting (CATBoost) were developed based on features that have proven useful in previous ML studies: COSMO-RS (conductor-like screening model for real solvents)-derived surface screening charge densities (sigma profiles). FFNN and CATBoost were the most accurate in predicting IL viscosities with lower average absolute relative deviation and higher R2 values on the test set. Tanimoto similarity scores were calculated to characterize the chemical space and structural similarity of the investigated ions. Furthermore, SHapley Additive exPlanation (SHAP) analysis was employed to interpret the ML results. Temperature, the polar area of ILs, and the nonpolar regions of ions are key features that influence the viscosity predictions. Importantly, the IL viscosity prediction here is the most accurate reported to date.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

Earthquake catalog-based machine learning identification of laboratory fault states and the effects of magnitude of completeness

Here, machine learning regression can predict macroscopic fault properties such as shear stress, friction, and time to failure using continuous records of fault zone acoustic emissions. Here we show that a similar approach is successful using event catalogs derived from the continuous data. Our methods are applicable to catalogs of arbitrary scale and magnitude of completeness. We investigate how machine learning regression from an event catalog of laboratory earthquakes performs as a function of the catalog magnitude of completeness. We find that strong model performance requires a sufficiently low magnitude of completeness, and below this magnitude of completeness, model performance saturates.

58 GEOSCIENCES↗
DOE OSTI2018

Spring Onset Predictability in the North American Multimodel Ensemble

Abstract The predictability of spring onset is assessed using an index of its interannual variability (the “extended spring index” or SI‐x) and output from the North American Multimodel Ensemble reforecast experiment. The input data to compute SI‐x were treated with a daily joint bias correction approach, and the SI‐x outputs computed from the North American Multimodel Ensemble were postprocessed using an ensemble model output statistic approach—nonhomogeneous Gaussian regression. This ensemble model output statistic approach was used to quantify the effects of training period length and ensemble size on forecast skill. The lead time for predicting the timing of spring onset is found to be from 10 to 60 days, with the higher end of this range located along a narrow band between 35°N to 45°N in the eastern United States. Using continuous rank probability scores and skill score (SS) thresholds, this study demonstrates that ranges of positive predictability of SI‐x fall into two categories: 10–40 and 40–60 days. Using higher skill thresholds (SS equal to 0.1 and 0.2), predictability is confined to a lower range with values around 10–30 days. The postprocessing work using joint bias correction improves the predictive skill for SI‐x relative to the untreated input data set. Using nonhomogeneous Gaussian regression, a positive change in the SS is noted in regions where the skill with joint bias correction shows evidence of improvement. These findings suggest that the start of spring might be predictable on intraseasonal time horizons, which in turn could be useful for farmers, growers, and stakeholders making decisions on these time scales.

Carrillo, Carlos M.↗
DOE OSTI2020

A Satellite-Derived Upper-Ocean Stratification Data Set for the Tropical North Atlantic With Potential Applications for Hurricane Intensity Prediction

Upper-ocean stratification strongly impacts vertical mixing and the heat flux between the ocean and atmosphere, especially under extreme conditions of tropical cyclones (TCs). Knowledge of prestorm stratification is important for accurate TC intensity prediction. In situ observations of the tropical ocean have significantly increased in the past decade. However, they are still too sparse to resolve ocean stratification variability in near-real time and on small spatial scales. Here, in this study, based on long-term observations and an ocean reanalysis data set from 2004–2017, we investigate the possibility of retrieving upper-ocean stratification from sea surface temperature (SST), sea surface salinity (SSS), and sea surface height (SSH) using a simple regression method. It is found that more than 90% of the mean seasonal cycle and about 30% to 80% of temperature and salinity stratification anomalies can be reconstructed using surface data from either observations or an ocean reanalysis. Simple regression can be used with satellite observations to create a high-resolution, near-real-time-gridded ocean stratification data set that successfully reproduces both the large and mesoscale variability of ocean stratification. When used in a simple expression for TC-induced SST cooling, the satellite-derived stratification shows improvements over an ocean analysis in terms of variance explained of SST cooling, offering promise as a near-real-time indicator of the ocean's impact on TC intensification.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

The Oceanic Barrier Layer in the Eastern Indian Ocean as a Predictor for Rainfall Over Indonesia and Australia

Barrier layers in the tropics trap heat in a shallow and stable near-surface layer and limit entrainment of cooler water from below. Both processes act to increase sea surface temperature and enhance atmospheric convection. The high resolution fully coupled pre-industrial Energy Exascale Earth System Model version 0 (E3SMv0) is used to investigate the relationship between barrier layers in the eastern Indian Ocean during the wet season with local atmospheric convection and remote rainfall. A partial least squares regression reveals a significant relationship between Australasian rainfall and the barrier layer thickness (BLT) west of Sumatra, occurring one month earlier. Furthermore, the largest positive regression coefficients are over northern Australia. The region west of Sumatra is strategically located where the East-Asian monsoon moisture flows toward northern Australia. Thickening of the west Sumatra BLT intensifies evaporation and local convection and amplifies the moisture transported to Australia acting to increase the terrestrial rainfall.

58 GEOSCIENCES↗
DOE OSTI2021

Deep Learning Estimation of Daily Ground–Level NO 2 Concentrations from Remote Sensing Data

The limited number of nitrogen dioxide (NO 2 ) surface measurements calls for the development of highly accurate approaches to estimating surface NO 2 concentrations. In this study, we leverage a new satellite instrument, the TROPOspheric Monitoring Instrument (TROPOMI), along with other predictor variables, to estimate daily surface NO 2 concentrations over Texas in 2019. We use the deep convolutional neural network (Deep-CNN), an advanced deep learning algorithm, to obtain estimates and achieve a correlation coefficient (R) of 0.91, an index of agreement (IOA) of 0.95, and a mean absolute bias (MAB) of 1.75 ppb in surface NO 2 estimation. Additionally, we leverage a novel approach, SHapley Additive exPlanations (SHAP), to describe how Deep-CNN understands each predictor variable. The SHAP results show that the Deep-CNN model has an advanced understanding of the dataset, revealing that TROPOMI closely captures levels of NO 2 . In addition, we show the superiority of our Deep-CNN model at estimating surface NO 2 over other well-known machine learning and regression models in the field, including the support vector machines (SVM), random forest (RF), and multiple linear regression (MLR). Although SVM and RF show strong capabilities at estimating surface NO 2 concentrations, their accuracy is inferior to that of the Deep-CNN model, ranking second and third in model accuracy in this study. The MLR, however, shows a poor ability at NO 2 estimation and ranks last among all models. Furthermore, testing the impact of sample size on model performance, we also show that, compared to other models, Deep-CNN needs more samples to trigger its strength at surface NO 2 estimation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Attribution of Snowpack Errors to Simulated Temperature and Precipitation in E3SMv1 Over the Contiguous United States

Abstract Snow water equivalent (SWE), temperature, and precipitation biases and trends are evaluated in the atmosphere‐land simulations of the Energy Exascale Earth System Model version 1 (E3SMv1) in comparison to the Community Earth System Model version 2 (CESM2) and two other models using the ground measurement‐based University of Arizona (UA) snow product. SWE, temperature, and precipitation biases are highest in magnitude in the Western contiguous United States (CONUS). SWE errors are attributed to temperature and precipitation through multiple linear regressions of normalized errors, the coefficients of which represent the sensitivities to temperature and precipitation errors. SWE errors are more sensitive to temperature errors throughout the CONUS. Model SWE and temperature trends are generally opposite from UA product trends in the Western CONUS. SWE trend errors are also attributed to temperature and precipitation trend errors using multiple linear regressions of normalized trend errors. SWE trend errors are more sensitive to those of precipitation at higher elevations (>1,500 m) in the Western CONUS in these simulations. Thus, the sensitivity to temperature and precipitation differ for SWE errors and its trend errors. Furthermore, the SWE trend errors are more sensitive to temperature and precipitation in the atmosphere‐ocean coupled simulations in which the atmosphere‐land is coupled to an active ocean model. These results suggest that both errors in simulated temperature and precipitation contribute to SWE errors.

Meteorology & Atmospheric Sciences↗
DOE OSTI2018

Meconium microbiome associates with the development of neonatal jaundice

Objective: Neonatal jaundice is a common disease that affects up to 60% of newborns. Gut microbiota mediated the excretion of bilirubin from the human body. However, the relationship between early gut microbiome and development of neonatal jaundice is not fully understood. Here we sought to characterize meconium microbiome of newborns and to clarify its association with risk of neonatal jaundice. Methods: We conducted a nested case–control study with 301 newborns providing meconium samples from 2014 to 2015. The main outcome was the development of neonatal jaundice at 42 day follow-up. 16S rRNA gene sequencing was performed to profile the meconium microbiome. LEfSe was employed to identify different features between control and case groups. Logistic regression was used to estimate the risk effect of early gut microbiome on neonatal jaundice. Results: Logistic regression models suggested that higher α-diversity was significantly associated with lower risk of jaundice in cesarean infants (OR 0.72, 95% CI 0.52–0.98), but not in infants born naturally. Higher relative abundance of Bifidobacterium pseudolongum in newborn meconium was significantly associated with lower risk of jaundice both in cesarean-born infants and in the total subjects (OR 0.24, 95% CI 0.07–0.68; OR 0.55, 95% CI 0.31–0.95, respectively). Spearman’s correlations showed that relative abundance of B. pseudolongum was significantly correlated with α-diversity (P < 0.01). Conclusion: Preventive and treatment methods implying early gut microbiome intervention could be promising for the management of neonatal jaundice.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2018

Active learning for accelerated design of layered materials

Hetero-structures made from vertically stacked monolayers of transition metal dichalcogenides hold great potential for optoelectronic and thermoelectric devices. Discovery of the optimal layered material for specific applications necessitates the estimation of key material properties, such as electronic band structure and thermal transport coefficients. However, screening of material properties via brute force ab initio calculations of the entire material structure space exceeds the limits of current computing resources. Moreover, the functional dependence of material properties on the structures is often complicated, making simplistic statistical procedures for prediction difficult to employ without large amounts of data collection. Here, we present a Gaussian process regression model, which predicts material properties of an input hetero-structure, as well as an active learning model based on Bayesian optimization, which can efficiently discover the optimal hetero-structure using a minimal number of ab initio calculations. The electronic band gap, conduction/valence band dispersions, and thermoelectric performance are used as representative material properties for prediction and optimization. The Materials Project platform is used for electronic structure computation, while the BoltzTraP code is used to compute thermoelectric properties. Bayesian optimization is shown to significantly reduce the computational cost of discovering the optimal structure when compared with finding an optimal structure by building a regression model to predict material properties. The models can be used for predictions with respect to any material property and our software, including data preparation code based on the Python Materials Genomics (PyMatGen) library as well as python-based machine learning code, is available open source.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Machine-learned impurity level prediction for semiconductors: the example of Cd-based chalcogenides

The ability to predict the likelihood of impurity incorporation and their electronic energy levels in semiconductors is crucial for controlling its conductivity, and thus the semiconductor's performance in solar cells, photodiodes, and optoelectronics. The difficulty and expense of experimental and computational determination of impurity levels makes a data-driven machine learning approach appropriate. In this work, we show that a density functional theory-generated dataset of impurities in Cd-based chalcogenides CdTe, CdSe, and CdS can lead to accurate and generalizable predictive models of defect properties. By converting any semiconductor + impurity system into a set of numerical descriptors, regression models are developed for the impurity formation enthalpy and charge transition levels. These regression models can subsequently predict impurity properties in mixed anion CdX compounds (where X is a combination of Te, Se and S) fairly accurately, proving that although trained only on the end points, they are applicable to intermediate compositions. We make machine-learned predictions of the Fermi-level-dependent formation energies of hundreds of possible impurities in 5 chalcogenide compounds, and we suggest a list of impurities which can shift the equilibrium Fermi level in the semiconductor as determined by the dominant intrinsic defects. Machine learning predictions for the dominating impurities compare well with DFT predictions, revealing the power of machine-learned models in the quick screening of impurities likely to affect the optoelectronic behavior of semiconductors.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Cross-scale covariance for material property prediction

A simulation can stand its ground against an experiment only if its prediction uncertainty is known. The unknown accuracy of interatomic potentials (IPs) is a major source of prediction uncertainty, severely limiting the use of large-scale classical atomistic simulations in a wide range of scientific and engineering applications. Here we explore covariance between predictions of metal plasticity, from 178 large-scale (~10 8 atoms) molecular dynamics (MD) simulations, and a variety of indicator properties computed at small-scales (≤10 2 atoms). All simulations use the same 178 IPs. In a manner similar to statistical studies in public health, we analyze correlations of strength with indicators, identify the best predictor properties, and build a cross-scale “strength-on-predictors” regression model. This model is then used to estimate regression error over the statistical pool of IPs. Small-scale predictors found to be highly covariant with strength are computed using expensive quantum-accurate calculations and used to predict flow strength, within the statistical error bounds established in our study.

36 MATERIALS SCIENCE↗