Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “feature”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Machine learning reveals factors that control ion mobility in anti-perovskite solid electrolytes

Solid-state batteries are projected to exhibit improved energy densities and safety compared to liquid-electrolyte-based systems. Consequently, the development of solid electrolytes that can conduct cations at rates comparable to that of liquid electrolytes is an active area of research. To facilitate this search it is desirable to understand the chemical and structural features that control ion transport through a crystalline lattice. Here, machine learning (ML) is used to identify features that influence ion mobility in solids, quantify the relative importance of those features, and demonstrate how the variation of individual features alters ion mobility. Adopting the anti-perovskite lattice as a model system, ML algorithms were trained to predict migration barriers from a data set containing hundreds of barriers calculated using density functional theory. In this study, more than 10 6 feature sets of non-redundant descriptors were evaluated for their ability to predict migration barriers. The present analysis correctly reiterates the importance of several features that are known to influence mobility – for example, anion polarizability – but also identifies others whose importance is not widely recognized. Lattice properties such as hopping distance and channel width exhibit the greatest influence on cation mobility. Individual conditional expectation analyses performed on these features shows that barriers decrease as hopping distance decreases and as channel width increases. The defect formation energy – which is commonly associated with the concentration of defects, but not with their mobility – is identified as an important feature for interstitial migration. In sum, this analysis aids in the design of optimal solid electrolytes by simplifying the multi-dimensional design space to a sub-set of properties that are the most important.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Electric field reversals resulting from voltage waveform tailoring in Ar/O 2 capacitively coupled plasmas sustained in asymmetric systems

The etching of nanometer scale high-aspect-ratio (HAR) features into dielectric materials in low pressure radio frequency excited plasmas is often accompanied by charge accumulation inside the features which can slow etching rates and produce distortions such as twisting. The intra feature charging is at least partially produced by differences in electron and ion energy and angular distributions (EADs). Positive ions, accelerated to high energies having narrow angular spreads by the sheath electric field, can penetrate deeply into HAR features. Electrons typically arrive at the wafer with nearly thermal and isotropic distributions and do not penetrate deeply into HAR features. These disparities lead to differential charging of the inside of the feature, which can lead to reductions in etch rate and feature distortion due to ion deflection. With in-creasing aspect ratio of features, charging challenges are expected to continue for the foreseeable future. In this work, the use of tailored voltage waveforms in geometrically asymmetric capacitively coupled plasmas sustained in Ar/O 2 at 40 mTorr was computationally investigated with the goal of shaping the EAD of electrons incident onto the substrate to address differential charging. The tailored waveform consisted of a sinusoidal wave and its higher harmonics with a fundamental frequency of 1 MHz. Further, we found that electric field reversals in the sheath and presheath can occur during the anodic portion of the cycle. The electric field reversal increases the energy and decreases the angular spread of electrons incident onto the substrate. The magnitude of the electric field reversal can be controlled by the phase angle of the even harmonics and the gas composition. Due to its electronegative nature, increasing mole fractions of O 2 impedes electron transport to the surface which further increases the electric field reversal.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

A neural network for determination of latent dimensionality in Nonnegative Matrix Factorization

Non-negative Matrix Factorization (NMF) has proven to be a powerful unsupervised learning method for uncovering hidden features in complex and noisy datasets with applications in data mining, text recognition, dimension reduction, face recognition, anomaly detection, blind source separation, and many other fields. An important input for NMF is the latent dimensionality of the data, that is, the number of hidden features, K, present in the explored dataset. Unfortunately, and this quantity is rarely known a priori. The existing methods for determining latent dimensionality, such as Automatic Relevance Determination (ARD), are mostly heuristic and utilize different characteristics to estimate the number of hidden features. However, all of them require human presence to make a final determination of K. Here we utilize a supervised machine learning approach in combination with a recent method for model determination, called NMFk, to determine the number of hidden features automatically. NMFk performs a set of NMF simulations on an ensemble of matrices, obtained by bootstrapping the initial dataset, and estimates which K produces stable groups of latent features that reconstruct the initial dataset well. We then train a Multi-Layter Perceptron (MLP) classifier network to determine the correct number of latent features utilizing the statistics and characteristics of the NMF solution, obtained from NMFk. In order to train the MLP classifier, a training set of 58,660 matrices with predetermined latent features were factorized with NMFk. The MLP classifier in conjunction with NMFk maintains a greater than 95% success rate when applied to a held out test set. Additionally, when applied to two well-known benchmark datasets, the swimmer and MIT face data, NMFk/MLP correctly recovers the established number of hidden features. Finally, we compare the accuracy of our method to the ARD, AIC and Stability-based methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Exploring the synergy of kinematics and dynamics for collider physics

In collider experiments, an event is characterized by two distinct yet mutually complementary features: the “global features” and the “local features.” Kinematic information such as the event topology of a hard process, masses, and spins of particles comprises global features spanning the entire phase space. This global feature can be inferred from reconstructed objects. In contrast, representations of particles in gauge groups, such as quantum chromodynamics (QCD), offer localized features revealing the dynamics of an underlying theory. These local features, particularly observed in the patterns of radiation as raw data in various detector components, complement the global kinematic features. We propose a simple but effective neural network architecture that seamlessly integrates information from both kinematics and QCD to enhance the signal sensitivity at colliders. Published by the American Physical Society 2024

Ban, Kayoung (ORCID:000000019691877X)↗
DOE OSTI2021

Improving Data Center Energy Efficiency Through End-to-End Cooling Modeling and Optimization. Final Report

This report summarizes the development and demonstration of the three features developed for the DOE project “Improving Data Center Energy Efficiency through End-to-End Cooling Modeling and Optimization” (Award No. DE-EE0007688). The development of the three software features, Feature 1: Optimization of Cooling System Operation, Feature 2: Optimization of Airflow Management System, and Feature 3: Simultaneous Optimization of Airflow Management and Cooling Systems, are described first. Feature 1 is implemented in Phase 1 of the project and demonstrates 15% energy savings from cooling system optimization by applying the proposed retrofit solutions. Feature 2 is implemented in Phase 2 and the assessments show cooling energy-saving potential between 19.3% and 54.0%, depending on the energy-saving measures employed. In addition, investigating the energy saving potential for a hypothetical simple data center shows about 6.8% energy savings by optimizing the server load placement. Feature 3 is implemented in Phase 3 and the results show energy savings of 53.4% and 74.6% for the two partner data centers, respectively, compared to the baselines defined in Phase 1. Lastly, the project outcomes including software releases and publications are discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Preprocessing for Unintended Conducted Emissions Classification with ResNet

Characterization of Unintended Conducted Emissions (UCE) from electronic devices is important when diagnosing electromagnetic interference, performing nonintrusive load monitoring (NILM) of power systems, and monitoring electronic device health, among other applications. Prior work has demonstrated that UCE analysis can serve as a diagnostic tool for energy efficiency investigations and detailed load analysis. While explaining the feature selection of deep networks with certainty is often not fully comprehensive, or in other applications, quite lacking, additional tools/methods for further corroboration and confirmation can help further the understanding of the researcher. This is true especially in the subject application of the study in this paper. Often the focus of such efforts is the selected features themselves, and there is not as much understanding gained about the noise in the collected data. If selected feature and noise characteristics are known, it can be used to further shape the design of the deep network or associated preprocessing. This is additionally difficult when the available data are limited, as in the case which the authors investigated in this study. Here, the authors present a novel work (which is a proposed complementary portion of the overall solution to the deep network classification explainability problem for this application) by applying a systematic progression of preprocessing and a deep neural network (ResNet architecture) to classify UCE data obtained via current transformers. By using a methodical application of preprocessing techniques prior to a deep classifier, hypotheses can be produced concerning what features the deep network deems important relative to what it perceives as noise. For instance, it is hypothesized in this particular study as a result of execution of the proposed method and periodic inspection of the classifier output that the UCE spectral features are relatively close to each other or to the interferers, as systematically reducing the beta parameter of the Kaiser window produced progressively better classification performance, but only to a point, as going below the Beta of eight produced decreased classifier performance, as well as the hypothesis that further spectral feature resolution was not as important to the classifier as rejection of the leakage from a spectrally distant interference. This can be very important in unpredictable low-FNR applications, where knowing the difference between features and noise is difficult. As a side-benefit, much was learned regarding the best preprocessing to use with the selected deep network for the UCE collected from these low power consumer devices obtained via current transformers. Baseline rectangular windowed FFT preprocessing provided a 62% classification increase versus using raw samples. After performing a more optimal preprocessing, more than 90% classification accuracy was achieved across 18 low-power consumer devices for scenarios in which the in-band features-to-noise ratio (FNR) was very poor.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Evidence for Impact of Galaxy Mergers on Stellar Kinematics of Early-type Galaxies

We provide observational evidence that galaxy mergers significantly affect stellar kinematics of early-type galaxies (ETGs) such as specific stellar angular momentum within the half-light radius (${\lambda }_{{R}_{e}}$) and kinematic misalignment (ψ mis ), using MaNGA integral field unit spectroscopic data that are in the Stripe 82 region of the Sloan Digital Sky Survey. In this study, tidal features around ETGs, which are detected in deep coadded images, are used as direct evidence for mergers that occurred recently. In the case of ETGs that do not have dust lanes, ${\lambda }_{{R}_{e}}$ is lower in ETGs with tidal features than in those without tidal features (median ${\lambda }_{{R}_{e}}$: 0.21 versus 0.39) in all stellar mass and Sérsic index ranges except the most massive bin, so that the fraction of ETGs with tidal features in slow rotators is more than twice as large as that in fast rotators (42% versus 18%). Moreover, ETGs with tidal features have larger ψ mis than those without tidal features (mean ψ mis : 28° versus 15°). By contrast, ETGs with dust lanes are fast rotators, and ETGs with both dust lanes and tidal features have the highest ${\lambda }_{{R}_{e}}$ (median ${\lambda }_{{R}_{e}}$: 0.59) among all ETG categories. In addition, ETGs with dust lanes have small ψ mis regardless of the existence of tidal features (Ψ mis <7$^{°}_{.}$5). Our results can be explained if mergers with different gas fractions generate merger remnants that have different kinematic properties.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Development of a Deep Learning Model for Predicting the Drag Coefficients of Spherical and Non-Spherical Particles,

There is yet to be a well-established drag model for non-spherical particles required in a particle-laden flow that could cover a wide range of sphericities. This talk will explore the development of a general drag model for non-spherical particles by applying deep learning using available experimental data available in the literature. The integration of several raw experimental measurements from different sources and research directions allows the training of robust Artificial Intelligence and Machine Learning (ML) models. Neural networks are an ML approach inspired by the inner biological workings of the brain. This work aims to develop a Deep Neural Network (DNN) that predicts drag coefficient values with the ability to adapt appropriately to unseen data. Given the limited number of data points available and the variance found within the data collected from various sources, challenges may arise when looking to train the model. Our study tests and implements various model regularization techniques and assesses different loss and activation functions for the proposed DNN. The proposed model considers a broader range of features other than sphericity and Reynold number. These features include density ratio, solid volume fraction, lengthwise and crosswise sphericity, and more. Furthermore, we present the features that play a significant role in predicting different drag coefficients through feature importance. Within the investigated parameter ranges in this study, the following conclusions can be achieved and summarized below: • An improved drag coefficient model can be developed by considering more features such as, aspect ratio, lengthwise sphericity, crosswise sphericity, and density ratio. • DNN model can predict better results compared to traditional methods using MAE metric. • The proposed model addresses data challenges such as limited data and extreme data points through expanded feature-set and regularization. • Three major features that mostly affect the drag coefficient were identified from a feature importance analysis.

Presa-Reyes, Maria↗
DOE OSTI2025

Utah FORGE: Well 16B(78)-32 Drill Core Fracture Analysis Images and Data

This dataset contains drilling core data from well 16B(78)-32, including PDF documents with flattened core images annotated by feature type and core interval, as well as spreadsheets detailing feature morphologies by depth, planar feature measurements, and planar feature orientations rotated to in situ conditions. Core was recovered from three intervals, one per stimulation stage, in the crystalline rocks affected by the stimulation of well 16A(78)-32. Seven core runs were conducted, yielding 135.8 feet of recovered core. Features in the core were categorized into planar fractures, semi-planar fractures, unbroken mineralized fractures, rough fractures, curviplanar fractures, concave-convex surfaces, and planar compositional features such as mylonite or dike-like structures. Planar features were measured while the core was positioned horizontally, with the core axis aligned to a downhole azimuth of 42 degrees. Planar core measurements from stimulations 2 and 3 that could be confidently correlated with FMI data were rotated to in situ orientations. This was done by rotating the planes along vertical and horizontal axes to match the azimuth and inclination data recorded in the directional survey of well 16B(78)-32, as well as applying an axial rotation to resemble the fracture orientations observed in the FMI log at corresponding depths. Coherent sets of planar fracture measurements were made by aligning the core within each 3-foot section of the dissected core barrel, and between adjacent 3-foot sections within a core run by matching rock fabrics, saw cuts and/or tool marks. Where coherent fracture measurements could not be made within a core run, data sets are denoted by a subscript (i.e. 2-Ta and 2-Tb both come from tangent core run number 2).

15 GEOTHERMAL ENERGY↗
DOE OSTI2020

Jefferson Laboratory C100 Superconducting Radio-Frequency Cavity Fault Data, 2020

The dataset was created to train machine learning models for the task of identifying the (1) cavity and (2) fault type from C100-type cryomodules at the Thomas Jefferson National Accelerator Facility (Jefferson Lab), thereby replacing the time-consuming efforts of a subject matter expert. Superconducting radio-frequency (SRF) cavity trips represent a significant source of accelerator downtime. Real-time – rather than post-mortem – identification of the offending cavity and classification of the fault type would give control room operators valuable feedback for corrective action planning. The anticipated benefit is increased beam-on-target time for users and provides performance metrics that can be used to improve future cavity designs. A series of 17 RF signals are recorded for each of the 8 cavities in a C100 cryomodule every time a cavity trips. These time-series signals are written to file using a specially designed data acquisition system. The dataset represents fault events recorded during Continuous Electron Beam Accelerator Facility (CEBAF) beam operations between January 18, 2019 and March 9, 2020. The following filtering steps were applied to collected data; (1) only 4 of the 17 signals per cavity are retained (GMES, GASK, CRFP, DETA2) (2) only events with data from each of the eight cavities in the cryomodule are kept, (3) only events that were sampled at 5 kHz were kept, (4) events from cryomodule 0L04 were neglected, (5) events occurring between February 4, 3PM and February 5, 12PM were neglected. As a result of preprocessing, the dataset is comprised of 2,375 unique events. The full dataset is comprised of three files: features.csv, cavity_labels.csv, fault_labels.csv. Each instance in faults.csv includes a timestamp (“date_time”), a label for the cryomodule which experienced the trip (“zone_label”), and 192 features (“feature_1”, “feature_2”... “feature_192”). The features correspond to 6 autoregressive features for each of 4 signals per cavity for each of the 8 cavities (6 × 4 signals/cavity × 8 cavities/cryomodule = 192). To deal with the large variation of signal amplitudes, time-series standardization via the z-score (standard score) function was applied prior to computing the features. For each instance, there is an associated label for the (1) cavity which faulted first (cavity_labels.csv) and (2) the type of fault that caused the trip (fault_labels.csv). The cavity identification can take values of [0, 1, 2, 3, 4, 5, 6, 7, 8] and the fault type can take values of [‘Microphonics’, ‘Quench_100ms’, ‘Controls_Fault’, ‘E_Quench’, ‘Quench_3ms’, ‘Single_Cav_Turn_Off’ , ‘Heat_Riser_Choke’, ‘Multi_Cav_Turn_Off’].

43 PARTICLE ACCELERATORS↗
DOE OSTI2022

Analytics-at-scale of Sensor Data for Digital Monitoring in Nuclear Plants (3 rd Annual Report)

Nuclear power plants collect and store large volumes of heterogeneous data from various components and systems. With recent advances in machine learning (ML) techniques, these data can be leveraged to develop diagnostic and short-term forecasting models to better predict future equipment condition. Maintenance operations can then be planned in advance whenever degraded performance is predicted, thus resulting in fewer unplanned outages and the optimization of maintenance activities. This enables lower maintenance costs and improves the overall economics of nuclear power. This report primarily focuses on developing a short-term forecasting process that leverages a feature selection process to distill large volumes of heterogeneous data and predict specific equipment parameters. A variety of feature selection methods, including Shapley Additive Explanations (SHAP) and variance inflation factor (VIF), were used to select the optimal features as inputs for three ML methods: long short-term memory (LSTM) networks, support vector regression (SVR), and random forest (RF). Each combination of model and input features was used to predict a pump bearing temperature both 1 and 24 hours in advance, based on actual plant system data. The optimal inputs for the LSTM and SVR were selected using the SHAP values, while the optimal input for the RF consisted solely of the response variable itself. Each model produced similar 1-hour-ahead predictions, with root mean square errors (RMSEs) of roughly 0.006. For the 24-hour-ahead predictions, differences could be seen between LSTM, SVR, and RF, as reflected by model performances of 0.036 ± 0.014, 0.0026 ± 0, and 0.063 ± 0.004 RMSE, respectively. As big data and continuous online monitoring become more widely available, the proposed feature selection process can be used for many applications beyond the prediction of process parameters within nuclear infrastructure. This report summarizes the Fiscal Year 2021 research progress encompassing the (1) data cleaning and feature selection necessary for ML applications; (2) development of short-term forecasting models to predict future plant process parameters for both single and multiple time steps ahead; and (3) validation of the feature selection methods and short-term forecasting models given new data from different systems.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

Virtual refrigerant charge sensing algorithm for residential CO₂ heat pumps

Natural refrigerants are increasingly adopted in next-generation heat pump systems, among which CO₂ heat pumps have attracted significant attention. However, due to their high operating pressures, the leakage risk is higher, resulting in undercharge conditions and degraded heat pump performance. Thus, developing an accurate refrigerant charge level detection technique is necessary to guarantee safe and efficient operation. Although virtual refrigerant charge (VRC) level calculation algorithms for CO₂ heat pumps exist, they typically rely on empirically selected features without a systematic selection framework, leading to multicollinearity and potential overfitting, which limit their prediction accuracy and generalizability. To address these issues, this study proposes a VRC algorithm framework with a systematic feature selection method that identifies physically meaningful and statistically significant features, and is applied using a residential CO₂ heat pump as a case study. The method is extended from previous work on conventional refrigerants to account for charge behavior in CO₂ gas coolers. The selected features include gas cooler outlet density, evaporator pressure, and superheat temperature. The results demonstrate that the proposed feature selection method significantly improves prediction accuracy compared to existing VRC approaches. A relatively small training dataset (∼30 samples) is sufficient for feature identification and model development. The developed algorithm achieves less than 3% prediction error under both undercharge and overcharge conditions, representing reductions of 46.7% and 35.3% compared to two recent reference VRC algorithms for transcritical CO₂ heat pumps reported in the literature. The proposed algorithm and feature selection method enhance leakage detection capability, facilitate the deployment of CO₂ heat pump systems, and contribute to reduced energy waste and maintenance costs.

Guo, Fangzhou [Lawrence Berkeley National Laborato↗
DOE OSTI2021

Stress-dominated growth of two-dimensional materials on nonplanar substrates

Curved features are ubiquitous on solid surfaces, but the effect of surface curvatures on growth of two-dimensional (2D) materials has not yet been established. Using a newly developed method based on the Metropolis algorithm and taking graphene as a prototype, we find that a curved feature on substrates can result in a variety of topological defects in 2D materials. As the feature's size increases by just nanometers, the defects can vary from adatoms, dislocation pairs, and grain boundary scars to long-range grain boundaries, in contrast to previously reported defect-free modes of rigid colloidal crystals growing on spheres. We identify an important role of curvature-induced lattice stress in lowering the growth rate over the curved features and driving a plastic instability in the materials. When the feature's size increases to several nanometers, the stress effect is compromised by an enhanced effect of geodesic curvature, yielding long-range grain boundaries as a result of increased local growth rate on the feature with respect to that on flat regions. Here we further provide a ‘phase diagram’ of defects that helps to guide a rational choice of geometrical parameters of features towards the growth of high-quality 2D materials as well as controllable creation of topological defects.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Decoding defect statistics from diffractograms via machine learning

Abstract Diffraction techniques can powerfully and nondestructively probe materials while maintaining high resolution in both space and time. Unfortunately, these characterizations have been limited and sometimes even erroneous due to the difficulty of decoding the desired material information from features of the diffractograms. Currently, these features are identified non-comprehensively via human intuition, so the resulting models can only predict a subset of the available structural information. In the present work we show (i) how to compute machine-identified features that fully summarize a diffractogram and (ii) how to employ machine learning to reliably connect these features to an expanded set of structural statistics. To exemplify this framework, we assessed virtual electron diffractograms generated from atomistic simulations of irradiated copper. When based on machine-identified features rather than human-identified features, our machine-learning model not only predicted one-point statistics (i.e. density) but also a two-point statistic (i.e. spatial distribution) of the defect population. Hence, this work demonstrates that machine-learning models that input machine-identified features significantly advance the state of the art for accurately and robustly decoding diffractograms.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Applying Thomson scattering to diagnosing turbulent density and velocity fluctuations in a gas-puff z-pinch

The electron plasma wave feature (EPW) in the time-resolved Thomson scattering spectrum is used to obtain the local electron density in imploding high energy density gas-puff z-pinch plasmas. The optical setup was optimized to allow the relatively weak EPW feature obtained from 1 MA imploding neon gas-puff z-pinches to be seen above the continuum emission as well as the brighter ion acoustic wave (IAW) feature. Using a frequency-doubled Nd:YLF laser (E = 10 J, λ = 526.5 nm, Δt= 2.3 ns, spot size ~ 250 μm) and two visible light streak cameras, we determined the average electron density in the imploding plasma sheath 40 ns prior to stagnation to be n e = 2.5 × 10 18 /cm 3 . At pinch time, it reached n e = 1.7 × 10 19 /cm 3 . Here, the electron temperature during implosion measured via the IAW (approximately 50 eV) was four times lower than the implosion electron temperature measured via the EPW (approximately 200 eV), assuming that neither feature is affected by turbulent fluctuations in the plasma. In order for the electron temperatures inferred from the EPW and IAW spectral features to be self-consistent, we find that it is necessary to include velocity fluctuations in the analysis of the IAW feature peaks and corresponding density fluctuation in the peak widths of the EPW feature.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Evaluation of Digital Nautical Chart data for confirmation and expansion of GeoNames data

Here, this work examines how Digital Nautical Chart (DNC) data may contribute to the evolution and refinement of GeoNames data for near-shore features. GeoNames features are point data with one or more possible place names. DNC Earth Cover Text (ECRText) objects are map labels positioned nearby their real word counterpart. ECRText feature map position strikes a compromise between association with real features and cartographic readability. This work explores whether ECRText features can confirm (or expand names for) existing locations or contribute new locations through data conflation. Due to name variations and spatial position, conflating these data are nontrivial. Previous work engaged in a brief examination using the trigram string matching algorithm under coarse proximity constraints, indicating that ECRText could provide additional value to GeoNames. This work builds on that study, by engaging in a deeper examination of spatial proximity and exploring conflation agreement across an ensemble of string matching approaches. The result finds strong ensemble agreement about ECRText features which already exist in GeoNames but mixed results about which features contribute new information, as well as exploring why some of these matching techniques fail. With an eye toward automation, computational efficiency was found not to be a constraint in sustaining updates.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2023

Explainable machine learning for hydrogen diffusion in metals and random binary alloys

Hydrogen diffusion in metals and alloys plays an important role in the discovery of new materials for fuel cell and energy storage technology. While analytic models use hand-selected features that have clear physical ties to hydrogen diffusion, they often lack accuracy when making quantitative predictions. Machine learning models are capable of making accurate predictions, but their inner workings are obscured, rendering it unclear which physical features are truly important. To develop interpretable machine learning models to predict the activation energies of hydrogen diffusion in metals and random binary alloys, we create a database for physical and chemical properties of the species and use it to fit six machine learning models. Our models achieve root-mean-squared errors between 98–119 meV on the testing data and accurately predict that elemental Ru has a large activation energy, while elemental Cr and Fe have small activation energies. By analyzing the feature importances of these fitted models, we identify relevant physical properties for predicting hydrogen diffusivity. While metrics for measuring the individual feature importances for machine learning models exist, correlations between the features lead to disagreement between models and limit the conclusions that can be drawn. Instead grouped feature importance, formed by combining the features via their correlations, agree across the six models and reveal that the two groups containing the packing factor and electronic specific heat are particularly significant for predicting hydrogen diffusion in metals and random binary alloys. In conclusion, this framework allows us to interpret machine learning models and enables rapid screening of new materials with the desired rates of hydrogen diffusion.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Characterizing Quantum Classifier Utility in Natural Language Processing Workflows

Quantum Natural Language Processing (QNLP) develops natural language processing (NLP) models for deployment on quantum computers. We explore feature and data prototype selection techniques to address challenges posed by encoding high dimensional features. Our study builds quantum circuit classifiers that includes classical feature pre-processing, quantum embedding and quantum model training. The quantum models are built on 4 or 6 qubits and the quantum neural network (QNN) uses the established bricklayer design. We compare the dependence of model performance (in terms of accuracy and F1 scores) on feature length, embedding gates and parameterized unitary design. We compare the performance of quantum machine learning models to classical convolution neural network model (CNN) on binary and multi-class classification tasks using two datasets of synthetic features and labels. The first is the ECP-CANDLE P3B3 dataset a corpus of synthetically generated cancer pathology reports. The second dataset is extracted from well-known benchmark dataset (MADELON) - features are generated with a combination of informative, repeated and uninformative features. Both datasets are used for binary classification and multi-class classification with 3 classes. We observe robust, accurate performance from all models on the binary classification tasks, but multiclass classification is a challenge for the quantum models-there is a notable decrease in accuracy when using 3 classes. Overall the performance is comparable in terms of recall and accuracy between QNNs and CNNs, even with large datasets. These results provide a point of comparison between quantum and classical models on real-world datasets.

Hamilton, Kathleen↗