Results for “Feature importance” — Page 21

DOE OSTI2025

IDENTIFICATION OF POTENTIAL SUPERCONDUCTOR QUENCH PRECURSORS USING FREQUENCY DOMAIN FEATURE ANALYSIS

Superconducting magnets are important pieces of technology in the world of particle accelerators, allowing researchers to study atomic and subatomic phenomena, among other things. In some instances, superconductors can lose this non-resistive property in a phenomenon known as quenching, which can cause damage to the magnets. This potential danger prompts the introduction of systems to predict when a quench is imminent; one such implementation is through the use of acoustic sensors that detect vibrations within the magnet. Within these acoustic sensor signals, significantly above-noise disturbances (referred to as ”events”) can be identified. Our research applies the statistical framework of a permutation test to features calculated from the power spectral density (PSD) to distinguish between events far from the quench at the end of the signal to events at the start of the signal. We found that dividing the PSD into frequency bands produced a feature capable of distinguishing between events early in the signal and late in the signal leading up the quench, providing a promising starting place for future quench prediction systems.

Roehrig, Benjamin [Northern Illinois U.]↗

DOE OSTI2022

Prediction of Self-Diffusion in Binary Fluid Mixtures Using Artificial Neural Networks

Artificial neural networks (ANNs) were developed to accurately predict the self-diffusion constants for individual components in binary fluid mixtures. The ANNs were tested on an experimental database of 4328 self-diffusion constants from 131 mixtures containing 75 unique compounds. The presence of strong hydrogen bonding molecules may lead to clustering or dimerization resulting in non-linear diffusive behavior. To address this, self- and binary association energies were calculated for each molecule and mixture to provide information on intermolecular interaction strength and were used as input features to the ANN. An accurate, generalized ANN model was developed with an overall average absolute deviation of 4.1%. Forward input feature selection reveals the importance of critical properties and self-association energies along with other fluid properties. Additional ANNs were developed with subsets of the full input feature set to further investigate the impact of various properties on model performance. The results from two specific mixtures are discussed in additional detail: one providing an example of strong hydrogen bonding and the other an example of extreme pressure changes, with the ANN models predicting self-diffusion well in both cases.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2024

Simulating Magnetic Reconnection in ‘Two Ribbon’ Type Solar Flares

Magnetic reconnection is an astrophysical process where neighboring magnetic field lines, facing anti-parallel, are reconfigured. This reconfiguration results in built up magnetic energy being explosively released as it is being converted to plasma kinetic and thermal energies. There are various kinds of simulations used to simulation reconnection; our work begins with Athena++, a magnetohydrodynamic (MHD) simulation code typically used for astrophysical problems, and a reconnection specific code file. The resistive MHD equations are solved with Riemann solvers. There was an initial test run without modifying the code to understand the dynamics of the simulation. We expand on the original reconnection problem file by implementing a radiative cooling term specific to the corona. The radiative cooling is theorized to have an effect on solar coronal plasma and magnetic reconnection dynamics. The cooling term will be tested with various parameters and compared to the case without cooling to study these dynamics. The condensation found in only the with cooling case emphasizes the importance of implementing this feature and will be later tested with a thermal conduction term. We want to determine the parameter regime where non-equilibrium cooling will be important for the reconnection dynamics.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

Preprocessing for Unintended Conducted Emissions Classification with ResNet

Characterization of Unintended Conducted Emissions (UCE) from electronic devices is important when diagnosing electromagnetic interference, performing nonintrusive load monitoring (NILM) of power systems, and monitoring electronic device health, among other applications. Prior work has demonstrated that UCE analysis can serve as a diagnostic tool for energy efficiency investigations and detailed load analysis. While explaining the feature selection of deep networks with certainty is often not fully comprehensive, or in other applications, quite lacking, additional tools/methods for further corroboration and confirmation can help further the understanding of the researcher. This is true especially in the subject application of the study in this paper. Often the focus of such efforts is the selected features themselves, and there is not as much understanding gained about the noise in the collected data. If selected feature and noise characteristics are known, it can be used to further shape the design of the deep network or associated preprocessing. This is additionally difficult when the available data are limited, as in the case which the authors investigated in this study. Here, the authors present a novel work (which is a proposed complementary portion of the overall solution to the deep network classification explainability problem for this application) by applying a systematic progression of preprocessing and a deep neural network (ResNet architecture) to classify UCE data obtained via current transformers. By using a methodical application of preprocessing techniques prior to a deep classifier, hypotheses can be produced concerning what features the deep network deems important relative to what it perceives as noise. For instance, it is hypothesized in this particular study as a result of execution of the proposed method and periodic inspection of the classifier output that the UCE spectral features are relatively close to each other or to the interferers, as systematically reducing the beta parameter of the Kaiser window produced progressively better classification performance, but only to a point, as going below the Beta of eight produced decreased classifier performance, as well as the hypothesis that further spectral feature resolution was not as important to the classifier as rejection of the leakage from a spectrally distant interference. This can be very important in unpredictable low-FNR applications, where knowing the difference between features and noise is difficult. As a side-benefit, much was learned regarding the best preprocessing to use with the selected deep network for the UCE collected from these low power consumer devices obtained via current transformers. Baseline rectangular windowed FFT preprocessing provided a 62% classification increase versus using raw samples. After performing a more optimal preprocessing, more than 90% classification accuracy was achieved across 18 low-power consumer devices for scenarios in which the in-band features-to-noise ratio (FNR) was very poor.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

A machine learning approach to emulation and biophysical parameter estimation with the Community Land Model, version 5

Abstract. Land models are essential tools for understanding and predicting terrestrial processes and climate–carbon feedbacks in the Earth system, but uncertainties in their future projections are poorly understood. Improvements in physical process realism and the representation of human influence arguably make models more comparable to reality but also increase the degrees of freedom in model configuration, leading to increased parametric uncertainty in projections. In this work we design and implement a machine learning approach to globally calibrate a subset of the parameters of the Community Land Model, version 5 (CLM5) to observations of carbon and water fluxes. We focus on parameters controlling biophysical features such as surface energy balance, hydrology, and carbon uptake. We first use parameter sensitivity simulations and a combination of objective metrics including ranked global mean sensitivity to multiple output variables and non-overlapping spatial pattern responses between parameters to narrow the parameter space and determine a subset of important CLM5 biophysical parameters for further analysis. Using a perturbed parameter ensemble, we then train a series of artificial feed-forward neural networks to emulate CLM5 output given parameter values as input. We use annual mean globally aggregated spatial variability in carbon and water fluxes as our emulation and calibration targets. Validation and out-of-sample tests are used to assess the predictive skill of the networks, and we utilize permutation feature importance and partial dependence methods to better interpret the results. The trained networks are then used to estimate global optimal parameter values with greater computational efficiency than achieved by hand tuning efforts and increased spatial scale relative to previous studies optimizing at a single site. By developing this methodology, our framework can help quantify the contribution of parameter uncertainty to overall uncertainty in land model projections.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Origins of epitaxial macro-terraces and macro-steps on GaN substrates

Localized lattice distortions in GaN substrates can serve as nucleation sites for epitaxial macro-steps and macro-terraces. These detrimental macro-scale features give rise to optically hazy homoepitaxial GaN surfaces. After nucleating, these macro-features grow laterally along the surface and coalesce, leading to significant coverage of the wafer surface. Dot-core GaN substrates consisting of a periodic array of cores were used as a defect-engineered system, where dislocations are intentionally concentrated at the cores. The high density of threading dislocations at the cores induced localized lattice distortions. Here, these distortions are associated predominantly with lattice tilt on the order of hundreds of arcsec across ~0.5 mm laterally along the wafer surface. The resulting macro-features that nucleated at these localized distorted sites were made up of macro-terraces with lengths ranging ~30–~150 μm and macro-step heights ranging ~200–~400 nm. Another source of localized distortion was threading screw dislocations or GaN nanopipes that resulted in spiral growth and hillock formation. Based on x-ray topography and optical microscopy measurements, we speculate that the coalescence of hillocks evolves into macro-terraces and macro-steps. While previous studies focused on the substrate miscut as a means to control macro-feature formation, we show that localized lattice tilt from defects is another important contributor to macro-feature formation.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Feature selection with distance correlation

Choosing which properties of the data to use as input to multivariate decision algorithms—also known as feature selection—is an important step in solving any problem with machine learning. While there is a clear trend towards training sophisticated deep networks on large numbers of relatively unprocessed inputs (so-called automated feature engineering), for many tasks in physics, sets of theoretically well-motivated and well-understood features already exist. Working with such features can bring many benefits, including greater interpretability, reduced training and run time, and enhanced stability and robustness. We develop a new feature selection method based on distance correlation, and demonstrate its effectiveness on the tasks of boosted top- and W -tagging. Using our method to select features from a set of over 7,000 energy flow polynomials, we show that we can match the performance of much deeper architectures, by using only ten features and two orders-of-magnitude fewer model parameters. Published by the American Physical Society 2024

Astronomy & Astrophysics↗

DOE OSTI2026

A multi-backend autotuning study of feature selection on GPUs

Abstract Feature selection is an important step in machine learning that can benefit from GPU acceleration. As the number of GPU vendors increases, it is imperative to adapt algorithms such as the minimum Redundancy Maximum Relevance (mRMR) feature selection method to different backends that support several GPU architectures. This work presents a multi-backend implementation of mRMR across CUDA, HIP, and SYCL, and studies its performance when combined with Bayesian optimization and transfer learning to automatically tune execution parameters for different platforms and datasets. Our experimental results show that when tuned, CUDA and HIP achieve comparable performance on NVIDIA architectures, while SYCL exhibits a moderate performance gap. Overall, this work highlights the impact of backend choice and autotuning on GPU-accelerated feature selection and provides insights into deploying mRMR across heterogeneous environments.

Beceiro, Bieito (ORCID:0000000333014890)↗

DOE OSTI2025

Implications of Safety and Operational Features of Small, Advanced Reactors for the Evaluation of Important Human Actions

The design and operational characteristics of non-light water reactors are likely to change the role of human actions in safety function management and the types of human actions that are deemed important. The objectives of this report are to: • Identify the implications of small, advanced reactor design characteristics on human performance and the changing role of human actions in the management of safety functions. • Identify the methods that may be used to identify important human actions. • Identify how HFE safety reviewers can help ensure that the methods adequately model human actions to identify those that are important to safety. We identified the implications of small, advanced reactor characteristics on the role of personnel in safety function management. Then we addressed how designers can identify which human actions are important to safety using both probabilistic risk assessment (PRA) and deterministic analyses. PRA identifies important human actions using risk-importance criteria. Deterministically identified important human actions include those identified by analyses of situations such as transients and accidents and defense in depth. In all cases, the acceptability of the analyses is dependent on the modeling, quantification, and criterion selection to determine which human actions are important. How well the designers address these processes determines the acceptability of their methodology.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2019

Machine Learning Assisted Synthesis of Metal–Organic Nanocapsules

Herein, we report machine learning algorithms by training data sets from a set of both successful and failed experiments for studying the crystallization propensity of metal–organic nanocapsules (MONCs). Among a variety of studied machine learning algorithms, XGBoost affords the highest prediction accuracy of >90%. The derived chemical feature scores that determine importance of reaction parameters from the XGBoost model assist to identify synthesis parameters for successfully synthesizing new hierarchical structures of MONCs, showing superior performance to a well-trained chemist. This work demonstrates that the machine learning algorithms can assist the chemists to faster search for the optimal reaction parameters from many experimental variables, whose features are usually hidden in the high-dimensional space.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2020

Machine learning substitutional defect formation energies in ABO 3 perovskites

Perovskite oxides are a promising material platform for use in a wide range of technological applications including electronics, sensors, fuel cells, and catalysis. This is owing to the extraordinary tunability of their physical and chemical properties via defect engineering. The feasibility and the stability of a defect, such as a substitutional dopant, in the host lattice is usually obtained via experiments and/or through detailed quantum mechanical calculations. Both of these conventional routes are expensive and time consuming. An alternative is a data-driven machine learning (ML)-based approach. In this work, we have applied ML techniques to identify the factors that influence defect formation energy, which is an important measure of the stability of the defects, in perovskite oxides. Using 13 elemental properties as features and random forest regression, we demonstrate a systematic approach to down-selecting from the larger set of features to those that are important, establishing a framework for accurate predictions of the defect formation energy. We quantitatively show that the most important factors that control the dopant stability are the dopant ionic size, heat of formation, effective tolerance factor, and oxidation state. Our work reveals previously unknown correlations, chemical trends, and the interplay between stability and underlying chemistries. Hence, these results showcase the efficacy of ML tools in identifying and quantifying different feature-dependencies and provide a promising route toward dopant selection in the perovskites. Herein, we have developed a framework that itself is general and can be potentially applied to other material classes.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Nanoscale chemistry and ion segregation in zirconia-based ceramic at grain boundaries by atom probe tomography

In this work nanoscale features that are of importance in the stability of yttria-stabilized tetragonal zirconia (Y-TZP) are quantified through atom probe tomography. In-depth analysis of grain boundary chemistry revealed preferential segregation of lighter and smaller ions towards specific grain boundaries. The relationship between elemental segregation and the local atomistic structure is investigated at the sub-nanometer level to gain insights on nanoscale features associated with the tetragonal-monoclinic phase transformation in Y-TZP through grain boundary characterization. Furthermore, principal component analysis was implemented to reveal any potential biases from varied field evaporation across stabilizer-rich grain boundaries. The observed variations in ion density across different grains suggested a variation in field which was attributed to potential variations in grain crystal orientation. In order to reveal the subtle depletion of oxygen atoms within grain boundaries a new methodology to map oxygen vacancies is proposed, utilizing the relative neighborhood chemistry of individual yttrium atoms.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Identifications of RR Lyrae Stars and Quasars from the Simulated Data of Mephisto-W Survey

We have investigated the feasibilities and accuracies of the identifications of RR Lyrae stars and quasars from the simulated data of the Multi-channel Photometric Survey Telescope (Mephisto) W Survey. Based on the variable sources light curve libraries from the Sloan Digital Sky Survey (SDSS) Stripe 82 data and the observation history simulation from the Mephisto-W Survey Scheduler, we have simulated the uvgriz multi-band light curves of RR Lyrae stars, quasars and other variable sources for the first-year observation of Mephisto W Survey. We have applied the ensemble machine learning algorithm Random Forest Classifier (RFC) to identify RR Lyrae stars and quasars, respectively. We build training and test samples and extract ~150 features from the simulated light curves and train two RFCs respectively for the RR Lyrae star and quasar classification. We find that, our RFCs are able to select the RR Lyrae stars and quasars with remarkably high precision and completeness, with purity = 95.4% and completeness = 96.9% for the RR Lyrae RFC and purity = 91.4% and completeness = 90.2% for the quasar RFC. In conclusion, we have also derived relative importances of the extracted features utilized to classify RR Lyrae stars and quasars.

(galaxies:) quasars: general↗

DOE OSTI2020

Library of Advanced Materials for Engineering (LAM) 4.56

Accurate and efficient constitutive modeling remains a cornerstone issue for solid mechanics analysis. Over the years, the LAME advanced material model library has grown to address this challenge by implementing models capable of describing material systems spanning soft polymers to stiff ceramics including both isotropic and anisotropic responses. Inelastic behaviors including (visco)plasticity, damage, and fracture have all incorporated for use in various analyses. This multitude of options and flexibility, however, comes at the cost of many capabilities, features, and responses and the ensuing complexity in the resulting implementation. Therefore, to enhance confidence and enable the utilization of the LAME library in application, this effort seeks to document and verify the various models in the LAME library. Specifically, the broader strategy, organization, and interface of the library itself is first presented. The physical theory, numerical implementation, and user guide for a large set of models is then discussed. Importantly, a number of verification tests are performed with each model to not only have confidence in the model itself but also highlight some important response characteristics and features that may be of interest to end-users. Finally, in looking ahead to the future, approaches to add material models to this library and further expand the capabilities are presented.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Library of Advanced Materials for Engineering (LAMÉ) 4.58

Accurate and efficient constitutive modeling remains a cornerstone issue for solid mechanics analysis. Over the years, the LAMÉ advanced material model library has grown to address this challenge by implementing models capable of describing material systems spanning soft polymers to stiff ceramics including both isotropic and anisotropic responses. Inelastic behaviors including (visco)plasticity, damage, and fracture have all incorporated for use in various analyses. This multitude of options and flexibility, however, comes at the cost of many capabilities, features, and responses and the ensuing complexity in the resulting implementation. Therefore, to enhance confidence and enable the utilization of the LAMÉ library in application, this effort seeks to document and verify the various models in the LAMÉ library. Specifically, the broader strategy, organization, and interface of the library itself is first presented. The physical theory, numerical implementation, and user guide for a large set of models is then discussed. Importantly, a number of verification tests are performed with each model to not only have confidence in the model itself but also highlight some important response characteristics and features that may be of interest to end-users. Finally, in looking ahead to the future, approaches to add material models to this library and further expand the capabilities are presented.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Library of Advanced Materials for Engineering (LAMÉ) 5.0

Accurate and efficient constitutive modeling remains a cornerstone issue for solid mechanics analysis. Over the years, the LAMÉ advanced material model library has grown to address this challenge by implementing models capable of describing material systems spanning soft polymers to stiff ceramics including both isotropic and anisotropic responses. Inelastic behaviors including (visco)plasticity, damage, and fracture have all incorporated for use in various analyses. This multitude of options and flexibility, however, comes at the cost of many capabilities, features, and responses and the ensuing complexity in the resulting implementation. Therefore, to enhance confidence and enable the utilization of the LAMÉ library in application, this effort seeks to document and verify the various models in the LAMÉ library. Specifically, the broader strategy, organization, and interface of the library itself is first presented. The physical theory, numerical implementation, and user guide for a large set of models is then discussed. Importantly, a number of verification tests are performed with each model to not only have confidence in the model itself but also highlight some important response characteristics and features that may be of interest to end-users. Finally, in looking ahead to the future, approaches to add material models to this library and further expand the capabilities are presented

36 MATERIALS SCIENCE↗

DOE OSTI2021

Library of Advanced Materials for Engineering (LAMÉ) 5.2

Accurate and efficient constitutive modeling remains a cornerstone issue for solid mechanics analysis. Over the years, the LAMÉ advanced material model library has grown to address this challenge by implementing models capable of describing material systems spanning soft polymers to stiff ceramics including both isotropic and anisotropic responses. Inelastic behaviors including (visco)plasticity, damage, and fracture have all incorporated for use in various analyses. This multitude of options and flexibility, however, comes at the cost of many capabilities, features, and responses and the ensuing complexity in the resulting implementation. Therefore, to enhance confidence and enable the utilization of the LAMÉ library in application, this effort seeks to document and verify the various models in the LAMÉ library. Specifically, the broader strategy, organization, and interface of the library itself is first presented. The physical theory, numerical implementation, and user guide for a large set of models is then discussed. Importantly, a number of verification tests are performed with each model to not only have confidence in the model itself but also highlight some important response characteristics and features that may be of interest to end-users. Finally, in looking ahead to the future, approaches to add material models to this library and further expand the capabilities are presented.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Library of Advanced Materials for Engineering (LAMÉ) 5.4

Accurate and efficient constitutive modeling remains a cornerstone issue for solid mechanics analysis. Over the years, the LAMÉ advanced material model library has grown to address this challenge by implementing models capable of describing material systems spanning soft polymers to stiff ceramics including both isotropic and anisotropic responses. Inelastic behaviors including (visco)plasticity, damage, and fracture have all incorporated for use in various analyses. This multitude of options and flexibility, however, comes at the cost of many capabilities, features, and responses and the ensuing complexity in the resulting implementation. Therefore, to enhance confidence and enable the utilization of the LAMÉ library in application, this effort seeks to document and verify the various models in the LAMÉ library. Specifically, the broader strategy, organization, and interface of the library itself is first presented. The physical theory, numerical implementation, and user guide for a large set of models is then discussed. Importantly, a number of verification tests are performed with each model to not only have confidence in the model itself but also highlight some important response characteristics and features that may be of interest to end-users. Finally, in looking ahead to the future, approaches to add material models to this library and further expand the capabilities are presented.

36 MATERIALS SCIENCE↗