Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “decision tree”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Searches for direct slepton production in the compressed-mass corridor in $\sqrt{\textrm{s}}$ = 13 TeV pp collisions with the ATLAS detector

This paper presents searches for the direct pair production of charged light-flavour sleptons, each decaying into a stable neutralino and an associated Standard Model lepton. The analyses focus on the challenging ``corridor'' region, where the mass difference, $Δm$, between the slepton ($\tilde{e}$ or $\tildeμ$) and the lightest neutralino ($\tildeχ^{0}_{1}$) is less or similar to the mass of the $W$ boson, $m(W)$, with the aim to close a persistent gap in sensitivity to models with $Δm \lesssim m(W)$. Events are required to contain a high-energy jet, significant missing transverse momentum, and two same-flavour opposite-sign leptons ($e$ or $μ$). The analysis uses $pp$ collision data at $\sqrt{s} = 13$ TeV recorded by the ATLAS detector, corresponding to an integrated luminosity of 140 fb$^{-1}$. Several kinematic selections are applied, including a set of boosted decision trees. These are each optimised for different $Δm$ to provide expected sensitivity for the first time across the full $Δm$ corridor. The results are generally consistent with the Standard Model, with the most significant deviations observed with a local significance of 2.0 $σ$ in the selectron search, and 2.4 $σ$ in the smuon search. While these deviations weaken the observed exclusion reach in some parts of the signal parameter space, the previously present sensitivity gap to this corridor is largely reduced. Constraints at the 95% confidence level are set on simplified models of selectron and smuon pair production, where selectrons (smuons) with masses up to 300 (350) GeV can be excluded for $Δm$ between 2 GeV and 100 GeV.

hadron-hadron scattering↗

Search for lepton-flavor-violating τ – → μ – μ + μ – decays at Belle II

We present the result of a search for the charged-lepton-flavor violating decay τ – → μ – μ + μ – using a 424 fb –1 sample of data recorded by the Belle II experiment at the SuperKEKB e + e – collider. The selection of e + e – → τ + τ – events is based on an inclusive reconstruction of the non-signal tau decay, and on a boosted decision tree to suppress background. We observe one signal candidate, which is compatible with the expectation from background processes. We set a 90% confidence level upper limit of 1.9 × 10 –8 on the branching fraction of the τ – → μ – μ + μ – decay, which is the most stringent bound to date.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Search for supersymmetry using vector boson fusion signatures and missing transverse momentum in pp collisions at $\sqrt{s}$ = 13 TeV with the ATLAS detector

This paper presents a search for supersymmetric particles in models with highly compressed mass spectra, in events consistent with being produced through vector boson fusion. The search uses 140 fb −1 of proton-proton collision data at $\sqrt{s}$ = 13 TeV collected by the ATLAS experiment at the Large Hadron Collider. Events containing at least two jets with a large gap in pseudorapidity, large missing transverse momentum, and no reconstructed leptons are selected. A boosted decision tree is used to separate events consistent with the production of supersymmetric particles from those due to Standard Model backgrounds. The data are found to be consistent with Standard Model predictions. The results are interpreted using simplified models of R-parity-conserving supersymmetry in which the lightest supersymmetric partner is a bino-like neutralino with a mass similar to that of the lightest chargino and second-to-lightest neutralino, both of which are wino-like. Lower limits at 95% confidence level on the masses of next-to-lightest supersymmetric partners in this simplified model are established between 117 and 120 GeV when the lightest supersymmetric partners are within 1 GeV in mass.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Search for the lepton-flavor-violating τ − → e ∓ ℓ ± ℓ − decays at Belle II

We present the result of a search for the charged-lepton-flavor violating decays τ − → e ∓ ℓ ± ℓ − , where ℓ is a muon or an electron, using a data sample with an integrated luminosity of 428 fb −1 recorded by the Belle II experiment at the SuperKEKB e + e − collider. The selection of e + e − → τ + τ − events containing a signal candidate is based on an inclusive-tagging reconstruction and on a boosted decision tree to suppress background. Upper limits on the branching fractions between 1.3 and 2.5 × 10 −8 are set at the 90% confidence level. These results are the most stringent bounds to date for four of the modes.

flavour physics↗

Machine learning for fundamental spectroscopic and thermodynamic data of actinides and lanthanides

Accurately modeling optical spectra with absolute radiometric intensities is vital for nuclear forensics applications that depend on characterizing optical emissions from energetic nuclear phenomena. This requires precise knowledge of the individual atomic transition probabilities, known as Einstein A-coefficients, for each emission line. Obtaining these values theoretically or experimentally is often impractical due to the complex electronic structures and the number of transitions involved in atoms relevant to nuclear applications. In this study, we explore the use of machine learning to predict the Einstein A coefficients for atomic transitions. Seven models were evaluated that ranged from deep learning to decision tree algorithms, and found that gradient boosting performed best, specifically the Extreme Gradient Boosting (XGB) architecture, achieving a precision of 86% across transitions of 36 elements. Furthermore, the model was cross-validated using published transition probabilities reported in the literature and applied to estimate Pu plasma temperatures from a previous experiment conducted at Savannah River National Laboratory.

Atomic spectroscopy↗

Converting sWeights to probabilities with density ratios

The use of machine learning approaches continues to have many benefits in experimental nuclear and particle physics. One common issue is generating training data which is sufficiently realistic to give reliable results. Here we advocate using real experimental data as the source of training data and demonstrate how one might subtract background contributions through the use of probabilistic weights which can be readily applied to training data. The sPlot formalism is a common tool used to isolate distributions from different sources. However, the negative sWeights produced by the sPlot technique can cause training problems and poor predictive power. This article demonstrates how density ratio estimation can be applied to convert sWeights to event probabilities, which we call drWeights. The drWeights can then be applied to produce the distributions of interest and are consistent with direct use of the sWeights. This article will also show how decision trees are particularly well suited to convert sWeights, with the benefit of fast prediction rates and adaptability to aspects of experimental data such as the data sample size and proportions of different event sources. We also show that a density ratio product approach in which the initial drWeights are reweighted by an additional converter gives substantially better results.

Glazier, Derek I. [Univ. of Glasgow, Scotland (Uni↗

Field-based AFDD for refrigerant undercharge in residential HVAC systems: enhancing reliability through false alarm mitigation

This study evaluated rule-based and machine learning (ML) based automated fault detection and diagnostics (AFDD) algorithms for detecting refrigerant undercharge faults in residential heating, ventilation, and air conditioning (HVAC) systems, using actual building data and a minimal set of features. The ML-based algorithms included Decision Tree (DT) and K-Nearest Neighbors (KNN). Both the rule-based and ML-based algorithms demonstrated the capability to detect refrigerant undercharge faults of -30% or more. Both types of algorithms exhibited false alarms before the implementation of a false alarm mitigation algorithm, which motivated the development of such a mitigation strategy. After applying the mitigation, false alarms were substantially reduced, with the rule-based algorithm decreasing to 0.6% and the ML-based algorithms reaching 0%, while maintaining strong detection performance. Although the rule-based algorithm initially showed lower performance compared to the ML-based algorithms, its detection accuracy improved after mitigation to a level comparable to the ML-based algorithms. These results confirm that combining false alarm mitigation with both rule-based and ML-based AFDD algorithms significantly enhances practical reliability while preserving robust fault detection capabilities. Furthermore, the findings demonstrate the potential for field deployment of these algorithms in residential HVAC systems and highlight the importance of minimizing false alarms.

False Alarm↗

Parallel sorting algorithm classification: is manual instrumentation necessary?

Understanding parallel algorithms is crucial for accelerating scientific simulations on complex, distributed memory, high-performance computers. Modern algorithm classification approaches learn semantics directly from source code to differentiate between algorithms, however, accessing source code is not always possible. We can learn about parallel algorithms from observing their performance, as programs running the same algorithms and using the same hardware should exhibit similar performance characteristics. We present an approach to learn algorithm classes from parallel performance data directly in order to classify algorithms without access to the source code. We extend previous work to enable classifying parallel sorting algorithms using automatic instrumentation instead of requiring manual region annotations in the source code. In this work, we design and demonstrate a study for classification of parallel sorting algorithms using parallel performance data collected from automatic instrumentation, and evaluate the performance of our new methodology on classification. We leverage Caliper to collect the performance data, Thicket for our exploratory data analysis (EDA), and PyTorch and Scikit-learn to evaluate the effectiveness of random forests, support vector machines (SVMs), decision trees, neural networks, and logistic regressions on parallel performance data. Additionally, we study noise in parallel performance data, whether the removal of noise and pre-processing of the data is necessary to accurately classify parallel sorting algorithms, and determine the effectiveness of features created from performance data. In conclusion, we demonstrate classification accuracy for these five different models of up to 97.7% across four different parallel algorithm classes.

Algorithm Classification↗

Understanding drivers of oil and gas well integrity issues in the greater wattenberg area of Colorado

Well integrity is critically important to maintain to minimize the environmental impacts of oil and gas development and other subsurface energy operations. The Wattenberg Field of Colorado—a top producing field with >40,000 wells—has one of the most robust publicly reported well integrity programs in the country. Here, in this study, we analyzed annular pressure and annular-fluid geochemical test results collected from Wattenberg wells through the end of 2019 to characterize the frequency and spatial variability of integrity issues in the field and understand their drivers. Estimated frequencies of integrity issues among tested wells were 8.2-17.1% between 1955 and 2019 and 6.1-11.4% in 2019 alone. The frequency of integrity issues was nearly four times greater in wells located above the Longmont Wrench Fault Zone. Potential drivers of integrity issues were identified using ensemble decision tree models trained with a broad set of relevant information. Models show that well integrity issues are spatially clustered on regional and sub-regional scales and suggest the relatively high frequency of integrity issues observed is likely attributed to geologic factors. These findings are valuable for regulatory agencies and operators seeking to inform well integrity monitoring, plugging, and emissions reduction efforts and design future subsurface energy projects.

03 NATURAL GAS↗

Segmentation and Classification of Fission as Pores in Reactor Irradiated Annular U–10Zr Metallic Fuel Using Machine Learning Models

Metallic fuels, particularly U—10Zr, are promising candidates for next-generation sodium-cooled fast reactors. Irradiation of nuclear fuels in reactors can lead to the formation of solid and gas fission product which subsequently forms microstructural pores, deteriorating fuel performance. Due to the massive amount of pores and complex phases formed, a quantitative description of fission gas pores is not yet available, preventing the development of microstructure-informed fuel performance modeling for fuel qualification. This paper applied a pre-trained deep learning model to ~10,260 high magnification scanning electron microscopy images. This method increased the accuracy of fission gas pore segmentation and allows statistical features to be extracted which cannot be achieved manually. A pre-trained decision tree model worked on the segemenation results and further classified the pores into different categories to produce a correlation between the pores, movement of lanthanides, and temperature gradient during irradiation. Finally, this paper emphasizes the potentials of machine learning models to accelerate fuel research, development, and qualification for advanced reactors.

36 MATERIALS SCIENCE↗

Predictive modeling of Néel temperature in austenitic alloys using CALPHAD and data analytics

The Néel temperature is a crucial yet often overlooked parameter in calculating the stacking fault energy (SFE) of austenitic alloys. Several empirical equations have been proposed to estimate the Néel temperature of austenitic alloys, which are then used to calculate the SFE and explain deformation mechanisms. However, these empirical equations, typically derived using linear regression algorithms, are often simplistic and may fail to capture the complex interactions among multiple alloying elements that influence the Néel temperature. Moreover, their applicability is usually limited to specific compositional ranges. In this study, we propose a CALPHAD based approach and develop a surrogate decision tree based regression model capable of capturing the interactions among multiple alloying elements to predict the Néel temperature. Predictions from both the CALPHAD approach and the regression model show close agreement with experimental measurements reported in the literature. In conclusion, the implications of accurate Néel temperature predictions on the calculated SFE and deformation mechanisms are also discussed.

36 MATERIALS SCIENCE↗

How does ion temperature gradient turbulence depend on magnetic geometry? Insights from data and machine learning

Magnetic geometry has a significant effect on the level of turbulent transport in fusion plasmas. Here, we model and analyse this dependence using multiple machine learning methods and a dataset of >200 000 nonlinear gyrokinetic simulations of ion-temperature-gradient turbulence in diverse non-axisymmetric geometries. The dataset is generated using a large collection of both optimised and randomly generated stellarator equilibria. At fixed gradients and other input parameters, the turbulent heat flux varies between geometries by several orders of magnitude. Trends are apparent among the configurations with particularly high or particularly low heat flux. Regression and classification techniques from machine learning are then applied to extract patterns in the dataset. Due to a symmetry of the gyrokinetic equation, the heat flux and regressions thereof should be invariant to translations of the raw features in the parallel coordinate, similar to translation invariance in computer vision applications. Multiple regression models including convolutional neural networks (CNNs) and decision trees can achieve reasonable predictive power for the heat flux in held-out test configurations, with highest accuracy for the CNNs. Using Spearman correlation, sequential feature selection and Shapley values to measure feature importance, it is consistently found that the most important geometric lever on the heat flux is the flux surface compression in regions of bad curvature. The second most important geometric feature relates to the magnitude of geodesic curvature. These two features align remarkably with surrogates that have been proposed based on theory, while the methods here allow a natural extension to more features for increased accuracy. The dataset, released with this publication, may also be used to test other proposed surrogates, and we find that many previously published proxies do correlate well with both the heat flux and stability boundary.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Ab Initio-Based Bond Order Potential for Arsenene Polymorphs Developed via Hierarchical Reinforcement Learning

Arsenene, a less-explored two-dimensional material, holds the potential for applications in wearable electronics, memory devices, and quantum systems. This study introduces a bond-order potential model with Tersoff formalism, the ML-Tersoff, which leverages multireward hierarchical reinforcement learning (RL), trained on an ab initio data set. This data set covers a spectrum of properties for arsenene polymorphs, enhancing our understanding of its mechanical and thermal behaviors without the complexities of traditional models requiring multiple parameter sets. Our RL strategy utilizes decision trees coupled with a hierarchical reward strategy to accelerate convergence in high-dimensional continuous search spaces. Unlike the Stillinger-Weber approach, which demands separate formalisms for buckled and puckered forms, the ML-Tersoff model concurrently captures multiple properties of the two polymorphs by effectively representing the local environment, thereby avoiding the need for different atomic types. Here, we apply the ML model to understand the mechanical and thermal properties of the arsenene polymorphs and nanostructures. We observe an inverse relationship between the critical strain and temperature in arsenene. Thermal conductivity calculations in nanosheets show good agreement with ab initio data, reflecting a decrease in thermal conductivity attributable to increased anharmonic effects at higher temperatures. We also apply the model to predict the thermal behavior of arsenene nanotubes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Resolving the Coverage Dependence of Surface Reaction Kinetics with Machine Learning and Automated Quantum Chemistry Workflows

Microkinetic models for catalytic systems require estimation of many thermodynamic and kinetic parameters that can be calculated for isolated species and transition states using ab initio methods. However, the presence of nearby coadsorbates on the surface can dramatically alter these thermodynamic and kinetic parameters causing them to be dependent on species coverage fractions. As there are combinatorially many coadsorbed configurations on the surface, computing the coverage dependence of these parameters is far less straightforward. We present a framework for generating and applying machine learning models to predict coverage-dependent parameters for microkinetic models. Our toolkit enables automatic calculation and evaluation of coadsorbed configurations allowing us to sample 2,000 coadsorbed adsorbates and transition states (TSs) for a diverse set of 9 reactions on Cu(111), a challenging surface, with four possible coadsorbates. This dataset was then used to train subgraph isomorphic decision trees (SIDTs) to predict the stability and association energy of configurations. We were able to achieve mean absolute errors (MAEs) of 0.106 eV on adsorbates, 0.172 eV on TSs, and due to natural error cancellation in SIDTs for relative properties, 0.130 eV on reaction energies and 0.180 eV on activation barriers. In conclusion, we describe how to use these models to predict coverage-dependent corrections for adsorbates and TSs and demonstrate on H*, HO*, and O* comparing the generated SIDT model with an iteratively refined version.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Using Data Science Tools to Reveal and Understand Subtle Relationships of Inhibitor Structure in Frontal Ring-Opening Metathesis Polymerization

The rate of frontal ring-opening metathesis polymerization (FROMP) using the Grubbs generation II catalyst is impacted by both the concentration and choice of monomers and inhibitors, usually organophosphorus derivatives. Herein we report a data-science-driven workflow to evaluate how these factors impact both the rate of FROMP and how long the formulation of the mixture is stable (pot life). Using this workflow, we built a classification model using a single-node decision tree to determine how a simple phosphine structural descriptor (V bur-near ) can bin long versus short pot life. Additionally, we applied a nonlinear kernel ridge regression model to predict how the inhibitor and selection/concentration of comonomers impact the FROMP rate. Furthermore, the analysis provides selection criteria for material network structures that span from highly cross-linked thermosets to non-cross-linked thermoplastics as well as degradable and nondegradable materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Detection of Diversion in a Realistic Heat Pipe Microreactor Using Supervised Machine Learning

Microreactors (MRs) pose new challenges for international safeguards. Here, their small size and mass reproducibility make them ideal for deployment in greater numbers and in remote locations, making the job of safeguards inspectors more challenging. Machine learning (ML) is currently being applied to many fields to augment human performance and increase automation; in particular, ML could be used to provide insight for international inspectors to help detect the diversion of nuclear fuel from MR cores. Four ML model types (k-nearest neighbors, decision tree, random forest, and histogram-based gradient boosted ensemble) were trained on integrated flux and critical control drum angle data generated with Serpent 2 for a realistic heat pipe MR design, achieving nearly 100% binary classification accuracy of nominal and diversion core configurations by the end of 1 full power year for three of the four model types. Regression model variants were also trained, using the same input data, for predicting the number of fuel pins diverted. Root-mean-square errors below 5% of the total number of fuel pins were achieved by the 1 full power year mark for all models.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Impurity gas detection for SNF canisters using probabilistic deep learning and acoustic sensing *

Abstract Monitoring impurity gases in spent nuclear fuel (SNF) canisters is a novel structural health monitoring approach for SNF in dry storage. The SNF canisters are sealed containers that do not facilitate visual access to the inside. Acoustic sensing can be deployed by taking advantage of the pathways unobstructed by internal hardware. Although the ultrasonic time-of-flight measurement can provide valuable information, it is limited in its ability to discern the concentration of only one impurity gas. As such, deep learning algorithms, particularly convolutional neural networks (CNNs), offer a promising solution. In this study, CNN-based probabilistic deep learning models were implemented to detect and quantify multiple impurity gases in helium. An experimental platform was established to simulate canister conditions, and ultrasonic test data were collected. The presence of argon and air in helium at concentrations ranging from 0% to 1.2% at increments of 0.05% was considered. The multi-layer perceptron, decision tree, and logistic regression classifiers achieved high accuracies when distinguishing pure helium from helium with impurities. CNN with dropout layers and CNN using maximum likelihood estimation showed a similar performance, indicating their ability to capture uncertainties. The ensemble CNN model exhibited improved predictions and the ability to balance individual gas concentration by integrating 1D- and 2D-CNN models. These findings contribute probabilistic deep learning solutions for impurity gas detection and analysis within SNF canisters, thus ensuring safe storage and management of SNFs.

47 OTHER INSTRUMENTATION↗