Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Decision tree”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Improving Solar and Solar+Storage Screening Techniques to Reduce Utility Interconnection Time and Costs (Final Technical Report)

Residential PV installations have increased rapidly over the last decade, and the increased application volume has caused permitting delays and lower overall adoption rates. In this project, we developed and evaluated whether data-driven secondary modeling and screening techniques can help utilities assess customer applications more accurately than traditional screening shortcuts. Secondary topologies are predicted using decision trees and commonly available information, such as service transformer, customer, and street locations. Conductors were predicted using a logistic regression method based on real world object (RWO) types, service transformer ratings, conductor length, and distance to transformer. After developing the combined primary and secondary distribution network model, hosting capacity results were used to train a random forest model to predict the pass/fail likelihood of a customer application. Powerflow based models with predicted secondaries and data-driven methods both increased the screening success rate, relative to common utility heuristics, by as much as 55 percentage points. Data-driven screening techniques were described by one utility as a "right-sized" approach for residential customers given the low-risk of small errors and the high-cost of accurate modeling.

14 SOLAR ENERGY↗
DOE OSTI2022

Automated System-wide Event Detection and Classification Using Machine Learning on Synchrophasor Data

As the number of phasor measurement units (PMUs) deployed in a power system increases, and their data volume streamed to the control canter intensifies, operators are facing challenges related to the analysis of such data, which need to be observed and responded to as the measurements are displayed in the Control Room. Humans are generally unable to process such large amount of data efficiently and rapidly. There is an apparent need for automated ways to analyze the data, extract actionable information about occurrence of specific events, and characterize the events quickly and cost effectively. This paper discusses the use of machine learning (ML) to facilitate such tasks by providing automated, highly computationally efficient, and cost-effective ways of extracting actionable information from synchrophasor big data in real-time. We developed Big Data Smart (BDSmart) ML-based prototype tool for the Control Room use that automatically analyses data properties from synchrophasor system measurements taken across the three grid Interconnections in the USA (Western, Eastern and ERCOT). The data collected from several hundreds of PMUs located across the Interconnections over a period of two years have been made available for our extensive study. As a result, we were able to identify a number of big data properties that influence how ML methodology is applied to select, develop, train and test the data models that can eventually be used for the tool implementation. The resulting set of candidate algorithms spans unsupervised, supervised, semi-supervised and transfer-learning approaches. Many ML techniques, such as decision trees, multinomial logistic regression, feed-forward neural networks, K-nearest neighbor, multiclass support vector machine, and single and multi-channel convolutional neural networks, are implemented, and their performance is examined. We offer the results from testing the data models. The novelty of our study is in the approaches for bad data detection and mitigation, selection of a simplified feature for event detection, and data label improvements. As a result, we came up with a list of recommendations for the utilities on how to improve the PMU recording practices to cater to the future ML applications aimed at automating the analysis of synchrophasor data.

Synchrophasors, Machine Learning, System-wide Even↗
DOE OSTI2023

Turbulence Modeling with Nek5000/RS, SOD2D and Alya

We present Validation and Verification (V & V) study of two high-order spectral element method (SEM) based Computational Fluid Dyanimcs (CFD) codes that we will utilize for work on turbulence modeling: Nek5000 and SOD2D. While the former solves the incompressible form of Navier-Stokes equation, the latter works with compressible set of equations and uses an entropy-viscosity formulation to account for the discontinuities for high Mach number flows. We demonstrate the accuracy of these codes for two benchmark sub-sonic turbulent flows: periodic channel and pipe flow, by carrying out first and second order statistical analysis, grid convergence and turbulent structure analysis using wall-resolved large eddy simulations (WRLES). Later, we report on the implementation and testing of various wall-modeling strategies for large eddy simulation of turbulent flows in Nek5000. These include both classical log-law based and decision-tree based machine-learning models. Accuracy of these closure strategies are analyzed and necessary future work is outlined.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

SULI Peer Review

Daniel Xing is a SULI intern whose project was titled: “An Improved Boosted Decision Tree Framework for Event Classification MicroBooNE” This is a physical subject that helps us understand how we can better model neutrinos. I do not study neutrinos, so listening to this talk was very formal.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Track vs Shower Discrimination in the Event Reconstruction of the ICARUS Experiment

The ICARUS collaboration has employed the 760-ton T600 liquid argon TPC detector in a successful three-year physics run at the underground LNGS laboratory, performing a sensitive search for LSND-like anomalous appearance in the CERN Neutrino to Gran Sasso beam, which contributed to the constraints on the allowed neutrino oscillation parameters to a narrow region around 1 eV. After a significant overhaul at CERN, the T600 detector has been installed at Fermilab. The detector commissioning phase lasted until June 2022, then ICARUS moved to data taking for neutrino oscillation physics collecting events from the Booster Neutrino Beam (BNB) and the Neutrinos at the Main Injector (NuMI) beam off-axis. The initial experiment goals are to either confirm or refute the claim by Neutrino-4 short-baseline reactor experiment, perform measurements of neutrino cross sections with the NuMI beam and several Beyond Standard Model searches. Then, ICARUS will jointly search for evidence of sterile neutrinos with the Short-Baseline Near Detector (SBND). In this contribution, we discuss recent changes to the standard TPC event reconstruction that uses Pandora, a pattern recognition software common to liquid argon-based detectors. In particular, we performed a new training of the Boosted Decision Tree (BDT) employed to separate track-like and shower-like reconstructed particles using Monte Carlo simulations of neutrino events from BNB in ICARUS. We compare the discrimination capabilities of the old and new BDT training and discuss further improvements of this algorithm.

43 PARTICLE ACCELERATORS↗
DOE OSTI2020

Progress Toward the First Search for Bound Neutron Oscillation into Antineutron in a Liquid Argon TPC

This note presents current progress for a neutron-antineutron oscillation ($n–\overline{n}$) search in MicroBooNE paving the way for the first search analysis of such process in a Liquid Argon Time Projection Chamber (LArTPC). Convolutional Neural Network (CNN) and Boosted Decision Tree (BDT) algorithms were used to select signal $n–\overline{n}$ events over cosmogenic backgrounds. The CNN-only, BDT-only, and the combined (CNN+BDT) methods were demonstrated on the Monte-Carlo signal and background events. Validation of the CNNonly and the BDT-only methods was carried out on a small dataset of MicroBooNE Run1 off-beam data, setting the starting point toward further improvement of the analysis.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Sensitivity of the MicroBooNE experiment to dark trident interactions

This note describes an ongoing search for dark tridents in the MicroBooNE detector. The dark trident interaction is a proposed interaction of sub-GeV dark matter with ordinary matter that would allow an exploration of a hidden dark sector composed of a dark scalar or fermion χ and a dark photon A'. This dark matter candidate can be produced at fixed-target neutrino beams such as the NuMI beam and travel uninterrupted to the MicroBooNE liquid argon detector. The interaction with the liquid argon occurs through the process χ + Ar → χ + Ar + A' where the dark photon promptly decays inside the detector through: A' → e + + e - . Two event selection strategies are explored, one using boosted decision trees and the other one applying a convolutional neural network. For both analyses a projected sensitivity in MicroBooNE after 2 × 10 21 protons on target is presented.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Logical Approach to Tritium Vacuum Pump Selection

Introduction Vacuum pumps are essential to the operation of tritium purification and recovery processes. However, not all vacuum pumps sold meet the requirements for tritium service. Manufacturers routinely do not fully appreciate the hazards associated with tritium, or the complex materials interactions. Therefore, a decision tree was established detailing which pump types, and certain manufacturers, are either fully compatible, limited use, or to avoid at all costs to establish a more structured and uniform approach to tritium vacuum pumps.

ANGELETTE, LUCAS↗
DOE OSTI2024

Geometric Measures of Trustworthiness for Machine Learning Predictions

his report details the findings from the research and investigation of Geometric Measures of Trustworthiness for Machine Learning Predictions. We explored the trustworthiness of machine learning (ML) models’ predictions using geometric measures to quantify the similarity of a query point with the training data. Predictive uncertainty in ML can originate from at least three sources: (1) Model uncertainty, which represents the uncertainty in model form (e.g. decision tree, vs neural network) and estimating the model parameters from the training data, (2) Data uncertainty, which represents the natural complexities of the data such as class overlap and inherent noise, and (3) Distributional uncertainty, which represents the mismatch between the training and operational distributions. The proposed measures focus on measuring and explaining the data and distributional uncertainties by measuring the relationships of operational data with the training data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Operational Forecasting of Induced Seismicity (CRADA Final Report)

This was a collaborative effort between Lawrence Livermore National Security, LLC ("LLNS"), as manager and operator of Lawrence Livermore National Laboratory ("LLNL"), The Regents of the University of California, as manager and operator of Lawrence Berkeley National Laboratory (Collectively, Contractors) and Nanometrics, Inc. ("Participant"), to develop a toolkit called "Operational Forecasting of Induced Seismicity (ORION)" that includes a decision tree method for operational forecasting of induced seismicity rates related to fluid disposal operations.

58 GEOSCIENCES↗
DOE OSTI2025

Connectivity Troubleshooting Guide for Advanced Electricity Meters

This guide is designed to walk users through a troubleshooting process for disconnected advanced electricity meters. The guide centers on two connectivity troubleshooting decision trees related to power issues and network connectivity issues, respectively. Additionally, it contains additional background information such as definitions, diagrams, and checklists that can help a user prepare to troubleshoot meter connectivity issues.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Exploring the Whole Set of Accurate Sparse Interpretable Models

In data science applications, there are often many models that fit the data well. This phenomenon was called the Rashomon Effect by Leo Breiman. The set of good models is called the Rashomon Set, and the goal of this project is to locate, store, and study the Rashomon sets for classes of interpretable models, including decision trees and generalized additive models.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Baseline Hypothetical Facility for the Production of 131 I and 99 Mo using Activation Targets

This report describes a hypothetical facility for production of medical radioisotopes via activation under the Proliferation Resistance and Optimization (PRO-X) program. The facility uses neutron activation of non-special nuclear material (SNM) to produce the medical isotopes 131 I and 99 Mo at a throughput of 60 Ci/week of 131 I and 5 Ci/week of 99 Mo. The hypothetical design was carried out using a 10 MWt research reactor. The precursors used for the activation process were TeO2 for 131 I and MoO 3 for 99 Mo. The processes are performed in 3 hot cells used for target receipt, extraction, purification low specific activity (LSA) generator introduction, and packaging. A fourth hotcell is used for waste processing. The hot cell processing area takes up a footprint of 15.4 m 2 with the total footprint of the facility, including space for administrative offices, non-rad labs, quality assurance, and radiation buffer areas set at 763 m 2 . Waste is produced at a weekly rate of 257.8 g low activity solid waste and 8032.7 mL of low activity liquid waste, 8032 mL of which is water. This baseline hypothetical facility for production of medical isotopes via activation was then compared and contrasted to the hypothetical facility for production of medical isotopes via fission products to show the differences in approach for the two production modes. The two production modes had several highlighted differences including the overall facility and hot cell layout, the type and amount of waste produced by the respective facilities, and economic factors impacting production mode. Finally, a decision tree for which production mode might be more beneficial for an entrant into medical isotope production was developed based on the differences examined and the desired output of medical isotopes desired by the entrant.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Machine Learning–Guided Boolean Matrix Inference for Real-Time O-RAN Conflict Detection

Open Radio Access Networks (O-RAN) are emerging, software-driven cellular architectures that promote flexibility by enabling components from different vendors to interoperate. Multiple control applications called xApps can independently adjust network parameters in near real time, often without awareness of each other's actions. This creates a system highly prone to unintended conflicts and performance degradation due to the inherent complexity of such openness. To model such systems and ultimately prevent or mitigate xApp conflicts, it is essential to understand the dynamic relationships between xApps (A), the control parameters they adjust (P), and the resulting KPI responses (K). While the mappings from A to P and from K to A can often be derived from xApp specifications, the relationship from P to K is typically hidden within the system’s dynamics and must be inferred from observed data. We propose a novel data-driven Boolean inference framework that uncovers the hidden P?K dependencies using machine learning and interpretable rule induction. Continuous parameters and KPIs are first binarized using decision tree classifiers, and a binary influence matrix L is then inferred by solving Boolean matrix equations over time. This compact representation improves interpretability and enables real-time tracking of dynamically evolving parameter-KPI dependencies. We demonstrate the effectiveness of our method in a realistic mobile handover scenario, where it accurately recovers the underlying logic and enables proactive conflict detection.

42 - ENGINEERING↗
DOE OSTI2026

Machine Learning-Based Anomaly Detection for PMT Data Quality Monitoring in the SBN and DUNE

Maintaining high-quality detector data is essential for achieving the scientific objectives of the Short-Baseline Neutrino (SBN) Program at Fermilab. Current data quality monitoring (DQM) procedures rely primarily on threshold-based metrics and manual inspection of detector monitoring plots, making the detection of subtle or gradually developing anomalies both time-consuming and dependent on expert interpretation. This project developed and evaluated a machine-learning workflow for automatically identifying anomalous photomultiplier tube (PMT) channels in the Short-Baseline Near Detector (SBND) using optical-hit amplitude data. A Python-based analysis program was developed to process ROOT files, extract statistical features describing individual PMT amplitude distributions, and generate feature vectors for anomaly detection. These features were used to train an Isolation Forest model using data representing normal detector operation. The trained model was subsequently applied to independent detector runs to identify channels exhibiting statistically unusual behavior relative to the learned reference response. To support expert interpretation, the workflow generated complementary diagnostic products, including anomaly score distributions, normalized amplitude comparisons, decision-tree visualizations, and principal component analysis (PCA) projections. This project demonstrated the feasibility of integrating unsupervised machine learning into detector data-quality monitoring and developed a complete workflow for automated PMT performance assessment to aid expert-driven review. Beyond its technical contributions, the VFP appointment fostered a research collaboration between Aurora University and Fermilab and provided direct workforce development benefits by training the visiting faculty member in detector-scale machine-learning methods that are now being incorporated into undergraduate coursework and research. The methodology developed here provides a foundation for future applications to ProtoDUNE and other liquid argon time projection chamber (LArTPC) detectors, contributing to ongoing efforts to improve detector reliability, reduce manual monitoring requirements, and enable scalable data quality monitoring for future large-scale neutrino experiments, including the Deep Underground Neutrino Experiment (DUNE).

Colón Santana, Juan A. [Unlisted, US, IL]↗
DOE OSTI2021

Predicting Metabolic Reaction Networks with Perturbation-Theory Machine Learning (PTML) Models

Background: Checking the connectivity (structure) of complex Metabolic Reaction Networks(MRNs) models proposed for new microorganisms with promising properties is an importantgoal for chemical biology. Objective: In principle, we can perform a hand-on checking (Manual Curation). However, this is achallenging task due to the high number of combinations of pairs of nodes (possible metabolic reactions). Results: The CPTML linear model obtained using the LDA algorithm is able to discriminate nodes(metabolites) with the correct assignation of reactions from incorrect nodes with values of accuracy,specificity, and sensitivity in the range of 85-100% in both training and external validation dataseries. Methods: In this work, we used Combinatorial Perturbation Theory and Machine Learning techniquesto seek a CPTML model for MRNs >40 organisms compiled by Barabasis’ group. First, wequantified the local structure of a very large set of nodes in each MRN using a new class of node indexcalled Markov linear indices fk. Next, we calculated CPT operators for 150000 combinationsof query and reference nodes of MRNs. Last, we used these CPT operators as inputs of differentML algorithms. Conclusion: Meanwhile, PTML models based on Bayesian network, J48-Decision Tree and RandomForest algorithms were identified as the three best non-linear models with accuracy greaterthan 97.5%. The present work opens the door to the study of MRNs of multiple organisms usingPTML models.

Pharmacology & Pharmacy↗
DOE OSTI2021

Application of Quantum Machine Learning to High Energy Physics Analysis at LHC using IBM Quantum Computer Simulators and IBM Quantum Computer Hardware

One of the major objectives of the experimental programs at the LHC is the discovery of new physics. This requires the identification of rare signals in immense backgrounds. Using machine learning algorithms greatly enhances our ability to achieve this objective. With the progress of quantum technologies, quantum machine learning could become a powerful tool for data analysis in high energy physics. In this study, using IBM gate-model quantum computing systems, we employ the quantum variational classifier method and the quantum kernel estimator method in two recent LHC flagship physics analyses: $t\bar{t}H$ (Higgs boson production in association with a top quark pair) and $H\rightarrow\mu\mu$ (Higgs boson decays to two muons). We have obtained early results with 10 qubits on the IBM quantum simulator and the IBM quantum hardware. On the quantum simulator, the quantum machine learning methods perform similarly to classical algorithms such as SVM (support vector machine) and BDT (boosted decision tree), which are often employed in LHC physics analyses. On the quantum hardware, the quantum machine learning methods have shown promising discrimination power, comparable to that on the quantum simulator. This study demonstrates that quantum machine learning has the ability to differentiate between signal and background in realistic physics datasets.

Chan, Jay↗
DOE OSTI2021

Using Machine Learning for Quantum Annealing Accuracy Prediction

Quantum annealers, such as the device built by D-Wave Systems, Inc., offer a way to compute solutions of NP-hard problems that can be expressed in Ising or quadratic unconstrained binary optimization (QUBO) form. Although such solutions are typically of very high quality, problem instances are usually not solved to optimality due to imperfections of the current generations quantum annealers. In this contribution, we aim to understand some of the factors contributing to the hardness of a problem instance, and to use machine learning models to predict the accuracy of the D-Wave 2000Q annealer for solving specific problems. We focus on the maximum clique problem, a classic NP-hard problem with important applications in network analysis, bioinformatics, and computational chemistry. By training a machine learning classification model on basic problem characteristics such as the number of edges in the graph, or annealing parameters, such as the D-Wave’s chain strength, we are able to rank certain features in the order of their contribution to the solution hardness, and present a simple decision tree which allows to predict whether a problem will be solvable to optimality with the D-Wave 2000Q. We extend these results by training a machine learning regression model that predicts the clique size found by D-Wave.

97 MATHEMATICS AND COMPUTING↗