Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “decision trees”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Three-dimensional object recognition using similar triangles and decision trees

A system, TRIDEC, that is capable of distinguishing between a set of objects despite changes in the objects' positions in the input field, their size, or their rotational orientation in 3D space is described. TRIDEC combines very simple yet effective features with the classification capabilities of inductive decision tree methods. The feature vector is a list of all similar triangles defined by connecting all combinations of three pixels in a coarse coded 127 x 127 pixel input field. The classification is accomplished by building a decision tree using the information provided from a limited number of translated, scaled, and rotated samples. Simulation results are presented which show that TRIDEC achieves 94 percent recognition accuracy in the 2D invariant object recognition domain and 98 percent recognition accuracy in the 3D invariant object recognition domain after training on only a small sample of transformed views of the objects.

Spirkovska, Lilly↗

Using decision-tree classifier systems to extract knowledge from databases

One difficulty in applying artificial intelligence techniques to the solution of real world problems is that the development and maintenance of many AI systems, such as those used in diagnostics, require large amounts of human resources. At the same time, databases frequently exist which contain information about the process(es) of interest. Recently, efforts to reduce development and maintenance costs of AI systems have focused on using machine learning techniques to extract knowledge from existing databases. Research is described in the area of knowledge extraction using a class of machine learning techniques called decision-tree classifier systems. Results of this research suggest ways of performing knowledge extraction which may be applied in numerous situations. In addition, a measurement called the concept strength metric (CSM) is described which can be used to determine how well the resulting decision tree can differentiate between the concepts it has learned. The CSM can be used to determine whether or not additional knowledge needs to be extracted from the database. An experiment involving real world data is presented to illustrate the concepts described.

St.clair, D. C.↗

Learning from examples - Generation and evaluation of decision trees for software resource analysis

A general solution method for the automatic generation of decision (or classification) trees is investigated. The approach is to provide insights through in-depth empirical characterization and evaluation of decision trees for software resource data analysis. The trees identify classes of objects (software modules) that had high development effort. Sixteen software systems ranging from 3,000 to 112,000 source lines were selected for analysis from a NASA production environment. The collection and analysis of 74 attributes (or metrics), for over 4,700 objects, captured information about the development effort, faults, changes, design style, and implementation style. A total of 9,600 decision trees were automatically generated and evaluated. The trees correctly identified 79.3 percent of the software modules that had high development effort or faults, and the trees generated from the best parameter combinations correctly identified 88.4 percent of the modules on the average.

Selby, Richard W.↗

ArborZ: PHOTOMETRIC REDSHIFTS USING BOOSTED DECISION TREES

Precision photometric redshifts will be essential for extracting cosmological parameters from the next generation of wide-area imaging surveys. In this paper, we introduce a photometric redshift algorithm, ArborZ, based on the machine-learning technique of boosted decision trees. We study the algorithm using galaxies from the Sloan Digital Sky Survey (SDSS) and from mock catalogs intended to simulate both the SDSS and the upcoming Dark Energy Survey. We show that it improves upon the performance of existing algorithms. Moreover, the method naturally leads to the reconstruction of a full probability density function (PDF) for the photometric redshift of each galaxy, not merely a single 'best estimate' and error, and also provides a photo-z quality figure of merit for each galaxy that can be used to reject outliers. We show that the stacked PDFs yield a more accurate reconstruction of the redshift distribution N(z). We discuss limitations of the current algorithm and ideas for future work.

79 ASTRONOMY AND ASTROPHYSICS↗

Development of heavy-duty vehicle representative driving cycles via decision tree regression

Previously, researchers who developed representative driving cycles mainly focused on light-duty vehicles and only considered vehicle speed and related derivations. In this paper, we propose a novel approach to develop representative cycles for heavy-duty vehicles. By implementing decision tree regression (DTR) to the Fleet DNA on-road vehicle data, a broader set of metrics, such as engine power and fuel consumption, can be used for more robust cycle development. Additionally, the influence of each metric on the regression target is also accounted for by a weighted number derived through the DTR to enhance the representativenss of the developed cycle. As case studies, we applied the proposed method to five heavy-duty vocations (drayage, long haul, regional haul, local delivery, and transit bus) and derived the most representative cycle, as well as four extreme cycles (maximal energy consumption, maximal power-weighted work, maximal fraction of high speed, and minimal fuel economy) to advance the related alternative powertrain design.

33 ADVANCED PROPULSION SYSTEMS↗

Hyperplane decision trees as piecewise linear surrogate models for chemical process design

Recent trends in chemical engineering research point towards an increasing reliance on data-driven modeling approaches. Neural networks, for instance, have proven to be accurate when data is plentiful and high-dimensional, but in many cases, they require computationally-intensive training procedures. Here, in this work, we describe hyperplane decision trees (HT) as a highly expressive and low-compute machine learning model architecture. These models are locally linear and have linear decision boundaries, resulting in a piecewise linear model of the data. This property allows them to be converted into mixed-integer linear constraints which can be globally optimized. Our open-source PyTorch implementation of this method is a fast, flexible, and accessible way to build accurate piecewise linear models of data.

Decision trees↗

A method of building of decision trees based on data from wearable device during a rehabilitation of patients with tibia fractures

Nowadays technologies which are used in traumatology are a combination of mechanical, electronic, calculating and programming tools. Relevance of development of mobile applications for an expeditious data processing which are received from medical devices (in particular, wearable devices), and formulation of management decisions increases. Using of a mathematical method of building of decision trees for an assessment of a patient’s health condition using data from a wearable device considers in this article.

97 MATHEMATICS AND COMPUTING↗

Decision Trees for Analysis of Strategies to Deter Limited Nuclear Use in a Generic Scenario

We assert that analysis of a decision tree model can reveal key insights for deterring limited nuclear use in a conventional conflict. To illustrate the method, we develop a decision analysis model to explore the choices an attacker would make and how they can be influenced by his perceptions of the defender’s capabilities and potential responses. Sensitivity analysis with the model can provide insights into strategies and actions the defender might take in order to influence the choices the attacker would make. This methodology is widely applicable and could provide insight into a variety of scenarios.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Decision Tree Based Anomaly Detection for Remedial Action Scheme in Smart Grid using PMU Data

The advanced and persistent cyber threats facing the critical infrastructure such as the smart grid are exponentially rising which require sophisticated defense strategy. Remedial Action Scheme (RAS), also known as Special Protection Scheme (SPS), relies on the interconnected cyber physical system for automated protection which is exposed to the multitude of vulnerabilities. In this paper, we propose an innovative approach to develop an Intelligent Remedial Action Scheme (IRAS) which can detect and distinguish cyber attacks from the physical disturbances in smart grid and later take smart corrective actions as required to minimize the impact on system reliability and economy. Specifically, we have proposed the decision tree based anomaly detection methodology which can distinguish between the normal tripping during power line faults and malicious tripping attack on the physical relays in the context of RAS. The classification model is developed using differential features of voltage and current phasors. Next, as a proof of concept, we have implemented and validated the proposed methodology in cyber physical environment at Iowa State's PowerCyber testbed. Finally, the proposed methodology is tested on modified IEEE 39 bus system in offline and real-time mode. Our experimental results show that the proposed method is efficient in detecting attacks and performing corrective actions within an acceptable time frame.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Decision Tree Regression to Identify Representative Road Sections for Evaluating Performance of Connected and Automated Class 8 Tractors

Currently, connected and autonomous vehicle (CAV) technology is being developed for Class 8 tractor trucks aimed at improved safety and fuel economy and reduced CO2 emissions. Despite extensive efforts conducted across the world, the reported efficiency gains were varied from different research groups, raising concerns about the fidelity of models, the performance of control, and the effectiveness of the experimental validation. One root cause for this variation stems from the fact that the efficiency gain obtained from the CAV is sensitive to real-world conditions, including surrounding traffic and road grade. This study presents an approach aimed at identifying representative public road sections and facilitating CAV research from this perspective. By employing the decision tree regression (DTR) method to the Fleet DNA database, the most representative road sections can be identified. High-level metrics and detailed information of the derived road sections are also illustrated and discussed, which demonstrate their representativeness and the effectiveness of the approach. Meanwhile, the capability of this approach can be easily extended by integrating specific constraints into the DTR algorithm. As an example, a specific representative road section with an aggressive road grade profile was also provided via this approach.

27 ARPA - Advanced Research Projects Agency-Energy↗

Measurement of single top quark production in the tau+jets channnel using boosted decision trees at D0

The top quark is the heaviest known matter particle and plays an important role in the Standard Model of particle physics. At hadron colliders, it is possible to produce single top quarks via the weak interaction. This allows a direct measurement of the CKM matrix element V tb and serves as a window to new physics. The first direct measurement of single top quark production with a tau lepton in the final state (the tau+jets channel) is presented in this thesis. The measurement uses 4.8 fb -1 of Tevatron Run II data in p$\bar{p}$ collisions at √s = 1.96 TeV acquired by the D0 experiment. After selecting a data sample and building a background model, the data and background model are in good agreement. A multivariate technique, boosted decision trees, is employed in discriminating the small single top quark signal from a large background. The expected sensitivity of the tau+jets channel in the Standard Model is 1.8 standard deviations. Using a Bayesian statistical approach, an upper limit on the cross section of single top quark production in the tau+jets channel is measured as 7.3 pb at 95% confidence level, and the cross section is measured as 3.4 -1.8 +2.0 pb. The result of the single top quark production in the tau+jets channel is also combined with those in the electron+jets and muon+jets channels. The expected sensitivity of the electron, muon and tau combined analysis is 4.7 standard deviations, to be compared to 4.5 standard deviations in electron and muon alone. The measured cross section in the three combined final states is σ(p$\bar{p}$ → tb + X,tqb + X) = 3.84 -0.83 +0.89 pb. A lower limit on |V tb | is also measured in the three combined final states to be larger than 0.85 at 95% confidence level. These results are consistent with Standard Model expectations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Top Quark Produced Through the Electroweak Force: Discovery Using the Matrix Element Analysis and Search for Heavy Gauge Bosons Using Boosted Decision Trees

The top quark produced through the electroweak channel provides a direct measurement of the V tb element in the CKM matrix which can be viewed as a transition rate of a top quark to a bottom quark. This production channel of top quark is also sensitive to different theories beyond the Standard Model such as heavy charged gauged bosons termed W'. This thesis measures the cross section of the electroweak produced top quark using a technique based on using the matrix elements of the processes under consideration. The technique is applied to 2.3 fb -1 of data from the D0 detector. From a comparison of the matrix element discriminants between data and the signal and background model using Bayesian statistics, we measure the cross section of the top quark produced through the electroweak mechanism σ(p$\bar{p}$ → tb + X, tqb + X) = 4.30 -1.20 +0.98 pb. The measured result corresponds to a 4.9σ Gaussian-equivalent significance. By combining this analysis with other analyses based on the Bayesian Neural Network (BNN) and Boosted Decision Tree (BDT) method, the measured cross section is 3.94 ± 0.88 pb with a significance of 5.0σ, resulting in the discovery of electroweak produced top quarks. Using this measured cross section and constraining |V tb | < 1, the 95% confidence level (C.L.) lower limit is |V tb | > 0.78. Additionally, a search is made for the production of W' using the same samples from the electroweak produced top quark. An analysis based on the BDT method is used to separate the signal from expected backgrounds. No significant excess is found and 95% C.L. upper limits on the production cross section are set for W' with masses within 600-950 GeV. For four general models of W{prime} boson production using decay channel W' → t$\bar{p}$, the lower mass limits are the following: M(W' L with SM couplings) > 840 GeV; M(W' R ) > 880 GeV or 890 GeV if the right-handed neutrino is lighter or heavier than W{prime}{sub R}; and M(W' L+R ) > 915 GeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

LeptonJet Categorization with Decision Tree

With much evidence for dark matter arising from astronomical observations, particle physics has also begun to look for dark matter candidates. Here, a boosted decision tree machine learning algorithm (BDT) is used to distinguish signal from background in a search for self-interacting dark matter at CMS with two different final states of signal. The signal final states are two displaced collimated pairs of leptons (leptonJets). In this project, possible improvements to the BDT are explored. Various methods of signal separation are studied, as well as various accuracy metrics to study and compare the different models. Through the separated models and improvements in training, a slight increase in accuracy score was obtained (0.01% on electrons, 0.46% on muons). Additionally, the separated models were able to recognize a significantly increased percentage of signal, particularly against the electron signal. Separated models are being considered as part of the larger an alysis.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Nanosecond anomaly detection with decision trees and real-time application to exotic Higgs decays

Abstract We present an interpretable implementation of the autoencoding algorithm, used as an anomaly detector, built with a forest of deep decision trees on FPGA, field programmable gate arrays. Scenarios at the Large Hadron Collider at CERN are considered, for which the autoencoder is trained using known physical processes of the Standard Model. The design is then deployed in real-time trigger systems for anomaly detection of unknown physical processes, such as the detection of rare exotic decays of the Higgs boson. The inference is made with a latency value of 30 ns at percent-level resource usage using the Xilinx Virtex UltraScale+ VU9P FPGA. Our method offers anomaly detection at low latency values for edge AI users with resource constraints.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Boosted decision tree reweighting of simulated neutrino interactions for O ( 1 ) GeV neutrino cross-section measurements

This paper illustrates a generic method for multidimensional reweighting of O ( 1 ) GeV neutrino interaction Monte Carlo samples. The reweighting is based on a boosted decision tree algorithm trained on high-dimensional space in detector final-state observables. This enables one generator’s events to be reweighted so that its reconstructed particle content and kinematics distributions, as well as detector efficiency, match those of a target model. The approach establishes an efficient way to reuse legacy Monte Carlo data, avoiding regeneration. As an example, we test its use in a measurement of transverse kinematic imbalance of the μ - and proton in charged-current quasielastic like ν μ events from the MINERvA experiment.

Lin, Z. [Rochester U.] (ORCID:0009000188903698)↗

FEMP Facility Evaluation (Audit) Decision Tree

This document is a resource to be used in concert with FEMP Audit Definitions, FEMP Consolidated Facility Management Guidance, and agency best practices and expert judgment—for agencies to use to determine the best approaches to evaluate their facilities. It features a decision tree that provides a framework for agencies to interpret gathered facility data to understand the existing conditions; benchmark the facility against others in the portfolio to determine whether an on-site or remote audit is appropriate for a facility; determine the best remote or on-site audit level of detail to meet agency facility auditing goals, such as meeting Energy Independence and Security Act of 2007 requirements and developing projects; and improve their energy and water management programs.

auditing↗