Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “decision trees”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

A Software Framework for Comparing Training Approaches for Spiking Neuromorphic Systems

There are a wide variety of training approaches for spiking neural networks for neuromorphic deployment. However, it is often not clear how these training algorithms perform or compare when applied across multiple neuromorphic hardware platforms and multiple datasets. In this work, we present a software framework for comparing performance across four neuromorphic training algorithms across three neuromorphic simulators and four simple classification tasks. We introduce an approach for training a spiking neural network using a decision tree, and we compare this approach to training algorithms based on evolutionary algorithms, back-propagation, and reservoir computing. We present a hyperparameter optimization approach to tune the hyperparameters of the algorithm, and show that these optimized hyperparameters depend on the processor, algorithm, and classification task. Finally, we compare the performance of the optimized algorithms across multiple metrics, including accuracy, training time, and resulting network size, and we show that there is not one best training algorithm across all datasets and performance metrics.

Schuman, Catherine↗

Evaluation of Anomaly Detection for Wide-Area Protection Using Cyber Federation Testbed

Cyber physical security research for smart grid is currently one of the nation's top R&D priorities. The existing vulnerabilities in the legacy grid infrastructure make it particularly susceptible to countless cyber-attacks. There is a growing emphasis towards building interconnected, sophisticated federated testbeds to perform realistic experiments by allowing the integration of geographically-dispersed resources in the dynamic cyber-physical environment. In this paper, we present a cyber (network) based federation testbed to validate the performance of an anomaly detector in context of a Wide Area Protection (WAP) security. Specifically, we have utilized the resources available at the Iowa State University Power Cyber (ISU PCL) Laboratory to emulate the substation and local center networks; and the US Army Research Laboratory (ARL); to emulate the regional control center network. Initially, we describe a hardware-in-the loop based experimental setup for implementing data integrity attacks on an IEEE 39 bus system. We then perform network packet analysis focusing on latency and bandwidth as well as evaluate the performance of a decision tree based anomaly detector in measuring its ability to identify different attacks. Our experimental results reveal the computed wide area network latency; bandwidth requirement for minimum packet loss; and successful performance of the anomaly detector. Our studies also highlight the conceptual architecture necessary for developing the federated testbed, inspired by the NASPI network.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Low Activity Tritium Detection in CCDs Using Deep Learning Techniques

Here, this study explores the use of charge-coupled devices (CCDs) for detecting low-energy beta particles from tritium decay - a critical signal for nuclear safety, nuclear nonproliferation, and environmental monitoring. We employ a dual approach utilizing both measured CCD data and detailed Geant4 simulations. Our analysis compares classical techniques with advanced deep learning methods, including convolutional neural networks (CNNs), autoencoders trained exclusively on tritium data, and preliminary studies on boosted decision trees (BDTs). The CNN, trained on mixed signal/background datasets, demonstrates superior classification performance, while the autoencoder shows the potential of unsupervised, background-agnostic strategies when background characteristics are poorly defined. These results highlight the excellent sensitivity achievable thanks to the background rejection made possible by information-rich CCD data, paving the way for improved portable tritium monitoring.

Autoencoder↗

A Machine Learning Initializer for Newton-Raphson AC Power Flow Convergence

Power flow computations are fundamental to many power system studies. Obtaining a converged power flow case is not a trivial task especially in large power grids due to the non-linear nature of the power flow equations. One key challenge is that the widely used Newton based power flow methods are sensitive to the initial voltage magnitude and angle estimates, and a bad initial estimate would lead to non-convergence. This paper addresses this challenge by developing a random-forest (RF) machine learning model to provide better initial voltage magnitude and angle estimates towards achieving power flow convergence. This method was implemented on a real ERCOT 6102 bus system under various operating conditions. By providing better Newton-Raphson initialization, the RF model precipitated the solution of 2,106 cases out of 3,899 non-converging dispatches. These cases could not be solved from flat start or by initialization with the voltage solution of a reference case. Finally, results obtained from the RF initializer performed better when compared with DC power flow initialization, Linear regression, and Decision Trees.

random forest↗

Detection and Diagnosis of Data Integrity Attacks in Solar Farms Based on Multilayer Long Short-Term Memory Network

Photovoltaic (PV) systems are becoming more vulnerable to cyber threats. In response to this emerging concern, developing cyber-secure power electronics converters has received increased attention from the IEEE Power Electronics Society that recently launched a cyber-physical-security initiative. Here this letter proposes a deep sequence learning based diagnosis solution for data integrity attacks on PV systems in smart grids, including dc–dc and dc–ac converters. The multilayer long short-term memory networks are used to leverage time-series electric waveform data from current and voltage sensors in PV systems. The proposed method has been evaluated in a PV smart grid benchmark model with extensive quantitative analysis. As a comparison, we have evaluated classic data-driven methods, including K-nearest neighbor, decision tree, support vector machine, artificial neural network, and convolutional neural network. Comparison results verify performances of the proposed method for detection and diagnosis of various data integrity attacks on PV systems.

42 ENGINEERING↗

Situational Awareness in Distribution Grid Using Micro-PMU Data: A Machine Learning Approach

The recent development of distribution-level phasor measurement units, a.k.a. micro-PMUs, has been an important step towards achieving situational awareness in power distribution networks. The challenge however is to transform the large amount of data that is generated by micro-PMUs to actionable information and then match the information to use cases with practical value to system operators. This open problem is addressed in this paper. First, we introduce a novel data-driven event detection technique to pick out valuable portion of data from extremely large raw micro-PMU data. Subsequently, a datadriven event classifier is developed to effectively classify power quality events. Importantly, we use field expert knowledge and utility records to conduct an extensive data-driven event labeling. Moreover, certain aspects from event detection analysis are adopted as additional features to be fed into the classifier model. In this regard, a multi-class support vector machine (multi-SVM) classifier is trained and tested over 15 days of real-world data from two micro-PMUs on a distribution feeder in Riverside, CA. In total, we analyze 1.2 billion measurement points, and 10,700 events. Here, the effectiveness of the developed event classifier is compared with prevalent multi-class classification methods, including k-nearest neighbor method as well as decision-tree method. Importantly, two real-world use-cases are presented for the proposed data analytics tools, including remote asset monitoring and distribution-level oscillation analysis.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Static Detection of Disassembly Errors

Static disassembly is a crucial first step in reverse engineering executable files, and there is a consider- able body of work in reverse-engineering of binaries, as well as areas such as semantics-based security anal- ysis, that assumes that the input executable has been correctly disassembled. However, disassembly errors, e.g., arising from binary obfuscations, can render this assumption invalid. This work describes a machine- learning-based approach, using decision trees, for stat- ically identifying possible errors in a static disassem- bly; such potential errors may then be examined more closely, e.g., using dynamic analyses. Experimental re- sults using a variety of input executables indicate that our approach performs well, correctly identifying most disassembly errors with relatively few false positives.

97 MATHEMATICS AND COMPUTING↗

Recent increases in annual, seasonal, and extreme methane fluxes driven by changes in climate and vegetation in boreal and temperate wetland ecosystems

Climate warming is expected to increase global methane (CH 4 ) emissions from wetland ecosystems. Although in situ eddy covariance (EC) measurements at ecosystem scales can potentially detect CH 4 flux changes, most EC systems have only a few years of data collected, so temporal trends in CH 4 remain uncertain. Here, we use established drivers to hindcast changes in CH 4 fluxes (FCH 4 ) since the early 1980s. We trained a machine learning (ML) model on CH 4 flux measurements from 22 [methane-producing sites] in wetland, upland, and lake sites of the FLUXNET-CH 4 database with at least two full years of measurements across temperate and boreal biomes. The gradient boosting decision tree ML model then hindcasted daily FCH 4 over 1981-2018 using meteorological reanalysis data. We found that, mainly driven by rising temperature, half of the sites (n = 11) showed significant increases in annual, seasonal, and extreme FCH 4 , with increases in FCH 4 of ca. 10% or higher found in the fall from 1981–1989 to 2010–2018. The annual trends were driven by increases during summer and fall, particularly at high-CH 4 -emitting fen sites dominated by aerenchymatous plants. We also found that the distribution of days of extremely high FCH 4 (defined according to the 95th percentile of the daily FCH 4 values over a reference period) have become more frequent during the last four decades and currently account for 10–40% of the total seasonal fluxes. The share of extreme FCH 4 days in the total seasonal fluxes was greatest in winter for boreal/taiga sites and in spring for temperate sites, which highlights the increasing importance of the non-growing seasons in annual budgets. Our results shed light on the effects of climate warming on wetlands, which appears to be extending the CH 4 emission seasons and boosting extreme emissions.

54 ENVIRONMENTAL SCIENCES↗

Using Machine Learning to Analyze Factors Determining Cycle-to-Cycle Variation in a Spark-Ignited Gasoline Engine

In this work, we have applied a machine learning (ML) technique to provide insights into the causes of cycle-to-cycle variation (CCV) in a gasoline spark-ignited (SI) engine. The analysis was performed on a set of large eddy simulation (LES) calculations of a single cylinder of a four-cylinder port-fueled SI engine. The operating condition was stoichiometric, without significant knock, at a load of 16 bar brake mean effective pressure (BMEP), at an engine speed of 2500 revolutions per minute. A total of 123 cycles was simulated. Of these, 49 were run in sequence, while 74 were run in parallel. For the parallel approach, each cycle is initialized with its own synthetic turbulent field to generate CCV, as part of another work performed by us. In the current work, we used 3D information from all 123 cycles to compute flame topology and pre-ignition flow-field metrics. We then evaluated correlations between these metrics, and peak cylinder pressure (PCP) employing an ML technique called random forest. The computed metrics form the inputs to the random forest model, and PCP is the output. This model captures the effect of all inputs, as well as interactions between them owing to its decision-tree structure. The goal of this work is to demonstrate (as a first step) that ML models can implicitly learn complex relationships between pre-ignition flow-fields, flame shapes, and the eventual outcome of the cycle (whether a cycle will be a high or a low cycle).

42 ENGINEERING↗

Gunnar uranium mine environmental remediation - Northern Saskatchewan

The Gunnar Mine and mill site was the largest of some 38 now-abandoned uranium mines that were developed and operated in Northern Saskatchewan, Canada, during the Cold War years. During their operating lifetimes these mines produced large quantities of ore and tailings. The Gunnar mine (open pit and underground) produced over 5 million tonnes of uranium ore and nearly 4.4 million tonnes of mine tailings during its operations from 1955 through 1963. An estimated 2.2 to 2.7 million m{sup 3} of waste rock that was generated during the processing of the ore abuts the shores of Lake Athabasca, the 22. largest lake in the world. After closure in the 1960's, the Gunnar site was abandoned with little to no decommissioning being done. The Saskatchewan Research Council has been contracted to manage the clean-up of these abandoned northern uranium mine and mill sites. The Gunnar Mine, because of the magnitude of tailings and waste rock, is subject to an environmental site assessment process regulated by both provincial and federal governments. This process requires a detailed study of the environmental impacts that have resulted from the mining activities and an analysis of projected impacts from remediation efforts. The environmental assessment process, specific site studies, and public involvement initiatives are all now well underway. Due to the many uncertainties associated with an abandoned site, an adaptive remediation approach, utilizing a decision tree, presented within the environmental assessment documents will be used as part of the site regulatory licensing. A critical early task was dealing with major public safety hazards on the site. The site originally included many buildings that were remnants of a community of approximately 800 people who once occupied the site. These buildings, many of which contained high levels of asbestos, had to be appropriately abated and demolished. Similarly, the original mine head frame and mill site buildings, many of which still contained the original machinery and equipment, also had to be dismantled. Remediation options for the accumulated demolition debris have been assessed, as have remediation options for the waste rock and tailings, all of which form part of the environmental assessment. The regulatory requirements include the environmental assessment processes, a complex public involvement strategy, and licensing from the Canadian Nuclear Safety Commission (CNSC) with the long-term goal of releasing the property in a remediated and stable state to the Province of Saskatchewan. Prescribed environmental and land use endpoints will be determined based on the environmental assessment studies and remediation options analyzed and implemented. Ultimately, the site will be released into an institutional controls program that will allow long-term government management and monitoring. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

TU-FG-201-11: Evaluating the Validity of Prospective Risk Analysis Methods: A Comparison of Traditional FMEA and Modified Healthcare FMEA

Purpose: To examine the ability of traditional Failure mode and effects analysis (FMEA) and a light version of Healthcare FMEA (HFMEA), called Scenario analysis of FMEA (SAFER) by comparing their outputs in terms of the risks identified and their severity rankings. Methods: We applied two prospective methods of the quality management to surface image guided, linac-based radiosurgery (SIG-RS). For the traditional FMEA, decisions on how to improve an operation are based on risk priority number (RPN). RPN is a product of three indices: occurrence, severity and detectability. The SAFER approach; utilized two indices-frequency and severity-which were defined by a multidisciplinary team. A criticality matrix was divided into 4 categories; very low, low, high and very high. For high risk events, an additional evaluation was performed. Based upon the criticality of the process, it was decided if additional safety measures were needed and what they comprise. Results: Two methods were independently compared to determine if the results and rated risks were matching or not. Our results showed an agreement of 67% between FMEA and SAFER approaches for the 15 riskiest SIG-specific failure modes. The main differences between the two approaches were the distribution of the values and the failure modes (No.52, 54, 154) that have high SAFER scores do not necessarily have high FMEA RPN scores. In our results, there were additional risks identified by both methods with little correspondence. In the SAFER, when the risk score is determined, the basis of the established decision tree or the failure mode should be more investigated. Conclusion: The FMEA method takes into account the probability that an error passes without being detected. SAFER is inductive because it requires the identification of the consequences from causes, and semi-quantitative since it allow the prioritization of risks and mitigation measures, and thus is perfectly applicable to clinical parts of radiotherapy.

60 APPLIED LIFE SCIENCES↗

A bacterial sensor taxonomy across earth ecosystems for machine learning applications

Microbial communities have evolved to colonize all ecosystems of the planet, from the deep sea to the human gut. Microbes survive by sensing, responding, and adapting to immediate environmental cues. This process is driven by signal transduction proteins such as histidine kinases, which use their sensing domains to bind or otherwise detect environmental cues and “transduce” signals to adjust internal processes. We hypothesized that an ecosystem’s unique stimuli leave a sensor “fingerprint,” able to identify and shed insight on ecosystem conditions. To test this, we collected 20,712 publicly available metagenomes from Host-associated, Environmental, and Engineered ecosystems across the globe. We extracted and clustered the collection’s nearly 18M unique sensory domains into 113,712 similar groupings with MMseqs2. We built gradient-boosted decision tree machine learning models and found we could classify the ecosystem type (accuracy: 87%) and predict the levels of different physical parameters (R2 score: 83%) using the sensor cluster abundance as features. Feature importance enables identification of the most predictive sensors to differentiate between ecosystems which can lead to mechanistic interpretations if the sensor domains are well annotated. To demonstrate this, a machine learning model was trained to predict patient’s disease state and used to identify domains related to oxygen sensing present in a healthy gut but missing in patients with abnormal conditions. Moreover, since 98.7% of identified sensor domains are uncharacterized, importance ranking can be used to prioritize sensors to determine what ecosystem function they may be sensing. Furthermore, these new predictive sensors can function as targets for novel sensor engineering with applications in biotechnology, ecosystem maintenance, and medicine.

97 MATHEMATICS AND COMPUTING↗

Machine Learning Leveraging Genomes from Metagenomes Identifies Influential Antibiotic Resistance Genes in the Infant Gut Microbiome

Antibiotic resistance in pathogens is extensively studied, and yet little is known about how antibiotic resistance genes of typical gut bacteria influence microbiome dynamics. Here, we leveraged genomes from metagenomes to investigate how genes of the premature infant gut resistome correspond to the ability of bacteria to survive under certain environmental and clinical conditions. We found that formula feeding impacts the resistome. Random forest models corroborated by statistical tests revealed that the gut resistome of formula-fed infants is enriched in class D beta-lactamase genes. Interestingly, Clostridium difficile strains harboring this gene are at higher abundance in formula-fed infants than C. difficile strains lacking this gene. Organisms with genes for major facilitator superfamily drug efflux pumps have higher replication rates under all conditions, even in the absence of antibiotic therapy. Using a machine learning approach, we identified genes that are predictive of an organism’s direction of change in relative abundance after administration of vancomycin and cephalosporin antibiotics. The most accurate results were obtained by reducing annotated genomic data to five principal components classified by boosted decision trees. Among the genes involved in predicting whether an organism increased in relative abundance after treatment are those that encode subclass B2 beta-lactamases and transcriptional regulators of vancomycin resistance. This demonstrates that machine learning applied to genome-resolved metagenomics data can identify key genes for survival after antibiotics treatment and predict how organisms in the gut microbiome will respond to antibiotic administration.

59 BASIC BIOLOGICAL SCIENCES↗

Pulse shape discrimination technique for diffuse supernova neutrino background search with JUNO

Pulse shape discrimination (PSD) is widely used in particle and nuclear physics. Specifically in liquid scintillator detectors, PSD facilitates the classification of different particle types based on their energy deposition patterns. This technique is particularly valuable for studies of the diffuse supernova neutrino background (DSNB), nucleon decay, and dark matter searches. This paper presents a detailed investigation of the PSD technique, applied in the DSNB search performed with the Jiangmen Underground Neutrino Observatory (JUNO). Instead of using conventional cut-and-count methods, we employ methods based on boosted decision trees and neural networks and compare their capability to distinguish the DSNB signals from the atmospheric neutrino neutral-current background events. The two methods demonstrate comparable performance, resulting in a 50–80% improvement in signal efficiency compared to a previous study performed for JUNO (An et al. [JUNO] in J Phys G 43(3):030401, 2016). Moreover, we study the dependence of the PSD performance on the visible energy and final state composition of the events and find a significant dependence on the presence/absence of 11 C. Finally, we evaluate the impact of the detector effects (photon propagation, PMT dark noise, and waveform reconstruction) on the PSD performance.

FOS: Physical sciences↗

Reconstruction and identification of pairs of collimated τ-leptons decaying hadronically using s=13 TeV pp collision data with the ATLAS detector

This paper describes an algorithm for reconstructing and identifying a highly collimated hadronically decaying τ$$\tau $$-lepton pair with low transverse momentum. When two τ$$\tau $$-leptons are highly collimated, their visible decay products might overlap, degrading the reconstruction performance for each of the τ$$\tau $$-leptons. A dedicated treatment attempting to tag the τ$$\tau $$-lepton pair as a single object is required. The reconstruction algorithm is based on a large radius jet and its associated two leading subjets, and the identification uses a boosted decision tree to discriminate between signatures from τ+τ-$$\tau ^+\tau ^-$$ systems and those arising from QCD jets. The efficiency of the identification algorithm is measured in Zγ$$Z\gamma $$ events using proton–proton collision data at s=13$$\sqrt{s}=13$$ TeV collected by the ATLAS experiment at the Large Hadron Collider between 2015 and 2018, corresponding to an integrated luminosity of 139fb-1$$139\,\text{ fb}^{-1}$$. The resulting data-to-simulation scale factors are close to unity with uncertainties ranging from 26 to 37%.

Aad, G↗

Measuring the electron Yukawa coupling via resonant s-channel Higgs production at FCC-ee

The Future Circular Collider (FCC-ee) offers the unique opportunity of studying the Higgs Yukawa coupling to the electron, \(y_\mathrm {e}\) , via resonant s -channel production, \(\mathrm {e^+e^-}\rightarrow \mathrm {H}\) , in a dedicated run at \(\sqrt{s} = m_\mathrm {H}\) . The signature for direct Higgs production is a small rise in the cross sections for particular final states, consistent with Higgs decays, over the expectations for their occurrence due to Standard Model (SM) background processes involving \(\mathrm {Z}^*\) , \(\gamma ^*\) , or t -channel exchanges alone. Performing such a measurement is remarkably challenging for four main reasons. First, the low value of the e \(^\pm \) mass leads to a tiny \(y_\mathrm {e}\) coupling and correspondingly small cross section: \(\sigma _\mathrm {ee\rightarrow H} \propto m_\mathrm {e}^2 = 0.57\) fb accounting for initial-state \(\gamma \) radiation. Second, the \(\mathrm {e^+e^-}\) beams must be monochromatized such that the spread of their centre-of-mass (c.m.) energy is commensurate with the narrow width of the SM Higgs boson, \(\varGamma _\mathrm {H} = 4.1\) MeV, while keeping large beam luminosities. Third, the Higgs mass must also be known beforehand with a few-MeV accuracy in order to operate the collider at the resonance peak, \(\sqrt{s} = m_\mathrm {H}\) . Last but not least, the cross sections of the background processes are many orders-of-magnitude larger than those of the Higgs decay signals. A preliminary generator-level study of 11 Higgs decay channels using a multivariate analysis, which exploits boosted decision trees to discriminate signal and background events, identifies two final states as the most promising ones in terms of statistical significance: \(\mathrm {H}\rightarrow gg\) and \(\mathrm {H}\rightarrow \mathrm {W}\mathrm {W}^*\!\rightarrow \ell \nu \) + 2 jets. For a benchmark monochromatization with 4.1-MeV c.m. energy spread (leading to \(\sigma _\mathrm {ee\rightarrow H} = 0.28\) fb) and 10 ab \(^{-1}\) of integrated luminosity, a \(1.3\sigma \) signal significance can be reached, corresponding to an upper limit on the e \(^\pm \) Yukawa coupling at 1.6 times the SM value: |y e | < 1.6|y e SM | at 95% confidence level, per FCC-ee interaction point per year. Directions for future improvements of the study are outlined.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Machine learning-based analysis of COVID-19 pandemic impact on US research networks

Here in this study we explore how fallout from the changing public health policy around COVID-19 has changed how researchers access and process their science experiments. Using a combination of techniques from statistical analysis and machine learning, we conduct a retrospective analysis of historical network data for a period around the stay-at-home orders that took place in March 2020. Our analysis takes data from the entire ESnet infrastructure to explore DOE high-performance computing (HPC) resources at OLCF, ALCF, and NERSC, as well as User sites such as PNNL and JLAB. We look at detecting and quantifying changes in site activity using a combination of t-Distributed Stochastic Neighbor Embedding (t-SNE) and decision tree analysis. Our findings bring insights into the working patterns and impact on data volume movements, particularly during late-night hours and weekends.

97 MATHEMATICS AND COMPUTING↗