Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “decision tree”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Accelerating FEM-Based Corrosion Predictions Using Machine Learning

Atmospheric corrosion of metallic parts is a widespread materials degradation phenomena that is challenging to predict given its dependence on many factors (e.g. environmental, physiochemical, and part geometry). For materials with long expected service lives, accurately predicting the degree to which corrosion will degrade part performance is especially difficult due to the stochastic nature of corrosion damage spread across years or decades of service. The Finite Element Method (FEM) is a computational technique capable of providing accurate estimates of corrosion rate by numerically solving complex differential Eqs. characterizing this phenomena. Nevertheless, given the iterative nature of FEM and the computational expense required to solve these complex equations, FEM is ill-equipped for an efficient exploration of the design space to identify factors that accelerate or deter corrosion, despite its accuracy. In this work, a machine learning based surrogate model capable of providing accurate predictions of corrosion with significant computational savings is introduced. Specifically, this work leverages AdaBoosted Decision trees to provide an accurate estimate of corrosion current per width given different values of temperature, water layer thickness, molarity of the solution, and the length of the cathode for a galvanic couple of aluminum and stainless steel.

36 MATERIALS SCIENCE↗

Lung Cancer Survival Prediction using Ensemble Data Mining on Seer Data

We analyze the lung cancer data available from the SEER program with the aim of developing accurate survival prediction models for lung cancer. Carefully designed preprocessing steps resulted in removal/modification/splitting of several attributes, and 2 of the 11 derived attributes were found to have significant predictive power. Several supervised classification methods were used on the preprocessed data along with various data mining optimizations and validations. In our experiments, ensemble voting of five decision tree based classifiers and meta-classifiers was found to result in the best prediction performance in terms of accuracy and area under the ROC curve. We have developed an on-line lung cancer outcome calculator for estimating the risk of mortality after 6 months, 9 months, 1 year, 2 year and 5 years of diagnosis, for which a smaller non-redundant subset of 13 attributes was carefully selected using attribute selection techniques, while trying to retain the predictive power of the original set of attributes. Further, ensemble voting models were also created for predicting conditional survival outcome for lung cancer (estimating risk of mortality after 5 years of diagnosis, given that the patient has already survived for a period of time), and included in the calculator. The on-line lung cancer outcome calculator developed as a result of this study is available at http://info.eecs.northwestern.edu:8080/LungCancerOutcomeCalculator/.

Agrawal, Ankit↗

Deep Jointly-Informed neural networks

OJINN Is an easy-to-use deep neural network model that requires fewer user-specified hyper-parameters than traditional neural networks. The algorithm leverages decision trees trained on the data to determine an appropriate deep neural network architectures and weight Initializations. Optional functions also select the learning rate, batch size. and number of training Iterations necessary to create an accurate model.

Humbird, Kelli↗

IViz-OT (Intrusion Detection Visualizer for Operational Technology Network) [SWR-22-63]

The Visualizer dashboard provides grid operator highly-trusted alarming environment for an ongoing or potential cyber-attack based on system anomalies and network-based verification. Once anomalies are detected by the IDS tool (HIDES, NREL SWR-19-65), this platform stores the signatures or alert logs that are generated by the intrusion detector, lays out the detailed summary of the possible alerts, and maps these attacks with high-level scenarios. These scenarios are later combined to define a final event using a decision tree approach and a final report is generated out of this tool for further forensic analysis. It also supports authentication and authorization to support roles-based access control (RBAC) for users and a group of people.

Singh, Vivek Kumar↗

Decayheatml

This code is designed to predict and analyze the decay heat generated in molten salt reactors (MSRs) using a hybrid approach that combines machine learning and segmented polynomial fitting. The accurate prediction of decay heat is essential for reactor safety and the optimization of spent fuel storage. The code operates through several key components: 1) Data Architecture: It incorporates a modular data architecture that handles various MSR-specific operational parameters such as power density, humidity content, and air ingress. These parameters are sampled using Sobol sequences to ensure comprehensive coverage of operational uncertainties. 2) Machine Learning Framework: The code employs a diverse set of machine learning models, including polynomial regression, decision trees, random forests, gradient boosting, support vector regression, k-nearest neighbors, multi-layer perceptrons, and symbolic regression. These models are trained to predict decay heat over a wide temporal range, from immediate shutdown up to 10,000 years. 3) Region-Optimized Training: The temporal domain is divided into multiple regions, each modeled separately to capture distinct decay heat characteristics across different time scales. This approach significantly improves the accuracy and interpretability of predictions. 4) Segmented Polynomial Interpretation (SPI): The SPI method translates machine learning predictions into piecewise polynomial equations. These equations are physically interpretable and can be directly integrated into existing engineering workflows and safety analyses. 5) Front-End Interfaces: The code includes both a Jupyter notebook interface for research development and a Streamlit web application for operational deployment. These interfaces allow users to interactively explore decay heat predictions, adjust operational parameters, and visualize results in real-time. 6) Applications: The framework supports various applications, including safety system validation and spent fuel container optimization. It enables real-time evaluation of worst-case decay heat scenarios, informing the design of passive safety systems and optimizing container designs for long-term storage. Overall, this code provides a robust, accurate, and user-friendly tool for predicting decay heat in MSRs, enhancing reactor safety, and optimizing spent fuel management.

Retamales, Mauricio Eduardo Tano [Idaho National L↗

A Maximum-Entropy approach for accurate document annotation in the biomedical domain

The increasing number of scientific literature on the Web and the absence of efficient tools used for classifying and searching the documents are the two most important factors that influence the speed of the search and the quality of the results. Previous studies have shown that the usage of ontologies makes it possible to process document and query information at the semantic level, which greatly improves the search for the relevant information and makes one step further towards the Semantic Web. A fundamental step in these approaches is the annotation of documents with ontology concepts, which can also be seen as a classification task. In this paper we address this issue for the biomedical domain and present a new automated and robust method, based on a Maximum Entropy approach, for annotating biomedical literature documents with terms from the Medical Subject Headings (MeSH). The experimental evaluation shows that the suggested Maximum Entropy approach for annotating biomedical documents with MeSH terms is highly accurate, robust to the ambiguity of terms, and can provide very good performance even when a very small number of training documents is used. More precisely, we show that the proposed algorithm obtained an average F-measure of 92.4% (precision 99.41%, recall 86.77%) for the full range of the explored terms (4,078 MeSH terms), and that the algorithm’s performance is resilient to terms’ ambiguity, achieving an average F-measure of 92.42% (precision 99.32%, recall 86.87%) in the explored MeSH terms which were found to be ambiguous according to the Unified Medical Language System (UMLS) thesaurus. Finally, we compared the results of the suggested methodology with a Naive Bayes and a Decision Trees classification approach, and we show that the Maximum Entropy based approach performed with higher F-Measure in both ambiguous and monosemous MeSH terms.

59 BASIC BIOLOGICAL SCIENCES↗

Learning curves for drug response prediction in cancer cell lines

Motivated by the size and availability of cell line drug sensitivity data, researchers have been developing machine learning (ML) models for predicting drug response to advance cancer treatment. As drug sensitivity studies continue generating drug response data, a common question is whether the generalization performance of existing prediction models can be further improved with more training data. We utilize empirical learning curves for evaluating and comparing the data scaling properties of two neural networks (NNs) and two gradient boosting decision tree (GBDT) models trained on four cell line drug screening datasets. The learning curves are accurately fitted to a power law model, providing a framework for assessing the data scaling behavior of these models. The curves demonstrate that no single model dominates in terms of prediction performance across all datasets and training sizes, thus suggesting that the actual shape of these curves depends on the unique pair of an ML model and a dataset. The multi-input NN (mNN), in which gene expressions of cancer cells and molecular drug descriptors are input into separate subnetworks, outperforms a single-input NN (sNN), where the cell and drug features are concatenated for the input layer. In contrast, a GBDT with hyperparameter tuning exhibits superior performance as compared with both NNs at the lower range of training set sizes for two of the tested datasets, whereas the mNN consistently performs better at the higher range of training sizes. Moreover, the trajectory of the curves suggests that increasing the sample size is expected to further improve prediction scores of both NNs. These observations demonstrate the benefit of using learning curves to evaluate prediction models, providing a broader perspective on the overall data scaling characteristics. A fitted power law learning curve provides a forward-looking metric for analyzing prediction performance and can serve as a co-design tool to guide experimental biologists and computational scientists in the design of future experiments in prospective research studies.

60 APPLIED LIFE SCIENCES↗

Human limits in machine learning: prediction of potato yield and disease using soil microbiome data

Abstract Background The preservation of soil health is a critical challenge in the 21st century due to its significant impact on agriculture, human health, and biodiversity. We provide one of the first comprehensive investigations into the predictive potential of machine learning models for understanding the connections between soil and biological phenotypes. We investigate an integrative framework performing accurate machine learning-based prediction of plant performance from biological, chemical, and physical properties of the soil via two models: random forest and Bayesian neural network. Results Prediction improves when we add environmental features, such as soil properties and microbial density, along with microbiome data. Different preprocessing strategies show that human decisions significantly impact predictive performance. We show that the naive total sum scaling normalization that is commonly used in microbiome research is one of the optimal strategies to maximize predictive power. Also, we find that accurately defined labels are more important than normalization, taxonomic level, or model characteristics. ML performance is limited when humans can’t classify samples accurately. Lastly, we provide domain scientists via a full model selection decision tree to identify the human choices that optimize model prediction power. Conclusions Our study highlights the importance of incorporating diverse environmental features and careful data preprocessing in enhancing the predictive power of machine learning models for soil and biological phenotype connections. This approach can significantly contribute to advancing agricultural practices and soil health management.

Aghdam, Rosa↗

NANO.PTML model for read-across prediction of nanosystems in neurosciences. computational model and experimental case of study

Abstract Neurodegenerative diseases involve progressive neuronal death. Traditional treatments often struggle due to solubility, bioavailability, and crossing the Blood-Brain Barrier (BBB). Nanoparticles (NPs) in biomedical field are garnering growing attention as neurodegenerative disease drugs (NDDs) carrier to the central nervous system. Here, we introduced computational and experimental analysis. In the computational study, a specific IFPTML technique was used, which combined Information Fusion (IF) + Perturbation Theory (PT) + Machine Learning (ML) to select the most promising Nanoparticle Neuronal Disease Drug Delivery (N2D3) systems. For the application of IFPTML model in the nanoscience, NANO.PTML is used. IF-process was carried out between 4403 NDDs assays and 260 cytotoxicity NP assays conducting a dataset of 500,000 cases. The optimal IFPTML was the Decision Tree (DT) algorithm which shown satisfactory performance with specificity values of 96.4% and 96.2%, and sensitivity values of 79.3% and 75.7% in the training (375k/75%) and validation (125k/25%) set. Moreover, the DT model obtained Area Under Receiver Operating Characteristic (AUROC) scores of 0.97 and 0.96 in the training and validation series, highlighting its effectiveness in classification tasks. In the experimental part, two samples of NPs (Fe 3 O 4 _A and Fe 3 O 4 _B) were synthesized by thermal decomposition of an iron(III) oleate (FeOl) precursor and structurally characterized by different methods. Additionally, in order to make the as-synthesized hydrophobic NPs (Fe 3 O 4 _A and Fe 3 O 4 _B) soluble in water the amphiphilic CTAB (Cetyl Trimethyl Ammonium Bromide) molecule was employed. Therefore, to conduct a study with a wider range of NP system variants, an experimental illustrative simulation experiment was performed using the IFPTML-DT model. For this, a set of 500,000 prediction dataset was created. The outcome of this experiment highlighted certain NANO.PTML systems as promising candidates for further investigation. The NANO.PTML approach holds potential to accelerate experimental investigations and offer initial insights into various NP and NDDs compounds, serving as an efficient alternative to time-consuming trial-and-error procedures.

60 APPLIED LIFE SCIENCES↗

Mitigating Algorithmic Bias in Cancer Site Classification Models

Purpose Integrating artificial intelligence in cancer diagnostics has improved tumor classification beyond rule-based systems. Despite these advancements, these models may still encode demographic biases. We conducted a large-scale, applied bias-probing study of a deep learning–based cancer site classifier to quantify race information encoded in document embeddings. We then evaluated how performance changes when race-correlated embedding dimensions are removed in a post-training sensitivity analysis. Methods The cancer site classifier was trained using 3.5 million electronic cancer pathology reports from six of the National Cancer Institute's SEER registries. We trained a hierarchical self-attention network to generate 400-dimensional document embeddings. These embeddings were used to train two downstream, gradient-boosted decision tree classifiers: one to classify the cancer sites and another to predict racial categories. We identified overlapping features by intersecting the top 50 feature-importance rankings from the site and race models and computed their cumulative feature importance in each model. As a post hoc sensitivity analysis, we progressively pruned these overlapping dimensions, retrained the site model, and compared overall macro-F1 and accuracy, race-stratified macro-F1, and group fairness metrics on the basis of demographic parity and equalized odds before and after pruning. Results The analysis revealed minimal feature overlap between the cancer site and race prediction models, and the cumulative importance scores indicated a negligible influence of racial information on clinical predictions. Post-training pruning of overlapping features did not compromise the models' diagnostic accuracy, with a 0.07% loss in accuracy. Conclusion Our findings demonstrate that HiSAN-generated embeddings from SEER data can be used effectively in cancer site classification without significant demographic bias influencing the outcomes. Post-training pruning therefore functions as a practical audit and sensitivity check.

Shivanna, Abhishek [ORNL] (ORCID:0009000665228593)↗

ESS-DIVE guidelines for archiving terrestrial model data

This dataset contains supporting documents and images for ESS-DIVE terrestrial model data archiving guidelines.Terrestrial models are broadly defined as numerical models that couple both land dynamics and energy, water, carbon, or nutrient fluxes. We created these guidelines based on input from the U.S. Department of Energy’s Biological and Environmental Research land modeling community. The guidelines are intended to help modelers determine which components of their terrestrial model data associated with publication should be archived. Based on input from the land modeling community, the guidelines recommend archiving both model input and testing data, as well as code, script, and metadata. The guidelines also recommend archiving model data output, depending on the limitations set by data repositories. Lastly, we provide recommendations for bundling data files for publication as well as a discussion about tools that can facilitate model data archiving and reuse.This dataset is an archive of the associated GitHub repository for our model archiving guidelines (https://github.com/ess-dive-community/essdive-model-data-archiving-guidelines). The ‘README.pdf’ file gives a general introduction to the guidelines, and the ‘instructions.pdf’ file provides more detailed steps for following the guidelines. We also provide 2 figures in this data package: 1) a decision tree (model_data_guidelines_decision_tree.png) that can help users determine which components of their model data to archive. and 2) the ‘model_data_guidelines_flmd.png’ file depicts the different files that can be archived in addition to the model data itself. Lastly, we include 3 digitized tables from our associated manuscript and 3 CSV files with anonymized input from DOE scientists about the importance of different aspects of model data archiving from which we developed the guidelines.Dataset updates for v1.1.0: We updated this data package on 2021-11-22 in response to review comments on our related manuscript. In this update we removed one figure so that the model archiving guidelines are conveyed in text rather than an image. We updated the file-level metadata (FLMD) figure to be in accord with the most recent FLMD recommendations. We made minor edits to the README file to update the recommended citation and added two co-authors. We also added 6 new data files (3 are anonymized input from DOE scientists that helped to inform guidelines, and 3 are digitized tables from our manuscript.

54 ENVIRONMENTAL SCIENCES↗

Simultaneous prediction of structural properties in epitaxially–grown GaN with quantum and conventional multi–output learning algorithms

Hundreds of GaN thin film crystal plasma–assisted molecular beam epitaxy synthesis experiment records spanning two decades were organized into a dataset correlating the growth experiment design parameters with discrete, binary determinations of crystallinity and surface morphology. Conventional data science techniques as well as both quantum and classical multi–output supervised machine learning algorithms were implemented to investigate the relationships between the operating parameter data and the structural figures of merit. Correlation coefficients, decision tree nodes, p–values, and SHAP values all support substrate temperature and gallium effusion cell conditions as being statistically significant for simultaneously influencing GaN crystallinity and surface morphology. Here, a conventional deep neural network learned best from the data, followed by a quantum–classical hybrid gradient boosting algorithm. When combined with calculations of uncertainty intervals based on VennAbers predictors, machine learning predictions of both structural properties show good agreement with results reported in published experimental literature.

36 MATERIALS SCIENCE↗

Observation of $t$-channel electroweak top quark production

The top quark is the heaviest known fundamental particle, with a mass of 172.0 +0.9 -1.3 GeV. This is nearly twice the mass of the second heaviest known particle, the Z boson, and roughly the mass of a gold atom. Because of its unusually large mass, studying the top quark may provide insight into the Higgs mechanism and other beyond the standard model physics. Only two accelerators in the world are powerful enough to produce top quarks. The Tevatron, which first accelerated protons in 1983, has produced almost 400,000 top quarks, roughly half at each of its two detectors: DO and CDF. The LHC is a much newer accelerator which currently has accumulated about 0.5% as much data as the Tevatron. However, when running at full luminosity, the LHC is capable of producing a top quark about once every second and will quickly surpass the Tevatron as the leading producer of top quarks. This analysis uses data from the DØ detector at the Tevatron, which are described in chapter 3. Top quarks are produced most often in pairs of top and anti-top quarks through an interaction of the strong force. This production mode was first observed in 1995 at the Tevatron. However, top quarks can also be produced though an electroweak interaction, which produces just one top quark. This production mode was first observed at the Tevatron in 2008. Single top quark production can occur in different channels. In this analysis, a measurement of the cross section of the t-channel production mode is performed. This measurement uses 5.4 fb -1 of data and uses the technique of boosted decision trees in order to separate signal from background events. The t-channel cross section is measured to be: σ(p$\bar{p}$ → tqb + X) = 3.03 +0.78 -0.66 pb (0.0.1). Additional cross section measurements were also performed for the s-channel as well as the s + t-channel. The measurement of each one of these three cross sections was repeated three times using different techniques, and all three methods were combined into a 'super-method' which achieves the best performance. The details of these additional measurements are shown in appendix A.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Search for the Standard Model Higgs Boson in Missing Transverse Energy and $b$-quark Final States Using Proton-Antiproton Collisions at 1.96 TeV

A search for the standard model Higgs boson is performed in 6.4 fb -1 of p$\bar{p}$ collisions at √s = 1.96 TeV, collected with the DØ detector during Run II of the Fermilab Tevatron. The final state considered is a pair of jets originating from b quarks and missing transverse energy, as expected from p$\bar{p}$ → ZH → v$\bar{v}$b$\bar{b}$ production. The search is also sensitive to the WH → ℓvb$\bar{b}$ channel, where the charged lepton is not identified. Boosted decision trees are used to discriminate signal from background. Good agreement is observed between data and expected backgrounds, and a limit is set at 95% C.L. on the section multiplied by branching fraction of (p$\bar{p}$ → (Z/W)H) x (H → b$\bar{b}$). For a Higgs boson mass of 115 GeV, the observed limit is a factor of 3.5 larger than the value expected from the standard model.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Search for V H and Technicolor Producion in the qqbb Final State Using the RunII DØ Detector

A search for dijet resonance production in a four-jet all-hadronic final state from the DØ detector at Fermilab’s Tevatron is presented. The data set, acquired at a p$\bar{p}$ center-of-mass energy of √s = 1.96 TeV, contains primarily multijet events and represents approximately 1 fb -1 of data. The cross section limits for associated Higgs production and Technicolor pro- cesses are determined through a background subtraction method using data to estimate the background. This four-jet channel is potentially very powerful, but is extremely challenging due to the large multijet background from QCD processes. Background rejection is performed by utilizing b-tagging, pre-selection cuts, a multi-variate boosted decision tree discriminant, and the correlated information contained in the M(bb) and M(jj) dijet invariant masses. The search for V H (WH+ZH) processes yields a 95% confidence level observed upper limit of 20.4 pb on the VH cross section for a Higgs mass of 115 GeV/c 2 . Additionally, a 95% confidence level observed upper limit of 16.7 pb was set for a Higgs boson mass of 125 GeV/c 2 and 24.6 pb was set for a Higgs boson mass of 135 GeV/c 2 . The same data set was used to place limits on the Technicolor process ρTC → WπTC where the technirho mass was fixed to 240 GeV/c 2 . For a technipion mass of 115 GeV/c 2 we find a 95% confidence level observed upper limit on the cross section of 49 pb. The technipion masses of 125 GeV/c 2 and 140 GeV/c 2 , the 95% confidence level observed upper limits are 57 pb and 71 pb, respectively.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Innovations in Voluntary Renewable Energy Procurement: Methods for Expanding Access and Lowering Cost for Communities, Governments, and Businesses (Technical Report)

This guide explores five innovative options for voluntarily procuring renewable energy generation or systems. The options and their descriptions are shown in Table 1. These methods can be replicated by a variety of stakeholders—including local governments, not-for-profit organizations, businesses, and utilities. The three decision trees in Figure 1 indicate which method may best suit a particular stakeholder’s needs.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Search for a Higgs-like boson decaying to two photons in $p\bar{p}$ collisions at $\sqrt{s} = 1.96$ TeV

We present a search for the Standard Model (SM) Higgs boson decaying to two photons using the 9.6 fb -1 of p$\bar{p}$ collisions at √s = 1.96 TeV collected by the D0 detector at the Tevatron from July 2002 to September 2011. The data corresponds to the complete data-set in the RunII period of the Tevatron. This thesis employs a multivariate technique, boosted decision trees, to optimize the discrimination of signal from background. No significant excess of data above theoretical prediction is observed, so limits on the ratio of the production cross section times the branching ratio to the SM value are set at 95% confidence level as a function of hypothetical Higgs boson mass. The expected and observed limits on this ratio are 8.7 and 12.8 respectively at 125 GeV. We also interpret the data in the fermiophobic Higgs model. The result has reached a sensitivity of 114 GeV, and we set a lower limit on the fermiophobic Higgs mass of M Hf > 113 GeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Measurement of the Single Top Quark Production Cross Section at $\sqrt {s} = 1.96$ TeV

Within the standard model top quarks are predicted to be most often produced in pairs via the strong interaction. However they can also be produced singly through the weak interation. This is a rarer process with many experimental challenges. It is interesting because it provides a new window to search for evidence of physics beyond the standard model picture, such as a fourth generation of quarks or to search for insight into the Higgs Mechanism. Single top production also provides a direct way to calculate the CKM matrix element V tb . This thesis presents new measurements for single top quark production in the s+t, s and t channels using 5.4 fb -1 of data collected at the DØ detector at Fermilab in Batavia, IL. The analysis was performed using Boosted decision trees to separate signal from background and Bayesian statistcs to calculate all the cross sections.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗