Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Tree Classifiers”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

32 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Human limits in machine learning: prediction of potato yield and disease using soil microbiome data

Abstract Background The preservation of soil health is a critical challenge in the 21st century due to its significant impact on agriculture, human health, and biodiversity. We provide one of the first comprehensive investigations into the predictive potential of machine learning models for understanding the connections between soil and biological phenotypes. We investigate an integrative framework performing accurate machine learning-based prediction of plant performance from biological, chemical, and physical properties of the soil via two models: random forest and Bayesian neural network. Results Prediction improves when we add environmental features, such as soil properties and microbial density, along with microbiome data. Different preprocessing strategies show that human decisions significantly impact predictive performance. We show that the naive total sum scaling normalization that is commonly used in microbiome research is one of the optimal strategies to maximize predictive power. Also, we find that accurately defined labels are more important than normalization, taxonomic level, or model characteristics. ML performance is limited when humans can’t classify samples accurately. Lastly, we provide domain scientists via a full model selection decision tree to identify the human choices that optimize model prediction power. Conclusions Our study highlights the importance of incorporating diverse environmental features and careful data preprocessing in enhancing the predictive power of machine learning models for soil and biological phenotype connections. This approach can significantly contribute to advancing agricultural practices and soil health management.

Aghdam, Rosa↗
DOE OSTI2026

AmeriFlux FLUXNET-1F BR-Sa1 Santarem-Km67-Primary Forest

This is the AmeriFlux Management Project (AMP) created FLUXNET-1F version of the carbon flux data for the site BR-Sa1 Santarem-Km67-Primary Forest. This is the FLUXNET version of the carbon flux data for the site BR-Sa1 Santarem-Km67-Primary Forest produced by applying the standard ONEFlux (1F) software. Site Description - The LBA Tapajos KM67 Mature Forest site is a closed-canopy terra firme (upland) forest, located in the FLONA Tapajos, or National Forest, a 450,000 ha government conservation unit in the Brazilian Amazon. Bounded by the Tapajos River in the west and highway BR-163 to the east, the tower is located on a flat plateau (or planalto) that extends up to 40 km to the north, south, and east. The forest at the tower site is classified as primary or "old-growth"" predominantly by its uneven age distribution, emergent trees, numerous epiphytes and abundant large logs. In January 2006 and again in November 2023, falling trees hit the tower guy wires destroying the tower and halting measurements. In each case, the tower was restored and measurements resumed, first in August of 2008 (enabled by a Partnership for International Research and Education, or PIRE, grant from the U.S. National Science Foundation) and again in June 2024.

Restrepo-Coupe, Natalia [University of Arizona, Cu↗
DOE OSTI2026

A Centralized AI Lakehouse Framework for Brain Tumor MRI Classification and Segmentation, University KPI Forecasting, and Water Potability Prediction

In many university and healthcare projects, models are built for very different data types such as tables, institutional time series, and medical images, but they are deployed as separate applications. In this work, that separation made testing and maintenance difficult because each module had its own pipeline and runtime requirements. This paper presents an integrated AI lakehouse-style implementation that runs three model pipelines inside one containerized backend. For medical imaging, we used MRI datasets from IEEE DataPort: a four-class classification set with 7012 images (5708 train/1304 test) and a segmentation set with 3063 image–mask pairs. The classification model (ResNet50 transfer learning) is evaluated using a proper train–validation–test protocol across multiple splits (80/10/10, 70/10/20, 60/10/30, and 10/30/60), achieving a test accuracy of 99.00% under the standard 80/10/10 split. Additionally, a patient-level evaluation is conducted using an external glioma dataset to provide a more realistic assessment without data leakage. The segmentation model (DeepLabV3-ResNet50) achieved 83.09% validation mIoU and 88.79% Dice score. For university KPI forecasting, we used annual IPEDS and NSF HERD data from 2010 to 2023 for three universities (BSU, EOU, and UAB). To examine the effect of preprocessing on forecasting performance, two case studies are conducted. In the first case, linear interpolation is applied to generate semester-level data. In the second case, the original annual data is used directly without interpolation. Random Forest regression and ARIMA models are evaluated using MAE, RMSE, MAPE, and R 2 . The results showed that interpolation improved apparent forecasting performance due to smoothing, while evaluation on the original annual data provided a more realistic assessment of model behavior. To further validate the framework on a larger dataset, an additional case study is conducted using a student dropout dataset. For water potability, we trained and compared multiple tabular classifiers on a large dataset (1,048,575 samples). A Random Forest model (100 trees, max depth 10) achieved 85.86% test accuracy and high recall for unsafe samples (0.8447). All modules are served via FastAPI and deployed together using Docker, with workflow automation routing requests to the correct endpoint. System-level benchmarking indicates that the backend maintains stable throughput and latency under concurrent requests.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Parallel sorting algorithm classification: is manual instrumentation necessary?

Understanding parallel algorithms is crucial for accelerating scientific simulations on complex, distributed memory, high-performance computers. Modern algorithm classification approaches learn semantics directly from source code to differentiate between algorithms, however, accessing source code is not always possible. We can learn about parallel algorithms from observing their performance, as programs running the same algorithms and using the same hardware should exhibit similar performance characteristics. We present an approach to learn algorithm classes from parallel performance data directly in order to classify algorithms without access to the source code. We extend previous work to enable classifying parallel sorting algorithms using automatic instrumentation instead of requiring manual region annotations in the source code. In this work, we design and demonstrate a study for classification of parallel sorting algorithms using parallel performance data collected from automatic instrumentation, and evaluate the performance of our new methodology on classification. We leverage Caliper to collect the performance data, Thicket for our exploratory data analysis (EDA), and PyTorch and Scikit-learn to evaluate the effectiveness of random forests, support vector machines (SVMs), decision trees, neural networks, and logistic regressions on parallel performance data. Additionally, we study noise in parallel performance data, whether the removal of noise and pre-processing of the data is necessary to accurately classify parallel sorting algorithms, and determine the effectiveness of features created from performance data. In conclusion, we demonstrate classification accuracy for these five different models of up to 97.7% across four different parallel algorithm classes.

Algorithm Classification↗
DOE OSTI2025

Distinguishing Orbiting and Infalling Dark Matter Particles with Machine Learning

Dark matter halos are typically defined as spheres that enclose some overdensity, but these sharp, somewhat arbitrary boundaries introduce nonphysical artifacts such as backsplash halos, pseudo-volution, and an incomplete accounting of halo mass. A more physically motivated alternative is to define halos as the collection of particles that are physically orbiting within their potential well. However, existing methods to classify particles as orbiting or infalling suffer from trade-offs between accuracy, computational cost, and generalizability across cosmologies. We present an efficient, yet accurate, supervised machine learning approach using decision trees. The classification is based on only the particle radii and velocities at two epochs. Compared to detailed analysis of particle trajectories, we find that our model matches the classification of 97% of particles. Consequently, we are able to quickly and accurately reproduce the density profiles of the orbiting and infalling components out to many virial radii. We demonstrate that our model generalizes to a significantly different cosmology that lies outside the training data set. We make publicly available both our final model and the code to train similar models.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

New avenues for |∆ B | = 2 processes beyond neutron-antineutron oscillations

We explore baryon-number-violating (|∆ B | = 2) processes beyond the well-known neutron-antineutron ($n - \bar{n}$) oscillations, focusing on the $Λ - \bar{Λ}$ system. The presence of a strange quark in the Λ baryon introduces a new set of six-quark operators roughly of the form (uds) 2 , which are different from the (udd) 2 operators responsible for oscillations. Using the Standard Model Effective Field Theory (SMEFT), we classify all dimension-9 operators that cause |∆ B | = 2 transitions and study their UV completions mediated by exotic scalar fields with trilinear interactions. We demonstrate that in these models, oscillations can occur at tree level, with $n - \bar{n}$ mixing potentially appearing at higher loop levels. We employ a chiral effective theory to constrain the effective mass mixing δm Λ , deriving bounds from current experimental limits on $n - \bar{n}$ oscillations and dinucleon decays such as pp → K + K + . These bounds indicate that $Λ - \bar{Λ}$ oscillations probe a complementary parameter space, sensitive to baryon-number violation at scales up to 10 2 − 10 3 TeV. We show that the existing indirect bounds make it challenging to provide a competitive bound on δm Λ at BESIII.

Baryon/Lepton Number Violation↗
DOE OSTI2026

Entire four-graviton EFT from the duality between color and kinematics

The Bern-Carrasco-Johansson (BCJ) double-copy construction reveals a fundamental structural connection between gauge and gravity theories. At its core, the BCJ double copy is directly due to a duality between the algebraic relations of a color root and those of a kinematic root. We generalize this principle beyond the conventional Lie algebra structure of tree-level Yang-Mills theory. By demanding color-kinematics duality for the complete basis of four-point color structures—including those involving the symmetric 𝑑 𝑎⁢𝑏⁢𝑐 constants—we define the universal double copy. We systematically classify the bases of all such parity-even generalized gauge-theory numerators and, independently, the space of all parity-even four-graviton higher-derivative operators. We demonstrate that our universal double-copy construction precisely spans the entire tower of parity-even four-graviton amplitudes in any dimension, except for the Lovelock 𝑅 3 contribution in 𝐷 > 6 which we can express in terms of a particularly simple universal triple-copy involving gauge theories coupled to scalars. Explicit machine-readable expressions for the complete basis of gauge-theory numerators and fundamental gravitational building blocks are provided in the Supplemental Material. This establishes that all possible four-point gravitational interactions can be factorized into products of gauge-theory building blocks governed by this universal notion of color-kinematics duality.

Carrasco, John Joseph M. [Northwestern Univ., Evan↗
DOE OSTI2024

Training toward significance with the decorrelated event classifier transformer neural network

Experimental particle physics uses machine learning for many tasks, where one application is to classify signal and background events. This classification can be used to bin an analysis region to enhance the expected significance for a mass resonance search. In natural language processing, one of the leading neural network architectures is the transformer. In this work, an event classifier transformer is proposed to bin an analysis region, in which the network is trained with special techniques. The techniques developed here can enhance the significance and reduce the correlation between the network’s output and the reconstructed mass. It is found that this trained network can perform better than boosted decision trees and feed-forward networks. Published by the American Physical Society 2024

Astronomy & Astrophysics↗
DOE OSTI2026

Uncertainty-Aware Machine Learning for Small-Angle X-ray Scattering Analysis in Autonomous Experimentation

Small-angle X-ray scattering (SAXS) is a powerful high-throughput characterization tool for probing nanoscale structure in native sample environments, providing real-time morphological information such as nanoparticle size and shape during synthesis. However, automated SAXS data analysis for extracting meaningful structural parameters is non-trivial and remains a bottleneck in closed-loop experimentation towards autonomous materials discovery, which demands fast, reliable, and uncertainty-aware data analysis. Here, we develop a machine-learning approach for automated SAXS analysis tailored to closed-loop nanoparticle synthesis. A Random Forest (RF) regression model is trained on 100,000 synthetic SAXS curves generated from polydisperse spherical nanoparticles with realistic background contributions. Using normalized one-dimensional SAXS intensity profiles as input, the RF model directly predicts nanoparticle radius, size polydispersity, and background parameters, while the ensemble standard deviation across trees provides built-in uncertainty quantification (UQ). On synthetic data, we show that combining fit-quality metrics (R 2 , MAE) with thresholds on prediction uncertainty reliably identifies accurate parameter estimates without access to ground truth. We then apply the trained model to 365 experimental SAXS profiles of citrate-reduced gold nanoparticles synthesized using an automated droplet-flow microreactor with in situ SAXS at a synchrotron beamline, classifying the results into high- and low-confidence subsets based on UQ metrics. Finally, we integrate RF-based SAXS analysis into a simulated closed-loop optimization campaign using Gaussian process Bayesian optimization to minimize nanoparticle polydispersity, benchmarking against conventional automated Levenberg–Marquardt fitting. The RF-guided campaign exhibits substantially faster convergence and lower relative opportunity cost (∼0.07 vs ∼0.3), demonstrating that uncertainty-aware machine-learning SAXS analysis significantly enhances the efficiency and robustness of autonomous nanomaterials synthesis workflows.

Bayesian optimization↗
DOE OSTI2026

Ecological and genomic variation in ectomycorrhizal fungal exploration types

Ectomycorrhizal fungi (EMF) produce mycelia with variable extension and complexity, which can be classified according to soil ‘exploration types’ (ETs). ETs have received attention as one of the few mycorrhizal trait frameworks, but without an empirical classification of ET functional diversity and environmental preferences, understanding and interpreting EMF biogeographic patterns has been difficult. We conducted a synthesis combining: comparative EMF genomics to describe functional divergence in decomposition and nutrient cycling genes across ETs; and EMF trait distribution modeling across continental Europe, pairing soil and root EMF surveys to establish biogeographic ET niche profiles. We demonstrate a signature of ETs encoded in EMF genomes, which is independent from phylogeny and linked to biomass production strategies. EMF ET relative abundances were separated by soil, root, and dominant tree leaf type habitats and exhibited unique correlations with forest biotic (e.g. plant productivity and plant pathogen densities) and abiotic (e.g. nitrogen deposition and soil pH) conditions. These findings support a theory that EMF niche partitioning can be partially explained by extraradical mycelial traits, with underlying variation in ET biogeography likely arising from distinct decomposition and nutrient cycling potentials. We also identify important limitations to this trait framework and provide a guided outlook for future research.

biogeography↗
DOE OSTI2025

Explaining word embeddings with perfect fidelity: a case study in predicting research impact

The best-performing approaches for scholarly document quality prediction are based on embedding models. In addition to their performance when used in classifiers, embedding models can also provide predictions even for words that were not contained in the labelled training data for the classification model, which is important in the context of the ever-evolving research terminology. Although model-agnostic explanation methods, such as Local interpretable model-agnostic explanations, can be applied to explain machine learning classifiers trained on embedding models, these produce results with questionable correspondence to the model. We introduce a new feature importance method, Self-Model Entities Rated (SMER), for logistic regression-based classification models trained on word embeddings. We show that SMER has theoretically perfect fidelity with the explained model, as the average of logits of SMER scores for individual words (SMER explanation) exactly corresponds to the logit of the prediction of the explained model. Quantitative and qualitative evaluation is performed through five diverse experiments conducted on 50,000 research articles (papers) from the CORD-19 corpus. In conclusion, through an AOPC curve analysis, we experimentally demonstrate that SMER produces better explanations than LIME, SHAP and global tree surrogates.

Coarse-grained models↗
DOE OSTI2025

Leveraging intermediate resonances to probe CP violation at colliders

We explore the phenomenological impact of interference in tree-level contributions to three-body final states in $2\rightarrow 3$ scattering processes. This work introduces a novel search strategy leveraging asymmetries to enable sensitivity to CP-violating effects in less well-explored regions of phase space. Analytically, we demonstrate the effectiveness of this observable in probing interference between Standard Model charged-current decays and effective left-handed vector interactions, illustrated in a toy model featuring a scalar leptoquark, $S_1 \sim (3, 1, -\,1/3)$. Numerically, we apply this framework to studying the process $pp\rightarrow b \tau \nu $; unlike traditional high-$p_T$ searches or “bump hunts”, this approach utilizes an intermediate energy regime – where new physics is neither light enough to be produced on shell or heavy enough to justify an effective field theory treatment. A proof-of-principle analysis at parton level demonstrates a percent-level asymmetry, with sensitivity also to BSM weak-CP phase. While the specific phase sensitivity is diminished at particle level due to showering and detector effects, a machine learning classifier can recover sensitively to the presence of SM-BSM interference, significantly outperforming standard analysis methods. Notably discrimination between BSM signal and SM background could be achieved at the 2$\sigma $ level for the current LHC dataset and 8$\sigma $ at the High-Luminosity LHC. Moreover, this asymmetry observable as defined can also be more broadly applied to other searches for CP-violation in $2\rightarrow 3$ processes in present and future collider environments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Comparative genomic analysis of thermophilic fungi reveals convergent evolutionary adaptations and gene losses

Thermophily is a trait scattered across the fungal tree of life, with its highest prevalence within three fungal families (Chaetomiaceae, Thermoascaceae, and Trichocomaceae), as well as some members of the phylum Mucoromycota. We examined 37 thermophilic and thermotolerant species and 42 mesophilic species for this study and identified thermophily as the ancestral state of all three prominent families of thermophilic fungi. Thermophilic fungal genomes were found to encode various thermostable enzymes, including carbohydrate-active enzymes such as endoxylanases, which are useful for many industrial applications. At the same time, the overall gene counts, especially in gene families responsible for microbial defense such as secondary metabolism, are reduced in thermophiles compared to mesophiles. We also found a reduction in the core genome size of thermophiles in both the Chaetomiaceae family and the Eurotiomycetes class. The Gene Ontology terms lost in thermophilic fungi include primary metabolism, transporters, UV response, and O-methyltransferases. Comparative genomics analysis also revealed higher GC content in the third base of codons (GC3) and a lower effective number of codons in fungal thermophiles than in both thermotolerant and mesophilic fungi. Furthermore, using the Support Vector Machine classifier, we identified several Pfam domains capable of discriminating between genomes of thermophiles and mesophiles with 94% accuracy. Using AlphaFold2 to predict protein structures of endoxylanases (GH10), we built a similarity network based on the structures. We found that the number of disulfide bonds appears important for protein structure, and the network clusters based on protein structures correlate with the optimal activity temperature. Thus, comparative genomics offers new insights into the biology, adaptation, and evolutionary history of thermophilic fungi while providing a parts list for bioengineering applications.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Removal of Antibiotics from Swine Wastewater Using an Environmentally Friendly Biochar: Performance and Mechanisms

Antibiotics used in the swine industry to treat diseases and improve animal growth are poorly absorbed by swine and have been classified as micropollutants due to their occurrence in surface water, wastewater, and soil. This study investigated the capacity of biochar produced from eastern red cedar to remove target antibiotics that have been extensively used in the swine industry. Biochar was produced by pyrolysis from eastern red cedar at 450 °C. The sorption tests were performed by mixing biochar and a solution (1:10 ratio) containing each antibiotic in 100, 300, 600, and 900 μg L –1 concentrations. The results indicate that red cedar biochar was able to effectively remove up to 99.93% tetracycline, 96.23% oxytetracycline, 98.28% chlortetracycline, 76.4% sulfadiazine, and 78.6% sulfamethazine at the lowest concentrations. The removal efficiencies at higher concentrations declined up to 83.52, 47.23, 64.16, 69.8, and 58.4% for tetracycline, oxytetracycline, chlortetracycline, sulfadiazine, and sulfamethazine, respectively. The biochar exhibited stronger adsorption capacity for chlortetracycline and sulfamethazine compared to the other antibiotics. The likely adsorption mechanisms driving the removal of tetracyclines and sulfonamides are hydrogen-bonding and π–π electron-donor–acceptor, supported by FTIR analyses of the biochar itself. Overall, the results highlighted the potential utilization of eastern red cedar biochar for practical applications, mitigating antibiotic residues from swine wastewater in a cost-effective and environmentally friendly manner due to its relatively low pyrolysis temperature (450 °C) and sustainable repurposing of an invasive tree species.

09 BIOMASS FUELS↗