Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “randomized algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Using Machine Learning Methods to Predict Bias in Nuclear Criticality Safety

The manuscript provides a description of the application of machine-learning (ML) tools to the prediction of bias in criticality safety analysis. In particular, a set of over 1000 experiments included in the Whisper package were fed into a variety of ML algorithms (notably Random Forest and AdaBoost) implemented in SciKit-Learn using k-eigenvalue sensitivities (with and without energy dependence) for individual nuclides, and optionally, the simulated k eff as the training features. Ultimately, the ML model was used to predict the bias (k sim - k exp ). The results indicate that use of energy-integrated sensitivity profiles with k sim as training features led to the best predictions as quantified by root-mean square and mean absolute errors. In particular, the best-case estimates came from AdaBoost, with a mean absolute error of 0.00174, which is less than the mean experimental uncertainty of 0.00328 for the experiments included.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

STATISTICAL STUDY OF 2XMMi-DR3/SDSS-DR8 CROSS-CORRELATION SAMPLE

Cross-correlating the XMM-Newton 2XMMi-DR3 catalog with the Sloan Digital Sky Survey (SDSS) Data Release 8, we obtain one of the largest X-ray/optical catalogs and explore the distribution of various classes of X-ray emitters in the multidimensional photometric parameter space. Quasars and galaxies occupy different zones while stars scatter in them. However, X-ray active stars have a certain distributing rule according to spectral types. The earlier the type of stars, the stronger its X-ray emitting. X-ray active stars have a similar distribution to most stars in the g - r versus r - i diagram. Based on the identified samples with SDSS spectral classification, a random forest algorithm for automatic classification is performed. The result shows that the classification accuracy of quasars and galaxies adds up to more than 93.0% while that of X-ray emitting stars only amounts to 45.3%. In other words, it is easy to separate quasars and galaxies, but it is difficult to discriminate X-ray active stars from quasars and galaxies. If we want to improve the accuracy of automatic classification, it is necessary to increase the number of X-ray emitting stars, since the majority of X-ray emitting sources are quasars and galaxies. The results obtained here will be used for the optical spectral survey performed by the Large sky Area Multi-Object fiber Spectroscopic Telescope (LAMOST, also named the Guo Shou Jing Telescope), which is a Chinese national scientific research facility operated by the National Astronomical Observatories, Chinese Academy of Sciences.

79 ASTRONOMY AND ASTROPHYSICS↗

Topological bifurcation of magnetic islands in NSTX-U

The topological bifurcation of magnetic islands is observed in two M3D-C1 linear resistive MHD calculations of model NSTX-U equilibria during the application of small 3D magnetic perturbation fields. In comparing to a DIII-D ELM suppression case, reconstructed from shot 147170 at time slice 3745 ms, we propose that stronger kink response in the NSTX-U plasma may be the primary causes of the bifurcations. Island evolution and bifurcation in both the DIII-D and the two NSTX-U cases with the increase of perturbation current are analyzed. Further, a hypothesis is proposed that such magnetic island topology bears an intrinsic property to confine charged particles and cause their density inside the islands to rise, which is examined by implementing a random kick algorithm in the magnetic field line integration code TRIP3D-GPU to approximate electron collisional transport. Although full consideration of all forces between electrons is missing as it requires 3D large scale kinetic simulation in toroidal geometry, the positive result of this approximate transport simulation does provide first step confirmation towards fully validating the hypothesis.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Photometric redshifts and clustering of emission line galaxies selected jointly by DES and eBOSS

We present the results of the first test plates of the extended Baryon Oscillation Spectroscopic Survey. This paper focuses on the emission line galaxies (ELG) population targetted from the Dark Energy Survey (DES) photometry. We analyse the success rate, efficiency, redshift distribution, and clustering properties of the targets. From the 9000 spectroscopic redshifts targetted, 4600 have been selected from the DES photometry. The total success rate for redshifts between 0.6 and 1.2 is 71\% and 68\% respectively for a bright and faint, on average more distant, samples including redshifts measured from a single strong emission line. We find a mean redshift of 0.8 and 0.87, with 15 and 13\% of unknown redshifts respectively for the bright and faint samples. In the redshift range 0.6<z<1.2, for the most secure spectroscopic redshifts, the mean redshift for the bright and faint sample is 0.85 and 0.9 respectively. Star contamination is lower than 2\%. We measure a galaxy bias averaged on scales of 1 and 10~Mpc/h of 1.72 \pm 0.1 for the bright sample and of 1.78 \pm 0.12 for the faint sample. The error on the galaxy bias have been obtained propagating the errors in the correlation function to the fitted parameters. This redshift evolution for the galaxy bias is in agreement with theoretical expectations for a galaxy population with MB-5\log h < -21.0. We note that biasing is derived from the galaxy clustering relative to a model for the mass fluctuations. We investigate the quality of the DES photometric redshifts and find that the outlier fraction can be reduced using a comparison between template fitting and neural network, or using a random forest algorithm.

79 ASTRONOMY AND ASTROPHYSICS↗

Universality class for loopless invasion percolation models and a percolation avalanche burst model for hydraulic fracturing

Invasion percolation is a model that was originally proposed to describe growing networks of fractures. In this work, we describe a loopless algorithm on random lattices, coupled with an avalanche-based model for bursts. The model reproduces the characteristic b-value seismicity and spatial distribution of bursts consistent with earthquakes resulting from hydraulic fracturing (“fracking”). We test models for both site invasion percolation and bond invasion percolation. These have differences on the scale of site and bond lengths l. But since the networks are characterized by their large-scale behavior, l << L, we find small differences between scaling exponents. Though data may not differentiate between models, our results suggest that both models belong to different universality classes.

58 GEOSCIENCES↗

A Machine Learning-Based Method to Estimate Transformer Primary-Side Voltages with Limited Customer-Side AMI Measurements

Distribution control applications such as volt/var optimization, network reconfiguration, and distribution automation require accurate knowledge of the distribution system state. The lack of sufficient sensors on the primary side of distribution networks often limits the accuracy of the control decisions by these applications. The deployment of advanced metering infrastructure (AMI) provides utilities an opportunity to translate the AMI data on the secondary onto the primary so that it can be used as pseudo-measurements to augment the limited existing measurements on the primary. This paper develops a machine learning based approach for estimating service transformer primary-side voltages by using limited secondary-side AMI measurement. The machine learning model is developed by using random forest algorithm. The estimated primary-side voltages can be used by utilities as pseudo-measurements for distribution control applications. The detailed secondary model topology, which is an essential input data for many existing algorithms, is not required for the proposed method. The performance of the proposed method is validated by using AMI measurements from the field and an actual distribution feeder model of San Diego Gas & Electric Company.

advanced metering infrastructure↗

Machine learning based job status prediction in scientific clusters

Large high-performance computing systems are built with increasing number of components with more CPU cores, more memory, and more storage space. At the same time, scientific applications have been growing in complexity. Together, they are leading to more frequent unsuccessful job statuses on HPC systems. From measured job statuses, 23.4% of CPU time was spent to the unsuccessful jobs. Here, we set out to study whether these unsuccessful job statuses could be anticipated from known job characteristics. To explore this possibility, we have developed a job status prediction method for the execution of jobs on scientific clusters. The Random Forests algorithm was applied to extract and characterize the patterns of unsuccessful job statuses. Experimental results show that our method can predict the unsuccessful job statuses from the monitored ongoing job executions in 99.8% the cases with 83.6% recall and 94.8% precision. Lastly, this prediction accuracy can be sufficiently high that it can be used to mitigation procedures of predicted failures.

97 MATHEMATICS AND COMPUTING↗

Compression Analytics for Classification and Anomaly Detection within Network Communication

Here, the flexibility of network communication within Internet protocols is fundamental to network function, yet this same flexibility permits the possibility of malicious use. In particular, malicious behavior can masquerade as benign traffic, thus evading systems designed to catch misuse of network resources. However, perfect imitation of benign traffic is difficult, meaning that small unintentional deviations from normal can occur. Identifying these deviations requires that the defenders know what features reveal malicious behavior. Herein we present an application of compression-based analytics to network communication that can reduce the need for defenders to know a priori what features they need to examine. Motivating the approach is the idea that compression relies on the ability to discover and make use of predictable elements in information, thereby highlighting any deviations between expected and received content. We introduce a so-called “slice compression” score to identify malicious or anomalous communication in two ways. First, we apply normalized compression distances (NCDs) to classification problems and discuss methods for reducing the noise by excising application content (as opposed to protocol features) using slice compression. Second, we present a new technique for anomaly detection, referred to as slice compression for anomaly detection (SCADe). A diverse collection of datasets are analyzed to illustrate the efficacy of the proposed approaches. While our focus is network communication, other types of data are also considered to illustrate the generality of the method.

97 MATHEMATICS AND COMPUTING↗

A Genome-Based Model to Predict the Virulence of Pseudomonas aeruginosa Isolates

ABSTRACT: Variation in the genome of Pseudomonas aeruginosa , an important pathogen, can have dramatic impacts on the bacterium’s ability to cause disease. We therefore asked whether it was possible to predict the virulence of P. aeruginosa isolates based on their genomic content. We applied a machine learning approach to a genetically and phenotypically diverse collection of 115 clinical P. aeruginosa isolates using genomic information and corresponding virulence phenotypes in a mouse model of bacteremia. We defined the accessory genome of these isolates through the presence or absence of accessory genomic elements (AGEs), sequences present in some strains but not others. Machine learning models trained using AGEs were predictive of virulence, with a mean nested cross-validation accuracy of 75% using the random forest algorithm. However, individual AGEs did not have a large influence on the algorithm’s performance, suggesting instead that virulence predictions are derived from a diffuse genomic signature. These results were validated with an independent test set of 25 P. aeruginosa isolates whose virulence was predicted with 72% accuracy. Machine learning models trained using core genome single-nucleotide variants and whole-genome k-mers also predicted virulence. Our findings are a proof of concept for the use of bacterial genomes to predict pathogenicity in P. aeruginosa and highlight the potential of this approach for predicting patient outcomes. IMPORTANCE Pseudomonas aeruginosa is a clinically important Gram-negative opportunistic pathogen. P. aeruginosa shows a large degree of genomic heterogeneity both through variation in sequences found throughout the species (core genome) and through the presence or absence of sequences in different isolates (accessory genome). P. aeruginosa isolates also differ markedly in their ability to cause disease. In this study, we used machine learning to predict the virulence level of P. aeruginosa isolates in a mouse bacteremia model based on genomic content. We show that both the accessory and core genomes are predictive of virulence. This study provides a machine learning framework to investigate relationships between bacterial genomes and complex phenotypes such as virulence.

59 BASIC BIOLOGICAL SCIENCES↗

Dependence of Convective Cloud Microphysical Properties on Environmental Conditions during the TRACER and ESCAPE Field Campaigns: A Synergistic Approach of Observations, Machine Learning and Parcel Models

The sensitivity of convective clouds to aerosols and their interactions with environment, combined with limited observational constraints in parameterizations, introduces significant uncertainties in atmospheric models. Here, this study investigates the dependence of convective cloud microphysical properties on environmental conditions using a synergistic approach that combines unique observations from the TRACER and ESCAPE field campaigns, machine learning techniques, and parcel model simulations with a super-droplet microphysics scheme. A random forest algorithm identifies in-situ vertical velocity (w), temperature (T), and surface fine-mode aerosol mass concentration as the three most important environmental conditions influencing cloud properties including liquid water content (LWC), number concentration for particles with D max < 50 μm (N c ,<50), 50 μm ≤ D max ≤ 3000 μm (N c,50–3000 ), and droplet effective diameter (D e ). Results show that LWC, N c,<50 , and N c,50–3000 significantly increase with w in updrafts. Across w bins, as T decreases, LWC, D e , and N c,50–3000 increase, while N c,<50 decreases, which are closely linked to the distance above cloud bases. Warmer cloud bases yield higher LWC, greater N c,50–3000 , and smaller N c,<50 , while polluted environments produce greater N c,<50 . Parcel model simulations successfully replicate these observed dependencies. The simulation results indicate that warmer cloud bases enhance condensation generating larger droplets, and differences in droplet sizes are then amplified through collision-coalescence, resulting in a greater N c,50–3000 . Polluted conditions result in a greater N c,<50 primarily due to enhanced cloud condensation nuclei activation despite increased collision-coalescence rates compared to pristine conditions. This study provides observed quantitative patterns characterizing cloud microphysical properties as a function of key environmental parameters, offering valuable constraints for improving physics parameterizations and numerical models.

54 ENVIRONMENTAL SCIENCES↗

Dimensionally reduced machine learning model for predicting single component octanol–water partition coefficients

Abstract MF-LOGP, a new method for determining a single component octanol–water partition coefficients ( $$LogP$$ LogP ) is presented which uses molecular formula as the only input. Octanol–water partition coefficients are useful in many applications, ranging from environmental fate and drug delivery. Currently, partition coefficients are either experimentally measured or predicted as a function of structural fragments, topological descriptors, or thermodynamic properties known or calculated from precise molecular structures. The MF-LOGP method presented here differs from classical methods as it does not require any structural information and uses molecular formula as the sole model input. MF-LOGP is therefore useful for situations in which the structure is unknown or where the use of a low dimensional, easily automatable, and computationally inexpensive calculations is required. MF-LOGP is a random forest algorithm that is trained and tested on 15,377 data points, using 10 features derived from the molecular formula to make $$LogP$$ LogP predictions. Using an independent validation set of 2713 data points, MF-LOGP was found to have an average $$RMSE$$ RMSE = 0.77 ± 0.007, $$MAE$$ MAE = 0.52 ± 0.003, and $${R}^{2}$$ R 2 = 0.83 ± 0.003. This performance fell within the spectrum of performances reported in the published literature for conventional higher dimensional models ( $$RMSE$$ RMSE = 0.42–1.54, $$MAE$$ MAE = 0.09–1.07, and $${R}^{2}$$ R 2 = 0.32–0.95). Compared with existing models, MF-LOGP requires a maximum of ten features and no structural information, thereby providing a practical and yet predictive tool. The development of MF-LOGP provides the groundwork for development of more physical prediction models leveraging big data analytical methods or complex multicomponent mixtures. Graphical Abstract

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine learning identifies novel signatures of antifungal drug resistance in Saccharomycotina yeasts

Antifungal drug resistance is a major challenge in fungal infection management. Numerous genomic changes are known to contribute to acquired drug resistance in clinical isolates of specific pathogens, but whether they broadly explain natural resistance across entire lineages is unknown. We leveraged genomic, ecological, and phenotypic trait data from naturally sampled strains from nearly all known species in subphylum Saccharomycotina to examine the evolution of resistance to eight antifungal drugs. The phylogenetic distribution of drug resistance varied by drug; fluconazole resistance was widespread, while 5-fluorocytosine resistance was rare, except in Lipomycetales. A random forest algorithm trained on genomic data predicted drug-resistant yeasts with 54–75% accuracy. Fluconazole resistance was consistently predicted with the highest accuracy (75.2%). Furthermore, fluconazole resistance prediction accuracy was similar between models trained on genome-wide variation in the presence and number of InterPro protein annotations across Saccharomycotina (75.2%) and those trained on amino acid sequence alignment data of Erg11, a protein known to be involved in fluconazole resistance (74.3-74.9%). Interestingly, the top Erg11 residues for predicting fluconazole resistance across Saccharomycotina do not overlap with, are not spatially close to, and are less conserved than those previously linked to resistance in clinical isolates of Candida albicans. In silico deep mutational scanning of the C. albicans Erg11 protein reveals that amino acid variants implicated in clinical cases of resistance are almost universally destabilizing while variants in our most informative residues are energetically more neutral, explaining why the latter are much more common than the former in natural populations. Importantly, previous experimental analyses of C. albicans Erg11 have shown that amino acid variation in our most informative residues, despite having never been directly implicated in clinical cases, can directly contribute to resistance. Our results suggest that studies of natural resistance in yeast species never encountered in the clinic will yield a fuller understanding of antifungal drug resistance.

Harrison, Marie-Claire [Vanderbilt Univ., Nashvill↗

Advancing Multiscale Simulation of Plasma-Surface Interfaces

We report the development of an atomistic-informed, surface-state-dependent predictive model for particle exchange in a carbon-tungsten plasma-surface interface. The predictive model uses machine learning (ML) techniques to learn the energy and angular distributions for particle exchange and rate functions for surface state evolution from molecular dynamics simulations of cumulative bombardment of tungsten by energetic carbon ions. Each predictive component is sensitive to the energy and trajectory of incident plasma species and the surface state. The surface state is represented by a set of surface state descriptors, which were derived from the atomistic surface state for each independent carbon bombardment event. These descriptors are representative of the composition and degree of amorphization of the outermost angstrom of surface material and were chosen to optimize predictive performance for particle exchange at the interface. The distributions for particle exchange (reflection/sputtering) are demonstrated to vary with each surface state descriptor, motivating the development of surface-state-dependent particle exchange models for plasma simulations. The performance of various ML methods was compared, including polynomial quantile regression, artificial neural networks, k-nearest neighbors, and random forest algorithms, with polynomial regression performing the best for interpolation and extrapolation of learned relationships. In addition to the particle exchange model, a neutral network was developed and used to identify data sufficiency throughout surface descriptor space, which will enable real-time feedback during future data production to ensure data is produced where it is most needed, and we provide commentary on improvements to the data production workflow for future endeavors.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The direct and indirect drivers shaping RNA viral communities in grassland soil

Recent studies have revealed diverse RNA viral communities in soils. Yet, how environmental factors influence soil RNA viruses remains largely unknown. Here, we recovered RNA viral communities from 24 metatranscriptomes sequenced from grassland soils managed under a range of environmental conditions including 1) water content: 100% and 25% water holding capacity, 2) plant presence: planted with tall wheatgrass (Thinopyrum ponticum) and bare soil, 3) cultivar type: Alkar and Jose, and 4) soil depth: 0-5 cm and 15-25 cm. The recovered RNA viral communities were novel with nearly one-third of the RNA viral contigs uniquely detected in the studied grassland. The classified RNA viral contigs are mostly known as eukaryotic RNA viruses (74.7%) belonging to Phyla Duplornaviricota, Kitrinoviricota, Lenarviricota, and Pisuviricota. Eukaryotic RNA viruses of Family Mitoviridae as well as their natural hosts, Fungi, are one of the most dominant taxa. Consistent with the results of nonmetric multidimensional scaling analysis, the four environmental conditions (water content, plant presence, cultivar, and soil depth) significantly influence the assemblages of soil RNA viral communities as suggested by the correlation analysis and the random forest algorithm. The modularity analysis of the factor network and the structural equation modeling further support the hierarchical associations among the four environmental factors and the community factors representing the co-existing eukaryotic, prokaryotic, and RNA viral communities. The soil water content, plant presence, and type of cultivar demonstrate a significant positive impact on eukaryotic RNA viral richness directly as well as indirectly on eukaryotic RNA viral abundance via influencing the co-existing eukaryotic members in this soil. Our data also provide statistical support for the negative influence of soil depth on soil eukaryotic richness and abundances resulting in its indirect impact on soil eukaryotic RNA viral communities. This study provides field-relevant information on how environmental and community factors collectively shape soil RNA communities and contribute to ecological understanding of RNA viral survival under various environmental conditions and virus-host interactions in soil.

Wu, Ruonan↗

Microbial communities in the liver and brain are informative for postmortem submersion interval estimation in the late phase of decomposition: A study in mouse cadavers recovered from freshwater

Introduction Bodies recovered from water, especially in the late phase of decomposition, pose difficulties to the investigating authorities. Various methods have been proposed for postmortem submersion interval (PMSI) estimation and drowning identification, but some limitations remain. Many recent studies have proved the value of microbiota succession in viscera for postmortem interval estimation. Nevertheless, the visceral microbiota succession and its application for PMSI estimation and drowning identification require further investigation. Methods In the current study, mouse drowning and CO 2 asphyxia models were developed, and cadavers were immersed in freshwater for 0 to 14 days. Microbial communities in the liver and brain were characterized via 16S rDNA high-throughput sequencing. Results Only livers and brains collected from 5 to 14 days postmortem were qualified for sequencing. There was significant variation between microbiota from liver and brain. Differences in microbiota between the cadavers of mice that had drowned and those only subjected to postmortem submersion decreased over the PMSI. Significant successions in microbial communities were observed among the different subgroups within the late phase of the PMSI in livers and brains. Eighteen taxa in the liver which were mainly related to Clostridium_sensu_stricto and Aeromonas , and 26 taxa in the brain which were mainly belonged to Clostridium_sensu_stricto , Acetobacteroides , and Limnochorda , were selected as potential biomarkers for PMSI estimation based on a random forest algorithm. The PMSI estimation models established yielded accurate prediction results with mean absolute errors ± the standard error of 1.282 ± 0.189 d for the liver and 0.989 ± 0.237 d for the brain. Conclusions The present study provides novel information on visceral postmortem microbiota succession in corpses submerged in freshwater which sheds new light on PMSI estimation based on the liver and brain in forensic practice.

Wang, Linlin↗

Deep Learning for In-Situ Layer Quality Monitoring during Laser-Based Directed Energy Deposition (LB-DED) Additive Manufacturing Process

Defects are a leading issue for the rejection of parts manufactured through the Directed Energy Deposition (DED) Additive Manufacturing (AM) process. In an attempt to illuminate and advance in situ quality monitoring and control of workpieces, we present an innovative data-driven method that synchronously collects sensing data and AM process parameters with a low sampling rate during the DED process. The proposed data-driven technique determines the important influences that individual printing parameters and sensing features have on prediction at the inter-layer qualification to perform feature selection. Three Machine Learning (ML) algorithms including Random Forest (RF), Support Vector Machine (SVM), and Convolutional Neural Network (CNN) are used. During post-production, a threshold is applied to detect low-density occurrences such as porosity sizes and quantities from CT scans that render individual layers acceptable or unacceptable. This information is fed to the ML models for training. Training/testing are completed offline on samples deemed “high-quality” and “low-quality”, utilizing only features recorded from the build process. CNN results show that the classification of acceptable/unacceptable layers can reach between 90% accuracy while training/testing on a “high-quality” sample and dip to 65% accuracy when trained/tested on “low-quality”/“high-quality” (respectively), indicating over-fitting but showing CNN as a promising inter-layer classifier.

36 MATERIALS SCIENCE↗

Machine Learning-Based Classification of Lignocellulosic Biomass from Pyrolysis-Molecular Beam Mass Spectrometry Data

High-throughput analysis of biomass is necessary to ensure consistent and uniform feedstocks for agricultural and bioenergy applications and is needed to inform genomics and systems biology models. Pyrolysis followed by mass spectrometry such as molecular beam mass spectrometry (py-MBMS) analyses are becoming increasingly popular for the rapid analysis of biomass cell wall composition and typically require the use of different data analysis tools depending on the need and application. Here, the authors report the py-MBMS analysis of several types of lignocellulosic biomass to gain an understanding of spectral patterns and variation with associated biomass composition and use machine learning approaches to classify, differentiate, and predict biomass types on the basis of py-MBMS spectra. Py-MBMS spectra were also corrected for instrumental variance using generalized linear modeling (GLM) based on the use of select ions relative abundances as spike-in controls. Machine learning classification algorithms e.g., random forest, k-nearest neighbor, decision tree, Gaussian Naïve Bayes, gradient boosting, and multilayer perceptron classifiers were used. The k-nearest neighbors (k-NN) classifier generally performed the best for classifications using raw spectral data, and the decision tree classifier performed the worst. After normalization of spectra to account for instrumental variance, all the classifiers had comparable and generally acceptable performance for predicting the biomass types, although the k-NN and decision tree classifiers were not as accurate for prediction of specific sample types. Gaussian Naïve Bayes (GNB) and extreme gradient boosting (XGB) classifiers performed better than the k-NN and the decision tree classifiers for the prediction of biomass mixtures. The data analysis workflow reported here could be applied and extended for comparison of biomass samples of varying types, species, phenotypes, and/or genotypes or subjected to different treatments, environments, etc. to further elucidate the sources of spectral variance, patterns, and to infer compositional information based on spectral analysis, particularly for analysis of data without a priori knowledge of the feedstock composition or identity.

59 BASIC BIOLOGICAL SCIENCES↗