Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “CLASSIFICATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Prenatal Ultrasound Analysis of Umbilical‐Portal‐Systemic Venous Shunts Concurrent With Trisomy 21

Objectives A classification termed umbilical‐portal‐systemic venous shunt (UPSVS) for an abnormal umbilical vein (UV), portal vein (PV), and ductus venosus (DV) was proposed recently. According to this classification, there are 3 types of UPSVSs: types I, II, and III. Trisomy 21 associated with UV‐PV‐DV anomalies has been described, but the incidence of trisomy 21 in UPSVS cases, the relationship between UPSVS types and trisomy 21, and the pregnancy outcome are poorly documented. This study aimed to address these issues. Methods All UPSVS cases diagnosed at our department from 2016 to 2019 were retrospectively studied. The English literature describing UV‐PV‐DV anomalies and trisomy 21 from 2000 to 2019 was searched, and the retrieved cases were analyzed. Results Four of 20 UPSVS cases identified by us also had trisomy 21, with 2 type I and 2 type II UPSVSs. Ultrasound markers of Down syndrome were observed in all 4 cases that underwent termination of pregnancy (TOP). The literature search retrieved 12 reports including 279 patients, with 29 also having trisomy 21, giving a pooled trisomy 21 incidence rate of 10.4%. Of the 29 cases, 16 had type I, and 9 had type II, whereas UPSVS types in 4 were undeterminable, and 22 cases underwent TOP. Conclusions There is a high incidence of trisomy 21 in UPSVS cases. Trisomy 21 is associated with a type I or II UPSVS. Most cases with the combined defect underwent TOP. These findings may be used to direct prenatal counseling and management of the combined condition.

Dong, Xiangyi↗
DOE OSTI2024

Quantifying leaf symptoms of sorghum charcoal rot in images of field‐grown plants using deep neural networks

Abstract Charcoal rot of sorghum (CRS) is a significant disease affecting sorghum crops, with limited genetic resistance available. The causative agent, Macrophomina phaseolina (Tassi) Goid, is a highly destructive fungal pathogen that targets over 500 plant species globally, including essential staple crops. Utilizing field image data for precise detection and quantification of CRS could greatly assist in the prompt identification and management of affected fields and thereby reduce yield losses. The objective of this work was to implement various machine learning algorithms to evaluate their ability to accurately detect and quantify CRS in red‐green‐blue images of sorghum plants exhibiting symptoms of infection. EfficientNet‐B3 and a fully convolutional network emerged as the top‐performing models for image classification and segmentation tasks, respectively. Among the classification models evaluated, EfficientNet‐B3 demonstrated superior performance, achieving an accuracy of 86.97%, a recall rate of 0.71, and an F1 score of 0.73. Of the segmentation models tested, FCN proved to be the most effective, exhibiting a validation accuracy of 97.76%, a recall rate of 0.68, and an F1 score of 0.66. As the size of the image patches increased, both models’ validation scores increased linearly, and their inference time decreased exponentially. This trend could be attributed to larger patches containing more information, improving model performance, and fewer patches reducing the computational load, thus decreasing inference time. The models, in addition to being immediately useful for breeders and growers of sorghum, advance the domain of automated plant phenotyping and may serve as a foundation for drone‐based or other automated field phenotyping efforts. Additionally, the models presented herein can be accessed through a web‐based application where users can easily analyze their own images.

Gonzalez, Emmanuel M.↗
DOE OSTI2023

Differential Property Prediction: A Machine Learning Approach to Experimental Design in Advanced Manufacturing

Advanced manufacturing techniques have enabled the production of materials with state-of-the-art properties. In many cases however, the development of physics-based models of these techniques lags behind their development in the lab. This means that material and process development proceeds largely via trial and error. This is sub-optimal since experiments are cost-, time-, and labor-intensive. In this work we propose a machine learning framework, differential property classification (DPC), which enables an experimenter to leverage machine learning's unparalleled pattern matching capability to pursue data-driven experimental design. DPC takes two possible experiment parameter sets and outputs a prediction of which will produce a material with a more desirable property specified by the operator. We demonstrate the success of DPC on AA7075 tube manufacturing process and mechanical property data using shear assisted processing and extrusion (ShAPE), an emerging solid phase processing technology. We show that by focusing on the experimenter's need to choose between multiple candidate experimental parameters, we can reframe the challenging regression task of predicting material properties from processing parameters, into a classification task on which machine learning models can achieve good performance.

advanced manufacturing, machine learning, ShAPE↗
DOE OSTI2024

Provable Repair of Vision Transformers

Vision Transformers have emerged as state-of-the-art image recognition tools, but may still exhibit incorrect behavior. Incorrect image recognition can have disastrous consequences in safety-critical real-world applications such as self-driving automobiles. In this paper, we present Provable Repair of Vision Transformers (PRoViT), a provable repair approach that guarantees the correct classification of images in a repair set for a given Vision Transformer without modifying its architecture. PRoViT avoids negatively affecting correctly classified images (drawdown) by minimizing the changes made to the Vision Transformer’s parameters and original output. Here, we observe that for Vision Transformers, unlike for other architectures such as ResNet or VGG, editing just the parameters in the last layer achieves correctness guarantees and very low drawdown. We introduce a novel method for editing these last-layer parameters that enables PRoViT to efficiently repair state-of-the-art Vision Transformers for thousands of images, far exceeding the capabilities of prior provable repair approaches.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Sum rules in the standard model effective field theory from helicity amplitudes

The dispersion relation of an elastic 4-point amplitude in the forward direction leads to a sum rule that connects the low energy amplitude to the high energy observables. We perform a classification of these sum rules based on massless helicity amplitudes. With this classification, we are able to systematically write down the sum rules for the dimension-6 operators of the Standard Model Effective Field Theory (SMEFT), some of which are absent in previous literatures. These sum rules offer distinct insights on the relations between the operator coefficients in the EFT and the properties of the full theory that generates them. Their applicability goes beyond tree level, and in some cases can be used as a practical method of computing the one loop contributions to low energy observables. They also provide an interesting perspective for understanding the custodial symmetries of the SM Higgs and fermion sectors.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Global flow structure and exact formal transseries of the Gubser flow in kinetic theory

In this work we introduce the generic conditions for the existence of a non-equilibrium attractor that is an invariant manifold determined by the long-wavelength modes of the physical system. We investigate the topological properties of the global flow structure of the Gubser flow for the Israel-Stewart theory and a kinetic model for the Boltzmann equation by employing Morse-Smale theory. We present a complete classification of the invariant submanifolds of the flow and determine all the possible flow lines connecting any pair of UV/IR fixed points. The formal transseries solutions to the Gubser dynamical system around the early-time (UV) and late-time (IR) fixed points are constructed and analyzed. It is proven that these solutions are purely perturbative (or power-law asymptotic) series with a finite radius of convergence. Based on these analyses, we find that Gubser-like expanding kinetic systems do not hydrodynamize owing to the failure of the hydrodynamization process which heavily relies on the classification of (non)hydrodynamic modes in the IR regime. This is in contrast to longitudinal boost-invariant plasmas where the asymptotic dynamics is described by a few terms of the hydrodynamic gradient expansion. We finally compare our results for both Bjorken and Gubser conformal kinetic models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Holomorphic modular bootstrap revisited

In this work we revisit the “holomorphic modular bootstrap”, i.e. the classification of rational conformal field theories via an analysis of the modular differential equations satisfied by their characters. By making use of the representation theory of PSL(2, $\mathbb{Z}_n$), we describe a method to classify allowed central charges and weights (c, h i ) for theories with any number of characters d. This allows us to avoid various bottlenecks encountered previously in the literature, and leads to a classification of consistent characters up to d = 5 whose modular differential equations are uniquely fixed in terms of (c, h i ). In the process, we identify the full set of constraints on the allowed values of the Wronskian index for fixed d ≤ 5.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Assessing decision boundaries under uncertainty

In order to make design decisions, engineers may seek to identify regions of the design domain that are acceptable in a computationally efficient manner. A design is typically considered acceptable if its reliability with respect to parametric uncertainty exceeds the designer’s desired level of confidence. Despite major advancements in reliability estimation and in design classification via decision boundary estimation, the current literature still lacks a design classification strategy that incorporates parametric uncertainty and desired design confidence. To address this gap, this paper offers a novel interpretation of the acceptance region by defining the decision boundary as the hypersurface which isolates the designs that exceed a user-defined level of confidence given parametric uncertainty. This work addresses the construction of this novel decision boundary using computationally efficient algorithms that were developed for reliability analysis and decision boundary estimation. The approach proposed in this paper is verified on two physical examples from structural and thermal analysis using Support Vector Machines and Efficient Global Optimization-based contour estimation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Predicting chatter using machine learning and acoustic signals from low-cost microphones

Machining chatter is a phenomenon resulting from self-oscillation between a machining tool and workpiece. This self-oscillation results in variation on the machined product that reduces the ability to meet desired specifications. Chatter is a widely studied topic as it directly relates to the quality of machined products. Here, this study details the application of a Random Forest (RF) classifier with Recursive Feature Elimination (RFE) to machining audio collected by a single microphone during down-milling operations. This approach allows straightforward feature elimination that results in an easily understood set of analyzed dimensions. Stability is predicted solely based on the classification output of the RF classifier. Our approach proves highly predictive with consistent machining setup and a small sample set. We also review transferability between machining setups and present key findings. Our RF approach demonstrates the ability to analyze and classify chatter through a low-cost approach with limited training data required. The motivation for using a single microphone is to enable detection on machines without other sensors, such as accelerometers, present in the machining setup. The value of the in-process sensor and chatter classifier is highlighted because the machining setup included asymmetric dynamics that reduced the accuracy of the traditional analytical stability solution. We see a natural progression to deploying this audio-only methodology with real-time processing and classification using either a laptop or smartphone. This progression will allow visual indicators during the machining process that can alert machinists of progression into unstable machining processes.

42 ENGINEERING↗
DOE OSTI2023

Uncovering acoustic signatures of pore formation in laser powder bed fusion

Abstract We present a machine learning workflow to discover signatures in acoustic measurements that can be utilized to create a low-dimensional model to accurately predict the location of keyhole pores formed during additive manufacturing processes. Acoustic measurements were sampled at 100 kHz during single-layer laser powder bed fusion (LPBF) experiments, and spatio-temporal registration of pore locations was obtained from post-build radiography. Power spectral density (PSD) estimates of the acoustic data were then decomposed using non-negative matrix factorization with custom $$\varvec{k}$$ k -means clustering (NMF $$\varvec{k}$$ k ) to learn the underlying spectral patterns associated with pore formation. NMF $$\varvec{k}$$ k returned a library of basis signals and matching coefficients to blindly construct a feature space based on the PSD estimates in an optimized fashion. Moreover, the NMF $$\varvec{k}$$ k decomposition led to the development of computationally inexpensive machine learning models which are capable of quickly and accurately identifying pore formation with classification accuracy of supervised and unsupervised label learning greater than 95% and 90%, respectively. The intrinsic data compression of NMF k , the relatively light computational cost of the machine learning workflow, and the high classification accuracy makes the proposed workflow an attractive candidate for edge computing toward in-situ keyhole pore prediction in LPBF.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Fermionic Finite-Group Gauge Theories and Interacting Symmetric/Crystalline Orders via Cobordisms

We formulate a family of spin Topological Quantum Field Theories (spin-TQFTs) as fermionic generalization of bosonic Dijkgraaf–Witten TQFTs. They are obtained by gauging G-equivariant invertible spin-TQFTs, or, in physics language, gauging the interacting fermionic Symmetry Protected Topological states (SPTs) with a finite group G symmetry. We use the fact that the torsion part of the classification is given by Pontryagin duals to spin-bordism groups of the classifying space BG. We also consider unoriented analogues, that is G-equivariant invertible pin ± -TQFTs (fermionic time-reversal-SPTs) and their gauging. We compute these groups for various examples of abelian G using Adams spectral sequence and describe all corresponding TQFTs via certain bordism invariants in 3, 4 and other dimensions. This gives explicit formulas for the partition functions of spin-TQFTs on closed manifolds with possible extended operators inserted. The results also provide explicit classification of ’t Hooft anomalies of fermionic QFTs with finite abelian group symmetries in one dimension lower. We construct new anomalous boundary spin-TQFTs (surface fermionic topological orders). Finally, we explore SPT and symmetry enriched topologically (SET) ordered states, and crystalline SPTs protected by space-group (e.g. translation Z) or point-group (e.g. reflection, inversion or rotation C m ) symmetries, via the layer-stacking construction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Peri-Net-Pro: the neural processes with quantified uncertainty for crack patterns

Abstract This paper develops a deep learning tool based on neural processes (NPs) called the Peri-Net-Pro, to predict the crack patterns in a moving disk and classifies them according to the classification modes with quantified uncertainties. In particular, image classification and regression studies are conducted by means of convolutional neural networks (CNNs) and NPs. First, the amount and quality of the data are enhanced by using peridynamics to theoretically compensate for the problems of the finite element method (FEM) in generating crack pattern images. Second, case studies are conducted with the prototype microelastic brittle (PMB), linear peridynamic solid (LPS), and viscoelastic solid (VES) models obtained by using the peridynamic theory. The case studies are performed to classify the images by using CNNs and determine the suitability of the PMB, LBS, and VES models. Finally, a regression analysis is performed on the crack pattern images with NPs to predict the crack patterns. The regression analysis results confirm that the variance decreases when the number of epochs increases by using the NPs. The training results gradually improve, and the variance ranges decrease to less than 0.035. The main finding of this study is that the NPs enable accurate predictions, even with missing or insufficient training data. The results demonstrate that if the context points are set to the 10th, 100th, 300th, and 784th, the training information is deliberately omitted for the context points of the 10th, 100th, and 300th, and the predictions are different when the context points are significantly lower. However, the comparison of the results of the 100th and 784th context points shows that the predicted results are similar because of the Gaussian processes in the NPs. Therefore, if the NPs are employed for training, the missing information of the training data can be supplemented to predict the results.

Mathematics↗
DOE OSTI2025

Explaining word embeddings with perfect fidelity: a case study in predicting research impact

The best-performing approaches for scholarly document quality prediction are based on embedding models. In addition to their performance when used in classifiers, embedding models can also provide predictions even for words that were not contained in the labelled training data for the classification model, which is important in the context of the ever-evolving research terminology. Although model-agnostic explanation methods, such as Local interpretable model-agnostic explanations, can be applied to explain machine learning classifiers trained on embedding models, these produce results with questionable correspondence to the model. We introduce a new feature importance method, Self-Model Entities Rated (SMER), for logistic regression-based classification models trained on word embeddings. We show that SMER has theoretically perfect fidelity with the explained model, as the average of logits of SMER scores for individual words (SMER explanation) exactly corresponds to the logit of the prediction of the explained model. Quantitative and qualitative evaluation is performed through five diverse experiments conducted on 50,000 research articles (papers) from the CORD-19 corpus. In conclusion, through an AOPC curve analysis, we experimentally demonstrate that SMER produces better explanations than LIME, SHAP and global tree surrogates.

Coarse-grained models↗
DOE OSTI2021

Charged Particle Tracking via Edge-Classifying Interaction Networks

Recent work has demonstrated that geometric deep learning methods such as graph neural networks (GNNs) are well suited to address a variety of reconstruction problems in high-energy particle physics. In particular, particle tracking data are naturally represented as a graph by identifying silicon tracker hits as nodes and particle trajectories as edges, given a set of hypothesized edges, edge-classifying GNNs identify those corresponding to real particle trajectories. In this work, we adapt the physics-motivated interaction network (IN) GNN toward the problem of particle tracking in pileup conditions similar to those expected at the high-luminosity Large Hadron Collider. Assuming idealized hit filtering at various particle momenta thresholds, we demonstrate the IN’s excellent edge-classification accuracy and tracking efficiency through a suite of measurements at each stage of GNN-based tracking: graph construction, edge classification, and track building. The proposed IN architecture is substantially smaller than previously studied GNN tracking architectures; this is particularly promising as a reduction in size is critical for enabling GNN-based tracking in constrained computing environments. Furthermore, the IN may be represented as either a set of explicit matrix operations or a message passing GNN. Efforts are underway to accelerate each representation via heterogeneous computing resources towards both high-level and low-latency triggering applications.

accelerator physics↗
DOE OSTI2023

Batch Active Learning for Multispectral and Hyperspectral Image Segmentation Using Similarity Graphs

Abstract Graph learning, when used as a semi-supervised learning (SSL) method, performs well for classification tasks with a low label rate. We provide a graph-based batch active learning pipeline for pixel/patch neighborhood multi- or hyperspectral image segmentation. Our batch active learning approach selects a collection of unlabeled pixels that satisfy a graph local maximum constraint for the active learning acquisition function that determines the relative importance of each pixel to the classification. This work builds on recent advances in the design of novel active learning acquisition functions (e.g., the Model Change approach in arXiv:2110.07739) while adding important further developments including patch-neighborhood image analysis and batch active learning methods to further increase the accuracy and greatly increase the computational efficiency of these methods. In addition to improvements in the accuracy, our approach can greatly reduce the number of labeled pixels needed to achieve the same level of the accuracy based on randomly selected labeled pixels.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Multilabel proportion prediction and out-of-distribution detection on gamma spectra of short-lived fission products

In the machine learning problem of multilabel classification, the objective is to determine for each test instance which classes the instance belongs to. In this work, we consider an extension of multilabel classification, called multilabel proportion prediction, in the context of radioisotope identification (RIID) using gamma spectra data. We aim to not only predict radioisotope proportions, but also identify out-of-distribution (OOD) spectra. We achieve this goal by viewing gamma spectra as discrete probability distributions, and based on this perspective, we develop a custom semi-supervised loss function that combines a traditional supervised loss with an unsupervised reconstruction error function. Our approach was motivated by its application to the analysis of short-lived fission products from spent nuclear fuel. In particular, we demonstrate that a neural network model trained with our loss function can successfully predict the relative proportions of 37 radioisotopes simultaneously. The model trained with synthetic data was then applied to measurements taken by Pacific Northwest National Laboratory (PNNL) to conduct analysis typically done by subject-matter experts. Here, we also extend our approach to successfully identify when measurements are OOD, and thus should not be trusted, whether due to the presence of a novel source or novel proportions.

Anomaly detection↗
DOE OSTI2020

DeepMerge: Classifying high-redshift merging galaxies with deep neural networks

In this work, we investigate and demonstrate the use of convolutional neural networks (CNNs) for the task of distinguishing between merging and non-merging galaxies in simulated images, and for the first time at high redshifts (i.e. $z=2$). We extract images of merging and non-merging galaxies from the Illustris-1 cosmological simulation and apply observational and experimental noise that mimics that from the Hubble Space Telescope; the data without noise form a "pristine" data set and that with noise form a "noisy" data set. The test set classification accuracy of the CNN is $79\%$ for pristine and $76\%$ for noisy. The CNN outperforms a Random Forest classifier, which was shown to be superior to conventional one- or two-dimensional statistical methods (Concentration, Asymmetry, the Gini, $M_{20}$ statistics etc.), which are commonly used when classifying merging galaxies. We also investigate the selection effects of the classifier with respect to merger state and star formation rate, finding no bias. Finally, we extract Grad-CAMs (Gradient-weighted Class Activation Mapping) from the results to further assess and interrogate the fidelity of the classification model.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Interlaboratory Study: Testing Reproducibility of Solid Biofuels Component Identification Using Reflected Light Microscopy

Considering global market trends and concerns about climate change and sustainability, increased biomass use for energy is expected to continue. As more diverse materials are being utilized to manufacture solid biomass fuels, it is critical to implement quality assessment methods to analyze these fuels thoroughly. One such method is reflected light microscopy (RLM), which has the potential to complement and enhance current standard testing, leading to improving fuel quality assessment and, ultimately, preventing avoidable air pollution. An interlaboratory study (ILS) was conducted to test the reproducibility of biomass fuels component identification using a reflected light microscopy technique. The exercise was conducted on thirty photomicrographs showing biomass and various undesired components (like plastics or mineral matter), which were purposely added (by the ILS organizers) to contaminate wood pellets and charcoal-based grilling fuels. Forty-six participants had various levels of difficulty identifying the marked components, and as a result, the percentage of correct answers ranged from 52.2 to 94.4%. Among the most difficult components to distinguish were petroleum products and inorganic matter. Various reasons led to the misidentification, including insufficient morphological descriptions of the components provided to participants, ambiguities of the nomenclature, limitations of the analytical and exercise method, and insufficient experience of the participants. Overall, the results indicate that RLM has the potential to enhance the quality assessment of biomass fuels. However, they also demonstrate that the petrographic classification used in this exercise requires further refinement before it can be standardized. While a new simplified classification of solid biomass fuels components was created as an outcome of this study, future research is necessary to refine the nomenclature, develop a microscopic morphological description of the components, and verify the accuracy of component identification with a follow-up ILS.

biomass↗