Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69

Monitoring leaf phenology in moist tropical forests by applying a superpixel-based deep learning method to time-series images of tree canopies

Tropical leaf phenology-particularly its variability at the tree-crown scale-dominates the seasonality of carbon and water fluxes. However, given enormous species diversity, accurate means of monitoring leaf phenology in tropical forests is still lacking. Time series of the Green Chromatic Coordinate (GCC) metric derived from tower-based red-green-blue (RGB) phenocams have been widely used to monitor leaf phenology in temperate forests, but its application in the tropics remains problematic. To improve monitoring of tropical phenology, we explored the use of a deep learning model (i.e. superpixel-based Residual Networks 50, SP-ResNet50) to automatically differentiate leaves from non-leaves in phenocam images and to derive leaf fraction at the tree-crown scale. To evaluate our model, we used a year of data from six phenocams in two contrasting forests in Panama. Here, we first built a comprehensive library of leaf and non-leaf pixels across various acquisition times, exposure conditions and specific phenocams. We then divided this library into training and testing components. We evaluated the model at three levels: 1) superpixel level with a testing set, 2) crown level by comparing the model-derived leaf fractions with those derived using image-specific supervised classification, and 3) temporally using all daily images to assess the diurnal stability of the model-derived leaf fraction. Finally, we compared the model-derived leaf fraction phenology with leaf phenology derived from GCC. Our results show that: 1) the SP-ResNet50 model accurately differentiates leaves from non-leaves (overall accuracy of 93%) and is robust across all three levels of evaluations; 2) the model accurately quantifies leaf fraction phenology across tree-crowns and forest ecosystems; and 3) the combined use of leaf fraction and GCC helps infer the timing of leaf emergence, maturation and senescence, critical information for modeling photosynthetic seasonality of tropical forests. Collectively, this study offers an improved means for automated tropical phenology monitoring using phenocams.

54 ENVIRONMENTAL SCIENCES↗

Systems and methods for customizing kernel machines with deep neural networks

A method including receiving an input data set. The input data set can include one of a feature domain set or a kernel matrix. The method also can include constructing dense embeddings using: (i) Nyström approximations on the input data set when the input data set comprises the kernel matrix, and (ii) clustered Nyström approximations on the input data set when the input data set comprises the feature domain set. The method additionally can include performing representation learning on each of the dense embeddings using a multi-layer fully-connected network for each of the dense embeddings to generate latent representations corresponding to each of the dense embeddings. The method further can include applying a fusion layer to the latent representations corresponding to the dense embeddings to generate a combined representation. The method additionally can include performing classification on the combined representation. Other embodiments of related systems and methods are also disclosed.

Song, Huan↗

Designing Remote Monitoring for Smart Manufacturing Facilities: Hazard Identification and Classification

This study investigates the process of hazard identification in complex manufacturing environments during the design phase, emphasizing the significance of the design process in developing designs that effectively mitigate hazards in contexts with numerous variables, such as a variety of machines, sensors, actuators, and agents. Through a mixed-methods approach, the objective of this work is to understand how the evolution of design outcomes across various stages might influence a designer’s ability to recognize both standard and novel hazards. To achieve this understanding, an experimental design task was conducted with six designers from a national lab specializing in manufacturing technologies. This approach combined qualitative and quantitative data analysis from a one-hour virtual session with participants. Findings suggest that the complexity of identifying hazards in a high-dimensional design space is challenging within a limited time frame and that the identification of hazards is significantly influenced by the stage of the design task and the initial design decisions, indicating the need for extended time and strategic initial planning in the design process to enhance hazard identification.

Ballestas, Caseysimone↗

Enhanced Machine-Learning Flow for Microwave-Sensing Systems for Contaminant Detection in Food

The presence of foreign bodies in packaged food is a serious concern for both fnal consumers (allergies, injuries, choking) and food manufacturers (reputation and economic losses). In particular, low-density plastics, glass and wood splinters are hard to detect even by the most advanced X-ray imagers. One solution is Machine-Learning-based Microwave Sensing (MLMWS): a non-invasive, contactless, and real-time method which uses a machine-learning (ML) classifer to analyze the scattered microwaves from the irradiated target object. In this paper, we want to extend our previous work about contaminant detection in cocoa-hazelnut spread jars by proposing an enhanced ML flow to increase the accuracy of the ML classifier. For the first time in this case study, we use a multi-class classifier, we train it with scattering parameters measured at multiple microwave frequencies, with a new pre-processing scaler, data augmentation, quantization-aware training and a pruning schedule. The results show a contaminant detection multi-class accuracy of 94.167% with a latency of 26 µs when targeting an AMD/Xilinx Kria K26 FPGA. Finally, we released our datasets publicly to OpenML.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

SDSS-IV MaNGA: Unveiling Galaxy Interaction by Merger Stages with Machine Learning

We use machine-learning techniques to classify galaxy merger stages, which can unveil physical processes that drive the star formation and active galactic nucleus (AGN) activities during galaxy interaction. The sample contains 4690 galaxies from the integral field spectroscopy survey SDSS-IV MaNGA and can be separated into 1060 merging galaxies and 3630 nonmerging or unclassified galaxies. For the merger sample, there are 468, 125, 293, and 174 galaxies (1) in the incoming pair phase, (2) in the first pericentric passage phase, (3) approaching or just passing the apocenter, and (4) in the final coalescence phase or post-mergers. With the information of projected separation, line-of-sight velocity difference, Sloan Digital Sky Survey (SDSS) gri images, and MaNGA Hα velocity map, we are able to classify the mergers and their stages with good precision, which is the most important score to identify interacting galaxies. For the two-phase classification (binary; nonmerger and merger), the performance can be high (precision > 0.90) with LGBMClassifier . We find that sample size can be increased by rotation, so the five-phase classification (nonmerger, and merger stages 1, 2, 3, and 4) can also be good (precision > 0.85). The most important features come from SDSS gri images. The contribution from the MaNGA Hα velocity map, projected separation, and line-of-sight velocity difference can further improve the performance by 0%–20%. In other words, the image and the velocity information are sufficient to capture important features of galaxy interactions, and our results can apply to all the MaNGA data, as well as future all-sky surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Lab-Scale Demonstration of Pipeline Third-Party Damage Classification Using Convolutional Neural Networks

This research aims to mitigate the challenges of field tests for classification of third-party damages by generating a dataset of third-party damage events on a laboratory scale utilizing single mode-multi mode-single mode (SMS) fiber acoustic sensor. The sound samples representative of various third-party activities, such as vehicle movements, excavation, and digging, were sourced from open-source databases. These samples were then played through a speaker in proximity to an SMS sensor, and the resultant fiber acoustic vibration data were recorded for each event. This process yielded a collection of 200 samples across 13 distinct third-party events. Convolutional Neural Networks (CNNs) were employed to classify these samples into their respective categories, and an accuracy exceeding 97% was obtained from our results.

Bukka, Sandeep Reddy↗

Morphology-Based Building Use-Type Modeling: Learnability-First Schema Discovery

This technical memorandum documents an update to the building use-type classification workflow, used in LandScan Mosaic, that replaces a fixed, semantically defined class schema with a learnability-first schema discovery procedure. Historically, the target label schema was specified a priori (e.g., predicting a chosen set of use-type codes), and model training and evaluation were performed within that fixed label space. In the updated workflow, the pipeline first evaluates which non-residential distinctions are learnable under spatial generalization and then collapses ambiguous classes into data-driven groupings before finalizing the schema used for production training.

97 MATHEMATICS AND COMPUTING↗

Demonstration of background rejection using deep convolutional neural networks in the NEXT experiment

Convolutional neural networks (CNNs) are widely used state-of-the-art computer vision tools that are becoming increasingly popular in high-energy physics. In this paper, we attempt to understand the potential of CNNs for event classification in the NEXT experiment, which will search for neutrinoless double-beta decay in $^{136}$Xe. To do so, we demonstrate the usage of CNNs for the identification of electron-positron pair production events, which exhibit a topology similar to that of a neutrinoless double-beta decay event. These events were produced in the NEXT-White high-pressure xenon TPC using 2.6 MeV gamma rays from a $^{228}$Th calibration source. We train a network on Monte Carlo-simulated events and show that, by applying on-the-fly data augmentation, the network can be made robust against differences between simulation and data. The use of CNNs offers significant improvement in signal efficiency and background rejection when compared to previous non-CNN-based analyses.[graphic not available: see fulltext]

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Novel usage of deep learning and high-performance computing in long-baseline neutrino oscillation experiments

Mención Internacional en el título de doctorDeep-learning methods are playing a crucial role in numerous scientific and industrialapplications. Over the past two decades, these techniques have helped in the collection,reconstruction, and analysis of large data samples in particle physics experiments. Themain topic of this PhD research is the study of deep-learning techniques in long-baselineneutrino oscillation experiments. Neutrinos are mysterious light elementary particles,and their investigation is essential to shed light on some of the remaining open questionsin physics. The work presented here describes an algorithm based on a convolutionalneural network developed to provide highly accurate and efficient selections of electronneutrino and muon neutrino interactions in the Deep Underground Neutrino Experiment(DUNE). With this algorithm, the electron neutrino (antineutrino) selection efficiencypeaks at 90% (94%) and exceeds 85% (90%) for reconstructed neutrino energies between2-5 GeV. The selection efficiency for muon neutrino (antineutrino) interactions is foundto have a maximum of 96% (97%) and exceeds 90% (95%) efficiency for reconstructedneutrino energies above 2 GeV. When considering all electron neutrino and antineutrinointeractions as signal (both those appearing from oscillations and those intrinsic tothe beam), a selection purity of 90% is achieved. These event selections are criticalto maximise the sensitivity of the experiment to CP-violating effects, key to furtherunderstand the matter-antimatter asymmetry of the Universe.In high-energy physics experiments, deep learning has also been explored for producingfast simulations and physically-motivated manipulations of simulated images. Some ofthose simulations, such as the light production and detection, are very computationallyexpensive and require novel methods to produce the necessary samples while controllingthe varied underlying physics model parameters. To do so, we invented the model-assistedgenerative adversarial network (MAGAN), first validated on simple generic case studiesand then successfully applied to the DUNE photon-detector simulation.Moreover, we also developed graph neural networks for 3D-voxel classification ofambiguities and optical crosstalk for a different particle physics experiment, most preciselyfor the proposed SuperFGD. This novel 3D-granular plastic-scintillator neutrino detectorwill be used to upgrade the near detector of the T2K neutrino oscillation experiment, and our method reports efficiencies and purities of 94-96% per event in the classificationof particle track voxels.Due to the growth and complexity of deep neural networks, researchers have beeninvestigating techniques to train those networks in a more computationally-efficient way.Many efforts have been made by the community to optimise deep-learning models byparallelising or distributing their training computation across multiple devices. In thisthesis, we study an approach based on data locality for those neural networks that cannotbenefit from scaling their computation due to a significant bottleneck in the data I/O.The research also includes a detailed study on the performance of deep neural networkson hardware accelerator boards.Los métodos de aprendizaje profundo son cada vez más utilizados en numerosas aplicacionescientíficas e industriales hoy en día. Durante las dos últimas décadas, estastécnicas se han empleado en la recolección, reconstrucción y análisis de la gran cantidadde datos generados por experimentos de física de partículas. El tema principal de estatesis doctoral es el uso de estos modelos de aprendizaje profundo en experimentos defísica de neutrinos, en concreto en los experimentos de larga distancia DUNE y T2K. Losneutrinos, partículas fundamentales neutras, de las más ligeras del Universo, pueden serclave para explicar algunas de las cuestiones todavía sin resolver en física fundamental.Entre las diferentes contribuciones que esta tesis ha hecho a su estudio, cabe destacar eldesarrollo de un algoritmo basado en una red de neuronas convolucional para seleccionarcon gran eficiencia y precisión las interacciones de neutrinos electrónicos y muónicos enel Deep Underground Neutrino Experiment (DUNE). La eficiencia de selección obtenidapara neutrinos (antineutrinos) electrónicos alcanza un máximo del 90% (94%) y supera el85% (90%) para neutrinos con energías reconstruidas en el rango 2-5 GeV. La selección deneutrinos (antineutrinos) muónicos tiene una eficiencia máxima del 96% (97%) y excedeel 90% (95%) para neutrinos con energías reconstruidas de más de 2 GeV. Considerandocomo señal todas las interacciones de neutrinos y antineutrinos electrónicos (procedentestanto de oscilaciones como intrínsecos en el haz inicial), se logra una pureza en la seleccióndel 90%. Dichas selecciones de eventos son fundamentales para maximizar la sensibilidaddel experimento a los efectos de violació...

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

MIGHTEE: the nature of the radio-loud AGN population

ABSTRACT We study the nature of the faint radio source population detected in the MeerKAT International GHz Tiered Extragalactic Exploration (MIGHTEE) Early Science data in the COSMOS field, focusing on the properties of the radio-loud active galactic nuclei (AGNs). Using the extensive multiwavelength data available in the field, we are able to classify 88 per cent of the 5223 radio sources in the field with host galaxy identifications as AGNs (35 per cent) or star-forming galaxies (54 per cent). We select a sample of radio-loud AGNs with redshifts out to z ∼ 6 and radio luminosities 1020 < L1.4 GHz/W Hz−1 < 1027 and classify them as high-excitation and low-excitation radio galaxies (HERGs and LERGs). The classification catalogue is released with this work. We find no significant difference in the host galaxy properties of the HERGs and LERGs in our sample. In contrast to previous work, we find that the HERGs and LERGs have very similar Eddington-scaled accretion rates; in particular we identify a population of very slowly accreting AGNs that are formally classified as HERGs at these low radio luminosities, where separating into HERGs and LERGs possibly becomes redundant. We investigate how black hole mass affects jet power, and find that a black hole mass ≳ 107.8 M⊙ is required to power a jet with mechanical power greater than the radiative luminosity of the AGN (Lmech/Lbol > 1). We discuss that both a high black hole mass and black hole spin may be necessary to launch and sustain a dominant radio jet.

Whittam, I. H. (ORCID:0000000322655983)↗

Dark Energy Survey Year 6 Results: Synthetic-source Injection Across the Full Survey Using Balrog

Synthetic source injection (SSI), the insertion of sources into pixel-level on-sky images, is a powerful method for characterizing object detection and measurement in wide-field, astronomical imaging surveys. Within the Dark Energy Survey (DES), SSI plays a critical role in characterizing all necessary algorithms used in converting images to catalogs, and in deriving quantities needed for the cosmology analysis, such as object detection rates, galaxy redshift estimation, galaxy magnification, star-galaxy classification, and photometric performance. We present here a source injection catalog of 146 million injections spanning the entire 5000 deg 2 DES footprint, generated using the Balrog SSI pipeline. Through this SSI sample, we demonstrate that the DES Year 6 (Y6) image processing pipeline provides accurate estimates of the object properties, for both galaxies and stars, at the percent-level, and we highlight specific regimes where the accuracy is reduced. We then show the consistency between SSI and data catalogs, for all galaxy samples developed within the weak lensing and galaxy clustering analyses of DES Y6. The consistency between the two catalogs also extends to their correlations with survey observing properties (seeing, airmass, depth, extinction, etc.). Lastly, we highlight a number of applications of this catalog to the DES Y6 cosmology analysis, such as estimates of the redshift distribution and lens magnification. This dataset is the largest SSI catalog produced at this fidelity and will serve as a key testing ground for exploring the utility of SSI catalogs in upcoming surveys such as the Vera C. Rubin Observatory Legacy Survey of Space and Time.

79 ASTRONOMY AND ASTROPHYSICS↗

ARMing the Edge: Designing Edge Computing–Capable Machine Learning Algorithms to Target ARM Doppler Lidar Processing

Abstract There is a need for long-term observations of cloud and precipitation fall speeds in validating and improving rainfall forecasts from climate models. To this end, the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility Southern Great Plains (SGP) site at Lamont, Oklahoma, hosts five ARM Doppler lidars that can measure cloud and aerosol properties. In particular, the ARM Doppler lidars record Doppler spectra that contain information about the fall speeds of cloud and precipitation particles. However, due to bandwidth and storage constraints, the Doppler spectra are not routinely stored. This calls for the automation of cloud and rain detection in ARM Doppler lidar data so that the spectral data in clouds can be selectively saved and further analyzed. During the ARMing the Edge field experiment, a Waggle node capable of performing machine learning applications in situ was deployed at the ARM SGP site for this purpose. In this paper, we develop and test four algorithms for the Waggle node to automatically classify ARM Doppler lidar data. We demonstrate that supervised learning using a ResNet50-based classifier will classify 97.6% of the clear-air images and 94.7% of cloudy images correctly, outperforming traditional peak detection methods. We also show that a convolutional autoencoder paired with k -means clustering identifies 10 clusters in the ARM Doppler lidar data. Three clusters correspond to mostly clear conditions with scattered high clouds, and seven others correspond to cloudy conditions with varying cloud-base heights.

54 ENVIRONMENTAL SCIENCES↗

Codes and standards for ceramic composite core materials for High Temperature Reactor applications

Fiber-reinforced ceramic matrix composites are attractive for high-temperature nuclear applications due to excellent thermal and mechanical properties as well as reasonable-to-outstanding radiation resistance. Over the past 20 years, the use of ceramic matrix composite applications expanded to many commercial non-nuclear industries as fabrication and application of the technologies mature. The ASME Boiler Pressure Vessel Code, under Section III Division 5, provides the design and construction rules for High Temperature Reactor components. It published the first rules for ceramic matrix composites to be used for reactor core components. The rules lay out the quality requirements together with the design and materials criteria for the use and application of silicon carbide- and carbon-based matrix material technologies. As with the established graphite rules, the ceramic composite material rules are structured in Subsection HH (from Section III), that addresses the criteria for class SN nonmetallic core components. The code rules rely heavily on the development and publication of standards for composite specification, classification, and testing of mechanical, thermal, and other properties. These test methods are developed in ASTM Committee C28 on Advanced Ceramics, with a current focus on ceramic composite tubes. This article describes the detail of the composites code, the design methodology and similarities to the graphite code, the guidance for the development of specifications for ceramic composites (for nuclear applications) including recent standard developments, and it mentions the next steps to support licensing aspects by validating the code with benchmarking data.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Development and Evaluation of Ensemble Learning-based Environmental Methane Detection and Intensity Prediction Models

The environmental impacts of global warming driven by methane (CH 4 ) emissions have catalyzed significant research initiatives in developing novel technologies that enable proactive and rapid detection of CH 4 . Several data-driven machine learning (ML) models were tested to determine how well they identified fugitive CH 4 and its related intensity in the affected areas. Various meteorological characteristics, including wind speed, temperature, pressure, relative humidity, water vapor, and heat flux, were included in the simulation. We used the ensemble learning method to determine the best-performing weighted ensemble ML models built upon several weaker lower-layer ML models to (i) detect the presence of CH 4 as a classification problem and (ii) predict the intensity of CH 4 as a regression problem. The classification model performance for CH 4 detection was evaluated using accuracy, F1 score, Matthew’s Correlation Coefficient (MCC), and the area under the receiver operating characteristic curve (AUC ROC), with the top-performing model being 97.2%, 0.972, 0.945 and 0.995, respectively. The R 2 score was used to evaluate the regression model performance for CH 4 intensity prediction, with the R 2 score of the best-performing model being 0.858. The ML models developed in this study for fugitive CH 4 detection and intensity prediction can be used with fixed environmental sensors deployed on the ground or with sensors mounted on unmanned aerial vehicles (UAVs) for mobile detection.

Majumder, Reek↗

Failure diagnosis and trend‐based performance losses routines for the detection and classification of incidents in large‐scale photovoltaic systems

Abstract Fault detection and classification in photovoltaic (PV) systems through real‐time monitoring is a fundamental task that ensures quality of operation and significantly improves the performance and reliability of operating systems. Different statistical and comparative approaches have already been proposed in the literature for fault detection; however, accurate classification of fault and loss incidents based on PV performance time series remains a key challenge. Failure diagnosis and trend‐based performance loss routines were developed in this work for detecting PV underperformance and accurately identifying the different fault types and loss mechanisms. The proposed routines focus mainly on the differentiation of failures (e.g., inverter faults) from irreversible (e.g., degradation) and reversible (e.g., snow and soiling) performance loss factors based on statistical analysis. The proposed routines were benchmarked using historical inverter data obtained from a 1.8 MWp PV power plant. The results demonstrated the effectiveness of the routines for detecting failures and loss mechanisms and the capability of the pipeline for distinguishing underperformance issues using anomaly detection and change‐point (CP) models. Finally, a CP model was used to extract significant changes in time series data, to detect soiling and cleaning events and to estimate both the performance loss and degradation rates of fielded PV systems.

14 SOLAR ENERGY↗

Search for charged-lepton flavour violation in top quark interactions with an up-type quark, a muon, and a $τ$ lepton in proton-proton collisions at $\sqrt{s}$ = 13 TeV

A search for charged-lepton flavour violation (CLFV) in top quark (t) production and decay is presented. The search uses proton-proton collision data corresponding to 138 fb$^{-1}$ collected with the CMS experiment at $\sqrt{s}$ = 13 TeV. The signal consists of the production of a single top quark via a CLFV interaction or top quark pair production followed by a CLFV decay. The analysis selects events containing a hadronically decaying $τ$ lepton and a muon of opposite electric charge, as well as at least three jets, one of which is identified as originating from the fragmentation of a bottom quark. Machine learning classification techniques are used to distinguish signal from standard model background events. The results of this search are consistent with the standard model expectations. The upper limits at 95% confidence level on the branching fraction $\mathcal{B}$ for CLFV top quark decays to a muon, a $τ$ lepton, and an up or a charm quark are set at $\mathcal{B}$(t $\to$ $μτ$u) $\lt$ (0.04, 0.08, and 0.12) $\times$ 10$^{-6}$, and $\mathcal{B}$(t $\to$ $μτ$c) $\lt$ (0.81, 1.71, and 2.05) $\times$ 10$^{-6}$ for scalar, vector, and tensor-like operators, respectively.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Gap-filled water quality, Normalized Differenced Vegetation Index, total nitrogen (nitrate and ammonia) deposition, and land cover data trends for the Continental United States

The purpose of this work was to quantify trends in water quality, total nitrogen deposition, vegetation, and land-use trends for the Continental United States (CONUS). This dataset contains gap-filled daily and yearly in-stream carbon (C) and nitrogen (N) concentrations, discharge, and calculated exports from United States Geological Survey (USGS) National Water Information System (NWIS) stations across the United States of six different nitrogen parameters (Supplementary Table A1), one carbon parameter, and temperature (USGS, 2016, 2018) (https://waterdata.usgs.gov/nwis). The final water quality dataset is merged with the normalized differenced vegetation index (NDVI), total deposition (TDEP), landcover, and elevation datasets. All data are available at the CONUS scale as well as at the scale of hydrologic unit codes: (HUC) HUC8, HUC6, HUC4, and HUC2 watersheds. There are two zip files associated with this data package. I split the data into two equal sized zip files to comply with the data size limits, however the datasets are the same within each zip file. All data files can be read in directly into the R software.

54 ENVIRONMENTAL SCIENCES↗

Combining Spike Time Dependent Plasticity (STDP) and Backpropagation (BP) for Robust and Data Efficient Spiking Neural Networks (SNN)

National security applications require artificial neural networks (ANNs) that consume less power, are fast and dynamic online learners, are fault tolerant, and can learn from unlabeled and imbalanced data. We explore whether two fundamentally different, traditional learning algorithms from artificial intelligence and the biological brain can be merged. We tackle this problem from two directions. First, we start from a theoretical point of view and show that the spike time dependent plasticity (STDP) learning curve observed in biological networks can be derived using the mathematical framework of backpropagation through time. Second, we show that transmission delays, as observed in biological networks, improve the ability of spiking networks to perform classification when trained using a backpropagation of error (BP) method. These results provide evidence that STDP could be compatible with a BP learning rule. Combining these learning algorithms will likely lead to networks more capable of meeting our national security missions.

97 MATHEMATICS AND COMPUTING↗