Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Generalization of Deep-Learning Models for Classification of Local Distance Earthquakes and Explosions across Various Geologic Settings

Although accurately classifying signals from earthquakes and explosions at local distance (<250 km) remains an important task for seismic network operations, the growing volume of available seismic data presents a challenge for analysts using traditional source discrimination techniques. In recent years, deep-learning models have proven effective at discriminating between low-magnitude earthquakes and explosions measured at local distances, but it is not clear how well these models are capable of generalizing across different geological settings. To address the issue of generalization between regions, we train deep-learning models (convolutional neural networks [CNNs]) on time–frequency representations (scalograms) of three-component earthquake and explosion signals from eight different regions in the continental United States. We explore scenarios where models are trained on data from all regions, individual regions, or all but one region. We find that although CNN models trained on individual regions do not necessarily generalize well across different settings, models trained on multiple regions that include diverse path coverage generalize to new regions, with station-level accuracy of up to 90% or more for data sets from unseen regions. In general, CNN-based discrimination models significantly outperform models based on uncorrected P/S ratio (measured in the 10–18 Hz frequency band), even when CNN models are tested on data from entirely unseen regions.

58 GEOSCIENCES↗

Retrieval Augmented Generation for Robust Cyber Defense

In cybersecurity, the ability to efficiently analyze and respond to vulnerabilities, weaknesses, attack patterns, and threat tactics is critical for effective defense strategies. With the increasing complexity and volume of cybersecurity data, traditional methods of querying and retrieving information are often inadequate. To address this challenge, we implemented Retrieval-Augmented Generation (RAG) systems—CyRAG and GraphCyRAG—that integrate large language models (LLMs) with both structured data from relational databases and knowledge graphs such as Neo4j. CyRAG is designed to handle structured data, focusing on CVE (Common Vulnerabilities and Exposures) and CWE (Common Weakness Enumeration) entities to generate accurate and context-rich responses. In contrast, GraphCyRAG leverages Neo4j knowledge graphs to retrieve interconnected information from CVE, CWE, CAPEC (Common Attack Pattern Enumeration and Classification), and ATT&CK (Adversarial Tactics, Techniques, and Common Knowledge) datasets. By utilizing Neo4j’s graph-based framework, GraphCyRAG enables deeper traversal of relationships between vulnerabilities and attack patterns, providing cybersecurity analysts with more comprehensive insights into potential attack vectors and mitigation strategies. Our preliminary results demonstrate that integrating knowledge graphs with RAG significantly enhances both the accuracy and depth of threat analysis, allowing for the retrieval of dynamic, real-time data and the generation of contextually aware responses. This approach helps analysts uncover hidden relationships between cyber entities, predict exploit paths, and prioritize mitigation efforts effectively. The integration of RAG with cybersecurity knowledge graphs represents a significant advancement in cybersecurity threat intelligence, enabling more informed decision-making and stronger defense strategies.

97 MATHEMATICS AND COMPUTING↗

The Preprocessing of Galaxies in the Early Stages of Cluster Formation in Abell 1882 at z = 0.139

A rare opportunity to distinguish between internal and environmental effects on galaxy evolution is afforded by "SuperGroups," systems that are rich and massive, but include several comparably rich substructures, surrounded by filaments. We present here a multiwavelength photometric and spectroscopic study of the galaxy population in the SuperGroup Abell 1882 (A1882) at z = 0.139, combining new data from the MMT and Hectospec with archival results from the Galaxy And Mass Assembly survey, the Sloan Digital Sky Survey, the Nasa/IPAC Extragalactic Database, the Gemini Multi-Object Spectrograph, and the Galaxy Evolution Explorer. These provide spectroscopic classifications for 526 member galaxies, across wide ranges of local density and velocity dispersion. We identify three prominent filaments along which galaxies seem to be entering the SuperGroup (mostly in E–W directions). A1882 has a well-populated red sequence, containing most galaxies with stellar mass >10 10.5 M Sun , and a pronounced color–density relation even within its substructures. Thus, galaxy evolution responds to the external environment as strongly in these unrelaxed systems as we find in rich and relaxed clusters. From these data, local density remains the primary factor, with a secondary role for distance from the inferred center of the entire structure's potential well. The effects on star formation, as traced by optical and near-UV colors, depend on galaxy mass. We see changes in lower-mass galaxies (M < 10 10.5 M Sun ) at four times the virial radius of major substructures, while the more massive near-UV Green Valley galaxies show low levels of star formation within two virial radii. The suppression of star formation ("quenching") occurs in the infall regions of these structures even before the galaxies enter the denser group environment.

79 ASTRONOMY AND ASTROPHYSICS↗

Freely scalable and reconfigurable optical hardware for deep learning

Abstract As deep neural network (DNN) models grow ever-larger, they can achieve higher accuracy and solve more complex problems. This trend has been enabled by an increase in available compute power; however, efforts to continue to scale electronic processors are impeded by the costs of communication, thermal management, power delivery and clocking. To improve scalability, we propose a digital optical neural network (DONN) with intralayer optical interconnects and reconfigurable input values. The path-length-independence of optical energy consumption enables information locality between a transmitter and a large number of arbitrarily arranged receivers, which allows greater flexibility in architecture design to circumvent scaling limitations. In a proof-of-concept experiment, we demonstrate optical multicast in the classification of 500 MNIST images with a 3-layer, fully-connected network. We also analyze the energy consumption of the DONN and find that digital optical data transfer is beneficial over electronics when the spacing of computational units is on the order of $$>10\,\upmu $$ > 10 μ m.

42 ENGINEERING↗

Discovery of the luminous X-ray ignition eRASSt J234402.9-352640: I. Tidal disruption event or a rapid increase in accretion in an active galactic nucleus?

In November 2020, a new, bright object, eRASSt J234402.9-352640, was discovered in the second all-sky survey of SRG/eROSITA. The object brightened by a factor of at least 150 in 0.2–2.0 keV flux compared to an upper limit found six months previous, reaching an observed peak of 1.76 -0.24 +0.03 × 10 -11 erg cm -2 s -1 . The X-ray ignition is associated with a galaxy at z = 0.10, making the peak luminosity log 10 (L 0.2-2 keV /[erg s -1 ]) = 44.7 ± 0.1. Around the time of the rise in X-ray flux, the nucleus of the galaxy brightened by approximately 3 mag. in optical photometry, after correcting for the host contribution. We present X-ray follow-up data from Swift, XMM-Newton, and NICER, which reveal a very soft spectrum as well as strong 0.2–2.0 keV flux variability on multiple timescales. Optical spectra taken in the weeks after the ignition event show a blue continuum with broad, asymmetric Balmer emission lines, and high-ionisation ([OIII]λλ4959,5007) and low-ionisation ([NII]λ6585, [SII]λλ6716,6731) narrow emission lines. Following the peak in the optical light curve, the X-ray, UV, and optical photometry all show a rapid decline. The X-ray light curve shows a decrease in luminosity of ~0.45 over 33 days and the UV shows a drop of ~0.35 over the same period. eRASSt J234402.9-352640 also shows a brightening in the mid-infrared, likely powered by a dust echo of the luminous ignition. We find no evidence in Fermi-LAT γ-ray data for jet-like emission. The event displays characteristics of a tidal disruption event (TDE) as well as of an active galactic nucleus (AGN), complicating the classification of this transient. Based on the softness of the X-ray spectrum, the presence of high-ionisation optical emission lines, and the likely infrared echo, we find that a TDE within a turned-off AGN best matches our observations.

79 ASTRONOMY AND ASTROPHYSICS↗

Crash Risks Evaluation of Urban Expressways: A Case Study in Shanghai

We report that proactive traffic safety management systems can reduce crashes by identifying crash precursors, evaluating real-time crash risks, and implementing suitable interventions. The basic prerequisite for developing such a system is to propose a reliable crash risk evaluation model that takes real-time traffic flow data as input. Previous studies have primarily focused on real-time crash prediction using some statistical or machine-learning methods. However, further quantitative evaluation and classification of crash risks have been ignored. In this study, we conduct a systematic crash risk evaluation workflow, including crash risk prediction, crash risk quantification, and crash risk classification. Specifically, the crash risk prediction using an extended logit model is proposed, from which CAS, CSD, UAS, DAS, DTV are identified to be contributing factors of crash risks. Then a crash risk quantification model based on the parameter evaluation of the extended logit model is developed. The crash risks of urban expressways and their spatial-temporal evolution trends are quantified. Finally, the crash risks are classified into high crash risk level, moderate crash risk level, and low crash risk level by the k-means cluster algorithm. Then the threshold boundaries of different crash risk levels are determined. The research results provide a proactive guidance for traffic safety management of urban expressways.

33 ADVANCED PROPULSION SYSTEMS↗

Flaming Moe

Current clamp measurements collected on various small electronic devices. Details on the data set can be found in J. M. Vann, T. P. Karnowski, R. Kerekes, C. D. Cooke and A. L. Anderson, A Dimensionally Aligned Signal Projection for Classification of Unintended Radiated Emissions, in IEEE Transactions on Electromagnetic Compatibility, vol. 60, no. 1, pp. 122-131, Feb. 2018, doi: 10.1109/TEMC.2017.2692962.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Solar collector installation design system including exceptional condition management and display

Embodiments may include systems and methods to create and edit a representation of a worksite, to create various data objects, to classify such objects as various types of pre-defined “features” with attendant properties and layout constraints. As part of or in addition to classification, an embodiment may include systems and methods to create, associate, and edit intrinsic and extrinsic properties to these objects. A design engine may apply of design rules to the features described above to generate one or more solar collectors installation design alternatives, including generation of on-screen and/or paper representations of the physical layout or arrangement of the one or more design alternatives. In some embodiments, metadata about the design process, including the process of classifying features and providing user input, generating layouts, and then modifying those layouts, may be generated. The metadata may include information about exceptional conditions in the project state information or design. A list of exceptions corresponding to exceptional conditions may be generated, and the designer may interact with these exceptions in a variety of ways, such as by complying with rules to remove an item from the exceptions list or overriding the application of the rules. The exceptions may be non-blocking relative to other user actions.

Wayne, Gary↗

Chemical signature characterization with hyperspectral imagery: novel deep learning model architectures and physically-motivated data augmentation techniques

The high spectral resolution afforded by Hyperspectral Imaging (HSI) sensors is poised to bring unprecedented advancements to signature characterization applications. Thus far, much of the research in the machine learning field devoted to HSI applications has focused on a few specific tasks like land-use land-cover classification. In land classification tasks, spatial information is very important, and model architectures are often designed to leverage spatial contexts. However, it is unclear how well these spatially-tuned models will translate to tasks where spectral information is critical, like the detection and characterization of chemicals. In this work, we compare spectral models (inputs are 1D spectra) and spatial-spectral models (inputs are 3D cubes) in the context of predicting chemical concentration maps. We find that spatial-spectral models perform the best, though we find a wide range in performance across the different architectures tested. Additionally, we find that model performance is impacted by the availability of training data, particularly in scenarios where the training data doesn't fully capture the true variance of real-world conditions. We find that data augmentation can help mitigate sparse coverage of observed parameter space (e.g., seasonal or geographic variability in ground cover), and present augmentation strategies that are tailored to hyperspectral data.

• Artificial intelligence (AI) / machine learning ↗

On the discovery of stars, quasars, and galaxies in the Southern Hemisphere with S-PLUS DR2

ABSTRACT This paper provides a catalogue of stars, quasars, and galaxies for the Southern Photometric Local Universe Survey Data Release 2 (S-PLUS DR2) in the Stripe 82 region. We show that a 12-band filter system (5 Sloan-like and 7 narrow bands) allows better performance for object classification than the usual analysis based solely on broad bands (regardless of infrared information). Moreover, we show that our classification is robust against missing values. Using spectroscopically confirmed sources retrieved from the Sloan Digital Sky Survey DR16 and DR14Q, we train a random forest classifier with the 12 S-PLUS magnitudes + 4 morphological features. A second random forest classifier is trained with the addition of the W1 (3.4 $\mu\mathrm{m} $) and W2 (4.6 $\mu\mathrm{m} $) magnitudes from the Wide-field Infrared Survey Explorer (WISE). Forty-four per cent of our catalogue have WISE counterparts and are provided with classification from both models. We achieve 95.76 per cent (52.47 per cent) of quasar purity, 95.88 per cent (92.24 per cent) of quasar completeness, 99.44 per cent (98.17 per cent) of star purity, 98.22 per cent (78.56 per cent) of star completeness, 98.04 per cent (81.39 per cent) of galaxy purity, and 98.8 per cent (85.37 per cent) of galaxy completeness for the first (second) classifier, for which the metrics were calculated on objects with (without) WISE counterpart. A total of 2926 787 objects that are not in our spectroscopic sample were labelled, obtaining 335 956 quasars, 1347 340 stars, and 1243 391 galaxies. From those, 7.4 per cent, 76.0 per cent, and 58.4 per cent were classified with probabilities above 80 per cent. The catalogue with classification and probabilities for Stripe 82 S-PLUS DR2 is available for download.

79 ASTRONOMY AND ASTROPHYSICS↗

Tag you're it: Application of stable isotope labeling and LC-MS to identify the precursors of specialized metabolites in plants

Untargeted liquid chromatography/mass spectrometry (LC-MS) can contribute a comprehensive and unbiased picture of the metabolic space of plants. These data can be used to quantify natural metabolite variation for genome wide association studies, to compare global metabolic responses from environmental or genetic perturbations, and to identify previously undescribed metabolites in Nature. A major limitation with untargeted metabolomics is the classification and identification of the thousands of metabolite features that can be detected in a single analytical run. Isotopic labeling improves the informational value of these datasets by categorizing metabolites as being derived from specific upstream precursors and/or to known metabolic pathways. When a 13 C-labeled precursor is fed to either a plant or tissue, the downstream metabolites produced from it have a higher m/z value than the molecules in the pre-existing pool, generating an m/z peak pair that can be specifically identified within the MS data. In this paper, we outline methods and principles to consider when supplementing untargeted MS data with isotopic labeling, including how to choose the appropriate isotopic label, grow and feed plant tissues to maximize label uptake and incorporation into derivatives, optimize LC-MS methods, and interpret the resulting labeling data. Although the focus here is on annotation of amino acid-derived metabolites using LC-MS, we anticipate that the methods are generally adaptable to other precursors, plant species, and chromatographic approaches.

59 BASIC BIOLOGICAL SCIENCES↗

Scalar Field Comparison with Topological Descriptors: Properties and Applications for Scientific Visualization

In topological data analysis and visualization, topological descriptors such as persistence diagrams, merge trees, contour trees, Reeb graphs, and Morse–Smale complexes play an essential role in capturing the shape of scalar field data. Herein we present a state–of–the–art report on scalar field comparison using topological descriptors. We provide a taxonomy of existing approaches based on visualization tasks associated with three categories of data: single fields, time–varying fields, and ensembles. These tasks include symmetry detection, periodicity detection, key event/feature detection, feature tracking, clustering, and structure statistics. Our main contributions include the formulation of a set of desirable mathematical and computational properties of comparative measures, and the classification of visualization tasks and applications that are enabled by these measures.

97 MATHEMATICS AND COMPUTING↗

Classification of Photovoltaic Failures with Hidden Markov Modeling, an Unsupervised Statistical Approach

Failure detection methods are of significant interest for photovoltaic (PV) site operators to help reduce gaps between expected and observed energy generation. Current approaches for field-based fault detection, however, rely on multiple data inputs and can suffer from interpretability issues. In contrast, this work offers an unsupervised statistical approach that leverages hidden Markov models (HMM) to identify failures occurring at PV sites. Using performance index data from 104 sites across the United States, individual PV-HMM models are trained and evaluated for failure detection and transition probabilities. This analysis indicates that the trained PV-HMM models have the highest probability of remaining in their current state (87.1% to 93.5%), whereas the transition probability from normal to failure (6.5%) is lower than the transition from failure to normal (12.9%) states. A comparison of these patterns using both threshold levels and operations and maintenance (O&M) tickets indicate high precision rates of PV-HMMs (median = 82.4%) across all of the sites. Although additional work is needed to assess sensitivities, the PV-HMM methodology demonstrates significant potential for real-time failure detection as well as extensions into predictive maintenance capabilities for PV.

classification↗

Rapid, antibiotic incubation-free determination of tuberculosis drug resistance using machine learning and Raman spectroscopy

Tuberculosis (TB) is the world’s deadliest infectious disease, with over 1.5 million deaths and 10 million new cases reported anually. The causative organism Mycobacterium tuberculosis (Mtb) can take nearly 40 d to culture, a required step to determine the pathogen’s antibiotic susceptibility. Both rapid identification and rapid antibiotic susceptibility testing of Mtb are essential for effective patient treatment and combating antimicrobial resistance. Here, we demonstrate a rapid, culture-free, and antibiotic incubation-free drug susceptibility test for TB using Raman spectroscopy and machine learning. We collect few-to-single-cell Raman spectra from over 25,000 cells of the Mtb complex strain Bacillus Calmette-Guérin (BCG) resistant to one of the four mainstay anti-TB drugs, isoniazid, rifampicin, moxifloxacin, and amikacin, as well as a pan-susceptible wildtype strain. By training a neural network on this data, we classify the antibiotic resistance profile of each strain, both on dried samples and on patient sputum samples. On dried samples, we achieve >98% resistant versus susceptible classification accuracy across all five BCG strains. In patient sputum samples, we achieve ~79% average classification accuracy. We develop a feature recognition algorithm in order to verify that our machine learning model is using biologically relevant spectral features to assess the resistance profiles of our mycobacterial strains. Finally, we demonstrate how this approach can be deployed in resource-limited settings by developing a low-cost, portable Raman microscope that costs <$5,000. We show how this instrument and our machine learning model enable combined microscopy and spectroscopy for accurate few-to-single-cell drug susceptibility testing of BCG.

60 APPLIED LIFE SCIENCES↗

The ambiguous AT2022rze: changing-look AGN mimicking a supernova in a merging galaxy system

AT2022rze is a luminous, ambiguous transient located south-east of the geometric centre of its host galaxy at redshift $z = 0.08$. The host appears to be formed by a merging galaxy system. The observed characteristics of AT2022rze are reminiscent of active galactic nuclei (AGNs), tidal disruption events, and superluminous supernovae. The transient reached a peak absolute magnitude of $-$20.2 $\pm$ 0.2 mag, showing a sharp rise (t$_{\mathrm{rise,1/e}} = 27.5 \pm 0.6$ d) followed by a slow decline (t$_{\mathrm{dec,1/e}} = 382.9 \pm 0.6$). Its bumpy light curve and narrow Balmer lines indicate the presence of gas (and dust). Its light curve shows rather red colours, indicating that the transient could be affected by significant host extinction. The spectra reveal coronal lines, indicative of high-energy (X-ray/UV) emission. Archival data reveal no prior activity at this location, disfavouring a steady-state AGN, although an optical spectrum obtained prior to the transient is consistent with an AGN classification of the host. Based on this, we conclude that the transient most likely represents a changing-look AGN at the centre of the smallest component of the merging system.

galaxies: active↗

Mitigating Catastrophic Forgetting in Deep Learning in a Streaming Setting Using Historical Summary

Recent advancements in scientific equipment and the adaptation of electronics and the Internet of Things (IoT) in our everyday lives resulted in large and complex data production at a high rate. Making meaningful and timely knowledge discovery at a modest cost from this big data is difficult for computing power and storage limitations. Training deep learning models incrementally in a streaming setting can help us with overcoming these limitations. However, in a well-known phenomenon named catastrophic forgetting, incrementally trained models increasingly perform poorly on the past data. To mitigate catastrophic forgetting in training in a streaming setting, we propose constructing a historical summary over time and use the summary with newly arrived data during incremental training. We propose various data summarization techniques such as random sampling, micro clustering, coreset computation, and Auto Encoders to counteract catastrophic forgetting. We built a pipeline for incremental training with a historical summary for training deep learning models for streaming data. We demonstrate the effectiveness of historical summary in mitigating catastrophic forgetting using three case studies involving three different deep learning applications: an Artificial Neural Network (ANN) for classification task on MNIST dataset, a language model (RNN-LM) on the WikiText2 dataset, and a Convolutional Neural Network (CNN), ResNet50 to classify the ImageNet dataset. Through the training of the models, we observe that catastrophic forgetting is evident in ANN and CNN but not in an RNN. For the first task, our method recovers up to 47.9% lost accuracy due to catastrophic forgetting. For the third task, the historical summary recovers classification accuracy by up to 25%. For the second task, though there is not proof of catastrophic forgetting, the training performance (PPL) improves by up to 26% with historical summary.

Dash, Sajal↗

Efficient human activity recognition with spatio-temporal spiking neural networks

In this study, we explore Human Activity Recognition (HAR), a task that aims to predict individuals' daily activities utilizing time series data obtained from wearable sensors for health-related applications. Although recent research has predominantly employed end-to-end Artificial Neural Networks (ANNs) for feature extraction and classification in HAR, these approaches impose a substantial computational load on wearable devices and exhibit limitations in temporal feature extraction due to their activation functions. To address these challenges, we propose the application of Spiking Neural Networks (SNNs), an architecture inspired by the characteristics of biological neurons, to HAR tasks. SNNs accumulate input activation as presynaptic potential charges and generate a binary spike upon surpassing a predetermined threshold. This unique property facilitates spatio-temporal feature extraction and confers the advantage of low-power computation attributable to binary spikes. We conduct rigorous experiments on three distinct HAR datasets using SNNs, demonstrating that our approach attains competitive or superior performance relative to ANNs, while concurrently reducing energy consumption by up to 94%.

60 APPLIED LIFE SCIENCES↗

The Hobby–Eberly Telescope Dark Energy Experiment (HETDEX) Survey Design, Reductions, and Detections*

In this work, we describe the survey design, calibration, commissioning, and emission-line detection algorithms for the Hobby–Eberly Telescope Dark Energy Experiment (HETDEX). The goal of HETDEX is to measure the redshifts of over a million Lyα emitting galaxies between 1.88 < z < 3.52, in a 540 deg 2 area encompassing a comoving volume of 10.9 Gpc 3 . No preselection of targets is involved; instead the HETDEX measurements are accomplished via a spectroscopic survey using a suite of wide-field integral field units distributed over the focal plane of the telescope. This survey measures the Hubble expansion parameter and angular diameter distance, with a final expected accuracy of better than 1%. Additionally, we detail the project's observational strategy, reduction pipeline, source detection, and catalog generation, and present initial results for science verification in the Cosmological Evolution Survey, Extended Groth Strip, and Great Observatories Origins Deep Survey North fields. We demonstrate that our data reach the required specifications in throughput, astrometric accuracy, flux limit, and object detection, with the end products being a catalog of emission-line sources, their object classifications, and flux-calibrated spectra.

79 ASTRONOMY AND ASTROPHYSICS↗