Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image recognition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Quantum Transfer Learning to Boost Dementia Detection

Dementia is a devastating condition with profound implications for individuals, families, and healthcare systems. Early and accurate detection of dementia is critical for timely intervention and improved patient outcomes. While classical machine learning and deep learning approaches have been explored extensively for dementia prediction, these solutions often struggle with high-dimensional biomedical data and large-scale datasets, quickly reaching computational and performance limitations. To address this challenge, quantum machine learning (QML) has emerged as a promising paradigm, offering faster training and advanced pattern recognition capabilities. This work aims to demonstrate the potential of quantum transfer learning (QTL) to enhance the performance of a weak classical deep learning model applied to a binary classification task for dementia detection. Besides, we show the effect of noise on the QTL-based approach, investigating the reliability and robustness of this method. Using the OASIS 2 dataset, we show how quantum techniques can transform a suboptimal classical model into a more effective solution for biomedical image classification, highlighting their potential impact on advancing healthcare technology.

Bhowmik, Sounak [University of Tennessee, Knoxvill↗
DOE OSTI2024

Self-Supervised Cloud Classification

Abstract Low-level marine clouds play a pivotal role in Earth’s weather and climate through their interactions with radiation, heat and moisture transport, and the hydrological cycle. These interactions depend on a range of dynamical and microphysical processes that result in a broad diversity of cloud types and spatial structures, and a comprehensive understanding of cloud morphology is critical for continued improvement of our atmospheric modeling and prediction capabilities moving forward. Deep learning has recently accelerated our ability to study clouds using satellite remote sensing, and machine learning classifiers have enabled detailed studies of cloud morphology. A major limitation of deep learning approaches to this problem, however, is the large number of hand-labeled samples that are required for training. This work applies a recently developed self-supervised learning scheme to train a deep convolutional neural network (CNN) to map marine cloud imagery to vector embeddings that capture information about mesoscale cloud morphology and can be used for satellite image classification. The model is evaluated against existing cloud classification datasets and several use cases are demonstrated, including training cloud classifiers with very few labeled samples, interrogation of the CNN’s learned internal feature representations, cross-instrument application, and resilience against sensor calibration drift and changing scene brightness. The self-supervised approach learns meaningful internal representations of cloud structures and achieves comparable classification accuracy to supervised deep learning methods without the expense of creating large hand-annotated training datasets. Significance Statement Marine clouds heavily influence Earth’s weather and climate, and improved understanding of marine clouds is required to improve our atmospheric modeling capabilities and physical understanding of the atmosphere. Recently, deep learning has emerged as a powerful research tool that can be used to identify and study specific marine cloud types in the vast number of images collected by Earth-observing satellites. While powerful, these approaches require hand-labeling of training data, which is prohibitively time intensive. This study evaluates a recently developed self-supervised deep learning method that does not require human-labeled training data for processing images of clouds. We show that the trained algorithm performs competitively with algorithms trained on hand-labeled data for image classification tasks. We also discuss potential downstream uses and demonstrate some exciting features of the approach including application to multiple satellite instruments, resilience against changing image brightness, and its learned internal representations of cloud types. The self-supervised technique removes one of the major hurdles for applying deep learning to very large atmospheric datasets.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

The gammaherpesviral TATA-box-binding protein directly interacts with the CTD of host RNA Pol II to direct late gene transcription

β- and γ-herpesviruses include the oncogenic human viruses Kaposi’s sarcoma-associated virus (KSHV) and Epstein-Barr virus (EBV), and human cytomegalovirus (HCMV), which is a significant cause of congenital disease. Near the end of their replication cycle, these viruses transcribe their late genes in a manner distinct from host transcription. Late gene transcription requires six virally encoded proteins, one of which is a functional mimic of host TATA-box-binding protein (TBP) that is also involved in recruitment of RNA polymerase II (Pol II) via unknown mechanisms. Here, we applied biochemical protein interaction studies together with electron microscopy-based imaging of a reconstituted human preinitiation complex to define the mechanism underlying Pol II recruitment. These data revealed that the herpesviral TBP, encoded by ORF24 in KSHV, makes a direct protein-protein contact with the C-terminal domain of host RNA polymerase II (Pol II), which is a unique feature that functionally distinguishes viral from cellular TBP. The interaction is mediated by the N-terminal domain (NTD) of ORF24 through a conserved motif that is shared in its β- and γ-herpesvirus homologs. Thus, these herpesviruses employ an unprecedented strategy in eukaryotic transcription, wherein promoter recognition and polymerase recruitment are facilitated by a single transcriptional activator with functionally distinct domains.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Integrating N -glycan and CODEX imaging reveal cell-specific protein glycosylation in healthy human lung

Identifying cell-specific glycan structures in human lungs is critical for understanding the chemistry and mechanisms that guide cell–cell and cell–matrix interactions and determining nuanced functions of specific glycosylation. Our dual-modality omics platform, which uses matrix-assisted laser desorption/ionization (MALDI) mass spectrometry imaging (MSI) to profile glycan chemistry at 50 μm × 50 μm scale, combined with co-detection by indexing (CODEX) to provide cell identification from the exact same tissue section, is a significant step in this direction. It enabled us to detect, differentiate, and reveal chemical properties of N-glycans in the various cell types of a human lung, suggesting the cell-specific function of distinct carbohydrate moieties. This innovative technological combination bridges the gap between the specific protein glycosylation and their cellular origin, paving the way for targeted studies in the lungs and many other human tissues where glycans mediate cell–cell recognition events.

Veličković, Dušan [Pacific Northwest National Labo↗
DOE OSTI2021

Deep Learning Systems for Increased Safeguards Surveillance Review Productivity

Nuclear safeguards inspectors expend significant time and maintain intense focus in reviewing video surveillance for safeguards relevant events. To increase efficiency and reduce the time burden of safeguards inspectors performing surveillance data review, this paper presents a novel deep learning (DL) systems concept to integrate generalized DL models into the safeguards surveillance review workflow. The Agency is investigating several DL algorithms for object recognition, localization, tracking, and flagging relevant activities. The project team is working closely with nuclear safeguards inspectors to identify review use cases (based on specific safeguards objectives) and collect their associated requirements. We focused on CANDU and LWR Nuclear Power Plants (NPPs) and their associated dry storage areas as these present a particularly heavy burden on the inspector surveillance review process due to the number of these facilities under safeguards worldwide. Initial DL algorithm results on safeguards data are promising. Using a convolutional neural network, the team attained a mean average precision (mAP) of 92.9% identifying and localizing spent fuel (SF) casks from a 475 surveillance image dataset. Further, the team had initial success in training a recurrent neural network to identify reactor area activities in video clips, successfully indicating when SF casks enter or exit a pool. We discuss how such DL algorithms would be integrated into the Next Generation Surveillance Review (NGSR) software application. Another issue impacting review productivity is the long time inspectors may have to wait when running these algorithms in NGSR. We present a concept to pre-process remotely collected surveillance data with DL models as the data arrives to IAEA headquarters so that results are already available when starting a new review in NGSR. The proposed DL system concept shows a pathway and workflow for increasing an inspector’s surveillance review productivity by quickly and accurately identifying declared and undeclared safeguards relevant objects and activities in large quantities of surveillance imagery data.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2021

2021 Smoky Mountains Conference Data Challenge Synthetic-to-Real Domain Adaptation for Autonomous Driving Dataset

The dataset is comprised of both real and synthetic images from a vehicle's forward-facing camera. Each camera image is accompanied by a corresponding pixel-level semantic segmentation image (all files are .png files). In total, the dataset contains 5600 images in the training/validation set and 1400 images in the testing set. The training dataset contains mostly synthetic RGB images collected with a wide range of weather and lighting conditions using the CARLA simulator [1]. In addition, the training data also includes a small pre-selected subset of data from the Cityscapes training dataset – which is comprised of RGB-segmentation image pairs from driving scenarios in various European cities [2]. The testing data is split into three sets. The first set contains synthetic CARLA images with weather/lighting conditions that were not present in the training set. The second set is a subset of the Cityscapes testing dataset. Finally, the third set is an unknown testing set which will not be revealed to the participants until after the submission deadline. [1] Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., and Koltun, V. (2017, October). CARLA: An open urban driving simulator. In Conference on robot learning (pp. 1-16). PMLR. [2] Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., ... and Schiele, B. (2016). The cityscapes dataset for semantic urban scene understanding. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 3213-3223).

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Component Identification of Solid Biomass Fuels Using Reflected Light Microscopy: Interlaboratory Study 2

As nations transition toward sustainable energy systems, biomass has become a vital component of global energy portfolios. Derived from organic materials such as wood, agricultural residues, forestry byproducts, and organic waste, biomass is a renewable energy source with significant environmental and economic benefits. Responsible biomass energy production can improve waste management, reduce emissions of greenhouse gases, and mitigate environmental pollution. However, as the diversity of biomass-derived fuels increases, robust quality assessment methods are essential to ensure their efficiency, safety, and minimal environmental impact. Reflected light microscopy (RLM) is one such technique with the potential to complement conventional physico-chemical analyses by enabling a rapid identification of material constituents and impurities. To refine this methodology and evaluate the reproducibility of solid biomass component identification using RLM, an interlaboratory study (ILS) was conducted. The study involved the recognition of 58 components across 45 photomicrographs, with the participation of 65 scientists and students from 25 countries. The participants faced high difficulty identifying some of the marked components, and as a result, the percentage of correct answers ranged from 19.0 % to 98.3 %, with an average correct identification rate of 62.7 %. The most challenging aspects of the identification process included distinguishing between woody and non-woody (agro) biomass, accurately identifying petroleum-derived materials, and differentiating agro biomass from inorganic matter. The results suggest that while RLM is an important tool for characterizing solid biomass, further development of methodology guidelines and training are necessary to enhance its effectiveness. Future research should prioritize preparing detailed, image-rich, microscopic morphological descriptions of biomass fuel components, which could improve the accuracy and reliability of using RLM in biomass fuel characterization.

09 BIOMASS FUELS↗
DOE OSTI2020

Visualizing Charge Transport and Nanoscale Electrochemistry by Hyperspectral Kelvin Probe Force Microscopy

Charge-transport and electrochemical processes are heavily influenced by the local microstructure. Kelvin probe force microscopy (KPFM) is a widely used technique to map electrochemical potentials at the nanometer scale; however, it offers little information on local charge dynamics. In this study, we implement a hyperspectral KPFM approach for spatially mapping bias-dependent charge dynamics in timescales ranging from the sub-millisecond to the second regime. As a proof of principle, we investigate the role mobile surface charges play in a three-unit-cell LaAlO 3 /SrTiO 3 oxide heterostructure. We explore machine learning approaches to assist with visualization, pattern recognition, and interpretation of the information-rich data sets. Linear unmixing methods reveal hidden bias-dependent interfacial processes, most likely water splitting, which are essentially unnoticed by functional fitting of the dynamic response alone. Hyperspectral KPFM will be beneficial for investigating nanoscale charge transport and local reactivity in systems involving a possible combination of electronic, ionic, and electrochemical phenomena.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Multidisciplinary studies with mutated HIV-1 capsid proteins reveal structural mechanisms of lattice stabilization

Abstract HIV-1 capsid (CA) stability is important for viral replication. E45A and P38A mutations enhance and reduce core stability, thus impairing infectivity. Second-site mutations R132T and T216I rescue infectivity. Capsid lattice stability was studied by solving seven crystal structures (in native background), including P38A, P38A/T216I, E45A, E45A/R132T CA, using molecular dynamics simulations of lattices, cryo-electron microscopy of assemblies, time-resolved imaging of uncoating, biophysical and biochemical characterization of assembly and stability. We report pronounced and subtle, short- and long-range rearrangements: (1) A38 destabilized hexamers by loosening interactions between flanking CA protomers in P38A but not P38A/T216I structures. (2) Two E45A structures showed unexpected stabilizing CA NTD -CA NTD inter-hexamer interactions, variable R18-ring pore sizes, and flipped N-terminal β-hairpin. (3) Altered conformations of E45A a α9-helices compared to WT, E45A/R132T, WT PF74 , WT Nup153 , and WT CPSF6 decreased PF74, CPSF6, and Nup153 binding, and was reversed in E45A/R132T. (4) An environmentally sensitive electrostatic repulsion between E45 and D51 affected lattice stability, flexibility, ion and water permeabilities, electrostatics, and recognition of host factors.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Universal Fourier Attack for Time Series

A wide variety of adversarial attacks have been proposed and explored using image and audio data. These attacks are notoriously easy to generate digitally when the attacker can directly manipulate the input to a model, but are much more difficult to implement in the real-world. In this paper we present a universal, time invariant attack for general time series data such that the attack has a frequency spectrum primarily composed of the frequencies present in the original data. The universality of the attack makes it fast and easy to implement as no computation is required to add it to an input, while time invariance is useful for real-world deployment. Additionally, the frequency constraint ensures the attack can withstand filtering. We demonstrate the effectiveness of the attack in two different domains, speech recognition and unintended radiated emission, and show that the attack is robust against common transform-and-compare defense pipelines.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Power System Waveform Classification Using Time-Frequency and CNN

Many modern reclosers and circuit breakers have microprocessor relays that record waveforms of system events. In some cases, utilities may record a half-a-dozen event captures for every event. This is thousands of events per year. The industry needs faster, more automated, more conclusive, and easy-to-use systems that can process massive amounts of event recordings without extensive input/support from power system engineers. To address the need for a commercially viable solution that can classify waveform data, energies were directed to develop a universal neural network (NN) structure (deep learning algorithm) that works for a wide variety of system event types. The structure that showed the most promise was one that included the use of spectrograms. The technique has shown positive results in audio engineering, particularly with respect to speech recognition. A waveform signature could be treated as a spoken word like audio waveforms for specific things such as “YES” or “UP”. No two people produce the exact same waveform when speaking each of these words, but audio processing algorithms based on spectrograms and convolutional neural networks (CNN) can still distinguish the word regardless of the speaker. No two circuits produce the exact same waveform for a given event, but the NN can be trained to classify the event type regardless of the circuit or location on the circuit. A Power System Neural Network (PSNN) has been developed to use a CNN to classify events within waveform data for power systems. The waveform is converted to an array of values by way of spectrograms and interpreted as an image. This image is passed into the CNN. The test results on independent simulated test and validation datasets show greater than 99% accuracy. While the results thus far are based on simulated data, the performance of the PSNN is very promising and should work for a wide variety of power system conditions of interest. Ultimately, much of the custom code and tools used today and much of the manual effort expended today may be automated using this PSNN.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Novel compound heterozygous CPLANE1 variants identified in a Chinese family with Joubert syndrome

Abstract Joubert syndrome (JS) and JS‐related disorders (JSRD) are a group of neurodevelopmental diseases that share the “molar tooth sign” on axial brain magnetic resonance imaging (MRI), accompanied by cerebellar vermis hypoplasia, ataxia, hypotonia, and developmental delay. To identify variants responsible for the clinical symptoms of a Chinese family with JS and to explore the genotype–phenotype associations, we conducted a series of clinical examinations, including blood tests, brain MRI scans, ultrasound imaging, and ophthalmologic examination. Genomic DNA was extracted from the peripheral blood of the six‐person family, and the pathogenic variants were detected by whole‐exome sequencing (WES) and verified by Sanger sequencing. WES revealed two novel compound heterozygous variants in CPLANE1 : c.1270C>T (p.Arg424*) in exon 10 and c.8901C>A (p.Tyr2967*) in exon 48 of one child, inherited from each parent. Both variants were absent in ethnically matched Chinese control individuals and were either absent or present at very low frequencies in public databases, suggesting that these variants could be the pathogenic triggers of the JS phenotype. Notably, these CPLANE1 sequence variants were related to the pathogenesis of autosomal recessive JS in this study. The newly discovered variants expand the mutation spectrum of CPLANE1 , which assists in understanding the molecular mechanism underlying JS and improving the recognition of genetic counseling, particularly for families with a history of autosomal recessive JS.

Zhang, Cheng↗
DOE OSTI2022

Automatic recognition system for document digitization in nuclear power plants

With the increasing number of data-driven models in nuclear applications, large volumes of numerical data are required to accurately model and predict the health status of a plant component. However, many historical operation logs that contain useful information are not fully utilized due to the lack of a systematic approach of digitization. To overcome this issue, this study proposes an automatic pipeline for extracting information from handwritten tabular documents collected from nuclear power plants. In our pipeline, we first denoise scanned documents with morphological operations, and then extract relevant parts from individual pages using both traditional computer vision and neural network methods. Handwriting recognition is applied to obtain text and numbers. As the most challenging step is how to crop only relevant information, the main focus of our paper is to detect tables and cells from scanned handwritten documents. Here we evaluate the efficiency and accuracy of our proposed method on handwritten operational reports obtained from a real-world case study. The results demonstrate the high accuracy and practicality of our proposed method.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

Confidence-weighted integration of human and machine judgments for superior decision-making

Large language models (LLMs) can surpass humans in certain forecasting tasks. What role does this leave for humans in the overall decision process? One possibility is that humans, despite performing worse than LLMs, can still add value when teamed with them. A human and machine team can surpass each individual teammate when team members’ confidence is well calibrated and team members diverge in which tasks they find difficult (i.e., calibration and diversity are needed). We simplified and extended a Bayesian approach to combining judgments using a logistic regression framework that integrates confidence-weighted judgments for any number of team members. Using this straightforward method, we demonstrated its effectiveness in both image classification and neuroscience forecasting tasks. Combining human judgments with one or more machines consistently improved overall team performance. Our hope is that this simple and effective strategy for integrating the judgments of humans and machines will lead to productive collaborations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Fireworks on Weather Radar and Camera

High-sensitivity weather radars easily detect nonmeteorological phenomena characterized by weak radar returns. Fireworks are the example presented here. To understand radar observations, an experiment was conducted in which the National Severe Storms Laboratory (NSSL)’s research (3-cm wavelength) dual-polarization radar and a video camera were located at 1 km from fireworks in Norman, Oklahoma. The fireworks from the 4 July 2017 celebration were recorded by both instruments. The experiment is described. Few bursts recorded by the camera are analyzed to obtain the height of the explosion, its maximum diameter, number of stars, and the duration of the visible image. Radar volume scans are examined to characterize the height of the observation, the maximum reflectivity, and its distribution with height. The fireworks location is close to the Terminal Doppler Weather Radar (TDWR) that operates in single polarization at a 5-cm wavelength and monitors hazardous weather over the Oklahoma City airport. A third radar with data from the event is the Weather Surveillance Radar-1988 Doppler (WSR-88D) located in Norman. It has a wavelength of 10 cm and supports technical developments at the Radar Operation Center. Reflectivity factors measured by the three radars are compared to infer the size of dominant scatterers. The polarimetric characteristics of fireworks returns are analyzed. Although these differ from those of precipitation, they are indistinguishable from insect returns. Radar observation of larger fireworks in Fort Worth, Texas, with a WSR-88D is included and compared with the observations of the smaller fireworks in Norman. We expect the detectability of explosions would be similar as of fireworks. Pinpointing locations would be useful to first responders, or air quality forecasters. We note a benefit of fireworks recognition in weather radar data is that it can prevent contamination of precipitation accumulations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Effectiveness of Deep Learning Trained on SynthCity Data for Urban Point-Cloud Classification

3D object recognition is one of the most popular areas of study in computer vision. Many of the more recent algorithms focus on indoor point clouds, classifying 3D geometric objects, and segmenting outdoor 3D scenes. One of the challenges of the classification pipeline is finding adequate and accurate training data. Hence, this article seeks to evaluate the accuracy of a synthetically generated data set called SynthCity, tested on two mobile laser-scan data sets. Varying levels of noise were applied to the training data to reflect varying levels of noise in different scanners. The chosen deep-learning algorithm was Kernel Point Convolution, a convolutional neural network that uses kernel points in Euclidean space for convolution weights.

Geology↗
DOE OSTI2023

Ultrasensitive Photothermal Spectroscopy: Harnessing the Seebeck Effect for Attogram-Level Detection

Molecular-level spectroscopy is crucial for sensing and imaging applications, yet detecting and quantifying minuscule quantities of chemicals remain a challenge, especially when they surface adsorb in low numbers. Here, we introduce a photothermal spectroscopic technique that enables the high selectivity sensing of adsorbates with an attogram detection limit. Our approach utilizes the Seebeck effect in a microfabricated nanoscale thermocouple junction, incorporated into the apex of a microcantilever. We observe minimal thermal mass exhibited by the sensor, which maintains exceptional thermal insulation. The temperature variation driving the thermoelectric junction arises from the nonradiative decay of molecular adsorbates’ vibrational states on the tip. We demonstrate the detection of photothermal spectra of physisorbed trinitrotoluene (TNT) and dimethyl methylphosphonate (DMMP) molecules, as well as representative polymers, with an estimated mass of 10 -18 g.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Convolutional Neural Networks for Problems in Transport Phenomena: A Theoretical Minimum

Convolutional neural network (CNN), a deep learning algorithm, has gained popularity in technological applications that rely on interpreting images (typically, an image is a 2D field of pixels). Transport phenomena is the science of studying different fields representing mass, momentum, or heat transfer. Some of the common fields are species concentration, fluid velocity, pressure, and temperature. Each of these fields can be expressed as an image(s). Consequently, CNNs can be leveraged to solve specific scientific problems in transport phenomena. Herein, we show that such problems can be grouped into three basic categories: (a) mapping a field to a descriptor (b) mapping a field to another field, and (c) mapping a descriptor to a field. After reviewing the representative transport phenomena literature for each of these categories, we illustrate the necessary steps for constructing appropriate CNN solutions using sessile liquid drops as an exemplar problem. If sufficient training data is available, CNNs can considerably speed up the solution of the corresponding problems. Finally, the present discussion is meant to be minimalistic such that readers can easily identify the transport phenomena problems where CNNs can be useful as well as construct and/or assess such solutions.

97 MATHEMATICS AND COMPUTING↗