Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image recognition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

The Mertens Unrolled Network (MU-Net): A High Dynamic Range Fusion Neural Network for Through the Windshield Driver Recognition

Face recognition of vehicle occupants through windshields in unconstrained environments poses a number of unique challenges ranging from glare, poor illumination, driver pose and motion blur. In this paper, we further develop the hardware and software components of a custom vehicle imaging system to better overcome these challenges. After the build out of a physical prototype system that performs High Dynamic Range (HDR) imaging, we collect a small dataset of through-windshield image captures of known drivers. We then reformulate the classical Mertens-Kautz-Van Reeth HDR fusion algorithm as a pre-initialized neural network, which we name the Mertens Unrolled Network (MU-Net), for the purpose of fine-tuning the HDR output of through-windshield images. Reconstructed faces from this novel HDR method are then evaluated and compared against other traditional and experimental HDR methods in a pre-trained state-of-the-art (SOTA) facial recognition pipeline, verifying the efficacy of our approach.

Ruby, Max↗
DOE OSTI2020

A semblance measure for model comparison

Algorithmic and computational advances have made it possible that geophysical survey and earth model design can be aided by many systematic trial inverse-modelling runs with synthetic data. Such may, for example, come up in machine-learning approaches. Automated image appraisal pertaining to such applications will involve common statistical tests for goodness-of-data fit as a primary evaluation method. However, solution non-uniqueness may render multiple images equivalent in terms of their data fit, requiring secondary categorizers. A logical choice for classifying synthetic-imaging results quantifies the goodness of model fit where a known reference model replaces the observational input. The task of model intercomparison in terms of measuring the resemblance to the reference model poses challenges to common distance-based metrics like root mean square error and mean absolute error. First, distance-based metrics can introduce spurious contributions when smooth models with fuzzy target contours are to be compared against a sharp reference. Second, large differences due to parameter-estimation overshoots can dominate distance metrics. Here, we propose a remedy that is referred to as semblance and is based on the idea of logistic functions, where a binary-dependent variable adds non-zero or zero accumulation terms for the, respectively, passing or failing of preset target thresholds. This classifying approach is amenable to an objective where model feature recognition is primary. Numerical comparisons to distance-based metrics provide evidence for the advantages of the semblance in view of this objective. Geophysical imaging in conjunction with machine-learning is seen as a benefitting upcoming application area.

58 GEOSCIENCES↗
DOE OSTI2026

Quantifying Operational Drivers of Multimodal Biometric Verification in Aerial Surveillance

Multimodal biometric verification is increasingly applied across operational contexts ranging from close-range security cameras and building-mounted surveillance to long-range ground sensors and unmanned aerial system (UAS) imagery. Variations in acquisition conditions—such as image resolution, viewing geometry, and motion artifacts—pose significant challenges for cross-domain algorithmic generalization. This study evaluates two independent multimodal biometric verification systems developed under the Intelligence Advanced Research Projects Activity (IARPA) Biometric Recognition and Identification at Altitude and Range (BRIAR) program, comparing performance on close-range and aerial datasets. Close-range video served as a baseline to quantify the decline in verification performance on aerial footage. The dataset included six UAS platforms, spanning small quadcopters at 10m altitude to medium-sized fixed-wing aircraft at 360m. Mixed-effects logistic regression identified image resolution (head and body pixel counts), head height, sensor characteristics, and algorithm selection as primary determinants of verification success, whereas demographic attributes and mission gait were not significant predictors. Activity type and collection site influenced performance in close-range data but had negligible impact on UAS imagery. These results clarify modality-specific strengths and limitations and highlight opportunities to enhance cross-domain biometric verification.

Peluso, Alina [ORNL] (ORCID:0000000328950406)↗
DOE OSTI2020

Machine learning technique to identify grains in polycrystalline materials samples

A method of identifying grains in polycrystalline materials, the method including (a) identifying local crystal structure of the polycrystalline material based on neighbor coordination or pattern recognition machine learning, the local crystal structure including grains and grain boundaries, (b) pre-processing the grains and the grain boundaries using image processing techniques, (c) conducting grain identification using unsupervised machine learning; and (d) refining a resolution of the grain boundaries.

Sankaranarayanan, Subramanian↗
DOE OSTI2023

Single molecule insights into interfacial molecular recognition for model electrochemical DNA biosensors

Electrochemical sensors that use surface-immobilized DNA to bind analytes and transduce the binding into electrochemical signals, have the potential for rapid, specific, and sensitive detection of bioanalytes via a compact and portable platform. However, accessing the structure of these surfaces/interfaces at the relevant spatial scale (< 10 nm), which determines the interfacial interactions and ultimately sensing performance, remains an unsolved challenge. Here, we review studies that have used high resolution atomic force microscope imaging and spatial statistical analysis tools to understand crowding interactions between thiolated DNA probes immobilized on gold electrodes and how such interactions impact target binding. We also review related studies that attempt to control the nanoscale spatial arrangement of the immobilized recognition elements to optimize sensing performance. Furthermore, these efforts have led to new advances in understanding of the structure-function relationships of DNA-based electrochemical biosensors to move the field toward rational engineering of these biosensing interfaces.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Expected tracking performance of the ATLAS Inner Tracker at the High-Luminosity LHC

The high-luminosity phase of LHC operations (HL-LHC), will feature a large increase in simultaneous proton-proton interactions per bunch crossing up to 200, compared with a typical leveling target of 64 in Run 3. Such an increase will create a very challenging environment in which to perform charged particle trajectory reconstruction, a task crucial for the success of the ATLAS physics program, and will exceed the capabilities of the current ATLAS Inner Detector (ID). A new all-silicon Inner Tracker (ITk) will replace the current ID in time for the start of the HL-LHC. To ensure successful use of the ITk capabilities in Run 4 and beyond, the ATLAS tracking software has been successfully adapted to achieve state-of-the-art track reconstruction in challenging high-luminosity conditions with the ITk detector. This paper presents the expected tracking performance of the ATLAS ITk based on the latest available developments since the ITk technical design reports.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Robustness of topological persistence in knowledge distillation for wearable sensor data

Topological data analysis (TDA) has shown great success in various applications involving wearable sensor data. However, there are difficulties in leveraging topological features in machine learning and wearable sensors because of the large time consumption and computational resources required to extract the features. To address this problem, knowledge distillation (KD) is utilized to generate a small model and accommodate topological features with persistence image (PI) representations from the raw time series data. Deploying topological knowledge in KD enables the student to achieve better performance compared to the one trained solely on raw time series data. However, it is not yet known if there are coherent characteristics for topological features in PI, which can aid in improving the performance during KD. In this paper, we investigate the suitability and challenges of utilizing topological features in KD for wearable sensor data, thereby contributing to the advancement of the field. Our study explores the impact of transferred topological features by comparing the Teacher-to-Student framework with Multiple Teachers-to-Student where teachers utilize both time series data and persistence images obtained by TDA as inputs. Additionally, we conduct a rigorous examination of topological knowledge effects by testing under various corruptions, knowledge types, and learning strategies in the context of human activity recognition tasks. Our analysis of topological features in KD presents the optimal strategy for incorporating these features. This study includes datasets of varying scales, window lengths, and activity classes, providing a comprehensive evaluation. Our results demonstrate that leveraging topological features in KD to enhance performance across databases.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Deep transfer learning for star cluster classification: I. application to the PHANGS– HST survey

ABSTRACT We present the results of a proof-of-concept experiment that demonstrates that deep learning can successfully be used for production-scale classification of compact star clusters detected in Hubble Space Telescope(HST) ultraviolet-optical imaging of nearby spiral galaxies ($D\lesssim 20\, \textrm{Mpc}$) in the Physics at High Angular Resolution in Nearby GalaxieS (PHANGS)–HST survey. Given the relatively small nature of existing, human-labelled star cluster samples, we transfer the knowledge of state-of-the-art neural network models for real-object recognition to classify star clusters candidates into four morphological classes. We perform a series of experiments to determine the dependence of classification performance on neural network architecture (ResNet18 and VGG19-BN), training data sets curated by either a single expert or three astronomers, and the size of the images used for training. We find that the overall classification accuracies are not significantly affected by these choices. The networks are used to classify star cluster candidates in the PHANGS–HST galaxy NGC 1559, which was not included in the training samples. The resulting prediction accuracies are 70 per cent, 40 per cent, 40–50 per cent, and 50–70 per cent for class 1, 2, 3 star clusters, and class 4 non-clusters, respectively. This performance is competitive with consistency achieved in previously published human and automated quantitative classification of star cluster candidate samples (70–80 per cent, 40–50 per cent, 40–50 per cent, and 60–70 per cent). The methods introduced herein lay the foundations to automate classification for star clusters at scale, and exhibit the need to prepare a standardized data set of human-labelled star cluster classifications, agreed upon by a full range of experts in the field, to further improve the performance of the networks introduced in this study.

Wei, Wei↗
DOE OSTI2023

Many but not all deep neural network audio models capture brain responses and exhibit correspondence between model stages and brain regions

Models that predict brain responses to stimuli provide one measure of understanding of a sensory system and have many potential applications in science and engineering. Deep artificial neural networks have emerged as the leading such predictive models of the visual system but are less explored in audition. Prior work provided examples of audio-trained neural networks that produced good predictions of auditory cortical fMRI responses and exhibited correspondence between model stages and brain regions, but left it unclear whether these results generalize to other neural network models and, thus, how to further improve models in this domain. We evaluated model-brain correspondence for publicly available audio neural network models along with in-house models trained on 4 different tasks. Most tested models outpredicted standard spectromporal filter-bank models of auditory cortex and exhibited systematic model-brain correspondence: Middle stages best predicted primary auditory cortex, while deep stages best predicted non-primary cortex. However, some state-of-the-art models produced substantially worse brain predictions. Models trained to recognize speech in background noise produced better brain predictions than models trained to recognize speech in quiet, potentially because hearing in noise imposes constraints on biological auditory representations. The training task influenced the prediction quality for specific cortical tuning properties, with best overall predictions resulting from models trained on multiple tasks. The results generally support the promise of deep neural networks as models of audition, though they also indicate that current models do not explain auditory cortical responses in their entirety.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Efficient multi-scale representation of visual objects using a biologically plausible spike-latency code and winner-take-all inhibition

Deep neural networks have surpassed human performance in key visual challenges such as object recognition, but require a large amount of energy, computation, and memory. In contrast, spiking neural networks (SNNs) have the potential to improve both the efficiency and biological plausibility of object recognition systems. Here we present a SNN model that uses spike-latency coding and winner-take-all inhibition (WTA-I) to efficiently represent visual stimuli using multi-scale parallel processing. Mimicking neuronal response properties in early visual cortex, images were preprocessed with three different spatial frequency (SF) channels, before they were fed to a layer of spiking neurons whose synaptic weights were updated using spike-timing-dependent-plasticity. We investigate how the quality of the represented objects changes under different SF bands and WTA-I schemes. We demonstrate that a network of 200 spiking neurons tuned to three SFs can efficiently represent objects with as little as 15 spikes per neuron. Furthermore, studying how core object recognition may be implemented using biologically plausible learning rules in SNNs may not only further our understanding of the brain, but also lead to novel and efficient artificial vision systems.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Covalent Surface Modification Effects on Single‐Walled Carbon Nanotubes for Targeted Sensing and Optical Imaging

Abstract Optical nanoscale technologies often implement covalent or noncovalent strategies for the modification of nanoparticles, whereby both functionalizations are leveraged for multimodal applications but can affect the intrinsic fluorescence of nanoparticles. Specifically, single‐walled carbon nanotubes (SWCNTs) can enable real‐time imaging and cellular delivery; however, the introduction of covalent SWCNT sidewall functionalizations often attenuates SWCNT fluorescence. Recent advances in SWCNT covalent functionalization chemistries preserve the SWCNT's pristine graphitic lattice and intrinsic fluorescence, and here, such covalently functionalized SWCNTs maintain intrinsic fluorescence‐based molecular recognition of neurotransmitter and protein analytes. The covalently modified SWCNT nanosensor preserves its fluorescence response towards its analyte for certain nanosensors, presumably dependent on the intermolecular interactions between SWCNTs or the steric hindrance introduced by the covalent functionalization that hinders noncovalent interactions with the SWCNT surface. These SWCNT nanosensors are further functionalized via their covalent handles with a targeting ligand, biotin, to self‐assemble on passivated microscopy slides, and these dual‐functionalized SWCNT materials are explored for future use in multiplexed sensing and imaging applications.

Chio, Linda↗
DOE OSTI2024

From Data to Insights: A Covariate Analysis of the IARPA BRIAR Dataset for Multimodal Biometric Recognition Algorithms at Altitude and Range

This paper examines covariate effects on fused whole body biometrics performance in the IARPA BRIAR dataset, specifically focusing on UAV platforms, elevated positions, and distances up to 1000 meters. The dataset includes outdoor videos compared with indoor images and controlled gait recordings. Normalized raw fusion scores relate directly to predicted false accept rates (FAR), offering an intuitive means for interpreting model results. A linear model is developed to predict biometric algorithm scores, analyzing their performance to identify the most influential covariates on accuracy at altitude and range. Weather factors like temperature, wind speed, solar loading, and turbulence are also investigated in this analysis. The study found that resolution and camera distance best predicted accuracy and findings can guide future research and development efforts in long-range/elevated/UAV biometrics and support the creation of more reliable and robust systems for national security and other critical domains.

Bolme, David↗
DOE OSTI2025

Phylogenomic discovery and engineering of nitrogen fixation into the bioenergy woody crop poplar

Biological nitrogen fixation (BNF) is a key process enabling plants in specific lineages to convert atmospheric dinitrogen (N₂) into bioavailable ammonia through symbioses with diazotrophic microbes. Expanding this capability beyond native nitrogen-fixing clades into non-nodulating crops would reduce synthetic fertilizer use, lowering energy inputs and environmental impacts in agriculture. Supported by DOE Funding Award DE-SC0018247, the NitFix project advanced foundational knowledge required to engineer root-nodule symbioses in new host species. The team generated the most comprehensive phylogenomic analysis to date of all known nodulating lineages, resolving the evolutionary history of nitrogen-fixing symbiosis and identifying core gene suites retained across nodulating taxa. Through multimodal genomics, transcriptomics, and functional analyses in Medicago truncatula and related species, the project mapped regulatory networks underlying nodule organogenesis, bacterial infection, and nitrogen-fixation efficiency. Key discoveries include the identification of conserved signaling modules for rhizobial recognition, transcription factors controlling nodule differentiation, and metabolic pathways integrating fixed nitrogen into plant growth. The project also developed enabling tools—including optimized transformation pipelines, gene-editing workflows, and imaging-based phenotyping—to accelerate engineering efforts in emerging models. Together, these results refine the mechanistic framework of symbiotic nitrogen fixation and highlight transferable components essential for rewiring these traits into non-nodulating crops.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Machine Learning for Predictive Performance Analysis in Charged Particle Beam Tools

Imaging methods driven by probes, electrons, and ions have played a dominant role in modern science and engineering. Opportunities for machine vision and AI that focus on consumer problems like driving and feature recognition, are now presenting themselves for automating aspects of the scientific processes. This proposal aims to enable and drive discovery in ultra-low energy implantation by taking advantage of faster processing, flexible control and detection methods, and architecture-agnostic workflows that will result in higher efficiency and shorter scientific development cycles. Custom microscope control, collection and analysis hardware will provide a framework for conducting novel in situ experiments revealing unprecedented insight into surface dynamics at the nanoscale. Ion implantation is a key capability for the semiconductor industry. As devices shrink, novel materials enter the manufacturing line, and quantum technologies transition to being more mainstream. Traditional implantation methods fall short in terms of energy, ion species, and positional precision. Here we demonstrate 1 keV focused ion beam Au implantation into Si and validate the results via atom probe tomography. We show the Au implant depth at 1 keV is 0.8 nm and that identical results for low energy ion implants can be achieved by either lowering the column voltage, or decelerating ions using bias – while maintaining a sub-micron beam focus. We compare our experimental results to static calculations using SRIM and dynamic calculations using binary collision approximation codes TRIDYN and IMSIL. A large discrepancy between the static and dynamic simulation is found that is due to lattice enrichment with high stopping power Au and surface sputtering. Additionally, we demonstrate how model details are particularly important to the simulation of these low-energy heavy-ion implantations. Finally, we discuss how our results pave a way to much lower implantation energies, while maintaining high spatial resolution.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Development of $\mathrm{AMOEBA}$ Polarizable Force Field for Rare-Earth La 3+ Interaction with Bioinspired Ligands

Rare-earth metals (REMs) are crucial for many important industries, such as power generation and storage, in addition to cancer treatment and medical imaging. One promising new REM refinement approach involves mimicking the highly selective and efficient binding of REMs observed in relatively recently discovered proteins. However, realizing any such bioinspired approach requires an understanding of the biological recognition mechanisms. In this report we developed a new classical polarizable force field based on the AMOEBA framework for modeling a lanthanum ion (La 3+ ) interacting with water, acetate, and acetamide, which have been found to coordinate the ion in proteins. The parameters were derived by comparing to high-level ab initio quantum mechanical (QM) calculations that include relativistic effects. The AMOEBA model, with advanced atomic multipoles and electronic polarization, is successful in capturing both the QM distance-dependent La 3+ –ligand interaction energies and experimental hydration free energy. A new scheme for pairwise polarization damping (POLPAIR) was developed to describe the polarization energy in La 3+ interactions with both charged and neutral ligands. Simulations of La3+ in water showed water coordination numbers and ion–water distances consistent with previous experimental and theoretical findings. Water residence time analysis revealed both fast and slow kinetics in water exchange around the ion. This new model will allow investigation of fully solvated lanthanum ion–protein systems using GPU-accelerated dynamics simulations to gain insights on binding selectivity, which may be applied to the design of synthetic analogues.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

A Novel Hit-Based Method to Distinguish Tracks and Showers in ProtoDUNE Single Phase

Pandora is a pattern recognition software used in liquid argon time projection chamber (LArTPC) experiments such as MicroBooNE, DUNE, SBND, ICARUS, and ProtoDUNE Single Phase (SP). The output of a LArTPC can be considered a high-resolution 2D image and energy depositions, called hits, from particles in a LArTPC create complicated topologies that are broadly classified into tracks and showers. The event reconstruction is particularly challenging when there are multiple overlapping particles and in order to fully harness the imaging capabilities of thoseexperiments, Pandora needs to separate them. A hit-based approach to this problem is presented, which analyses small regions around each hit in events from DUNE Far Detector (FD) and from those regions it calculates local variables that are used subsequently in a machine learning approach. After this stage, it is given to each hit a probability to belong to a track or shower-like particle. Results will show the performance of separation between tracks and showers. This method is planned to be used for ProtoDUNE SP.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

A scanning-to-incision switch in TFIIH-XPG induced by DNA damage licenses nucleotide excision repair

Nucleotide excision repair (NER) is critical for removing bulky DNA base lesions and avoiding diseases. NER couples lesion recognition by XPC to strand separation by XPB and XPD ATPases, followed by lesion excision by XPF and XPG nucleases. Here, we describe key regulatory mechanisms and roles of XPG for and beyond its cleavage activity. Strikingly, by combing single-molecule imaging and bulk cleavage assays, we found that XPG binding to the 7-subunit TFIIH core (coreTFIIH) stimulates coreTFIIH-dependent double-strand (ds)DNA unwinding 10-fold, and XPG-dependent DNA cleavage by up to 700-fold. Simultaneous monitoring of rates for coreTFIIH single-stranded (ss)DNA translocation and dsDNA unwinding showed XPG acts by switching ssDNA translocation to dsDNA unwinding as a likely committed step. Pertinent to the NER pathway regulation, XPG incision activity is suppressed during coreTFIIH translocation on DNA but is licensed when coreTFIIH stalls at the lesion or when ATP hydrolysis is blocked. Moreover, ≥15 nucleotides of 5'-ssDNA is a prerequisite for efficient translocation and incision. Our results unveil a paired coordination mechanism in which key lesion scanning and DNA incision steps are sequentially coordinated, and damaged patch removal is only licensed after generation of ≥15 nucleotides of 5'-ssDNA, ensuring the correct ssDNA bubble size before cleavage.

59 BASIC BIOLOGICAL SCIENCES↗