Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

A Denoising Autoencoder for Improved Kikuchi Pattern Quality and Indexing in Electron Backscatter Diffraction

The rapid collection and indexing of electron diffraction patterns as produced via electron backscatter diffraction (EBSD) has enabled crystallographic orientation and structural determination, as well as additional property-determining strain and dislocation density information with increasing speed, resolution, and efficiency. Pattern indexing quality is reliant on the noise of the collected electron diffraction patterns, which is often convoluted by sample preparation and data collection parameters. EBSD acquisition is sensitive to many factors and thus can result in low confidence index (CI), poor image quality (IQ), and improper minimization of fit, which can result in noisy datasets and misrepresent the microstructure. In an attempt to enable both higher speed EBSD data collection and enable greater orientation fit accuracy with noisy datasets, an image denoising autoencoder was implemented to improve pattern quality. Here, we show that EBSD data processed through the autoencoder results in a higher CI, IQ, and a more accurate degree of fit. In addition, using denoised datasets in HR-EBSD cross correlative strain analysis can result in reduced phantom strain from erroneous calculations due to the increased indexing accuracy and improved correspondence between collected and simulated patterns.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Quantum machine learning with differential privacy

Abstract Quantum machine learning (QML) can complement the growing trend of using learned models for a myriad of classification tasks, from image recognition to natural speech processing. There exists the potential for a quantum advantage due to the intractability of quantum operations on a classical computer. Many datasets used in machine learning are crowd sourced or contain some private information, but to the best of our knowledge, no current QML models are equipped with privacy-preserving features. This raises concerns as it is paramount that models do not expose sensitive information. Thus, privacy-preserving algorithms need to be implemented with QML. One solution is to make the machine learning algorithm differentially private, meaning the effect of a single data point on the training dataset is minimized. Differentially private machine learning models have been investigated, but differential privacy has not been thoroughly studied in the context of QML. In this study, we develop a hybrid quantum-classical model that is trained to preserve privacy using differentially private optimization algorithm. This marks the first proof-of-principle demonstration of privacy-preserving QML. The experiments demonstrate that differentially private QML can protect user-sensitive information without signficiantly diminishing model accuracy. Although the quantum model is simulated and tested on a classical computer, it demonstrates potential to be efficiently implemented on near-term quantum devices [noisy intermediate-scale quantum (NISQ)]. The approach’s success is illustrated via the classification of spatially classed two-dimensional datasets and a binary MNIST classification. This implementation of privacy-preserving QML will ensure confidentiality and accurate learning on NISQ technology.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Real Space Imaging of Field-Driven Decision-Making in Nanomagnetic Galton Boards

A possible spintronic route to hardware implementation for decision-making involves injecting a domain wall into a bifurcated magnetic nanostrip resembling a Y-shaped junction. A decision is made when the domain wall chooses a particular path through the bifurcation. Recently, it was shown that a structure like a nanomagnetic Galton board, which is essentially an array of interconnected Y-shaped junctions, produces outcomes that are stochastic and therefore relevant to artificial neural networks. However, the exact mechanism leading to the robust nature of randomness is unknown. Here, in this study, we directly image the decision-making process in nanomagnetic Galton boards using Lorentz transmission electron microscopy. We identify that the stochasticity in nanomagnetic Galton boards arises as a culmination of (1) the topology of the injected domain wall, (2) dissimilarly sized vertices, and (3) the strength of the applied field. Our results pave the way to a detailed understanding of stochasticity in nanomagnetic networks.

lorentz microscopy↗
DOE OSTI2020

Adapting In Situ Accelerators for Sparsity With Granular Matrix Reordering

Neural network (NN) inference is an essential part of modern systems and is found at the heart of numerous applications ranging from image recognition to natural language processing. In situ NN accelerators can efficiently perform NN inference using resistive crossbars, which makes them a promising solution to the data movement challenges faced by conventional architectures. Although such accelerators demonstrate significant potential for dense NNs, they often do not benefit from sparse NNs, which contain relatively few non-zero weights. Processing sparse NNs on in situ accelerators results in wasted energy to charge the entire crossbar where most elements are zeros. To address this limitation, this paper proposes Granular Matrix Reordering (GMR): a preprocessing technique that enables an energy-efficient computation of sparse NNs on in situ accelerators. GMR reorders the rows and columns of sparse weight matrices to maximize the crossbars' utilization and minimize the total number of crossbars needed to be charged. The reordering process does not rely on sparsity patterns and incurs no accuracy loss. Finally, GMR achieves an average of 28% and up to 34% reduction in energy consumption over seven pruned NNs across four different pruning methods and network architectures.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Exploring Capability of Multimodal Foundation Model for Image-based Fault Detection of Photovoltaic Modules

Multimodal Foundation Model (MFM), like ChatGPT and Gemini, have emerged as powerful tools for their exceptional natural language processing capabilities and their emerging potential in image analysis. This paper investigates the application of MFMs for photovoltaic (PV) fault detection through image analysis, focusing on ChatGPT 4.0 and Gemini 1.5 Pro. Three types of PV images and the corresponding common PV faults are detected: bird droppings using visible images, cell cracks via electroluminescence (EL) images, and hotspots using infrared (IR) images. Among the two models, Gemini 1.5 Pro demonstrated superior performance, achieving near-perfect results with an average F1 score of 0.97, consistently outperforming ChatGPT 4.0 in accuracy and reliability. Unlike traditional machine learning (ML) models, MFMs can operate in a zero shot manner that does not require additional training by the user, and the input images are not limited by size, angle, scope, or PV technology. The strong adaptability and user-friendliness make MFM a promising tool for analyzing PV images and advancing health monitoring for PV modules.

Li, Baojie↗
DOE OSTI2026

Practical Three-Dimensional Curvilinear Aperture Monopulse Synthetic Aperture Radar

When collected over a curved path, Synthetic Aperture Radar (SAR) contains information about the three-dimensional content of a scene that can aid interpretation of this difficult imaging modality. In a point scatterer simulation with amplitudes and heights derived from a real SAR image pair, we supplement confocal processing with a monopulse-based algorithm to compute heights of certain bright points, which we find automatically. In SAR, bright points often reflect man-made infrastructure central to scene interpretation.

Story, Mark [ORNL] (ORCID:0000000289148911)↗
DOE OSTI2025

Characterization of ablator dynamics initiated by picket-pulse conditions

Direct-drive laser-fusion targets may include low-cost plastic ablator material. Here, this work describes a tabletop experimental system designed to enable the investigation of the interaction of such ablator material as a function of the laser wavelength and the associated excitation mechanism. This experimental system offers time-resolved imaging of the material response with subpicosecond temporal resolution and ≈1-μm spatial resolution. The system involves synchronized femtosecond and picosecond lasers to initiate and characterize the dynamics of polystyrene planar targets irradiated by conditions similar to a “picket” prepulse from a direct-drive pulse shape. Ultrafast imaging of the initial excitation process followed by the resulting critical plasma formation, shock-wave propagation, and blowoff plasma expansion is used to compare the impact of excitation wavelength, 355 nm or 266 nm, on the ensuing dynamics. This work aims to investigate fundamental laser material interactions to help advance physics models that can inform the development of laser driver and target designs.

42 ENGINEERING↗
DOE OSTI2022

areaDetector/ADTimePix3

ADTimePix3 is an open‑source EPICS areaDetector driver for TimePix3 pixel detectors from Advanced Scientific Instruments (ASI). It provides a complete control and data‑acquisition interface between EPICS and the Serval server, supporting both real detectors (single‑chip and 2×2 quad configurations) and the TimePix3 emulator. The driver configures measurements via an HTTP/JSON REST API and acquires data through high‑rate TCP streams for raw events, images, and histograms. It offers real‑time preview and accumulated images, Time‑of‑Flight histogram processing, pixel masking (including Binary Pixel Configuration files and hot‑pixel tools), extensive health and status monitoring, and integration with standard areaDetector plugins for file saving and downstream analysis. ADTimePix3 is designed for Linux 64‑bit systems (tested on Ubuntu and RHEL) and is distributed under an MIT license with additional institutional disclaimers, enabling reuse and extension in photon science beamlines and other TimePix3‑based experimental facilities.

Gofron, Kaz↗
DOE OSTI2023

Characterization of a Low-Temperature Plasma (LTP) Ambient Ionization Source Using Temporally Resolved Monochromatic Imaging Spectrometry

The low-temperature plasma (LTP) probe is a common plasma-based source used for ambient desorption–ionization mass spectrometry (MS). While the LTP probe has been characterized in detail with MS, relatively few studies have used optical spectroscopy. In this paper, two-dimensional (2D) imaging at selected wavelengths is used to visualize important species in the LTP plasma jet. First, 2D steady-state images of the LTP plume for N 2 + (391.2 nm), He I (706.5 nm), and N 2 (337.1 nm) emissions were recorded under selected plasma conditions. Second, time-resolved 2D emission maps of radiative species in the LTP plasma jet were recorded through the use of a 200 ns detection gate and varying gate delays with respect to the LTP trigger pulse. Emission from He I, N 2 + , and N 2 in the plasma jet region was found to show a transient behavior (often referred to as plasma bullets) lasting only a few microseconds. The N 2 + and He I maps were highly correlated in spatial and temporal structure. Further, emission from N 2 showed two maxima in time, one before and one after the maximum emission for N 2 + and He I, due to an initial electronic excitation wave and ion–electron recombination, respectively. Third, the interaction of the LTP probe with a sample substrate and an electrically grounded metallic needle was studied. Emission from a fluorophore on the sample substrate showed an initial photon-induced excitation from plasma-generated photons followed by electronic excitation by other plasma species. The presence of a grounded needle near the plasma jet significantly extended the plasma jet lifetime and also generated a long-lived corona discharge on the needle. The effect of LTP operating parameters on emission spectra was correlated with mass-spectral results including reagent-ion signals. Lastly, five movies provide a side-by-side comparison of the temporal behavior of emitting species and insights into the interactions of the emission clouds with a sample surface as well as an external needle. Temporally and spatially resolved imaging provided insights into important processes in the LTP plasma jet, which will help improve analyte ion sampling in LTP–MS.

Chan, George C. -Y.↗
DOE OSTI2022

Temporal and spatial tuning of optical constants in praseodymium doped ceria by electrochemical means

Abstract Temporal and spatial tuning of the refractive index of optical thin films is desired for flat optics applications. The redistribution of mobile ions in mixed ionic-electronic conductors (MIEC) has been demonstrated to serve as a viable means for achieving optical tuning down to the nanoscale. Here we studied the dynamic range of the optical tuning achievable in the refractive index, in the MIEC oxide – Pr x Ce 1− x O 2− δ (PCO), for x = 0.1, 0.2 and 0.4, at 500 °C, by in-situ spectrophotometry. Significant increases in the modulation of both the imaginary and real optical constants in the visible and the adjacent spectra were obtained for increased doping levels. Device employing an electrochemical titration method was implemented to modulate the oxygen concentration, and thereby the optical transmission of PCO. Incorporation of a patterned top electrode allowed for the demonstration of spatial control of PCO thin film properties by in-situ video imaging of the optical switching process. The electrochemically induced optical state is shown to remain non-volatile upon quenching the device to room temperature under applied bias.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Model Data Archive Associated with Manuscript "Fire-altered Carbon Pools Create Disturbance Memory in Stream Dissolved Organic Carbon"

This data package supports the publication “Fire-altered Carbon Pools Create Disturbance Memory in Stream Dissolved Organic Carbon” by Li et al. (2026). The package contains processed model inputs, configuration files, restart files, simulation outputs, scripts, and visualization products used to evaluate post-fire dissolved organic carbon (DOC) dynamics in the Naches River Watershed, Washington, USA, following the 2021 Schneider Springs Fire. The modeling workflow couples ELM-BGC, the biogeochemistry-enabled Energy Exascale Earth System Model Land Model; ATS, the Advanced Terrestrial Simulator for integrated surface-subsurface hydrology; and PFLOTRAN, a reactive transport model for multicomponent aqueous geochemistry. Together, these models simulate how wildfire-induced changes in vegetation, litter, coarse woody debris, and soil organic matter influence DOC production, transport, and reaction from burned hillslopes to stream networks. The archive includes preprocessed meteorological, geospatial, hydrologic, and biogeochemical forcing data; ELM-BGC-derived DOC source terms; ATS mesh files; PFLOTRAN reactive-transport inputs; model configuration files; spin-up and transient restart files; watershed-scale diagnostic outputs; stream concentration time series; and figures or visualization files used to inspect and reproduce key results. File types include Hierarchical Data Format 5 (HDF5) files for gridded forcing and model-coupling data, model input and configuration files for ELM-BGC, ATS, and PFLOTRAN, restart and simulation-output files generated by the modeling workflow, tabular or time-series diagnostic outputs, scripts for post-processing and figure generation, and image or visualization products associated with the manuscript. Use of the package depends on the intended task. Re-running the simulations requires the relevant modeling software, including ELM-BGC, ATS, and PFLOTRAN as ATS's geochemical engine. Inspecting outputs and reproducing figures requires Python with scientific plotting libraries such as Matplotlib, and three-dimensional model outputs may be viewed with ParaView. Geographic information system files or maps may be inspected with ArcGIS Pro or comparable GIS software. The data package is intended to enable traceability, reuse, and partial reproduction of the coupled land-to-watershed hydro-biogeochemical modeling workflow used to test how wildfire disturbance affects terrestrial carbon pools and downstream DOC dynamics.

ATS↗
DOE OSTI2022

Unified Language Frontend for Physic-Informed AI/ML

Artificial intelligence and machine learning (AI/ML) are becoming important tools for scientific modeling and simulation as in several other fields such as image analysis and natural language processing. ML techniques can leverage the computing power available in modern systems and reduce the human effort needed to configure experiments, interpret and visualize results, draw conclusions from huge quantities of raw data, and build surrogates for physics based models. Domain scientists in fields like fluid dynamics, microelectronics and chemistry can automate many of their most difficult and repetitive tasks or improve the design times by use of the faster ML-surrogates. However, modern ML and traditional scientific highperformance computing (HPC) tend to use completely different software ecosystems. While ML frameworks like PyTorch and TensorFlow provide Python APIs, most HPC applications and libraries are written in C++. Direct interoperability between the two languages is possible but is tedious and error-prone. In this work, we show that a compiler-based approach can bridge the gap between ML frameworks and scientific software with less developer effort and better efficiency. We use the MLIR (multi-level intermediate representation) ecosystem to compile a pre-trained convolutional neural network (CNN) in PyTorch to freestanding C++ source code in the Kokkos programming model. Kokkos is a programming model widely used in HPC to write portable, shared-memory parallel code that can natively target a variety of CPU and GPU architectures. Our compiler-generated source code can be directly integrated into any Kokkosbased application with no dependencies on Python or cross-language interfaces.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Vision Transformers Explained Series

Since their introduction in 2017 with Attention is All You Need¹, transformers have established themselves as the state of the art for natural language processing (NLP). In 2021, An Image is Worth 16x16 Words successfully adapted transformers for computer vision tasks. Since then, numerous transformer-based architectures have been proposed for computer vision. This article walks through the Vision Transformer (ViT) as laid out in An Image is Worth 16x16 Words.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Evaluation and Development of Phase Array Ultrasonic Testing (PAUT) System for Additively Manufactured Parts

This research focuses on the application of advanced ultrasonic testing techniques developed by The Phased Array Company (TPAC) for inspecting defects in additive manufacturing (AM) parts. Traditionally, X-ray computed tomography is the standard for inspecting AM components. Although, the long inspection and analysis time, along with relatively high cost make implementation difficult. Thus, an alternative nondestructive evaluation (NDE) approach is necessary to support quality assurance efforts within the field of AM. TPAC is recognized as a leader in ultrasonic testing innovation, deploying sophisticated algorithms such as Total Focusing Method (TFM) and Phased Wave Imaging (PWI) for ultrasonic data processing and interpretation. This work will explore how the TFM and PWI algorithms can assist defect detection within polymer AM parts. The AM field is seeking novel NDE methods to provide support within quality control and assurance efforts. Advanced ultrasonics inspection have the potential to fulfill this need.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Evaluation and Development of Phase Array Ultrasonic Testing (PAUT) System for Additively Manufactured Parts

This research focuses on the application of advanced ultrasonic testing techniques developed by The Phased Array Company (TPAC) for inspecting defects in additive manufacturing (AM) parts. Traditionally, X-ray computed tomography is the standard for inspecting AM components. Although, the long inspection and analysis time, along with relatively high cost make implementation difficult. Thus, an alternative nondestructive evaluation (NDE) approach is necessary to support quality assurance efforts within the field of AM. TPAC is recognized as a leader in ultrasonic testing innovation, deploying sophisticated algorithms such as Total Focusing Method (TFM) and Phased Wave Imaging (PWI) for ultrasonic data processing and interpretation. This work will explore how the TFM and PWI algorithms can assist defect detection within polymer AM parts. The AM field is seeking novel NDE methods to provide support within quality control and assurance efforts. Advanced ultrasonics inspection have the potential to fulfill this need.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Assessing the Reliability of Relevant Tweets and Validation Using Manual and Automatic Approaches for Flood Risk Communication

While Twitter has been touted as a preeminent source of up-to-date information on hazard events, the reliability of tweets is still a concern. Our previous publication extracted relevant tweets containing information about the 2013 Colorado flood event and its impacts. Using the relevant tweets, this research further examined the reliability (accuracy and trueness) of the tweets by examining the text and image content and comparing them to other publicly available data sources. Both manual identification of text information and automated (Google Cloud Vision, application programming interface (API)) extraction of images were implemented to balance accurate information verification and efficient processing time. The results showed that both the text and images contained useful information about damaged/flooded roads/streets. This information will help emergency response coordination efforts and informed allocation of resources when enough tweets contain geocoordinates or location/venue names. This research will identify reliable crowdsourced risk information to facilitate near real-time emergency response through better use of crowdsourced risk communication platforms.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

System, apparatus, and method for determining elemental composition using 4D STEM

The present disclosure relates to transmission electron microscopy for evaluation of biological matter. According to an embodiment, the present disclosure further relates to an apparatus for determining the structure and/or elemental composition of a sample using 4D STEM, comprising a direct bombardment detector operating with global shutter readout, processing circuitry configured to acquire images of bright-field disks using either a contiguous array or non-contiguous array of detector pixel elements, correct distortions in the images, align each image of the images based on a centroid of the bright-field disk, calculate a radial profile of the images, normalize the radial profiles by a scaling factor, calculate the rotationally-averaged edge profile of the bright-field disk, and determine elemental composition within the specimen based on the characteristics of the edge profile of the bright-field disk corresponding to each specimen location.

Bammes, Benjamin↗