Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image and signal processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Augmented signal processing in Liquid Argon Time Projection Chambers with a deep neural network

The Liquid Argon Time Projection Chamber (LArTPC) is an advanced neutrino detector technology widely used in recent and upcoming accelerator neutrino experiments. It features a low energy threshold and high spatial resolution that allow for comprehensive reconstruction of event topologies. In current-generation LArTPCs, the recorded data consist of digitized waveforms on wires produced by induced signal on wires of drifting ionization electrons, which can also be viewed as two-dimensional (2D) (time versus wire) projection images of charged-particle trajectories. For such an imaging detector, one critical step is the signal processing that reconstructs the original charge projections from the recorded 2D images. For the first time, we introduce a deep neural network in LArTPC signal processing to improve the signal region of interest detection. By combining domain knowledge (e.g., matching information from multiple wire planes) and deep learning, this method shows significant improvements over traditional methods. This work details the method, software tools, and performance evaluated with realistic detector simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Physics-guided dual implicit neural representations for source separation

Significant challenges exist in efficient data analysis of most advanced experimental and observational techniques because the collected signals often include unwanted contributions, such as background and signal distortions, that can obscure the physically relevant information of interest. To address this, we have developed a self-supervised machine-learning approach for source separation using a dual implicit neural representation framework that jointly trains two neural networks: one for approximating distortions of the physical signal of interest and the other for learning the effective background contribution. Our method learns directly from the raw data by minimizing a reconstruction-based loss function without requiring labeled data or pre-defined dictionaries. We demonstrate the effectiveness of our framework by considering a challenging case study involving large-scale simulated, as well as experimental, momentum-energy-dependent inelastic neutron scattering data in a four-dimensional parameter space, characterized by heterogeneous background contributions and unknown distortions to the target signal. The method is found to successfully separate physically meaningful signals from a complex or structured background even when the signal characteristics vary across all four dimensions of the parameter space. An analytical approach that informs the choice of the regularization parameter is presented. Our method offers a versatile framework for addressing source separation problems across diverse domains, ranging from superimposed signals in astronomical measurements to structural features in biomedical image reconstructions.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Efficient ptychographic phase retrieval via a matrix-free Levenberg-Marquardt algorithm

The phase retrieval problem, where one aims to recover a complex-valued image from far-field intensity measurements, is a classic problem encountered in a range of imaging applications. Modern phase retrieval approaches usually rely on gradient descent methods in a nonlinear minimization framework. Calculating closed-form gradients for use in these methods is tedious work, and formulating second order derivatives is even more laborious. Additionally, second order techniques often require the storage and inversion of large matrices of partial derivatives, with memory requirements that can be prohibitive for data-rich imaging modalities. We use a reverse-mode automatic differentiation (AD) framework to implement an efficient matrix-free version of the Levenberg-Marquardt (LM) algorithm, a longstanding method that finds popular use in nonlinear least-square minimization problems but which has seen little use in phase retrieval. Furthermore, we extend the basic LM algorithm so that it can be applied for more general constrained optimization problems (including phase retrieval problems) beyond just the least-square applications. Since we use AD, we only need to specify the physics-based forward model for a specific imaging application; the first and second-order derivative terms are calculated automatically through matrix-vector products, without explicitly forming the large Jacobian or Gauss-Newton matrices typically required for the LM method. We demonstrate that this algorithm can be used to solve both the unconstrained ptychographic object retrieval problem and the constrained “blind” ptychographic object and probe retrieval problems, under the popular Gaussian noise model as well as the Poisson noise model. We compare this algorithm to state-of-the-art first order ptychographic reconstruction methods to demonstrate empirically that this method outperforms best-in-class first-order methods: it provides excellent convergence guarantees with (in many cases) a superlinear rate of convergence, all with a computational cost comparable to, or lower than, the tested first-order algorithms.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Rethinking skip connections in Spiking Neural Networks with Time-To-First-Spike coding

Time-To-First-Spike (TTFS) coding in Spiking Neural Networks (SNNs) offers significant advantages in terms of energy efficiency, closely mimicking the behavior of biological neurons. In this work, we delve into the role of skip connections, a widely used concept in Artificial Neural Networks (ANNs), within the domain of SNNs with TTFS coding. Our focus is on two distinct types of skip connection architectures: (1) addition-based skip connections, and (2) concatenation-based skip connections. We find that addition-based skip connections introduce an additional delay in terms of spike timing. On the other hand, concatenation-based skip connections circumvent this delay but produce time gaps between after-convolution and skip connection paths, thereby restricting the effective mixing of information from these two paths. To mitigate these issues, we propose a novel approach involving a learnable delay for skip connections in the concatenation-based skip connection architecture. This approach successfully bridges the time gap between the convolutional and skip branches, facilitating improved information mixing. We conduct experiments on public datasets including MNIST and Fashion-MNIST, illustrating the advantage of the skip connection in TTFS coding architectures. Additionally, we demonstrate the applicability of TTFS coding on beyond image recognition tasks and extend it to scientific machine-learning tasks, broadening the potential uses of SNNs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A laser powder bed fusion system for operando synchrotron x-ray imaging and correlative diagnostic experiments at the Stanford Synchrotron Radiation Lightsource

Laser powder bed fusion (LPBF) is a highly dynamic multi-physics process used for the additive manufacturing (AM) of metal components. Improving process understanding and validating predictive computational models require high-fidelity diagnostics capable of capturing data in challenging environments. Synchrotron x-ray techniques play a vital role in the validation process as they are the only in situ diagnostic capable of imaging sub-surface melt pool dynamics and microstructure evolution during LPBF-AM. In this article, a laboratory scale system designed to mimic LPBF process conditions while operating at a synchrotron facility is described. The system is implemented with process accurate atmospheric conditions, including an air knife for active vapor plume removal. Significantly, the chamber also incorporates a diagnostic sensor suite that monitors emitted optical, acoustic, and electronic signals during laser processing with coincident x-ray imaging. The addition of the sensor suite enables validation of these industrially compatible single point sensors by detecting pore formation and spatter events and directly correlating the events with changes in the detected signal. Experiments in the Ti–6Al–4V alloy performed at the Stanford Synchrotron Radiation Lightsource using the system are detailed with sufficient sampling rates to probe melt pool dynamics. X-ray imaging captures melt pool dynamics at frame rates of 20 kHz with a 2 µm pixel resolution, and the coincident diagnostic sensor data are recorded at 470 kHz. Furthermore, this work shows that the current system enables the in situ detection of defects during the LPBF process and permits direct correlation of diagnostic signatures at the exact time of defect formation.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Highly sensitive 2D X-ray absorption spectroscopy via physics informed machine learning

Abstract Improving the spatial and spectral resolution of 2D X-ray near-edge absorption structure (XANES) has been a decade-long pursuit to probe local chemical reactions at the nanoscale. However, the poor signal-to-noise ratio in the measured images poses significant challenges in quantitative analysis, especially when the element of interest is at a low concentration. In this work, we developed a post-imaging processing method using deep neural network to reliably improve the signal-to-noise ratio in the XANES images. The proposed neural network model could be trained to adapt to new datasets by incorporating the physical features inherent in the latent space of the XANES images and self-supervised to detect new features in the images and achieve self-consistency. Two examples are presented in this work to illustrate the model’s robustness in determining the valence states of Ni and Co in the LiNi x Mn y Co 1-x-y O 2 systems with high confidence.

36 MATERIALS SCIENCE↗
DOE OSTI2021

In Situ Transmission Electron Microscopy: Signal processing challenges and examples

Transmission electron microscopy (TEM) is a powerful tool for imaging material structure and characterizing material chemistry. Recent advances in data collection technology for TEM have enabled high-volume and high-resolution data collection at a microsecond frame rate. Here, taking advantage of these advances in data collection rates requires the development and application of data processing tools, including image analysis, feature extraction, and streaming data processing techniques. In this article, we highlight a few areas in materials science that have benefited from combining signal processing and statistical analysis with data collection capabilities in TEM and present a future outlook on opportunities of integrating signal processing with automated TEM data analysis.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Enhancing hyperspectral EELS analysis of complex plasmonic nanostructures with pan-sharpening

Nanoscale hyperspectral techniques—such as electron energy loss spectroscopy (EELS)—are critical to understand the optical response in plasmonic nanostructures, but as systems become increasingly complex, the required sampling density and acquisition times become prohibitive for instrumental and specimen stability. As a result, there has been a recent push for new experimental methodologies that can provide comprehensive information about a complex system, while significantly reducing the duration of the experiment. In this work, we present a pan-sharpening approach to hyperspectral EELS analysis, where we acquire two datasets from the same region (one with high spatial resolution and one with high spectral fidelity) and combine them to achieve a single dataset with the beneficial properties of both. This work outlines a straightforward, reproducible pathway to reduced experiment times and higher signal-to-noise ratios, while retaining the relevant physical parameters of the plasmonic response, and is generally applicable to a wide range of spectroscopy modalities.

36 MATERIALS SCIENCE↗
DOE OSTI2020

In Situ Chemical Monitoring and Imaging of Contents within Microfluidic Devices Having a Porous Membrane Wall Using Liquid Microjunction Surface Sampling Probe Mass Spectrometry

The ability to observe dynamic chemical processes (e.g., signaling, transport, etc.) in vivo or in situ using nondestructive chemical imaging opens a new door to understanding the complex dynamics of developing biological systems. With the advent of “biology-on-a-chip” devices has come the ability to monitor dynamic chemical processes in a controlled environment, using these engineered habitats to capture key features of natural systems while allowing visual observation of system development. Having the capability to spatially and temporally map the chemical signals within these devices may yield new insights into the forces that drive biosystem development. Here, a porous membrane sealed microfluidic device was designed to allow normal microfluidic operation while enabling continuous, location specific sampling and chemical characterization by liquid microjunction surface sampling probe mass spectrometry (LMJ-SSP MS). LMJ-SSP was used to extract fluids with nL-to-μL/min flow rates directly from selected areas of the microfluidic device without negatively impacting the device function. These extracts were subsequently characterized using MS. This technique was used to acquire MS images of the entirety of several multi-input microfluidic devices having different degrees of fluid mixing. LMJ-SSP MS imaging visualized the spatial distribution of chemical components within the microfluidic channels and could visualize chemical reactions occurring in the device. These microfluidic devices with a porous membrane wall are wholly compatible with the construction of biology-on-a-chip devices. This ultimately would enable correlation of biosystem physical structure with an evolving chemical environment

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Imaging and Segmenting Grains and Subgrains Using Backscattered Electron Techniques

We present two new methods of processing data from backscattered electron signals in a scanning electron microscope to image grains and subgrains. The first combines data from multiple backscattered electron images acquired at different specimen geometries to (1) better reveal grain boundaries in recrystallized microstructures and (2) distinguish between recrystallized and unrecrystallized regions in partially recrystallized microstructures. The second utilizes spherical harmonic transform indexing of electron backscatter diffraction patterns to produce high angular resolution orientation data that enable the characterization of subgrains. Subgrains are produced during high-temperature plastic deformation and have boundary misorientation angles ranging from a few degrees down to a few hundredths of a degree. Here, we also present an algorithm to automatically segment grains from combined backscattered electron image data or grains and subgrains from high angular resolution electron backscatter diffraction data. Together, these new techniques enable rapid measurements of individual grains and subgrains from large populations.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Flow Induced Vibration Studies in Pressurized Helium Gas Cooling Channels

Production of metastable Technetium-99 (Tc-99m), a radioactive tracer that emits gamma rays, is vital to the medical imaging community. Tc-99m is extracted from the decay of Molybdenum-99 (Mo-99) which has a half-life of about 2-3 days. The work presented in this report is part of the NNSA’s mission to produce Mo-99 commercially, within the US, without the use of highly enriched uranium (HEU) in support of nonproliferation and global security. Los Alamos National Laboratory (LANL) is working with NorthStar Medical Radioisotopes (NMR) on their efforts to produce Mo-99 through the irradiation of Mo-100 targets using an electron beam. The NMR target comprises a stack of approximately 60-70 Mo-100 disks with diameter 24 mm and thickness 0.74 mm held in stainless steel laminations, each separated using 0.25 mm thick stainless steel spacers. The symmetric target stack is housed in an Inconel vessel with two Inconel windows on either side. Two electron accelerators are used to produce 40 MeV, 3.16 µA electron beams each that penetrate the Inconel windows and irradiate the Mo-100 disks. Approximately 90% of the total 250 kW beam power is deposited in the NMR target during the irradiation process. During irradiation, pressurized helium gas flows through 0.25 mm thin gaps between the disks cooling the beam window, target disks, disk laminations and spacers. Both NMR and LANL have found during cold testing of the target system (no heat deposition) that the Mo-100 disks undergo significant mass loss and disk breakage due to vibrations induced by the flowing helium gas. The mass loss is not only undesirable due to monetary loss from reduced final quantities of Mo-99, but also due to the hazards associated with radioactive material trapped in the cooling lines and particle filters. The effect of flow rate and target geometry on the flow induced vibrations need to be quantified, and recommendations provided to minimize this mass loss. This work describes LANL’s experimental characterization of the flow induced vibrations and disk mass loss in a reduced scale set-up containing 10 Mo-100 disks. We use high speed imaging, displacement measurements and microphone measurements combined with signal processing to estimate the vibration frequency of each disk. The effect of disk thickness, target fit and duration of testing on the mass loss is described. We find that in the current configuration of NMR targets, the vibrations and mass loss on the first disk are minimized, while those in the adjacent disks are highest. The microphone and high-speed image data show that increased flow rates and increased duration of testing increases vibration frequency and mass loss. The mass loss is due to both disk rotation and back and forth motion. There are visible wear marks on the disks with the highest mass loss. We also note that the current NMR window gap reduces flow induced vibrations compared to the previous smaller gaps. Longer duration testing will provide more data and verification for the findings presented in this report. The work will be continued in FY 24.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Skipper-in-CMOS: Nondestructive Readout With Subelectron Noise Performance for Pixel Detectors

The Skipper-in-CMOS image sensor integrates the nondestructive readout capability of skipper charge coupled devices (Skipper-CCDs) with the high conversion gain of a pinned photodiode (PPD) in a CMOS imaging process while taking advantage of in-pixel signal processing. This allows both single photon counting as well as high frame rate readout through highly parallel processing. The first results obtained from a ${15} \times {15}~\mu $ m2 pixel cell of a Skipper-in-CMOS sensor fabricated in Tower Semiconductor’s commercial 180-nm CMOS image sensor process are presented. Measurements confirm the expected reduction of the readout noise with the number of samples down to deep subelectron noise of $0.15\text {e}^ - $ , demonstrating the charge transfer operation from the PPD and the single photon counting operation when the sensor is exposed to light. This article also discusses new testing strategies employed for its operation and characterization.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Window Cooling Studies and Disk Vibration Testing on a Subset of Mo-100 Disks

Production of metastable Technetium-99 (Tc-99m), a radioactive tracer that emits gamma rays, is vital to the medical imaging community. Tc-99m is extracted from the decay of Molybdenum-99 (Mo-99) which has a half-life of about 2-3 days. The work presented in this report is part of the NNSA’s mission to produce Mo-99 commercially, within the US, without the use of highly enriched uranium (HEU) in support of nonproliferation and global security. Los Alamos National Laboratory (LANL) is working with NorthStar Medical Radioisotopes (NMR) on their efforts to produce Mo-99 through the irradiation of Mo-100 targets using an electron beam. The NMR target comprises a stack of approximately 60-70 Mo-100 disks with diameter 24 mm and thickness 0.74 mm held in stainless steel laminations, each separated using 0.25 mm thick stainless-steel spacers. The symmetric target stack is housed in an Inconel vessel with two Inconel windows on either side. Two electron accelerators are used to produce 40 MeV, 3.16 µA electron beams each that penetrate the Inconel windows and irradiate the Mo-100 disks. Approximately 90% of the total 250 kW beam power is deposited in the NMR target during the irradiation process, with a smaller percentage adding up to 2.2 kW of heat deposited on the Inconel window. During irradiation, pressurized helium gas flows through thin gaps between the disks cooling the beam window, target disks, disk laminations and spacers. Both NMR and LANL have found during cold testing of the target system (no heat deposition) that the Mo 100 disks undergo significant mass loss and disk breakage due to vibrations induced by the flowing helium gas. The mass loss is not only undesirable due to monetary loss from reduced final quantities of Mo-99, but also due to the hazards associated with radioactive material trapped in the cooling lines and particle filters. The effect of flow rate and target geometry on the flow induced vibrations need to be quantified, and recommendations provided to minimize this mass loss. LANL has previously also tested NMR’s Inconel beam window by heating the window, while flowing pressurized helium, using the average heat deposited on the window. However, the NMR beam is pulsed with a duty cycle of 12.5%, which introduces oscillation in temperature around the nominal 600 °C steady state value with each pulse. Available fatigue curves for Inconel are few, established for room temperature, and they are based on mechanical strain cycles not thermally induced strain as in the NMR target. The effect of pulsed beam heating on the Inconel window therefore needs to be quantified. This report details the experiments conducted to assess the factors that lead to mass loss in the NMR target disks as well as to understand the effect of a pulsed beam on NMR’s Inconel window. This work describes LANL’s experimental characterization of the flow induced vibrations and disk mass loss in a reduced scale set-up containing 5 to 10 Mo-100 disks. We use high speed imaging, displacement measurements and microphone measurements combined with signal processing to estimate the vibration frequency of each disk. The effect of disk thickness, target fit and duration of testing on the mass loss is described. We find that in the current configuration of NMR targets, the vibrations and mass loss on the first disk are minimized, while those in the adjacent disks are highest. The microphone and high-speed image data show that increased flow rates and increased duration of testing increases vibration frequency and mass loss. The mass loss is due to both disk rotation and back and forth motion. There are visible wear marks on the disks with the highest mass loss. We also note that the current NMR window gap reduces flow induced vibrations compared to the previous smaller gaps. Improved target holders significantly reduce disk mass loss to almost negligible quantities. This work finds that the larger window to first disk gap and improved target holder geometry should allow NMR to successfully conduct irradiations with minimal mass loss. The window tests were conducted to understand the effect of a pulsed beam on both the window longevity and to estimate the window temperature and displacement during pulsing. The experiments presented here were performed at significantly low power, due to the limitations of the induction heating system. The window temperature rose to approximately 73 °C with a significantly reduced power of 45 W without beam pulsing. With a 5 Hz pulse rate, 12.5% duty cycle, the window temperature remained constant at 26 °C. These experiments will be repeated with improved coil geometry and reported in upcoming journal papers.

42 ENGINEERING↗
DOE OSTI2020

Time-resolved 3D imaging of two-phase fluid flow inside a steel fuel injector using synchrotron X-ray tomography

The multiphase flow inside a diesel injection nozzle is imaged using synchrotron X-rays from the Advanced Photon Source at Argonne National Laboratory. Through acquisitions performed at several viewing angles and subsequent tomographic reconstruction, in-situ 3D visualization is achieved for the first time inside a steel injector at engine-like operating conditions. The morphology of the internal flow reveals strong flow separation and vapor-filled cavities (cavitation), the degree of which correlates with the nozzle's asymmetric inlet corner profile. Micron-scale surface features, which are artifacts of manufacturing, are shown to influence the morphology of the resulting liquid-gas interface. The data obtained at 0.1 ms time resolution exposes transient flow features and the flow development timescales are shown to be correlated with in-situ imaging of the fuel injector's hydraulically-actuated valve (needle). As more than 98.5% of the X-ray photon flux is attenuated within the steel injector body itself, we are posed with a unique challenge for imaging the flow within. Time-resolved imaging under these low-light conditions is achieved by exploiting both the refractive and absorptive properties of X-ray photons. The data-processing strategy converted these images with a signal-to-noise ratio of similar to 10 into a meaningful dataset for understanding internal flow and cavitation in a nozzle of diameter 200 mu m enclosed within 1-2 millimeters of steel.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2026

Spatiotemporal Learning in Power Modules: Wavelet-Enhanced Forecasting of Thermomechanical Degradation

Detecting internal defects in power electronics packages is critical for their performance and reliability, especially under extreme operating conditions, as these defects can lead to catastrophic failure if not properly addressed. Confocal scanning acoustic microscopy (C-SAM) plays a key role in the nondestructive evaluation of bond layer degradation within a power electronics package by detecting defects such as delamination, voids, and cracks. However, accurately quantifying and predicting these defects from C-SAM images remains a significant challenge due to the low noise-to-signal ratio, which typically arises from both imaging process and bond patterns itself. In this paper, we explore machine learning strategies for processing C-SAM images and providing predictive models of defect growth. We use C-SAM images of sintered copper and sintered silver samples, which are obtained under accelerated thermal experiments, as the representative dataset for our study. We investigate the effect of Fourier transforms and wavelet transforms on these datasets to remove high-frequency noise and address noise across multiple scales with histogram equalization to enhance the contrast and improve the visibility of defects. As a result, defect boundaries can be clearly distinguished, enabling more accurate tracking of their growth over time. We then employ different time-series forecasting algorithms on the denoised images to formulate an image-based lifetime prediction model. Statistical models and deep-learning techniques are trained on images obtained in the early stages of thermal shock, and defect growth in the later stages is predicted. Our work serves as a preliminary attempt to improve the accuracy of lifetime prediction models of power electronics packages, which is critical under extreme operating environments.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Three-dimensional super line-localization in low signal-to-noise microscope images via prior-apprised unsupervised learning (PAUL)

Biological processes such as processive enzyme turnover and intracellular cargo tracking involve the dynamic motion of a small "article" along a curvilinear biopolymer track. To understand these processes that occur across multiple length and time scales, one must acquire both the trajectory of the particle and the position of the track along which it moves, possibly by combining high-resolution single-particle tracking with conventional microscopy. Yet, usually there is a significant resolution mismatch between these modalities: while the tracked particle is localized with a precision of 10 nm, the image of the surroundings is limited by optical difraction, with 200 nm lateral and 500 nm axial resolutions. Compared to the particle's trajectory, the surrounding curvilinear structure appears as a blurred and noisy image. This disparity in the spatial resolutions of the particle trajectory and the surrounding curvilinear structure image makes data reconstruction, as well as interpretation, particularly challenging. Analysis is further complicated when the curvilinear structures are oriented arbitrarily in 3D space. Here, we present a prior-apprised unsupervised learning (PAUL) approach to extract information from 3D images where the underlying features resemble a curved line such as a filament or microtubule. This three-stage framework starts with a Hessian-based feature enhancement, which is followed by feature registration, where local line segments are detected on repetitively sampled subimage tiles. In the final stage, statistical learning, segments are clustered based on their geometric relationships. Principal curves are then approximated from each segment group via statistical tools including principal component analysis, bootstrap and kernel transformation. This procedure is characterized on simulated images, where sub-voxel medium deviations from true curves have been achieved. The 3D PAUL approach has also been implemented for successful line localization in experimental 3D images of gold nanowires obtained using a multifocal microscope. Lastly, this work not only bridges the resolution gap between two microscopy modalities, but also allows us to conduct 3D super line-localization imaging experiments, without using super-resolution techniques.

42 ENGINEERING↗