Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Designing Unmanned Aerial Survey Monitoring Program to Assess Floating Litter Contamination

Monitoring marine contamination by floating litter can be particularly challenging since debris are continuously moving over a large spatial extent pushed by currents, waves, and winds. Floating litter contamination have mostly relied on opportunistic surveys from vessels, modeling and, more recently, remote sensing with spectral analysis. This study explores how a low-cost commercial unmanned aircraft system equipped with a high-resolution RGB camera can be used as an alternative to conduct floating litter surveys in coastal waters or from vessels. The study compares different processing and analytical strategies and discusses operational constraints. Collected UAS images were analyzed using three different approaches: (i) manual counting (MC), using visual inspection and image annotation with object counts as a baseline; (ii) pixel-based detection, an automated color analysis process to assess overall contamination; and (iii) machine learning (ML), automated object detection and identification using state-of-the-art convolutional neural network (CNNs). Our findings illustrate that MC still remains the most precise method for classifying different floating objects. ML still has a heterogeneous performance in correctly identifying different classes of floating litter; however, it demonstrates promising results in detecting floating items, which can be leveraged to scale up monitoring efforts and be used in automated analysis of large sets of imagery to assess relative floating litter contamination.

Almeida, Sílvia (ORCID:0000000320636826)↗

Fast quantum ghost imaging with a single-photon-sensitive time-stamping camera

Quantum ghost imaging (QGI) leverages correlations between entangled photon pairs to reconstruct an image using light that has never physically interacted with an object. Despite extensive research interest, this technique has long been hindered by slow acquisition speeds, due to the use of raster-scanned detectors or the slow response of intensified cameras. Here, we utilize a single-photon-sensitive time-stamping camera to perform QGI at ultra-low-light levels with rapid data acquisition and processing times, achieving high-resolution and high-contrast images in under 1 min. Our work addresses the trade-off between image quality, optical power, data acquisition time, and data processing time in QGI, paving the way for practical applications in biomedical and quantum-secured imaging.

Mavian, Alex (ORCID:0000000279448830)↗

Quantifying patterns in optical micrographs of one- and two-dimensional ellipsoidal particle assemblies

Current developments in colloidal science include the assembly of anisotropic colloids with broad geometric diversity. As the complexity of particle assemblies increases, the need for ubiquitous algorithms that quantitatively analyze images of the assemblies to deliver key information such as quantification of crystal structures becomes more urgent. This contribution describes algorithms capable of image analysis for classifying colloidal structures based on abstracted interparticle relationship information and quantitatively analyzing the abundance of each structure in mixed pattern assemblies. The algorithm parameters can be adjusted, allowing for the algorithms to be adapted for different image analyses. Three different ellipsoidal particle assembly images are presented to demonstrate the effectiveness of the algorithms: a one-dimensional (1D) particle chain assembly and two two-dimensional (2D) polymorphic crystals each consisting of assemblies of two distinct plane symmetry groups. Angle relationships between neighbouring particles are calculated and neighbour counts of each particle are determined. Combining these two parameters as rules for classification criteria allows for the labeling and quantification of each particle into a defined symmetry class within an assembly. The algorithms provide a labelled image comprising classification results and particle counts of each defined class. For multiple images or individual frames from a video, the script can be looped to achieve automatic processing. The yielded classification data allow for more in-depth image analysis of mixed pattern particle assemblies. Finally, we envision that these algorithms will have utility in quantitative analysis of images comprising ellipsoidal colloidal materials, nanoparticles, or biological matter.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Expediting DECam Multimessenger Counterpart Searches with Convolutional Neural Networks

Searches for counterparts to multimessenger events with optical imagers use difference imaging to detect new transient sources. However, even with existing artifact-detection algorithms, this process simultaneously returns several classes of false positives: false detections from poor-quality image subtractions, false detections from low signal-to-noise images, and detections of preexisting variable sources. Currently, human visual inspection to remove the false positives is a central part of multimessenger follow-up observations, but when next generation gravitational wave and neutrino detectors come online and increase the rate of multimessenger events, the visual inspection process will be prohibitively expensive. We approach this problem with two convolutional neural networks operating on the difference imaging outputs. The first network focuses on removing false detections and demonstrates an accuracy of 92% on our data set. The second network focuses on sorting all real detections by the probability of being a transient source within a host galaxy and distinguishes between various classes of images that previously required additional human inspection. We find the number of images requiring human inspection will decrease by a factor of 1.5 using our approach alone and a factor of 3.6 using our approach in combination with existing algorithms, facilitating rapid multimessenger counterpart identification by the astronomical community.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Influence of Tabula Rasa on Process- and Light-Induced Degradation of Solar Cells Fabricated From Czochralski Silicon

Monocrystalline Si solar cells are fabricated from Czochralski (Cz) Si, which contains 10 17 –10 18 cm -3 oxygen atoms. Cz Si undergoes degradation during high-temperature thermal processing steps, such as dopant diffusion to form the p - n junction. This degradation in the bulk minority carrier lifetime can be related to the formation of oxygen precipitates. We found that a high-temperature annealing process known as tabula rasa (TR) not only mitigates process-induced degradation via oxygen precipitate nuclei dissolution, but also modifies subsequent light-induced degradation. We report on the bulk carrier lifetime of n - and p -type Cz Si after TR, which homogenizes the interstitial oxygen in the bulk Si to its monoatomic form in either an N 2 or O 2 environment. A control sample, which was not subjected to a TR processing step, experienced severe process-induced degradation during a boron emitter thermal budget as oxygen precipitates were formed in the Si bulk. These precipitates could be imaged using photoluminescence. Additionally, samples that underwent a TR processing step prior to the boron emitter thermal budget show efficient gettering of metallic impurities compared to the control sample, which showed a decline in the implied open-circuit voltage after the gettering step. Furthermore, modification of the interstitial oxygen bonding by TR had a strong effect on the light-induced degradation kinetics. Instead of a typically observed monotonic decrease, minority carrier lifetime increases first, followed by a nonmonotonic decrease over a ~20 h period. Finally, we conclude that by modifying the interstitial oxygen bonding via TR pretreatment, p -type Cz Si wafers become substantially resistant to harsh solar cell processes and strongly modified light-induced degradation, which would open alternative ways to mitigate this degradation mechanism.

14 SOLAR ENERGY↗

Laser-interference pulse number dependence of surface chemistry and sub-surface microstructure of AA2024-T3 alloy

The laser-based treatment of a metal surface is an intrinsically non-chemical technique that can alter both the topology and chemistry of surfaces. A laser-based treatment for coating and joining applications can offer alternative surface preparations to the chemically-based surface preparation techniques, which are subject to severe environmental protection and hazardous-waste management considerations. In this study, the surface chemistry and sub-surface microstructural changes are investigated for a novel surface processing method using laser interferometry produced by two beams of a pulsed Nd:YAG laser. The two-beam laser-interference allowed the structuring of the surface at length scales much less than that of the laser beam spot. Surface chemistry changes in the oxide layer of AA 2024-T3 aluminum alloy rolled sheet due to laser processing were investigated using x-ray photoelectron spectroscopy (XPS). Near surface microstructural changes have been investigated with scanning electron microscopy and energy dispersive x-ray spectroscopy (SEM/EDS), and scanning transmission electron microscopy (STEM) as a function of number of interfering laser shots. SEM microstructure pictures of the top surface shows the minimization of surface defects, as all of the sharp features from a rolled sheet surface were smoothed by laser-structuring. STEM images indicate that the laser-interference processing reduced the formation of CuMn-rich precipitates over a 500–800 nm depth from the top surface. XPS data indicated that the Al oxide layer is modified compared to that of the baseline specimen and that the oxide thickness increases with the number of shots per spot. Finally, the additional thicker oxide on Al alloys is expected to increase the corrosion resistance of the coated Al 2024.

36 MATERIALS SCIENCE↗

Characterizing Biomass Feedstock Transport Properties Using State of the Art Imaging and Computational Techniques

The microstructure of lignocellulosic biomass determines heat and mass transfer during conversion processes. We present a novel method for characterizing the transport properties of biomass using advanced imaging and computational techniques. The microstructure of two woody feedstocks, red oak and Douglas fir, before and after pyrolysis, is revealed using X-ray computed tomography (XCT). Transport properties are calculated from the XCT images, and principal permeability tensors are calculated using an immersed boundary-based finite volume solver to model gas flow through the geometries. We observe that the permeabilities of native biomass are distinctly anisotropic, however, this anisotropy is greatly reduced after pyrolysis.

adaptive mesh refinement↗

Introduction to Special Section: Machine Learning for Image-based Geologic Interpretation

Image-based geological interpretation has been a labor-intensive and time-consuming process because it requires well-trained geoscientists to identify geological structures, features, and textures from various types of images. These images include scanning electron microscopic images, optical microscopic images, optical photos, resistivity images, seismic volumes, remote-sensing images, etc. With fast-evolving machine learning (ML) technology and computing power in recent decades, computers can achieve nearhuman-level to super-human-level performance with scalable high efficiency in the computer vision field. These technological revolutions facilitated image-based geological interpretation in petroleum exploration and production. For example, a fault picking method applied to 3-D seismic volume data using deep learning can achieve superior performance in comparison to conventional auto-picking methods. In addition, under the new normal of low oil prices, the petroleum industry seeks cost-effective strategies such as automating traditionally labor-intensive processes. Nevertheless, the potential of applying ML to geological image interpretation is still facing a few key challenges including data scarcity, data distribution, poor data and/or label quality, data leakage, learning algorithms, model architecture, training methodologies, testing and evaluation metrics, hyper-parameters optimization, model drift, production deployment, and the like.

58 GEOSCIENCES↗

A prototype scintillator real‐time beam monitor for ultra‐high dose rate radiotherapy

Background: FLASH Radiotherapy (RT) is an emergent cancer RT modality where an entire therapeutic dose is delivered at more than 1000 times higher dose rate than conventional RT. For clinical trials to be conducted safely, a precise and fast beam monitor that can generate out-of-tolerance beam interrupts is required. This paper describes the overall concept and provides results from a prototype ultra-fast, scintillator-based beam monitor for both proton and electron beam FLASH applications. Purpose: A FLASH Beam Scintillator Monitor (FBSM) is being developed that employs a novel proprietary scintillator material. The FBSM has capabilities that conventional RT detector technologies are unable to simultaneously provide: (1) large area coverage; (2) a low mass profile; (3) a linear response over a broad dynamic range; (4) radiation hardness; (5) real-time analysis to provide an IEC-compliant fast beam-interrupt signal based on true two-dimensional beam imaging, radiation dosimetry and excellent spatial resolution. Methods: The FBSM uses a proprietary low mass, less than 0.5 mm water equivalent, non-hygroscopic, radiation tolerant scintillator material (designated HM: hybrid material) that is viewed by high frame rate CMOS cameras. Folded optics using mirrors enable a thin monitor profile of ∼10 cm. A field programmable gate array (FPGA) data acquisition system generates real-time analysis on a time scale appropriate to the FLASH RT beam modality: 100–1000 Hz for pulsed electrons and 10–20 kHz for quasi-continuous scanning proton pencil beams. An ion beam monitor served as the initial development platform for this work and was tested in low energy heavy-ion beams ( 86 Kr +26 and protons). A prototype FBSM was fabricated and then tested in various radiation beams that included FLASH level dose per pulse electron beams, and a hospital RT clinic with electron beams. Results: Results presented in this report include image quality, response linearity, radiation hardness, spatial resolution, and real-time data processing. Furthermore, the HM scintillator was found to be highly radiation damage resistant. It exhibited a small 0.025%/kGy signal decrease from a 216 kGy cumulative dose resulting from continuous exposure for 15 min at a FLASH compatible dose rate of 237 Gy/s. Measurements of the signal amplitude versus beam fluence demonstrate linear response of the FBSM at FLASH compatible dose rates of >40 Gy/s. Comparison with commercial Gafchromic film indicates that the FBSM produces a high resolution 2D beam image and can reproduce a nearly identical beam profile, including primary beam tails. The spatial resolution was measured at 35–40 µm. Tests of the firmware beta version show successful operation at 20 000 Hz frame rate or 50 µs/frame, where the real-time analysis of the beam parameters is achieved in less than 1 µs. Conclusions: The FBSM is designed to provide real-time beam profile monitoring over a large active area without significantly degrading the beam quality. A prototype device has been staged in particle beams at currents of single particles up to FLASH level dose rates, using both continuous ion beams and pulsed electron beams. Using a novel scintillator, beam profiling has been demonstrated for currents extending from single particles to 10 nA currents. Radiation damage is minimal and even under FLASH conditions would require ≥50 kGy of accumulated exposure in a single spot to result in a 1% decrease in signal output. Beam imaging is comparable to radiochromic films, and provides immediate images without hours of processing. Real-time data processing, taking less than 50 µs (combined data transfer and analysis times), has been implemented in firmware for 20 kHz frame rates for continuous proton beams.

2D beam imaging↗

Unsupervised multimodal fusion of in-process sensor data for advanced manufacturing process monitoring

Effective monitoring of manufacturing processes is crucial for maintaining product quality and operational efficiency. Modern manufacturing environments often generate vast amounts of complementary multimodal data, including visual imagery from various perspectives and resolutions, hyperspectral data, and machine health monitoring information such as actuator positions, accelerometer readings, and temperature measurements. However, fusing and interpreting this complex, high-dimensional data presents significant challenges, particularly when labeled datasets are unavailable or impractical to obtain. This paper presents a novel approach to multimodal sensor data fusion in manufacturing processes, inspired by the Contrastive Language-Image Pre-training (CLIP) model. We leverage contrastive learning techniques to correlate different data modalities without the need for labeled data, overcoming limitations of traditional supervised machine learning methods in manufacturing contexts. Our proposed method demonstrates the ability to handle and learn encoders for five distinct modalities: visual imagery, audio signals, laser position (x and y coordinates), and laser power measurements. By compressing these high-dimensional datasets into low-dimensional representational spaces, our approach facilitates downstream tasks such as process control, anomaly detection, and quality assurance. The unsupervised nature of our method makes it broadly applicable across various manufacturing domains, where large volumes of unlabeled sensor data are common. We evaluate the effectiveness of our approach through a series of experiments, demonstrating its potential to enhance process monitoring capabilities in advanced manufacturing systems. This research contributes to the field of smart manufacturing by providing a flexible, scalable framework for multimodal data fusion that can adapt to diverse manufacturing environments and sensor configurations. The proposed method paves the way for more robust, data-driven decision-making in complex manufacturing processes.

Contrastive Learning↗

Device and method for constructing and displaying high quality images from imaging data by transforming a data structure utilizing machine learning techniques

Constructing a computer image from raw imaging data or encoded imaging data by transforming a first data structure in which the raw imaging data or the encoded imaging data is stored into a second data structure storing reorganized imaging data. The raw imaging data or the encoded imaging data is received, stored in the first data structure. The computer reorganizes the raw imaging data or the encoded imaging data into the reorganized data and stores the reorganized data in the second data structure, which is a multi-dimensional array having subarrays containing local information needed by a convolutional neural network for processing the reorganized data. Other portions of the multi-dimensional array store other portions of the raw imaging data or the encoded imaging data. The computer also processes the reorganized data using the convolutional neural network to construct the image, whereby a constructed image is formed.

Korbin, John P.↗

Characterizing natural fractures and sub-seismic faults for well completion of Marcellus shale in the MSEEL Consortium project, West Virginia, USA

The Middle Devonian Marcellus shale play has emerged as a major world-class hydrocarbon accumulation and represents one of the largest and most prolific shale plays in the world. According to many outcrop studies in the region, natural fractures are well developed in the Marcellus Shale. However, evaluating fractures in the subsurface is often a significant challenge due to a lack of sufficient data. Therefore, in the Marcellus Shale Energy and Environment Laboratory (MSEEL) consortium project, significant efforts have been made to acquire high-quality image logs in the Marcellus laterals. The project provided tremendous opportunities to characterize the natural fractures and sub-seismic faults and to evaluate their impact on well stimulation. In this study, about 70,000 ft of acquired high-resolution logging while drilling (LWD) acoustic images from five long laterals located in Monongalia County, West Virginia, were processed and interpreted. In addition, the study used high-quality micro-resistivity images from a pilot well, allowing the evaluation of natural fractures in the entire Marcellus vertical sequence. Based on the available acoustic images, the natural fractures were classified into three basic categories: high-amplitude fractures, low-amplitude fractures, and faults. Further, larger open fractures can also be determined when a low-amplitude fracture is evident on caliper images. The fractures in the Marcellus usually have a medium to high angle dip; however, multiple fracture sets in terms of strike orientation were clearly observed in all the laterals. The fracture set with a strike at NE-SW (or 60-240 deg) seems to be the predominant one in all the wells. A few other sets, including those with N-S, NWW-SEE, and E-W strikes, were also observed. Several sub-seismic faults, with mostly a low dip angle and a NE-SW strike, have also been seen in two of the laterals. The fracture density is variable across all the laterals, ranging from very low (or none) to very high (up to 5 fractures per ft). The average fracture density for all the laterals is about 1 fracture per 10 ft. In the vertical sequence, the natural fracture development showed a clear preference for shale or shaly facies over carbonate-rich or thin limestone layers. The interpreted fracture and fault data were used as input data for the stimulation design with the purpose of better understanding the fractures’ impact on well stimulation. Production data from the laterals were also used to evaluate the natural fractures’ influence on well performance. The quality image database and the consistent interpretation results for the entire project enabled a systematic approach to characterizing fractures and, more importantly, to evaluating the impact of fractures on well stimulation and production.

03 NATURAL GAS↗

Three-Dimensional Imaging Lidar for Characterizing Particle Fields and Organisms in the Mesopelagic Zone

The ocean’s mesopelagic zone is largely uncharacterized despite its vital role in sustaining ocean ecosystems. The composition, cycling, and fate of particle fields in the mesopelagic lacks an integrative multi-scale understanding of organism migration patterns, distribution, and diversity. This problem is addressed by combining complementary technologies with overlapping size spectra, including profiler mounted optical scattering sensors, profiler, and ship mounted acoustic devices, and a custom Unobtrusive Multi-Static Lidar Imager (UMSLI). This unique sensor suite can observe distributions of particles including organisms over a six order of magnitude dynamic size range, from microns to meters. Overlapping size ranges between different methods allows for cross-validation. This work focuses on the lidar imaging measurements and optical backscattering and attenuation, covering a combined particle size range of 0.1 mm to several cm. Particles at the small end of this range are sized using an existing backscattering time series inversion method after Briggs et al. (2013). Larger particles are resolved with UMSLI over an expanding volume using three-dimensional photo-realistic laser serial imaging. UMSLI’s image rectifying ability over time allows for derivation of particle concentration, size, and spatial distribution. Technical details on the development and post-processing methods for the novel UMSLI system are provided. Image resolved particle size distributions (PSDs) revealed a size shift from smaller to larger particles (>0.5 mm) as indicated by flatter slopes from dawn (slope = 2.6) to dusk (slope = 3.0). PSD trends are supported by an optical backscatter and transmissometer time series inversion analysis. Size shifts in the particle field are largely attributed to aggregation effects. Images support evidence of temporal variation between dusk and dawn stations through statistical analysis of particle concentrations for particle sizes 0.50–5.41 mm. Spatial analysis of the particle field revealed a dominantly uniform distributed marine snow background. The importance and potential of integrated approaches to studying particle and organism dynamics in ocean environments are discussed.

54 ENVIRONMENTAL SCIENCES↗

Computational modeling and neutron imaging to understand interface shape and solute segregation during the vertical gradient freeze growth of BaBrCl:Eu

In this work we apply continuum models to analyze phase change, heat transfer, fluid flow, solute transport, and segregation in order to understand prior neutron imaging observations of the vertical gradient freeze growth of Eu-doped BaBrCl. The models provide a rigorous framework in which to understand the mechanisms that are responsible for the complicated evolution of interface shape and dopant distribution in the growth experiment. We explain how a transition in the solid/liquid interface shape from concave to convex is driven by changes in radial heat transfer caused by furnace design. We also provide a mechanistic explanation of how dynamic growth conditions and changes of the flow structure in the melt result in complicated segregation patterns in this system. A growth pause caused by controller lock-up is shown to result in a band of solute depletion in accordance with classical theory. However, changing flow patterns during growth result in a non-monotonic axial distribution of solute that cannot be explained by simple application of classical segregation models. We assert that the approach presented here, namely the use of rigorous models in conjunction advanced diagnostics, such as neutron imaging, provides an exciting path forward for process optimization and control, accelerating the incremental advances that have, in the past, typically relied on empiricism, experience, and intuition.

36 MATERIALS SCIENCE↗

Scalable Hybrid Learning Techniques for Scientific Data Compression

Data compression is becoming critical for storing scientific data because many scientific applications need to store large amounts of data and post process this data for scientific discovery. Unlike image and video compression algorithms that limit errors to primary data (PD), scientists require compression techniques that accurately preserve derived quantities of interest (QoIs). Here, this article presents a physics-informed compression technique implemented as an end-to-end, scalable, GPU-based pipeline for data compression that addresses this requirement. Our hybrid compression technique combines machine learning techniques and standard compression methods. Specifically, we combine an autoencoder, an error-bounded lossy compressor to provide guarantees on raw data error, and a constraint satisfaction post-processing step to preserve the QoIs within a minimal error (generally less than floating point error). The effectiveness of the data compression pipeline is demonstrated by compressing nuclear fusion simulation data generated by a large-scale fusion code, XGC, which produces hundreds of terabytes of data in a single day. Our approach works within the ADIOS framework and results in compression by a factor of more than 150 while requiring only a few percent of the computational resources necessary for generating the data, making the overall approach highly effective for practical scenarios.

ITER↗

rustpix

rustpix is a high-performance, open-source Rust library with first-class Python bindings (via PyO3) for processing pixel-detector data in neutron imaging. It targets time-stamping detectors such as Timepix3 (TPX3) at ORNL's Spallation Neutron Source (VENUS beamline), where each detected neutron deposits charge across a cluster of pixels within a very high-rate event stream (96M+ hits/sec). rustpix parses TPX3 event data in parallel using memory-mapped I/O, offers four interchangeable clustering algorithms (ABS adjacency-based search, DBSCAN, graph/union-find connected components, and a parallel grid method), and extracts weighted, super-resolved centroids to produce neutron-event lists. A streaming architecture lets it process files larger than available memory. rustpix is distributed as a pip-installable Python package (with NumPy integration), Rust crates, a command-line tool, and an interactive GUI; it writes HDF5, Apache Arrow, and CSV; and it is designed to extend to TPX4 and other detector types. Released as open-source under the MIT License.

Zhang, Chen [Oak Ridge National Laboratory (ORNL),↗

Scalable 3D reconstruction for X-ray single particle imaging with online machine learning

X-ray free-electron lasers offer unique capabilities for measuring the structure and dynamics of biomolecules, helping us understand the basic building blocks of life. Notably, high-repetition-rate free-electron lasers enable single particle imaging, where individual, weakly scattering biomolecules are imaged under near-physiological conditions with the opportunity to access fleeting states that cannot be captured in cryogenic or crystallized conditions. Existing X-ray single particle reconstruction algorithms, which estimate the particle orientation for each image independently, are slow and memory-intensive when handling the massive datasets generated by emerging free-electron lasers. Here, we introduce X-RAI (X-Ray single particle imaging with Amortized Inference), an online reconstruction framework that estimates the structure of 3D macromolecules from large X-ray single particle datasets. X-RAI consists of a convolutional encoder, which amortizes pose estimation over large datasets, as well as a physics-based decoder, which employs an implicit neural representation to enable high-quality 3D reconstruction in an end-to-end, self-supervised manner. We demonstrate that X-RAI achieves state-of-the-art performance for small-scale datasets in simulation and challenging experimental settings and demonstrate its unprecedented ability to process large datasets containing millions of diffraction images in an online fashion. These abilities signify a paradigm shift in X-ray single particle imaging towards real-time reconstruction.

Computer science↗