Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Efficient multi-scale representation of visual objects using a biologically plausible spike-latency code and winner-take-all inhibition

Deep neural networks have surpassed human performance in key visual challenges such as object recognition, but require a large amount of energy, computation, and memory. In contrast, spiking neural networks (SNNs) have the potential to improve both the efficiency and biological plausibility of object recognition systems. Here we present a SNN model that uses spike-latency coding and winner-take-all inhibition (WTA-I) to efficiently represent visual stimuli using multi-scale parallel processing. Mimicking neuronal response properties in early visual cortex, images were preprocessed with three different spatial frequency (SF) channels, before they were fed to a layer of spiking neurons whose synaptic weights were updated using spike-timing-dependent-plasticity. We investigate how the quality of the represented objects changes under different SF bands and WTA-I schemes. We demonstrate that a network of 200 spiking neurons tuned to three SFs can efficiently represent objects with as little as 15 spikes per neuron. Furthermore, studying how core object recognition may be implemented using biologically plausible learning rules in SNNs may not only further our understanding of the brain, but also lead to novel and efficient artificial vision systems.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Correlation of SWIR imaging with LPBF 304L stainless steel part properties

In the Laser Powder Bed Fusion (LPBF) process, the local thermal history can vary significantly over a part as the heat transfer characteristics and the laser scan path are geometry dependent. The variations introduce the potential for defects that lead to part failure, some of which are difficult to identify non-destructively with common ex-situ evaluation techniques. These defects include significant microstructural and mechanical property differences in the part interiors. In this paper, thermal features are extracted from in-situ Short-Wave Infrared (SWIR) imaging measurements to compile voxel based part representations and understand how the complexities in the thermal history affect part performance. The deviations in thermal features due to different laser processing parameters and complex scan pathing are explored. Empirical correlations are developed to map thermal features with the engineering properties (bulk yield strength, area percentage porosity, and local state) of 304L stainless steel parts manufactured by LPBF. Processing modes (insufficient melting and keyholing) are determined by mapping part property measurements with multiple thermal features. Generating the relationships between thermographic measurements and resulting SLM part properties lays the foundation for in-situ part qualification.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Imaging the dynamics of initial laser-driven shocks and blowoff plasmas in polystyrene under laser-direct-drive fusion conditions

The dynamics of laser-driven shock propagation in solid ablator material, along with the concomitant processes of shinethrough and blowoff plasma plume expansion, at conditions relevant to laser-direct-drive fusion are measured using a tabletop system capable of supporting rapid dataset development with significantly higher resolution compared to existing methods. The experimental results are directly compared with current radiation-hydrodynamic simulations using the two-dimensional code . Discrepancies between experiments and simulations are evidenced and attributed to limitation of simulation to account for important processes involved in the solid-to-plasma transition. Published by the American Physical Society 2024

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Segmentation method comparison for residual fiber length measurement across tiled microscopy images

Fiber length distribution (FLD), in part, governs mechanical properties in discontinuous fiber composites, yet manual measurement methods limit the high-throughput characterization needed for materials design optimization. This study compares deep learning segmentation approaches for automated FLD measurement in large-field microscopy, evaluating how method choice affects the microstructural descriptors used in structure-property-processing relationships. A critical challenge is that high-resolution microscopy images (10,000×10,000 pixels) must be tiled for deep learning analysis, fragmenting fibers at boundaries. We demonstrate that segmentation method proves crucial for measurement accuracy. For example, instance segmentation with Slicing Aided Hyper Inference (SAHI) preserves individual fiber integrity across tiles while semantic segmentation prioritizes speed. Comparing against manual measurement of extracted carbon fibers, YOLOv11-SAHI matched manual ground truth (238 μm weighted mean) with 40x speedup (4.5 vs 167 minutes per image). U-Net provides rapid quantification although it is at the cost of reduced accuracy due only reliably measuring stand-alone fibers. Our comparative analysis reveals that instance segmentation with SAHI better preserves length measurements while semantic segmentation prioritizes speed, providing empirical guidance for method selection. The characterization provides essential inputs for mechanical property prediction models and inverse design workflows, accelerating composite materials development cycles.

Additive manufacturing↗
DOE OSTI2025

Mechanically flexible mid-wave infrared imagers using black phosphorus ink films

The mid-wave infrared (MWIR) spectral range (λ = 3–8 μm) enables important sensing and imaging applications, including non-invasive bioimaging, night vision, and autonomous navigation. Commercial MWIR photodetectors are limited to rigid imagers based on heteroepitaxial materials. There is an emerging need for mechanically flexible MWIR imagers to broaden their functionality and practicality. Recently, photodetectors using van der Waals (vdW) black phosphorus (BP) flakes have demonstrated highly sensitive room-temperature photodetection. Additionally, vdW materials are solution-processable, facilitating scalable processing and flexible device fabrication. In this work, we present flexible MWIR imagers consisting of photodiodes fabricated on thin plastic substrates using BP ink films. We demonstrate mechanically robust responsivity up to 2.5-mm bending radii and after 5000 bending cycles. Leveraging this flexibility, we achieve full-azimuthal imaging, detecting directional light sources with precision. These results establish a scalable approach for large-area, conformable MWIR imaging and pave the way for integration with flexible electronics.

Wijaya, Theodorus Jonathan↗
DOE OSTI2021

Nonlinear Optical Microscopy with Ultralow Quantum Light

Nonlinear optical (NLO) microscopy relies on multiple light–matter interactions to provide unique contrast mechanisms and imaging capabilities that are inaccessible to traditional linear optical imaging approaches, making them versatile tools to understand a wide range of complex systems. However, the strong excitation fields that are necessary to drive higher-order optical processes efficiently are often responsible for photobleaching, photodegradation, and interruption in many systems of interest. This is especially true for imaging living biological samples over prolonged periods of time or in accessing intrinsic dynamics of electronic excited-state processes in spatially heterogeneous materials. This perspective outlines some of the key limitations of two NLO imaging modalities implemented in our lab and highlights the unique potential afforded by the quantum properties of light, especially entangled two-photon absorption based NLO spectroscopy and microscopy. Here, we further review some of the recent exciting advances in this emerging filed and highlight some major challenges facing the realization of quantum-light-enabled NLO imaging modalities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Airborne hyperspectral imaging of nitrogen deficiency on crop traits and yield of maize by machine learning and radiative transfer modeling

Nitrogen is an essential nutrient that directly affects plant photosynthesis, crop yield, and biomass production for bioenergy crops, but excessive application of nitrogen fertilizers can cause environmental degradation. To achieve sustainable nitrogen fertilizer management for precision agriculture, there is an urgent need for nondestructive and high spatial resolution monitoring of crop nitrogen and its allocation to photosynthetic proteins as that changes over time. Here, we used visible to shortwave infrared (400–2400 nm) airborne hyperspectral imaging with high spatial (0.5 m) and spectral (3–5 nm) resolutions to accurately estimate critical crop traits, i.e., nitrogen, chlorophyll, and photosynthetic capacity (CO 2 -saturated photosynthesis rate, V max,27 ), at leaf and canopy scales, and to assess nitrogen deficiency on crop yield. We conducted three airborne campaigns over a maize (Zea mays L.) field during the growing season of 2019. Physically based soil-canopy Radiative Transfer Modeling (RTM) and data-driven approaches i.e. Partial-Least Squares Regression (PLSR) were used to retrieve crop traits from hyperspectral reflectance, with ground truth of leaf nitrogen, chlorophyll, V max,27 , Leaf Area Index (LAI), and harvested grain yield. To improve computational efficiency of RTMs, Random Forest (RF) was used to mimic RTM simulations to generate machine learning surrogate models RTM-RF. The results show that prior knowledge of soil background and leaf angle distribution can significantly reduce the ill-posed RTM retrieval. RTM-RF achieved a high accuracy to predict leaf chlorophyll content (R 2 = 0.73) and LAI (R 2 = 0.75). Meanwhile, PLSR exhibited better accuracy to predict leaf chlorophyll content (R 2 = 0.79), nitrogen concentration (R 2 = 0.83), nitrogen content (R 2 = 0.77), and V max,27 (R 2 = 0.69) but required measured traits for model training. We also found that canopy structure signals can enhance the use of spectral data to predict nitrogen related photosynthetic traits, as combining RTM-RF LAI and PLSR leaf traits well predicted canopy-level traits (leaf traits × LAI) including canopy chlorophyll (R 2 = 0.80), nitrogen (R 2 = 0.85) and V max,27 (R 2 = 0.82). Compared to leaf traits, we further found that canopy-level photosynthetic traits, particularly canopy V max,27 , have higher correlation with maize grain yield. This study highlights the potential for synergistic use of process-based and data-driven approaches of hyperspectral imaging to quantify crop traits that facilitate precision agricultural management to secure food and bioenergy production.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

High-Resolution Imaging of Cellulose Organization in Cell Walls by Field Emission Scanning Electron Microscopy

Field emission scanning electron microscopy (FESEM) is a powerful tool for analyzing surface structures of biological and nonbiological samples. However, when it is used to study fine structures of nanometer-sized microfibrils of epidermal cell walls, one often encounters tremendous challenges to acquire clear and undistorted images because of two major issues: (1) Preparation of samples suitable for high resolution imaging; due to the delicateness of some plant materials, such as onion epidermal cell walls, many things can happen during sample processing, which subsequently result in damaged samples or introduce artifacts. (2) Difficulties to acquire clear images of samples which are electron-beam sensitive and prone to charging artifacts at magnifications over 100,000×. In this chapter we described detailed procedures for sample preparation and conditions for high-resolution FESEM imaging of onion epidermal cell walls. Lastly, the methods can be readily adapted for other wall materials.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Evolution of titanium particle combustion in potassium perchlorate and air

Understanding titanium particle combustion processes is critical not only for characterizing existing pyrotechnic systems but also for creating new igniter designs. In order to characterize titanium particle combustion processes, morphologies, and temperatures, simultaneous spatially-resolved electric field holography and imaging pyrometry techniques were used to capture post-ignition data at up to 7 kHz. Due to the phase and thermal distortions present in the combustion cloud, traditional digital in-line holography techniques fail to capture accurate data. Here in this work, electric field holography techniques are used in order to cancel distortions and capture the three-dimensional spatial locations and diameters of the particles. In order to estimate the projected surface temperatures of the titanium particles, an imaging pyrometry method that ratios emission at 750 and 850 nm is utilized. Using these diagnostics, joint statistics are collected for particle size, morphology, velocity, and temperature. Results show that, early in the combustion process, the titanium particles are primarily oxidized by potassium perchlorate inside the igniter cup, resulting in projected surface temperatures near 3000 K. Later in the process, the particles interact with ambient air, resulting in lower surface temperatures around 2400 K and the formation of flame zones. These results are consistent with adiabatic flame temperature predictions as well as particle morphology observations of a titanium core with a TiO 2 surface. Late stage particle expansion, star fragmentation, and molten droplet breakup events are also observed using the time-resolved morphology and temperature diagnostics. These results illustrate the different stages of titanium particle combustion in pyrotechnic environments, which can be used to inform improvements in next-generation igniters.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Improving microstructures segmentation via pretraining with synthetic data

Image analysis of material microstructures through microscopy is an integral capability in the field of materials science. The topological and chemical information obtained through microscopy allow us to draw vital connections between material microstructures, properties, and processing. While scanning electron microscopy (SEM) is able to yield a considerable wealth of information interpretable by the intuition of experts, there has been considerable interest in using machine learning, convolutional neural networks (CNNs) in particular, for such image analysis task. Training CNNs for an image analysis task requires a large annotated dataset. However, in many materials science applications, obtaining a large annotated dataset is cost and labor intensive. In this work, we study the use of synthetic data to enlarge the available annotated experimental data of uranium oxide. We utilize a modified Potts model to simulate uranium oxide particles with morphologies similar to those observed experimentally. We then leverage an image-to-image translation model to synthesize the simulated particles as if they are acquired with SEM. Through this process, we obtain pairs of particle images and their corresponding SEM representations, which corresponds to pairs of annotations and images. Unlike previous works, we leverage synthetic data for pretraining a CNN model prior, and finetune that model further with experimental data. We experimentally demonstrate that using synthetic data as incremental learning process benefits the overall performance compared to training a model on combined synthetic and experimental data.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Particle classification by image analysis improves understanding of corn stover degradation mechanisms during deconstruction

Biomass feedstock heterogeneity is a principal roadblock to implementation of the biorefinery concept. Even within an identical cultivar of corn stover, different bales contain not only varying abundance moisture, ash, glucan, and other chemical compounds, but also varying abundance of tissue anatomies (e.g., leaf, husk, cob, or stalk). These different anatomical components not only differ in their response to pretreatment and enzymatic hydrolysis to glucose, but also vary in their mechanical and conveyance properties. Although this heterogeneous nature of corn stover feedstock has been identified as a challenge, a fundamental knowledge gap of how these tissues behave during biorefining processing remains. Here, we demonstrate the use of a commercial fiber image analyzer typically used for wood fiber characterization to monitor the particle size and shapes of non-woody feedstock during milling, pretreatment, and hydrolysis. Additionally, we present novel use of Gaussian process classification to distinguish bundle, parenchyma, and fiber particles to an accuracy of 96.4%. Quantitative probability distribution plots for characteristics such as length and roundness allow elucidation of particle morphology as pretreatment and enzymatic hydrolysis progress. In both stalk pith and stalk rind, particles peel into individual cells whose walls are subsequently fragmented during enzymatic hydrolysis.

09 BIOMASS FUELS↗
DOE OSTI2023

Analysis and mitigation of an oscillating background on hybrid complementary metal-oxide semiconductor (hCMOS) imaging sensors at the National Ignition Facility

Nanosecond-gated hybrid complementary metal-oxide semiconductor imaging sensors are a powerful tool for temporally gated and spatially resolved measurements in high energy density science, including inertial confinement fusion, and in laser diagnostics. However, a significant oscillating background excited by photocurrent has been observed in image sequences during testing and in experiments at the National Ignition Facility (NIF). Characterization measurements and simulation results are used to explain the oscillations as the convolution of the pixel-level sensor response with a sensor-wide RLC circuit ringing. Finally, data correction techniques are discussed for NIF diagnostics, and for diagnostics where these techniques cannot be used, a proof-of-principle image correction algorithm is presented.

42 ENGINEERING↗
DOE OSTI2021

Transient Deformation in Additively Manufactured 316L Stainless Steel Lattices Characterized with in-situ X-ray Phase Contrast Imaging: The Complete Dataset for Three Geometrical Lattices

Metallic lattice structures are being considered for shock mitigation applications due to their superior mechanical properties, energy absorption capability and lightweight characteristics inherent of the additive manufacturing process. In this study, shock compression experiments coupled to x-ray phase contrast imaging (PCI) were conducted on 316L stainless steel lattices. Meso-scale simulations incorporating the as-built lattice structure characterized by computed tomography were used to simulate PCI radiographs in CTH for direct comparison to experimental data. The methodology presented here offers robust validation for constitutive properties to further our understanding of lattice compaction at application-relevant strain rates.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Real Space and Time Imaging of Collective Headgroup Dipole Motions in Zwitterionic Lipid Bilayers

Lipid bilayers are supramolecular structures responsible for a range of processes, such as transmembrane transport of ions and solutes, and sorting and replication of genetic materials, to name just a few. Some of these processes are transient and currently, cannot be visualized in real space and time. Here, we developed an approach using 1D, 2D, and 3D Van Hove correlation functions to image collective headgroup dipole motions in zwitterionic phospholipid bilayers. We show that both 2D and 3D spatiotemporal images of headgroup dipoles are consistent with commonly understood dynamic features of fluids. However, analysis of the 1D Van Hove function reveals lateral transient and re-emergent collective dynamics of the headgroup dipoles—occurring at picosecond time scales—that transmit and dissipate heat at longer times, due to relaxation processes. At the same time, the headgroup dipoles also generate membrane surface undulations due a collective tilting of the headgroup dipoles. A continuous intensity band of headgroup dipole spatiotemporal correlations—at nanometer length and nanosecond time scales—indicates that dipoles undergo stretching and squeezing elastic deformations. Importantly, the above mentioned intrinsic headgroup dipole motions can be externally stimulated at GHz-frequency scale, enhancing their flexoelectric and piezoelectric capabilities (i.e., increased conversion efficiency of mechanical energy into electric energy). In conclusion, we discuss how lipid membranes can provide molecular-level insights about biological learning and memory, and as platforms for the development of the next generation of neuromorphic computers.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Safeguards-Informed Hybrid Imagery Dataset [Poster]

Deep Learning computer vision models require many thousands of properly labelled images for training, which is especially challenging for safeguards and nonproliferation, given that safeguards-relevant images are typically rare due to the sensitivity and limited availability of the technologies. Creating relevant images through real-world staging is costly and limiting in scope. Expert-labeling is expensive, time consuming, and error prone. We aim to develop a data set of both realworld and synthetic images that are relevant to the nuclear safeguards domain that can be used to support multiple data science research questions. In the process of developing this data, we aim to develop a novel workflow to validate synthetic images using machine learning explainability methods, testing among multiple computer vision algorithms, and iterative synthetic data rendering. We will deliver one million images – both real-world and synthetically rendered – of two types uranium storage and transportation containers with labelled ground truth and associated adversarial examples.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Aerial and Processed Model Data Representing As-built Conditions in Coastal Port Arthur, Texas in May 2025

This dataset was collected by the Co-Design Team of the Southeast Texas Urban Integrated Field Lab, a research initiative led by the University of Texas at Austin and funded by the U.S. Department of Energy. The broader project focuses on developing climate-resilient design solutions for the Beaumont–Port Arthur region, with more information available at www.setx-uifl.org. Our team conducted aerial surveys of the Port Arthur coastal neighborhood in May 2025, before the start of construction scheduled for Summer 2026. These pre-construction datasets are designed to facilitate comparative analyses, including pre- and post-construction assessments and simulated inundation scenario evaluations. Aerial images were captured using DroneDeploy autonomous flight systems, with imagery processed through the DroneDeploy engine. All original aerial photographs are provided in JPG format and organized in zipped folders by area. The processed data package includes: 3D surface models Orthomosaics Geospatial and topographic mappings Point clouds For guidance on file contents, structure, and recommended usage, please refer to the included README file.

2D mapping↗
DOE OSTI2024

Massive all-atom analysis of 2D materials with quantum properties (Final report)

Improvements in microscopy have enabled the acquisition of data at a scale that is difficult to process manually, making automated machine learning approaches to analyzing experimental images essential. In this project, we developed and applied machine learning (ML) workflows for atomic resolution scanning transmission electron microscopy (STEM) images. This development included improving both methodology as well as generating user-friendly codes. We developed machine learning architectures which, after training, automatically identify the location and types of defects throughout a material. We used these data to produce class-averaged images of 2D atomic coordinates with up to 0.3 pm precision, uncovering the structure and oscillations of long-range strain fields around point defects in WSe 2-2x Te 2x . We also resolved a long-standing problem in this field in the training of ML models, a lack of labeled experimental data, by developing a cycle-GAN that transformed simulated-generated labeled data into labeled data indistinguishable from experiment and therefore suitable for training. This removed the remaining parts of the ML data processing workflow where human intervention was still critical and therefore a bottleneck to working at scale. Codes have been developed and released for this full machine learning workflow. ML approaches to partially automate STEM acquisition were also developed. Finally we applied ML and other advanced data processing methods to several materials science problems in two-dimensional materials, including studying the evolution of hyperuniformity with defect concentration in WSe2, understanding phase transformations in transition metal dichalcogenides during in-situ heating in the STEM, and exploring how 2D interfaces transform from twisted into aligned structures.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Performance Validation of Pulsed Thermal Imaging System for In-Service Applications

Additive manufacturing (AM) is an emerging method for cost-efficient fabrication of complex topology nuclear reactor parts from high-strength corrosion resistance alloys, such as stainless steel and Inconel. AM of metallic structures for nuclear energy applications is currently based on laser powder bed fusion (LPBF) process, which has the capability of melting metallic powder and net shaping the structures with relatively high precision. Some of the challenges with using LPBF method for nuclear manufacturing include the possibility of introducing pores into metallic structures. Integrity of AM structures needs to be evaluated nondestructively because material flaws could lead to premature failures in high temperature nuclear reactor environment. Currently, there exist limited capabilities to evaluate actual AM structures non-destructively. Pulsed Thermography Imaging (PTI) provides a capability for non-destructive evaluation (NDE) of subsurface defects in arbitrary size structures. The PTI method is based on recording material surface temperature transients with infrared (IR) camera following thermal pulse delivered on material surface with flash light. The PTI method has advantages for NDE of actual AM structures because the method involves one-sided non-contact measurements and fast processing of large sample areas captured in one image. Following initial qualification of an AM component for deployment in a nuclear reactor, a PTI system can also be used for in-service nondestructive evaluation (NDE) applications. In this report, we describe recent progress in enhancing PTI capabilities in detecting microscopic defects in metallic specimens. SS316 and IN718 specimens were developed with a pattern of subsurface calibrated flat bottom hole (FBH) defects with diameters from 500µm to 200µm. FBH’s were created with EDM (electron discharge machining) drill. PTI imaging data was processed Spatial Temporal Denoised Thermal Source Separation (STDTSS) unsupervised machine learning (ML) algorithm. We show that defects as small as 200µm in SS316 and IN718 can be detected with STDTSS algorithm. To the best of our knowledge, these are the smallest detected defects which are reported in literature.

42 ENGINEERING↗