Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “adaptive imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

An innovative digital image correlation technique for in-situ process monitoring of composite structures in large scale additive manufacturing

As additive manufacturing (AM) continues to develop and become a standardized manufacturing method, there will be a continued need to provide in-situ monitoring during the manufacturing of polymer composite printed components. Thermal residual stress is a primary cause of failures such as interlayer disbonds or delamination, micro cracking, and dimensional instability, which can occur during or after the build. Here, we report a novel digital image correlation (DIC) adaptation to monitor thermal residual stresses during the entire print process for large-scale AM. In this work, DIC has been investigated (a) by the natural speckle produced by the polymer surface for correlation, (b) to monitor AM build, and (c) to evaluate the effect of thermal residual stress on warpage of the printed component. The natural speckle pattern of the AM material resulted in a respectable 3.57% error compared to the traditional painted speckle pattern of 3.05% error. DIC measured a 190% increase in vertical displacement at the edge of the wall compared to the center, indicating warpage during AM. This work is a step towards a non-intrusive residual stress measuring technique using DIC for large-scale AM.

36 MATERIALS SCIENCE↗

TEMImageNet training library and AtomSegNet deep-learning models for high-precision atom segmentation, localization, denoising, and deblurring of atomic-resolution images

Abstract Atom segmentation and localization, noise reduction and deblurring of atomic-resolution scanning transmission electron microscopy (STEM) images with high precision and robustness is a challenging task. Although several conventional algorithms, such has thresholding, edge detection and clustering, can achieve reasonable performance in some predefined sceneries, they tend to fail when interferences from the background are strong and unpredictable. Particularly, for atomic-resolution STEM images, so far there is no well-established algorithm that is robust enough to segment or detect all atomic columns when there is large thickness variation in a recorded image. Herein, we report the development of a training library and a deep learning method that can perform robust and precise atom segmentation, localization, denoising, and super-resolution processing of experimental images. Despite using simulated images as training datasets, the deep-learning model can self-adapt to experimental STEM images and shows outstanding performance in atom detection and localization in challenging contrast conditions and the precision consistently outperforms the state-of-the-art two-dimensional Gaussian fit method. Taking a step further, we have deployed our deep-learning models to a desktop app with a graphical user interface and the app is free and open-source. We have also built a TEM ImageNet project website for easy browsing and downloading of the training data.

25 ENERGY STORAGE↗

A framework for data-driven solution and parameter estimation of PDEs using conditional generative adversarial networks

We employ and adapt the image-to-image translation concept based on conditional generative adversarial networks (cGAN) for learning a forward and an inverse solution operator of partial differential equations (PDEs). We focus on steady-state solutions of coupled hydromechanical processes in heterogeneous porous media and present the parameterization of the spatially heterogeneous coefficients, which is exceedingly difficult using standard reduced-order modeling techniques. We show that our framework provides a speed-up of at least 2,000 times compared to a finite-element solver and achieves a relative root-mean-square error (r.m.s.e.) of less than 2% for forward modeling. For inverse modeling, the framework estimates the heterogeneous coefficients, given an input of pressure and/or displacement fields, with a relative r.m.s.e. of less than 7%, even for cases where the input data are incomplete and contaminated by noise. The framework also provides a speed-up of 120,000 times compared to a Gaussian prior-based inverse modeling approach while also delivering more accurate results.

97 MATHEMATICS AND COMPUTING↗

Visualizing bleb mass dynamics in single cells using quantitative phase microscopy

Understanding biological responses to directed energy (DE) is critical to ensure the safety of personnel within the Department of Defense. At the Air Force Research Laboratory, we have developed or adapted advanced optical imaging systems that quantify biophysical responses to DE. One notable cellular response to DE exposure is the formation of blebs, or semi-spherical protrusions of the plasma membrane in living cells. In this work, we demonstrate the capacity of quantitative phase imaging (QPI) to both visualize and quantify the formation of membrane blebs following DE exposure. QPI is an interferometric imaging tool that uses optical path length as a label-free contrast mechanism and is sensitive to the non-aqueous mass density, or dry mass, of living cells. Blebs from both CHO-K1 and U937 cells were generated after exposure to a series of 600 ns, 21.2 kV/cm electric pulses. These blebs were visualized in real time, and their dry mass relative to the rest of the cell body was quantified as a function of time. It is our hope that this system will lead to an improved understanding of both DE-induced and apoptotic blebbing.

Steelman, Zachary A.↗

Characterization of the Nucleus, Morphology, and Activity of Interstellar Comet 2I/Borisov by Optical and Near-infrared GROWTH, Apache Point, IRTF, ZTF, and Keck Observations

We present visible and near-infrared (NIR) photometric and spectroscopic observations of interstellar object (ISO) 2I/Borisov taken from 2019 September 10 to 2019 December 20 using the GROWTH, the Apache Point Observatory Astrophysical Research Consortium 3.5 m, and the NASA Infrared Telescope Facility 3.0 m combined with pre- and postdiscovery observations of 2I obtained by the Zwicky Transient Facility from 2019 March 17 to 2019 May 5. Comparison with imaging of distant solar system comets shows an object very similar to mildly active solar system comets with an outgassing rate of ∼10{sup 27} mol s{sup −1}. The photometry, taken in filters spanning the visible and NIR range, shows a gradual brightening trend of ∼0.03 mag day{sup −1} since 2019 September 10 UTC for a reddish object becoming neutral in the NIR. The light curve from recent and prediscovery data reveals a brightness trend suggesting the recent onset of significant H{sub 2}O sublimation with the comet being active with super volatiles such as CO at heliocentric distances >6 au consistent with its extended morphology. Using the advanced capability to significantly reduce the scattered light from the coma enabled by high-resolution NIR images from Keck adaptive optics taken on 2019 October 4, we estimate a diameter for 2I’s nucleus of ≲1.4 km. We use the size estimates of 1I/’Oumuamua and 2I/Borisov to roughly estimate the slope of the ISO size distribution, resulting in a slope of ∼3.4 ± 1.2, similar to solar system comets and bodies produced from collisional equilibrium.

79 ASTRONOMY AND ASTROPHYSICS↗

Shortest Microlensing Event with a Bound Planet: KMT-2016-BLG-2605

With a planet–host mass ratio q = 0.012 ± 0.001, KMT-2016-BLG-2605 has the shortest Einstein timescale, t {sub E} = 3.41 ± 0.13 days, of any planetary microlensing event to date. This prompts us to examine the full sample of seven short (t {sub E} < 7 days) planetary events with good q measurements. We find that six have clustered Einstein radii θ {sub E} = 115 ± 20 μas and lens–source relative proper motions μ {sub rel} ≃ 9.5 ± 2.5 mas yr{sup -1}. For the seventh, these two quantities could not be measured. These distributions are consistent with a Galactic bulge population of very low mass (VLM) hosts near the hydrogen-burning limit. This conjecture could be verified by imaging at first adaptive optics light on next-generation (30 m) telescopes. Based on a preliminary assessment of the sample, “planetary” companions (i.e., below the deuterium-burning limit) are divided into “genuine planets,” formed in their disks by core accretion, and VLM brown dwarfs, which form like stars. We discuss techniques for expanding the sample, which include taking account of the peculiar “anomaly-dominated” morphology of the KMT-2016-BLG-2605 light curve.

74 ATOMIC AND MOLECULAR PHYSICS↗

Ultra-compact Imaging Technology (CRADA Final Report)

As part of the Cyclotron Road program, Synopic (formerly FlatCam LLC) sought to investigate the benefits of its depth-sensitive imaging techniques. The basic principle involved using a thin mask specially designed to encode light reaching a sensor, in conjunction with optimized computational algorithms, in such a manner that allowed for both miniaturization of imaging systems and improved computation toward high resolution, three-dimensional imaging. By thoroughly exploring the resolution, mask/optical design, and algorithmic capabilities of our depth sensitive technology, we expand the potential applications for (but not limited to) medical, consumer and industrial purposes. The project aimed to develop new imaging systems by building on previous work and using 1) materials capable of modulating and 2) sensors capable of measuring visible and longer wavelengths. Preliminary research was conducted to design, fabricate and characterize imaging systems with the goal of improving resolution, enhancing single capture, three-dimensional imaging, and extending depth of field of captured images. The primary goal was to determine whether adapting the depth-sensitive imaging system is feasible, and early results are promising.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Grating-Based Imaging-Scattering with Portable Neutron Generator

Company: Adelphi Technology, Inc. Title: Grating-Based Imaging-Scattering with Portable Neutron Generator PI: Dr. Jay Theodore Cremer, Jr. Topic: 26a Statement of the problem or situation that is being addressed. Successful plant growth depends upon an efficient and robust root system. The plant root is part of a larger system of water and microbial flows in the soil system. While much effort has been exerted to develop an imaging system for water, microbes, and roots, the problem is challenging, and no widely accepted imaging method currently exists. The optical solutions use a highly modified soil system. X-ray imaging methods are insensitive to the soft tissues in the presence of sand. Thermal neutron imaging has been often tested, but found inadequate, due to limited access and low image resolution. This project will develop a new strategy for neutron imaging of plant/soil systems. The project will allow long duration experiments in greenhouse environments and increase the image information content to the micron scale. General statement of how this problem is being addressed. Portable, rugged thermal and fast neutron sources are being developed where portable means a two-soldier team can carry the source and power unit to survey rough terrain for explosives. In the past decade, microfabrication of X-ray and thermal/cold neutron optics has opened a new imaging strategy. The standard transmission image is now supplemented with simultaneous acquisition of a phase contrast image and an image revealing scattering features. In materials science, the interferometric neutron scattering image has been used to detect early crack formation in stressed additive manufacturing test samples. The detection requires sensitivity to scattering features at the 1-micron scale. By addition of our proposed grating-optic to Adelphi Technology’s radiographic/tomographic imaging system, which is based on portable thermal neutron source, the resulting thermal neutron scatter image of the plant/soil system, will reveal details at 1-micron. Commercial Applications and Other Benefits Neutron interferometry imaging has greater penetration through large metal components compared to industrial X-ray imaging. The low-cost, large area optics developed for greenhouse applications, combined with the robust, portable neutron generator, can then be marketed as a system for inspection of additive manufactured components. In the aerospace industry, all freshly printed components are validated with X-ray CT. Scheduled maintenance again requires X-ray CT as the ability to predict aerospace component lifetime does not yet exist. Large aerospace components are only partially observed with X-ray imaging. Key Words Neutron radiography/tomography, grating interferometry, thermal neutron generator imaging, plant root and soil imaging, rhizosphere imaging, deployable neutron imaging systems Summary for Members of Congress A rugged, portable source of thermal neutrons is adapted for neutron interferometry imaging with the addition of low-cost, 3D printed optics. The first application of our proposed deployable, compact thermal neutron generator imaging system, using a grating optic, is plant root/soil science in greenhouse settings and agricultural laboratories.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Efficient and Flexible Sensitivity Matrix Computation for Adaptive Electrical Capacitance Volume Tomography

Electrical capacitance tomography is a widely used sensor modality for flow imaging in many industrial settings. Adaptive Electrical Capacitance Volume Tomography (AECVT) extends the capabilities of traditional ECT by enabling direct volumetric imaging and an improved resolution. Construction of the sensitivity matrix is a necessary step to obtain flow images. This step requires computation of the electric field inside the sensing domain, which is done via a typical field solver such as the finite element method. In this work, we present an efficient and flexible method to construct the sensitivity matrix for Adaptive Electrical Capacitance Volume Tomography (AECVT) based on individual electrode segment excitations and their judicious combination to form desired matrix elements. We illustrate how the proposed method yields the same sensitivity matrix as the traditional method but at a much lower computational cost. Once all segment contributions are obtained, we also indicate how the proposed method, unlike the traditional approach, can generate the sensitivity matrix on demand for an arbitrary combination of synthetic electrodes and obviating the need for any additional field computations. Finally, we present image reconstruction results for two different experimental scenarios where the mutual capacitance data and the corresponding sensitivity vectors are obtained through the proposed measurement combination scheme.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Adaptive optical third-harmonic generation microscopy for in vivo imaging of tissues

Third-harmonic generation microscopy is a powerful label-free nonlinear imaging technique, providing essential information about structural characteristics of cells and tissues without requiring external labelling agents. In this work, we integrated a recently developed compact adaptive optics module into a third-harmonic generation microscope, to measure and correct for optical aberrations in complex tissues. Taking advantage of the high sensitivity of the third-harmonic generation process to material interfaces and thin membranes, along with the 1,300-nm excitation wavelength used here, our adaptive optical third-harmonic generation microscope enabled high-resolution in vivo imaging within highly scattering biological model systems. Examples include imaging of myelinated axons and vascular structures within the mouse spinal cord and deep cortical layers of the mouse brain, along with imaging of key anatomical features in the roots of the model plant Brachypodium distachyon. In all instances, aberration correction led to enhancements in image quality.

60 APPLIED LIFE SCIENCES↗

Adaptive optical correction for in vivo two-photon fluorescence microscopy with neural fields

Adaptive optics restore ideal imaging performance in complex samples by measuring and correcting optical aberrations but often require custom-built microscopes with carefully aligned wavefront sensing/shaping devices and can be susceptible to sample motion. Here we describe NeAT, a computational framework using neural fields for adaptive optics two-photon fluorescence microscopy. NeAT estimates wavefront aberration and recovers sample structure from a 3D image stack without requiring external datasets for training. Incorporating motion correction in learning and correcting conjugation errors commonly found in commercial microscopes, NeAT is designed for deployment in biological laboratories for in vivo imaging. We validate NeAT’s performance using a custom-built microscope with a wavefront sensor under varying signal-to-noise ratios, aberration and motion conditions. With a commercial microscope, we demonstrate real-time aberration correction for in vivo morphological and functional imaging in the living mouse brain, with NeAT improving the signal and accuracy of glutamate and calcium imaging of synapses and neurons.

Kang, Iksung↗

Manifold projection image segmentation for nano-XANES imaging

As spectral imaging techniques are becoming more prominent in science, advanced image segmentation algorithms are required to identify appropriate domains in these images. We present a version of image segmentation called manifold projection image segmentation (MPIS) that is generally applicable to a broad range of systems without the need for training because MPIS uses unsupervised machine learning with a few physically motivated hyperparameters. We apply MPIS to nanoscale x-ray absorption near edge structure (XANES) imaging, where XANES spectra are collected with nanometer spatial resolution. We show the superiority of manifold projection over linear transformations, such as the commonly used principal component analysis (PCA). Moreover, MPIS maintains accuracy while reducing computation time and sensitivity to noise compared to the standard nano-XANES imaging analysis procedure. Finally, we demonstrate how multimodal information, such as x-ray fluorescence data and spatial location of pixels, can be incorporated into the MPIS framework. We propose that MPIS is adaptable for any spectral imaging technique, including scanning transmission x-ray microscopy, where the length scale of domains is larger than the resolution of the experiment.

36 MATERIALS SCIENCE↗

SHF: Symmetrical Hierarchical Forest with Pretrained Vision Transformer Encoder for High-Resolution Medical Segmentation

This paper presents a novel approach to addressing the long-sequence problem in high-resolution medical images for Vision Transformers (ViTs). Using smaller patches as tokens can enhance ViT performance, but quadratically increases computation and memory requirements. Therefore, the common practice for applying ViTs to high-resolution images is either to: (a) employ complex sub-quadratic attention schemes or (b) use large to medium-sized patches and rely on additional mechanisms within the model to capture the spatial hierarchy of details. We propose Symmetrical Hierarchical Forest (SHF), a lightweight approach that adaptively patches the input image to increase token information density and encode hierarchical spatial structures into the input embedding. We then apply a reverse depatching scheme to the output embeddings of the transformer encoder, eliminating the need for convolution-based decoders. Unlike previous methods that modify attention mechanisms or use a complex hierarchy of interacting models, SHF can be retrofitted to any ViT model to allow it to learn the hierarchical structure of details in high-resolution images without requiring architectural changes. Experimental results demonstrate significant gains in computational efficiency and performance: on the PAIP WSI dataset, we achieved a 3∼32×speedup or a 2.95%∼7.03% increase in accuracy (measured by Dice score) at a 64K2 resolution with the same computational budget, compared to state-of-the-art production models. On the 3D medical datasets BTCV and KiTS, training was 6×faster, with accuracy gains of 6.93% and 5.9%, respectively, compared to models without SHF.

Zhang, Enzhi [Hokkaido University, Japan]↗

Domain Adaptation for Measurements of Strong Gravitational Lenses

Upcoming surveys are predicted to discover galaxy-scale strong lenses on the magnitude of 105, making deep learning methods necessary in lensing data analysis. Currently, there is insufficient real lensing data to train deep learning algorithms, but training only on simulated data results in poor performance on real data. Domain adaptation can bridge the gap between simulated and real datasets. We adopt domain adaptation on the estimation of Einstein radius in simulated galaxy-scale gravitational lensing images. We evaluate two domain adaptation techniques - domain adversarial neural networks (DANN) and maximum mean discrepancy (MMD). We train on a source domain of simulated lenses and apply it to a target domain with emulation of DES survey conditions. We show that both domain adaptation techniques can significantly improve the model performance on the more complex target domain datasets. Our results show the potential of using domain adaptation to perform analysis on future survey data with a deep neural network trained on simulated data.

79 ASTRONOMY AND ASTROPHYSICS↗

The FastrSHWFS Project Development Motivation, Analysis, & Test Results

The recent 2020 Decadal Survey of Astronomy and Astrophysics listed habitable exoplanet imaging with future extreme adaptive optics (AO) on 30m-class telescopes as a key priority in the coming decade. However, there is a current 100x contrast gap between the best systems today and what is needed to enable this goal. Astronomical AO is a required approach to enable ground-based diffraction-limited imaging of exoplanets on future extremely large telescopes. Time lag between the end of an exposure and the application of deformable mirror commands is a major contributor to the error budget in many AO systems, and detector read time is often a large component of this lag. We present two designs for a modified Shack Hartmann wavefront sensor (SHWFS), named Focal plane Actualized Shifted Technique Realized for a SHWFS (fastrSHWFS), to reduce the time lag component. This design steers the spot pattern at the focal plane into a rectangular or linear array with a custom aspect ratio, reducing readout time. The mask with focus yields aberrated results while the mask with tip/tilt only yields some defined spots. This essay outlines the current SHWFS concept, our fastrSHWFS theoretical solution to addressing time lag, reflection and quality analysis of printed mask designs, and results from testing both masks on the High Contrast Testbed at Lawrence Livermore National Lab. This work follows the test of a previous fastrSHWFS design.

79 ASTRONOMY AND ASTROPHYSICS↗

Optical Imaging for Understanding of Thermal Barrier Coated Piston Engine Performance

Thermal barrier coatings (TBC) applied to pistons have been a recently renewed research topic in the field of internal combustion engines. Single cylinder testing of a conventional C15™ Tier 4 final pro-duction steel piston and a TBC coated piston showed that the Yttrium stabilized Zirconia (YSZ) TBC did not significantly alter engine performance, with the TBC piston having slower combustion rates and higher criteria emissions. For deeper understanding, research continued by studying 3D-piston sections optically in a constant pressure vessel using photodiodes, four high-speed cameras (natural luminosity, CH*, and OH*), and visualization of the flame from two orthogonal directions. Particle Im-aging Velocimetry (PIV) algorithms were adapted to perform Combustion Imaging Velocimetry (CIV) to aid in quantification of the observed visual combustion flow field differences. The optical work showed that the TBC piston flame development is slower, spatially different, with lower mixing energy for the TBC variant. Geometric profiles of engine pistons and optical vessel 3D-piston sections were measured using a Coordinate Measurement Machine (CMM), and surface roughness was measured with a stylus surface profilometer. CMM results showed that the TBC piston bowl had reasonable macroscopic accuracy, but the rim had a larger radius with less reentrancy. A discussion of the results and analyses in relation to future TBC effort and direction concludes the work.

33 ADVANCED PROPULSION SYSTEMS↗