Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image processing.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Random Walks With Tweedie: A Unified View of Score-Based Diffusion Models [In the Spotlight]

We present a concise derivation for several influential score-based diffusion models that relies on only a few textbook results. Diffusion models have recently emerged as powerful tools for generating realistic, synthetic signals—particularly natural images—and often play a role in state-of-the-art algorithms for inverse problems in image processing. While these algorithms are often surprisingly simple, the theory behind them is not, and multiple complex theoretical justifications exist in the literature. Here, in this study, we provide a simple and largely self-contained theoretical justification for score-based diffusion models that is targeted towards the signal processing community. This approach leads to generic algorithmic templates for training and generating samples with diffusion models. We show that several influential diffusion models correspond to particular choices within these templates and demonstrate that alternative, more straightforward algorithmic choices can provide comparable results. This approach has the added benefit of enabling conditional sampling without any likelihood approximation.

97 MATHEMATICS AND COMPUTING↗

Robust and Simple ADMM Penalty Parameter Selection

We present a new method for online selection of the penalty parameter for the alternating direction method of multipliers (ADMM) algorithm. ADMM is a widely used method for solving a range of optimization problems, including those that arise in signal and image processing. In its standard form, ADMM includes a scalar hyperparameter, known as the penalty parameter, which usually has to be tuned to achieve satisfactory empirical convergence. In this work, we develop a framework for analyzing the ADMM algorithm applied to a quadratic problem as an affine fixed point iteration. Using this framework, we develop a new method for automatically tuning the penalty parameter by detecting when it has become too large or small. We analyze this and several other methods with respect to their theoretical properties, i.e., robustness to problem transformations, and empirical performance on several optimization problems. Our proposed algorithm is based on a theoretical framework with clear, explicit assumptions and approximations, is theoretically covariant/invariant to problem transformations, is simple to implement, and exhibits competitive empirical performance.

42 ENGINEERING↗

An Adaptive Multiparameter Penalty Selection Method for Multiconstraint and Multiblock ADMM

This work presents a new method for online selection of multiple penalty parameters for the alternating direction method of multipliers (ADMM) algorithm applied to optimization problems with multiple constraints or functions with block matrix components. ADMM is widely used for solving constrained optimization problems in a variety of fields, including signal and image processing. Implementations of ADMM often utilize a single hyperparameter, referred to as the penalty parameter, which needs to be tuned to control the rate of convergence. However, in problems with multiple constraints, ADMM may demonstrate slow convergence regardless of penalty parameter selection due to scale differences between constraints. Accounting for scale differences between constraints to improve convergence in these cases requires introducing a penalty parameter for each constraint. The proposed method is able to adaptively account for differences in scale between constraints, providing robustness with respect to problem transformations and initial selection of penalty parameters. It is also simple to understand and implement. Our numerical experiments demonstrate that the proposed method performs favorably compared to a variety of existing penalty parameter selection methods.

97 MATHEMATICS AND COMPUTING↗

Automatic Detection and Evaluation of Solar Cell Micro-Cracks in Electroluminescence Images Using Matched Filters

A method for detecting micro-cracks in solar cells using two dimensional matched filters was developed, derived from the electroluminescence intensity profile of typical micro-cracks. We describe the image processing steps to obtain a binary map with the location of the micro-cracks. Finally, we show how to automatically estimate the total length of each micro-crack from these maps, and propose a method to identify severe types of micro-cracks, such as parallel, dendritic, and cracks with multiple orientations. With an optimized threshold parameter, the technique detects over 90 % of cracks larger than 3 cm in length. The method shows great potential for quantifying micro-crack damage after manufacturing or module transportation for the determination of a module quality criterion for cell cracking in photovoltaic modules.

14 SOLAR ENERGY↗

Event-to-Video Conversion for Overhead Object Detection

Collecting overhead imagery using an event camera is desirable due to the energy efficiency of the image sensor compared to standard cameras. However, event cameras complicate downstream image processing, especially for complex tasks such as object detection. In this paper, we investigate the viability of event streams for overhead object detection. We demonstrate that across a number of standard modeling approaches, there is a significant gap in performance between dense event representations and corresponding RGB frames. We establish that this gap is, in part, due to a lack of overlap between the event representations and the pre-training data that the object detectors were initially trained on through a number of experiments. Then, apply an off-the-shelf event-to-video conversion tool that converts event streams into gray-scale video to close this gap. We demonstrate that this approach results in a large performance increase, outperforming even event-specific object detection techniques on our overhead target task. These results suggest that better aligning event representations with existing large pre-trained models may result in greater short-term performance gains compared to end-to-end event-specific architectural improvements.

machine learning (ML), computer vision, Neuromorph↗

Assessment of the displacement field along a surface crack in a flat plate using optical techniques

Structural components may contain cracks, and for these components a crack tip represents a highly singular stress. The evaluation of the associated strain gradient is difficult to achieve with experimental discrete methods. An efficient alternative are the optical techniques which are non-contact, and so delivering continuous information of the displacement fields and associated derivatives for strain evaluation. This paper describes some experimental methods to fully characterize the displacement field near a crack tip existing in flat plates. Three optical field techniques based on image analysis were used in the present work; respectively, Electronic Speckle Pattern Interferometry, Moiré Interferometry, and Digital Image Correlation. These methods allow different resolutions which can be adjusted according to the expected strain gradient. While the first method depends on the laser wavelength and position of the illumination sources, the second depends on the grating pitch and the last on the surface texture or painted speckle. Algorithms to derivate and filtering the displacement field are developed to compute the strain field and will be used for further works.

36 MATERIALS SCIENCE↗

Quantitative order-parameter measurement in lattice-mismatched AlInP using precession electron diffraction

Precession electron diffraction (PED) was used to measure the long-range order parameter in lattice-mismatched AlInP epitaxial films under investigation for solid-state-lighting applications. Both double- and single-variant films grown at 620, 650, and 680°C were analyzed in TEM cross-section. PED patterns were acquired in selected-area-diffraction mode through external microscope control using serial acquisition, which allows inline image processing. The integrated peak intensities from experimental patterns were fit using dynamical simulations of diffraction from the ordered domain structures. Included in the structure-factor calculations were mean atomic displacements of the anions (P) due to ordering, which were found by valence-force-field calculations to have a nearly linear dependence on order parameter. A maximum order parameter of S = 0.36 was measured for a double-variant specimen grown at 650°C.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

OPEN leaf : an open‐source cloud‐based phenotyping system for tracking dynamic changes at leaf‐specific resolution in Arabidopsis

SUMMARY The first draft of the Arabidopsis genome was released more than 20 years ago and despite intensive molecular research, more than 30% of Arabidopsis genes remained uncharacterized or without an assigned function. This is in part due to gene redundancy within gene families or the essential nature of genes, where their deletion results in lethality (i.e., thedark genome). High‐throughput plant phenotyping (HTPP) offers an automated and unbiased approach to characterize subtle or transient phenotypes resulting from gene redundancy or inducible gene silencing; however, access to commercial HTPP platforms remains limited. Here we describe the design and implementation ofOPEN leaf, an open‐source phenotyping system with cloud connectivity and remote bilateral communication to facilitate data collection, sharing and processing.OPEN leaf, coupled with our SMART imaging processing pipeline was able to consistently document and quantify dynamic changes at the whole rosette level and leaf‐specific resolution when plants experienced changes in nutrient availability. Our data also demonstrate that VIS sensors remain underutilized and can be used in high‐throughput screens to identify and characterize previously unidentified phenotypes in a leaf‐specific time‐dependent manner. Moreover, the modular and open‐source design ofOPEN leafallows seamless integration of additional sensors based on users and experimental needs.

Plant Sciences↗

PT -symmetry in kagome photonic lattices

Photonic lattices composed of balanced gain and loss waveguides have attracted considerable attention due of their potential applications in optical beam engineering and image processing. These photonic lattices belong to a larger class of intriguing active metamaterials that exhibit the parity-time ( PT ) symmetry. Kagome lattice is a two-dimensional network of corner-sharing triangles and is often associated with geometrical frustration. In particular, the frustrated coupling between waveguide modes in a kagome array leads to a dispersionless flat band consisting of spatially localized modes. Recently, a PT -symmetric photonics lattice based on the kagome structure has been proposed by placing PT -symmetric dimers at the kagome lattice points. Each dimer corresponds to a pair of strongly coupled waveguides. With balanced arrangement of gain and loss on individual dimers, the system exhibits a PT -symmetric phase for finite gain/loss parameter up to a critical value. Here we discuss the linear and nonlinear optical beam propagations in this novel PT -symmetric kagome system. The linear beam evolution in this complex kagome waveguide array exhibits a novel oscillatory rotation of optical power along the propagation distance. Long-lived local chiral structures originating from the nearly flat bands of the kagome structure are observed when the lattice is subject to a narrow beam excitation. We further show that inclusion of Kerr-type nonlinearity leads to novel optical solitons.

42 ENGINEERING↗

Snapshot 3D tracking of insulin granules in live cells

Rapid and accurate volumetric imaging remains a challenge, yet has the potential to enhance understanding of cell function. We developed and used a multifocal microscope (MFM) for 3D snapshot imaging to allow 3D tracking of insulin granules labeled with mCherry in MIN6 cells. MFM employs a special diffractive optical element (DOE) to simultaneously image multiple focal planes. This simultaneous acquisition of information deteunines the 3D location of single objects at a speed only limited by the array detector's frame rate. We validated the accuracy of MFM imaging/tracking with fluorescence beads; the 3D positions and trajectories of single fluorescence beads can be detelinined accurately over a wide range of spatial and temporal scales. The 3D positions and trajectories of single insulin granules in a 3.2um deep volume were deteunined with imaging processing that combines 3D decovolution, shift correction, and finally tracking using the Imaris software package. We find that the motion of the granules is super diffusive, but less so in 3D than 2D for cells grown on coverslip surfaces, suggesting an anisotropy in the cytoskeleton (e.g. microtubules and action).

3D tracking↗

Terahertz time-domain spectroscopy imaging of pancreatic ductal adenocarcinoma tissues

Pancreatic ductal adenocarcinoma (PDAC) ranks among the malignancies with the highest fatality and morbidity rates. This is predominantly attributable to an absence of understanding the intricate and diverse microenvironment of the tumor. We use terahertz time-domain spectroscopy (THz-TDS) imaging in transmission geometry to probe ex-vivo the heterogenous microenvironment of the genetically modified murine PDAC tissue that closely resembles the PDAC heterogeneity in human malignancy. We introduced a maximum a-posteriori probability estimation algorithm to objectively the tumor’s heterogenous microenvironment using the average values of refractive index and absorption coefficient within the useable terahertz bandwidth as imaging markers. Furthermore, direct comparison of stained histopathologic images and the refractive index and the absorption coefficient high-resolution, two dimensional maps of the same PDAC samples confirms the high potential of the THz-TDS method for tumor tissue characterization.

absorption↗

A new generic method for the semi-automatic extraction of river and road networks in low and mid-resolution satellite images

This paper addresses the problem of semi-automatic extraction of road or hydrographic networks in satellite images. For that purpose, we propose an approach combining concepts arising from mathematical morphology and hydrology. The method exploits both geometrical and topological characteristics of rivers/roads and their tributaries in order to reconstruct the complete networks. It assumes that the images satisfy the following two general assumptions, which are the minimum conditions for a road/river network to be identifiable and are usually verified in low- to mid-resolution satellite images: (i) visual constraint: most pixels composing the network have similar spectral signature that is distinguishable from most of the surrounding areas; (ii) geometric constraint: a line is a region that is relatively long and narrow, compared with other objects in the image. While this approach fully exploits local (roads/rivers are modeled as elongated regions with a smooth spectral signature in the image and a maximum width) and global (they are structured like a tree) characteristics of the networks, further directional information about the image structures is incorporated. Namely, an appropriate anisotropic metric is designed by using both the characteristic features of the target network and the eigen-decomposition of the gradient structure tensor of the image. Following, the geodesic propagation from a given network seed with this metric is combined with hydrological operators for overland flow simulation to extract the paths which contain most line evidence and identify them with the target network.

47 OTHER INSTRUMENTATION↗

Image artifacts in digital breast tomosynthesis: Investigation of the effects of system geometry and reconstruction parameters using a linear system approach

Digital breast tomosynthesis (DBT) is a three-dimensional (3D) x-ray imaging modality that reconstructs image slices parallel to the detector plane. Image acquisition is performed using a limited angular range (less than 50 degrees) and a limited number of projection views (less than 50 views). Due to incomplete data sampling, image artifacts are unavoidable in DBT. In this preliminary study, the image artifacts in DBT were investigated systematically using a linear system approximation. A cascaded linear system model of DBT was developed to calculate the 3D presampling modulation transfer function (MTF) with different image acquisition geometries and reconstruction filters using a filtered backprojection (FBP) algorithm. A thin, slanted tungsten (W) wire was used to measure the presampling MTF of the DBT system in the cross-sectional plane defined by the thickness (z-) and tube travel (x-) directions. The measurement was in excellent agreement with the calculation using the model. A small steel bead was used to calculate the artifact spread function (ASF) of the DBT system. The ASF was correlated with the convolution of the two-dimensional (2D) point spread function (PSF) of the system and the object function of the bead. The results showed that the cascaded linear system model can be used to predict the magnitude of image artifacts of small, high-contrast objects with different image acquisition geometry and reconstruction filters.

61 RADIATION PROTECTION AND DOSIMETRY↗

A simplified method of four-dimensional dose accumulation using the mean patient density representation

The purpose of this work was to demonstrate, both in phantom and patient, the feasibility of using an average 4DCT image set (AVG-CT) for 4D cumulative dose estimation. A series of 4DCT numerical phantoms and corresponding AVG-CTs were generated. For full 4D dose summation, static dose was calculated on each phase and cumulative dose was determined by combining each phase's static dose distribution with known tumor displacement. The AVG-CT cumulative dose was calculated similarly, although the same AVG-CT static dose distribution was used for all phases (i.e., tumor displacements). Four lung cancer cases were also evaluated for stereotactic body radiotherapy and conformal treatments; however, deformable image registration of the 4DCTs was used to generate the displacement vector fields (DVFs) describing patient-specific motion. Dose discrepancy between full 4D summation and AVG-CT approach was calculated and compared. For all phantoms, AVG-CT approximation yielded slightly higher cumulative doses compared to full 4D summation, with dose discrepancy increasing with increased tumor excursion. In vivo, using the AVG-CT coupled with deformable registration yielded clinically insignificant differences for all GTV parameters including the minimum, mean, maximum, dose to 99% of target, and dose to 1% of target. Furthermore, analysis of the spinal cord, esophagus, and heart revealed negligible differences in major dosimetric indices and dose coverage between the two dose calculation techniques. Simplifying 4D dose accumulation via the AVG-CT, while fully accounting for tumor deformation due to respiratory motion, has been validated, thereby, introducing the potential to streamline the use of 4D dose calculations in clinical practice, particularly for adaptive planning purposes.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Mean glandular dose estimation using MCNPX for a digital breast tomosynthesis system with tungsten/aluminum and tungsten/aluminum+silver x-ray anode-filter combinations

Breast cancer screening with x-ray mammography, using one or two projection images of the breast, is an indispensible tool in the early detection of breast cancer in women. Digital breast tomosynthesis (DBT) is a 3D imaging technique that promises higher sensitivity and specificity in breast cancer screening at a similar radiation dose to conventional two-view screening mammography. In DBT a 3D volume is reconstructed with anisotropic voxels from a limited number of x-ray projection images acquired over a limited angle. Although the benefit of early cancer detection through screening mammography outweighs the potential risks associated with radiation, the radiation dosage to women in terms of mean glandular dose (MGD) is carefully monitored. This work studies the MGD arising from a prototype DBT system under various parameters. Two anode/filter combinations (W/Al and W/Al+Ag) were investigated; the tube potential ranges from 20 to 50 kVp; and the breast size varied between 4 and 10 cm chest wall-to-nipple distance and between 3 and 7 cm compressed breast thickness. The dosimetric effect of breast positioning with respect to the imaging detector was also reviewed. It was found that the position of the breast can affect the MGD by as much as 5% to 13% depending on the breast size.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Automated regional registration and characterization of corresponding microcalcification clusters on temporal pairs of mammograms for interval change analysis

A computerized regional registration and characterization system for analysis of microcalcification clusters on serial mammograms is being developed in our laboratory. The system consists of two stages. In the first stage, based on the location of a detected cluster on the current mammogram, a regional registration procedure identifies the local area on the prior that may contain the corresponding cluster. A search program is used to detect cluster candidates within the local area. The detected cluster on the current image is then paired with the cluster candidates on the prior image to form true (TP-TP) or false (TP-FP) pairs. Automatically extracted features were used in a newly designed correspondence classifier to reduce the number of false pairs. In the second stage, a temporal classifier, based on both current and prior information, is used if a cluster has been detected on the prior image, and a current classifier, based on current information alone, is used if no prior cluster has been detected. The data set used in this study consisted of 261 serial pairs containing biopsy-proven calcification clusters. An MQSA radiologist identified the corresponding clusters on the mammograms. On the priors, the radiologist rated the subtlety of 30 clusters (out of the 261 clusters) as 9 or 10 on a scale of 1 (very obvious) to 10 (very subtle). Leave-one-case-out resampling was used for feature selection and classification in both the correspondence and malignant/benign classification schemes. The search program detected 91.2%(238/261) of the clusters on the priors with an average of 0.42 FPs/image. The correspondence classifier identified 86.6%(226/261) of the TP-TP pairs with 20 false matches (0.08 FPs/image) relative to the entire set of 261 image pairs. In the malignant/benign classification stage the temporal classifier achieved a test A{sub z} of 0.81 for the 246 pairs which contained a detection on the prior. In addition, a classifier was designed by using the clusters on the current mammograms only. It achieved a test A{sub z} of 0.72 in classifying the clusters as malignant and benign. The difference between the performance of the temporal classifier and the current classifier was statistically significant (p=0.0014). Our interval change analysis system can detect the corresponding cluster on the prior mammogram with high sensitivity, and classify them with a satisfactory accuracy.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Lung tumor tracking in fluoroscopic video based on optical flow

Respiratory gating and tumor tracking for dynamic multileaf collimator delivery require accurate and real-time localization of the lung tumor position during treatment. Deriving tumor position from external surrogates such as abdominal surface motion may have large uncertainties due to the intra- and interfraction variations of the correlation between the external surrogates and internal tumor motion. Implanted fiducial markers can be used to track tumors fluoroscopically in real time with sufficient accuracy. However, it may not be a practical procedure when implanting fiducials bronchoscopically. In this work, a method is presented to track the lung tumor mass or relevant anatomic features projected in fluoroscopic images without implanted fiducial markers based on an optical flow algorithm. The algorithm generates the centroid position of the tracked target and ignores shape changes of the tumor mass shadow. The tracking starts with a segmented tumor projection in an initial image frame. Then, the optical flow between this and all incoming frames acquired during treatment delivery is computed as initial estimations of tumor centroid displacements. The tumor contour in the initial frame is transferred to the incoming frames based on the average of the motion vectors, and its positions in the incoming frames are determined by fine-tuning the contour positions using a template matching algorithm with a small search range. The tracking results were validated by comparing with clinician determined contours on each frame. The position difference in 95% of the frames was found to be less than 1.4 pixels ({approx}0.7 mm) in the best case and 2.8 pixels ({approx}1.4 mm) in the worst case for the five patients studied.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Phantom evaluation of a commercially available three modality image guided radiation therapy system

The authors describe a detailed evaluation of the capabilities of imaging and image registration systems available with Varian linear accelerators for image guided radiation therapy (IGRT). Specifically, they present modulation transfer function curves for megavoltage planar, kilovoltage (kV) planar, and cone beam computed tomography imaging systems and compare these with conventional computed tomography. While kV planar imaging displayed the highest spatial resolution, all IGRT imaging techniques were assessed as adequate for their intended purpose. They have also characterized the image registration software available for use in conjunction with these imaging systems through a comprehensive phantom study involving translations in three orthogonal directions. All combinations of imaging systems and image registration software were found to be accurate, although the planar kV imaging system with automatic registration was generally superior, with both accuracy and precision of the order of 1 mm, under the conditions tested. Based on their phantom study, the attainable accuracy for rigid body translations using any of the features available with Varian equipment will more likely be limited by the resolution of the couch readouts than by inherent limitations in the imaging systems and image registration software. Overall, the accuracy and precision of currently available IGRT technology exceed published experience with the accuracy and precision of contouring for planning.

62 RADIOLOGY AND NUCLEAR MEDICINE↗