Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image representation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Compact representations of structured BFGS matrices

For general large-scale optimization problems compact representations exist in which recursive quasi-Newton update formulas are represented as compact matrix factorizations. For problems in which the objective function contains additional structure, recent structured quasi-Newton methods exploit available second-derivative information and approximate unavailable second derivatives. Here, this article develops the compact representations of two structured Broyden-Fletcher-Goldfarb-Shanno update formulas. The compact representations enable efficient limited memory and initialization strategies. Two limited memory line search algorithms are described for which extensive numerical results demonstrate the efficacy of the algorithms, including comparisons to IPOPT on large machine learning problems, and to L-BFGS on a real world large scale ptychographic imaging application.

97 MATHEMATICS AND COMPUTING↗

Semi-Automated, Object-Based Tomography of Dislocation Structures

The characterization of the three-dimensional arrangement of dislocations is important for many analyses in materials science. Dislocation tomography in transmission electron microscopy is conventionally accomplished through intensity-based reconstruction algorithms. Although such methods work successfully, a disadvantage is that they require many images to be collected over a large tilt range. Here, we present an alternative, semi-automated object-based approach that reduces the data collection requirements by drawing on the prior knowledge that dislocations are line objects. Our approach consists of three steps: (1) initial extraction of dislocation line objects from the individual frames, (2) alignment and matching of these objects across the frames in the tilt series, and (3) tomographic reconstruction to determine the full three-dimensional configuration of the dislocations. Drawing on innovations in graph theory, we employ a node-line segment representation for the dislocation lines and a novel arc-length mapping scheme to relate the dislocations to each other across the images in the tilt series. We demonstrate the method for a dataset collected from a dislocation network imaged by diffraction-contrast scanning transmission electron microscopy. Based on these results and a detailed uncertainty analysis for the algorithm, we discuss opportunities for optimizing data collection and further automating the method.

47 OTHER INSTRUMENTATION↗

Passive Inter-Photon Imaging

Digital camera pixels measure image intensities by converting incident light energy into an analog electrical current, and then digitizing it into a fixed-width binary representation. This direct measurement method, while conceptually simple, suffers from limited dynamic range and poor performance under extreme illumination --- electronic noise dominates under low illumination, and pixel full-well capacity results in saturation under bright illumination. We propose a novel intensity cue based on measuring inter-photon timing, defined as the time delay between detection of successive photons. Based on the statistics of inter-photon times measured by a time-resolved single-photon sensor, we develop theory and algorithms for a scene brightness estimator which works over extreme dynamic range; we experimentally demonstrate imaging scenes with a dynamic range of over ten million to one. The proposed techniques, aided by the emergence of single-photon sensors such as single-photon avalanche diodes (SPADs) with picosecond timing resolution, will have implications for a wide range of imaging applications: robotics, consumer photography, astronomy, microscopy and biomedical imaging.

97 MATHEMATICS AND COMPUTING↗

On-film optical recording of camera lens settings

An apparatus is described for recording a representation of the camera lens aperture and focus setting on the film of a camera, while the photographic image is being recorded. A data lens is provided between the camera lens and film, by means of which the aperture and focus setting may be determined. The determination is made by measuring both the location and the size of a data image provided by the data lens. The data lens apparatus requires no electrical power, is low in weight, and does not result in an increase in the external dimensions of the camera.

Thompson, R. E.↗

Dynamic edge warping - An experimental system for recovering disparity maps in weakly constrained systems

Dynamic edge warping (DEW), a technique for recovering reasonably accurate disparity maps from uncalibrated stereo image pairs, is presented. No precise knowledge of the epipolar camera geometry is assumed. The technique is embedded in a system including structural stereopsis on the front end and robust estimation in digital photogrammetry on the other for the purpose of self-calibrating stereo image pairs. Once the relative camera orientation is known, the epipolar geometry is computed and the system can use this information to refine its representation of the object space. Such a system will find application in the autonomous extraction of terrain maps from stereo aerial photographs, for which camera position and orientation are unknown a priori, and for online autonomous calibration maintenance for robotic vision applications, in which the cameras are subject to vibration and other physical disturbances after calibration. This work thus forms a component of an intelligent system that begins with a pair of images and, having only vague knowledge of the conditions under which they were acquired, produces an accurate, dense, relative depth map. The resulting disparity map can also be used directly in some high-level applications involving qualitative scene analysis, spatial reasoning, and perceptual organization of the object space. The system as a whole substitutes high-level information and constraints for precise geometric knowledge in driving and constraining the early correspondence process.

Boyer, K. L.↗

Distributed Stochastic Optimization of a Neural Representation Network for Time-Space Tomography Reconstruction

4D time-space reconstruction of dynamic events or deforming objects using X-ray computed tomography (CT) is an important inverse problem in non-destructive evaluation. Conventional back-projection based reconstruction methods assume that the object remains static for the duration of several tens or hundreds of X-ray projection measurement images (reconstruction of consecutive limited-angle CT scans). However, this is an unrealistic assumption for many in-situ experiments that causes spurious artifacts and inaccurate morphological reconstructions of the object. To solve this problem, we propose to perform a 4D time-space reconstruction using a distributed implicit neural representation (DINR) network that is trained using a novel distributed stochastic training algorithm. Our DINR network learns to reconstruct the object at its output by iterative optimization of its network parameters such that the measured projection images best match the output of the CT forward measurement model. Here, we use a forward measurement model that is a function of the DINR outputs at a sparsely sampled set of continuous valued 4D object coordinates. Unlike previous neural representation architectures that forward and back propagate through dense voxel grids that sample the object's entire time-space coordinates, we only propagate through the DINR at a small subset of object coordinates in each iteration resulting in an order-of-magnitude reduction in memory and compute for training. DINR leverages distributed computation across several compute nodes and GPUs to produce high-fidelity 4D time-space reconstructions. We use both simulated parallel-beam and experimental cone-beam X-ray CT datasets to demonstrate the superior performance of our approach.

36 MATERIALS SCIENCE↗

Computer measurement and representation of the heart in two and three dimensions

Methods for accurate measurement and meaningful display of cardiac dimensions as obtained from fluoroscopy were surveyed. Recorded images were scaled back to actual dimensions and cardiac motion was displayed to assess functional changes. This was accomplished by use of a low-cost but flexible ensemble of computer and video equipment which assisted in (1) digitizing image outlines or points, (2) filing digitized images for later recall in any sequence, (3) correcting recorded images for distortion, (4) modeling heart geometry, (5) analyzing dimensional changes, and (6) displaying both heart geometry and results of analysis in a useful form.

Rasmussen, D.↗

On-line object feature extraction for multispectral scene representation

A new on-line unsupervised object-feature extraction method is presented that reduces the complexity and costs associated with the analysis of the multispectral image data and data transmission, storage, archival and distribution. The ambiguity in the object detection process can be reduced if the spatial dependencies, which exist among the adjacent pixels, are intelligently incorporated into the decision making process. The unity relation was defined that must exist among the pixels of an object. Automatic Multispectral Image Compaction Algorithm (AMICA) uses the within object pixel-feature gradient vector as a valuable contextual information to construct the object's features, which preserve the class separability information within the data. For on-line object extraction the path-hypothesis and the basic mathematical tools for its realization are introduced in terms of a specific similarity measure and adjacency relation. AMICA is applied to several sets of real image data, and the performance and reliability of features is evaluated.

Ghassemian, Hassan↗

Experimental Investigation of Cavitation-Induced Erosion Using X-Ray Imaging and Tomography

High injection pressure in diesel engines can lead to cavitation-induced erosion in injector nozzles. One important factor affecting the severity of erosion is the fuel and its properties. Traditionally, modeling and simulation studies have used single-component representations of fuels, but realistic fuels feature a multitude of components and can even include volatile additives such as water and alcohol. To provide realistic benchmarks and comparisons, experimental measurements quantifying erosion characteristics were made using ultra-low sulfur diesel (ULSD) and two alternative diesel fuels (ADF). X-ray imaging and computed tomography were used to investigate cavitation-induced erosion onset and progression. Hard X-ray tomography revealed injector internal geometry, including details such as surface marks from the manufacturing process and erosion patterns from repeated injections. Erosion progression was measured using X-ray tomography and imaging performed between injections. The critical erosion site was found to be similar across different fuel blends, while the erosion rate and incubation time were sensitive to the fuel blend. The injector geometry and the erosion characteristics were also prepared for numerical model development and validation.

42 ENGINEERING↗

Learning neural representations for X-ray ptychography reconstruction with unknown probes

X-ray ptychography provides exceptional nanoscale resolution and is widely applied in materials science, biology, and nanotechnology. However, its full potential is constrained by the critical challenge of accurately reconstructing images when the illuminating probe is unknown. Conventional iterative methods and deep learning approaches are often suboptimal, particularly under the low-signal conditions inherent to low-dose and high-speed experiments. These limitations compromise reconstruction fidelity and restrict the broader adoption of the technique. In this work, we introduce the Ptychographic Implicit Neural Representation (PtyINR), a self-supervised framework that simultaneously addresses the object- and probe-recovery problem. By parameterizing both as continuous neural representations, PtyINR performs end-to-end reconstruction directly from raw diffraction patterns without requiring any pre-characterization of the probe. Extensive evaluations demonstrate that PtyINR achieves superior reconstruction quality on both simulated and experimental data, with remarkable robustness under challenging low-signal conditions. Furthermore, PtyINR offers a generalizable, physics-informed framework for addressing probe-dependent inverse problems, making it applicable to a wide range of computational microscopy problems.

36 MATERIALS SCIENCE↗

Comparison of point cloud and image-based models for calorimeter fast simulation

Score based generative models are a new class of generative models that have been shown to accurately generate high dimensional calorimeter datasets. Recent advances in generative models have used images with 3D voxels to represent and model complex calorimeter showers. Point clouds, however, are likely a more natural representation of calorimeter showers, particularly in calorimeters with high granularity. Furthermore, point clouds preserve all of the information of the original simulation, more naturally deal with sparse datasets, and can be implemented with more compact models and data files. In this work, two state-of-the-art score based models are trained on the same set of calorimeter simulation and directly compared.

47 OTHER INSTRUMENTATION↗

Monitoring coastal water properties and circulation from ERTS-1

The author has identified the following significant results. Imagery and digital tapes from nine successful ERTS-1 passes over Delaware Bay during different portions of the tidal cycle have been analyzed with special emphasis on turbidity, current circulation, waste disposal plumes, and convergent boundaries between different water masses. ERTS-1 image radiance correlated well with Secchi depth and suspended sediment concentration. MSS band 5 seemed to give the best representation of sediment load in the upper one meter of the water column. Circulation patterns observed by ERTS-1 during different parts of the tidal cycle, agreed well with predicted and measured currents throughout Delaware Bay. During flood tide the suspended sediment as visible from ERTS-1 also correlated well with the depth profile. Convergent shear boundaries between different water masses were observed from ERTS-1, with foam lines containing high concentrations of lead, mercury, and other toxic substances. Several fronts have been seen. Those near the mouth of the bay are associated with the tidal intrusion of shelf water. Fronts in the interior of the bay on the Delaware side appear to be associated with velocity shears induced by differences in bottom topography. Waste disposal plumes have benn detected 36 miles offshore.

Klemas, V.↗

An unsupervised feature extraction method for high dimensional image data compaction

A new on-line unsupervised feature extraction method for high-dimensional remotely sensed image data compaction is presented. This method can be utilized to solve the problem of data redundancy in scene representation by satellite-borne high resolution multispectral sensors. The algorithm first partitions the observation space into an exhaustive set of disjoint objects. Then, pixels that belong to an object are characterized by an object feature. Finally, the set of object features is used for data transmission and classification. The example results show that the performance with the compacted features provides a slight improvement in classification accuracy instead of any degradation. Also, the information extraction method does not need to be preceded by a data decompaction.

Ghassemian, Hassan↗

A survey of visual preprocessing and shape representation techniques

Many recent theories and methods proposed for visual preprocessing and shape representation are summarized. The survey brings together research from the fields of biology, psychology, computer science, electrical engineering, and most recently, neural networks. It was motivated by the need to preprocess images for a sparse distributed memory (SDM), but the techniques presented may also prove useful for applying other associative memories to visual pattern recognition. The material of this survey is divided into three sections: an overview of biological visual processing; methods of preprocessing (extracting parts of shape, texture, motion, and depth); and shape representation and recognition (form invariance, primitives and structural descriptions, and theories of attention).

Olshausen, Bruno A.↗

Tests of the Grobner Basis Solution for Lightning Ground Flash Fraction Retrieval

Satellite lightning imagers such as the NASA Tropical Rainfall Measuring Mission Lightning Imaging Sensor (TRMM/LIS) and the future GOES-R Geostationary Lightning Mapper (GLM) are designed to detect total lightning (ground flashes + cloud flashes). However, there is a desire to discriminate ground flashes from cloud flashes from the vantage point of space since this would enhance the overall information content of the satellite lightning data and likely improve its operational and scientific applications (e.g., in severe weather warning, lightning nitrogen oxides studies, and global electric circuit analyses). A Bayesian inversion method was previously introduced for retrieving the fraction of ground flashes in a set of flashes observed from a satellite lightning imager. The method employed a constrained mixed exponential distribution model to describe the lightning optical measurements. To obtain the optimum model parameters (one of which is the ground flash fraction), a scalar function was minimized by a numerical method. In order to improve this optimization, a Grobner basis solution was introduced to obtain analytic representations of the model parameters that serve as a refined initialization scheme to the numerical optimization. In this study, we test the efficacy of the Grobner basis initialization using actual lightning imager measurements and ground flash truth derived from the national lightning network.

Koshak, William↗

Brain segmentation and the generation of cortical surfaces

This paper describes methods for white matter segmentation in brain images and the generation of cortical surfaces from the segmentations. We have developed a system that allows a user to start with a brain volume, obtained by modalities such as MRI or cryosection, and constructs a complete digital representation of the cortical surface. The methodology consists of three basic components: local parametric modeling and Bayesian segmentation; surface generation and local quadratic coordinate fitting; and surface editing. Segmentations are computed by parametrically fitting known density functions to the histogram of the image using the expectation maximization algorithm [DLR77]. The parametric fits are obtained locally rather than globally over the whole volume to overcome local variations in gray levels. To represent the boundary of the gray and white matter we use triangulated meshes generated using isosurface generation algorithms [GH95]. A complete system of local parametric quadratic charts [JWM+95] is superimposed on the triangulated graph to facilitate smoothing and geodesic curve tracking. Algorithms for surface editing include extraction of the largest closed surface. Results for several macaque brains are presented comparing automated and hand surface generation. Copyright 1999 Academic Press.

NASA Discipline Neuroscience↗

XRF-ROI Finder: Machine Learning to Guide Region-of-Interest Scanning for X-ray Fluorescence Microscopy

The ROI-finder software is being developed for use by several Microscopy Group beamlines at Argonne National Laboratory, including 2-ID microprobes and 9-ID-B Bionanoprobe which use multi-scale scanning fluorescence microscopy to acquire elemental maps (multi-modal image data). Microscopy experiments require scan of samples at a coarse resolution followed by ROI identification using feature detection based on domain expertise. Finer resolution scans are then conducted based on identified ROI. The decision-making process based on domain expertise will be difficult to perform for faster data rates and much larger sampling volumes anticipated after APS-U necessitating the need for the ROI-finder software. The ROI- finder detects regions of interest through a continuous learning process, starting with a unsupervised representation learning and improving its recommendations through supervised learning and an interactive tool for user annotation. The scope of ongoing development efforts includes the integration of image registration module to correlate optical and X-ray images, extraction of feature morphology as well as elemental signatures in the image space and incorporation of beamtime streaming data by the scanning probe via EPICS.

CHOWDHURY, M. ARSHAD ZAHANGIR↗

Atomic-scale Imaging of PGM-free Catalyst Active Sites by 30 keV 4D-STEM

Platinum group metal (PGM)-free catalysts have attracted a large amount of attention due to their potential for enabling low-cost, commercially viable hydrogen fuel cells and electrolyzers [1]. Degradation of cell performance remains a significant challenge, however, currently limiting implementation of devices that utilize PGM-free materials [2]. Controlling degradation in these materials requires a better understanding of the atomic structure of active sites, thought to be FeN4 structures within a graphitic carbon lattice, which would enable more accurate prediction of the associated degradation pathways. The exact structural arrangement of active sites in these materials is still debated since a range of structures have been computationally predicted and methods to directly validate these models are still needed [1,3-5].While scanning transmission electron microscopy (STEM) has provided initial glimpses into the nature of the proposed active sites, detailed evaluation of the structure of these sites is challenging since they involve defects, edges, and nitrogen dopants in the graphitic lattice, which are susceptible to beam damage [6,7]. Conventional STEM imaging and spectroscopy methods exacerbate this problem with dose-inefficiency or nonideal contrast characteristics for imaging light and heavy elements simultaneously. A method that minimizes damage while generating dose-efficient, easily-interpretable contrast for both light and heavy elements is therefore needed to facilitate imaging of sensitive active site atomic structure.Here, we demonstrate direct atomic-scale imaging of PGM-free catalyst active sites by low-voltage four-dimensional (4D)-STEM. To accomplish this, we pair a 30 keV aberration-corrected probe, which minimizes knock-on damage, with a fast pixelated detector that has optimal performance at low beam energies [8]. We show how this setup enables relatively simple center-of-mass (CoM) techniques [9,10] to produce images with an increased signal-to-noise ratio (SNR) and light-element contrast over conventional imaging modes, allowing the entire active site structure to be imaged at the atomic scale. Moreover, we show how electron ptychography [11,12] enables images with further improved characteristics to be obtained, for example by minimizing residual aberrations, which provides a more accurate structural representation. The increased understanding that these low-voltage 4D-STEM techniques will provide about the atomic structure of PGM-free active sites and their associated degradation pathways will facilitate rational design of next-generation materials, promoting development of low-cost hydrogen fuel cells, electrolyzers, and other energy conversion devices [13]. References:[1] U Martinez et al., Adv. Mater. 31 (2019), p. 1806545.[2] Y Shao et al., Adv. Mater. 31 (2019), p. 1807615.[3] J Kneebone et al., J. Phys. Chem. C 121, (2017), p.16283.[4] T Mineva et al., ACS Catal. 9 (2019), p. 9359.[5] J Li et al., Nat. Catal. 4 (2021), p. 10.[6] T Susi et al., ACS Nano 6 (2012), p. 8837.[7] P Zelenay and DJ Myers, US Department of Energy Hydrogen and Fuel Cells Program 2017 Annual Merit Review and Peer Evaluation Meeting, Washington, DC (2017).[8] H Ryll et al., J. Inst. 11 (2016), p. P04006.[9] K Müller et al., Nat. Commun. 5 (2014), p. 5653.[10] I Lazic et al., Ultramicroscopy 160 (2016), p. 265.[11] H Yang et al., Nat. Commun. 7 (2016), p. 12532.[12] Y Jiang et al., Nature 559 (2018), p. 343. [13] Research sponsored by the Hydrogen and Fuel Cell Technologies Office, Office of Energy Efficiency and Renewable Energy, US Department of Energy (DOE). Research was conducted at the Center for Nanophase Materials Sciences, which is a DOE Office of Science User Facility.

Zachman, Michael↗