Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Computational imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

End–to–End Metasurface Design for Temperature Imaging via Broadband Planck‐Radiation Regression

A theoretical framework is presented for temperature imaging from long-wavelength infrared (LWIR) thermal radiation (e.g., 8–12 µm) through the end-to-end design of a metasurface-optics frontend and a computational-reconstruction backend. A new nonlinear reconstruction algorithm, “Planck regression”, is introduced to reconstruct the temperature map from a gray scale sensor image, even in the presence of severe chromatic aberration, by exploiting black body and optical physics particular to thermal imaging. This algorithm is combined with an end-to-end approach that optimizes manufacturable, single-layer metasurfaces to yield the most accurate reconstruction. The designs demonstrate high-quality, noise-robust reconstructions of arbitrary temperature maps (including completely random images) in simulations of an ultra-compact thermal-imaging device. Here, it is also shown that Planck regression is much more generalizable to arbitrary images than a straightforward neural-network reconstruction, which requires a large training set of domain-specific images.

36 MATERIALS SCIENCE↗

A Review of Machine Learning Classification Using Quantum Annealing for Real-World Applications

Optimizing the training of a machine learning pipeline helps in reducing training costs and improving model performance. One such optimizing strategy is quantum annealing, which is an emerging computing paradigm that has shown potential in optimizing the training of a machine learning model. The implementation of a physical quantum annealer has been realized by D-wave systems and is available to the research community for experiments. Recent experimental results on a variety of machine learning applications using quantum annealing have shown interesting results where the performance of classical machine learning techniques is limited by limited training data and high dimensional features. This article explores the application of D-wave’s quantum annealer for optimizing machine learning pipelines for real-world classification problems. Finally, we review the application domains on which a physical quantum annealer has been used to train machine learning classifiers. We discuss and analyze the experiments performed on the D-Wave quantum annealer for applications such as image recognition, remote sensing imagery, computational biology, and particle physics. We discuss the possible advantages and the problems for which quantum annealing is likely to be advantageous over classical computation.

97 MATHEMATICS AND COMPUTING↗

Symmetric Phase-Only Filtering in Particle-Image Velocimetry

Symmetrical phase-only filtering (SPOF) can be exploited to obtain substantial improvements in the results of data processing in particle-image velocimetry (PIV). In comparison with traditional PIV data processing, SPOF PIV data processing yields narrower and larger amplitude correlation peaks, thereby providing more-accurate velocity estimates. The higher signal-to-noise ratios associated with the higher amplitude correlation peaks afford greater robustness and reliability of processing. SPOF also affords superior performance in the presence of surface flare light and/or background light. SPOF algorithms can readily be incorporated into pre-existing algorithms used to process digitized image data in PIV, without significantly increasing processing times. A summary of PIV and traditional PIV data processing is prerequisite to a meaningful description of SPOF PIV processing. In PIV, a pulsed laser is used to illuminate a substantially planar region of a flowing fluid in which particles are entrained. An electronic camera records digital images of the particles at two instants of time. The components of velocity of the fluid in the illuminated plane can be obtained by determining the displacements of particles between the two illumination pulses. The objective in PIV data processing is to compute the particle displacements from the digital image data. In traditional PIV data processing, to which the present innovation applies, the two images are divided into a grid of subregions and the displacements determined from cross-correlations between the corresponding sub-regions in the first and second images. The cross-correlation process begins with the calculation of the Fourier transforms (or fast Fourier transforms) of the subregion portions of the images. The Fourier transforms from the corresponding subregions are multiplied, and this product is inverse Fourier transformed, yielding the cross-correlation intensity distribution. The average displacement of the particles across a subregion results in a displacement of the correlation peak from the center of the correlation plane. The velocity is then computed from the displacement of the correlation peak and the time between the recording of the two images. The process as described thus far is performed for all the subregions. The resulting set of velocities in grid cells amounts to a velocity vector map of the flow field recorded on the image plane. In traditional PIV processing, surface flare light and bright background light give rise to a large, broad correlation peak, at the center of the correlation plane, that can overwhelm the true particle- displacement correlation peak. This has made it necessary to resort to tedious image-masking and background-subtraction procedures to recover the relatively small amplitude particle-displacement correlation peak. SPOF is a variant of phase-only filtering (POF), which, in turn, is a variant of matched spatial filtering (MSF). In MSF, one projects a first image (denoted the input image) onto a second image (denoted the filter) as part of a computation to determine how much and what part of the filter is present in the input image. MSF is equivalent to cross-correlation. In POF, the frequency-domain content of the MSF filter is modified to produce a unitamplitude (phase-only) object. POF is implemented by normalizing the Fourier transform of the filter by its magnitude. The advantage of POFs is that they yield correlation peaks that are sharper and have higher signal-to-noise ratios than those obtained through traditional MSF. In the SPOF, these benefits of POF can be extended to PIV data processing. The SPOF yields even better performance than the POF approach, which is uniquely applicable to PIV type image data. In SPOF as now applied to PIV data processing, a subregion of the first image is treated as the input image and the corresponding subregion of the second image is treated as the filter. The Fourier transforms from both the firs and second- image subregions are normalized by the square roots of their respective magnitudes. This scheme yields optimal performance because the amounts of normalization applied to the spatial-frequency contents of the input and filter scenes are just enough to enhance their high-spatial-frequency contents while reducing their spurious low-spatial-frequency content. As a result, in SPOF PIV processing, particle-displacement correlation peaks can readily be detected above spurious background peaks, without need for masking or background subtraction.

Wemet, Mark P.↗

Fast Hyperspectral Neutron Tomography

Hyperspectral neutron computed tomography is a tomographic imaging technique in which thousands of wavelength-specific neutron radiographs are measured for each tomographic view. In conventional hyperspectral reconstruction, data from each neutron wavelength bin are reconstructed separately, which is extremely time-consuming. These reconstructions often suffer from poor quality due to low signal-to-noise ratios. Consequently, material decomposition based on these reconstructions tends to produce inaccurate estimates of the material spectra and erroneous volumetric material separation. In this paper, we present two novel algorithms for processing hyperspectral neutron data: fast hyperspectral reconstruction and fast material decomposition. Both algorithms rely on a subspace decomposition procedure that transforms hyperspectral views into low-dimensional projection views within an intermediate subspace, where tomographic reconstruction is performed. The use of subspace decomposition dramatically reduces reconstruction time while reducing both noise and reconstruction artifacts. We apply our algorithms to both simulated and measured neutron data and demonstrate that they reduce computation and improve the quality of the results relative to conventional methods.

Chowdhury, Mohammad Samin Nur [Purdue University]↗

A Visual Designer of Layer-wise Relevance Propagation Models

Layer-wise Relevance Propagation (LRP) is an emerging and widely-used method for interpreting the prediction results of convolutional neural networks (CNN). LRP developers often select and employ different relevance backpropagation rules and parameters, to compute relevance scores on input images. However, there exists no obvious solution to define a "best" LRP model. A satisfied model is highly reliant on pertinent images and designers' goals. We develop a visual model designer, named as VisLRPDesigner, to overcome the challenges in the design and use of LRP models. Various LRP rules are unified into an integrated framework with an intuitive workflow of parameter setup. VisLRPDesigner thus allows users to interactively configure and compare LRP models. It also facilitates relevance-based visual analysis with two important functions: relevance-based pixel flipping and neuron ablation. Several use cases illustrate the benefits of VisLRPDesigner. The usability and limitation of the visual designer is evaluated by LRP users.

97 MATHEMATICS AND COMPUTING↗

Photogrammetric calibration of the NASA-Wallops Island image intensifier system

An image intensifier was designed for use as one of the primary tracking systems for the barium cloud experiment at Wallops Island. Two computer programs, a definitive stellar camara calibration program and a geodetic stellar camara orientation program, were originally developed at Wallops on a GE 625 computer. A mathematical procedure for determining the image intensifier distortions is outlined, and the implementation of the model in the Wallops computer programs is described. The analytical calibration of metric cameras is also discussed.

Harp, B. F.↗

Accelerated radiation transport modeling techniques for pencil beam computed tomography using gamma rays

Monte Carlo radiation transport modeling studies were performed for a compact, and high-resolution gamma-ray computed tomography system designed for imaging irradiated nuclear fuel. The system comprises a 60 Co source – chosen for its highly penetrating 1173 keV and 1332 keV gamma rays – a pair of high-aspect-ratio pencil beam collimators, and an inorganic scintillator detector. Here two acceleration methods are proposed to rapidly model a transmission type gamma-ray tomography system. The first, a variance reduction technique, is based on performing Monte Carlo simulations with a monodirectionally-biased source, sampled from a characteristic sub-volume of the full source volume. The second acceleration method is based on the deterministic calculations using the Beer–Lambert law and detector response characteristics. Comparison of simulations using acceleration approaches with analog simulations of the fully isotropic, full-volume equivalent, show that the Monte Carlo variance reduction technique gives quantitatively accurate predictions for large collimator aspect ratios while the deterministic calculations are semi-quantitative but converge close to the correct result as the collimator aspect ratio increases. As such, these techniques can be used to reduce the computational cost in generating simulated radiographs and tomographs by several orders of magnitude. Experimental validation efforts are currently underway and will be demonstrated in future work.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

The Radiometric Scaling of the MODIS and VIIRS Imagers to a Common Reference and Stability Analysis for the Next Edition of CERES Products

The NASA CERES project has provided the climate quality observed TOA and computed surface fluxes to the scientific community. CERES uses MODIS and VIIRS imagers to retrieve cloud properties needed to convert Terra, Aqua, NPP, and NOAA-20 CERES footprint radiance observations into fluxes. The imagers are also used to radiometrically scale the geostationary sensors (GEO) radiances to the imager calibration reference to ensure that the GEO derived cloud properties and broadband TOA fluxes are consistent in both space and time. Both the imager and GEO retrieved cloud properties are used to compute the surface fluxes. The CERES imager and GEO calibration team uses ray-matched radiance pairs to radiometrically scale the SNPP and NOAA-20 VIIRS sensors to the Aqua-MODIS calibration reference. The radiometric scaling is further validated using geostationary imagers as transfer radiometers. The team will rely primarily on deep convective clouds to monitor the imager channel calibration stability and to correct for short term calibration drifts. The DSCOVR satellite was launched on February 25, 2015 and orbits around the L1 Lagrange point directly between the Earth and the sun. The EPIC sensor contains no onboard calibration systems. However, multiple inter-calibration studies have shown that the EPIC imager is very stable in time. The excellent radiometric stability of EPIC allows the use of EPIC observations as a stable reference to validate both the short term drift corrections of the imagers, as well as to validate the radiometric scaling factors between them. Examples of the imager relative calibration using EPIC before and after radiometric scaling will be shown along with the results from the use of invariant targets to remove imager calibration drifts.

DSCOVR-EPIC↗

Digital image analysis of Landsat data

The paper defines some basic processing functions than can be performed digitally, discusses a variety of computer peripherals including hard copy output devices and television terminals, compares the characteristics of stand-alone image analysis systems, and briefly describes the important features of image processing and geographic information systems software. Several examples are discussed to demonstrate the efficient use of computers through implementation of hard copy image recorders and television display terminals. The commercially available stand-alone image analysis systems include a computer, appropriate peripherals, and sufficient software to perform analysis without other computational support.

Alford, W. L.↗

Digital Mammography with a Mosaic of CCD-Arrays

The present invention relates generally to a mammography device and method and more particularly to a novel digital mammography device and method to detect microcalcifications of precancerous tissue. A digital mammography device uses a mosaic of electronic digital imaging arrays to scan an x-ray image. The mosaic of arrays is repositioned several times to expose different portions of the image, until the entire image is scanned. The data generated by the arrays during each exposure is stored in a computer. After the final exposure, the computer combines data of the several partial images to produce a composite of the original x-ray image. An aperture plate is used to reduce scatter and the overall exposure of the patient to x-rays. The novelty of this invention is that it provides a digital mammography device with large field coverage, high spatial resolution, scatter rejection, excellent contrast characteristics and lesion detectability under clinical conditions. This device also shields the patient from excessive radiation, can detect extremely small calcifications and allows manipulation and storage of the image.

Jalink, Antony, Jr.↗

Digital Mammography with a Mosaic of CCD Arrays

A digital mammography device uses a mosaic of electronic digital imaging arrays to scan an x-ray image is discussed. The mosaic of arrays is repositioned several times to expose different portions of the image, until the entire image is scanned. The data generated by the arrays during each exposure is stored in a computer. After the final exposure, the computer combines data of the several partial images to produce a composite of the original x-ray image. An aperture plate is used to reduce scatter and the overall exposure of the patient to x-rays.

Jalink, Antony, Jr.↗

Real World Use Case Evaluation of Radar Retro-reflectors for Autonomous Vehicle Lane Detection Applications

Lane detection plays a critical role in autonomous vehicles for safe and reliable navigation. Lane detection is traditionally accomplished using a camera sensor and computer vision processing. The downside of this traditional technique is that it can be computationally intensive when high quality images at a fast frame rate are used and has reliability issues from occlusion such as, glare, shadows, active road construction, and more. This study addresses these issues by exploring alternative methods for lane detection in specific scenarios caused from road construction-induced lane shift and sun glare. Specifically, a U-Net, a convolutional network used for image segmentation, camera-based lane detection method is compared with a radar-based approach using a new type of sensor previously unused in the autonomous vehicle space: radar retro-reflectors. This evaluation is performed using ground truth data, obtained by measuring the lane positions and transforming them into pixel coordinates. The performance of each method is assessed using the statistical R2 score, indicating the correlation between the detected lane lines and the ground truth. The results show that the U-Net camera-based method exhibits limitations in accurately detecting and aligning the lane lines, particularly in challenging scenarios. However, the radar-based lane detection method demonstrates a strong correlation with the ground truth which implies that the use of this sensor may improve current reliability issues from conventional camera lane detection approach. Furthermore, the study highlights the limitations of the U-Net model for camera lane detection, especially in scenarios with sun glare. This study shows that infrastructure-based radar retro-reflectors can improve autonomous vehicle lane detection reliability. The integration of different sensor modalities and the development of advanced computer vision algorithms are crucial for improving the accuracy, reliability, and energy efficiency of lane detection systems. Addressing these challenges contributes to the advancement of autonomous vehicles and the realization of safer and more efficient transportation systems.

Brown, Nicolas E.↗

Nonuniform visual pattern image sequence coding

Visual Pattern Image Sequence Coding (VPISC) is a pyramidal image coding scheme which utilizes human visual system (HVS) properties to achieve low bit rates while maintaining a good perceived image quality, all with extremely low computational cost. This paper describes extensions of VPISC, termed Foveal VPISC (FVPISC) and Adaptive VPISC (AVPISC). Both algorithms produce decreased bit rates by selectively allowing some image regions to be coded at low resolution. In FVPISC, a foveation criterion is used to select a region of interest. In AVPISC, the algorithm adaptively determines which regions require high-resolution coding in order to maintain uniform image quality over the entire image.

Silsbee, Peter L.↗

Application of a data-mining method based on Bayesian networks to lesion-deficit analysis

Although lesion-deficit analysis (LDA) has provided extensive information about structure-function associations in the human brain, LDA has suffered from the difficulties inherent to the analysis of spatial data, i.e., there are many more variables than subjects, and data may be difficult to model using standard distributions, such as the normal distribution. We herein describe a Bayesian method for LDA; this method is based on data-mining techniques that employ Bayesian networks to represent structure-function associations. These methods are computationally tractable, and can represent complex, nonlinear structure-function associations. When applied to the evaluation of data obtained from a study of the psychiatric sequelae of traumatic brain injury in children, this method generates a Bayesian network that demonstrates complex, nonlinear associations among lesions in the left caudate, right globus pallidus, right side of the corpus callosum, right caudate, and left thalamus, and subsequent development of attention-deficit hyperactivity disorder, confirming and extending our previous statistical analysis of these data. Furthermore, analysis of simulated data indicates that methods based on Bayesian networks may be more sensitive and specific for detecting associations among categorical variables than methods based on chi-square and Fisher exact statistics.

NASA Discipline Neuroscience↗

Recursive Hierarchical Image Segmentation by Region Growing and Constrained Spectral Clustering

This paper describes an algorithm for hierarchical image segmentation (referred to as HSEG) and its recursive formulation (referred to as RHSEG). The HSEG algorithm is a hybrid of region growing and constrained spectral clustering that produces a hierarchical set of image segmentations based on detected convergence points. In the main, HSEG employs the hierarchical stepwise optimization (HS WO) approach to region growing, which seeks to produce segmentations that are more optimized than those produced by more classic approaches to region growing. In addition, HSEG optionally interjects between HSWO region growing iterations merges between spatially non-adjacent regions (i.e., spectrally based merging or clustering) constrained by a threshold derived from the previous HSWO region growing iteration. While the addition of constrained spectral clustering improves the segmentation results, especially for larger images, it also significantly increases HSEG's computational requirements. To counteract this, a computationally efficient recursive, divide-and-conquer, implementation of HSEG (RHSEG) has been devised and is described herein. Included in this description is special code that is required to avoid processing artifacts caused by RHSEG s recursive subdivision of the image data. Implementations for single processor and for multiple processor computer systems are described. Results with Landsat TM data are included comparing HSEG with classic region growing. Finally, an application to image information mining and knowledge discovery is discussed.

Tilton, James C.↗

Deep learning at the edge enables real-time streaming ptychographic imaging

Abstract Coherent imaging techniques provide an unparalleled multi-scale view of materials across scientific and technological fields, from structural materials to quantum devices, from integrated circuits to biological cells. Driven by the construction of brighter sources and high-rate detectors, coherent imaging methods like ptychography are poised to revolutionize nanoscale materials characterization. However, these advancements are accompanied by significant increase in data and compute needs, which precludes real-time imaging, feedback and decision-making capabilities with conventional approaches. Here, we demonstrate a workflow that leverages artificial intelligence at the edge and high-performance computing to enable real-time inversion on X-ray ptychography data streamed directly from a detector at up to 2 kHz. The proposed AI-enabled workflow eliminates the oversampling constraints, allowing low-dose imaging using orders of magnitude less data than required by traditional methods.

36 MATERIALS SCIENCE↗

Three-Dimensional Imaging and Quantification of Gas Storativity in Nanoporous Media via X-rays Computed Tomography

This study provides the engineering science underpinnings for improved characterization and quantification of the interplay of gases with kerogen and minerals in shale. Natural nanoporous media such as shale (i.e., mudstone) often present with low permeability and dual porosity, making them difficult to characterize given the complex structural and chemical features across multiple scales. These structures give nanoporous solids a large surface area for gas to sorb. In oil and gas applications, full understanding of these media and their sorption characteristics are critical for evaluating gas reserves, flow, and storage for enhanced recovery and CO 2 sequestration potential. Other applications include CO 2 capture from industrial plants, hydrogen storage on sorbent surfaces, and heterogeneous catalysis in ammonia synthesis. Therefore, high-resolution experimental procedures are demanded to better understand the gas–solid behavior. In this study, CT imaging was applied on the sub-millimeter scale to shale samples (Eagle Ford and Wolfcamp) to improve quantitative agreement between CT-derived and pulse decay (mass balance) derived results. Improved CT imaging formulations are presented that better match mass balance results, highlighting the significance of gas sorption in complex nanoporous media. The proposed CT routine implemented on the Eagle Ford sample demonstrated a 17% error reduction (22% to 5%) when compared to the conventional CT procedure. These observations are consistent in the Wolfcamp sample, emphasizing the reliability of this technique for broader implementation of digital adsorption studies in nanoporous geomaterials.

42 ENGINEERING↗

NASA/NOAA: Earth Science Electronic Theater 1999. Earth Science Observations, Analysis and Visualization: Roots in the 60s - Vision for the Next Millennium

The Etheater presents visualizations which span the period from the original Suomi/Hasler animations of the first ATS-1 GEO weather satellite images in 1966, to the latest 1999 NASA Earth Science Vision for the next 25 years. Hot off the SGI-Onyx Graphics-Supercomputer are NASA''s visualizations of Hurricanes Mitch, Georges, Fran and Linda. These storms have been recently featured on the covers of National Geographic, Time, Newsweek and Popular Science. Highlights will be shown from the NASA hurricane visualization resource video tape that has been used repeatedly this season on National and International network TV. Results will be presented from a new paper on automatic wind measurements in Hurricane Luis from 1-min GOES images that appeared in the November BAMS. The visualizations are produced by the NASA Goddard Visualization & Analysis Laboratory, and Scientific Visualization Studio, as well as other Goddard and NASA groups using NASA, NOAA, ESA, and NASDA Earth science datasets. Visualizations will be shown from the Earth Science ETheater 1999 recently presented in Tokyo, Paris, Munich, Sydney, Melbourne, Honolulu, Washington, New York, and Dallas. The presentation Jan 11-14 at the AMS meeting in Dallas used a 4-CPU SGI/CRAY Onyx Infinite Reality Super Graphics Workstation with 8 GB RAM and a Terabyte Disk at 3840 X 1024 resolution with triple synchronized BarcoReality 9200 projectors on a 60ft wide screen. Visualizations will also be featured from the new Earth Today Exhibit which was opened by Vice President Gore on July 2, 1998 at the Smithsonian Air & Space Museum in Washington, as well as those presented for possible use at the American Museum of Natural History (NYC), Disney EPCOT, and other venues. New methods are demonstrated for visualizing, interpreting, comparing, organizing and analyzing immense HyperImage remote sensing datasets and three dimensional numerical model results. We call the data from many new Earth sensing satellites, HyperImage datasets, because they have such high resolution in the spectral, temporal, spatial, and dynamic range domains. The traditional numerical spreadsheet paradigm has been extended to develop a scientific visualization approach for processing HyperImage datasets and 3D model results interactively. The advantages of extending the powerful spreadsheet style of computation to multiple sets of images and organizing image processing were demonstrated using the Distributed Image SpreadSheet (DISS). The DISS is being used as a high performance testbed Next Generation Internet (NGI) VisAnalysis of: 1) El Nino SSTs and NDVI response 2) Latest GOES 10 5-min rapid Scans of 26 day 5000 frame movie of March & April 198 weather and tornadic storms 3) TRMM rainfall and lightning 4)GOES 9 satellite images/winds and NOAA aircraft radar of hurricane Luis, 5) lightning detector data merged with GOES image sequences, 6) Japanese GMS, TRMM, & ADEOS data 7) Chinese FY2 data 8) Meteosat & ERS/ATSR data 9) synchronized manipulation of multiple 3D numerical model views; etc. will be illustrated. The Image SpreadSheet has been highly successful in producing Earth science visualizations for public outreach.

Hasler, A. Fritz↗