Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “images”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Ray-tracing image simulations of transparent objects with complex shape and inhomogeneous refractive index

Optical images of transparent three-dimensional objects can be different from a replica of the object’s cross section in the image plane, due to refraction at the surface or in the body of the object. Simulations of the object’s image are thus needed for the visualization and validation of physical models. We report ray tracing image simulations that achieved high physical fidelity, reproducing optical behaviors and image features not rendered in previous studies. We replicated brightfield microscopy images of drops with complex shapes, and images of pressure and shock waves traveling inside them. For high physical fidelity, the simulations must replicate the spatial and angular distribution of illumination rays, and both the experiment and the simulation must be designed for accurate optical modeling. The simulations are highly sensitive to the properties of the drops and can be used to diagnose and refine fluid dynamics models. The simulated images can also be optimized to extract multiple 3D properties from experimental images. Compared to specialized single-shot 3D imaging methods, this approach has the advantage that it preserves the experimental simplicity, the high resolution, and the visual interpretability characteristic to basic optical imaging. The techniques introduced here are directly applicable to optical microscopy, so they can be used in other fields, such as microfluidics and biology, to expand the type and the accuracy of three-dimensional information that can be extracted from basic optical images.

Cavitation↗
DOE OSTI2020

Deep machine learning-assisted multiphoton microscopy to reduce light exposure and expedite imaging

Two-photon excitation fluorescence (2PEF) allows imaging of tissue up to about one millimeter in thickness. Typically, reducing fluorescence excitation exposure reduces the quality of the image. However, using deep learning super resolution techniques, these low-resolution images can be converted to high-resolution images. This work explores improving human tissue imaging by applying deep learning to maximize image quality while reducing fluorescence excitation exposure. We analyze two methods: a method based on U-Net, and a patch-based regression method. Both methods are evaluated on a skin dataset and an eye dataset. The eye dataset includes 1200 paired high power and low power images of retinal organoids. The skin dataset contains multiple frames of each sample of human skin. High-resolution images were formed by averaging 70 frames for each sample and low-resolution images were formed by averaging the first 7 and 15 frames for each sample. The skin dataset includes 550 images for each of the resolution levels. We track two measures of performance for the two methods: mean squared error (MSE) and structural similarity index measure (SSIM). For the eye dataset, the patches method achieves an average MSE of 27,611 compared to 146,855 for the U-Net method, and an average SSIM of 0.636 compared to 0.607 for the U-Net method. For the skin dataset, the patches method achieves an average MSE of 3.768 compared to 4.032 for the U-Net method, and an average SSIM of 0.824 compared to 0.783 for the U-Net method. Despite better performance on image quality, the patches method is worse than the U-Net method when comparing the speed of prediction, taking 303 seconds to predict one image compared to less than one second for the U-Net method.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2021

Neutron Transmission Imaging with a Portable D-T Neutron Generator

Fast-neutron transmission imaging provides complementary information to x-ray transmission imaging. While fast neutron imaging resolution is generally below x-ray imaging, 14-MeV neutrons have an advantage over portable x-ray systems. Neutrons have higher transmission through high-Z materials due to a more uniform attenuation as a function of material atomic number Z compared to X-rays, and can therefore image low-Z materials inside high-Z materials. As a result, portable neutron transmission imaging has many applications, including inspection of concrete and welds for corrosion in vehicles, bridges, and other infrastructure, measurement of material levels in containers, and inspection of suspicious packages. Fast-neutron imaging is also more practical for field use than thermal-neutron imaging due to the size and shielding requirements typical of thermal-imaging systems compared to the availability of small 14.1 MeV D-T neutron generators. However, there are limitations in portable fast-neutron imaging systems, including limited neutron output, limited light produced by neutron scintillators, and lower resolution due to neutron source spot size and 2-3 mm scintillator thickness. In addition, digital-panel dark-noise is roughly 100x higher than neutron scintillator light, and variations in noise across the panel and in time is comparable to the imaging signal. Here we discuss recent efforts in developing a portable fast-neutron radiography system, including an improved neutron scintillator, mitigation of panel noise, and new commercial portable D-T neutron generators. We also present MCNP efforts to model neutron imaging, including scintillator resolution and the effects of neutron scattering from the object and surrounding materials.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Bayesian Spatially Varying Multi-Regularization Image Deblurring

Many scientific experiments such as those found in astronomy, geology, microbiology, and X-ray radiography require the use of high-energy instruments to capture images. Since blur and noise are inevitably present in any imaging system, the images must be \deblurred" to extract the full information content. Mathematically, image deblurring is an ill-posed inverse problem that requires regularization. The regularization, in turn, has a large effect on the deblurred image: different regularization strengths, and types, lead to drastically different reconstructions. Moreover, many images contain a mixture of smooth and sharp features which suggests the use of multi-regularization, i.e., varying the type of regularization (e.g. Tikhonov or total variation) across the image. We address these issues by formulating the image deblurring problem within a hierarchical Bayesian framework in which we spatially adapt the strength of the regularization and also vary the regularization type across the image. In this way, the image itself, along with corresponding regularization strength at each pixel, are described jointly by a posterior distribution which we can sample by Markov chain Monte Carlo (MCMC) methods. We illustrate our techniques on simplified test problems and apply them to high-energy X-ray images taken at the Nevada National Security Site. Numerical tests show that our new method is robustly applicable and increases the quality of the image reconstruction when compared to other (Bayesian) methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

The Role of Quantum Science Concepts in Enhancing Sensing and Imaging Technologies: Applications for Biology: Proceedings of a Workshop

Quantum concepts hold the potential to enable significant advances in sensing and imaging technologies that could be vital to the study of biological systems. The workshop Quantum Science Concepts in Enhancing Sensing and Imaging Technologies: Applications for Biology, held online March 8–10, 2021, was organized to examine the research and development needs to advance biological applications of quantum technology. Hosted by the National Academies of Sciences, Engineering, and Medicine, the event brought together experts working on state-of-the-art, quantum-enabled technologies and scientists who are interested in applying these technologies to biological systems. Through talks, panels, and discussions, the workshop facilitated a better understanding of the current and future biological applications of quantum-enabled technologies in fields such as microbiology, molecular biology, cell biology, plant science, mycology, and many others. The workshop was organized around three main themes. The first, quantum in biology, examined quantum concepts that are hypothesized to be important for life processes and that researchers are working to observe through biological imaging and sensing. The second, quantum for biology, addressed ways to use quantum concepts to enhance technologies for biological imaging and sensing. The third, biology for quantum, offered a wider discussion of how the frontiers of biological imaging and sensing could enable future study using quantum concepts, tools, or technologies. Throughout the workshop, participants identified a wide range of emerging approaches and opportunities at the intersection of quantum physics and biological sensing and imaging. During the workshop, there were some differences in how each speaker defined the term quantum. During one of the panels, Prem Kumar offered thoughts on what phenomena are classical versus quantum, explaining that techniques get progressively more quantum as you move from just having superposition to having superposition with measurement and entanglement. Another explanation from Clarice Aiello delineates the definition into several levels. This includes a base level of “quantum-ness,” which reflects that all matter is made of atoms, and when these particles are isolated they behave based on quantum mechanical principles. A second level is related to quantum coherence, where a single quantum object might be found in a coherent superposition state. A final level, which she described as the quantum-entangled level, involves multiple quantum systems which are entangled among themselves. Overall, the workshop touched on concepts such as superposition, entanglement, and squeezing and their potential implications for communication, computing, and simulation, in addition to the workshop’s main focal area, biological sensing and imaging. At the opening of the workshop, Thorsten Ritz of the University of California, Irvine, identified two questions at the heart of quantum biology: Is the machinery of life quantum mechanical, and can quantum mechanics be used to study the machinery of life in new ways? Participants highlighted systems in which researchers have explored these questions, from the vast array of molecular interactions involved in biological processes such as photosynthesis, to the mechanics involved in cellular functions such as differentiation and aggregation, to the role of oscillating magnetic fields in flight orientation among birds. Sensing and imaging technologies are crucial to biological research; these technologies could both enhance the study of quantum effects and be enhanced by quantum concepts. A critical challenge in biological research is to develop imaging and sensing tools that do not damage or interfere with the often fragile and fleeting systems being studied. Attendees discussed a variety of established and emerging technologies that could enhance noninvasive biological imaging, including single- and two-photon spectroscopy, single-molecule spectroscopy, quantum illumination, ghost imaging, and cryo-electron microscopy. One example came from Marlan Scully who gave a keynote address on the first day of the workshop. Scully emphasized the use of different laser technologies, which exhibit coherence and other quantum properties, in moving toward real-world biological applications, such as the detection of SARS-CoV-2. Both tools and theory will play an important role in advancing quantum biology research and applications. Several participants suggested theorists and experimentalists should work in tandem to understand and model biological processes. While physics often reduces systems to their simplest forms for fundamental insights, participants also noted the value of observing and understanding biological systems in all their “messiness,” capturing both the inner workings of biological systems and the complex interactions that occur within and between organisms. In discussions among participants, several attendees stressed the need to match emerging tools with the right scientific questions. Rather than developing quantum technologies as “a hammer looking for a nail,” participants emphasized a focus on exploring the problems these technologies are best suited to address. For example, it is important to consider the size of the phenomenon being studied, the timescales that are important in answering the scientific question, and other relevant considerations. Every tool along the spectrum from classical to quantum involves its own set of trade-offs. For example, Ted Laurence of the Lawrence Livermore National Laboratory said that quantum measurements, such as single photon counting, fluorescence transitions, and lasers, can take longer to produce the same results as classical measurements. These quantum measurements, however, do not require calibration and can enable new research questions to be answered. Prem Kumar, Northwestern University, noted that, despite their promise, quantum approaches should not be used simply for the sake of using quantum, especially in situations where classical approaches better meet the needs of the researcher. Understanding and applying quantum concepts could enable advances in a wide range of application areas including energy, synthetic biology, medicine, and sustainability. For example, Michelle O’Malley, University of California, Santa Barbara, described how improved noninvasive imaging approaches could help capture the complex interactions and functions involved in the breakdown of organic matter by microbial communities and lead to new technologies for capturing valuable products from plant waste. Several other participants discussed needs in tracking the movement of metabolites and molecules in microbial communities for insights into nutrient cycling in environments such as soil. Margaret Ahmad, Sorbonne University, discussed potential opportunities to leverage the magnetic properties of cryptochromes to advance new treatment approaches for diseases such as COVID-19 and cancer. Looking toward the future development of the field, participants discussed challenges to advancing quantum biology that arise from disciplinary disconnects between physicists and biologists. The siloing of academic research disciplines represents a significant barrier to progress. Disconnects in terminology, motivations and priorities, and structural barriers to collaborative work underscore the need for concerted efforts to bridge these divides. Attendees and speakers offered suggestions for resolving these divergences, establishing a shared language, moving the field forward, and fostering meaningful feedback between disciplines. Overall, participants stressed a need for balance, open communication, collaboration, unity, and clear dialogue on trade-offs between quantum and classical approaches. Keiko Torii, The University of Texas at Austin, said that the best collaborations happen when the project provides mutual advantages that can show off everyone’s talents, each team finds the work interesting, and partners develop a camaraderie to pursue new knowledge. To enable near- and long-term opportunities in this space, participants suggested that exploratory, high-risk funding could improve existing instrumentation to explore quantum enhancement collaboratively. They also emphasized the need for collaboration between quantum physicists and sensing/imaging scientists, which could be advanced through a dedicated quantum biology investigator program. People, even more than technology, will be crucial to the future of quantum biology. Participants explored training, education, and workforce needs to further develop this burgeoning field and cultivate the next generation of scientists. While many programs are still in their nascent stages, participants highlighted examples of approaches and programs being developed at various types of institutions to engage students and professional scientists in quantum biology research. Several participants stressed the need for an inclusive approach, spanning disciplines as well as communities to foster a diverse field fueled by the intellectual contributions of a wide range of people, including historically under-resourced schools and students. To increase awareness and excitement about quantum physics and related areas of biology, attendees suggested capitalizing on the “buzz” around quantum. Several participants emphasized the need to start early, introducing students to quantum concepts and their appealing “weirdness” in K–12 education. Engaging students early—before they become entrenched in traditional disciplinary siloes as typically happens in graduate school—could help to galvanize interest in the area and foster a generation of scientists with the interdisciplinary mindset and skills needed to advance this interdisciplinary field. While these efforts could be advanced at many levels and across multiple sectors, several participants suggested a national quantum biology center could be a valuable hub to coordinate and support quantum biology education and workforce development across academia, industry, and government.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Sequential Image Recovery Using Joint Hierarchical Bayesian Learning

Abstract Recovering temporal image sequences (videos) based on indirect, noisy, or incomplete data is an essential yet challenging task. We specifically consider the case where each data set is missing vital information, which prevents the accurate recovery of the individual images. Although some recent (variational) methods have demonstrated high-resolution image recovery based on jointly recovering sequential images, there remain robustness issues due to parameter tuning and restrictions on the type of sequential images. Here, we present a method based on hierarchical Bayesian learning for the joint recovery of sequential images that incorporates prior intra- and inter-image information. Our method restores the missing information in each image by “borrowing” it from the other images. More precisely, we couple sequential images by penalizing their pixel-wise difference. The corresponding penalty terms (one for each pixel and pair of subsequent images) are treated as weakly-informative random variables that favor small pixel-wise differences but allow occasional outliers. As a result, all of the individual reconstructions yield improved accuracy. Our method can be used for various data acquisitions and allows for uncertainty quantification. Some preliminary results indicate its potential use for sequential deblurring and magnetic resonance imaging.

Xiao, Yao↗
DOE OSTI2021

Anisotropic neutron response of trans-stilbene and impact on a handheld dual particle imager

Here this manuscript details measurements of the anisotropic light-output response of trans-stilbene, henceforth referred to as stilbene, along the three primary crystal planes and analyzes how this anisotropic response impacts neutron image reconstruction in a handheld dual particle imager (H2DPI). A prototype H2DPI composed of stilbene pillars (6 x 6 x 50 mm 3 ) coupled to silicon photomultipliers was built and is capable of imaging both fast neutrons and gamma rays from kilogram quantities of special nuclear material. Stilbene was chosen as the scintillating medium for the imager because of its pulse shape discrimination capability, time resolution and relatively high light output. A drawback to using stilbene, however, is the anisotropic response. A recoiling proton from a neutron elastic-scattering event in stilbene will yield different amounts of scintillation light depending on the direction of the recoiling proton with respect to the crystal lattice. This manuscript analyzes how this anisotropic response impacts neutron image reconstruction in 4π. The light output in the three primary crystal planes of stilbene were independently measured 6–7 times for proton recoil energies ranging from 0.5–5.0 MeV using a quasi-monoenergetic time-of-flight neutron source. The measured light-output data in the three crystal planes were fit with a semi-empirical function based on Birks’ formula. These fits were used to reconstruct the location of a 252 Cf source in front of the imager (0°, -0.8°), to the left of the imager (-90°, -0.8°) and directly above the imager (0°, 90°) to determine if it is necessary to apply the directionally-dependent response of stilbene to accurately reconstruct source locations. A bootstrapping technique was applied to the measured data sets to produce 1000 images composed of 2000 cone projections for each source location and each measured light-output curve. List-mode maximum likelihood expectation maximization was applied to each image; the highest pixel location and the full width at half maximum (FWHM) were then recorded. The average and standard deviations of these parameters were taken for each set of images. The maximum difference in the average azimuthal pixel location when varying between the appropriate and incorrect light-output curves for the source locations at (0°, -0.8°) and (-90°, -0.8°) were respectively found to be 1.85 ± 1.39° and 2.03 ± 1.78°. All other pixel locations and FWHMs were within a single standard deviation of uncertainty. Taken together, the anisotropic response of stilbene has negligible impact on the neutron image reconstruction capability of the H2DPI.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

A unified large language model–based framework for heterogeneous PV image diagnosis

With advances in imaging technologies, modern photovoltaic (PV) systems generate large volumes of heterogeneous image data, including visible, electroluminescence (EL), and infrared (IR) images. Existing PV image analysis models, particularly deep learning approaches, are typically task-specific and lack cross-modality generalization. To address this limitation, this paper proposes an open-source large language model (LLM)–based unified framework for heterogeneous PV image diagnostics. Through task-aware diagnostic prompting, the framework enables analysis of visible, EL, and IR images within a single pipeline, supporting both zero-shot and few-shot inference and binary and multiclass classification. It is compatible with state-of-the-art multimodal LLMs, including ChatGPT, Gemini, Claude, Qwen, and CLIP. The framework is evaluated on PV module condition classification (clean, soiling, snow, hail, and bird droppings) using visible images, cell crack detection using EL images, and hotspot detection using IR images. GPT-5.1 in few-shot mode achieves the best performance, with classification accuracy exceeding 97.3%. Open-source models such as Qwen and CLIP also deliver competitive results on visible images (around 90% accuracy), though their performance is more limited on EL and IR modalities. On the full ELPV dataset, the framework achieves 83.5% zero-shot accuracy, within 2.8% of the supervised CNN baseline, confirming scalability to larger benchmarks. Practical aspects such as reproducibility, response latency, and confidence estimation are systematically analyzed. The framework operates across PV image modalities without modality- or task-specific training, making it well suited as a rapid pre-screening tool to support downstream detailed diagnostics. A benchmark dataset of diverse labeled PV images is also released.

Li, Baojie↗
DOE OSTI2022

Deblurring galaxy images with Tikhonov regularization on magnitude domain

Abstract We propose a regularization-based deblurring method that works efficiently for galaxy images. The spatial resolution of a ground-based telescope is generally limited by seeing conditions and is much worse than space-based telescopes. This circumstance has generated considerable research interest in the restoration of spatial resolution. Since image deblurring is a typical inverse problem and often ill-posed, solutions tend to be unstable. To obtain a stable solution, much research has adopted regularization-based methods for image deblurring, but the regularization term is not necessarily appropriate for galaxy images. Although galaxies have an exponential or Sérsic profile, the conventional regularization assumes the image profiles to behave linearly in space. The significant deviation between the assumption and real situations leads to blurring of the images and smoothing out the detailed structures. Clearly, regularization on logarithmic domain, i.e., magnitude domain, should provide a more appropriate assumption, which we explore in this study. We formulate a problem of deblurring galaxy images by an objective function with a Tikhonov regularization term on a magnitude domain. We introduce an iterative algorithm minimizing the objective function with a primal–dual splitting method. We investigate the feasibility of the proposed method using simulation and observation images. In the simulation, we blur galaxy images with a realistic point spread function and add both Gaussian and Poisson noise. For the evaluation with the observed images, we use galaxy images taken by the Subaru HSC-SSP. Both of these evaluations show that our method successfully recovers the spatial resolution of the deblurred images and significantly outperforms the conventional methods. The code is publicly available from the GitHub 〈https://github.com/kzmurata-astro/PSFdeconv_amag〉.

Murata, Kazumi↗
DOE OSTI2025

Mask-side Hyper-NA EUV imaging on the SHARP microscope

Hyper-NA, the prospective successor to high-numerical aperture (NA) extreme ultraviolet lithography (EUVL) could be inserted soon after 2030. Hyper-NA poses a number of challenges, including reduced depth of focus, amplified mask three-dimensional effects, and increased mask-side angular range. A Hyper-NA capable extreme ultraviolet (EUV) mask-imaging tool can address these challenges and accelerate research and development toward Hyper-NA. The Sharp High-Numerical Aperture Actinic Reticle Review Project (SHARP) EUV mask microscope is supporting mask-side high-NA imaging since 2015. Implementing mask-side Hyper-NA imaging in 2024 enables research and development toward the corresponding nodes of EUVL. Hyper-NA zoneplates at 0.75 4x/8x NA with a 6.7-deg chief ray angle and 0.85 4x/8x NA with a 7.4-deg chief ray angle are added to the SHARP microscope. Imaging at mask-side Hyper-NA is demonstrated. Imaging of 5-nm half-pitch (wafer scale) horizontal lines and spaces is demonstrated using dipole illumination. Imaging of 5-nm half-pitch (wafer scale) vertical lines and spaces is demonstrated using frequency-doubled imaging of 40-nm hp (mask scale) lines and spaces. Normalized image log slope (NILS) and modulation of Hyper-NA image data match closely to simulations for horizontal lines and spaces. A reduction in NILS of 0.3 or less is observed for vertical lines and spaces in the two-beam imaging regime. Through-focus image data are discussed, comparing different dipole sources and mask-side NAs. Mask-side Hyper-NA photomask imaging has been implemented and demonstrated on the SHARP microscope and is now available to users of the instrument.

Benk, Markus↗
DOE OSTI2023

Multi-Task Learning of Scanning Electron Microscopy and Synthetic Thermal Tomography Images for Detection of Defects in Additively Manufactured Metals

One of the key challenges in laser powder bed fusion (LPBF) additive manufacturing of metals is the appearance of microscopic pores in 3D-printed metallic structures. Quality control in LPBF can be accomplished with non-destructive imaging of the actual 3D-printed structures. Thermal tomography (TT) is a promising non-contact, non-destructive imaging method, which allows for the visualization of subsurface defects in arbitrary-sized metallic structures. However, because imaging is based on heat diffusion, TT images suffer from blurring, which increases with depth. We have been investigating the enhancement of TT imaging capability using machine learning. In this work, we introduce a novel multi-task learning (MTL) approach, which simultaneously performs the classification of synthetic TT images, and segmentation of experimental scanning electron microscopy (SEM) images. Synthetic TT images are obtained from computer simulations of metallic structures with subsurface elliptical-shaped defects, while experimental SEM images are obtained from imaging of LPBF-printed stainless-steel coupons. MTL network is implemented as a shared U-net encoder between the classification and the segmentation tasks. Results of this study show that the MTL network performs better in both the classification of synthetic TT images and the segmentation of SEM images tasks, as compared to the conventional approach when the individual tasks are performed independently of each other.

36 MATERIALS SCIENCE↗
NASA NTRS1991

Image retrieval and processing system version 2.0 development work

The Image Retrieval and Processing System (IRPS) is a software package developed at Washington University and used by the NASA Regional Planetary Image Facilities (RPIF's). The IRPS combines data base management and image processing components to allow the user to examine catalogs of image data, locate the data of interest, and perform radiometric and geometric calibration of the data in preparation for analysis. Version 1.0 of IRPS was completed in Aug. 1989 and was installed at several IRPS's. Other RPIF's use remote logins via NASA Science Internet to access IRPS at Washington University. Work was begun on designing and population a catalog of Magellan image products that will be part of IRPS Version 2.0, planned for release by the end of calendar year 1991. With this catalog, a user will be able to search by orbit and by location for Magellan Basic Image Data Records (BIDR's), Mosaicked Image Data Records (MIDR's), and Altimetry-Radiometry Composite Data Records (ARCDR's). The catalog will include the Magellan CD-ROM volume, director, and file name for each data product. The image processing component of IRPS is based on the Planetary Image Cartography Software (PICS) developed by the U.S. Geological Survey, Flagstaff, Arizona. To augment PICS capabilities, a set of image processing programs were developed that are compatible with PICS-format images. This software includes general-purpose functions that PICS does not have, analysis and utility programs for specific data sets, and programs from other sources that were modified to work with PICS images. Some of the software will be integrated into the Version 2.0 release of IRPS. A table is presented that lists the programs with a brief functional description of each.

Slavney, Susan H.↗
NASA NTRS1999

Fidelity Analysis of Sampled Imaging Systems

Many modeling, simulation and performance analysis studies of sampled imaging systems are inherently incomplete because they are conditioned on a discrete-input, discrete-output model that only accounts for blurring during image acquisition and additive noise. For those sampled imaging systems where the effects of digital image acquisition, digital filtering and reconstruction are significant, the modeling, simulation and performance analysis should be based on a more comprehensive continuous-input, discrete-processing, continuous-output end-to-end model. This more comprehensive model should properly account for the low-pass filtering effects of image acquisition prior to sampling, the potentially important noiselike effects of the aliasing caused by sampling, additive noise due to device electronics and quantization, the generally high-boost filtering effects of digital processing, and the low-pass filtering effects of image reconstruction. This model should not, however, be so complex as to preclude significant mathematical analysis, particularly the mean-square (fidelity) type of analysis so common in linear system theory. We demonstrate that, although the mathematics of such a model is more complex, the increase in complexity is not so great as to prevent a complete fidelity-metric analysis at both the component level and at the end-to-end system level: that is, computable mean-square-based fidelity metrics are developed by which both component-level and system-level performance can be quantified. In addition, we demonstrate that system performance can be assessed qualitatively by visualizing the output image as the sum of three component images, each of which relates to a corresponding fidelity metric. The cascaded, or filtered, component accounts for the end-to-end system filtering of image acquisition, digital processing, and image reconstruction; the random noise component accounts for additive random noise, modulated by digital processing and image reconstruction filtering; and the aliased noise component accounts for the frequency folding effect of sampling, modulated by digital processing and image reconstruction filtering.

Park, Stephen K.↗
NASA NTRS2001

Normal and abnormal tissue identification system and method for medical images such as digital mammograms

A system and method for analyzing a medical image to determine whether an abnormality is present, for example, in digital mammograms, includes the application of a wavelet expansion to a raw image to obtain subspace images of varying resolution. At least one subspace image is selected that has a resolution commensurate with a desired predetermined detection resolution range. A functional form of a probability distribution function is determined for each selected subspace image, and an optimal statistical normal image region test is determined for each selected subspace image. A threshold level for the probability distribution function is established from the optimal statistical normal image region test for each selected subspace image. A region size comprising at least one sector is defined, and an output image is created that includes a combination of all regions for each selected subspace image. Each region has a first value when the region intensity level is above the threshold and a second value when the region intensity level is below the threshold. This permits the localization of a potential abnormality within the image.

Heine, John J.↗
NASA NTRS2008

Second Harmonic Imaging improves Echocardiograph Quality on board the International Space Station

Ultrasound (US) capabilities have been part of the Human Research Facility (HRF) on board the International Space Station (ISS) since 2001. The US equipment on board the ISS includes a first-generation Tissue Harmonic Imaging (THI) option. Harmonic imaging (HI) is the second harmonic response of the tissue to the ultrasound beam and produces robust tissue detail and signal. Since this is a first-generation THI, there are inherent limitations in tissue penetration. As a breakthrough technology, HI extensively advanced the field of ultrasound. In cardiac applications, it drastically improves endocardial border detection and has become a common imaging modality. U.S. images were captured and stored as JPEG stills from the ISS video downlink. US images with and without harmonic imaging option were randomized and provided to volunteers without medical education or US skills for identification of endocardial border. The results were processed and analyzed using applicable statistical calculations. The measurements in US images using HI improved measurement consistency and reproducibility among observers when compared to fundamental imaging. HI has been embraced by the imaging community at large as it improves the quality and data validity of US studies, especially in difficult-to-image cases. Even with the limitations of the first generation THI, HI improved the quality and measurability of many of the downlinked images from the ISS and should be an option utilized with cardiac imaging on board the ISS in all future space missions.

Garcia, Kathleen↗
NASA NTRS2008

Model of Image Artifacts from Dust Particles

A mathematical model of image artifacts produced by dust particles on lenses has been derived. Machine-vision systems often have to work with camera lenses that become dusty during use. Dust particles on the front surface of a lens produce image artifacts that can potentially affect the performance of a machine-vision algorithm. The present model satisfies a need for a means of synthesizing dust image artifacts for testing machine-vision algorithms for robustness (or the lack thereof) in the presence of dust on lenses. A dust particle can absorb light or scatter light out of some pixels, thereby giving rise to a dark dust artifact. It can also scatter light into other pixels, thereby giving rise to a bright dust artifact. For the sake of simplicity, this model deals only with dark dust artifacts. The model effectively represents dark dust artifacts as an attenuation image consisting of an array of diffuse darkened spots centered at image locations corresponding to the locations of dust particles. The dust artifacts are computationally incorporated into a given test image by simply multiplying the brightness value of each pixel by a transmission factor that incorporates the factor of attenuation, by dust particles, of the light incident on that pixel. With respect to computation of the attenuation and transmission factors, the model is based on a first-order geometric (ray)-optics treatment of the shadows cast by dust particles on the image detector. In this model, the light collected by a pixel is deemed to be confined to a pair of cones defined by the location of the pixel s image in object space, the entrance pupil of the lens, and the location of the pixel in the image plane (see Figure 1). For simplicity, it is assumed that the size of a dust particle is somewhat less than the diameter, at the front surface of the lens, of any collection cone containing all or part of that dust particle. Under this assumption, the shape of any individual dust particle artifact is the shape (typically, circular) of the aperture, and the contribution of the particle to the attenuation factor for a given pixel is the fraction of the cross-sectional area of the collection cone occupied by the particle. Assuming that dust particles do not overlap, the net transmission factor for a given pixel is calculated as one minus the sum of attenuation factors contributed by all dust particles affecting that pixel. In a test, the model was used to synthesize attenuation images for random distributions of dust particles on the front surface of a lens at various relative aperture (F-number) settings. As shown in Figure 2, the attenuation images resembled dust artifacts in real test images recorded while the lens was aimed at a white target.

Willson, Reg↗
NASA NTRS2010

Optimal Compression of Floating-Point Astronomical Images Without Significant Loss of Information

We describe a compression method for floating-point astronomical images that gives compression ratios of 6 - 10 while still preserving the scientifically important information in the image. The pixel values are first preprocessed by quantizing them into scaled integer intensity levels, which removes some of the uncompressible noise in the image. The integers are then losslessly compressed using the fast and efficient Rice algorithm and stored in a portable FITS format file. Quantizing an image more coarsely gives greater image compression, but it also increases the noise and degrades the precision of the photometric and astrometric measurements in the quantized image. Dithering the pixel values during the quantization process greatly improves the precision of measurements in the more coarsely quantized images. We perform a series of experiments on both synthetic and real astronomical CCD images to quantitatively demonstrate that the magnitudes and positions of stars in the quantized images can be measured with the predicted amount of precision. In order to encourage wider use of these image compression methods, we have made available a pair of general-purpose image compression programs, called fpack and funpack, which can be used to compress any FITS format image.

Pence, William D.↗
NASA NTRS2010

Reconstituted Three-Dimensional Interactive Imaging

A method combines two-dimensional images, enhancing the images as well as rendering a 3D, enhanced, interactive computer image or visual model. Any advanced compiler can be used in conjunction with any graphics library package for this method, which is intended to take digitized images and virtually stack them so that they can be interactively viewed as a set of slices. This innovation can take multiple image sources (film or digital) and create a "transparent" image with higher densities in the image being less transparent. The images are then stacked such that an apparent 3D object is created in virtual space for interactive review of the set of images. This innovation can be used with any application where 3D images are taken as slices of a larger object. These could include machines, materials for inspection, geological objects, or human scanning. Illuminous values were stacked into planes with different transparency levels of tissues. These transparency levels can use multiple energy levels, such as density of CT scans or radioactive density. A desktop computer with enough video memory to produce the image is capable of this work. The memory changes with the size and resolution of the desired images to be stacked and viewed.

Hamilton, Joseph↗