Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “imaging and visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Bioimaging Science Program: 2022 Principal Investigator Meetings Proceedings

The mission of the U.S. Department of Energy’s (DOE) Biological and Environmental Research (BER) program’s Bioimaging Science Program (BSP) is to understand the translation of genomic information into the mechanisms that power living cells, communities of cells, and whole organisms. The goal of BSP is to develop new imaging and measurement technologies to visualize the spatial and temporal relationships of key metabolic processes governing phenotypic expression in plants and microbes. The extended goal of dynamic imaging is to functionally connect cellular components and interdependent organisms. Information about the time and place of chemical reactions in situ can identify causal relationships between biological activators and downstream effectors. BSP held its annual PI meeting virtually February 28–March 1. Contributing investigators are convened to review progress and current state-of-the-art bioimaging research. Holding the 2022 BSP meeting as part of the broader Genomic Science Program (GSP) PI meeting allowed researchers to interact with the extended GSP community. This convergence provided a platform for networking and exchange of ideas with experts in other technologies and in target BSP application areas, helping to forge new multidisciplinary collaborations among investigators from the sister programmatic areas within BER’s Biological Systems Science Division. An important highlight of the BSP meeting was the keynote presentation by Nobel Laureate Dr. Joachim Frank on Time-Resolved Macromolecular Imaging using Cryo-EM. He discussed microfluidic mixing and fast freezing to capture nonequilibrium intermediate states during molecular binding and conformational changes. The action of molecular machines can be captured at nanometer resolution and millisecond discrimination. BSP PIs made presentations describing their research focus and progress in plenary sessions on bioimaging science and on quantum-enabled bioimaging science research projects. BSP research at universities and DOE laboratories is presented in this report. A final discussion of the BSP was organized by meeting plenary session chairs, who prepared the following Executive Summary of current BSP research, research challenges, future opportunities, and potential ideas for expanding the BSP’s impact and interactions.

59 BASIC BIOLOGICAL SCIENCES↗

Non-invasive assessment of otolith formation during development of the Japanese red-bellied newt, Cynops pyrrhogaster

Pre-mated adult female newts and embryos have been flown on the International Microgravity Laboratory-2 (IML-2) Space Shuttle flight in 1994 (Wiederhold et al., 1992b). With the specimens available from this flight, the calcification of otoliths, ulna, radius and backbone of the flown larvae and adult newts were analyzed. The experiments presented here studied the development of the otoliths on the ground. Otoliths of living newts, from embryo to adult, were observed in situ with the application of a new X-ray and bio-imaging analyzer system. For the establishment of this method, newts at different developmental stages were used. An imaging plate temporarily stores the X-ray energy pattern at the bio-imaging analyzer. A latent image on the imaging plate was transformed into a digital time series signal with an image reader. Acquired digital information was computed with the image processor. The processed information was recorded on film with an image recorder, in order to visualize it on an enlargement computed radiograph. To analyze development of the otoliths, photo-stimulated luminescence level was detected by an image analyzer, using transmitted X-ray photons. A single clump of otoconia could first be seen at stage 33. Stage-36 embryos first have distinguishable otoliths, with the utricle in front and saccule behind. Our results show that this X-ray method detects the otoliths equally as well as sectioning. In the newt, the mandibular/maxillary bone formed before the spine. It is suspected that for the newt embryo, living in water, feeding becomes necessary prior to support of the body.

NASA Discipline Neuroscience↗

Improvements and Additions to NASA Near Real-Time Earth Imagery

For many years, the NASA Global Imagery Browse Services (GIBS) has worked closely with the Land, Atmosphere Near real-time Capability for EOS (Earth Observing System) (LANCE) system to provide near real-time imagery visualizations of AIRS (Atmospheric Infrared Sounder), MLS (Microwave Limb Sounder), MODIS (Moderate Resolution Imaging Spectrometer), OMI (Ozone Monitoring Instrument), and recently VIIRS (Visible Infrared Imaging Radiometer Suite) science parameters. These visualizations are readily available through standard web services and the NASA Worldview client. Access to near real-time imagery provides a critical capability to GIBS and Worldview users. GIBS continues to focus on improving its commitment to providing near real-time imagery for end-user applications. The focus of this presentation will be the following completed or planned GIBS system and imagery enhancements relating to near real-time imagery visualization.

near real time↗

Enhanced rock discrimination using Landsat-5 Thematic Mapper (TM) data

The application of TM data to rock discrimination is discussed. Sixteen specific terrains derived from geologic maps are examined on TM images of the Arabian shield obtained on Apr. 14, 1984; visual enhancement procedures are applied to the images. The rock types observed in the test site are described; the major sedimentary formations in the test area are laterite and sandstone. The data reveal that the layered rocks in the outcrop consist of a variety of metamorphosed volcanics, metamorphosed sediments, and amphibolite, and the intrusive complex is composed of several classes of mafic and acidic rocks.

Blodget, H. W.↗

Weighted feature selection criteria for visual servoing of a telerobot

Because of the continually changing environment of a space station, visual feedback is a vital element of a telerobotic system. A real time visual servoing system would allow a telerobot to track and manipulate randomly moving objects. Methodologies for the automatic selection of image features to be used to visually control the relative position between an eye-in-hand telerobot and a known object are devised. A weighted criteria function with both image recognition and control components is used to select the combination of image features which provides the best control. Simulation and experimental results of a PUMA robot arm visually tracking a randomly moving carburetor gasket with a visual update time of 70 milliseconds are discussed.

Feddema, John T.↗

Fluid Flow Observations of The Spray Near-Field Using High-Speed X-Ray Imaging

Sprays are important to may industrial processes, but the near-field region where spray formation takes place is difficult to visualize and characterize through visible light imaging because this region is typically optically dense. X-ray imaging is one technique that can penetrate this optically dense region and provide unique observations of the spray formation process. This study uses high-speed white beam X-ray imaging conducted at the Advanced Photon Source to capture spray formation dynamics from a canonical airblast atomizer. In this work, a range of momentum flux ratios are visualized by varying the gas flow rate while the liquid flow rate is held constant. The use of X-rays show overlapping flow structures including bags, ligaments, mushrooms, and webs. Air bubbles are captured within the liquid regions, and a very dynamic crown forms at the liquid needle exit at higher momentum flux ratios. Finally, at the highest momentum flux ratios, air bubbles and liquid droplets are observed migrating upstream in the center of the crown, and this motion is attributed to a toroidal recirculation cell at the nozzle exit.

47 OTHER INSTRUMENTATION↗

Thirteen ways to say nothing with scientific visualization

Scientific visualization can be used to produce very beautiful images. Frequently, users and others not properly initiated into mysteries of visualization research fail to appreciate the artistic qualities of these images. Scientists will frequently use our work to needlessly understand the data from which it is derived. This paper describes a number of effective techniques to confound such pernicious activity.

Globus, AL↗

Comparing Deep Learning Approaches for Understanding Genotype × Phenotype Interactions in Biomass Sorghum

We explore the use of deep convolutional neural networks (CNNs) trained on overhead imagery of biomass sorghum to ascertain the relationship between single nucleotide polymorphisms (SNPs), or groups of related SNPs, and the phenotypes they control. We consider both CNNs trained explicitly on the classification task of predicting whether an image shows a plant with a reference or alternate version of various SNPs as well as CNNs trained to create data-driven features based on learning features so that images from the same plot are more similar than images from different plots, and then using the features this network learns for genetic marker classification. We characterize how efficient both approaches are at predicting the presence or absence of a genetic markers, and visualize what parts of the images are most important for those predictions. We find that the data-driven approaches give somewhat higher prediction performance, but have visualizations that are harder to interpret; and we give suggestions of potential future machine learning research and discuss the possibilities of using this approach to uncover unknown genotype × phenotype relationships.

Zhang, Zeyu↗

Visualizing Intrinsic 3D-Strain Distribution in Gold Coated ZnO Microstructures by Bragg Coherent X-Ray Diffraction Imaging and Transmission Electron Microscopy with Respect to Piezotronic Applications

Novel devices ranging from bio magnetic field sensors to energy harvesting nano machines utilize the piezotronic effect. For optimal function, understanding the interaction of electrical and strain phenomena within the semiconductor crystal is necessary. Here, studies of a model piezotronic system are presented, consisting of a ZnO microrod coated by a thin layer of gold, which forms a Schottky contact with the piezoelectric ZnO material. Coherent X-ray diffraction imaging (CXDI) and transmission electron microscopy (TEM) are used to visualize the structure and strain distribution, showing that the ZnO microrod exhibits strains of multiple origins in the bulk and at the interface. Strain values of -6 × 10 -4 have been measured by CXDI at the ZnO/Au interface. The origin is shown to be a combination of an interface strain, possibly caused by the Schottky contact formation, and distinct, localized electrical fields inside the crystal which are assigned to electron depletion and screening in a bent ZnO/Au piezotronic rod. These findings will contribute to sensor development and to a better understanding of piezotronic applications.

36 MATERIALS SCIENCE↗

Report on New Mission Concept Study: Stereo X-Ray Corona Imager Mission

Studies of the three-dimensional structure and dynamics of the solar corona have been severely limited by the constraint of single viewpoint observations. The Stereo X-Ray Coronal Imager (SXCI) mission will send a single instrument, an X-ray telescope, into deep space expressly to record stereoscopic images of the solar corona. The SXCI spacecraft will be inserted into a approximately 1 AU heliocentric orbit leading Earth by approximately 25 deg at the end of nine months. The SXCI X-ray telescope forms one element of a stereo pair, the second element being an identical X-ray telescope in Earth orbit placed there as part of the NOAA GOES program. X-ray emission is a powerful diagnostic of the corona and its magnetic fields, and three dimensional information on the coronal magnetic structure would be obtained by combining the data from the two X-ray telescopes. This information can be used to address the major solar physics questions of (1) what causes explosive coronal events such as coronal mass ejections (CMEs), eruptive flares and prominence eruptions and (2) what causes the transient heating of coronal loops. Stereoscopic views of the optically thin corona will resolve some ambiguities inherent in single line-of-sight observations. Triangulation gives 3D solar coordinates of features which can be seen in the simultaneous images from both telescopes. As part of this study, tools were developed for determining the 3D geometry of coronal features using triangulation. Advanced technologies for visualization and analysis of stereo images were tested. Results of mission and spacecraft studies are also reported.

Liewer, Paulett C.↗

Reconfigurable Image Generator

A RiG may simulate visual conditions of a real world environment, and generate the necessary amount of pixels in a visual simulation at rates up to 120 frames per second. RiG may also include a database generation system capable of producing visual databases suitable to drive the visual fidelity required by the RiG.

Archdeacon, John L.↗

AE (Acoustic Emission) for Flip-Chip CGA/FCBGA Defect Detection

C-mode scanning acoustic microscopy (C-SAM) is a nondestructive inspection technique that uses ultrasound to show the internal feature of a specimen. A very high or ultra-high-frequency ultrasound passes through a specimen to produce a visible acoustic microimage (AMI) of its inner features. As ultrasound travels into a specimen, the wave is absorbed, scattered or reflected. The response is highly sensitive to the elastic properties of the materials and is especially sensitive to air gaps. This specific characteristic makes AMI the preferred method for finding "air gaps" such as delamination, cracks, voids, and porosity. C-SAM analysis, which is a type of AMI, was widely used in the past for evaluation of plastic microelectronic circuits, especially for detecting delamination of direct die bonding. With the introduction of the flip-chip die attachment in a package; its use has been expanded to nondestructive characterization of the flip-chip solder bumps and underfill. Figure 1.1 compares visual and C-SAM inspection approaches for defect detection, especially for solder joint interconnections and hidden defects. C-SAM is specifically useful for package features like internal cracks and delamination. C-SAM not only allows for the visualization of the interior features, it has the ability to produce images on layer-by-layer basis. Visual inspection; however, is only superior to C-SAM for the exposed features including solder dewetting, microcracks, and contamination. Ideally, a combination of various inspection techniques - visual, optical and SEM microscopy, C-SAM, and X-ray - need to be performed in order to assure quality at part, package, and system levels. This reports presents evaluations performed on various advanced packages/assemblies, especially the flip-chip die version of ball grid array/column grid array (BGA/CGA) using C-SAM equipment. Both external and internal equipment was used for evaluation. The outside facility provided images of the key features that could be detected using the most advanced C-SAM equipment with a skilled operator. Investigation continued using in-house equipment with its limitations. For comparison, representative X-rays of the assemblies were also gathered to show key defect detection features of these non-destructive techniques. Key images gathered and compared are: Compared the images of 2D X-ray and C-SAM for a plastic LGA assembly showing features that could be detected by either NDE technique. For this specific case, X-ray was a clear winner. Evaluated flip-chip CGA and FCBGA assemblies with and without heat sink by C-SAM. Only the FCCGA package that had no heat sink could be fully analyzed for underfill and bump quality. Cross-sectional microscopy did not revealed peripheral delamination features detected by C-SAM. Analyzed a number of fine pitch PBGA assemblies by C-SAM. Even though the internal features of the package assemblies could be detected, C-SAM was unable to detect solder joint failure at either the package or board level. Twenty times touch ups by solder iron with 700degF tip temperature, each with about 5 second duration, did not induce defects to be detected by C-SAM images. Other techniques need to be considered to induce known defects for characterization. Given NASA's emphasis on the use of microelectronic packages and assemblies and quality assurance on workmanship defect detection, understanding key features of various inspection systems that detect defects in the early stages of package and assembly is critical to developing approaches that will minimize future failures. Additional specific, tailored non-destructive inspection approaches could enable low-risk insertion of these advanced electronic packages having hidden and fine features.

Ghaffarian, Reza↗

Automated phase segmentation and quantification of high-resolution TEM image for alloy design

In the alloy design and development process, a wealth of atomically resolved structural high-resolution transmission electron microscopy (HRTEM) images are produced. Identifying the different nano-precipitate phases and tracking their evolution under various compositions and during manufacturing or post-processing requires hundreds of HRTEM images and thousands of precipitates. The nanoscopic phase information labeling and analysis purely relies on humans are prohibitively costly and time-consuming, sometimes not reliable because of the lack of authoritative knowledge. Here, in this work, we develop a novel unsupervised machine learning approach coupled with adaptive computer vision techniques with features in the Fourier space to automatically determine the number of phases and segment/quantify the phases with nanoscale resolution, allowing for quantitative correlation between nanostructure formation, processing and functional properties. To automate the phase extraction/quantification and ascertain its applicability, we have applied the developed framework to the HRTEM images from several alloy systems, processing conditions, image magnifications, and phase types and morphologies (precipitates, nano-twins, stacking faults, crystalline matrix, and amorphous structures) for verification. This study paves the road for compression, visualization, and translation of raw image structural data into physically relevant information in real-time with minimal human supervision. It shows the promise of enabling high-throughput materials characterization for the acceleration of alloy manufacturing and design.

36 MATERIALS SCIENCE↗

Airfoil transition and separation studies using an infrared imaging system

An infrared imaging system was used to detect the thermal signature of boundary-layer flow regimes on a NACA 0012 airfoil from zero angle of attack up to separation. The boundary-layer transition from laminar to turbulent flow and the onset of separation could be seen on the airfoil thermograms. The findings were compared against the behavior of aluminum foil tufts observable both visually and with the infrared imaging system. This arrangement offers the option of using the infrared imaging system both for flow regime detection through surface thermography and flow visualization by the aluminum foil tufts. Ultimately the surface temperature changes due to variation in the angle of attack of a lifting surface provide a means for interpretation of the boundary-layer flow regimes.

Gartenberg, Ehud↗

Perceptual Image Compression in Telemedicine

The next era of space exploration, especially the "Mission to Planet Earth" will generate immense quantities of image data. For example, the Earth Observing System (EOS) is expected to generate in excess of one terabyte/day. NASA confronts a major technical challenge in managing this great flow of imagery: in collection, pre-processing, transmission to earth, archiving, and distribution to scientists at remote locations. Expected requirements in most of these areas clearly exceed current technology. Part of the solution to this problem lies in efficient image compression techniques. For much of this imagery, the ultimate consumer is the human eye. In this case image compression should be designed to match the visual capacities of the human observer. We have developed three techniques for optimizing image compression for the human viewer. The first consists of a formula, developed jointly with IBM and based on psychophysical measurements, that computes a DCT quantization matrix for any specified combination of viewing distance, display resolution, and display brightness. This DCT quantization matrix is used in most recent standards for digital image compression (JPEG, MPEG, CCITT H.261). The second technique optimizes the DCT quantization matrix for each individual image, based on the contents of the image. This is accomplished by means of a model of visual sensitivity to compression artifacts. The third technique extends the first two techniques to the realm of wavelet compression. Together these two techniques will allow systematic perceptual optimization of image compression in NASA imaging systems. Many of the image management challenges faced by NASA are mirrored in the field of telemedicine. Here too there are severe demands for transmission and archiving of large image databases, and the imagery is ultimately used primarily by human observers, such as radiologists. In this presentation I will describe some of our preliminary explorations of the applications of our technology to the special problems of telemedicine.

Watson, Andrew B.↗

Low-speed flowfield characterization by infrared measurements of surface temperatures

An experimental program was aimed at identifying areas in low speed aerodynamic research where infrared imaging systems can make significant contributions. Implementing a new technique, a long electrically heated wire was placed across a laminar jet. By measuring the temperature distribution along the wire with the IR imaging camera, the flow behavior was identified. Furthermore, using Nusselt number correlations, the velocity distribution could be deduced. The same approach was used to survey wakes behind cylinders in a wind-tunnel. This method is suited to investigate flows with position dependent velocities, e.g., boundary layers, confined flows, jets, wakes, and shear layers. It was found that the IR imaging camera cannot accurately track high gradient temperature fields. A correlation procedure was devised to account for this limitation. Other wind-tunnel experiments included tracking the development of the laminar boundary layer over a warmed flat plate by measuring the chordwise temperature distribution. This technique was applied also to the flow downstream from a rearward facing step. Finally, the IR imaging system was used to study boundary layer behavior over an airfoil at angles of attack from zero up to separation. The results were confirmed with tufts observable both visually and with the IR imaging camera.

Gartenberg, E.↗

Attitude and position estimation on the Mars Exploration Rovers

NASA/JPL 's Mars Exploration Rovers acquire their attitude upon command and autonomously propagate their attitude and position. The rovers use accelerometers and images of the sun to acquire attitude, autonomously searching the sky for the sun with a pointable camera. To propagate the attitude and position the rovers use either accelerometer and gyro readings or gyro readings and wheel odometiy, depending on the nature of the movement ground operators are commanding. Where necessary, visual odometry is performed on images to fine tune the position updates, particularly in high slip environments. The capability also exists for visual odometry attitude updates. This paper describes the techniques used by the rovers to acquire and maintain attitude and position knowledge, the accuracy which is obtainable, and lessons learned after more than one year in operation.

attitude estimation↗

Virtual Sensors Determined Through Machine Learning

We propose a method that increases the capability of a conventional sensor/instrument, transforming it into an enhanced virtual sensor/instrument. This paper focuses on a virtual thermal IR sensor based on a conventional visual (RGB) sensor. The estimation of thermal IR images can enhance the ability of terrain classification, which is crucial for autonomous navigation of rovers. The estimate in IR from visual band has inherent limitations, as these are different bands, yet correlations between visual/RGB and thermal IR images exist, as different terrains, which visually may appear different, also have different thermal inertia. We developed a deep learning-based algorithm that estimates thermal IR images from RGB images of terrains, providing the feasibility of the idea with average 1.21 error [degree].

Kurazume, Ryo↗