Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “imaging and visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Automated On-board Terrain Analysis for Precision Landings

Advances in space robotics technology hinge to a large extent upon the development and deployment of sophisticated new vision-based methods for automated in-space mission operations and scientific survey. To this end, we have developed a new concept for automated terrain analysis that is based upon a generic image enhancement platform-multi-scale Retinex (MSR) and visual servo (VS) processing. This pre-conditioning with the MSR and the VS produces a "canonical" visual representation that is largely independent of lighting variations, and exposure errors. Enhanced imagery is then processed with a biologically inspired two-channel edge detection process, followed by a smoothness based criteria for image segmentation. Landing sites can be automatically determined by examining the results of the smoothness-based segmentation which shows those areas in the image that surpass a minimum degree of smoothness. Though the MSR has proven to be a very strong enhancement engine, the other elements of the approach, the VS, terrain map generation, and smoothness-based segmentation, are in early stages of development. Experimental results on data from the Mars Global Surveyor show that the imagery can be processed to automatically obtain smooth landing sites. In this paper, we describe the method used to obtain these landing sites, and also examine the smoothness criteria in terms of the imager and scene characteristics. Several examples of applying this method to simulated and real imagery are shown.

Rahman, Zia-ur↗

New Orthophoto Generation Strategies from UAV and Ground Remote Sensing Platforms for High-Throughput Phenotyping

Remote sensing platforms have become an effective data acquisition tool for digital agriculture. Imaging sensors onboard unmanned aerial vehicles (UAVs) and tractors are providing unprecedented high-geometric-resolution data for several crop phenotyping activities (e.g., canopy cover estimation, plant localization, and flowering date identification). Among potential products, orthophotos play an important role in agricultural management. Traditional orthophoto generation strategies suffer from several artifacts (e.g., double mapping, excessive pixilation, and seamline distortions). The above problems are more pronounced when dealing with mid- to late-season imagery, which is often used for establishing flowering date (e.g., tassel and panicle detection for maize and sorghum crops, respectively). In response to these challenges, this paper introduces new strategies for generating orthophotos that are conducive to the straightforward detection of tassels and panicles. The orthophoto generation strategies are valid for both frame and push-broom imaging systems. The target function of these strategies is striking a balance between the improved visual appearance of tassels/panicles and their geolocation accuracy. The new strategies are based on generating a smooth digital surface model (DSM) that maintains the geolocation quality along the plant rows while reducing double mapping and pixilation artifacts. Moreover, seamline control strategies are applied to avoid having seamline distortions at locations where the tassels and panicles are expected. The quality of generated orthophotos is evaluated through visual inspection as well as quantitative assessment of the degree of similarity between the generated orthophotos and original images. Several experimental results from both UAV and ground platforms show that the proposed strategies do improve the visual quality of derived orthophotos while maintaining the geolocation accuracy at tassel/panicle locations.

54 ENVIRONMENTAL SCIENCES↗

In Situ Nano-Indentation of a Gold Sub-Micrometric Particle Imaged by Multi-Wavelength Bragg Coherent X-ray Diffraction

The microstructure of a sub-micrometric gold crystal during nanoindentation is visualized by in situ multi-wavelength Bragg coherent X-ray diffraction imaging. The gold crystal is indented using a custom-built atomic force microscope. A band of deformation attributed to a shear band oriented along the (221) lattice plane is nucleated at the lower left corner of the crystal and propagates towards the crystal center with increasing applied mechanical load. After complete unloading, an almost strain-free and defect-free crystal is left behind, demonstrating a pseudo-elastic behavior that can only be studied by in situ imaging while it is invisible to ex situ examinations. The recovery is probably associated with reversible dislocations nucleation/annihilation at the side surface of the particle and at the particle-substrate interface, a behavior that has been predicted by atomistic simulations. The full recovery of the particle upon unloading sheds new light on extraordinary mechanical properties of metal nanoparticles obtained by solid-state dewetting.

36 MATERIALS SCIENCE↗

Monte Carlo Simulation of Electron Interactions in an MeV-STEM for Thick Frozen Biological Sample Imaging

A variety of volume electron microscopy techniques have been developed to visualize thick biological samples. However, the resolution is limited by the sliced section thickness (>30–60 nm). To preserve biological samples in a hydrated state, cryo-focused ion beam scanning electron microscopy has been developed, providing nm resolutions. However, this method is time-consuming, requiring 15–20 h to image a 10 μm thick sample with an 8 nm slice thickness. There is a pressing need for a method that allows the rapid and efficient study of thick biological samples while maintaining nanoscale resolution. The remarkable ability of mega-electron-volt (MeV) electrons to penetrate thick biological samples, even exceeding 10 μm in thickness, while maintaining nanoscale resolution, positions MeV-STEM as a suitable microscopy tool for such applications. Our research delves into understanding the interactions between MeV electrons and frozen biological specimens through Monte Carlo simulations. Single elastic scattering, plural elastic scattering, single inelastic scattering, and plural inelastic scattering events have been simulated. The electron trajectories, the beam profile, and the intensity change of electrons in each category have been investigated. Additionally, the effects of the detector collection angle and the focal position of the electron beam were investigated. As electrons penetrated deeper into the specimen, single and plural elastic scattered electrons diminished, and plural inelastic scattered electrons became dominant, and the beam profile became wider. Even after 10 μm of the specimen, 42% of the MeV electrons were collected within 10 mrad. This confirms that MeV-STEM can be employed to study thick biological samples.

electron specimen interaction↗

Better Pictures in a Snap

Retinex Imaging Processing, winner of NASA's 1999 Space Act Award, is commercially available through TruView Imaging Company. With this technology, amateur photographers use their personal computers to improve the brightness, scene contrast, detail, and overall sharpness of images with increased ease. The process was originally developed for remote sensing of the Earth by researchers at Langley Research Center and Science and Technology Corporation (STC). It automatically enhances a digital image in terms of dynamic range compression, color independence from the spectral distribution of the scene illuminant, and color/lightness rendition. As a result, the enhanced digital image is much closer to the scene perceived by the human visual system, under all kinds and levels of lighting variations. TruView believes there are other applications for the software in medical imaging, forensics, security, recognizance, mining, assembly, and other industrial areas.

Source record↗

Volumetric 3D Display System with Static Screen

Current display technology has relied on flat, 2D screens that cannot truly convey the third dimension of visual information: depth. In contrast to conventional visualization that is primarily based on 2D flat screens, the volumetric 3D display possesses a true 3D display volume, and places physically each 3D voxel in displayed 3D images at the true 3D (x,y,z) spatial position. Each voxel, analogous to a pixel in a 2D image, emits light from that position to form a real 3D image in the eyes of the viewers. Such true volumetric 3D display technology provides both physiological (accommodation, convergence, binocular disparity, and motion parallax) and psychological (image size, linear perspective, shading, brightness, etc.) depth cues to human visual systems to help in the perception of 3D objects. In a volumetric 3D display, viewers can watch the displayed 3D images from a completely 360 view without using any special eyewear. The volumetric 3D display techniques may lead to a quantum leap in information display technology and can dramatically change the ways humans interact with computers, which can lead to significant improvements in the efficiency of learning and knowledge management processes. Within a block of glass, a large amount of tiny dots of voxels are created by using a recently available machining technique called laser subsurface engraving (LSE). The LSE is able to produce tiny physical crack points (as small as 0.05 mm in diameter) at any (x,y,z) location within the cube of transparent material. The crack dots, when illuminated by a light source, scatter the light around and form visible voxels within the 3D volume. The locations of these tiny voxels are strategically determined such that each can be illuminated by a light ray from a high-resolution digital mirror device (DMD) light engine. The distribution of these voxels occupies the full display volume within the static 3D glass screen. This design eliminates any moving screen seen in previous approaches, so there is no image jitter, and has an inherent parallel mechanism for 3D voxel addressing. High spatial resolution is possible with a full color display being easy to implement. The system is low-cost and low-maintenance.

Geng, Jason↗

Strain and crystallographic identification of the helically concaved gap surfaces of chiral nanoparticles

Identifying the three-dimensional (3D) crystal plane and strain-field distributions of nanocrystals is essential for optical, catalytic, and electronic applications. However, it remains a challenge to image concave surfaces of nanoparticles. Here, we develop a methodology for visualizing the 3D information of chiral gold nanoparticles ≈ 200 nm in size with concave gap structures by Bragg coherent X-ray diffraction imaging. The distribution of the high-Miller-index planes constituting the concave chiral gap is precisely determined. The highly strained region adjacent to the chiral gaps is resolved, which was correlated to the 432-symmetric morphology of the nanoparticles and its corresponding plasmonic properties are numerically predicted from the atomically defined structures. This approach can serve as a comprehensive characterization platform for visualizing the 3D crystallographic and strain distributions of nanoparticles with a few hundred nanometers, especially for applications where structural complexity and local heterogeneity are major determinants, as exemplified in plasmonics.

36 MATERIALS SCIENCE↗

Interactive displays in medical art

Medical illustration is a field of visual communication with a long history. Traditional medical illustrations are static, 2-D, printed images; highly realistic depictions of the gross morphology of anatomical structures. Today medicine requires the visualization of structures and processes that have never before been seen. Complex 3-D spatial relationships require interpretation from 2-D diagnostic imagery. Pictures that move in real time have become clinical and research tools for physicians. Medical illustrators are involved with the development of interactive visual displays for three different, but not discrete, functions: as educational materials, as clinical and research tools, and as data bases of standard imagery used to produce visuals. The production of interactive displays in the medical arts is examined.

Mcconathy, Deirdre Alla↗

3D Visualization for Phoenix Mars Lander Science Operations

Planetary surface exploration missions present considerable operational challenges in the form of substantial communication delays, limited communication windows, and limited communication bandwidth. A 3D visualization software was developed and delivered to the 2008 Phoenix Mars Lander (PML) mission. The components of the system include an interactive 3D visualization environment called Mercator, terrain reconstruction software called the Ames Stereo Pipeline, and a server providing distributed access to terrain models. The software was successfully utilized during the mission for science analysis, site understanding, and science operations activity planning. A terrain server was implemented that provided distribution of terrain models from a central repository to clients running the Mercator software. The Ames Stereo Pipeline generates accurate, high-resolution, texture-mapped, 3D terrain models from stereo image pairs. These terrain models can then be visualized within the Mercator environment. The central cross-cutting goal for these tools is to provide an easy-to-use, high-quality, full-featured visualization environment that enhances the mission science team s ability to develop low-risk productive science activity plans. In addition, for the Mercator and Viz visualization environments, extensibility and adaptability to different missions and application areas are key design goals.

Edwards, Laurence↗

A knowledge based system for scientific data visualization

A knowledge-based system, called visualization tool assistant (VISTA), which was developed to assist scientists in the design of scientific data visualization techniques, is described. The system derives its knowledge from several sources which provide information about data characteristics, visualization primitives, and effective visual perception. The design methodology employed by the system is based on a sequence of transformations which decomposes a data set into a set of data partitions, maps this set of partitions to visualization primitives, and combines these primitives into a composite visualization technique design. Although the primary function of the system is to generate an effective visualization technique design for a given data set by using principles of visual perception the system also allows users to interactively modify the design, and renders the resulting image using a variety of rendering algorithms. The current version of the system primarily supports visualization techniques having applicability in earth and space sciences, although it may easily be extended to include other techniques useful in other disciplines such as computational fluid dynamics, finite-element analysis and medical imaging.

Senay, Hikmet↗

X-ray Phase Contrast Imaging of the Impact of Multiple HMX Particles in a Polymeric Matrix

The initiation of high explosives (HEs) under shock loading lacks a comprehensive understanding: particularly at the particle scale. One common explanation is the hot spot theory, which suggests that energy in the material resulting from the impact event is localized in a small area causing an increase in temperature that can lead to ignition. This study focuses on the response of HMX particles (a common HE) within a polymer matrix (Sylgard-184 (R)), a simplified example of a polymer-bound explosive (PBX). These PBXs consist of multiple HMX particles in a single polymer-bound sample. A light gas gun was used to load the samples at impact velocities above 400 m/s. The impact events were visualized using X-ray phase-contrast imaging (PCI) allowing real-time observation of the impact event. The experiment used two different types of samples (multi-particle and two crystals) and found evidence of cracking and debonding in both sample types. Additionally, it was found that the multiple particle samples showed similar evidence of damage at lower velocities than that of single particle samples. This is an expected result as the multiple particles add additional interfaces for stress concentration and frictional heating.

42 ENGINEERING↗

Remote sensing images, DEM, and point clouds associated with “Accuracy evaluation of cost-effective 3D reconstruction approaches for hydrobiogeochemical processes in non-perennial stream riverbeds”

This data package is associated with the publication “Accuracy evaluation of cost-effective 3D reconstruction approaches for hydrobiogeochemical processes in non-perennial stream riverbeds” published in Frontiers in Environmental Science, Environmental Informatics and Remote Sensing (Bao et al., 2026; doi: 10.3389/fenvs.2026.1725258). This data package includes the drone photos for a section of Umtanum Creek in Washington, Unted States. The photos were used to reconstruct the 3-dimensional (3D) digital elevation model (DEM) of the riverbed for the investigated stream section. The reconstruction results from four approaches are provided: (1) unoccupied aerial vehicle (UAV, colloquially known as drone) imagery-based Structure-from-Motion (SfM), (2) a machine learning-based 3D reconstruction model, Visual Geometry Grounded Deep Structure from Motion (VGGSfM), (3) Visual Geometry Grounded Transformer for long sequence of images (VGGT-Long), and (4) handheld smartphone LiDAR scanning. The ground truth measurements by tripod-mounted optical level kit and ground control points GPS locations for evaluating the accuracy of the four reconstruction approaches are also provided in this data package. A preliminary version of this data package was published in October 2025 at the time of manuscript submission. It was updated in March 2026, at the time of manuscript acceptance, to include additional metadata (this readme, data dictionary, and file level metadata). The data did not change. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to a readme, this data package also includes a file-level metadata (FLMD) file that describes each file and a data dictionary (DD) that describes all column/row headers and variable definitions. This dataset is comprised of (1) 8 folders; (2) the detailed flight configuration html files; (3) field metadata; (4) a readme; (5) a data dictionary; and (6) file-level metadata. The folders “2024_10_18_d01” and “2024_10_18_d02” contain the original drone photos for the two drone flights (d01 and d02) on October 18, 2024. The reconstruction results from each of the approaches are in the folders called “ODM_SfM”, “VGGSfM”, “VGGTLong”, and “LiDAR”. The ground truth measurements are in the folder called “optical_level_kit”. Lastly, results comparing the different approaches are in the folder called “comparisons”. All files are .csv, .html, .jpg, .obj, .txt, and .npy. For information on using the .obj and .npy files, see the readme files within the same folder as the files.

54 ENVIRONMENTAL SCIENCES↗

Video transmission on ATM networks

The broadband integrated services digital network (B-ISDN) is expected to provide high-speed and flexible multimedia applications. Multimedia includes data, graphics, image, voice, and video. Asynchronous transfer mode (ATM) is the adopted transport techniques for B-ISDN and has the potential for providing a more efficient and integrated environment for multimedia. It is believed that most broadband applications will make heavy use of visual information. The prospect of wide spread use of image and video communication has led to interest in coding algorithms for reducing bandwidth requirements and improving image quality. The major results of a study on the bridging of network transmission performance and video coding are: Using two representative video sequences, several video source models are developed. The fitness of these models are validated through the use of statistical tests and network queuing performance. A dual leaky bucket algorithm is proposed as an effective network policing function. The concept of the dual leaky bucket algorithm can be applied to a prioritized coding approach to achieve transmission efficiency. A mapping of the performance/control parameters at the network level into equivalent parameters at the video coding level is developed. Based on that, a complete set of principles for the design of video codecs for network transmission is proposed.

Chen, Yun-Chung↗

Direct visualization and control of antiferromagnetic domains and spin reorientation in a parent cuprate

Here, we report magnetic optical second-harmonic generation (SHG) polarimetry and imaging on Sr 2 Cu 3 O 4 Cl 2 , which allows direct visualization of the mesoscopic antiferromagnetic (AFM) structure of a parent cuprate. Temperature- and magnetic-field-dependent SHG reveals large domains with 90° relative orientations that are stabilized by a combination of uniaxial magnetic anisotropy and the Earth's magnetic field. Below a temperature T R ~ 97 K, we observe an unusual 90° spin reorientation transition, possibly driven by competing magnetic anisotropies of the two copper sublattices, which swaps the AFM domain states while preserving the domain structure. This allows deterministic switching of the AFM states by thermal or laser heating. Near T R , the domain walls become exceptionally responsive to an applied magnetic field, with the Earth's field sufficient to completely expel them from the crystal. Our findings unlock opportunities to study the mesoscopic AFM behavior of parent cuprates and explore their potential for AFM technologies.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Virtual Diagnostic Interface: Aerospace Experimentation in the Synthetic Environment

The Virtual Diagnostics Interface (ViDI) methodology combines two-dimensional image processing and three-dimensional computer modeling to provide comprehensive in-situ visualizations commonly utilized for in-depth planning of wind tunnel and flight testing, real time data visualization of experimental data, and unique merging of experimental and computational data sets in both real-time and post-test analysis. The preparation of such visualizations encompasses the realm of interactive three-dimensional environments, traditional and state of the art image processing techniques, database management and development of toolsets with user friendly graphical user interfaces. ViDI has been under development at the NASA Langley Research Center for over 15 years, and has a long track record of providing unique and insightful solutions to a wide variety of experimental testing techniques and validation of computational simulations. This report will address the various aspects of ViDI and how it has been applied to test programs as varied as NASCAR race car testing in NASA wind tunnels to real-time operations concerning Space Shuttle aerodynamic flight testing. In addition, future trends and applications will be outlined in the paper.

Schwartz, Richard J.↗

Virtual Diagnostic Interface: Aerospace Experimentation in the Synthetic Environment

The Virtual Diagnostics Interface (ViDI) methodology combines two-dimensional image processing and three-dimensional computer modeling to provide comprehensive in-situ visualizations commonly utilized for in-depth planning of wind tunnel and flight testing, real time data visualization of experimental data, and unique merging of experimental and computational data sets in both real-time and post-test analysis. The preparation of such visualizations encompasses the realm of interactive three-dimensional environments, traditional and state of the art image processing techniques, database management and development of toolsets with user friendly graphical user interfaces. ViDI has been under development at the NASA Langley Research Center for over 15 years, and has a long track record of providing unique and insightful solutions to a wide variety of experimental testing techniques and validation of computational simulations. This report will address the various aspects of ViDI and how it has been applied to test programs as varied as NASCAR race car testing in NASA wind tunnels to real-time operations concerning Space Shuttle aerodynamic flight testing. In addition, future trends and applications will be outlined in the paper.

Schwartz, Richard J.↗

Real-Time Background Oriented Schlieren: Catching Up With Knife Edge Schlieren

Background Oriented Schlieren (BOS) is a widely used technique that provides density gradient information in flow fields of interest, without imposing stringent optical quality requirements on the facility/experiment windows and/or optics used in the BOS setup. Typically, the BOS reference image is acquired before the test begins (flow off) and then the "live" image data are acquired during the actual testing/experiment (flow on). The raw BOS image data, while displayed in real-time as they are acquired from the camera, unfortunately provide little if any visual indication of the density gradients in the flow. Generally, the "live" images must be processed off-line after the testing is completed, providing no indication of the success of the BOS setup and no feedback on the operational success of the test. Advances in computer processing hardware enables the implementation of real-time processing and display of the BOS image data. Two different approaches to implementing the real-time BOS (RT-BOS) processing capability are described herein. First, a traditional multi-core Central Processing Unit (CPU) based approach using scheduled parallel threads is used to build a RT-BOS processing engine. In the second approach, a Graphical Processing Unit (GPU) approach is used to costruct a RT-BOS processing engine. Generally, high core count CPU processors can provide a useful processing rate for RT-BOS. However, the GPU based approach exceeds the processing capability of the CPU approach, at a fraction of the cost. The GPU approach places no restrictions on the Host PC processing capability, except that it be capable of acquiring the BOS image data from the camera in real-time.

Wernet, Mark P.↗

Examples of Current and Future Uses of Neural-Net Image Processing for Aerospace Applications

Feed forward artificial neural networks are very convenient for performing correlated interpolation of pairs of complex noisy data sets as well as detecting small changes in image data. Image-to-image, image-to-variable and image-to-index applications have been tested at Glenn. Early demonstration applications are summarized including image-directed alignment of optics, tomography, flow-visualization control of wind-tunnel operations and structural-model-trained neural networks. A practical application is reviewed that employs neural-net detection of structural damage from interference fringe patterns. Both sensor-based and optics-only calibration procedures are available for this technique. These accomplishments have generated the knowledge necessary to suggest some other applications for NASA and Government programs. A tomography application is discussed to support Glenn's Icing Research tomography effort. The self-regularizing capability of a neural net is shown to predict the expected performance of the tomography geometry and to augment fast data processing. Other potential applications involve the quantum technologies. It may be possible to use a neural net as an image-to-image controller of an optical tweezers being used for diagnostics of isolated nano structures. The image-to-image transformation properties also offer the potential for simulating quantum computing. Computer resources are detailed for implementing the black box calibration features of the neural nets.

Decker, Arthur J.↗