Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “imaging and visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

A survey of multispectral remote sensing techniques for earth resources applications.

Remote sensing for earth resources applications has as its objective the collection and interpretation of information on all environmentally significant features of the atmosphere, oceans, and land surfaces. This information is most effectively gathered by airborne and satellite borne imaging systems. These systems operate at a variety of wavelengths extending from the visual spectrum, through the infrared and into the centimeter wavelengths of the microwave band. A comparison is made of the signal characteristics at these spectrum regions. In particular, the ability of microwave radiometric imaging to augment visual and infrared imaging is discussed. Recent developments in electronically scanned microwave radiometric sensors are described, together with methods of optimizing microwave data display. Results achieved with integrated display systems for both microwave and optical data are presented, together with projections for future applications.-

Pascalar, H. G.↗

GPU-based Image Compression for Efficient Compositing in Distributed Rendering Applications

Visualizations of large-scale data sets are often created on graphics clusters that distribute the rendering task amongst many processes. When using real-time GPU-based graphics algorithms, the most time-consuming aspect of distributed rendering is typically the com-positing phase - combining all partial images from each rendering process into the final visualization. Compo siting requires image data to be copied off the GPU and sent over a network to other processes. While compression has been utilized in existing distributed rendering compositors to reduce the data being sent over the network, this compression tends to occur after the raw images are transferred from the GPU to main memory. In this paper, we present work that leverages OpenGL / CUDA interoperability to compress raw images on the GPU prior to transferring the data to main memory. This approach can significantly reduce the device-to-host data transfer time, thus enabling more efficient compositing of images generated by distributed rendering applications.

Lipinksi, Riley↗

Imaging Intact Filamentous Fungi from Spore to Hyphal Tip on the Nanoscale

Previously, the Pacific Northwest National Laboratory was limited by a 3-order of magnitude gap in resolution for direct 2-D and 3-D imaging of chemical, biological, energy and materials science systems. Our imaging instrumentation could directly visualize 3-D ultrastructure without labeling at resolutions less than 10-nanometers or greater than 10-micrometers. To address this gap, we procured and commissioned a Sigray NanoFast Bio-Lambda laboratory-based x-ray nanotomography system. This equipment provides the capability to image through tens of micrometers of organic materials at down to 35-nanometer resolution to bridge the nanoscale to the mesoscale for biological systems, organic polymers, environmental and particulate samples.

47 OTHER INSTRUMENTATION↗

Real-Time Visualization of Tissue Ischemia

A real-time display of tissue ischemia which comprises three CCD video cameras, each with a narrow bandwidth filter at the correct wavelength is discussed. The cameras simultaneously view an area of tissue suspected of having ischemic areas through beamsplitters. The output from each camera is adjusted to give the correct signal intensity for combining with, the others into an image for display. If necessary a digital signal processor (DSP) can implement algorithms for image enhancement prior to display. Current DSP engines are fast enough to give real-time display. Measurement at three, wavelengths, combined into a real-time Red-Green-Blue (RGB) video display with a digital signal processing (DSP) board to implement image algorithms, provides direct visualization of ischemic areas.

Bearman, Gregory H.↗

Multiresolution image gathering and restoration

In this paper we integrate multiresolution decomposition with image gathering and restoration. This integration leads to a Wiener-matrix filter that accounts for the aliasing, blurring, and noise in image gathering, together with the digital filtering and decimation in signal decomposition. Moreover, as implemented here, the Wiener-matrix filter completely suppresses the blurring and raster effects of the image-display device. We demonstrate that this filter can significantly improve the fidelity and visual quality produced by conventional image reconstruction. The extent of this improvement, in turn, depends on the design of the image-gathering device.

Fales, Carl L.↗

High spectral resolution remote sensing of the earth

Early results of a major advance in remote sensing called imaging spectrometry (IS), the simultaneous acquisition of images in many narrow contiguous spectral bands throughout the visible and solar-reflected infrared portions of the spectrum, are discussed. The motivation for IS is reviewed, and the performance of IS is examined, describing prototype sensors. The analysis of IS data is addressed, including the problem of visual interaction with hyperspectral images and their statistical properties, and the effect of data dimensionality on multispectral scene classification. A test of the capability of imaging spectrometry to identify minerals is reported.

Vane, G.↗

Sub-millisecond keyhole pore detection in laser powder bed fusion using sound and light sensors and machine learning

Laser powder bed fusion is a mainstream additive manufacturing technology widely used to manufacture complex parts in prominent sectors, including aerospace, biomedical, and automotive industries. However, during the printing process, the presence of an unstable vapor depression can lead to a type of defect called keyhole porosity, which is detrimental to the part quality. In this study, we developed an effective approach to locally detect the generation of keyhole pores during the printing process by leveraging machine learning and a suite of optical and acoustic sensors. Simultaneous synchrotron x-ray imaging allows the direct visualization of pore generation events inside the sample, offering high-fidelity ground truth. A neural network model adopting SqueezeNet architecture using single-sensor data was developed to evaluate the fidelity of each sensor for capturing keyhole pore generation events. Our comparative study shows that the near infrared images gave the highest prediction accuracy, followed by 100 kHz and 20 kHz microphones, and the photodiode sensitive to processing laser wavelength had the lowest accuracy. Using a single sensor, over 90% prediction accuracy can be achieved with a temporal resolution as short as 0.1 ms. A data fusion scheme was also developed with features extracted using SqueezeNet neural network architecture and classification using different machine learning algorithms. Our work demonstrates the correlation between the characteristic optical and acoustic emissions and the keyhole oscillation behavior, and thereby provides strong physics support for the machine learning approach.

36 MATERIALS SCIENCE↗

Direct Multimodal Nanoscale Visualization of Early Phosphorus-Based Antiwear Tribofilm Formation

Understanding the mechanism of antiwear (AW) tribofilm formation and how to tune surface chemistry to control functionality is essential for the development of the next generation of oil lubricants. In particular, understanding and optimizing early AW tribofilm formation can increase the energy efficiency of mechanical systems. However, the mechanism for how these films form is not well understood. The majority of prior work has focused on analyzing only end-of-test surfaces long after the film has formed. In this work, we develop an in situ multimodal chemical imaging methodology to directly visualize the early formation of AW films on steel surfaces. We investigate an oil formulation containing a phosphorus-based additive commonly used to protect surfaces from wear and fatigue processes in machine elements, such as gears, bearings, and sliding contacts. Using nanoscale multimodal chemical imaging on combined platforms of atomic force microscopy (AFM) coupled directly with in situ nano-infrared (nano-IR) spectroscopy, and further combined ex situ with time-of-flight secondary ion mass spectrometry (ToF-SIMS), we demonstrate a direct correlation between changes in friction and local surface chemistry. In these experiments, the AFM probe acts as a single asperity contact to generate the tribofilm as well as a tool to analyze it in situ as it is forming. To verify our in situ measurements, we compare these results to the ex situ ToF-SIMS of macroscale block-on-ring tribometer-formed samples. We report the understanding gained here on how AW films form and how film properties can be modified by tuning the chemistry of the additives will facilitate developing transmission fluids to meet increasing demands for vehicle performance and efficiency.

36 MATERIALS SCIENCE↗

Scaling Building Energy Audits through Machine Learning Methods on Novel Drone Image Data

Building energy audits are time-consuming and labor-intensive. This paper describes a new method using machine learning (ML) techniques on novel data sources (drone images) to improve the identification of building characteristics and retrofit opportunities, and thereby reduce the effort for audits. The new ML method includes: (1) Building footprint extraction using line extraction, polygonization, and polygon-merging, (2) Building envelope extraction using PIX4d modeling software to reconstruct a building 3D model, (3) Visualization tool for viewing images from the 3D model, (4) Window-to-wall ratio (WWR) using state-of-art deep neural network semantic segmentation, (5) Envelope thermal anomaly detection using an unsupervised machine learning clustering algorithm, and (6) Rooftop energy equipment detection based on an object detection algorithm. The testing of this method involved a comparison of additional ML-generated information overlaid on current ‘state-of-practice’ audit and remote assessment baselines using evaluation metrics: labor time and associated cost, marginal benefits of using ML-generated information in workflows for audits and remote assessments, integration potential with existing processes and tools, and replicability/scalability of the method. In two test buildings in California that had comprehensive drawings and meter data available, the ML method effectively generated a building footprint, envelope, rooftop equipment, WWR, and locations of envelope thermal anomalies. Projected target segments of the ML method are sites with minimal drawings and energy data, and underserved sectors such as multistoried housing, disadvantaged communities, and schools for which the ML method can enable identification of building asset characteristics and prioritization of envelope retrofits and decentralized energy equipment retrofits.

Singh, Reshma↗

Imaging Light‐Induced Migration of Dislocations in Halide Perovskites with 3D Nanoscale Strain Mapping

Abstract In recent years, halide perovskite materials have been used to make high‐performance solar cells and light‐emitting devices. However, material defects still limit device performance and stability. Here, synchrotron‐based Bragg coherent diffraction imaging is used to visualize nanoscale strain fields, such as those local to defects, in halide perovskite microcrystals. Significant strain heterogeneity within MAPbBr 3 (MA = CH 3 NH 3 + ) crystals is found in spite of their high optoelectronic quality, and both 〈100〉 and 〈110〉 edge dislocations are identified through analysis of their local strain fields. By imaging these defects and strain fields in situ under continuous illumination, dramatic light‐induced dislocation migration across hundreds of nanometers is uncovered. Further, by selectively studying crystals that are damaged by the X‐ray beam, large dislocation densities and increased nanoscale strains are correlated with material degradation and substantially altered optoelectronic properties assessed using photoluminescence microscopy measurements. These results demonstrate the dynamic nature of extended defects and strain in halide perovskites, which will have important consequences for device performance and operational stability.

36 MATERIALS SCIENCE↗

Virtual Sensors Determined Through Machine Learning

We propose a method that increases the capability of a conventional sensor, transforming it into an enhanced virtual sensor. This paper focuses on a virtual thermal Infrared Radiation (IR) sensor based on a conventional visual (RGB) sensor. The estimation of thermal IR images can enhance the ability of terrain classification, which is crucial for autonomous navigation of rovers. The estimate in IR from visual band has inherent limitations, as these are different bands, yet correlations between visual RGB and thermal IR images exist, as different terrains, which visually may appear different, also have different thermal inertia. This paper describes the developed deep learning-based algorithm that estimates thermal IR images from RGB images of terrains, providing the feasibility of the idea with average 1.21 error [degree Celsius].

Torresen, Jim↗

Correlation Between Bulk Material Defects and Spectroscopic Response in Cadmium Zinc Telluride Detectors

One of the critical challenges for large area cadmium zinc telluride (CdZnTe) detector arrays is obtaining material capable of uniform imaging and spectroscopic response. Two complementary nondestructive techniques for characterizing bulk CdZnTe have been developed to identify material with a uniform response. The first technique, infrared transmission imaging, allows for rapid visualization of bulk defects. The second technique, x-ray spectral mapping, provides a map of the material spectroscopic response when it is configured as a planar detector. The two techniques have been used to develop a correlation between bulk defect type and detector performance. The correlation allows for the use of infrared imaging to rapidly develop wafer mining maps. The mining of material free of detrimental defects has the potential to dramatically increase the yield and quality of large area CdZnTe detector arrays.

Parker, Bradford H.↗

Three-dimensional organization of vestibular related eye movements to rotational motion in pigeons

During rotational motions, compensatory eye movement adjustments must continually occur in order to maintain objects of visual interest as stable images on the retina. In the present study, the three-dimensional organization of the vestibulo-ocular reflex in pigeons was quantitatively examined. Rotations about different head axes produced horizontal, vertical, and torsional eye movements, whose component magnitude was dependent upon the cosine of the stimulus axis relative to the animal's visual axis. Thus, the three-dimensional organization of the VOR in pigeons appears to be compensatory for any direction of head rotation. Frequency responses of the horizontal, vertical, and torsional slow phase components exhibited high pass filter properties with dominant time constants of approximately 3 s.

NASA Discipline Neuroscience↗

On-board Absolute Localization Based on Orbital Imagery for a Future Mars Science Helicopter

Future Mars Rotorcraft require advanced navigationcapabilities to enable all terrain access over long distance flightsthat are executed fully autonomously. A critical component toenable precision navigation during long traverses is the abilityto perform on-board absolute localization to eliminate drift inposition estimates of the on-board odometry algorithm. Inthis paper, we present an approach for on-board map-basedlocalization to provide global reference position based on orbitalor aerial image maps. Our approach builds on a vision-basedlocalization method to localize against a map derived fromHiRISE image products – an ortho-projected image (orthoimage) and a corresponding digital elevation map. The mapis pre-computed using a feature-based approach. Features arestored with their 3D world coordinates, and a descriptor to codethe local image intensity information in the vicinity of the featurelocation. An on-board matching algorithm uses this informationto match visual features in a query image acquired during flight,guided by a pose prior from the on-board range-visual-inertialstate estimator (Range-VIO). Valid matches are then used bya perspective-n-point (PnP) algorithm to estimate the absolutepose of the vehicle in a global frame. We demonstrate andevaluate our approach on simulated data, and data from UASflights.

Balaram, J. Bob↗

Visibility of wavelet quantization noise

The discrete wavelet transform (DWT) decomposes an image into bands that vary in spatial frequency and orientation. It is widely used for image compression. Measures of the visibility of DWT quantization errors are required to achieve optimal compression. Uniform quantization of a single band of coefficients results in an artifact that we call DWT uniform quantization noise; it is the sum of a lattice of random amplitude basis functions of the corresponding DWT synthesis filter. We measured visual detection thresholds for samples of DWT uniform quantization noise in Y, Cb, and Cr color channels. The spatial frequency of a wavelet is r 2-lambda, where r is display visual resolution in pixels/degree, and lambda is the wavelet level. Thresholds increase rapidly with wavelet spatial frequency. Thresholds also increase from Y to Cr to Cb, and with orientation from lowpass to horizontal/vertical to diagonal. We construct a mathematical model for DWT noise detection thresholds that is a function of level, orientation, and display visual resolution. This allows calculation of a "perceptually lossless" quantization matrix for which all errors are in theory below the visual threshold. The model may also be used as the basis for adaptive quantization schemes.

NASA Center ARC↗

A Semi-Supervised Learning Method for the Identification of Bad Exposures in Large Imaging Surveys

As the data volume of astronomical imaging surveys rapidly increases, traditional methods for image anomaly detection, such as visual inspection by human experts, are becoming impractical. We introduce a machine-learning-based approach to detect poor-quality exposures in large imaging surveys, with a focus on the DECam Legacy Survey (DECaLS) in regions of low extinction (i.e., E ( B − V ) < 0.04 ). Our semi-supervised pipeline integrates a vision transformer (ViT), trained via self-supervised learning (SSL), with a k-Nearest Neighbor (kNN) classifier. We train and validate our pipeline using a small set of labeled exposures observed by surveys with the Dark Energy Camera (DECam). A clustering-space analysis of where our pipeline places images labeled in good and bad categories suggests that our approach can efficiently and accurately determine the quality of exposures. Applied to new imaging being reduced for DECaLS Data Release 11, our pipeline identifies 780 problematic exposures, which we subsequently verify through visual inspection. Being highly efficient and adaptable, our method offers a scalable solution for quality control in other large imaging surveys.

Luo, Yufeng (ORCID:0000000246230683)↗

In operando neutron imaging characterizations of all-solid-state batteries

The surge in electric vehicle demand has propagated the extensive application of lithium-ion batteries (LIBs) in recent years. Gaining significant traction due to their promising high-energy density and elevated safety over traditional LIBs, all-solid-state Li batteries (ASLBs) have nonetheless been faced with hurdles relating to battery performance. These include concerns with interfacial compatibility, structural stability, Li dendrite inhibition, and large-scale manufacturing. To tackle these issues, it is necessary to employ advanced characterization methods to comprehend the intrinsic mechanisms within ASLBs. In this article, we advocate for the use of neutron imaging as a nondestructive approach for the operando visualization of ASLBs. We draw comparisons with other operando visualization strategies, underline the benefits of neutron imaging, and discuss its potential applicability in the scrutiny of all-solid-state Li metal batteries and all-solid-state Li-sulfur batteries. Neutron imaging provides valuable insights into the dynamics of Li concentration, reaction mechanisms, and transport constraints in ASLBs. These insights are pivotal in contributing to the evolution of high-performance all-solid-state batteries.

25 ENERGY STORAGE↗

Digital preprocessing and classification of multispectral earth observation data

The development of airborne and satellite multispectral image scanning sensors has generated wide-spread interest in application of these sensors to earth resource mapping. These point scanning sensors permit scenes to be imaged in a large number of electromagnetic energy bands between .3 and 15 micrometers. The energy sensed in each band can be used as a feature in a computer based multi-dimensional pattern recognition process to aid in interpreting the nature of elements in the scene. Images from each band can also be interpreted visually. Visual interpretation of five or ten multispectral images simultaneously becomes impractical especially as area studied increases; hence, great emphasis has been placed on machine (computer) techniques for aiding in the interpretation process. This paper describes a computer software system concept called LARSYS for analysis of multivariate image data and presents some examples of its application.

Anuta, P. E.↗