Results for “Image representation” — Page 16

NASA NTRSDate not supplied

Predictive Modeling of Carbon Ablators

Efforts to build a Predictive Material Modeling (PMM) framework from the micro-scale to the macro-scale are presented in this abstract. To reduce the need for extensive testing, accelerate the design cycle process, and reduce uncertainty margins applied to final designs, NASA is developing simulation and modeling tools that enable characterization of material properties and response to high-enthalpy environments. The Porous Microstructure Analysis (PuMA) code has been developed for computing macroscale (volume averaged) properties of porous materials using microscale images from micro-computed tomography (micro-CT). Microscale modeling requires a realistic representation of a material microstructure; these are obtained either synthetically during the design of the material or through X-ray micro-CT. Volume averaged properties are then used to inform macroscale material response models, such as those implemented in the Porous-material Analysis Toolbox based on OpenFOAM (PATO) software, also actively developed by NASA. The computational model in PATO is a generic heat and mass transfer model for porous reactive materials containing several solid phases and a single gas phase. The detailed chemical interactions occurring between the solid phases and the gas phase are modeled at the pore scale assuming local thermal equilibrium. These tools were developed to efficiently interface with other pre-existing codes such as SPARTA (direct simulation Monte Carlo), DPLR (hypersonic CFD), NEQAIR (radiative transport) and DAKOTA (uncertainty quantification and optimization). Detailed flight data (Mars Science Laboratory [MSL] Entry Descent and Landing Instrument [MEDLI]) is critical for validating these computational tools for NASA applications. Examples of modeling ablative material response using these codes will be presented including 3D simulations of the full-scale heatshield of the MSL capsule. The simulations demonstrate the ability of the modern material response code, PATO, to handle the material response of geometrically complex and large domains, through the use of massively parallel computations.

Thermal Protection Systems↗

NASA NTRSDate not supplied

Predictive Modeling of Carbon Ablators Using Micro and Macro-Scale Modeling

Efforts to build a Predictive Material Modeling (PMM) framework from the micro-scale to the macro-scale are presented in this abstract. To reduce the need for extensive testing, accelerate the design cycle process, and reduce uncertainty margins applied to final designs, NASA is developing simulation and modeling tools that enable characterization of material properties and response to high-enthalpy environments. The Porous Microstructure Analysis (PuMA) code has been developed for computing macroscale (volume averaged) properties of porous materials using microscale images from micro-computed tomography (micro-CT). Microscale modeling requires a realistic representation of a material microstructure; these are obtained either synthetically during the design of the material or through X-ray micro-CT. Volume averaged properties are then used to inform macroscale material response models, such as those implemented in the Porous-material Analysis Toolbox based on OpenFOAM (PATO) software, also actively developed by NASA. The computational model in PATO is a generic heat and mass transfer model for porous reactive materials containing several solid phases and a single gas phase. The detailed chemical interactions occurring between the solid phases and the gas phase are modeled at the pore scale assuming local thermal equilibrium. These tools were developed to efficiently interface with other pre-existing codes such as SPARTA (direct simulation Monte Carlo), DPLR (hypersonic CFD), NEQAIR (radiative transport) and DAKOTA (uncertainty quantification and optimization). Detailed flight data (Mars Science Laboratory [MSL] Entry Descent and Landing Instrument [MEDLI]) is critical for validating these computational tools for NASA applications. Examples of modeling ablative material response using these codes will be presented including 3D simulations of the full-scale heatshield of the MSL capsule. The simulations demonstrate the ability of the modern material response code, PATO, to handle the material response of geometrically complex and large domains, through the use of massively parallel computations.

Thermal Protection Systems↗

DOE OSTI2024

Machine learning based reconstruction of intracardiac electrical behavior based on electrocardiograms

A computer-based system and process are disclosed for reconstructing the internal electrical behavior of a patient's heart based partly or wholly on the patient's electrocardiogram (ECG). The output of the process may include, for example, a cardiac activation map, and/or a representation of transmembrane potentials over time. The process advantageously does not require any medical imaging of the patient, and does not require any special medical equipment. For example, the patient's activation map and transmembrane potentials may be reconstructed based solely on a preexisting or newly-obtained 12-lead cardiac ECG of the patient. The process makes use of a machine learning model, such as a neural network based model, trained with actual and/or simulated ECGs and intracardiac electrical data (typically transmembrane potentials) of many thousands of patients. Because an insufficient quantity of such data exists for actual patients, model training may be performed using ECGs and intracardiac electrical data obtained through computer simulations.

Blake, Robert↗

DOE OSTI2025

Heterogeneous Point Set Transformers for Segmentation of Multiple View Particle Detectors

NOvA is a long-baseline neutrino oscillation experiment that detects neutrino particles from the NuMI beam at Fermilab. Before data from this experiment can be used in analyses, raw hits in the detector must be matched to their source particles, and the type of each particle must be identified. This task has commonly been done using a mix of traditional clustering approaches and convolutional neural networks (CNNs). Due to the construction of the detector, the data is presented as two sparse 2D images: an XZ and a YZ view of the detector, rather than a 3D representation. We propose a point set neural network that operates on the sparse matrices with an operation that mixes information from both views. Our model uses less than 10% of the memory required using previous methods while achieving a 96.8% AUC score, a higher score than obtained when both views are processed independently (85.4%).

Robles, Edgar E. [UC, Irvine (main)]↗

DOE OSTI2024

Source shape estimation for neutron imaging systems using convolutional neural networks

Neutron imaging systems are important diagnostic tools for characterizing the physics of inertial confinement fusion reactions at the National Ignition Facility (NIF). In particular, neutron images give diagnostic information on the size, symmetry, and shape of the fusion hot spot and surrounding cold fuel. Images are formed via collection of neutron flux from the source using a system of aperture arrays and scintillator-based detectors. Currently, reconstruction of fusion source geometry from the collected neutron images is accomplished by solving a computationally intensive maximum likelihood estimation problem via expectation maximization. In contrast, it is often useful to have simple representations of the overall source geometry that can be computed quickly. In this work, we develop convolutional neural networks (CNNs) to reconstruct the outer contours of simple source geometries. We compare the performance of the CNN for penumbral and pinhole data and provide experimental demonstrations of our methods on both non-noisy and noisy data.

Machine learning, neutron imaging, source reconstr↗

DOE OSTI2025

Volumetric imaging of the 3D orientation of cellular structures with a polarized fluorescence light-sheet microscope

Polarized fluorescence microscopy is a valuable tool for measuring molecular orientations in biological samples, but techniques for recovering three-dimensional orientations and positions of fluorescent ensembles are limited. We report a polarized dual-view light-sheet system for determining the diffraction-limited three-dimensional distribution of the orientations and positions of ensembles of fluorescent dipoles that label biological structures. We share a set of visualization, histogram, and profiling tools for interpreting these positions and orientations. We model the distributions based on the polarization-dependent efficiency of excitation and detection of emitted fluorescence, using coarse-grained representations we call orientation distribution functions (ODFs). We apply ODFs to create physics-informed models of image formation with spatio-angular point-spread and transfer functions. We use theory and experiment to conclude that light-sheet tilting is a necessary part of our design for recovering all three-dimensional orientations. We use our system to extend known two-dimensional results to three dimensions in FM1-43-labeled giant unilamellar vesicles, fast-scarlet-labeled cellulose in xylem cells, and phalloidin-labeled actin in U2OS cells. Additionally, we observe phalloidin-labeled actin in mouse fibroblasts grown on grids of labeled nanowires and identify correlations between local actin alignment and global cell-scale orientation, indicating cellular coordination across length scales.

Science & Technology - Other Topics↗

NASA NTRS1981

Geologic application of thermal inertia imaging using HCMM data

Three test sites in the western US were selected to discriminate among surface geologic materials on the basis of their thermal properties as determined from HCMM data. Attempts to determine quantitatively accurate thermal inertia values from HCMM digital data met with only partial success due to the effects of sensor miscalibrations, radiative transfer in the atmosphere, and varying meteorology and elevation across a scene. In most instances, apparent thermal inertia was found to be an excellent qualitative representation of true thermal inertia. Computer processing of digital day and night HCMM data allowed construction of geologically useful images. At some test sites, more information was provided by data than LANDSAT data. Soil moisture effects and differences in spectrally dark materials were more effectively displayed using the thermal data.

Kahle, A. B.↗

DOE OSTI2021

Predictive Proxies of Present and Future Lightning in a Superparameterized Model

Abstract A superparameterized climate model is used to assess the global performance of several previously proposed proxies for lightning. In particular, predictors incorporating hydrometeor (ice, graupel) profiles and convective vertical velocities are compared to observations, then used to estimate changes in flash rates with global warming. The choice of microphysics parameterization is also investigated, with all predictors showing higher correlations with Lightning Imaging Sensor/Optical Transient Detector observations when using a 2‐moment scheme compared to a 1‐moment representation. All proxies generally agree in their response to warming over tropical land, with notable decreases in Africa, the Middle East, and northern South America, but disagree over oceans and the midlatitudes. The product of convective available potential energy and precipitation predicts increases over these latter areas, as do the 2‐moment ice‐based proxies, while those of the 1‐moment model tend to show decreases, highlighting the importance of cloud microphysics when using climate models to simulate lightning.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1974

Reversal-bounded multipushdown machines

Several representations of the recursively enumerable (r.e.) sets are presented. The first states that every r.e. set is the homomorphic image of the intersection of two linear context-free languages. The second states that every r.e. set is accepted by an on-line Turing acceptor with two pushdown stores such that in every computation, each pushdown store can make at most one reversal (that is, one change from 'pushing' to 'popping'). It is shown that this automata theoretic representation cannot be strengthened by restricting the acceptors to be deterministic multitape, nondeterministic one-tape, or nondeterministic multicounter acceptors. This provides evidence that reversal bounds are not a natural measure of computational complexity for multitape Turing acceptors.

Baker, B. S.↗

NASA NTRS2013

Memory-Efficient Onboard Rock Segmentation

Rockster-MER is an autonomous perception capability that was uploaded to the Mars Exploration Rover Opportunity in December 2009. This software provides the vision front end for a larger software system known as AEGIS (Autonomous Exploration for Gathering Increased Science), which was recently named 2011 NASA Software of the Year. As the first step in AEGIS, Rockster-MER analyzes an image captured by the rover, and detects and automatically identifies the boundary contours of rocks and regions of outcrop present in the scene. This initial segmentation step reduces the data volume from millions of pixels into hundreds (or fewer) of rock contours. Subsequent stages of AEGIS then prioritize the best rocks according to scientist- defined preferences and take high-resolution, follow-up observations. Rockster-MER has performed robustly from the outset on the Mars surface under challenging conditions. Rockster-MER is a specially adapted, embedded version of the original Rockster algorithm ("Rock Segmentation Through Edge Regrouping," (NPO- 44417) Software Tech Briefs, September 2008, p. 25). Although the new version performs the same basic task as the original code, the software has been (1) significantly upgraded to overcome the severe onboard re source limitations (CPU, memory, power, time) and (2) "bulletproofed" through code reviews and extensive testing and profiling to avoid the occurrence of faults. Because of the limited computational power of the RAD6000 flight processor on Opportunity (roughly two orders of magnitude slower than a modern workstation), the algorithm was heavily tuned to improve its speed. Several functional elements of the original algorithm were removed as a result of an extensive cost/benefit analysis conducted on a large set of archived rover images. The algorithm was also required to operate below a stringent 4MB high-water memory ceiling; hence, numerous tricks and strategies were introduced to reduce the memory footprint. Local filtering operations were re-coded to operate on horizontal data stripes across the image. Data types were reduced to smaller sizes where possible. Binary- valued intermediate results were squeezed into a more compact, one-bit-per-pixel representation through bit packing and bit manipulation macros. An estimated 16-fold reduction in memory footprint relative to the original Rockster algorithm was achieved. The resulting memory footprint is less than four times the base image size. Also, memory allocation calls were modified to draw from a static pool and consolidated to reduce memory management overhead and fragmentation. Rockster-MER has now been run onboard Opportunity numerous times as part of AEGIS with exceptional performance. Sample results are available on the AEGIS website at http://aegis.jpl.nasa.gov.

Burl, Michael C.↗

NASA NTRS1993

The SSABLE system - Automated archive, catalog, browse and distribution of satellite data in near-real time

Historically, locating and browsing satellite data has been a cumbersome and expensive process. This has impeded the efficient and effective use of satellite data in the geosciences. SSABLE is a new interactive tool for the archive, browse, order, and distribution of satellite date based upon X Window, high bandwidth networks, and digital image rendering techniques. SSABLE provides for automatically constructing relational database queries to archived image datasets based on time, data, geographical location, and other selection criteria. SSABLE also provides a visual representation of the selected archived data for viewing on the user's X terminal. SSABLE is a near real-time system; for example, data are added to SSABLE's database within 10 min after capture. SSABLE is network and machine independent; it will run identically on any machine which satisfies the following three requirements: 1) has a bitmapped display (monochrome or greater); 2) is running the X Window system; and 3) is on a network directly reachable by the SSABLE system. SSABLE has been evaluated at over 100 international sites. Network response time in the United States and Canada varies between 4 and 7 s for browse image updates; reported transmission times to Europe and Australia typically are 20-25 s.

Simpson, James J.↗

NASA NTRS2006

Automated, on-board terrain analysis for precision landings

Advances in space robotics technology hinge to a large extent upon the development and deployment of sophisticated new vision-based methods for automated in-space mission operations and scientific survey. To this end, we have developed a new concept for automated terrain analysis that is based upon a generic image enhancement platform|multi-scale retinex (MSR) and visual servo (VS) processing. This pre-conditioning with the MSR and the vs produces a "canonical" visual representation that is largely independent of lighting variations, and exposure errors. Enhanced imagery is then processed with a biologically inspired two-channel edge detection process, followed by a smoothness based criteria for image segmentation. Landing sites can be automatically determined by examining the results of the smoothness-based segmentation which shows those areas in the image that surpass a minimum degree of smoothness. Though the msr has proven to be a very strong enhancement engine, the other elements of the approach|the vs, terrain map generation, and smoothness-based segmentation|are in early stages of development. Experimental results on data from the Mars Global Surveyor show that the imagery can be processed to automatically obtain smooth landing sites. In this paper, we describe the method used to obtain these landing sites, and also examine the smoothness criteria in terms of the imager and scene characteristics. Several examples of applying this method to simulated and real imagery are shown.

Rahman, Zia-ur↗

NASA NTRS2006

Automated On-board Terrain Analysis for Precision Landings

Advances in space robotics technology hinge to a large extent upon the development and deployment of sophisticated new vision-based methods for automated in-space mission operations and scientific survey. To this end, we have developed a new concept for automated terrain analysis that is based upon a generic image enhancement platform-multi-scale Retinex (MSR) and visual servo (VS) processing. This pre-conditioning with the MSR and the VS produces a "canonical" visual representation that is largely independent of lighting variations, and exposure errors. Enhanced imagery is then processed with a biologically inspired two-channel edge detection process, followed by a smoothness based criteria for image segmentation. Landing sites can be automatically determined by examining the results of the smoothness-based segmentation which shows those areas in the image that surpass a minimum degree of smoothness. Though the MSR has proven to be a very strong enhancement engine, the other elements of the approach, the VS, terrain map generation, and smoothness-based segmentation, are in early stages of development. Experimental results on data from the Mars Global Surveyor show that the imagery can be processed to automatically obtain smooth landing sites. In this paper, we describe the method used to obtain these landing sites, and also examine the smoothness criteria in terms of the imager and scene characteristics. Several examples of applying this method to simulated and real imagery are shown.

Rahman, Zia-ur↗

DOE OSTI2022

Practical galaxy morphology tools from deep supervised representation learning

Astronomers have typically set out to solve supervised machine learning problems by creating their own representations from scratch. We show that deep learning models trained to answer every Galaxy Zoo DECaLS question learn meaningful semantic representations of galaxies that are useful for new tasks on which the models were never trained. We exploit these representations to outperform several recent approaches at practical tasks crucial for investigating large galaxy samples. The first task is identifying galaxies of similar morphology to a query galaxy. Given a single galaxy assigned a free text tag by humans (e.g. ‘#diffuse’), we can find galaxies matching that tag for most tags. The second task is identifying the most interesting anomalies to a particular researcher. Our approach is 100 per cent accurate at identifying the most interesting 100 anomalies (as judged by Galaxy Zoo 2 volunteers). The third task is adapting a model to solve a new task using only a small number of newly labelled galaxies. Models fine-tuned from our representation are better able to identify ring galaxies than models fine-tuned from terrestrial images (ImageNet) or trained from scratch. We solve each task with very few new labels; either one (for the similarity search) or several hundred (for anomaly detection or fine-tuning). This challenges the longstanding view that deep supervised methods require new large labelled data sets for practical use in astronomy. To help the community benefit from our pretrained models, we release our fine-tuning code zoobot. Zoobot is accessible to researchers with no prior experience in deep learning.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1981

The Use of Interactive Raster Graphics in the Display and Manipulation of Multidimensional Data

Techniques for the review, display, and manipulation of multidimensional data are developed and described. Multidimensional data is meant in this context to describe scalar data associated with a three dimensional geometry or otherwise too complex to be well represented by traditional graphs. Raster graphics techniques are used to display a shaded image of a three dimensional geometry. The use of color to represent scalar data associated with the geometries in shaded images is explored. Distinct hues are associated with discrete data ranges, thus emulating the traditional representation of data with isarithms, or lines of constant numerical value. Data ranges are alternatively associated with a continuous spectrum of hues to show subtler data trends. The application of raster graphics techniques to the display of bivariate functions is explored.

Anderson, D. C.↗

NASA NTRS1984

Mesoscale analysis of VAS 6.7 micron image data for several case studies

Several case studies are examined in an attempt to relate Visible infrared spin scan radiometers Atmospheric Sounder (VAS) water vapor channel radiance data to atmospheric moisture. Since the 6.7 micrometer channel detects radiation emitted by atmospheric water vapor from a rather thick layer, a scheme is developed which weighted rawinsonde observations of relative humidity in a similar manner. A comparison of the two fields (weighted relative humidity values from gridded rawinsonde observations and the VAS water vapor image) indicates that even when mesoscale data are used, the technique only presented a smooth representation of the radiance field. This weighting function is dependent on both the temperature and moisture distribution of the atmosphere. Cross sections of relative humidity from the mesoscale rawinsondes are produced which sliced the water vapor imagery in particularly interesting regions (areas of high and low blackbody temperatures). Comparisons are then made between the cross sections and the variations in the VAS radiance data along the cross section line. Bright regions in the water vapor imagery (cold blackbody temperatures) are often associated with thin layers of high relative humidity or thick layers of only moderately moist air. The reverse also applies, i.e., dark regions (warm blackbody temperatures) in the imagery corresponded well with very dry regions in the cross sections.

Jedlovec, G. J.↗

NASA NTRS1984

Mesoscale analysis of 6.7 micron image data from the VISSR Atmospheric Sounder (VAS) for several case studies

Several case studies are examined in an attempt to relate Visible infrared spin scan radiometers Atmospheric Sounder (VAS) water vapor channel radiance data to atmospheric moisture. Since the 6.7 micrometer channel detects radiation emitted by atmospheric water vapor from a rather thick layer, a scheme is developed which weighted rawinsonde observations of relative humidity in a similar manner. A comparison of the two fields (weighted relative humidity values from gridded rawinsonde observations and the VAS water vapor image) indicates that even when mesoscale data are used, the technique only presented a smooth representation of the radiance field. This weighting function is dependent on both the temperature and moisture distribution of the atmosphere. Cross sections of relative humidity from the mesoscale rawinsondes are produced which sliced the water vapor imagery in particularly interesting regions (areas of high and low blackbody temperatures). Comparisons are then made between the cross sections and the variations in the VAS radiance data along the cross section line. Bright regions in the water vapor imagery (cold blackbody temperatures) are often associated with thin layers of high relative humidity or thick layers of only moderately moist air. The reverse also applies, i.e., dark regions (warm blackbody temperatures) in the imagery corresponded well with very dry regions in the cross sections.

Jedlovec, G. J.↗

NASA NTRS1991

Spatial orientation and dynamics in virtual reality systems - Lessons from flight simulation

Artificial representations of virtual worlds are becoming more common due to advances in the technology of image generation and display systems. Application areas include flight simulation, mission rehearsal, teleoperator systems, and virtual reality systems. System developers should be forewarned that some proportion of users will experience perceptual anomalies and symptoms of motion sickness as a result of travel through virtual space.

Mccauley, Michael E.↗