Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image understanding”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Local spatial frequency analysis for computer vision

A sense of vision is a prerequisite for a robot to function in an unstructured environment. However, real-world scenes contain many interacting phenomena that lead to complex images which are difficult to interpret automatically. Typical computer vision research proceeds by analyzing various effects in isolation (e.g., shading, texture, stereo, defocus), usually on images devoid of realistic complicating factors. This leads to specialized algorithms which fail on real-world images. Part of this failure is due to the dichotomy of useful representations for these phenomena. Some effects are best described in the spatial domain, while others are more naturally expressed in frequency. In order to resolve this dichotomy, we present the combined space/frequency representation which, for each point in an image, shows the spatial frequencies at that point. Within this common representation, we develop a set of simple, natural theories describing phenomena such as texture, shape, aliasing and lens parameters. We show these theories lead to algorithms for shape from texture and for dealiasing image data. The space/frequency representation should be a key aid in untangling the complex interaction of phenomena in images, allowing automatic understanding of real-world scenes.

Krumm, John↗

Velocity filtering applied to optical flow calculations

Optical flow is a method by which a stream of two-dimensional images obtained from a forward-looking passive sensor is used to map the three-dimensional volume in front of a moving vehicle. Passive ranging via optical flow is applied here to the helicopter obstacle-avoidance problem. Velocity filtering is used as a field-based method to determine range to all pixels in the initial image. The theoretical understanding and performance analysis of velocity filtering as applied to optical flow is expanded and experimental results are presented.

Barniv, Yair↗

Using KD(asterisk)P modulators for polarization measurements of the sun

Longitudinal KD(asterisk)Ps are used in ground-based solar magnetographs to eliminate seeing effects by rapidly changing their retardation characteristics. Although one of the main applications for longitudinal KD(asteriak)Ps has been their use as a variable retarder for 'imaging' applications, an understanding of their limitations is important when developing scientific instruments that make very accurate polarization measurements. This paper discusses some of the problems associated with the use of these devices in the Marshall Space Flight Center (MSFC) vector magnetograph, including temperature, field of view errors, and electrical characteristics.

West, E. A.↗

A high-resolution radio image of a young supernova

A VLBI radio images of the bright supernova 1986J, which occurred in the galaxy NGC891 at a distance of about 12 Mpc, is presented. No detailed image of any supernova or remnant has been obtained before so soon after the explosion. The image shows a shell of emission with jetlike protrusions. Analysis of the images should advance understanding of the dynamics of the expanding debris, the dissipation of energy into the surrounding circumstellar medium, and the evolution of the supernova into the remnant.

Bartel, N.↗

Status of automatic guidance systems for rotorcraft in low altitude flight

Rotorcraft operating in high-threat environments fly close to the earth's surface to utilize surrounding terrain, vegetation, or man-made objects to minimize the risk of being detected by an enemy. The piloting of the rotorcraft is at best a very demanding task and the pilots need help from on-board automation tools in order to devote more time to mission-related activities. The Automated Nap-of-the-Earth (NOE) Flight Program is a cooperative NASA/Army program aimed at the development of technologies for enhancing piloted low-altitude/NOE flight path management and control through computer and sensor aiding. The long-term objective is to work towards achieving automation for aiding the pilot in NOE flight with a flight demonstration of resulting computer/sensor aiding concepts at an established course. The technology for pilot-centered NOE automation is not currently available. Success in automating NOE functions will depend on major breakthroughs in real-time flight path planning algorithms, effective methods for the pilot to interface to the automatic modes, understanding of visual images, sensor data processing/fusion, and sensor development. Our approach to developing the technologies required to solve this problem consist of the following phases: (1) algorithm development, (2) laboratory evaluation, (3) piloted ground simulation, and (4) evaluation in flight. An overview of the research in this area at NASA Ames Research Center is given.

Sridhar, Banavar↗

The use of interactive computer vision and robot hand controllers for enhancing manufacturing safety

Current available robotic systems provide limited support for CAD-based model-driven visualization, sensing algorithm development and integration, and automated graphical planning systems. This paper describes ongoing work which provides the functionality necessary to apply advanced robotics to automated manufacturing and assembly operations. An interface has been built which incorporates 6-DOF tactile manipulation, displays for three dimensional graphical models, and automated tracking functions which depend on automated machine vision. A set of tools for single and multiple focal plane sensor image processing and understanding has been demonstrated which utilizes object recognition models. The resulting tool will enable sensing and planning from computationally simple graphical objects. A synergistic interplay between human and operator vision is created from programmable feedback received from the controller. This approach can be used as the basis for implementing enhanced safety in automated robotics manufacturing, assembly, repair and inspection tasks in both ground and space applications. Thus, an interactive capability has been developed to match the modeled environment to the real task environment for safe and predictable task execution.

Marzwell, Neville I.↗

Seeing the Invisible with the IMAGE Mission

The Global Positioning System, communication, power transmission, and oil pipelines are only a few of the technologies upon which we depend in research and in everyday life. Each is at risk from invisible storms in near-Earth space. The astrophysical plasmas near our planet store and deliver vast amounts of energy from the Sun in the form of high energy particles, electric currents, and heating of the upper atmosphere. This natural plasma environment is the only one routinely measured in situ over the last 40 years and until recently one of the few we haven't been able to see. Much like atmospheric weather satellites brought global context to that field many decades ago, the IMAGE Mission is now revealing a global context for space weather. The contributions being made by the IMAGE Mission to understanding space weather will be presented along with a brief overview of this dynamic environment. Special emphasis will be placed on research involving the plasmasphere, a toroidal region of relatively dense, cold plasma surrounding the Earth that plays a key role in energy and mass transport through near-Earth space.

Gallagher, D. L.↗

The Geospace Dynamics Observatory; a Mission of Discovery for Geospace

A few examples of potential advances include: 1. Unparalleled advances in the connection of the upper atmosphere to the Sun. In the aurora and lower latitudes, extending the duration of uninterrupted images would advance understanding of the transfer of energy from the Sun to the upper atmosphere and the response of the space environment. 2. Advances in the influence of waves and tides on the upper atmosphere. Increasing both the signal to noise and the duration ofthe observations would reveal contributions that are not identifiable using other approaches. 3. The ability to probe the mechanisms that control the evolution of planetary atmospheres. The vantage point provided by this mission allows the flux of hydrogen (which is tied to the escape of water from a planet) to be mapped globally. It also allows unique observations of changes in the atmospheric structure and their causes.

Spann, James↗

Physical State and Distribution of Materials at the Surface of Pluto from New Horizons LEISA Imaging Spectrometer

From Earth based observations Pluto is known to be the host of N2, CH4 and CO ices and also a dark red material. Very limited spatial distribution information is available from rotational visible and near-infrared spectral curves obtained from hemispheric measurements. In July 2015 the New Horizons spacecraft reached Pluto and its satellite system and recorded a large set of data. The LEISA spectro-imager of the RALPH instruments are dedicated to the study of the composition and physical state of the materials composing the surface. In this paper we report a study of the distribution and physical state of the ices and non-ice materials on Pluto's illuminated surface and their mode and degree of mixing. Principal Component analysis as well as various specific spectral indicators and correlation plots are used on the first set of 2 high resolution spectro-images from the LEISA instrument covering the whole illuminated face of Pluto at the time of the New Horizons encounter. Qualitative distribution maps have been obtained for the 4 main condensed molecules, N2, CH4, CO, H2O as well as for the visible-dark red material. Based on specific spectral indicators, using either the strength or the position of absorption bands, these 4 molecules are found to indicate the presence of 3 different types of ices: N2-rich:CH4:CO ices, CH4-rich(:CO:N2?) ices and H2O ice. The mixing lines between these ices and with the dark red material are studied using scatter plots between the various spectral indicators. CH4 is mixed at the molecular level with N2, most probably also with CO, thus forming a ternary molecular mixture that follows its phase diagram with low solubility limits. The occurrence of a N2-rich - CH4-rich ices mixing line associated with a progressive decrease of the CO/CH4 ratio tells us that a fractionation sublimation sequence transforms one type of ice to the other forming either a N2-rich - CH4-rich binary mixture at the surface or an upper CH4-rich ice crust that may hide the N2-rich ice below. The strong CH4-rich - H2O mixing line witnesses the subsequent sublimation of the CH4-rich ice lag left behind by the N2:CO sublimation (N spring-summer), or a direct condensation of CH4 ice on the cold H2O ice (S autumn). The weak mixing line between CH4-containing ices and the dark red material and the very sharp spatial transitions between these ices and this non-volatile material are probably due to thermal incompatibility. Finally the occurrence of a H2O ice - red material mixing line advocates for a spatial mixing of the red material covering H2O ice, with possibly a small amount intimately mixed in water ice. From this analysis of the different materials distribution and their relative mixing lines, H2O ice appears to be the substratum on which other ices condense or non-volatile organic material is deposited from the atmosphere. N2-rich ices seem to evolve to CH4-dominated ices, possibly still containing traces of CO and N2, as N2 and CO sublimate away. The spatial distribution of these materials is very complex. The high spatial definition of all these composition maps, as well as those at even higher resolution that will be soon available, will allow us to compare them with Pluto's geologic features observed by LORRI panchromatic and MVIC multispectral imagers to better understand the geophysical processes in action at the surface of this astonishingly active frozen world.

Schmitt, B.↗

Wellbore Stability and Mud Loss Management in Geothermal Drilling: Optimizing Mud Weight to Mitigate Tensile Wellbore Fracturing at The Geysers, California

As part of a U.S. Department of Energy (DOE) Geothermal Technologies Office-funded initiative, Geysers Power Company, LLC, a subsidiary of Calpine Corporation, has been working to enhance drilling performance at the world’s largest geothermal field, The Geysers, in northern California. In a recent drilling operation of the GDC-36 well, excessive mud losses were encountered, initially addressed through repeated but largely ineffective cement plugging. Ultimately, the most effective strategy was to drill blind through the loss zones, made feasible by the high rate of penetration (ROP) achieved with PDC bits, allowing significant progress before the mud tanks were depleted and water-sensitive argillic formation layers could collapse. In response to these challenges, the project team explored alternative methods to minimize downtime and risks associated with cement plugging and continuous mud loss and to contemplate the driving mechanisms for the losses. Wellbore imaging using Formation MicroImager (FMI) and Ultrasonic Borehole Imager (UBI) tools revealed longitudinal tensile fractures, which were attributed to mud weights exceeding the minimum circumferential stress resulting from the native stress field and formation pressure. This study examines the mud losses encountered and leverages wellbore imaging data to understand the mechanisms behind mud induced tensile fracturing in specific rock facies. Understanding fracture behavior across different lithologies is crucial, as fractures within the reservoir can enhance steam migration throughout the system. The reservoir at The Geysers lies within the Mesozoic Franciscan Assemblage, a tectonic mélange formed by subduction. It consists of metamorphosed turbidite sandstone (greywacke) and mudstone (argillite), oceanic upper crust (including greenstone and chert), and serpentinized ultramafic rocks - each exhibiting distinct geomechanical fracturing properties. The structural fabric of the Franciscan Assemblage was shaped by low-angle Mesozoic thrust faulting and later overprinted by sub-vertical strike-slip structures related to the Pacific-North American plate boundary. A wellbore stability model was developed using core measurements and logs to simulate fracturing scenarios during drilling under varying stress conditions. These simulations guided the development of an optimized mud weight management strategy that should enable adaptive adjustments during drilling, reducing the likelihood of tensile fracturing and mud losses, ultimately improving operational efficiency.

15 GEOTHERMAL ENERGY↗

Single-molecule live-cell RNA imaging with CRISPR–Csm

Abstract Understanding the diverse dynamic behaviors of individual RNA molecules in single cells requires visualizing them at high resolution in real time. However, single-molecule live-cell imaging of unmodified endogenous RNA has not yet been achieved in a generalizable manner. Here, we present single-molecule live-cell fluorescence in situ hybridization (smLiveFISH), a robust approach that combines the programmable RNA-guided, RNA-targeting CRISPR–Csm complex with multiplexed guide RNAs for direct and efficient visualization of single RNA molecules in a range of cell types, including primary cells. Using smLiveFISH, we track individual nativeNOTCH2andMAP1Btranscripts in living cells and identify two distinct localization mechanisms including the cotranslational translocation ofNOTCH2mRNA at the endoplasmic reticulum and directional transport ofMAP1BmRNA toward the cell periphery. This method has the potential to unlock principles governing the spatiotemporal organization of native transcripts in health and disease.

Biotechnology & Applied Microbiology↗

High-speed volumetric two-photon fluorescence imaging of neurovascular dynamics

Abstract Understanding the structure and function of vasculature in the brain requires us to monitor distributed hemodynamics at high spatial and temporal resolution in three-dimensional (3D) volumes in vivo. Currently, a volumetric vasculature imaging method with sub-capillary spatial resolution and blood flow-resolving speed is lacking. Here, using two-photon laser scanning microscopy (TPLSM) with an axially extended Bessel focus, we capture volumetric hemodynamics in the awake mouse brain at a spatiotemporal resolution sufficient for measuring capillary size and blood flow. With Bessel TPLSM, the fluorescence signal of a vessel becomes proportional to its size, which enables convenient intensity-based analysis of vessel dilation and constriction dynamics in large volumes. We observe entrainment of vasodilation and vasoconstriction with pupil diameter and measure 3D blood flow at 99 volumes/second. Demonstrating high-throughput monitoring of hemodynamics in the awake brain, we expect Bessel TPLSM to make broad impacts on neurovasculature research.

59 BASIC BIOLOGICAL SCIENCES↗

Transforming Our Understanding of the X-ray Universe: The Imaging X-ray Polarimeter Explorer (IXPE)

Accurate X-ray polarimetry can provide unique information on high-energy-astrophysical processes and sources. As there have been no meaningful X-ray polarization measurements of cosmic sources since our pioneering work in the 1970's, the time is ripe to explore this new parameter space in X-ray astronomy. To accomplish this requires a well-calibrated and well understood system that-particularly for an Explorer mission-has technical, cost, and schedule credibility. The system that we shall present satisfies these conditions, being based upon completely calibrated imaging- and polarization-sensitive detectors and proven X-ray-telescope technology.

Weisskopf, Martin C.↗

On the problem of embedding picture elements in regions

A few new algorithms for region growing in pictures were developed. These algorithms are a step toward finding a satisfactory solution to the image segmentation problem, and in-depth understanding of the problems of nonsemantic image segmentation. The algorithms utilize a sequential decision approach for region boundaries detection. The sequential decisions are supported by a stochastic algorithm that maintains local statistics of the region near the boundaries as the region grows. A few illustrations of the algorithm's performance are included.

Yakimovsky, Y.↗

Concept-based Analysis of Neural Networks via Vision-Language Models

The analysis of vision-based deep neural networks (DNNs) is highly desirable but it is very challenging due to the difficulty of expressing formal specifications for vision tasks and the lack of efficient verification procedures. In this paper, we propose to leverage emerging multimodal, vision-language, foundation models (VLMs) as a lens through which we can reason about vision models. VLMs have been trained on a large body of images accompanied by their textual description, and are thus implicitly aware of high-level, human-understandable concepts describing the images. We describe a logical specification language Con spec designed to facilitate writing specifications in terms of these concepts. To define and formally check Con spec specifications, we build a map between the internal representations of a given vision model and a VLM, leading to an efficient verification procedure of natural-language properties for vision models. We demonstrate our techniques on a ResNet-based classifier trained on the RIVAL-10 dataset using CLIP as the multimodal model.

Large Vision Language Models↗

Some characteristics and advantages of LANDSAT 3 return beam vidicon images

One advantage of a LANDSAT 3 return beam vidicon (RBV) scene is the synoptic view it provides. A 1:500,000 paper print of the size 19.4 cm x 19.4 cm encompasses an area of about 3,721 square miles (9,637 sq. km.) and this compares very favorably in coverage to small scale aerial photography. A second important advantage is that the ground resolution is 38 by 38 meters. Compared to the resolution of the MSS which is 79 by 79 meters the RBV provides a wealth of detail useful for many purposes. A great variety of man made structures are visible including bridges, roads, docks, and small airfields. Agricultural field patterns are clear and settlements of various sizes can be identified and delineated. A third advantage is related to the approximate panchromatic spectral response displayed in RBV images. Since many aerial photographic interpreters are accustomed to working with panchromatic photographs, they should have no difficulty understanding and putting RBV images immediately into use.

Baker, S.↗

High Resolution Three-Color Imaging of Spirals With Nuclear Star-Forming Rings

Nuclear rings in barred spirals offer an opportunity to study starburst properties in order to develop an understanding of the evolution of star formation in galaxies. To achieve this understanding, a large scale imaging survey in the H alpha line and in the B and I broad bands has been performed. Analysis of all galaxies that reveal nuclear rings in the H alpha line will be compared to numerical models so that the relative ages between the starforming clumps can be estimated. The luminosity function of the starforming regions will be related to the measured properties of the associated star-cluster and the required ionizing flux. Also B - I color index images will be performed to indicate the location of the dust lanes.

Mazzuca, Lisa↗