SEARCH · Engineering Papers

Results for “stereo cameras, stereo reconstruction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Principles of stereo reconstruction of aerial objects using stationary cameras

An overview is given here of the principles and mathematics of stereo reconstruction of objects in the sky using stationary cameras with an emphasis on meteorological applications. Through its Atmospheric Radiation Measurement program, the Department of Energy has operated stereo-photogrammetric cameras since 2017 as part of an effort to measure the life-cycle properties of clouds. At the core of that technology is stereo reconstruction, which calculates the real-world position of an object from the location of the object’s image in two cameras’ photographs. Here, stereo reconstruction is stripped down to its basic elements and presented using conventions tailored to applications in atmospheric science. In addition, the resulting equations are used to illustrate the high sensitivity of reconstructed cloud positions to errors in the cameras’ Euler angles. The interested reader will find here a self-contained guide to performing stereo reconstructions using distortion-corrected images from a pair of calibrated, stationary cameras, as well as a demonstration of the need for high accuracy in the measurement of camera properties and orientations.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

cogs.c1

COGS is a four-dimensional (4D) map of cloudiness generated by multiview stereo reconstruction using the ARM stereo camera ring at the Southern Great Plains (SGP) atmospheric observatory. These data are particularly useful for studies of the life cycles and macrophysical attributes of shallow cumulus clouds. COGS covers a 6 km x 6 km x 6 km region at the SGP Central Facility centered at the position of the Doppler lidar.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Stereo Cameras for Clouds (STEREOCAM) Instrument Handbook

The three pairs of stereo camera setups aim to provide synchronized and stereo calibrated time series of images that can be used for 3D cloud mask reconstruction. Each camera pair is positioned at approximately 120 degrees from the other pair, with a 17o-19o pitch angle from the ground, and at 5-6 km distance from the U.S. Department of Energy (DOE) Central Facility at the Atmospheric Radiation Measurement (ARM) Climate Research Facility Southern Great Plains (SGP) observatory to cover the region from northeast, northwest, and southern views. Images from both cameras of the same stereo setup can be paired together to obtain 3D reconstruction by triangulation. 3D reconstructions from the ring of three stereo pairs can be combined together to generate a 3D mask from surrounding views. This handbook delivers all stereo reconstruction parameters of the cameras necessary to make 3D reconstructions from the stereo camera images.

47 OTHER INSTRUMENTATION↗

DOE OSTI2021

Summertime Continental Shallow Cumulus Cloud Detection Using GOES-16 Satellite and Ground-Based Stereo Cameras at the DOE ARM Southern Great Plains Site

Summertime continental shallow cumulus clouds (ShCu) are detected using Geostationary Operational Environmental Satellite (GOES)-16 reflectance data, with cross-validation by observations from ground-based stereo cameras at the Department of Energy Atmospheric Radiation Measurement Southern Great Plains site. A ShCu cloudy pixel is identified when the GOES reflectance exceeds the clear-sky surface reflectance by a reflectance detection threshold of ShCu, ΔR. We firstly construct diurnally varying clear-sky surface reflectance maps and then estimate the ΔR. A GOES simulator is designed, projecting the clouds reconstructed by stereo cameras towards the surface along the satellite’s slanted viewing direction. The dynamic ShCu detection threshold ΔR is determined by making the GOES cloud fraction (CF) equal to the CF from the GOES simulator. Although there are temporal variabilities in ΔR, cloud fractions and cloud size distributions can be well reproduced using a constant ΔR value of 0.045. The method presented in this study enables daytime ShCu detection, which is usually falsely reported as clear sky in the GOES-16 cloud mask data product. Using this method, a new ShCu dataset can be generated to bridge the observational gap in detecting ShCu, which may transition into deep precipitating clouds, and to facilitate further studies on ShCu development over heterogenous land surface.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Confronting Large‐Eddy Simulations With Stereo Camera Data by Means of Reconstructed Hemispheric Cloud Size Distributions

High-resolution hemispheric camera images at a meteorological site in western Germany are used to analyze the multi-dimensional spatial characteristics of continental cumulus cloud fields, and to evaluate Large-Eddy Simulations on this aspect. Traditional non-hemispheric cloud-detecting instruments provide additional reference data. The main model-observation comparison focuses on cloud size distributions (CSDs), employing two methods: (a) directly using three-dimensional model fields, direct CSDs, and (b) using rendered hemispheric images of the model fields as produced by a camera simulator based on path-tracing. In the latter method, both the real and rendered images are used to three-dimensionally reconstruct the cloud fields, yielding hemispheric CSDs. Advantages of hemispheric comparisons over more classic approaches include (a) fair comparisons between model and data, and (b) full use of the enhanced resolutions and hemispheric spatial coverage of the camera imagery. Basic evaluation of the simulations demonstrates good agreement on thermodynamic structure and its diurnal cycle. Cloud heights and cloud cover are intercompared between the model, camera data and other instrumentation, providing insight into their structural differences. A consistent alignment is found between the hemispheric CSDs from both the model and the cameras. Power law fits reveal structurally lower exponents in hemispheric CSDs compared to non-hemispheric CSDs, which particularly caution against directly comparing hemispheric CSDs to non-hemispheric distributions. This result is robust for sample size and fitting method. These findings inform future use of hemispheric camera systems for studying cumulus cloud field morphology and model evaluation.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Principles of stereo reconstruction of aerial objects using stationary cameras

Explore the source record for details and available documents.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

A Stereo Camera Simulator for Large-Eddy Simulations of Continental Shallow Cumulus Clouds Based on Three-Dimensional Path-Tracing

The complex spatial and temporal structure of cumulus clouds complicates their representation in weather and climate models. Classic meteorological instrumentation struggles to fully capture these features. Networks of multiple high-resolution hemispheric cameras are increasingly used to fill this data gap, and provide information on this missing multi-dimensional spatial information. In this study, a path-tracing algorithm is used to generate virtual camera images of resolved clouds in large-eddy simulations (LES). These images are then used as a camera network simulator, allowing reconstructions of three-dimensional cloud edges from the model output. Because the actual LES cloud field is fully known, the combined path-tracing and reconstruction method can be statistically analyzed. The method is applied to LES realizations of summertime shallow cumulus at the Jülich Observatory for Cloud Evolution (JOYCE), Germany, which also routinely operates a camera network. We find that the path-tracing method allows accurate reconstruction of up to 70% of the visible cloud edges. Additional sensitivity tests show that the method is robust for changes in its hyperparameters. The sensitivity to cloud optical thickness is also investigated, finding a cloud boundary placement error of approximately 182 m. This error can be considered typical for cloud boundary reconstruction using real stereo camera imagery. The results provide proof of principle for future use of the method for evaluating LES clouds against camera network imagery, and for further optimizing the configuration of such camera networks.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Point Cloud of Cloud Points (PCCP) Value-Added Product Report

In this report, we refer to a pair of cameras that capture synchronized pictures with overlapping fields of view (FOV) as a stereo pair. Each stereo pair independently performs a stereo reconstruction of cloud points. Currently, there are three U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility stereo pairs (six cameras in total) positioned around the Southern Great Plains (SGP) observatory’s Central Facility (CF; Romps and Oktem 2017). Time-synchronized pictures from the two cameras in a stereo pair can be paired together to obtain a three-dimensional (3D) reconstruction of feature points by triangulation. This document explains how we use ARM stereo cameras and stereophotogrammetric principles to generate the Point Cloud of Cloud Points (PCCP) Value-Added Product (VAP). The PCCP VAP is essentially a set of 3D positions representing the locations of cloud features in the sky. Thousands of cloud features can be reconstructed instantly in each stereo pair's FOV, which covers an area of tens of square kilometers. Cloud base and cloud top heights can be extracted from the PCCP product.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Retrieving Point Cloud of Cloud Points (PCCP) Value-Added Product from Stereo Cameras

42 ENGINEERING↗

NASA NTRS1973

Robot vision.

The work reported had been undertaken to develop hardware that would guide an automatic vehicle in the exploration of the surface of Mars, recognize objects, and report the findings to earth. Approaches for automatically determining the range and shape of objects are discussed, giving attention to the automatic comparison of one scan line of the left with one scan line of the right TV image. Methods of mapping binocular space into match space are considered together with the use of a model in match space, rules for processing random-dot stereograms, the elimination of spurious matches, random-square stereograms, questions of the processing of a real scene, and aspects of range accuracy. Methods of computation for extracting other features are also discussed along with stereo TV cameras and approaches for reconstructing the appearance of a scene.

Sutro, L. L.↗

NASA NTRS2012

Dig Hazard Assessment Using a Stereo Pair of Cameras

This software evaluates the terrain within reach of a lander s robotic arm for dig hazards using a stereo pair of cameras that are part of the lander s sensor system. A relative level of risk is calculated for a set of dig sectors. There are two versions of this software; one is designed to run onboard a lander as part of the flight software, and the other runs on a PC under Linux as a ground tool that produces the same results generated on the lander, given stereo images acquired by the lander and downlinked to Earth. Onboard dig hazard assessment is accomplished by executing a workspace panorama command sequence. This sequence acquires a set of stereo pairs of images of the terrain the arm can reach, generates a set of candidate dig sectors, and assesses the dig hazard of each candidate dig sector. The 3D perimeter points of candidate dig sectors are generated using configurable parameters. A 3D reconstruction of the terrain in front of the lander is generated using a set of stereo images acquired from the mast cameras. The 3D reconstruction is used to evaluate the dig goodness of each candidate dig sector based on a set of eight metrics. The eight metrics are: 1. The maximum change in elevation in each sector, 2. The elevation standard deviation in each sector, 3. The forward tilt of each sector with respect to the payload frame, 4. The side tilt of each sector with respect to the payload frame, 5. The maximum size of missing data regions in each sector, 6. The percentage of a sector that has missing data, 7. The roughness of each sector, and 8. Monochrome intensity standard deviation of each sector. Each of the eight metrics forms a goodness image layer where the goodness value of each sector ranges from 0 to 1. Goodness values of 0 and 1 correspond to high and low risk, respectively. For each dig sector, the eight goodness values are merged by selecting the lowest one. Including the merged goodness image layer, there are nine goodness image layers for each stereo pair of mast images.

Rankin, Arturo L.↗

NASA NTRS2004

Systematic Errors in Stereo PIV When Imaging through a Glass Window

This document assesses the magnitude of velocity measurement errors that may arise when performing stereo particle image velocimetry (PIV) with cameras viewing through thick, refractive window and where the calibration is performed in one plane only. The effect of the window is to introduce a refractive error that increases with window thickness and the camera angle of incidence. The calibration should be performed while viewing through the test section window, otherwise a potentially significant error may be introduced that affects each velocity component differently. However, even when the calibration is performed correctly, another error may arise during the stereo reconstruction if the perspective angle determined for each camera does not account for the displacement of the light rays as they refract through the thick window. Care should be exercised when applying in a single-plane calibration since certain implicit assumptions may in fact require conditions that are extremely difficult to meet in a practical laboratory environment. It is suggested that the effort expended to ensure this accuracy may be better expended in performing a more lengthy volumetric calibration procedure, which does not rely upon the assumptions implicit in the single plane method and avoids the need for the perspective angle to be calculated.

Green, Richard↗

NASA NTRS1989

Moments applied in the manual assembly of space structures - Ease biomechanics results from STS-61B

Measurements of the level and pattern of moments applied in the manual assembly of a space structure were made in extravehicular activity (EVA) and neutral buoyancy simulation (NBS). The Experimental Assembly of Structures in EVA program included the repeated assembly of a 3.6 m tetrahedral truss structure in EVA on STS-61B after extensive neutral buoyancy crew training. The flight and training structures were of equivalent mass and geometry to allow a direct correlation between EVA and NBS performance. A stereo photographic motion camera system was used to reconstruct in three dimensions rotational movements of structural beams during assembly. Moments applied in these manual handling tasks were calculated on the basis of the reconstructed movements taking into account effects of inertia, drag and virtual mass. Applied moments of 2.0 Nm were typical for beam rotations in EVA. Corresponding applied moments in NBS were typically up to five times greater. Moments were applied as impulses separated by several seconds of coasting in both EVA and NBS. Decelerating impulses were only infrequently observed in NBS.

Cousins, D.↗

NASA NTRS2024

Lensless Particle Image Velocimetry

The application of lensless imaging to particle image velocimetry (PIV) is demonstrated. Lensless PIV eliminates the need for imaging lenses to measure flow fields near a surface. Only the camera sensor, a thin mask, and computations are required to image particles in a flow field and to compute the velocity field. The small form factor could enable embedded sensors for near-wall measurements. Flow field measurements are obtained simultaneously for a lensless system and lens-based 2D PIV system, and several different reconstruction techniques are demonstrated. The reconstructed particle images and computed velocity fields compare well for both a uniform and shear flow. The potential for stereo and 3D volumetric PIV with a single camera sensor is demonstrated through different image reconstruction approaches.

Lensless imaging↗

NASA NTRS2011

Orthographic Stereo Correlator on the Terrain Model for Apollo Metric Images

A stereo correlation method on the object domain is proposed to generate the accurate and dense Digital Elevation Models (DEMs) from lunar orbital imagery. The NASA Ames Intelligent Robotics Group (IRG) aims to produce high-quality terrain reconstructions of the Moon from Apollo Metric Camera (AMC) data. In particular, IRG makes use of a stereo vision process, the Ames Stereo Pipeline (ASP), to automatically generate DEMs from consecutive AMC image pairs. Given camera parameters of an image pair from bundle adjustment in ASP, a correlation window is defined on the terrain with the predefined surface normal of a post rather than image domain. The squared error of back-projected images on the local terrain is minimized with respect to the post elevation. This single dimensional optimization is solved efficiently and improves the accuracy of the elevation estimate.

Terrain Model↗

NASA NTRS2001

(Almost) Featureless Stereo: Calibration and Dense 3D Reconstruction Using Whole Image Operations

The conventional approach to shape from stereo is via feature extraction and correspondences. This results in estimates of the camera parameters and a typically spare estimate of the surface. Given a set of calibrated images, a dense surface reconstruction is possible by minimizing the error between the observed image and the image rendered from the estimated surface with respect to the surface model parameters. Given an uncalibrated image and an estimated surface, the camera parameters can be estimated by minimizing the error between the observed and rendered images a function of the camera parameters. We use a very small dense set of matched features to provide camera parameter estimates for the initial dense surface estimate. We then re-estimate the camera parameters as described above, and then re-estimate the surface. This process is iterated. Whilst it can not be proven to converge, we have found that around three iterations results in excellent surface and camera parameters estimates.

Smelyanskiy, V. N.↗

NASA NTRS2021

Dense 3D-Reconstruction from Monocular Image Sequences for Computationally Constrained UAS

The ability to find safe landing sites over complex 3D terrain is an essential safety feature for fully autonomous small unmanned aerial systems (UAS), which requires on-board perception for 3D reconstruction and terrain analysis if the overflown terrain is unknown. This is a challenge for UAS that are limited in size, weight and computational power, such as small rotorcrafts executing autonomous missions on Earth, or in planetary applications such as the Mars Helicopter. For such a computationally constraint system, we propose a structure from motion approach that uses inputs from a single downward facing camera to produce dense point clouds of the overflown terrain in real time. In contrast to existing approaches, our method uses metric pose information from a visual-inertial odometry algorithm as camera pose priors, which allows deploying a fast pose refinement step to align camera frames such that a conventional stereo algorithm can be used for dense 3D reconstruction. We validate the performance of our approach with extensive evaluations in simulation, and demonstrate the feasibility with data from UAS flights.

Brockers, Roland↗

NASA NTRSDate not supplied

Three Dimensional Instantaneous Spray Measurements of Additively Manufactured Candidate Injector Schemes at Varying Pressure Drops

Additively manufactured (AM) injectors have the potential to improve upon the combustion performance achieved using traditionally manufactured (TM) injectors. Traditionally manufactured injector combustion performance decreases greatly in off-design conditions. Additively manufactured injectors hold the potential to sustain high combustion performance over a broader range of operating conditions than currently seen in TM injectors. Additively manufactured injectors promise to offer higher resistances to instability and achieve better overall propellant mixing and atomization for all types of combustion devices. This study expands upon previous studies that used 2-D imaging techniques to characterize the injector spray pattern of candidate AM injector elements. In this study, 3-D instantaneous measurements of the injector spray pattern are taken, allowing for deeper insight into the liquid spray breakup, an inherently 3-D phenomena. Stereo imaging is used for three dimensional analysis, which utilizes two cameras at different angles to reconstruct a three dimensional reconstruction. With this information, AM injectors can be designed to improve propellant mixing and atomization and reduce breakup length. As part of this work, a high-pressure, cold flow experimental spray facility was modified to measure each injector’s spray characteristics in terms of 𝑅𝑒 𝐿 and 𝑊𝑒 𝑔 . This facility is operated to capture instantaneous stereo photographic images, mass flow rates, and injector element thrust for pressure drop across the injector face ranging from 100 to 200 psig at a stiffness ratio of 1.0.

Murphy Mitchell↗