Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “CAMERAS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Camera modeling, centroiding performance, and geometric camera calibration on ASTERIA

The Arcsecond Space Telescope Enabling Research in Astrophysics (ASTERIA) is a 10-kg, 6U CubeSat in low-Earth orbit that was able to achieve subarcsecond pointing stability and repeatability. To date, this is the best pointing on a spacecraft of its size. This paper will analyze various aspects of the performance of its key piece of hardware—the payload. First,a model of the optics and imager, which is used to simulate stellar images, will be presented. The imager parameters used in this model were derived from simple ground measurements. Next, a centroiding algorithm is provided and used on the simulated images to predict centroiding performance. These results will be shown to match on-orbit telemetry of centroiding performance, validating the modeling approach. This paper will then describe an approach for and results of a geometric camera calibration algorithm to estimate the focal length,distortion,and alignment parameters. The modeling, analyses, and results presented in this paper provide key information that can be used in a time domain pointing simulation or a frequency-domain pointing error analysis.

Smith, Matthew W.↗

Situational Awareness from a Low-Cost Camera System

A method gathers scene information from a low-cost camera system. Existing surveillance systems using sufficient cameras for continuous coverage of a large field necessarily generate enormous amounts of raw data. Digitizing and channeling that data to a central computer and processing it in real time is difficult when using low-cost, commercially available components. A newly developed system is located on a combined power and data wire to form a string-of-lights camera system. Each camera is accessible through this network interface using standard TCP/IP networking protocols. The cameras more closely resemble cell-phone cameras than traditional security camera systems. Processing capabilities are built directly onto the camera backplane, which helps maintain a low cost. The low power requirements of each camera allow the creation of a single imaging system comprising over 100 cameras. Each camera has built-in processing capabilities to detect events and cooperatively share this information with neighboring cameras. The location of the event is reported to the host computer in Cartesian coordinates computed from data correlation across multiple cameras. In this way, events in the field of view can present low-bandwidth information to the host rather than high-bandwidth bitmap data constantly being generated by the cameras. This approach offers greater flexibility than conventional systems, without compromising performance through using many small, low-cost cameras with overlapping fields of view. This means significant increased viewing without ignoring surveillance areas, which can occur when pan, tilt, and zoom cameras look away. Additionally, due to the sharing of a single cable for power and data, the installation costs are lower. The technology is targeted toward 3D scene extraction and automatic target tracking for military and commercial applications. Security systems and environmental/ vehicular monitoring systems are also potential applications.

Freudinger, Lawrence C.↗

Measuring Positions of Objects using Two or More Cameras

An improved method of computing positions of objects from digitized images acquired by two or more cameras (see figure) has been developed for use in tracking debris shed by a spacecraft during and shortly after launch. The method is also readily adaptable to such applications as (1) tracking moving and possibly interacting objects in other settings in order to determine causes of accidents and (2) measuring positions of stationary objects, as in surveying. Images acquired by cameras fixed to the ground and/or cameras mounted on tracking telescopes can be used in this method. In this method, processing of image data starts with creation of detailed computer- aided design (CAD) models of the objects to be tracked. By rotating, translating, resizing, and overlaying the models with digitized camera images, parameters that characterize the position and orientation of the camera can be determined. The final position error depends on how well the centroids of the objects in the images are measured; how accurately the centroids are interpolated for synchronization of cameras; and how effectively matches are made to determine rotation, scaling, and translation parameters. The method involves use of the perspective camera model (also denoted the point camera model), which is one of several mathematical models developed over the years to represent the relationships between external coordinates of objects and the coordinates of the objects as they appear on the image plane in a camera. The method also involves extensive use of the affine camera model, in which the distance from the camera to an object (or to a small feature on an object) is assumed to be much greater than the size of the object (or feature), resulting in a truly two-dimensional image. The affine camera model does not require advance knowledge of the positions and orientations of the cameras. This is because ultimately, positions and orientations of the cameras and of all objects are computed in a coordinate system attached to one object as defined in its CAD model.

Klinko, Steve↗

Geocam Space: Enhancing Handheld Digital Camera Imagery from the International Space Station for Research and Applications

Handheld astronaut photography of the Earth has been collected from the International Space Station (ISS) since 2000, making it the most temporally extensive remotely sensed dataset from this unique Low Earth orbital platform. Exclusive use of digital handheld cameras to perform Earth observations from the ISS began in 2004. Nadir viewing imagery is constrained by the inclined equatorial orbit of the ISS to between 51.6 degrees North and South latitude, however numerous oblique images of land surfaces above these latitudes are included in the dataset. While unmodified commercial off-the-shelf digital cameras provide only visible wavelength, three-band spectral information of limited quality current cameras used with long (400+ mm) lenses can obtain high quality spatial information approaching 2 meters/ground pixel resolution. The dataset is freely available online at the Gateway to Astronaut Photography of Earth site (http://eol.jsc.nasa.gov), and now comprises over 2 million images. Despite this extensive image catalog, use of the data for scientific research, disaster response, commercial applications and visualizations is minimal in comparison to other data collected from free-flying satellite platforms such as Landsat, Worldview, etc. This is due primarily to the lack of fully-georeferenced data products - while current digital cameras typically have integrated GPS, this does not function in the Low Earth Orbit environment. The Earth Science and Remote Sensing (ESRS) Unit at NASA Johnson Space Center provides training in Earth Science topics to ISS crews, performs daily operations and Earth observation target delivery to crews through the Crew Earth Observations (CEO) Facility on board ISS, and also catalogs digital handheld imagery acquired from orbit by manually adding descriptive metadata and determining an image geographic centerpoint using visual feature matching with other georeferenced data, e.g. Landsat, Google Earth, etc. The lack of full geolocation information native to the data makes it difficult to integrate astronaut photographs with other georeferenced data to facilitate quantitative analysis such as urban land cover/land use classification, change detection, or geologic mapping. The manual determination of image centerpoints is both time and labor-intensive, leading to delays in releasing geolocated and cataloged data to the public, such as the timely use of data for disaster response. The GeoCam Space project was funded by the ISS Program in 2015 to develop an on-orbit hardware and ground-based software system for increasing the efficiency of geolocating astronaut photographs from the ISS (Fig. 1). The Intelligent Robotics Group at NASA Ames Research Center leads the development of both the ground and on-orbit systems in collaboration with the ESRS Unit. The hardware component consists of modified smartphone elements including cameras, central processing unit, wireless Ethernet, and an inertial measurement unit (gyroscopes/accelerometers/magnetometers) reconfigured into a compact unit that attaches to the base of the current Nikon D4 camera - and its replacement, the Nikon D5 - and connects using the standard Nikon peripheral connector or USB port. This provides secondary, side and downward facing cameras perpendicular to the primary camera pointing direction. The secondary cameras observe calibration targets with known internal X, Y, and Z position affixed to the interior of the ISS to determine the camera pose corresponding to each image frame. This information is recorded by the GeoCam Space unit and indexed for correlation to the camera time recorded for each image frame. Data - image, EXIF header, and camera pose information - is transmitted to the ground software system (GeoRef) using the established Ku-band USOS downlink system. Following integration on the ground, the camera pose information provides an initial geolocation estimate for the individual film frame. This new capability represents a significant advance in geolocation from the manual feature-matching approach for both nadir and off-nadir viewing imagery. With the initial geolocation estimate, full georeferencing of an image is completed using the rapid tie-pointing interface in GeoRef, and the resulting data is added to the Gateway to Astronaut Photography of Earth online database in both Geotiff and Keyhole Markup Language (kml) formats. The integration of the GeoRef software component of Geocam Space into the CEO image cataloging workflow is complete, and disaster response imagery acquired by the ISS crew is now fully georeferenced as a standard data product. The on-orbit hardware component (GeoSens) is in final prototyping phase, and is on-schedule for launch to the ISS in late 2016. Installation and routine use of the Geocam Space system for handheld digital camera photography from the ISS is expected to significantly improve the usefulness of this unique dataset for a variety of public- and private-sector applications.

Stefanov, William L.↗

The Use of Long-wave Infrared Cameras for Hazardous Waste Remediation - 20457

For over fifty years, infrared cameras have been used in military applications, nondestructive testing, condition monitoring, and predictive maintenance. As infrared cameras continue to become more sophisticated and less expensive, they are providing value in an ever-increasing variety of unique applications, including hazardous waste remediation. This paper describes several instances of how infrared cameras have been used within the US Department of Defense and the US Department of Energy in support of waste remediation projects, including the author's recent use of an infrared camera in support of the Calcine Retrieval Project at the Idaho National Laboratory. Infrared cameras provide images of infrared radiation, or heat energy, which is otherwise invisible to the unaided eye. Infrared radiation is part of the electromagnetic spectrum, which includes visible light. But unlike visible light, infrared has wavelengths longer than the human eye can detect. Infrared is emitted by everything with a temperature above absolute zero (-273 deg. C, or -459 deg. F); the higher the temperature, the greater the infrared thermal radiation, or heat, that is emitted. Even objects that feel cold to us, like ice, emit thermal radiation and can be imaged by infrared cameras. These cameras are typically used to look for abnormally hot or cold spots on a component or target area under normal operating conditions. The method provides a rapid, wide-area, noncontact technique for identifying problems associated with a temperature differential. All infrared cameras can provide qualitative thermal information by displaying relative differences in temperatures within a two-dimensional image. More expensive infrared cameras can also provide quantitative information where an absolute temperature value is assigned to each pixel associated with the displayed two-dimensional image. Proper camera calibration and a solid understanding of heat transfer and thermography techniques are required when using an infrared camera to obtain quantitative information. Case studies outlined in this paper include the rapid, non-intrusive detection of hazardous decontamination solution within one-ton shipping containers at Pine Bluff Arsenal, the non-intrusive identification of residual elemental sodium within the cooling loops of the Experimental Breeder Reactor II (EBR-II) reactor at the Idaho National Laboratory, process monitoring of heat exchanger melt-and-drain efforts during EBR-II decommissioning, and the remote detection of internal steel supports within calcine storage bins prior to bin penetration. For each use of thermography, the author describes a summary of the waste remediation effort, the infrared camera used, the thermal imaging technique employed, and the results obtained. The paper concludes with a discussion on common mistakes to avoid for similar applications of thermography. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Camera Calibration and Alignment Metrology at Johnson Space Center’s Electro-Optics Laboratory

It is increasingly common to see spacecraft equipped with cameras for the purpose of navigation. Images are either sent to Earth or processed autonomously on-board to provide information about the vehicle’s position, velocity, and/or attitude. These can be images of stars or celestial bodies for absolute navigation, or images of another spacecraft for relative navigation. While monocular cameras do not provide range information, the images they capture can be processed to determine bearing vectors to target objects within the camera’s field of view. For a camera to be effective in navigation, it must be carefully calibrated and aligned. This involves accurately modeling the optical effects that govern the projection of line-of-sight directions onto the camera’s pixels and determining the camera’s orientation relative to the spacecraft’s reference frame. Engineers at Johnson Space Center’s Electro-Optics Lab regularly perform camera inspection, calibration, and alignment metrology. This was done for the Orion Optical Navigation (OpNav) Camera, the Orion Docking Camera (DCAM), and for numerous cameras belonging to commercial partners. The nature of optical navigation means that cameras must be well-calibrated and their attitude well understood to provide high accuracy bearing measurements to the navigation filter. The stringent accuracy requirements for Orion could not have been met using traditional checkerboard camera calibration or by simply relying on design drawings. This paper details the hardware, software, techniques, and algorithms used by the EOL team to achieve this level of accuracy.

Paul D Mckee↗

Camera Calibration and Alignment Metrology at Johnson Space Center’s Electro-Optics Laboratory

It is increasingly common to see spacecraft equipped with cameras for the purpose of navigation. Images are either sent to Earth or processed autonomously on-board to provide information about the vehicle’s position, velocity, and/or attitude. These can be images of stars or celestial bodies for absolute navigation, or images of another spacecraft for relative navigation. While monocular cameras do not provide range information, the images they capture can be processed to determine bearing vectors to target objects within the camera’s field of view. For a camera to be effective in navigation, it must be carefully calibrated and aligned. This involves accurately modeling the optical effects that govern the projection of line-of-sight directions onto the camera’s pixels and determining the camera’s orientation relative to the spacecraft’s reference frame. Engineers at Johnson Space Center’s Electro-Optics Lab regularly perform camera inspection, calibration, and alignment metrology. This was done for the Orion Optical Navigation (OpNav) Camera, the Orion Docking Camera (DCAM), and for numerous cameras belonging to commercial partners. The nature of optical navigation means that cameras must be well-calibrated and their attitude well understood to provide high accuracy bearing measurements to the navigation filter. The stringent accuracy requirements for Orion could not have been met using traditional checkerboard camera calibration or by simply relying on design drawings. This paper details the hardware, software, techniques, and algorithms used by the EOL team to achieve this level of accuracy.

Paul McKee↗

The Use of Thermal Cameras for Pedestrian Detection

Visible-range camera sensors have been widely used for pedestrian detection. However, most of the methods, which employ visible-range color cameras, do not perform well under low-light and no-light conditions, e.g. during night time. Since the working principle of thermal camera sensors is mainly based on temperature and not light, they have been employed for person detection to overcome the drawbacks of visible-range sensors under these conditions. Every object gives off thermal energy, which is captured by a thermal camera sensor. When an object becomes hotter, it emits more thermal energy, and is therefore captured as much brighter or vice versa. Yet, compared to visible-range cameras, there are many additional challenges that need to be addressed when detecting pedestrians from thermal camera images. These challenges include bright hot objects close to humans, similar pixel values in an image due to weather conditions, or objects that block thermal cameras such as concrete or glass. Glass acts like a mirror for infrared radiation and reflects whatever is in front of the camera. Thus, novel methods are still required to accomplish pedestrian detection task from thermal camera images. To contribute to these efforts, we propose a new method and a modified object detection network incorporating saliency maps of thermal camera images. The features obtained from thermal images and their corresponding saliency maps are combined to obtain richer representations of pedestrian regions, and better detection performance. We perform extensive evaluations on five different datasets to compare the performance of the proposed approach with two baselines. Moreover, we evaluate and compare the transferability of these approaches by doing leave-one-out cross validation across different datasets. Furthermore, the results show that the proposed approach outperforms the baselines, and has better transferability properties across different thermal image datasets.

47 OTHER INSTRUMENTATION↗

Raccoon density estimation from camera traps for raccoon rabies management

Abstract Density estimation for unmarked animals is particularly challenging, yet density estimates are often necessary for effective wildlife management. Raccoons ( Procyon lotor ) are the primary terrestrial wildlife reservoir for Lyssavirus rabies within the United States. The raccoon rabies variant (RRVV) is actively managed at landscape scales using oral rabies vaccination (ORV) within the eastern United States. To effectively manage RRVV, it is important to know the density of raccoons to appropriately scale the density of ORV baits distributed on the landscape. We compared methods to estimate raccoon densities from camera‐trap data versus more intensive capture‐mark‐recapture (CMR) estimates across 2 land cover types (upland pine and bottomland hardwood) in the southeastern United States during 2019 and 2020. We evaluated the effect of alternative camera configurations and durations of camera trapping on density estimates and used an N‐mixture model to estimate raccoon densities, including covariates on abundance and detection. We further compared different methods of scaling camera‐based counts, with the maximum number of raccoons seen on any given image within a day best explaining density. Camera‐trap density estimates were moderately correlated with CMR estimates ( r = 0.56). However, densities from camera‐trap data were more reliable when classifying category of density as an index used to inform management (83% correct when compared to CMR estimates), although the densities in our study fell into the 2 lowest density classes only. Using more cameras reduced bias and uncertainty around density estimates; however, if ≤6 camera traps were used at a site, a line transect approach proved less biased than a grid design. Camera trapping should be conducted for at least 3 weeks for more accurate estimates of raccoon population density in our study area (<5% bias). We show that camera‐trap data can be used to assign raccoon densities to management‐relevant density index bins, but more studies are needed to ensure reliability across a greater range of environmental conditions and raccoon densities.

Davis, Amy J.↗

Deployable Wireless Camera Penetrators

A lightweight, low-power camera dart has been designed and tested for context imaging of sampling sites and ground surveys from an aerobot or an orbiting spacecraft in a microgravity environment. The camera penetrators also can be used to image any line-of-sight surface, such as cliff walls, that is difficult to access. Tethered cameras to inspect the surfaces of planetary bodies use both power and signal transmission lines to operate. A tether adds the possibility of inadvertently anchoring the aerobot, and requires some form of station-keeping capability of the aerobot if extended examination time is required. The new camera penetrators are deployed without a tether, weigh less than 30 grams, and are disposable. They are designed to drop from any altitude with the boost in transmitting power currently demonstrated at approximately 100-m line-of-sight. The penetrators also can be deployed to monitor lander or rover operations from a distance, and can be used for surface surveys or for context information gathering from a touch-and-go sampling site. Thanks to wireless operation, the complexity of the sampling or survey mechanisms may be reduced. The penetrators may be battery powered for short-duration missions, or have solar panels for longer or intermittent duration missions. The imaging device is embedded in the penetrator, which is dropped or projected at the surface of a study site at 90 to the surface. Mirrors can be used in the design to image the ground or the horizon. Some of the camera features were tested using commercial "nanny" or "spy" camera components with the charge-coupled device (CCD) looking at a direction parallel to the ground. Figure 1 shows components of one camera that weighs less than 8 g and occupies a volume of 11 cm3. This camera could transmit a standard television signal, including sound, up to 100 m. Figure 2 shows the CAD models of a version of the penetrator. A low-volume array of such penetrator cameras could be deployed from an aerobot or a spacecraft onto a comet or asteroid. A system of 20 of these penetrators could be designed and built in a 1- to 2-kg mass envelope. Possible future modifications of the camera penetrators, such as the addition of a chemical spray device, would allow the study of simple chemical reactions of reagents sprayed at the landing site and looking at the color changes. Zoom lenses also could be added for future use.

Badescu, Mircea↗

System Synchronizes Recordings from Separated Video Cameras

A system of electronic hardware and software for synchronizing recordings from multiple, physically separated video cameras is being developed, primarily for use in multiple-look-angle video production. The system, the time code used in the system, and the underlying method of synchronization upon which the design of the system is based are denoted generally by the term "Geo-TimeCode(TradeMark)." The system is embodied mostly in compact, lightweight, portable units (see figure) denoted video time-code units (VTUs) - one VTU for each video camera. The system is scalable in that any number of camera recordings can be synchronized. The estimated retail price per unit would be about $350 (in 2006 dollars). The need for this or another synchronization system external to video cameras arises because most video cameras do not include internal means for maintaining synchronization with other video cameras. Unlike prior video-camera-synchronization systems, this system does not depend on continuous cable or radio links between cameras (however, it does depend on occasional cable links lasting a few seconds). Also, whereas the time codes used in prior video-camera-synchronization systems typically repeat after 24 hours, the time code used in this system does not repeat for slightly more than 136 years; hence, this system is much better suited for long-term deployment of multiple cameras.

Nail, William↗

Unmanned Ground Vehicle Perception Using Thermal Infrared Cameras

The ability to perform off-road autonomous navigation at any time of day or night is a requirement for some unmanned ground vehicle (UGV) programs. Because there are times when it is desirable for military UGVs to operate without emitting strong, detectable electromagnetic signals, a passive only terrain perception mode of operation is also often a requirement. Thermal infrared (TIR) cameras can be used to provide day and night passive terrain perception. TIR cameras have a detector sensitive to either mid-wave infrared (MWIR) radiation (3-5?m) or long-wave infrared (LWIR) radiation (8-12?m). With the recent emergence of high-quality uncooled LWIR cameras, TIR cameras have become viable passive perception options for some UGV programs. The Jet Propulsion Laboratory (JPL) has used a stereo pair of TIR cameras under several UGV programs to perform stereo ranging, terrain mapping, tree-trunk detection, pedestrian detection, negative obstacle detection, and water detection based on object reflections. In addition, we have evaluated stereo range data at a variety of UGV speeds, evaluated dual-band TIR classification of soil, vegetation, and rock terrain types, analyzed 24 hour water and 12 hour mud TIR imagery, and analyzed TIR imagery for hazard detection through smoke. Since TIR cameras do not currently provide the resolution available from megapixel color cameras, a UGV's daytime safe speed is often reduced when using TIR instead of color cameras. In this paper, we summarize the UGV terrain perception work JPL has performed with TIR cameras over the last decade and describe a calibration target developed by General Dynamics Robotic Systems (GDRS) for TIR cameras and other sensors.

terrain classification↗