CMOS digital imager design from a system-on-a-chip perspective
In this paper, we have identified timing and circuit layout considerations that are critical for implementing a digital CMOS camera-on-a-chip.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
In this paper, we have identified timing and circuit layout considerations that are critical for implementing a digital CMOS camera-on-a-chip.
Dust devils are familiar sites in the and regions of the world: they can produce quite spectacular displays of dust lofting when the vortices scavenge very loose dust from a dry lake bed or from recently disturbed agricultural fields. If one were to arrive at the center of an arid region, take one photograph, or even a series of photographs over a period of several days, then return the images for laboratory analysis, it would be most likely concluded that the region was inactive from an aeolian perspective. No images of general dust movement were obtained, nor were any dust devils "caught on camera" owing to their ephemeral and unpredictable appearance, and the fact that there was deceptively little residue of their actions. If, however, a camera were to take a 360 degree continuous recording over a period of a year, and the film were then to be shown at high speed over a period a several minutes, the impression might be that of a region ravaged by air vorticity and dust movement. Extrapolate this over geological time, and it is possible to visualize dust devils as prime aeolian agents, rather than insignificant vagaries of nature, On Mars, the thin atmosphere permits the surface of the planet to be heated but it does not itself retain heat with the capacity of the earth's atmosphere. This gives rise to greater thermal instability near the surface of Mars as "warm" air pockets diapiritically inject themselves into higher atmospheric layers. Resulting boundary-layer vorticity on Mars might therefore be expected to produce dust devils in abundance, if only seasonally. The spectacular images of dust devils obtained by Pathfinder within its brief functional period on the planet testify to the probability of highly frequent surface vorticity in light of the above reasoning about observational probability. Notably, the Pathfinder devils appeared to be at least a kilometer in height. There are several consequences for the geology of Mars, and for human exploration, if dust devils are to be expected in reasonable abundance. First, from a geological perspective, the vortices will act as "gardening" agents for the top few centimeters of entrainable material. Over time (hundreds of millions, or billions of years being available), they will cover the surface with scouring paths, and the grain sizes that can be lofted by a vortex probably extends over the whole sand to dust range. The depositional paths are, of course, much larger, so that vortex-induced deposition is more widespread than vortex-induced erosion, and will without doubt, affect the whole region in which the dust devils occur (this might explain why rocks at the Viking site seemed oddly capped with dust in a region apparently subject to general aeolian scouring). On Mars, the lift forces in dust devils might be less than on earth owing to the much thinner atmosphere, but this may be counterbalanced by lower gravity and greater vortex velocities. Certainly, when active, other aeolian phenomena on Mars --sand motion and dust storms, seem no less energetic and no less capable of lofting sediments than equivalent terrestrial aeolian phenomena. Every several years, within the current climatic regime, the surface of Mars is subject to light dust fall from global dust storms. Over time, this should develop a very uniform surface layer, with commensurate uniformity in grain size, mineralogy, albedo, color, and general spectroscopic properties. Dust devils will disturb this situation by continually mixing the surface dust with underlying layers, perhaps composed of silt and sand. This size mixing will also involve compositional mixing. After some years, the thin layer of dust that may be difficult to entrain alone, becomes progressively mixed with coarser materials that could reduce the general aeolian threshold of the soil. Certainly the continual disturbance by vorticity will prevent surface stabilization that may bind or indurate grains (caused by slow cementation or ice welding at grain boundaries). If dust devils continually loft dust to kilometer heights, and the dust is sprayed into many cubic kilometers of atmosphere each time, could the devils produce a continual background of atmospheric dust that might be mistaken for the fallout of a distant large-scale dust storm? From a human exploration perspective, dust devils are unlikely to pose any, life- threatening situation for an astronaut unfortunate enough to encounter a momentary swirling cloud of loose soil. However, it is noted that pervasive dust is probably one of the greatest long-term hazards for a human encampment. The fineness and penetration capabilities of the dust, its electrostatic adhesive properties, and its complete ubiquity, render the material a persistent nuisance at best, but at worst, over a period of many months it is possible that space suits, machinery, habitat interiors, air filters, and so forth, could become jeopardized. Owing to dust penetration, the space suits used in the Apollo landings were rendered unusable after a few EVA activities. There will be a definite attempt to situate a human colony on Mars in an area that is far removed from the regions of the planet known for being the centers of major dust storms. At the heart of these storm systems, the dust lofting mechanics are unknown, but they are energetic and perhaps potentially life-threatening for an astronaut. Locating a colony in a region that appears from space to be meteorologically benign may lead to colony placement in a region prone to dust devils, but dust devils are not (or have not been) detectable from orbital observations: the region surveyed for placement will appear like the apparently inactive and area referred to earlier. The region may be spared from highly energetic weather systems, but it may not be necessarily immune from continual dust disturbance. Additional information is contained in the original.
Purpose: For electron cutouts of smaller sizes, it is necessary to verify electron cutout factors due to perturbations in electron scattering. Often, this requires a physical measurement using a small ion chamber, diode, or film. The purpose of this study is to develop a fast Monte Carlo based dose calculation framework that requires only a smart phone photograph of the cutout and specification of the SSD and energy to determine the electron cutout factor, with the ultimate goal of making this cloud-based calculation widely available to the medical physics community. Methods: The algorithm uses a pattern recognition technique to identify the corners of the cutout in the photograph as shown in Figure 1. It then corrects for variations in perspective, scaling, and translation of the photograph introduced by the user’s positioning of the camera. Blob detection is used to identify the portions of the cutout which comprise the aperture and the portions which are cutout material. This information is then used define physical densities of the voxels used in the Monte Carlo dose calculation algorithm as shown in Figure 2, and select a particle source from a pre-computed library of phase-spaces scored above the cutout. The electron cutout factor is obtained by taking a ratio of the maximum dose delivered with the cutout in place to the dose delivered under calibration/reference conditions. Results: The algorithm has been shown to successfully identify all necessary features of the electron cutout to perform the calculation. Subsequent testing will be performed to compare the Monte Carlo results with a physical measurement. Conclusion: A simple, cloud-based method of calculating electron cutout factors could eliminate the need for physical measurements and substantially reduce the time required to properly assure accurate dose delivery.
Every day, hundreds of images of Earth flood the Crew Earth Observations database as astronauts use hand held digital cameras to capture spectacular frames from the International Space Station. The variety of resolutions and perspectives provide a template for assessing land cover change over decades. We will focus on urban growth in the second fastest growing city in the nation, Houston, TX, using Object-Based Image Analysis. This research will contribute to the land change science community, integrated resource planning, and monitoring of the rapid rate of urban sprawl.
This work evaluated the iX Cameras iSpeed 727, a commercial CMOS-based continuous- recording high-speed camera. Various parameters of importance in the scheme of accurate time-resolved measurements and photonic quantification have been measured under controlled conditions on the bench, using state-of-the-art instrumentation. We will detail the procedures and results of the tests laid out to measure sensor sensitivity, linearity, signal-to-noise ratio and image lag. We also looked into the electronic shutter performance and accuracy, as exposure time is of particular interest to high-speed imaging. The results of the tests show that this camera matches or exceeds the performance of competing units in most aspects, but that, as is the case for other high-speed camera systems, corrections are necessary to make full use of the image data from a quantitative perspective.
Visual motion and other visual cues are used by tower controllers to provide important support for their control tasks at and near airports. These cues are particularly important for anticipated separation. Some of them, which we call visual features, have been identified from structured interviews and discussions with 24 active air traffic controllers or supervisors. The visual information that these features provide has been analyzed with respect to possible ways it could be presented at a remote tower that does not allow a direct view of the airport. Two types of remote towers are possible. One could be based on a plan-view, map-like computer-generated display of the airport and its immediate surroundings. An alternative would present a composite perspective view of the airport and its surroundings, possibly provided by an array of radially mounted cameras positioned at the airport in lieu of a tower. An initial more detailed analyses of one of the specific landing cues identified by the controllers, landing deceleration, is provided as a basis for evaluating how controllers might detect and use it. Understanding other such cues will help identify the information that may be degraded or lost in a remote or virtual tower not located at the airport. Some initial suggestions how some of the lost visual information may be presented in displays are mentioned. Many of the cues considered involve visual motion, though some important static cues are also discussed.
Martian dust lifting is believed to occur through two primary mechanisms: dust devils and wind stress forced dust lifting. Gale Crater's varied terrain and meteorology provide a unique in situ perspective on Martian dust lifting, with the Mars Science Laboratory Curiosity rover passing through both conditions and locations detrimental to dust lifting (e.g., the crater floor) and those with active sand motion and frequent dust lifting (e.g., the Bagnold Dunes). Between L s = 248° in Mars Year 33 and L s = 51° in Mars Year 37, over ∼3.5 Mars years and 2,300 sols, the rover's Navigation Cameras took 1,260 dedicated image sequences to search for dust lifting. Approximately 42.7% of all sequences, and 9.5% of the total images have shown active dust lifting, both dust devils and linear/straight-line wind stress dust lifting. 79% of dust lifting events are classified as dust devils, while ∼16% are linear wind stress dust lifting and the remainder are of an indeterminate type. We analyze this large catalog of dust lifting events to provide ground truth on theoretical and model expectations of dust lifting and show that dust lifting in Gale Crater occurs throughout the Martian year, is strongly peaked in frequency near solar noon (even after accounting for observational biases), and that dust lifting shows an affinity for sand-covered surfaces which highlights the importance of saltating sand grains for Martian dust lifting in both dust devils and wind stress forced lifting.
A mounting mechanism was designed and built to satisfy requirements specific to a developmental head-up display (HUD) to be used by pilots in a Boeing 757 airplane. This development was necessitated by the fact that although such mounting mechanisms were commercially available for other airplanes, there were none for the 757. The mounting mechanism supports a miniature electronic camera that provides a forward view. The mechanism was designed to be integrated with the other HUD instrumentation and to position the camera so that what is presented to the pilot is the image acquired by the camera, overlaid with alphanumeric and/or graphical symbols, from a close approximation of the pilot s natural forward perspective. The mounting mechanism includes an L-shaped mounting arm that can be adjusted easily to the pilot s perspective, without prior experience. The mounting mechanism is lightweight and flexible and presents little hazard to the pilot.
Stereomapping techniques applicable to the processing of imagery from facsimile cameras on board the Viking Mars landing vehicles are discussed. Two methods of stereomapping are considered: use of a gnomonic projection to transform the digital imagery to an equivalent of a perspective projection by computerized rectification through image processing; and interfacing a high-speed digital computer to an analytical plotter so that rectification and corrections proceed in real time. Contour maps produced during tests of the Viking Lander cameras, as well as maps of the area surrounding the Viking Lander on the Martian surface, are presented.
Today's modern vehicles contain anywhere from sixty to one-hundred sensors and exhibit the characteristics of Cyber-Physical-Systems (CPS). There is a high degree of coupling, cohesiveness, and interactions among vehicle's CPS components (e.g., sensors, devices, systems, systems-of-systems) across sensing, communication, and control layers. Cyber-attacks in the sensing or communication layers can compromise the security of the control layer. This paper provides a detailed review of potential cyber threats related to the sensing layer. Notably, the focus is mainly towards two categories of sensors: vehicle dynamics sensors (e.g., Tire Pressure Monitoring Systems (TPMS), magnetic encoders, and inertial sensors) and environment sensors (e.g., Light Detection and Ranging (LiDAR), ultrasonic, camera, Radio Detection and Ranging (Radar) systems, and Global Positioning System (GPS) units). Furthermore, the paper also offers perspectives through existing countermeasures from literature and stresses the need for data-driven cybersecurity solutions.
Highway safety remains a significant concern, especially in mixed traffic scenarios involving heavy-duty vehicles (HDV) and smaller passenger cars. The vulnerability of HDVs following closely behind smaller cars is evident in incidents involving the lead vehicle, potentially leading to catastrophic rear-end collisions. Here, this paper explores how automatic speed enforcement systems, using speed cameras, can mitigate risks for HDVs in such critical situations. While historical crash data consistently demonstrates the reduction of accidents near speed cameras, this paper goes beyond the conventional notion of crash occurrence reduction. Instead, it investigates the profound impact of driver behavior changes within desired travel speed distribution, especially around speed cameras, and their contribution to the safety of trailing vehicles, with a specific focus on heavy-duty trucks in accident-prone scenarios. To conduct this analysis, we utilize SUMO, an open-source microscopic traffic simulator, enabling realistic simulations of real-world driving behaviors with and without speed cameras. The simulations also consider empirical distributions of desired headway gaps and reaction times exhibited by human drivers. This study offers a fresh perspective on highway safety by examining how the influence of automatic speed enforcement systems on driver behavior enhances the safety of HDV when faced with challenging situations. By shedding light on these dynamics, we contribute valuable insights to the ongoing research efforts on using technology to create safer roadways, ultimately promoting safer coexistence between heavy-duty and passenger vehicles.
Over the last few years we have seen an increasing number of applications of Fuzzy Logic Controllers. These applications range from the development of auto-focus cameras, to the control of subway trains, cranes, automobile subsystems (automatic transmissions), domestic appliances, and various consumer electronic products. In summary, we consider a Fuzzy Logic Controller to be a high level language with its local semantics, interpreter, and compiler, which enables us to quickly synthesize non-linear controllers for dynamic systems.
To date, the IMAGE EUV camera has observed several plasmaspheric density trough features inside the plasmapause under a wide range of geomagnetic activity. From the perspective of EUV, a density trough feature appears as a channel of diminished pixel counts which spans a width of L-shell (DELTA L) and magnetic local time (MLT) inside the plasmapause. Plasmaspheric density troughs are found to be morphologically complex possessing considerable spatial and temporal variability. We present an analysis of the evolution of trough DELTA L and MLT extent as functions of associated D (sub ST) and K (sub p) history. Trough features range in size from 0.16 less than or equal to DELTA L less than or equal to 1.2 with azimuthal extent from 1500 less than or equal to MLT less than or equal to 1200. All cases of plasmaspheric density troughs studied to date appear to have evolved as a result of the inner edge of the afternoon/evening plasma drainage plume being wrapped around through the nightside plasmasphere. The structure of plasmaspheric density trough features is further probed by analyzing simulated EUV images produced by forward modeling artificially introduced regions of depleted density into both static and dynamic global core plasmaspheric models. Forward modeling suggests that (1) L-shell refilling of density troughs during storm recovery can be modeled as filling from the ionosphere toward the equator (i.e., bottom-up refilling), and (2) that an erosion process is operating within flux tubes beyond the outer L-shell wall of the observed density troughs.
In this work, we tested Maximum likelihood expectation-maximization (MLEM) algorithms optimized for gamma imaging applications on two recent coded mask gamma cameras. We respectively took advantage of the characteristics of the GAMPIX and Caliste HD-based gamma cameras: noise reduction thanks to mask/anti-mask procedure but limited energy resolution for GAMPIX, high energy resolution for Caliste HD. One of our short-term perspectives is the test of MAPEM algorithms integrating specific prior values for the data to reconstruct adapted to the gamma imaging topic. (authors)
Camera or lens-based detector calibration is essential for spatial accuracy in applications like dimensional tomography, optical metrology, and computer vision. Many methods and software exist yet there is still a lack of approaches that achieve both high accuracy and robustness while being easy to use and capable of handling a wide range of distortions. Radial lens distortion is common in high-resolution X-ray detector optics used in parallel-beam tomography at synchrotrons. Achieving sub-pixel accuracy requires calibrating with an optical target image. Although methods for characterizing radial distortion are well established, acquired images often also include perspective distortion and optical center offset. Here, we present our approaches to individually characterize and correct both types of distortion using a single calibration image, implemented in the Discorpy software.
In this work, we present an image generation methodology based on ray tracing that can be used to render realistic images of Particle Image Velocimetry (PIV) and Background Oriented Schlieren (BOS) experiments in the presence of density/refractive index gradients. This methodology enables the simulation of aero-thermodynamics experiments for experiment design, error, and uncertainty analysis. Images are generated by emanating light rays from the particles or dot pattern, and propagating them through the density gradient field and the optical elements, up to the camera sensor. The rendered images are realistic, and can replicate the features of a given experimental setup, like optical aberrations and perspective effects, which can be deliberately introduced for error analysis. We demonstrate this methodology by simulating a BOS experiment with a known density field obtained from direct numerical simulations (DNS) of homogeneous buoyancy driven turbulence, and comparing the light ray displacements from ray tracing to results from BOS theory. The light ray displacements show good agreement with the reference data. This methodology provides a framework for further development of simulation tools for use in experiment design and development of image analysis tools for PIV and BOS applications. Finally, an implementation of the proposed methodology in a Python-CUDA program is made available as an open source software for researchers.
This paper details effort by researchers at NASA Langley Research Center to prepare for an upcoming high-speed tomographic background-oriented schlieren test entry in the 31-Inch Mach 10 wind tunnel. In order to troubleshoot potential problems that will arise when setting up the experiment in the actual test facility, a full-scale mock-up of the 31-Inch Mach 10 wind tunnel test section was constructed in the laboratory to provide equivalent characteristic optical access and mounting options. A 3D-printed model that replicates the scale of the forebody of a supersonic retropropulsion (SRP) model that will be used in the final test entry has been fabricated with a central nozzle that can be connected to a high-pressure gas supply to approximate the nozzle flow that will occur. Six high-speed imaging systems consisting of a high-speed camera with a fiber illuminator module have been assembled and mounted on the test section mock-up to provide six unique perspective views of the nozzle flow from the model. Tests with one of the imaging systems using a pulsed laser light source showed that sufficient signal intensity and illumination uniformity was achieved, as demonstrated by the 2D BOS data obtained with the system. Additional work to show that retroreflective material would survive inside of the test section of the 31-Inch Mach 10 tunnel was also performed. Finally, a remotely-controlled tomographic BOS calibration system is discussed.
High resolution calibrated infrared imagery of the Space Shuttle was obtained during hypervelocity atmospheric entries of the STS-119, STS-125 and STS128 missions and has provided information on the distribution of surface temperature and the state of the airflow over the windward surface of the Orbiter during descent. This data collect was initiated by NASA s Hypersonic Thermodynamic Infrared Measurements (HYTHIRM) team and incorporated the use of air- and land-based optical assets to image the Shuttle during atmospheric re-entry. The HYTHIRM objective is to develop and implement a set of mission planning tools designed to establish confidence in the ability of an existing optical asset to reliably acquire, track and return global quantitative surface temperatures of the Shuttle during entry. On Space Shuttle Discovery s STS-119 mission, NASA flew a specially modified thermal protection system tile and instrumentation package to monitor heating effects from boundary layer transition during re-entry. On STS-119, the windward airflow on the port wing was deliberately disrupted by a four-inch wide and quarter-inch tall protuberance built into the modified tile. In coordination with this flight experiment, a US Navy NP-3D Orion aircraft was flown 28 nautical miles below Discovery and remotely monitored surface temperature of the Orbiter at Mach 8.4 using a long-range infrared optical package referred to as Cast Glance. Approximately two months later, the same Navy Cast Glance aircraft successfully monitored the surface temperatures of the Orbiter Atlantis traveling at approximately Mach 14.3 during its return from the successful Hubble repair mission. In contrast to Discovery, Atlantis was not part of the Boundary Layer Transition (BLT) flight experiment, thus the vehicle was not configured with a protuberance on the port wing. In September 2009, Cast Glance was again successful in capturing infrared imagery and monitoring the surface temperatures on Discovery s next flight, STS-128. Again, NASA flew a specially modified thermal protection system tile and instrumentation package to monitor heating effects from boundary layer transition during re-entry. During this mission, Cast Glance was able to image laminar and turbulent flow phenomenology optimizing data collection for Mach 14.7. The purpose of this paper is to describe key elements associated with STS-119/125/128 mission planning and execution from the perspective of the Cast Glance flight crew that obtained the imagery. The paper will emphasize a human element of experience, expertise and adaptability seamlessly coupled with Cast Glance system and sensor technology required to manually collect the required imagery. Specific topics will include a near infrared (NIR) camera upgrade that was implemented just prior to the missions, how pre-flight radiance modeling was utilized to optimize the IR sensor configuration, communications, the development of aircraft test support positions based upon Shuttle trajectory information, support to contingencies such as Shuttle one orbit wave-offs/west coast diversions and then the Cast Glance perspective during an actual Shuttle imaging mission.