RUDR: A New Paradigm for Model Extraction and Fitting
This paper describes a new algorithmic paradigm for solving problems where a model is extracted from or it to data. This paradigm has numerous applications, particularly in computer vision.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This paper describes a new algorithmic paradigm for solving problems where a model is extracted from or it to data. This paradigm has numerous applications, particularly in computer vision.
Autonomous off-road navigation of robotic ground vehicles has important applications on Earth and in space exploration. Progress in this domain has been retarded by the limited lookahead range of 3-D sensors and by the difficulty of preprogramming systems to understand the traversability of the wide variety of terrain they can encounter. Enabling robots to learn from experience may alleviate both of these problems. We define two paradigms for this, learning from 3-D geometry and learning from proprioception, and describe initial instantiations of them we have developed under DARPA and NASA programs. Field test results show promise for learning traversability of vegetated terrain, learning to extend the lookahead range of the vision system, and learning how slip varies with slope.
The paper presents an advanced 3D imaging system based on a combination of stereo vision and light projection methods.
Developments in architectural frameworks and system-of-systems thinking have provided useful constructs for systems engineering. DoDAF concepts, language, and formalisms, in particular, provide a natural way of conceptualizing an operations cost model applicable to NASA's space exploration vision. Not all DoDAF products have meaning or apply to a DoDAF inspired operations cost model, but this paper describes how such DoDAF concepts as nodes, systems, and operational activities relate to the development of a model to estimate exploration operations costs. The paper discusses the specific implementation to the Mission Operations Directorate (MOD) operational functions/activities currently being developed and presents an overview of how this powerful representation can apply to robotic space missions as well.
High speed stereo vision can allow unmanned robotic systems to navigate safely in unstructured terrain, but the computational cost can exceed the capacity of typical embedded CPUs. In this paper, we describe an end-to-end stereo computation co-processing system optimized for fast throughput that has been implemented on a single Virtex 4 LX160 FPGA. This system is capable of operating on images from a 1024 x 768 3CCD (true RGB) camera pair at 15 Hz. Data enters the FPGA directly from the cameras via Camera Link and is rectified, pre-filtered and converted into a disparity image all within the FPGA, incurring no CPU load. Once complete, a rectified image and the final disparity image are read out over the PCI bus, for a bandwidth cost of 68 MB/sec. Within the FPGA there are 4 distinct algorithms: Camera Link capture, Bilinear rectification, Bilateral subtraction pre-filtering and the Sum of Absolute Difference (SAD) disparity. Each module will be described in brief along with the data flow and control logic for the system. The system has been successfully fielded upon the Carnegie Mellon University's National Robotics Engineering Center (NREC) Crusher system during extensive field trials in 2007 and 2008 and is being implemented for other surface mobility systems at JPL.
We explore the use of machine learning, computer vision, and pattern recognition techniques to automatically identify volcanic ash plumes and plume shadows, in WorldView-2 imagery. Using information of the relative position of the sun and spacecraft and terrain information in the form of a digital elevation map, classification, the height of the ash plume can also be inferred. We present the results from applying this approach to six scenes acquired on two separate days in April and May of 2010 of the Eyjafjallajokull eruption in Iceland. These results show rough agreement with ash plume height estimates from visual and radar based measurements.
Terrain Relative Navigation (TRN) is an on-board GN&C function that generates a position estimate of a spacecraft relative to a map of a planetary surface. When coupled with a divert, the position estimate enables access to more challenging landing sites through pin-point landing or large hazard avoidance. The Lander Vision System (LVS) is a smart sensor system that performs terrain relative navigation by matching descent camera imagery to a map of the landing site and then fusing this with inertial measurements to obtain high rate map relative position, velocity and attitude estimates. A prototype of the LVS was recently tested in a helicopter field test over Mars analog terrain at altitudes representative of Mars Entry Descent and Landing conditions. TRN ran in real-time on the LVS during the flights without human intervention or tuning. The system was able to compute estimates accurate to 40m (3 sigma) in 10 seconds on a flight like processing system. This paper describes the Mars operational test space definition, how the field test was designed to cover that operational envelope, the resulting TRN performance across the envelope and an assessment of test space coverage.
The study of the Universe through gravitational waves will yield a revolutionary new perspective on the Universe, which has been intensely studied using electromagnetic signals in many wavelength bands. A space-based gravitational wave observatory will enable access to a rich array of astrophysical sources in the measurement band from 0.1 to 100 mHz, and nicely complement observations from ground-based detectors as well as pulsar timing arrays by sampling a different range of compact object masses and astrophysical processes. The observatory measures gravitational radiation by precisely monitoring the tiny change in the proper distance between pairs of freely falling proof masses. These masses are separated by millions of kilometers and, using a laser heterodyne interferometric technique, the change in their proper separation is detected to approx. 10 pm over timescales of 1000 seconds, a fractional precision of better than one part in 10(exp 19). Optical telescopes are essential for the implementation of this precision displacement measurement. In this paper we describe some of the key system level design considerations for the telescope subsystem in a mission context. The reference mission for this purpose is taken to be the enhanced Laser Interferometry Space Antenna mission (eLISA), a strong candidate for the European Space Agency's Cosmic Visions L3 launch opportunity in 2034. We will review the flow-down of observatory level requirements to the telescope subsystem, particularly pertaining to the effects of telescope dimensional stability and scattered light suppression, two performance specifications which are somewhat different from the usual requirements for an image forming telescope.
Human and robotic planetary lander missions require accurate surface relative position knowledge to land near science targets or next to pre-deployed assets. In the absence of GPS, accurate position estimates can be obtained by automatically matching sensor data collected during descent to an on-board map. The Lander Vision System (LVS) that is being developed for Mars landing applications generates landmark matches in descent imagery and combines these with inertial data to estimate vehicle position, velocity and attitude. This paper describes recent LVS design work focused on making the map relative localization algorithms robust to challenging environmental conditions like bland terrain, appearance differences between the map and image and initial input state errors. Improved results are shown using data from a recent LVS field test campaign. This paper also fills a gap in analysis to date by assessing the performance of the LVS with data sets containing significant vertical motion including a complete data set from the Mars Science Laboratory mission, a Mars landing simulation, and field test data taken over multiple altitudes above the same scene. Accurate and robust performance is achieved for all data sets indicating that vertical motion does not play a significant role in position estimation performance.
This Power Point Presentation is a mandatory requirement for Pathway's Interns to complete prior to both graduation and full-time conversion to work as a regular NASA employee. This presentation briefly outlines Mercedes Zuk's duties and experiences during her first semester as a Pathway's Intern during the Spring 2015 rotation. This presentation discusses projects and work accomplished by Mrs. Zuk while working at NASA. The presentation further discusses the NASA Engineering Directorate and alignment with NASA's Vision, Mission, and Strategic Plan.
This paper addresses the problem of localization for landing on the surface of icy moons, like Europa or Enceladus. Due to the possibility of specular reflection as well as high bulk albedo, icy surfaces present new challenges that make traditional vision-based navigation systems relying on visible imagery unreliable. We propose augmenting visible light cameras with a thermal-infrared camera using inverse-depth parameterized monocular EKF-SLAM to address problems arising from the appearance of icy moons. Results were obtained from a novel procedural Europa surface simulation which models the appearance and the thermal properties simultaneously from physically-based methods. In this framework, we show that thermal features improve localization by 23% on average when compared to a visible camera. Moreover, fusing both sensing modalities increases the improvement in localization to 31% on average, compared to using a visible light camera alone.
Although the analytical groundwork for understanding two-dimensional object images and various aspects of computer vision has been laid, we have not yet applied these concepts to automating the process of obtaining science images during space exploration missions. Our current approach in specifying pointing-command sequences relies heavily on target predicts, based on predicted target and spacecraft ephemerides, that propagate the target position as a function of time during pointing operations.
This paper presents on-going esearch in robotic ispeciton of space platforms. Three main area of investigation are discussed: machine-vision inspection techniques, an integrated sensor end-effector, and an orbital environment laboratory simulation.
The purpose of this project is to build a prototype camera system that utilizes artificial intelligence/machine learning and computer vision to track an object in 2D and recreate it in 3D.The goal is to improve image analysis and photogrammetry function for Pad 39B operations
Changes in the human brain, due to spaceflight, have been a challenge to the space program since its inception; a challenge that is becoming more acute as extended International Space Station (ISS) missions become routine, a return to crewed lunar exploration is about to begin, and a multi-year crewed trip to Mars is being planned. Determining the extent to which neurophysiological adaptations may adversely impact performance in operational tasks, assessing the full-time course of these changes, and identifying/mitigating any potential long-term health consequences are crucial steps required to enable safe crew-autonomous, long-duration, deep-space missions. Vision is the predominant perceptual sense used to guide cognition and motor control in humans. Thus, it is critical for the success of any future, long-duration mission to understand how long-term exposure to microgravity and to other stressors of spaceflight and their interactions, impact visual function. This is an especially challenging task given the small and disparate samples from which we have been and will be able to collect human performance data. NASA has recently been carefully tracking spaceflight-induced ophthalmic changes, driven in large part by the fluid shifts related to microgravity. In particular, a recent study of Optical Coherence Tomography (OCT) postflight measures revealed that more than two-thirds of US crew members experience significant increases in retinal thickness after 6month or longer ISS missions. Space Associated Neuro-ocular Syndrome (SANS) also includes visual acuity decrements and other ocular structural changes that could adversely impact in-flight performance as missions become longer. However, the impact of spaceflight on the visual system is not limited to the retina. Recent comparisons of pre-and post-flight brain images have revealed structural changes throughout the brain that implicate visual, visuomotor, and visual-cognitive pathways, consistent with observed functional impacts (e.g., decreased speed/accuracy/timing of fine goal-oriented movements). Current limitations on inflight testing make it very difficult to determine when and under what conditions SANS and other disruptions of human neurological subsystems arise. Currently, one cannot anticipate the time course and extent of impairment and recovery. This study addresses this knowledge gap by creating an integrated framework of the relevant existing literature on visual and oculomotor function during spaceflight with an eye towards complementing current structural measures of visuomotor impairment with new oculometric standard measures. Using eye-movement based visual function assessment and diagnostics would provide a valuable enhancement of crew health and performance monitoring in support of deepspace exploration.
Age-related macular degeneration (AMD) is a leading cause of blindness and is diagnosed as early-stage or late-stage. Early-stage AMD is usually asymptomatic and entails pigmentary changes of the retina (Ayoub & Patel, 2009). As the disorder progresses, there are atrophic or neovascular changes that distort vision, especially the central visual field (Ayoub & Patel, 2009). There are several genetic and non-genetic risk factors for AMD and no proven therapy to slow or reverse late-stage atrophic AMD, while anti-VEGF has effectively treated late-stage neovascular AMD. Several genes of interest have also been investigated thoroughly thus far in their connection to AMD and the CFH and ARMS2 genes have shown promise in understanding the genetic basis of the disorder (Awh et al., 2013). There are other epigenetic and environmental factors as well including smoking and low antioxidant levels (Cano et al., 2010). Ongoing investigations include antioxidant supplementation and a smoking cessation regimen to reverse early-stage AMD (Cano et al., 2010). Progress in treating AMD as a disorder across its varied stages requires newer therapeutics along with a more detailed understanding of the genetic and cellular pathways of pathophysiology is needed to better counter this prevalent disorder of the eye.
Simultaneous Localization and Mapping (SLAM) is a promising technique that provides localization information and precise mapping of the physical environment without having much prior knowledge of the surroundings. SLAM may have a vital role in aeronautics and aerospace, where vehicles and aircraft must operate in complex environments with traditional localization services that may be degraded or unavailable. This paper compares several pre-canned 3D SLAM algorithms based on vision and LiDAR, namely ORB-SLAM, ORB-SLAM2, LOAM, A-LOAM, and F-LOAM on NASA UAS (Unmanned Aircraft System) flight test data. The NASA ARC UAS flight test demonstrates preliminary SLAM algorithm results, which serve as a stepping stone to simulated AAM (Advanced Air Mobility) concepts. Conducting AFRC UAS flight test for simulated AAM approach and landing with SLAM algorithms provides an Alternative Precision Navigation and Timing solution based on distributed landmarks and fiducials in the landing zone. These algorithms use the telemetry data as ground truth for a baseline comparison. The criteria of the performance comparison include robustness, accuracy, re-localization, response to environmental changes, and real-time effectiveness, which are currently qualitative but to be quantitative in the future.
Simultaneous Localization and Mapping (SLAM) is a promising technique that provides localization information and precise mapping of the physical environment without having much prior knowledge of the surroundings. SLAM may have a vital role in aeronautics and aerospace, where vehicles and aircraft must operate in complex environments with traditional localization services that may be degraded or unavailable. This paper compares several pre-canned 3D SLAM algorithms based on vision and LiDAR, namely ORB-SLAM, ORB-SLAM2, LOAM, A-LOAM, and F-LOAM on NASA UAS (Unmanned Aircraft System) flight test data. The NASA ARC UAS flight test demonstrates preliminary SLAM algorithm results, which serve as a stepping stone to simulated AAM (Advanced Air Mobility) concepts. Conducting AFRC UAS flight test for simulated AAM approach and landing with SLAM algorithms provides an Alternative Precision Navigation and Timing solution based on distributed landmarks and fiducials in the landing zone. These algorithms use the telemetry data as ground truth for a baseline comparison. The criteria of the performance comparison include robustness, accuracy, re-localization, response to environmental changes, and real-time effectiveness, which are currently qualitative but to be quantitative in the future.