Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Visioning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
NASA NTRS2008

Synthetic Vision Displays for Planetary and Lunar Lander Vehicles

Aviation research has demonstrated that Synthetic Vision (SV) technology can substantially enhance situation awareness, reduce pilot workload, improve aviation safety, and promote flight path control precision. SV, and related flight deck technologies are currently being extended for application in planetary exploration vehicles. SV, in particular, holds significant potential for many planetary missions since the SV presentation provides a computer-generated view for the flight crew of the terrain and other significant environmental characteristics independent of the outside visibility conditions, window locations, or vehicle attributes. SV allows unconstrained control of the computer-generated scene lighting, terrain coloring, and virtual camera angles which may provide invaluable visual cues to pilots/astronauts, not available from other vision technologies. In addition, important vehicle state information may be conformally displayed on the view such as forward and down velocities, altitude, and fuel remaining to enhance trajectory control and vehicle system status. The paper accompanies a conference demonstration that introduced a prototype NASA Synthetic Vision system for lunar lander spacecraft. The paper will describe technical challenges and potential solutions to SV applications for the lunar landing mission, including the requirements for high-resolution lunar terrain maps, accurate positioning and orientation, and lunar cockpit display concepts to support projected mission challenges.

Arthur, Jarvis J., III↗
NASA NTRS2008

Vision System Measures Motions of Robot and External Objects

A prototype of an advanced robotic vision system both (1) measures its own motion with respect to a stationary background and (2) detects other moving objects and estimates their motions, all by use of visual cues. Like some prior robotic and other optoelectronic vision systems, this system is based partly on concepts of optical flow and visual odometry. Whereas prior optoelectronic visual-odometry systems have been limited to frame rates of no more than 1 Hz, a visual-odometry subsystem that is part of this system operates at a frame rate of 60 to 200 Hz, given optical-flow estimates. The overall system operates at an effective frame rate of 12 Hz. Moreover, unlike prior machine-vision systems for detecting motions of external objects, this system need not remain stationary: it can detect such motions while it is moving (even vibrating). The system includes a stereoscopic pair of cameras mounted on a moving robot. The outputs of the cameras are digitized, then processed to extract positions and velocities. The initial image-data-processing functions of this system are the same as those of some prior systems: Stereoscopy is used to compute three-dimensional (3D) positions for all pixels in the camera images. For each pixel of each image, optical flow between successive image frames is used to compute the two-dimensional (2D) apparent relative translational motion of the point transverse to the line of sight of the camera. The challenge in designing this system was to provide for utilization of the 3D information from stereoscopy in conjunction with the 2D information from optical flow to distinguish between motion of the camera pair and motions of external objects, compute the motion of the camera pair in all six degrees of translational and rotational freedom, and robustly estimate the motions of external objects, all in real time. To meet this challenge, the system is designed to perform the following image-data-processing functions: The visual-odometry subsystem (the subsystem that estimates the motion of the camera pair relative to the stationary background) utilizes the 3D information from stereoscopy and the 2D information from optical flow. It computes the relationship between the 3D and 2D motions and uses a least-mean-squares technique to estimate motion parameters. The least-mean-squares technique is suitable for real-time implementation when the number of external-moving-object pixels is smaller than the number of stationary-background pixels.

Talukder, Ashit↗
NASA NTRS2009

Simulation Evaluation of Equivalent Vision Technologies for Aerospace Operations

A fixed-based simulation experiment was conducted in NASA Langley Research Center s Integration Flight Deck simulator to investigate enabling technologies for equivalent visual operations (EVO) in the emerging Next Generation Air Transportation System operating environment. EVO implies the capability to achieve or even improve on the safety of current-day Visual Flight Rules (VFR) operations, maintain the operational tempos of VFR, and perhaps even retain VFR procedures - all independent of the actual weather and visibility conditions. Twenty-four air transport-rated pilots evaluated the use of Synthetic/Enhanced Vision Systems (S/EVS) and eXternal Vision Systems (XVS) technologies as enabling technologies for future all-weather operations. The experimental objectives were to determine the feasibility of XVS/SVS/EVS to provide for all weather (visibility) landing capability without the need (or ability) for a visual approach segment and to determine the interaction of XVS/EVS and peripheral vision cues for terminal area and surface operations. Another key element of the testing investigated the pilot's awareness and reaction to non-normal events (i.e., failure conditions) that were unexpectedly introduced into the experiment. These non-normal runs served as critical determinants in the underlying safety of all-weather operations. Experimental data from this test are cast into performance-based approach and landing standards which might establish a basis for future all-weather landing operations. Glideslope tracking performance appears to have improved with the elimination of the approach visual segment. This improvement can most likely be attributed to the fact that the pilots didn't have to simultaneously perform glideslope corrections and find required visual landing references in order to continue a landing. Lateral tracking performance was excellent regardless of the display concept being evaluated or whether or not there were peripheral cues in the side window. Although workload ratings were significantly less when peripheral cues were present compared to when there were none, these differences appear to be operationally inconsequential. Larger display concepts tested in this experiment showed significant situation awareness (SA) improvements and workload reductions compared to smaller display concepts. With a fixed display size, a color display was more influential in SA and workload ratings than a collimated display.

Kramer, Lynda J.↗
NASA NTRS2009

Robot Vision Library

The JPL Robot Vision Library (JPLV) provides real-time robot vision algorithms for developers who are not vision specialists. The package includes algorithms for stereo ranging, visual odometry and unsurveyed camera calibration, and has unique support for very wideangle lenses

Howard, Andrew B.↗
NASA NTRS2009

The Effects of Synthetic and Enhanced Vision Technologies for Lunar Landings

Eight pilots participated as test subjects in a fixed-based simulation experiment to evaluate advanced vision display technologies such as Enhanced Vision (EV) and Synthetic Vision (SV) for providing terrain imagery on flight displays in a Lunar Lander Vehicle. Subjects were asked to fly 20 approaches to the Apollo 15 lunar landing site with four different display concepts - Baseline (symbology only with no terrain imagery), EV only (terrain imagery from Forward Looking Infra Red, or FLIR, and LIght Detection and Ranging, or LIDAR, sensors), SV only (terrain imagery from onboard database), and Fused EV and SV concepts. As expected, manual landing performance was excellent (within a meter of landing site center) and not affected by the inclusion of EV or SV terrain imagery on the Lunar Lander flight displays. Subjective ratings revealed significant situation awareness improvements with the concepts employing EV and/or SV terrain imagery compared to the Baseline condition that had no terrain imagery. In addition, display concepts employing EV imagery (compared to the SV and Baseline concepts which had none) were significantly better for pilot detection of intentional but unannounced navigation failures since this imagery provided an intuitive and obvious visual methodology to monitor the validity of the navigation solution.

Kramer, Lynda J.↗
NASA NTRS2010

Stereoscopic Machine-Vision System Using Projected Circles

A machine-vision system capable of detecting obstacles large enough to damage or trap a robotic vehicle is undergoing development. The system includes (1) a pattern generator that projects concentric circles of laser light forward onto the terrain, (2) a stereoscopic pair of cameras that are aimed forward to acquire images of the circles, (3) a frame grabber and digitizer for acquiring image data from the cameras, and (4) a single-board computer that processes the data. The system is being developed as a prototype of machine- vision systems to enable robotic vehicles ( rovers ) on remote planets to avoid craters, large rocks, and other terrain features that could capture or damage the vehicles. Potential terrestrial applications of systems like this one could include terrain mapping, collision avoidance, navigation of robotic vehicles, mining, and robotic rescue. This system is based partly on the same principles as those of a prior stereoscopic machine-vision system in which the cameras acquire images of a single stripe of laser light that is swept forward across the terrain. However, this system is designed to afford improvements over some of the undesirable features of the prior system, including the need for a pan-and-tilt mechanism to aim the laser to generate the swept stripe, ambiguities in interpretation of the single-stripe image, the time needed to sweep the stripe across the terrain and process the data from many images acquired during that time, and difficulty of calibration because of the narrowness of the stripe. In this system, the pattern generator does not contain any moving parts and need not be mounted on a pan-and-tilt mechanism: the pattern of concentric circles is projected steadily in the forward direction. The system calibrates itself by use of data acquired during projection of the concentric-circle pattern onto a known target representing flat ground. The calibration- target image data are stored in the computer memory for use as a template in processing terrain images. During operation on terrain, the images acquired by the left and right cameras are analyzed. The analysis includes (1) computation of the horizontal and vertical dimensions and the aspect ratios of rectangles that bound the circle images and (2) comparison of these aspect ratios with those of the template. Coordinates of distortions of the circles are used to identify and locate objects. If the analysis leads to identification of an object of significant size, then stereoscopicvision algorithms are used to estimate the distance to the object. The time taken in performing this analysis on a single pair of images acquired by the left and right cameras in this system is a fraction of the time taken in processing the many pairs of images acquired in a sweep of the laser stripe across the field of view in the prior system. The results of the analysis include data on sizes and shapes of, and distances and directions to, objects. Coordinates of objects are updated as the vehicle moves so that intelligent decisions regarding speed and direction can be made. The results of the analysis are utilized in a computational decision-making process that generates obstacle-avoidance data and feeds those data to the control system of the robotic vehicle.

Mackey, Jeffrey R.↗
NASA NTRS2010

Enhanced Vision for All-Weather Operations Under NextGen

Recent research in Synthetic/Enhanced Vision technology is analyzed with respect to existing Category II/III performance and certification guidance. The goal is to start the development of performance-based vision systems technology requirements to support future all-weather operations and the NextGen goal of Equivalent Visual Operations. This work shows that existing criteria to operate in Category III weather and visibility are not directly applicable since, unlike today, the primary reference for maneuvering the airplane is based on what the pilot sees visually through the "vision system." New criteria are consequently needed. Several possible criteria are discussed, but more importantly, the factors associated with landing system performance using automatic and manual landings are delineated.

Bailey, Randall E.↗
NASA NTRS2011

Enhanced and Synthetic Vision for Terminal Maneuvering Area NextGen Operations

Synthetic Vision Systems and Enhanced Flight Vision System (SVS/EFVS) technologies have the potential to provide additional margins of safety for aircrew performance and enable operational improvements for low visibility operations in the terminal area environment with equivalent efficiency as visual operations. To meet this potential, research is needed for effective technology development and implementation of regulatory and design guidance to support introduction and use of SVS/EFVS advanced cockpit vision technologies in Next Generation Air Transportation System (NextGen) operations. A fixed-base pilot-in-the-loop simulation test was conducted at NASA Langley Research Center that evaluated the use of SVS/EFVS in NextGen low visibility ground (taxi) operations and approach/landing operations. Twelve crews flew approach and landing operations in a simulated NextGen Chicago O Hare environment. Various scenarios tested the potential for EFVS for operations in visibility as low as 1000 ft runway visibility range (RVR) and SVS to enable lower decision heights (DH) than can currently be flown today. Expanding the EFVS visual segment from DH to the runway in visibilities as low as 1000 RVR appears to be viable as touchdown performance was excellent without any workload penalties noted for the EFVS concept tested. A lower DH to 150 ft and/or possibly reduced visibility minima by virtue of SVS equipage appears to be viable when implemented on a Head-Up Display, but the landing data suggests further study for head-down implementations.

Kramer, Lynda J.↗
NASA NTRS2011

Flight Deck-Based Delegated Separation: Evaluation of an On-Board Interval Management System with Synthetic and Enhanced Vision Technology

An emerging Next Generation Air Transportation System concept - Equivalent Visual Operations (EVO) - can be achieved using an electronic means to provide sufficient visibility of the external world and other required flight references on flight deck displays that enable the safety, operational tempos, and visual flight rules (VFR)-like procedures for all weather conditions. Synthetic and enhanced flight vision system technologies are critical enabling technologies to EVO. Current research evaluated concepts for flight deck-based interval management (FIM) operations, integrated with Synthetic Vision and Enhanced Vision flight-deck displays and technologies. One concept involves delegated flight deck-based separation, in which the flight crews were paired with another aircraft and responsible for spacing and maintaining separation from the paired aircraft, termed, "equivalent visual separation." The operation required the flight crews to acquire and maintain an "equivalent visual contact" as well as to conduct manual landings in low-visibility conditions. The paper describes results that evaluated the concept of EVO delegated separation, including an off-nominal scenario in which the lead aircraft was not able to conform to the assigned spacing resulting in a loss of separation.

Prinzel, Lawrence J., III↗
NASA NTRS2011

Contribution of Spaceflight Environmental Factors to Vision Risks

The risk of visual impairment and elevated intracranial pressure as a result of low-earth orbit microgravity exposure has directed our attention and research efforts to the eye. While the alterations observed in astronauts returning from long duration missions include vision and neuroanatomical changes observed by non-invasive methods, other effects and subsequent tissue responses at the molecular and cellular level can only be studied by accessing the tissue itself. As a result of this need, several studies are currently taking place within the Human and Health Countermeasures Element (HHC) that use animal models for eye research. The rodent eye has many similarities to the human eye, and both rats and mice have historically been used as models of human eye disease, aiding in the identification of the disease genes, elucidation of mechanisms of disease, as well as in the assessment of therapeutic treatments. These studies attempt to answer two central questions in the etiology of possible vision alterations in the environment of space exploration missions. The first is: what effects and response mechanisms take place in the different eye structures at the cellular and molecular level? The second question is directed to elucidate the contribution of the various environmental stressors (radiation, nutrition, fluid shift) to these effects. Collaborative approaches with internal and external investigators have allowed performing these studies in a most cost-effective fashion, providing preliminary data and laying the bases for testing further hypotheses in future and specifically designed animal experiments. From a study centered on the radioadaptive response in mice, we have learned that the retina responds to low and high dose gamma radiation by elevating antioxidant-related genes at early time points (4hrs) and that this response returns to control levels after 1 day post-irradiation. We are expanding this research with another collaborative study that investigates the combined effects of radiation exposure and iron overload on sensitivity to radiation injury in rat eyes. All main eye structures will be analyzed in this study: retina, lens and cornea. A study in collaboration with the Space Human Factors and Habitability Element (SHFH) investigates the effects of lunar dust exposure on the rat cornea. It is anticipated that common underlying oxidative stress mechanisms of damage may be observed as a result of these three stressors: radiation, nutritional iron and lunar dust. The contribution of fluid shift is addressed by a study using rats subjected to hindlimb suspension. The hypothesis to be tested in this study is that the mechanical stress imparted by the pressure differential across the optic disc and lamina cribosa will impact oxygenation (therefore causing oxidative stress and hypoxia) and cell survival. This study also includes the assessment of two nutritional antioxidant countermeasures: epigallocatechin gallate (green tea) and resveratrol. Finally, as a result of two successful tissue sharing efforts, we are proceeding with the analysis of eye samples of mice aboard two shuttle missions: STS-133 and STS-135. Results from the STS-133 study are presented in an independent abstract. Briefly, the results show that spaceflight represents a source of environmental stress that directly translates into oxidative and cellular stress in the retina. Similar analysis is also planned for the cornea. These samples add large value to our current vision research as they provide data on the direct effects of low-earth orbit spaceflight on eye structures and physiology.

Zanello, Susana B.↗
NASA NTRS2012

An Operationally Based Vision Assessment Simulator for Domes

The Operational Based Vision Assessment (OBVA) simulator was designed and built by NASA and the United States Air Force (USAF) to provide the Air Force School of Aerospace Medicine (USAFSAM) with a scientific testing laboratory to study human vision and testing standards in an operationally relevant environment. This paper describes the general design objectives and implementation characteristics of the simulator visual system being created to meet these requirements. A key design objective for the OBVA research simulator is to develop a real-time computer image generator (IG) and display subsystem that can display and update at 120 frame s per second (design target), or at a minimum, 60 frames per second, with minimal transport delay using commercial off-the-shelf (COTS) technology. There are three key parts of the OBVA simulator that are described in this paper: i) the real-time computer image generator, ii) the various COTS technology used to construct the simulator, and iii) the spherical dome display and real-time distortion correction subsystem. We describe the various issues, possible COTS solutions, and remaining problem areas identified by NASA and the USAF while designing and building the simulator for future vision research. We also describe the critically important relationship of the physical display components including distortion correction for the dome consistent with an objective of minimizing latency in the system. The performance of the automatic calibration system used in the dome is also described. Various recommendations for possible future implementations shall also be discussed.

Archdeacon, John↗
NASA NTRS2013

FPGA Vision Data Architecture

JPL has produced a series of FPGA (field programmable gate array) vision algorithms that were written with custom interfaces to get data in and out of each vision module. Each module has unique requirements on the data interface, and further vision modules are continually being developed, each with their own custom interfaces. Each memory module had also been designed for direct access to memory or to another memory module.

Morfopoulos, Arin C.↗
NASA NTRS2015

Evidence Based Medicine in Space Flight: Evaluation of Inflight Vision Data for Operational Decision-Making

Due to recently identified vision changes associated with space flight, JSC Space and Clinical Operations (SCO) implemented broad mission‐related vision testing starting in 2009. Optical Coherence Tomography (OCT), 3 Tesla Brain and Orbit MRIs, Optical Biometry were implemented terrestrially for clinical monitoring. While no inflight vision testing was in place, already available onorbit technology was leveraged to facilitate in‐flight clinical monitoring, including visual acuity, Amsler grid, tonometry, and ultrasonography. In 2013, on‐orbit testing capabilities were expanded to include contrast sensitivity testing and OCT. As these additional testing capabilities have been added, resource prioritization, particularly crew time, is under evaluation.

Van Baalen, Mary↗
NASA NTRS2015

Are Medications Involved in Vision and Intracranial Pressure Changes Seen in Spaceflight?

Some crewmembers have experienced changes in their vision after long-duration spaceflight on the ISS. These impairments include visual performance decrements, development of cotton-wool spots or choroidal folds, optic-disc edema, optic nerve sheath distention, and/or posterior globe flattening with varying degrees of severity and permanence. These changes are now used to define the visual impairment/intracranial pressure (VIIP) syndrome. It is known that many medications can have side effects that are similar to VIIP symptoms. Some medications raise blood pressure, which can affect intracranial pressure. Many medications that act in the central nervous system can affect intracranial pressures and/or vision. About 40% of the medications in the ISS kit are known to cause side effects involving changes in blood pressure, intracranial pressure and/or vision. For this reason, we have begun an investigation of the potential relationship between ISS medications and their risk of causing or exacerbating VIIP-like symptoms.

Wotring, V. E.↗
NASA NTRS2016

Are Medications Involved in Vision and intracranial Pressure Changes Seen in Spaceflight?

Some crewmembers have experienced changes in their vision after long-duration spaceflight on the ISS. These impairments include visual performance decrements, development of cotton-wool spots or choroidal folds, optic-disc edema, optic nerve sheath distention, and/or posterior globe flattening with varying degrees of severity and permanence. These changes are now used to define the visual impairment/intracranial pressure (VIIP) syndrome. The reasons for these potentially debilitating medical issues are currently unknown. The potential role of administered medications has not yet been examined, but it is known that many medications can have side effects that are similar to VIIP symptoms. Some medications raise blood pressure, which can affect intracranial pressure. Many medications that act in the central nervous system can affect intracranial pressures and/or vision. About 40% of the medications in the ISS kit are known to cause side effects involving changes in blood pressure, intracranial pressure and/or vision. For this reason, we proposed an investigation of the potential relationship between ISS medications and their risk of causing or exacerbating VIIP-like symptoms. The purpose of this study was to use medication usage records for affected and unaffected crew to determine if use of particular medications seemed to correlate with VIIP occurrence or severity.

Wotring, V. E.↗
NASA NTRS2017

Simulation Test of a Head-Worn Display with Ambient Vision Display for Unusual Attitude Recovery

Head-Worn Displays (HWDs) are envisioned as a possible equivalent to a Head-Up Display (HUD) in commercial and general aviation. A simulation experiment was conducted to evaluate whether the HWD can provide an equivalent or better level of performance to a HUD in terms of unusual attitude recognition and recovery. A prototype HWD was tested with ambient vision capability which were varied (on/off) as an independent variable in the experiment testing for attitude awareness. The simulation experiment was conducted in two parts: 1) short unusual attitude recovery scenarios where the aircraft is placed in an unusual attitude and a single-pilot crew recovered the aircraft; and, 2) a two-pilot crew operating in a realistic flight environment with "off-nominal" events to induce unusual attitudes. The data showed few differences in unusual attitude recognition and recovery performance between the tested head-down, head-up, and head-worn display concepts. The presence and absence of ambient vision stimulation was inconclusive. The ergonomic influences of the head-worn display, necessary to implement the ambient vision experimentation, may have influenced the pilot ratings and acceptance of the concepts.

Arthur, Jarvis (Trey) J., III↗
NASA NTRS2018

2040 Vision: A Roadmap for Integrated, Multiscale Materials and System Modeling and Simulation

Over the last few decades, advances in high-performance computing, new materials characterization methods, and, more recently, an emphasis on integrated computational materials engineering (ICME) and additive manufacturing have been a catalyst for multiscale modeling and simulation-based design of materials and structures in the aerospace industry. While these advances have driven significant progress in the development of aerospace components and systems, that progress has been limited by persistent technology and infrastructure challenges that must be overcome to realize the full potential of integrated materials and systems design and simulation modeling throughout the supply chain. As a result, NASA's Transformational Tools and Technology (TTT) Project sponsored a study (performed by a team led by Pratt & Whitney) to define the potential 25-year future state required for integrated multiscale modeling of materials and systems (e.g., load-bearing structures) to accelerate the pace and reduce the expense of innovation in future aerospace and aeronautical systems. This talk will describe the findings of this 2040 Vision study (e.g., the 2040 vision state; the required interdependent core technical work areas, Key Element (KE); associated critical gaps and actions to close those gaps; and major recommendations). This roadmap is a community consensus document and is a result of over 450 professionals input obtain via: i) four society workshops (AIAA, NAFEMS, and two TMS), ii) community-wide survey, and iii) the establishment of 9 expert panels (one per key element) consisting on average 10 non-team members from academia, government and industry to review, update content, and prioritize gaps and actions. It is NASA's hope and desire that this roadmap provides the strategic guidance to both public and private research and development decision makers to make the proposed 2040 vision state a reality and thereby provide a significant advancement in the United States global competitiveness.

Multiscale Modeling↗
NASA NTRS2019

Demonstration of Stereo Vision for Deorbit Descent and Landing

Planetary landers need to reduce velocity at low altitude for soft landing. Traditionally, estimating velocity and altitude has been performed with radar sensors whose performance meets the specific mission needs. There are not very many options for these sensors and they are difficult to include in a flight system either due to obsolescence, prohibitive cost or difficulty in accommodation. Recently, alternative sensing modalities are being pursued including Doppler LiDAR and vision. This paper describes results from a recent helicopter field test of a binocular stereo vision system for deorbit descent and landing applications. The system consisted of two 18.6 ̊ field of view cameras mounted 1.7m apart. Post processing of the images showed ranging accuracy better than 1% up to 500mand 17 cm/s velocimetry accuracy at 37m. For a flight system these images could be input into an FPGA-based processor which processes dense stereo and visual odometry in less than 1 second to achieve the stereo ranging frame rates required for soft landing. When coupled with vision based Terrain Relative Navigation this stereo system enables landing accuracies on the order of 10m.

Sternberg, David C.↗