Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “mobile visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Human factor roles in design of teleoperator systems

Teleoperator systems are considered, giving attention to types of teleoperators, a manned space vehicle attached manipulator, a free-flying teleoperator, a surface exploration roving vehicle, the human factors role in total system design, the manipulator system, the sensor system, the communication system, the control system, and the mobility system. The role of human factors in the development of teleoperator systems is also discussed, taking into account visual systems, an operator control station, and the manipulators.

Janow, C.↗

SAVA 3: A testbed for integration and control of visual processes

The development of an experimental test-bed to investigate the integration and control of perception in a continuously operating vision system is described. The test-bed integrates a 12 axis robotic stereo camera head mounted on a mobile robot, dedicated computer boards for real-time image acquisition and processing, and a distributed system for image description. The architecture was designed to: (1) be continuously operating, (2) integrate software contributions from geographically dispersed laboratories, (3) integrate description of the environment with 2D measurements, 3D models, and recognition of objects, (4) capable of supporting diverse experiments in gaze control, visual servoing, navigation, and object surveillance, and (5) dynamically reconfiguarable.

Crowley, James L.↗

The Challenge of Planning and Execution for Spacecraft Mobile Robots

The need for spacecraft mobile robots continues to grow. These robots offer the potential to increase the capability, productivity, and duration of space missions while decreasing mission risk and cost. Spacecraft Mobile Robots (SMRs) can serve a number of functions inside and outside of spacecraft from simpler tasks, such as performing visual diagnostics and crew support, to more complex tasks, such as performing maintenance and in-situ construction. One of the predominant challenges to deploying SMRs is to reduce the need for direct operator interaction. Teleoperation is often not practical due to the communication latencies incurred because of the distances involved and in many cases a crewmember would directly perform a task rather than teleoperate a robot to do it. By integrating a mixed-initiative constraint-based planner with an executive that supports adjustably autonomous control, we intend to demonstrate the feasibility of autonomous SMRs by deploying one inside the International Space Station (ISS) and demonstrate in simulation one that operates outside of the ISS. This paper discusses the progress made at NASA towards this end, the challenges ahead, and concludes with an invitation to the research community to participate.

Dorais, Gregory A.↗

Towards Autonomous Inspection of Space Systems Using Mobile Robotic Sensor Platforms

The space transportation systems required to support NASA's Exploration Initiative will demand a high degree of reliability to ensure mission success. This reliability can be realized through autonomous fault/damage detection and repair capabilities. It is crucial that such capabilities are incorporated into these systems since it will be impractical to rely upon Extra-Vehicular Activity (EVA), visual inspection or tele-operation due to the costly, labor-intensive and time-consuming nature of these methods. One approach to achieving this capability is through the use of an autonomous inspection system comprised of miniature mobile sensor platforms that will cooperatively perform high confidence inspection of space vehicles and habitats. This paper will discuss the efforts to develop a small scale demonstration test-bed to investigate the feasibility of using autonomous mobile sensor platforms to perform inspection operations. Progress will be discussed in technology areas including: the hardware implementation and demonstration of robotic sensor platforms, the implementation of a hardware test-bed facility, and the investigation of collaborative control algorithms.

Wong, Edmond↗

Adams-Based Rover Terramechanics and Mobility Simulator - ARTEMIS

The Mars Exploration Rovers (MERs), Spirit and Opportunity, far exceeded their original drive distance expectations and have traveled, at the time of this reporting, a combined 29 kilometers across the surface of Mars. The Rover Sequencing and Visualization Program (RSVP), the current program used to plan drives for MERs, is only a kinematic simulator of rover movement. Therefore, rover response to various terrains and soil types cannot be modeled. Although sandbox experiments attempt to model rover-terrain interaction, these experiments are time-intensive and costly, and they cannot be used within the tactical timeline of rover driving. Imaging techniques and hazard avoidance features on MER help to prevent the rover from traveling over dangerous terrains, but mobility issues have shown that these methods are not always sufficient. ARTEMIS, a dynamic modeling tool for MER, allows planned drives to be simulated before commands are sent to the rover. The deformable soils component of this model allows rover-terrain interactions to be simulated to determine if a particular drive path would take the rover over terrain that would induce hazardous levels of slip or sink. When used in the rover drive planning process, dynamic modeling reduces the likelihood of future mobility issues because high-risk areas could be identified before drive commands are sent to the rover, and drives planned over these areas could be rerouted. The ARTEMIS software consists of several components. These include a preprocessor, Digital Elevation Models (DEMs), Adams rover model, wheel and soil parameter files, MSC Adams GUI (commercial), MSC Adams dynamics solver (commercial), terramechanics subroutines (FORTRAN), a contact detection engine, a soil modification engine, and output DEMs of deformed soil. The preprocessor is used to define the terrain (from a DEM) and define the soil parameters for the terrain file. The Adams rover model is placed in this terrain. Wheel and soil parameter files can be altered in the respective text files. The rover model and terrain are viewed in Adams View, the GUI for ARTEMIS. The Adams dynamics solver calls terramechanics subroutines in FORTRAN containing the Bekker-Wong equations.

Trease, Brian P.↗

Rover Sequencing and Visualization Program

The Rover Sequencing and Visualization Program (RSVP) is the software tool for use in the Mars Exploration Rover (MER) mission for planning rover operations and generating command sequences for accomplishing those operations. RSVP combines three-dimensional (3D) visualization for immersive exploration of the operations area, stereoscopic image display for high-resolution examination of the downlinked imagery, and a sophisticated command-sequence editing tool for analysis and completion of the sequences. RSVP is linked with actual flight-code modules for operations rehearsal to provide feedback on the expected behavior of the rover prior to committing to a particular sequence. Playback tools allow for review of both rehearsed rover behavior and downlinked results of actual rover operations. These can be displayed simultaneously for comparison of rehearsed and actual activities for verification. The primary inputs to RSVP are downlink data products from the Operations Storage Server (OSS) and activity plans generated by the science team. The activity plans are high-level goals for the next day s activities. The downlink data products include imagery, terrain models, and telemetered engineering data on rover activities and state. The Rover Sequence Editor (RoSE) component of RSVP performs activity expansion to command sequences, command creation and editing with setting of command parameters, and viewing and management of rover resources. The HyperDrive component of RSVP performs 2D and 3D visualization of the rover s environment, graphical and animated review of rover-predicted and telemetered state, and creation and editing of command sequences related to mobility and Instrument Deployment Device (IDD) operations. Additionally, RoSE and HyperDrive together evaluate command sequences for potential violations of flight and safety rules. The products of RSVP include command sequences for uplink that are stored in the Distributed Object Manager (DOM) and predicted rover state histories stored in the OSS for comparison and validation of downlinked telemetry. The majority of components comprising RSVP utilize the MER command and activity dictionaries to automatically customize the system for MER activities. Thus, RSVP, being highly data driven, may be tailored to other missions with minimal effort. In addition, RSVP uses a distributed, message-passing architecture to allow multitasking, and collaborative visualization and sequence development by scattered team members.

Cooper, Brian↗

Motion Sickness and Concerns for Urban Air Mobility Vehicles: A Literature Review

Motion sickness is a general term for a constellation of signs and symptoms, generally due to exposure to abrupt, periodic, or unnatural accelerations, especially when traveling in a vehicle. Motion sickness results from a mismatch of the visual and nonvisual (vestibular and kinesthetic) information, the observed scene and the motion felt or lack of it. Motion sickness onset is associated with a pattern of physiological changes in heart rate, peripheral blood flow, respiration, and skin conductance and the pattern is repeatable for a particular subject but variable between subjects. Demographic factors such as gender and age that affect motion sickness are well known with children, women, and older adults more likely to be susceptible. Often motion sickness is assessed and quantified using variations of the motion sickness susceptibility questionnaires including the Pensacola Diagnostic Rating Scale and the Simulator Sickness Questionnaire. Even though symptoms are easily identified by such questionnaires, they commonly are subjective. Tools such as these questionnaires for screening individuals susceptible to motion sickness are useful, however, they are only mildly predictive. Moreover, models for predicting motion sickness, which have largely been developed for sea sickness, do not consider task characteristics. Predictions of motion sickness rates and prevalence for Urban Air Mobility (UAM) vehicles are not possible at present because data from actual flight or full-fidelity simulation are simply not yet available. Extrapolation from other modes of transportation (i.e., automobiles, buses, trains, boats, other types of aircraft) is difficult because of differences in the motion stimulus experienced, trip duration, and other factors. How UAM vehicles will change the social dynamics of passenger interaction and vehicle interior design changes (e.g., seat orientations) is unknown. Should motion sickness prove to be an issue, vehicle design modifications such as having passengers face forward, providing additional seat recline, giving each person their own climate control for airflow, perhaps ensuring the horizon is visible to all passengers (reducing visual occlusion by the headrest) and visually stabilizing displays on carry-on devices (smart phones, tablets, etc.) may benefit passengers. Several commercial companies provide wearable devices for physiological monitoring that have been validated and are suitable for use with passengers in UAM vehicles or high-fidelity simulators. Potential countermeasures for motion sickness include user-worn devices, anti-motion sickness medications, and non-pharmacological approaches such as biofeedback and Autogenic Feedback Training Exercise. Both simulator and in-vehicle UAM research is needed to evaluate the effectiveness of any potential countermeasure.

motion sickness↗

Role of EIS in Materials and Coatings Selection for NASA's Launch Facilities

Corrosion studies began at NASA's John F. Kennedy Space Center (KSC) in 1966, during the Gemini/Apollo Programs, with the evaluation of long-term anti-corrosion coatings for carbon steel structures. NASAIKSC's Atmospheric Exposure Test Site was established at that time on the beach near the launch pad. In the years that followed, numerous studies at the site have identified materials, coatings, and maintenance procedures for launch hardware and equipment exposed to the highly corrosive environment at the launch pad. The atmosphere at the launch pad is highly corrosive due to the proximity of the Atlantic Ocean, high heat from rocket exhaust, and since the introduction of the Space Shuttle, the acidic combustion products of the Solid Rocket Boosters (SRBs). Currently, NASAIKSC maintains about $2 billion worth of unique equipment and facilities, not including the orbiters, each valued at about $1.8 billion. Among the items: two launch complexes, two crawler transporters, three mobile launch platforms, and specialized testing equipment. Atmospheric exposure provides very valuable data but it takes a long time and relies on human visual inspection. NASA Technical Standard for Protective Coatings requires 18 months of good performance at the Atmospheric Exposure Test Site for preliminary approval and continued good performance for 5 years for final approval of a coating system. The use of electrochemical impedance spectroscopy (EIS) was introduced at KSC in 1989 as a supplement to the traditional dc electrochemical techniques and atmospheric exposure studies. This paper presents and overview of several projects in which EIS was used in order to select materials and coatings to be used at NASA's launch facilities [1-2].

Calle, Luz Marina↗

A Framework for Sense and Follow Convoys for Collective Autonomous Mobility

Convoys are collections of vehicles that share similar velocity profiles. In the sense-and follow convoy construct, a vehicle can follow a member of an existing convoy resulting in convoy chaining. We prove conditions under which this can occur such that the resulting convoy chain is bounded and the velocities of all members converge to the leader velocity through locally distributed control algorithms. To assess the approach, we utilize a six degree-of-freedom rigid body vehicle dynamics model for each agent. A dynamic inversion based control law is used to track the desired trajectory generated by the convoy algorithms. To simulate the system, we utilize Unity, a cross-platform game engine, where 3-dimensional terrain, building, and vehicle data can be visualized. Numerous simulations are presented to illustrate the concept.

convoys↗

Risk of Impaired Control of Spacecraft/Associated Systems and Decreased Mobility Due to Vestibular/Sensorimotor Alterations Associated with Space flight

Control of vehicles and other complex systems is a high-level integrative function of the central nervous system (CNS). It requires well-functioning subsystem performance, including good visual acuity, eye-hand coordination, spatial and geographic orientation perception, and cognitive function. Evidence from space flight research demonstrates that the function of each of these subsystems is altered by removing gravity, a fundamental orientation reference, which is sensed by vestibular, proprioceptive, and haptic receptors and used by the CNS for spatial orientation, posture, navigation, and coordination of movements. The available evidence also shows that the degree of alteration of each subsystem depends on a number of crew- and mission-related factors. There is only limited operational evidence that these alterations cause functional impacts on mission-critical vehicle (or complex system) control capabilities. Furthermore, while much of the operational performance data collected during space flight has not been available for independent analysis, those that have been reviewed are somewhat equivocal owing to uncontrolled (and/or unmeasured) environmental and/or engineering factors. Whether this can be improved by further analysis of previously inaccessible operational data or by development of new operational research protocols remains to be seen. The true operational risks will be estimable only after we have filled the knowledge gaps and when we can accurately assess integrated performance in off-nominal operational settings (Paloski et al. 2008). Thus, our current understanding of the Risk of Impaired Control of Spacecraft/Associated Systems and Decreased Mobility Due to Vestibular/Sensorimotor Alterations Associated with Space flight is limited primarily to extrapolation of scientific research findings, and, since there are limited ground-based analogs of the sensorimotor and vestibular changes associated with space flight, observation of their functional impacts is limited to studies performed in the space flight environment. Fortunately, many sensorimotor and vestibular experiments have been performed during and/or after space flight missions since 1959 (Reschke et al. 2007). While not all of these experiments were directly relevant to the question of vehicle/complex system control, most provide insight into changes in aspects of sensorimotor control that might bear on the physiological subsystems underlying this high-level integrated function.

Bloomberg, Jacob J.↗

Studies of the Interactions Between Vestibular Function and Tactual Orientation Display Systems

When humans experience conditions in which internal vestibular cues to movement or spatial location are challenged or contradicted by external visual information, the result can be spatial disorientation, often leading to motion sickness. Spatial disorientation can occur in any situation in which the individual is passively moved in the environment, but is most common in automotive, aircraft, or undersea travel. Significantly, the incidence of motion sickness in space travel is great: The majority of individuals in Shuttle operations suffer from the syndrome. Even after the space-sickness-producing influences of spatial disorientation dissipate, usually within several days, there are other situations in which, because of the absence of reliable or familiar vestibular cues, individuals in space still experience disorientation, resulting in a reliance on the already preoccupied sense of vision. One possible technique to minimize the deleterious effects of spatial disorientation might be to present attitude information (including orientation, direction, and motion) through another less-used sensory modality - the sense of touch. Data from experiences with deaf and blind persons indicate that this channel can provide useful communication and mobility information on a real-time basis. More recently, technologies have developed to present effective attitude information to pilots in situations in which dangerously ambiguous and conflicting visual and vestibular sensations occur. This summers project at NASA-Johnson Space Center will evaluate the influence of motion-based spatial disorientation on the perception of tactual stimuli representing veridical position and orientation information, presented by new dynamic vibrotactile array display technologies. In addition, the possibility will be explored that tactile presentations of motion and direction from this alternative modality might be useful in mitigating or alleviating spatial disorientation produced by multi-axis rotatory systems, monitored by physiological recording techniques developed at JSC.

Cholewiak, Roger W.↗

Robotic system for the servicing of the orbiter thermal protection system

This paper describes the design and development of a mobile robotic system to process orbiter thermal protection system (TPS) tiles. This work was justified by a TPS automation study which identified tile rewaterproofing and visual inspection as excellent applications for robotic automation.

Graham, Todd↗

Update on Rover Sequencing and Visualization Program

The Rover Sequencing and Visualization Program (RSVP) has been updated. RSVP was reported in Rover Sequencing and Visualization Program (NPO-30845), NASA Tech Briefs, Vol. 29, No. 4 (April 2005), page 38. To recapitulate: The Rover Sequencing and Visualization Program (RSVP) is the software tool to be used in the Mars Exploration Rover (MER) mission for planning rover operations and generating command sequences for accomplishing those operations. RSVP combines three-dimensional (3D) visualization for immersive exploration of the operations area, stereoscopic image display for high-resolution examination of the downlinked imagery, and a sophisticated command-sequence editing tool for analysis and completion of the sequences. RSVP is linked with actual flight code modules for operations rehearsal to provide feedback on the expected behavior of the rover prior to committing to a particular sequence. Playback tools allow for review of both rehearsed rover behavior and downlinked results of actual rover operations. These can be displayed simultaneously for comparison of rehearsed and actual activities for verification. The primary inputs to RSVP are downlink data products from the Operations Storage Server (OSS) and activity plans generated by the science team. The activity plans are high-level goals for the next day s activities. The downlink data products include imagery, terrain models, and telemetered engineering data on rover activities and state. The Rover Sequence Editor (RoSE) component of RSVP performs activity expansion to command sequences, command creation and editing with setting of command parameters, and viewing and management of rover resources. The HyperDrive component of RSVP performs 2D and 3D visualization of the rover s environment, graphical and animated review of rover predicted and telemetered state, and creation and editing of command sequences related to mobility and Instrument Deployment Device (robotic arm) operations. Additionally, RoSE and HyperDrive together evaluate command sequences for potential violations of flight and safety rules. The products of RSVP include command sequences for uplink that are stored in the Distributed Object Manager (DOM) and predicted rover state histories stored in the OSS for comparison and validation of downlinked telemetry. The majority of components comprising RSVP utilize the MER command and activity dictionaries to automatically customize the system for MER activities.

Cooper, Brian↗

New Flight Rules to Enable the Era of Aerial Mobility in the National Airspace System

In the 21st Century, new aviation markets, vehicle types, and technologies are fast emerging, inspiring new operational concepts for the National Airspace System such as Unmanned Aircraft Systems Traffic Management and Urban Air Mobility. These novel operations envision a dramatic increase in aerial mobility, or the ability to navigate freely through the airspace with unprecedented access and operational flexibility. Implementing these concepts presents a major challenge to the existing operational modes of Visual Flight Rules (VFR) and Instrument Flight Rules (IFR), developed under the limitations of early 20th Century technology and procedures to ensure safe navigation and separation from traffic. To meet this challenge and to support the needs of operators in the 21st Century and beyond, this paper proposes that VFR and IFR be augmented by new flight rules – Digital Flight Rules (DFR) – that leverage modern and emerging technologies and are not bound by restrictions borne of the state of technology 75-100 years ago. The objective of DFR is to provide safe and unfettered access to the airspace to all participating vehicle operators under all visibility conditions without incurring the limitations in operational flexibility inherent to IFR and even VFR. Advancements in communications, navigation, surveillance, aircraft connectivity, information access, automation technology, and supporting ground infrastructure provide the opportunity for the vehicle operator to engage at an unprecedented level in managing their flights regardless of flight visibility. Under DFR, these advancements enable the vehicle operator to assume full responsibility for traffic separation and therefore full trajectory management authority in all visibility conditions and airspace regions. The changes in roles and responsibilities are expected to enable greater airspace access and operational flexibility than afforded by IFR and VFR, thus enabling the emergence of new operations and a new era of advanced aerial mobility.

Mobility↗

Digital Flight: Enabling the Era of Scalable Mobility in the National Airspace System

In the 21st Century, new aviation markets, vehicle types, and technologies are fast emerging, inspiring new operational concepts for the National Airspace System such as Unmanned Aircraft Systems Traffic Management and Urban Air Mobility. These novel operations envision a dramatic increase in aerial mobility, or the ability to navigate freely through the airspace with unprecedented access and operational flexibility. Implementing these concepts presents a major challenge to the existing operational modes of Visual Flight Rules (VFR) and Instrument Flight Rules (IFR), developed under the limitations of early 20th Century technology and procedures to ensure safe navigation and separation from traffic. To meet this challenge and to support the needs of operators in the 21st Century and beyond, this paper proposes that VFR and IFR be augmented by new flight rules – Digital Flight Rules (DFR) – that leverage modern and emerging technologies and are not bound by restrictions borne of the state of technology 75-100 years ago. The objective of DFR is to provide safe and unfettered access to the airspace to all participating vehicle operators under all visibility conditions without incurring the limitations in operational flexibility inherent to IFR and even VFR. Advancements in communications, navigation, surveillance, aircraft connectivity, information access, automation technology, and supporting ground infrastructure provide the opportunity for the vehicle operator to engage at an unprecedented level in managing their flights regardless of flight visibility. Under DFR, these advancements enable the vehicle operator to assume full responsibility for traffic separation and therefore full trajectory management authority in all visibility conditions and airspace regions. The changes in roles and responsibilities are expected to enable greater airspace access and operational flexibility than afforded by IFR and VFR, thus enabling the emergence of new operations and a new era of advanced aerial mobility.

Mobility↗

Distributed Sensor Fusion of Ground and Air Nodes Using Vision and Radar Modalities for Tracking Multirotor Small Uncrewed Air Systems and Birds

High-density airspace operations with multiple aircraft type and potentially noncooperative aircraft require distributed sensor detection and tracking systems to monitor airspace for safe, autonomous flight operations for advanced air mobility, urban air mobility, and high density small uncrewed air systems (SUAS) flight concepts. This work collected data using a distributed radar and camera sensor framework during the NASA Advanced Air Mobility High Density Vertiplex project SUAS flight operation. Node locations include on an onboard SUAS, affixed to the Landing and Impact Research Facility with approximate 200ft elevation, on a tripod on first-floor roof with an approximate elevation of 20 ft, and on a tripod on a concrete pad that is approximately 4 ft above sea level. Each node includes camera, radar, and GPS.

Beyond Visual Line of Sight↗

A Framework for Sense and Follow Convoys for Collective Autonomous Mobility

Convoys are collections of vehicles that share similar velocity profiles. In the sense-and follow convoy construct, a vehicle can follow a member of an existing convoy resulting in convoy chaining. We prove conditions under which this can occur such that the resulting convoy chain is bounded and the velocities of all members converge to the leader velocity through locally distributed control algorithms. To assess the approach, we utilize a six degree-of-freedom rigid body vehicle dynamics model for each agent. A dynamic inversion based control law is used to track the desired trajectory generated by the convoy algorithms. To simulate the system, we utilize Unity, a cross-platform game engine, where 3-dimensional terrain, building, and vehicle data can be visualized. Numerous simulations are presented to illustrate the concept. Link to video file below:

convoys↗