Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “visual tracking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Conditions for Interference Versus Facilitation During Sequential Sensorimotor Adaptation

We investigated how sensorimotor adaptation acquired during one experimental session influenced the adaptation in a subsequent session. The subjects' task was to track a visual target using a joystick-controlled cursor, while the relationship between joystick and cursor position was manipulated to introduce a sensorimotor discordance. Each subject participated in two sessions, separated by a pause of 2 min to 1 month duration. We found that adaptation was achieved within minutes, and persisted in the memory for at least a month, with only a small decay (experiment A). When the discordances administered in the two sessions were in mutual conflict, we found evidence for task interference (experiment B). However, when the discordances were independent, we found facilitation rather than interference (experiment C); the latter finding could not be explained by the use of an "easier" discordance in the second session (experiment D). We conclude that interference is due to an incompatibility between task requirements, and not to a competition of tasks for short-term memory. We further conclude that the ability to adapt to a sensorimotor discordance.

Bock, Otmar↗

Lunar Node – 1: Initial Flight Results and the Role of Surface Psuedolites in Lunar Navigation

On February 22, 2024, the Intuitive Machines IM-1 NOVA-C lander, nick-named Odysseus, landed on the lunar surface, carrying with it a cadre of NASA scientific and technology demonstration payloads. These payloads and missions marked the first delivery of NASA instruments to operate from the lunar surface since the Apollo landings. One of these payloads is Lunar Node -1 (LN-1), a navigation beacon demonstration mission. The payload was designed and built by NASA’s Marshall Space Flight Center. The payload’s main goal was to demonstrate and provide insight into the use of lunar surface-based radio navigation aids. As part of the mission, LN-1 successfully conducted multiple one-way transmissions from the NOVA-C vehicle to Deep Space Network ground receivers using its onboard S-band transmitter, while being disciplined by an onboard Space Chip Scale Atomic Clock. LN-1 transmitted to DSN on an almost daily basis during transit to the moon, including two surface passes. The payload was originally plan to conduct 7-10 days of surface operation as an always-on beacon. These passes focused on evaluating two main navigation approaches: performance and stability of ranging using time-based transfer techniques on a cubesat size and grade platform, as well as one-way psuedonoise ranging approaches. To assess performance, the measurements were compared to independent navigation solutions using multiple approaches including: one-way Doppler tracking, two-way Doppler Tracking, and visual verification of the landing location provided by visual observations from orbital platforms. While the mission only conducted limited surface operations, the data provides some initial insight to performance form the lunar surface. These results are compared with initial ground-based testing as well as continued evaluation of the flight-space platform using multiple grades of oscillators for maintaining clock and frequency stability. These focus on the timing stability of platform in a deep-space environment as well variations in state determination. Given these insights, this paper provides additional description and evaluation of how this approach can be utilized as part of a broader lunar navigation architecture, such as being developed and deployed across multiple international space agencies. Analysis is provided to develop overall timing requirements and assessment of operational scenarios, such as orbit and surface location determination. In addition, the results support discussion as to how surface pseudolites could best be used within existing standard signal definitions, such as defined in the LunaNet Interoperability Specifications. This will consider concerns such as the near-/far- problem as well as operational considerations, including whether a beacon is better suited as two- or one-way ranging platform. The use cases are focused on how these psuedolites can provide additional coverage to augment and support planned operational coverage. For example, this analysis provides analysis of mid-latitude surface missions, where there may be limited geometry and availability of orbital relays. The results will show how these navigation psuedolites can fit within the developing architecture to provide additional robustness, capability, and support multiple use cases. Lastly, the paper will discuss challenges and next steps to be addressed in the implementation and testing of a follow-on payload and a continued path towards demonstration and integration of this capability into Lunar PNT architectures.

Evan Anzalone↗

Lunar Node – 1: Initial Flight Results and the Role of Surface Psuedolites in Lunar Navigation

On February 22, 2024, Intuitive Machines NOVA-C lander, nick-named Odysseus, landed on the lunar surface, carrying with it a cadre of NASA scientific and technology demonstration payloads. These payloads and missions marked the first delivery of NASA instruments to operate from the lunar surface since the Apollo landings. One of these payloads is Lunar Node -1 (LN-1), a navigation beacon demonstration mission. The payload was designed and built by NASA’s Marshall Space Flight Center. The payload’s main goal was to demonstrate and provide insight into the use of lunar surface-based radio navigation aids. As part of the mission, LN-1 successfully conducted multiple one-way transmissions from the NOVA-C vehicle to Deep Space Network ground receivers using its onboard S-band transmitter, while being disciplined by an onboard Space Chip Scale Atomic Clock. LN-1 transmitted to DSN on an almost daily basis during transit to the moon, including two surface passes. The payload was originally plan to conduct 7-10 days of surface operation as an always-on beacon. These passes focused on evaluating two main navigation approaches: performance and stability of ranging using time-based transfer techniques on a cubesat size and grade platform, as well as one-way psuedonoise ranging approaches. To assess performance, the measurements were compared to independent navigation solutions using multiple approaches including: one-way Doppler tracking, two-way Doppler Tracking, and visual verification of the landing location provided by visual observations from orbital platforms. While the mission only conducted limited surface operations, the data provides some initial insight to performance form the lunar surface. These results are compared with initial ground-based testing as well as continued evaluation of the flight-space platform using multiple grades of oscillators for maintaining clock and frequency stability. These focus on the timing stability of platform in a deep-space environment as well variations in state determination. Given these insights, this paper provides additional description and evaluation of how this approach can be utilized as part of a broader lunar navigation architecture, such as being developed and deployed across multiple international space agencies. Analysis is provided to develop overall timing requirements and assessment of operational scenarios, such as orbit and surface location determination. In addition, the results support discussion as to how surface pseudolites could best be used within existing standard signal definitions, such as defined in the LunaNet Interoperability Specifications. This will consider concerns such as the near-/far- problem as well as operational considerations, including whether a beacon is better suited as two- or one-way ranging platform. The use cases are focused on how these psuedolites can provide additional coverage to augment and support planned operational coverage. For example, this analysis provides analysis of mid-latitude surface missions, where there may be limited geometry and availability of orbital relays. The results will show how these navigation psuedolites can fit within the developing architecture to provide additional robustness, capability, and support multiple use cases. Lastly, the paper will discuss challenges and next steps to be addressed in the implementation and testing of a follow-on payload and a continued path towards demonstration and integration of this capability into Lunar PNT architectures.

Evan J Anzalone↗

Analysis of VFR Traffic Uncertainty and its Impact on Uncrewed Aircraft Operational Capacity at Regional Airports

This paper proposes a method to characterize Visual Flight Rules traffic around a regional airport. The applicability of the method is discussed in the context of Uncrewed Aircraft operations at a regional airport. The relation between traffic interaction uncertainty and operational capacity at the runway is also investigated. The spatio-temporal distribution of traffic operating under Visual Flight Rules is analyzed from historical track data and visualized as heat maps generated at different altitudes. These are used to characterize the spatio-temporal uncertainty associated with traffic density, around a given airport, down to the runway. The traffic patterns at the runway are used to compute the runway capacity as a function of the probability of interaction with traffic operating under visual flight rules. Fort Worth Alliance is used as a representative regional airport for the study. Applications of the traffic characterization methods developed in this paper are also discussed.

VFR traffic, uncertainty, air mobility↗

Analysis of VFR Traffic Uncertainty and its Impact on Uncrewed Aircraft Operational Capacity at Regional Airports

This paper proposes a method to characterize Visual Flight Rules traffic around a regional airport. The applicability of the method is discussed in the context of Uncrewed Aircraft operations at a regional airport. The relation between traffic interaction uncertainty and operational capacity at the runway is also investigated. The spatio-temporal distribution of traffic operating under Visual Flight Rules is analyzed from historical track data and visualized as heat maps generated at different altitudes. These are used to characterize the spatio-temporal uncertainty associated with traffic density, around a given airport, down to the runway. The traffic patterns at the runway are used to compute the runway capacity as a function of the probability of interaction with traffic operating under visual flight rules. Fort Worth Alliance is used as a representative regional airport for the study. Applications of the traffic characterization methods developed in this paper are also discussed.

VFR traffic↗

Developing Methods for Exercise System Kinematic Tracking

BACKGROUND How to quantify the load and forces produced by exercise equipment and their Vibration Isolation and Stabilization (VIS) platforms in-flight is an active area of investigation. Kinematic tracking paired with system modeling can provide insights as well as verification and validation of simulations used for system design and development. Traditional motion capture methods can require significant cost in equipment procurement and crew-time, but newer lessons learned can be leveraged [1]. The VIS systems of current and future exercise hardware on the International Space Station (ISS) such as the Cycle Ergometer with Vibration Isolation System (CEVIS) and the European Enhanced Exploration Exercise Device (E4D) are not currently outfitted with IMUs or similar measurement devices. Video-based methods would enable use of multi-purpose, crew-familiar flight equipment. An initial exploration of video-based solutions was performed utilizing 2-camera video from crew cycling on Teal-CEVIS on the ISS. METHODS AND RESULTS Our group has scoped a variety of video-based object tracking methods. To date, we have primarily investigated computer vision toolkits such as open CV. Techniques explored include key-point detection, background subtraction, region-of interest tracking, color-based tracking, tag masking and tracking, and corner detection. Although object-tracking and 6D pose estimation is a rich field, space applications are a unique problem that are challenging for existing software and toolkits. The majority of the existing object-tracking applications involve vehicles/pedestrians and household objects with simple backgrounds. We have identified the following features which pose particular challenges for on-station exercise equipment tracking: 1. Busy and visually cluttered background 2. Low-textured tracking object with relatively small motions 3. Occlusions and motion by human subject and loose, floating objects 4. Limited number of video cameras with no fixed global references 5. Limited ability to add tags, markers, or visual references to the tracking object 6. Lack of training data for Machine Learning (ML) algorithms CONCLUSION We will summarize the efficacy of techniques tested for a ground mock-trial and the on-station exercise trial. It is likely that human-in-loop feedback or a conglomerate of methods is required. ML-based methods, like those implemented for human body tracking [2], may still be a viable option, but more training data and validation is needed.

L Nilsson↗

Weighted feature selection criteria for visual servoing of a telerobot

Because of the continually changing environment of a space station, visual feedback is a vital element of a telerobotic system. A real time visual servoing system would allow a telerobot to track and manipulate randomly moving objects. Methodologies for the automatic selection of image features to be used to visually control the relative position between an eye-in-hand telerobot and a known object are devised. A weighted criteria function with both image recognition and control components is used to select the combination of image features which provides the best control. Simulation and experimental results of a PUMA robot arm visually tracking a randomly moving carburetor gasket with a visual update time of 70 milliseconds are discussed.

Feddema, John T.↗

Hesitations in continuous tracking induced by a concurrent discrete task

Subjects performed a continuous visually-guided pursuit tracking task with the right hand. From time to time (intervals averaging 30 sec) an auditory tone appeared signaling the subjects to perform a discrete response with the left hand. The presence of this tone was frequently associated with a hesitation in right-hand tracking which lasted 1/3 sec or longer. The rate of occurrence of these hesitations was about the same when the left-hand response involved a choice between competing responses as when the left hand responded in a predetermined direction. Hesitations occurred for three different mechanical tracking manipulanda using different controlling muscles, and appeared to be due to freezing rather than to relaxation of muscular action. The rate of occurrence of hesitations declined with practice, and this improvement in right-hand performance was accompanied by an improvement in performance of the concurrent left-hand response. The presence of hesitations, and their reduction with practice, can be interpreted within several viewpoints.

Klapp, S. T.↗

Hesitations in continuous tracking induced by a concurrent discrete task

Subjects performed a continuous visually-guided pursuit tracking task with the right hand. From time to time (intervals averaging 30 sec) an auditory tone appeared signaling the subjects to perform a discrete response with the left hand. The presence of this tone was frequently associated with a hesitation in right-hand tracking which lasted 1/3 sec or longer. The rate of occurrence of these hesitations was about the same when the left-hand response involved a choice between competing responses as when the left hand responded in a predetermined direction. Hesitations occurred for three different mechanical tracking manipulanda using different controlling muscles, and appeared to be due to freezing rather than to relaxation of muscular action. The rate of occurrence of hesitations declined with practice, and this improvement in right-hand performance was accompanied by an improvement in performance of the concurrent left-hand response. The presence of hesitations, and their reduction with practice, can be interpreted within several viewpoints.

Klapp, Stuart T.↗

Visual perception system and method for a humanoid robot

A robotic system includes a humanoid robot with robotic joints each moveable using an actuator(s), and a distributed controller for controlling the movement of each of the robotic joints. The controller includes a visual perception module (VPM) for visually identifying and tracking an object in the field of view of the robot under threshold lighting conditions. The VPM includes optical devices for collecting an image of the object, a positional extraction device, and a host machine having an algorithm for processing the image and positional information. The algorithm visually identifies and tracks the object, and automatically adapts an exposure time of the optical devices to prevent feature data loss of the image under the threshold lighting conditions. A method of identifying and tracking the object includes collecting the image, extracting positional information of the object, and automatically adapting the exposure time to thereby prevent feature data loss of the image.

Wells, James W.↗

A Scalable Distributed Approach to Mobile Robot Vision

This paper documents our progress during the first year of work on our original proposal entitled 'A Scalable Distributed Approach to Mobile Robot Vision'. We are pursuing a strategy for real-time visual identification and tracking of complex objects which does not rely on specialized image-processing hardware. In this system perceptual schemas represent objects as a graph of primitive features. Distributed software agents identify and track these features, using variable-geometry image subwindows of limited size. Active control of imaging parameters and selective processing makes simultaneous real-time tracking of many primitive features tractable. Perceptual schemas operate independently from the tracking of primitive features, so that real-time tracking of a set of image features is not hurt by latency in recognition of the object that those features make up. The architecture allows semantically significant features to be tracked with limited expenditure of computational resources, and allows the visual computation to be distributed across a network of processors. Early experiments are described which demonstrate the usefulness of this formulation, followed by a brief overview of our more recent progress (after the first year).

Kuipers, Benjamin↗

Low-Dose Caffeine Administration During Acute Sleep Deprivation Eliminates Visual Motion Processing Impairment, but Does Not Improve Saccadic Rate

Oculomotor tracking performance changes according to time awake. A constant routine (CR) study demonstrated that increasing time awake 1) reduces the precision of visual motion processing, 2) decreases steady-state closed-loop pursuit performance and 3) decreases peak saccadic velocity. We aimed to determine the contribution of homeostatic sleep pressure on these oculometric changes by administering low-dose caffeine over one night of sleep deprivation. Participants completed two weeks of at-home 8.5 hours sleep per day, followed by an approximately 24-hour laboratory CR in semi-recumbent posture under less than 4 lux of light. The visual tracking task was performed every two hours after waking and hourly overnight. Low-dose caffeine of 0.3 milligrams per kilogram was administered hourly during the biological night. Nine participants (5F) completed the study. Caffeine dosing: 1) prevented the impairment of visual motion processing, 2) reduced by approximately half the impairment of closed-loop pursuit performance (gain, minus 0.47 percent per hour, significance of slope change: p (probability) less than 0.006; proportion smooth, minus 0.35 percent per hour, p less than 0.005), and 3) had an insignificant (p less than 0.39) effect on the impairment of saccadic peak velocity (slope, minus 1.13 percent per hour; intercept, minus 0.62 percent per hour). These results suggest that visual motion processing and some proportion of closed-loop pursuit performance are impaired due to homeostatic mechanisms during sleep deprivation.

Sleep↗

Sensor Spatial Distortion, Visual Latency, and Update Rate Effects on 3D Tracking in Virtual Environments

Several common defects that we have sought to minimize in immersing virtual environments are: static sensor spatial distortion, visual latency, and low update rates. Human performance within our environments during large amplitude 3D tracking was assessed by objective and subjective methods in the presence and absence of these defects. Results show that 1) removal of our relatively small spatial sensor distortion had minor effects on the tracking activity, 2) an Adapted Cooper-Harper controllability scale proved the most sensitive subjective indicator of the degradation of dynamic fidelity caused by increasing latency and decreasing frame rates, and 3) performance, as measured by normalized RMS tracking error or subjective impressions, was more markedly influenced by changing visual latency than by update rate.

Ellis, S. R.↗

Cross-modal interference and task integration - Resources or preemption switching?

Data are reviewed from experiments that have contrasted intra-modal (visual-visual) information presentation with cross-modal (visual-auditory) presentation. Five different processing mechanisms that are operating in dual stimulus tasks are described, and it is concluded that in studies where visual scanning is not required, cross-modal effects are of two classes. When the visual task is continuous (tracking), a discrete auditory stimulus will preempt tracking performance relative to a discrete visual stimulus, leading to an effective shift in allocation bias. When both tasks are discrete, the data regarding the relative advantages of cross- vs. intra-modal interference are ambivalent.

Wickens, Christopher D.↗

Secondary visual workload capability with primary visual and kinesthetic-tactual displays

Subjects performed a cross-adaptive tracking task with a visual secondary display and either a visual or a quickened kinesthetic-tactual (K-T) primary display. The quickened K-T display resulted in superior secondary task performance. Comparisons of secondary workload capability with integrated and separated visual displays indicated that the superiority of the quickened K-T display was not simply due to the elimination of visual scanning. When subjects did not have to perform a secondary task, there was no significant difference between visual and quickened K-T displays in performing a critical tracking task.

Gilson, R. D.↗

Development of the Code RITRACKS

A document discusses the code RITRACKS (Relativistic Ion Tracks), which was developed to simulate heavy ion track structure at the microscopic and nanoscopic scales. It is a Monte-Carlo code that simulates the production of radiolytic species in water, event-by-event, and which may be used to simulate tracks and also to calculate dose in targets and voxels of different sizes. The dose deposited by the radiation can be calculated in nanovolumes (voxels). RITRACKS allows simulation of radiation tracks without the need of extensive knowledge of computer programming or Monte-Carlo simulations. It is installed as a regular application on Windows systems. The main input parameters entered by the user are the type and energy of the ion, the length and size of the irradiated volume, the number of ions impacting the volume, and the number of histories. The simulation can be started after the input parameters are entered in the GUI. The number of each kind of interactions for each track is shown in the result details window. The tracks can be visualized in 3D after the simulation is complete. It is also possible to see the time evolution of the tracks and zoom on specific parts of the tracks. The software RITRACKS can be very useful for radiation scientists to investigate various problems in the fields of radiation physics, radiation chemistry, and radiation biology. For example, it can be used to simulate electron ejection experiments (radiation physics).

Plante, Ianik↗

The effect of visual-motion time delays on pilot performance in a pursuit tracking task

A study has been made to determine the effect of visual-motion time delays on pilot performance of a simulated pursuit tracking task. Three interrelated major effects have been identified: task difficulty, motion cues, and time delays. As task difficulty, as determined by airplane handling qualities or target frequency, increases, the amount of acceptable time delay decreases. However, when relatively complete motion cues are included in the simulation, the pilot can maintain his performance for considerably longer time delays. In addition, the number of degrees of freedom of motion employed is a significant factor.

Miller, G. K., Jr.↗