Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “visual guidance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Machine Vision for Autonomous Small Body Navigation

This paper describes machine vision algorithms that enable precision guidance and hazard avoidance during small body exploration through onboard visual feature tracking and landmark recognition.

Estimation Landmark Recognition↗

Safe and Precise Landing Integrated Capabilities Evolution (SPLICE) Imagery of Sensors

Collection of imagery of SPLICE hardware and software visualization. Descent Landing Computer ETU Open Frame Chassis (OFC). ETU pictures of the GSFC Hazard Detection Lidar during assembly. Prototype picture of the delivered Psionic Navigation Doppler Lidar, including testing with a three-dimensional mobile target. Visualization of a lunar lander simulation using the Dual Quaternion Guidance, demonstrating pointing of a mounted hazard lidar, and then diverting to a selected safe site.

Guidance Navigation and Control↗

Quantifying the performance limits of human saccadic targeting during visual search

In previous studies of saccadic targeting, the issue how visually guided saccades to unambiguous targets are programmed and executed has been examined. These studies have found different degrees of guidance for saccades depending on the task and task difficulty. In this study, we use ideal-observer analysis to estimate the visual information used for the first saccade during a search for a target disk in noise. We quantitatively compare the performance of the first saccadic decision to that of the ideal observer (ie absolute efficiency of the first saccade) and to that of the associated final perceptual decision at the end of the search (ie relative efficiency of the first saccade). Our results show, first, that at all levels of salience tested, the first saccade is based on visual information from the stimulus display, and its highest absolute efficiency is approximately 20%. Second, the efficiency of the first saccade is lower than that of the final perceptual decision after active search (with eye movements) and has a minimum relative efficiency of 19% at the lowest level of saliency investigated. Third, we found that requiring observers to maintain central fixation (no saccades allowed) decreased the absolute efficiency of their perceptual decision by up to a factor of two, but that the magnitude of this effect depended on target salience. Our results demonstrate that ideal-observer analysis can be extended to measure the visual information mediating saccadic target-selection decisions during visual search, which enables direct comparison of saccadic and perceptual efficiencies.

Non-NASA Center↗

Flight tests of a helmet-mounted display synthetic visibility system

A short flight test program was conducted using the NASA Langley Research Center's B737 Advanced Transport Operating Systems (ATOPS) research airplane to determine if pilots could land a transport category airplane under visual meteorological conditions (VMC) by reference to a synthetic visibility system. No external guidance was to be used. The program was undertaken jointly by NASA and the McDonnel-Douglas Corporation. The airplane was fitted with forward-looking television cameras fixed in the nose. Inputs from the television cameras were mixed with internally generated symbology and displayed to the pilot on helmet-mounted eyepieces. The pilot task was to execute a visual approach and landing. Two NASA and two McDonnel-Douglas engineering test pilots participated in the program completing over 200 landings in a 32-hour test program. Landings accomplished with the helmet-mounted display (HMD) were compared with visual landings for each pilot.

Yenni, Kenneth R.↗

Exploring Anomalous PM 2.5 from Wildfires and Dust Storms using Data and Services at NASA GES DISC

The presence of fine particles in the atmosphere with a diameter of less than 2.5 µm, called particulate matter 2.5 (PM 2.5 ), poses a significant threat to human health as a criteria air pollutant. Fortunately, NASA's Goddard Earth Sciences Data and Information Services Center (GES DISC) provides easy access to several PM 2.5 concentration products. These datasets include the reanalysis of global hourly and monthly aerosol components including PM 2.5 data from the Modern-Era Retrospective analysis for Research and Applications, version 2 (MERRA-2), as well as 3-hourly real-time ensemble forecasts of PM 2.5 from the Hazardous Air Quality Ensemble System (HAQES). The HAQES products are developed by the George Mason University Air Quality Laboratory as part of NASA's Health Air Quality Applied Science Team (HAQAST). The GES DISC is actively collaborating with scientists in the HAQAST program to further expand air quality data collections. Two new datasets are currently being archived: one is the machine learning-based global hourly PM 2.5 derived from MERRA-2; the other is the localized data (NO 2 , O 3 , and PM 2.5 ) time series derived from NASA's GEOS Composition Forecasting (GEOS-CF) system. In this presentation, we will explore the spatial patterns and long-distance transport characteristics of elevated PM 2.5 during extreme pollution events, such as the June 2023 Canadian wildfires, which are still active at the time of writing; and severe spring dust storms in 2023 over Asia. To gain comprehensive insights, we will utilize various PM 2.5 data in conjunction with satellite-observed aerosol data from TROPOspheric Monitoring Instrument (TROPOMI) on Sentinel-5P. The primary focus of this presentation will be to demonstrate effective use of data tools and services to visualize and explore extreme air pollution phenomena. Additionally, we will provide guidance on how users can download specific data of interest, facilitating further analysis and research in this critical area.

air quality↗

The Shuttle Mission Simulator computer generated imagery

Equipment available in the primary training facility for the Space Transportation System (STS) flight crews includes the Fixed Base Simulator, the Motion Base Simulator, the Spacelab Simulator, and the Guidance and Navigation Simulator. The Shuttle Mission Simulator (SMS) consists of the Fixed Base Simulator and the Motion Base Simulator. The SMS utilizes four visual Computer Generated Image (CGI) systems. The Motion Base Simulator has a forward crew station with six-degrees of freedom motion simulation. Operation of the Spacelab Simulator is planned for the spring of 1983. The Guidance and Navigation Simulator went into operation in 1982. Aspects of orbital visual simulation are discussed, taking into account the earth scene, payload simulation, the generation and display of 1079 stars, the simulation of sun glare, and Reaction Control System jet firing plumes. Attention is also given to landing site visual simulation, and night launch and landing simulation.

Henderson, T. H.↗

Autonomous Diagnostic Imaging Performed by Untrained Operators using Augmented Reality as a Form of "Just-in-Time" Training

We will address the Human Factors and Performance Team, "Risk of performance errors due to training deficiencies" by improving the JIT training materials for ultrasound and OCT imaging by providing advanced guidance in a detailed, timely, and user-friendly manner. Specifically, we will (1) develop an audio-visual tutorial using AR that guides non-experts through an abdominal trauma ultrasound protocol; (2) develop an audio-visual tutorial using AR to guide an untrained operator through the acquisition of OCT images; (3) evaluate the quality of abdominal ultrasound and OCT images acquired by untrained operators using AR guidance compared to images acquired using traditional JIT techniques (laptop-based training conducted before image acquisition); and (4) compare the time required to complete imaging studies using AR tutorials with images acquired using current JIT practices to identify areas for time efficiency improvements. Two groups of subjects will be recruited to participate in this study. Operator-subjects, without previous experience in ultrasound or OCT, will be asked to perform both procedures using either the JIT training with AR technology or the traditional JIT training via laptop. Images acquired by inexperienced operator-subjects will be scored by experts in that imaging modality for diagnostic and research quality; experts will be blinded to the form of JIT used to acquire the images. Operator-subjects also will be asked to submit feedback to improve the training modules used during the scans to improve future training modules. Scanned-subjects will be a small group individuals from whom all images will be acquired.

Martin, D. S.↗

Autonomous Diagnostic Imaging Performed by Untrained Operator Using Augmented Reality as a Form of "Just-in-Time" Training

We will address the Human Factors and Performance Team, "Risk of performance errors due to training deficiencies" by improving the JIT training materials for ultrasound and OCT imaging by providing advanced guidance in a detailed, timely, and user-friendly manner. Specifically, we will (1) develop an audio-visual tutorial using AR that guides non-experts through an abdominal trauma ultrasound protocol; (2) develop an audio-visual tutorial using AR to guide an untrained operator through the acquisition of OCT images; (3) evaluate the quality of abdominal ultrasound and OCT images acquired by untrained operators using AR guidance compared to images acquired using traditional JIT techniques (laptop-based training conducted before image acquisition); and (4) compare the time required to complete imaging studies using AR tutorials with images acquired using current JIT practices to identify areas for time efficiency improvements. Two groups of subjects will be recruited to participate in this study. Operator-subjects, without previous experience in ultrasound or OCT, will be asked to perform both procedures using either the JIT training with AR technology or the traditional JIT training via laptop. Images acquired by inexperienced operator-subjects will be scored by experts in that imaging modality for diagnostic and research quality; experts will be blinded to the form of JIT used to acquire the images. Operator-subjects also will be asked to submit feedback to improve the training modules used during the scans to improve future training modules. Scanned-subjects will be a small group individuals from whom all images will be acquired.

Martin, David S.↗

Conflict Alerts for Aircraft Conducting Visual Approaches

It is common for aircraft to conduct visual and instrument final approaches to a single runway or multiple parallel runways. Useful, nonexcessive safety alerts on aircraft conducting visual approaches are helpful to air traffic controllers, though pilots are responsible for separation with the preceding aircraft. A variety of visual approaches to various runway configurations are studied, and a set of safety alert thresholds is proposed. Fast-time simulations with recorded real-world air traffic data of mostly visual approach flights are performed on a prototype tactical separation assurance system for terminal airspace. Alerts are generated -- with both the standard separation thresholds and the proposed safety alert thresholds -- and compared with those from the Conflict Alert (CA) functionality in the Standard Terminal Automation Replacement System (STARS). The results show that the number of Mode-C Intruder alerts generated was reduced 76% as compared to STARS CA. The nuisance alerts generated by assuming visual to be instrument approaches was reduced by 92% when the proposed safety alert thresholds were used and visual approaches were assumed.A set of safety alert thresholds, which allow safety alerts to be provided to the controllers for aircraft conductingvisual approaches to a single runway or multiple parallel runways, has been proposed based on input from SubjectMatter Experts as well as visual approach procedures and common practices. The goal is to maximize the thresholdswithin the guidance of the procedures and common practices and to minimize the number of nuisance alerts and totalnumber of alerts with the support of flight intent information. Tests have been performed using a recently developedprototype tactical separation assurance system for terminal airspace, called Terminal Tactical Separation-AssuredFlight Environment (T-TSAFE). The input was a full day of air traffic data from Dallas/Fort Worth (DFW) TRACONwith most arriving flights conducting visual approaches. The results compare favorably with those of the ConflictAlert (CA) functionality of the Standard Terminal Automation Replacement System (STARS).When fast-time simulation experiment was performed using T-TSAFE with all arriving flights assumed to conductinstrument approaches, the expected large number of separation alerts were observed. When compared with STARSCA, the conflict pairs common to both T-TSAFE and STARS CA was only 21% of the total STARS CA alerts. As aresult, the nuisance-alert rate for STARS CA was estimated to be about 70%, which is comparable to a similar previously estimation of 80% nuisance-alert rate for CARTS (Common Automated Radar Terminal System) CA. The Mode-CIntruder (MCI) alerts were also reduced by 76% as compared to STARS CA.Examination of the common conflict pairs between T-TSAFE and STARS CA shows that they are valid separationconflicts with good alert lead times for T-TSAFE. However, many of them would still be considered nuisance alertsif the aircraft were conducting visual approaches. This was confirmed by another visual approach fast-time simulationT-TSAFE experiment, in which all DFW arriving flights were assumed to be on visual approaches and our proposedsafety alert thresholds were used and tested. The result of the experiment showed that the number of non-MCI alertswas less by 92% as compared to the number when all DFW arrivals were assumed to be conducting instrumentapproaches. The common conflict pairs involving aircraft conducting visual approaches to parallel runways werereduced by 93% as well. Thus, the flight intent information and the safety alert thresholds are effective in reducingnuisance alerts.T-TSAFE can thus provide separation and safety conflict alerts seamlessly in the real-world environment of mixedterminal operations with arriving flights of both visual and instrument approaches. Compared with STARS CA, TTSAFEhas fewer false alerts, larger alert lead time, and larger alert thresholds. While the nuisance alerts are reducedsignificantly with the safety alert thresholds, further work is needed to study if the alert lead time for safety alerts issufficient.

Tang, Huabin↗

Quartz Ampoule Loading, Sealing, and Inspection

This procedure applies to the loading of materials into quartz ampoules and flame sealing these ampoules. Flame sealed quartz ampoules are commonly used as a sealed containment for neutron irradiation. Due to the importance of maintaining containment for this application, this procedure involves a double encapsulation design wherein a sealed inner ampoule is sealed is in turn sealed within a larger diameter outer ampoule. General guidance for inspection of ampoules by destructive, non-destructive, qualitative (e.g., visual) and other methods are given. Materials to be placed inside the ampoules may consist of stable element materials or radioactive materials in either solid or liquid form. Liquids shall be dried prior to sealing the ampoule.

36 MATERIALS SCIENCE↗

Simulators for the X-38/CRV Parafoil and Re-Entry Phases

The X38/CRV is unique in several aspects: it does not afford the pilot a forward view through a window and it utilizes a parafoil in the final landing flight phase. As a result of some of these unique attributes the prototype on-board displays will need to provide enhanced situation awareness to aid a crew member in supervising the onboard GNC software to select a landing site, and possible obstacle avoidance during the final flight phase. In the ESA/ESTEC visualization prototype system the scene is visualized using MultiGen OpenFlight models on high-end SGI machines. The Parafoil Guidance Navigation and Control (PGNC) algorithms are being developed as a joint NASA/ESA venture. These algorithms will be used onboard the vehicle to create nominal flight trajectories for the vehicle to follow. These same algorithms are also used as parafoil simulators in our augmented situation awareness system we are developing. The output of the parafoil simulator is displayed on a Windows-based computer running the LandForm FlightVision software. The FlightVision software is used to create the synthetic environment displays and all the necessary HUD symbology. Maps, such as aeronautical charts, as well as satellite imagery are optionally overlaid on the 3D-terrain model to provide additional situation awareness for the crew.

SITUATIONAL AWARENESS↗

Review of Research On Guidance for Recovery from Pitch Axis Upsets

A literature review was conducted to identify past efforts in providing control guidance for aircraft upset recovery including stall recovery. Because guidance is integrally linked to the intended function of aircraft attitude awareness and upset recognition, it is difficult, if not impossible, to consider these issues separately. This literature review covered the aspects of instrumentation and display symbologies for attitude awareness, aircraft upset recognition, upset and stall alerting, and control guidance. Many different forms of symbology have been investigated including, but not limited to, pitch scale depictions, attitude indicator icons, horizon symbology, attitude recovery arrows, and pitch trim indicators. Past research on different visual and alerting strategies that provide advisories, cautions, and warnings to pilots before entering an unusual attitude (UA) are also discussed. Finally, potential control guidance for recovery from upset or unusual attitudes, including approach-to-stall and stall conditions, are reviewed. Recommendations for future research are made.

Harrison, Stephanie J.↗

Results of prototype software development for automation of shuttle proximity operations

A Rendezvous Expert System (REX) was implemented on a Symbolics 3650 processor and integrated with the 6 DOF, high fidelity Systems Engineering Simulator (SES) at the NASA Johnson Space Center in Houston, Texas. The project goals were to automate the terminal phase of a shuttle rendezvous, normally flown manually by the crew, and proceed automatically to docking with the Space Station Freedom (SSF). The project goals were successfully demonstrated to various flight crew members, managers, and engineers in the technical community at JSC. The project was funded by NASA's Office of Space Flight, Advanced Program Development Division. Because of the complexity of the task, the REX development was divided into two distinct efforts. One to handle the guidance and control function using perfect navigation data, and another to provide the required visuals for the system management functions needed to give visibility to the crew members of the progress being made towards docking the shuttle with the LVLH stabilized SSF.

Hiers, Harry K.↗

Assessing Dual Sensor Enhanced Flight Vision Systems to Enable Equivalent Visual Operations

Flight deck-based vision system technologies, such as Synthetic Vision (SV) and Enhanced Flight Vision Systems (EFVS), may serve as a revolutionary crew/vehicle interface enabling technologies to meet the challenges of the Next Generation Air Transportation System Equivalent Visual Operations (EVO) concept - that is, the ability to achieve the safety of current-day Visual Flight Rules (VFR) operations and maintain the operational tempos of VFR irrespective of the weather and visibility conditions. One significant challenge lies in the definition of required equipage on the aircraft and on the airport to enable the EVO concept objective. A motion-base simulator experiment was conducted to evaluate the operational feasibility, pilot workload and pilot acceptability of conducting straight-in instrument approaches with published vertical guidance to landing, touchdown, and rollout to a safe taxi speed in visibility as low as 300 ft runway visual range by use of onboard vision system technologies on a Head-Up Display (HUD) without need or reliance on natural vision. Twelve crews evaluated two methods of combining dual sensor (millimeter wave radar and forward looking infrared) EFVS imagery on pilot-flying and pilot-monitoring HUDs as they made approaches to runways with and without touchdown zone and centerline lights. In addition, the impact of adding SV to the dual sensor EFVS imagery on crew flight performance, workload, and situation awareness during extremely low visibility approach and landing operations was assessed. Results indicate that all EFVS concepts flown resulted in excellent approach path tracking and touchdown performance without any workload penalty. Adding SV imagery to EFVS concepts provided situation awareness improvements but no discernible improvements in flight path maintenance.

Kramer, Lynda J.↗

Understanding of and applications for robot vision guidance at KSC

The primary thrust of robotics at KSC is for the servicing of Space Shuttle remote umbilical docking functions. In order for this to occur, robots performing servicing operations must be capable of tracking a swaying Orbiter in Six Degrees of Freedom (6-DOF). Currently, in NASA KSC's Robotic Applications Development Laboratory (RADL), an ASEA IRB-90 industrial robot is being equipped with a real-time computer vision (hardware and software) system to allow it to track a simulated Orbiter interface (target) in 6-DOF. The real-time computer vision system effectively becomes the eyes for the lab robot, guiding it through a closed loop visual feedback system to move with the simulated Orbiter interface. This paper will address an understanding of this vision guidance system and how it will be applied to remote umbilical servicing at KSC. In addition, other current and future applications will be addressed.

Shawaga, Lawrence M.↗

Evaluation of camera-based freehand SPECT in preoperative sentinel lymph node mapping for melanoma patients

Assessment of lymphatic status via sentinel lymph node (SLN) biopsy is an integral and crucial part of melanoma surgical oncology. The most common technique for sentinel node mapping is preoperative planar scintigraphy of an injected gamma-emitting lymphatic tracer followed by intraoperative node localization using a non-imaging gamma probe with auditory feedback. In recent years, intraoperative visualization of SLNs in 3D has become possible by coupling the probe to an external system capable of tracking its location and orientation as it is read out, thereby enabling computation of the 3D distribution of the tracer (freehand SPECT). In this project, the non-imaging probe of the fhSPECT system was replaced by a unique handheld gamma camera containing an array of sodium iodide crystals optically coupled to an array of silicon photomultipliers (SiPMs). A feasibility study was performed in which preoperative SLN mapping was performed using camera fhSPECT and the number of detected nodes was compared to that visualized by lymphoscintigraphy, probe fhSPECT, and to the number ultimately excised under non-imaging probe guidance. Among five subjects, SLNs were detected in nine lymphatic basins, with one to five SLNs detected per basin. A basin-by-basin comparison showed that the number of SLNs detected using camera fhSPECT exceeded that using lymphoscintigraphy and probe fhSPECT in seven of nine basins and five of five basins, respectively. (Probe fhSPECT scans were not performed for four basins.) It exceeded the number excised under non-imaging probe guidance for seven of nine basins and equaled the number excised for the other two basins. Freehand SPECT using a prototype SiPM-based gamma camera demonstrates high sensitivity for detection of SLNs in a preoperative setting. Camera fhSPECT is a potential means for efficiently obtaining real-time 3D activity distribution maps in applications such as image-guided percutaneous biopsy, and surgical SLN biopsy or radioguided tumor excision.

60 APPLIED LIFE SCIENCES↗

Adaptive control of a robotic manipulator

A control hierarchy for a robotic manipulator is described. The hierarchy includes perception and robot/environment interaction, the latter consisting of planning, path control, and terminal guidance loops. Environment-sensitive features include the provision of control governed by proximity, tactile, and visual sensors as well as the usual kinematic sensors. The manipulator is considered as part of an overall robot system. 'Adaptive control' in the present context refers to both the hierarchical nature of the control system and to its environment-responsive nature.

Lewis, R. A.↗

A Virtual Audio Guidance and Alert System for Commercial Aircraft Operations

Our work in virtual reality systems at NASA Ames Research Center includes the area of aurally-guided visual search, using specially-designed audio cues and spatial audio processing (also known as virtual or "3-D audio") techniques (Begault, 1994). Previous studies at Ames had revealed that use of 3-D audio for Traffic Collision Avoidance System (TCAS) advisories significantly reduced head-down time, compared to a head-down map display (0.5 sec advantage) or no display at all (2.2 sec advantage) (Begault, 1993, 1995; Begault & Pittman, 1994; see Wenzel, 1994, for an audio demo). Since the crew must keep their head up and looking out the window as much as possible when taxiing under low-visibility conditions, and the potential for "blunder" is increased under such conditions, it was sensible to evaluate the audio spatial cueing for a prototype audio ground collision avoidance warning (GCAW) system, and a 3-D audio guidance system. Results were favorable for GCAW, but not for the audio guidance system.

Begault, Durand R.↗