Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Vision transformers”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Transforming Space Missions into Service Oriented Architectures

This viewgraph presentation reviews the vision of the sensor web enablement via a Service Oriented Architecture (SOA). An generic example is given of a user finding a service through the Web, and initiating a request for the desired observation. The parts that comprise this system and how they interact are reviewed. The advantages of the use of SOA are reviewed.

Mandl, Dan↗

Dual use of image based tracking techniques: Laser eye surgery and low vision prosthesis

With a concentration on Fourier optics pattern recognition, we have developed several methods of tracking objects in dynamic imagery to automate certain space applications such as orbital rendezvous and spacecraft capture, or planetary landing. We are developing two of these techniques for Earth applications in real-time medical image processing. The first is warping of a video image, developed to evoke shift invariance to scale and rotation in correlation pattern recognition. The technology is being applied to compensation for certain field defects in low vision humans. The second is using the optical joint Fourier transform to track the translation of unmodeled scenes. Developed as an image fixation tool to assist in calculating shape from motion, it is being applied to tracking motions of the eyeball quickly enough to keep a laser photocoagulation spot fixed on the retina, thus avoiding collateral damage.

Juday, Richard D.↗

Dual Use of Image Based Tracking Techniques: Laser Eye Surgery and Low Vision Prosthesis

With a concentration on Fourier optics pattern recognition, we have developed several methods of tracking objects in dynamic imagery to automate certain space applications such as orbital rendezvous and spacecraft capture, or planetary landing. We are developing two of these techniques for Earth applications in real-time medical image processing. The first is warping of a video image, developed to evoke shift invariance to scale and rotation in correlation pattern recognition. The technology is being applied to compensation for certain field defects in low vision humans. The second is using the optical joint Fourier transform to track the translation of unmodeled scenes. Developed as an image fixation tool to assist in calculating shape from motion, it is being applied to tracking motions of the eyeball quickly enough to keep a laser photocoagulation spot fixed on the retina, thus avoiding collateral damage.

Juday, Richard D.↗

Aero-Propulsion Control Research in Support of NASA Aeronautics Research Strategic Thrusts

In the past few years, NASA (National Aeronautics and Space Administration) Aeronautics Research Mission Directorate (ARMD) has introduced and updated a “New Blueprint for Transforming Global Aviation†. This blueprint consists of six NASA Aeronautics Research Strategic Thrusts â€" “The updated vision is designed to ensure that through NASA's aeronautical research the United States will maintain its leadership in the sky and sustain aviation so that it remains a key economic driver and cultural touchstone for the nation.†In mid-2016, technology development roadmaps were developed by ARMD for each of the strategic research thrusts and these roadmaps are continually being updated based on feedback from the broader aeronautics research community. The NASA Aeronautics research vision is implemented through a set of 4 programs â€" Advanced Air Vehicles Program (AAVP), Airspace Operations and Safety Program (AOSP), Integrated Aviation Systems Program (IASP), and Transformative Aeronautics Concepts Program (TACP). The Intelligent Control and Autonomy Branch (ICAB) at NASA Glenn Research Center (GRC) in Cleveland, Ohio, is leading and participating in various projects in partnership with other organizations within GRC and across NASA, the U.S. aerospace industry, and academia to develop advanced controls and health management technologies for aero-propulsion systems that will help meet the goals of the ARMD programs. These efforts are primarily under the various projects under AAVP, AOSP, and TACP. The ICAB current research tasks in support of ARMD program are described in this paper. The paper provides motivation, background, technical approach and recent accomplishments for these tasks, as well as a couple of tasks completed in the previous fiscal year.

Propulsion Control↗

The Adaptable and Resilient Safety System: The Human Factor in Future In-Time Aviation Safety Management Systems

In-time integrated safety management will be paramount for safely enabling the envisioned transformations of the future National Airspace System (NAS). The path for realizing the vision includes addressing the increasing need for advanced data analytics and fusion of aviation safety data, managed by human decision-makers. The paper describes safety management systems and its’ challenges, and how the concept of In-time Aviation Safety Management Systems addresses the need to ensure an adaptable and resilient future safety system in the envisioned transformed NAS. Finally, it discusses potential human factors challenges, including new human roles and responsibilities, new information and cognitive requirements, new intelligent technologies that change human-system interaction and coordination, and new design paradigms for human system integration and teaming.

L. Prinzel↗

The Adaptable and Resilient Safety System: The Human Factor in Future In-Time Aviation Safety Management Systems

In-time integrated safety management will be paramount for safely enabling the envisioned transformations of the future National Airspace System (NAS). The path for realizing the vision includes addressing the increasing need for advanced data analytics and fusion of aviation safety data, managed by human decision-makers. The paper describes safety management systems and its’ challenges, and how the concept of In-time Aviation Safety Management Systems addresses the need to ensure an adaptable and resilient future safety system in the envisioned transformed NAS. Finally, it discusses potential human factors challenges, including new human roles and responsibilities, new information and cognitive requirements, new intelligent technologies that change human-system interaction and coordination, and new design paradigms for human system integration and teaming.

Aviation Safety↗

Optical pattern recognition; Proceedings of the Meeting, Los Angeles, CA, Jan. 17, 18, 1989

Papers on optical pattern recognition are presented, covering topics such as the estimation of satellite pose and motion parameters using a neural net tracker, associative memory, optical implmentation of programmable neural networks, optoelectronic neural networks, dynamic autoassociative neural memory, heteroassociative memory, bilinear pattern recognition processors, optical processing of optical correlation plane data, and a synthetic discriminant function-based nonlinear optical correlator. Other topics include an interactive optical-digital image processor, geometric transformations for video compression and human teleoperator display, quasiconformal remapping for compensation of human visual field defects, hybrid vision for automated spacecraft landing, advanced symbolic and inference optical correlation filters, and a rotationally invariant holographic tracking system. Additional topics include the detection of rotational and scale-varying objects with a programmable joint transform correlator, a single spatial light modulator binary nonlinear optical correlator, optical joint transform correlation, linear phase coefficient composite filters, and binary phase-only filters.

Liu, Hua-Kuang↗

Digital Engineering Strategy Overview

Systems are changing and engineering practices must mind the balance between evolutionary and revolutionary change as we move towards increasingly agile processes, enabled by interconnected tools, to best provide for partnered collaboration. This is the first of many evolutions of the Goddard Digital Engineering strategy, in preparation for the NASA 2040 vision.

Digital Engineering↗

Digital Engineering at Goddard: Exploring the Digital Thread

Systems are changing and engineering practices must mind the balance between evolutionary and revolutionary change as we move towards increasingly agile processes, enabled by interconnected tools, to best provide for partnered collaboration. The Digital Thread is a foundational capability for a functional Digital Engineering Ecosystem, which is Phase 1 of Goddard's Digital Engineering strategy in an effort to achieve Goddard 2040 vision.

Digital Engineering↗

3-D sensing with polar exponential sensor arrays

The present computations for three-dimensional vision involve, in such cases as those of scaling for perspective and optic flow, their reduction to additive operations by the implicit logarithmic transformation of image coordinates. Expressions for such computations are derived and applied to illustrative examples of sensor design. The advantages of polar exponential arrays over X-Y rasters for binocular vision are noted to encompass the inference of range and three-dimensional position from local image velocity without knowledge of pixel location, provided that the relative velocity of the target and sensor are known by some other means.

Weiman, Carl F. R.↗

Optical calculation of correlation filters for a robotic vision system

A method is presented for designing optical correlation filters based on measuring three intensity patterns: the Fourier transform of a filter object, a reference wave and the interference pattern produced by the sum of the object transform and the reference. The method can produce a filter that is well matched to both the object, its transforming optical system and the spatial light modulator used in the correlator input plane. A computer simulation was presented to demonstrate the approach for the special case of a conventional binary phase-only filter. The simulation produced a workable filter with a sharp correlation peak.

Knopp, Jerome↗

A vision-based end-point control for a two-link flexible manipulator

The measurement and control of the end-effector position of a large two-link flexible manipulator are investigated. The system implementation is described and an initial algorithm for static end-point positioning is discussed. Most existing robots are controlled through independent joint controllers, while the end-effector position is estimated from the joint positions using a kinematic relation. End-point position feedback can be used to compensate for uncertainty and structural deflections. Such feedback is especially important for flexible robots. Computer vision is utilized to obtain end-point position measurements. A look-and-move control structure alleviates the disadvantages of the slow and variable computer vision sampling frequency. This control structure consists of an inner joint-based loop and an outer vision-based loop. A static positioning algorithm was implemented and experimentally verified. This algorithm utilizes the manipulator Jacobian to transform a tip position error to a joint error. The joint error is then used to give a new reference input to the joint controller. The convergence of the algorithm is demonstrated experimentally under payload variation. A Landmark Tracking System (Dickerson, et al 1990) is used for vision-based end-point measurements. This system was modified and tested. A real-time control system was implemented on a PC and interfaced with the vision system and the robot.

Obergfell, Klaus↗

Pictorial communication in virtual and real environments

Papers about the communication between human users and machines in real and synthetic environments are presented. Individual topics addressed include: pictorial communication, distortions in memory for visual displays, cartography and map displays, efficiency of graphical perception, volumetric visualization of 3D data, spatial displays to increase pilot situational awareness, teleoperation of land vehicles, computer graphics system for visualizing spacecraft in orbit, visual display aid for orbital maneuvering, multiaxis control in telemanipulation and vehicle guidance, visual enhancements in pick-and-place tasks, target axis effects under transformed visual-motor mappings, adapting to variable prismatic displacement. Also discussed are: spatial vision within egocentric and exocentric frames of reference, sensory conflict in motion sickness, interactions of form and orientation, perception of geometrical structure from congruence, prediction of three-dimensionality across continuous surfaces, effects of viewpoint in the virtual space of pictures, visual slant underestimation, spatial constraints of stereopsis in video displays, stereoscopic stance perception, paradoxical monocular stereopsis and perspective vergence. (No individual items are abstracted in this volume)

Ellis, Stephen R.↗

Convergent Aeronautics Solutions Project

NASA is committed to transforming our aviation system to best meet demands and opportunities of the future. With a vision of safe, efficient, flexible, and environmentally sustainable air transportation, the NASA Aeronautics Research Mission Directorate is conducting research and development to address future needs of the aviation community, the Nation, and the world. While our NASA Aeronautics vision and strategy reaches into the next 25 years and beyond, we recognize that our vision and strategy must be responsive to new discoveries and emerging markets. For this reason, we are empowering our research community to redefine the future of aviation by dreaming up convergent/transformative ideas and studying if those ideas are possible. By modeling the new NASA Aeronautics' Convergent Aeronautics Solutions (CAS) Project after the venture capital community, we created opportunities for teams of intrapreneurs to mature their ideas into concepts through rapid feasibility studies. The CAS Project expects teams to consider the complexities and potential benefits of multi-disciplinary solutions and to leverage technology advances from outside the field of aeronautics. We also expect teams to explore their concepts in a rapid, iterative manner that allows them to learn and adjust their research approach. Within a year or two, teams are responsible for reporting on the feasibility of their concept. The findings inform NASA Aeronautics strategic planning and further investment. This presentation will give an overview of CAS.

Transformative↗

Localization Using Visual Odometry and a Single Downward-Pointing Camera

Stereo imaging is a technique commonly employed for vision-based navigation. For such applications, two images are acquired from different vantage points and then compared using transformations to extract depth information. The technique is commonly used in robotics for obstacle avoidance or for Simultaneous Localization And Mapping, (SLAM). Yet, the process requires a number of image processing steps and therefore tends to be CPU-intensive, which limits the real-time data rate and use in power-limited applications. Evaluated here is a technique where a monocular camera is used for vision-based odometry. In this work, an optical flow technique with feature recognition is performed to generate odometry measurements. The visual odometry sensor measurements are intended to be used as control inputs or measurements in a sensor fusion algorithm using low-cost MEMS based inertial sensors to provide improved localization information. Presented here are visual odometry results which demonstrate the challenges associated with using ground-pointing cameras for visual odometry. The focus is for rover-based robotic applications for localization within GPS-denied environments.

Swank, Aaron J.↗

MIT-NASA Workshop: Transformational Technologies

As a space faring nation, we are at a critical juncture in the evolution of space exploration. NASA has announced its Vision for Space Exploration, a vision of returning humans to the Moon, sending robots and eventually humans to Mars, and exploring the outer solar system via automated spacecraft. However, mission concepts have become increasingly complex, with the potential to yield a wealth of scientific knowledge. Meanwhile, there are significant resource challenges to be met. Launch costs remain a barrier to routine space flight; the ever-changing fiscal and political environments can wreak havoc on mission planning; and technologies are constantly improving, and systems that were state of the art when a program began can quickly become outmoded before a mission is even launched. This Conference Publication describes the workshop and featured presentations by world-class experts presenting leading-edge technologies and applications in the areas of power and propulsion; communications; automation, robotics, computing, and intelligent systems; and transformational techniques for space activities. Workshops such as this one provide an excellent medium for capturing the broadest possible array of insights and expertise, learning from researchers in universities, national laboratories, NASA field Centers, and industry to help better our future in space.

Mankins, J. C.↗

Solving The Space Weather Problem: A 15+ Year Roadmap to Revolutionize Space Weather Research, Protect NASA Space Assets, and Enable Robust Operations

The White Paper (WP) describes a roadmap to address the Space Weather (SpWx) problem. It presents a strategic vision of how a community-wide effort could be organized and implemented to enable transformative advancement in SpWx research and ultimately, in applications. We envision a ‘system-of-systems’—an integrated web of SpWx stations and state-ofthe-art modeling facilities to enable a transformative advance in SpWx nowcasting and forecasting (Figure 1). The Space Weather Aggregated Network of Systems (SWANS) will enable space situational awareness for end-users invested in spaceflight operations, infrastructure risk mitigation, and future human endeavors in space exploration while profoundly transforming Heliophysics research.

A Vourrlidas↗