Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Vision transformers”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

DCT quantization matrices visually optimized for individual images

This presentation describes how a vision model incorporating contrast sensitivity, contrast masking, and light adaptation is used to design visually optimal quantization matrices for Discrete Cosine Transform image compression. The Discrete Cosine Transform (DCT) underlies several image compression standards (JPEG, MPEG, H.261). The DCT is applied to 8x8 pixel blocks, and the resulting coefficients are quantized by division and rounding. The 8x8 'quantization matrix' of divisors determines the visual quality of the reconstructed image; the design of this matrix is left to the user. Since each DCT coefficient corresponds to a particular spatial frequency in a particular image region, each quantization error consists of a local increment or decrement in a particular frequency. After adjustments for contrast sensitivity, local light adaptation, and local contrast masking, this coefficient error can be converted to a just-noticeable-difference (jnd). The jnd's for different frequencies and image blocks can be pooled to yield a global perceptual error metric. With this metric, we can compute for each image the quantization matrix that minimizes the bit-rate for a given perceptual error, or perceptual error for a given bit-rate. Implementation of this system demonstrates its advantages over existing techniques. A unique feature of this scheme is that the quantization matrix is optimized for each individual image. This is compatible with the JPEG standard, which requires transmission of the quantization matrix.

Watson, Andrew B.↗
NASA NTRS2012

Revitalization of the NASA Langley Research Center's Infrastructure

The NASA Langley Research Center (Langley) was founded in 1917 as the nation's first civilian aeronautical research facility and NASA's first field center. For nearly 100 years, Langley has made significant contributions to the Aeronautics, Space Exploration, and Earth Science missions through research, technology, and engineering core competencies in aerosciences, materials, structures, the characterization of earth and planetary atmospheres and, more recently, in technologies associated with entry, descent, and landing. An unfortunate but inevitable outcome of this rich history is an aging infrastructure where the longest serving building is close to 80 years old and the average building age is 44 years old. In the current environment, the continued operation and maintenance of this aging and often inefficient infrastructure presents a real challenge to Center leadership in the trade space of sustaining infrastructure versus not investing in future capabilities. To address this issue, the Center has developed a forward looking revitalization strategy that ties future core competencies and technical capabilities to the Center Master Facility Plan to maintain a viable Center well into the future. This paper documents Langley's revitalization strategy which integrates the Center's missions, the Langley 2050 vision, the Center Master Facility Plan, and the New Town repair-by-replacement program through the leadership of the Vibrant Transformation to Advance Langley (ViTAL) Team.

Weiser, Erik S.↗
NASA NTRS2010

Multi-Stage System for Automatic Target Recognition

A multi-stage automated target recognition (ATR) system has been designed to perform computer vision tasks with adequate proficiency in mimicking human vision. The system is able to detect, identify, and track targets of interest. Potential regions of interest (ROIs) are first identified by the detection stage using an Optimum Trade-off Maximum Average Correlation Height (OT-MACH) filter combined with a wavelet transform. False positives are then eliminated by the verification stage using feature extraction methods in conjunction with neural networks. Feature extraction transforms the ROIs using filtering and binning algorithms to create feature vectors. A feedforward back-propagation neural network (NN) is then trained to classify each feature vector and to remove false positives. The system parameter optimizations process has been developed to adapt to various targets and datasets. The objective was to design an efficient computer vision system that can learn to detect multiple targets in large images with unknown backgrounds. Because the target size is small relative to the image size in this problem, there are many regions of the image that could potentially contain the target. A cursory analysis of every region can be computationally efficient, but may yield too many false positives. On the other hand, a detailed analysis of every region can yield better results, but may be computationally inefficient. The multi-stage ATR system was designed to achieve an optimal balance between accuracy and computational efficiency by incorporating both models. The detection stage first identifies potential ROIs where the target may be present by performing a fast Fourier domain OT-MACH filter-based correlation. Because threshold for this stage is chosen with the goal of detecting all true positives, a number of false positives are also detected as ROIs. The verification stage then transforms the regions of interest into feature space, and eliminates false positives using an artificial neural network classifier. The multi-stage system allows tuning the detection sensitivity and the identification specificity individually in each stage. It is easier to achieve optimized ATR operation based on its specific goal. The test results show that the system was successful in substantially reducing the false positive rate when tested on a sonar and video image datasets.

Chao, Tien-Hsin↗
NASA NTRSDate not supplied

Defining Services, Functions, and Capabilities for an Advanced Air Mobility (AAM) In-time Aviation Safety Management System (IASMS)

NASA’s vision for Advanced Air Mobility (AAM) Mission is to help emerging aviation markets to safely develop an air transportation system that moves people and cargo between places previously not served or underserved by aviation. The integration of new operational paradigms and vehicle classes in this system requires a transformation of the National Airspace System (NAS) that includes substantive changes critical for assuring safety. These changes are compelled by unique challenges posed by AAM to the safety management system (SMS). These challenges were assessed by committees of the National Academies in their reports on a vision for an In-time Aviation Safety Management System (IASMS) and a blueprint for AAM [1,2]. In their description of an IASMS, the top recommendation was development of a concept of operations (ConOps) for IASMS. This paper describes the high-priority recommendations from the National Academies for its IASMS vision and how they are addressed through a distributed system-of-systems architecture. The IASMS architecture is structured on the services, functions, and capabilities (SFCs) necessary for In-time System-wide Safety Assurance (ISSA)initially developed for urban air mobility (UAM). The paper then posits where these SFCs would reside across vehicles, airspace, or service suppliers such as Supplemental Data Service Providers (SDSPs), and how SFCs scale with increasing complexity in design and operations of AAM. SFCs are foundational building blocks for a system that targets an individual or family of risks using a Monitor-Assess-Mitigate risk paradigm for anomalies, precursors and trends. An IASMS could be conceived that uses a portfolio of SFCs for AAM in general or prioritizes SFCs for a specific domain or operation.

K Ellis↗
NASA NTRS2010

The Spatial Vision Tree: A Generic Pattern Recognition Engine- Scientific Foundations, Design Principles, and Preliminary Tree Design

New foundational ideas are used to define a novel approach to generic visual pattern recognition. These ideas proceed from the starting point of the intrinsic equivalence of noise reduction and pattern recognition when noise reduction is taken to its theoretical limit of explicit matched filtering. This led us to think of the logical extension of sparse coding using basis function transforms for both de-noising and pattern recognition to the full pattern specificity of a lexicon of matched filter pattern templates. A key hypothesis is that such a lexicon can be constructed and is, in fact, a generic visual alphabet of spatial vision. Hence it provides a tractable solution for the design of a generic pattern recognition engine. Here we present the key scientific ideas, the basic design principles which emerge from these ideas, and a preliminary design of the Spatial Vision Tree (SVT). The latter is based upon a cryptographic approach whereby we measure a large aggregate estimate of the frequency of occurrence (FOO) for each pattern. These distributions are employed together with Hamming distance criteria to design a two-tier tree. Then using information theory, these same FOO distributions are used to define a precise method for pattern representation. Finally the experimental performance of the preliminary SVT on computer generated test images and complex natural images is assessed.

Rahman, Zia-ur↗
NASA NTRS2005

In Situ Resource Utilization Technology Research and Facilities Supporting the NASA's Human Systems Research and Technology Life Support Program

The NASA Microgravity Science program has transitioned research required in support of NASA s Vision for Space Exploration. Research disciplines including the Materials Science, Fluid Physics and Combustion Science are now being applied toward projects with application in the planetary utilization and transformation of space resources. The scientific and engineering competencies and infrastructure in these traditional fields developed at multiple NASA Centers and by external research partners provide essential capabilities to support the agency s new exploration thrusts including In-Situ Resource Utilization (ISRU). Among the technologies essential to human space exploration, the production of life support consumables, especially oxygen and; radiation shielding; and the harvesting of potentially available water are realistically achieved for long-duration crewed missions only through the use of ISRU. Ongoing research in the physical sciences have produced a body of knowledge relevant to the extraction of oxygen from lunar and planetary regolith and associated reduction of metals and silicon for use meeting manufacturing and repair requirements. Activities being conducted and facilities used in support of various ISRU projects at the Glenn Research Center and Marshall Space Flight Center will be described. The presentation will inform the community of these new research capabilities, opportunities, and challenges to utilize their materials, fluids and combustion science expertise and capabilities to support the vision for space exploration.

Schlagheck, Ronald A.↗
NASA NTRS2016

Visions of the Future: Hybrid Electric Aircraft Propulsion

The National Aeronautics and Space Administration (NASA) is investing continually in improving civil aviation. Hybridization of aircraft propulsion is one aspect of a technology suite which will transform future aircraft. In this context, hybrid propulsion is considered a combination of traditional gas turbine propulsion and electric drive enabled propulsion. This technology suite includes elements of propulsion and airframe integration, parallel hybrid shaft power, turbo-electric generation, electric drive systems, component development, materials development and system integration at multiple levels.

electric motor vehicles↗
NASA NTRS1990

Programmable Remapper

Input image remapped rapidly and accurately onto different coordinate grid. Analog/digital electronic image-processing system developed to warp input images onto arbitrary coordinate grids at video rates. Advantages of system include antialiasing effect of many-to-one data path and speed of lookup-table operation. Lookup tables reprogrammed easily with help of computer that generates table values from mathematical description of desired transformation. Applications include real-time corrections of distortions in input optics of image sensors, corrections for repeatable nonlinear scanning, and aiding persons of impaired vision by deliberately distorting images onto remaining functional portions of retinas.

Juday, Richard D.↗
NASA NTRS1997

Head-Mounted and Head-Up Display Glossary

One of the problems in head-up and helmet-mounted display (HMD) literature has been a lack of standardization of words and abbreviations. Several different words have been used for the same concept; for example, flight path angle, flight path marker, velocity vector, and total velocity vector all refer to the same thing. In other cases, the same term has been used with two different meanings, such as binocular field-of-view which means the field-of-view visible to both left and right eyes according to some or the field-of-view visible to either the left or right eye or both according to others. Many of the terms used in HMD studies have not been well-defined. We need to have a common language to ensure that system descriptions are communicated. As an example, the term 'stabilized' has been widely used with two meanings. 'Roll-stabilized' has been used to mean a symbol which rotates to indicate the roll or bank of the aircraft. 'World-stabilized' and 'head-stabilized' have both been used to indicate symbols which move to remain fixed with respect to external objects. HMDs present unique symbology problems not found in HUDs. Foremost among these is the issue of maintaining spatial orientation of the symbols. All previous flight displays, round dial instruments, HDDs, and HUDs have been fixed in the cockpit. With the HMD, the flight display can move through a large angle. The coordinates use in transforming from the real-world to the aircraft to the HMD have not been consistently defined. This glossary contains terms relating to optics and vision, displays, and flight information, weapons and aircraft systems. Some definitions, such as Navigation Display, have been added to clarify the definitions for Primary Flight Display and Primary Flight Reference. A list of HUD/HMD related abbreviations is also included.

Newman, Richard L.↗
NASA NTRS2025

Distributed Sensing Node Configuration

A vision and radar sensor integration strategy for surveillance of Advance Air Mobility Mission concept of airspace is contained in the CAD drawing in this publication developed as part of NASA's Transformational Tools and Technology project. High-density airspace operations with multiple aircraft type and potentially noncooperative aircraft require distributed sensor detection and tracking systems to monitor airspace for safe, autonomous flight operations for advanced air mobility, urban air mobility, and high density small uncrewed air systems (SUAS) flight concepts. Contained herein are drawings that are available in the stp and creo file formats of the distributed sensing nodes. Additional dovetail integration is included to enable rapid changing of embedded system. A day in the life node deployment is included in the 2023_last_flight_day.mp4. Please cite this publication if you use these drawings. This sensor configuration methodology is presented in detail in the publication reference below. Chester Dolph, Thomas Lombaerts, Corey A. Ippolito, Vahram Stepanyan, Evan Kawamura, Keerthana Kannan, George Szatkowski, Todd Ferante, Christopher Morris, Federica Vitiello, Flavia Causa, Roberto Opromolla and Giancarmine Fasano. "Distributed Sensor Fusion of Ground and Air Nodes using Vision and Radar Modalities for Tracking Multirotor Small Uncrewed Air Systems and Birds," AIAA 2024-1781. AIAA SCITECH 2024 Forum. January 2024.

Chester V Dolph↗
NASA NTRS1994

Technical guidance for the development of a solid state image sensor for human low vision image warping

This report surveys different technologies and approaches to realize sensors for image warping. The goal is to study the feasibility, technical aspects, and limitations of making an electronic camera with special geometries which implements certain transformations for image warping. This work was inspired by the research done by Dr. Juday at NASA Johnson Space Center on image warping. The study has looked into different solid-state technologies to fabricate image sensors. It is found that among the available technologies, CMOS is preferred over CCD technology. CMOS provides more flexibility to design different functions into the sensor, is more widely available, and is a lower cost solution. By using an architecture with row and column decoders one has the added flexibility of addressing the pixels at random, or read out only part of the image.

Vanderspiegel, Jan↗
NASA NTRS1988

Discrete analysis of spatial-sensitivity models

Procedures for reducing the computational burden of current models of spatial vision are described, the simplifications being consistent with the prediction of the complete model. A method for using pattern-sensitivity measurements to estimate the initial linear transformation is also proposed which is based on the assumption that detection performance is monotonic with the vector length of the sensor responses. It is shown how contrast-threshold data can be used to estimate the linear transformation needed to characterize threshold performance.

Nielsen, Kenneth R. K.↗
NASA NTRS2007

Sensing Super-Position: Human Sensing Beyond the Visual Spectrum

The coming decade of fast, cheap and miniaturized electronics and sensory devices opens new pathways for the development of sophisticated equipment to overcome limitations of the human senses. This paper addresses the technical feasibility of augmenting human vision through Sensing Super-position by mixing natural Human sensing. The current implementation of the device translates visual and other passive or active sensory instruments into sounds, which become relevant when the visual resolution is insufficient for very difficult and particular sensing tasks. A successful Sensing Super-position meets many human and pilot vehicle system requirements. The system can be further developed into cheap, portable, and low power taking into account the limited capabilities of the human user as well as the typical characteristics of his dynamic environment. The system operates in real time, giving the desired information for the particular augmented sensing tasks. The Sensing Super-position device increases the image resolution perception and is obtained via an auditory representation as well as the visual representation. Auditory mapping is performed to distribute an image in time. The three-dimensional spatial brightness and multi-spectral maps of a sensed image are processed using real-time image processing techniques (e.g. histogram normalization) and transformed into a two-dimensional map of an audio signal as a function of frequency and time. This paper details the approach of developing Sensing Super-position systems as a way to augment the human vision system by exploiting the capabilities of Lie human hearing system as an additional neural input. The human hearing system is capable of learning to process and interpret extremely complicated and rapidly changing auditory patterns. The known capabilities of the human hearing system to learn and understand complicated auditory patterns provided the basic motivation for developing an image-to-sound mapping system. The human brain is superior to most existing computer systems in rapidly extracting relevant information from blurred, noisy, and redundant images. From a theoretical viewpoint, this means that the available bandwidth is not exploited in an optimal way. While image-processing techniques can manipulate, condense and focus the information (e.g., Fourier Transforms), keeping the mapping as direct and simple as possible might also reduce the risk of accidentally filtering out important clues. After all, especially a perfect non-redundant sound representation is prone to loss of relevant information in the non-perfect human hearing system. Also, a complicated non-redundant image-to-sound mapping may well be far more difficult to learn and comprehend than a straightforward mapping, while the mapping system would increase in complexity and cost. This work will demonstrate some basic information processing for optimal information capture for headmounted systems.

Maluf, David A.↗
NASA NTRS1993

Emerging computer technologies and the news media of the future

The media environment of the future may be dramatically different from what exists today. As new computing and communications technologies evolve and synthesize to form a global, integrated communications system of networks, public domain hardware and software, and consumer products, it will be possible for citizens to fulfill most information needs at any time and from any place, to obtain desired information easily and quickly, to obtain information in a variety of forms, and to experience and interact with information in a variety of ways. This system will transform almost every institution, every profession, and every aspect of human life--including the creation, packaging, and distribution of news and information by media organizations. This paper presents one vision of a 21st century global information system and how it might be used by citizens. It surveys some of the technologies now on the market that are paving the way for new media environment.

Vrabel, Debra A.↗
NASA NTRS2004

NASA's Nuclear Frontier: The Plum Brook Reactor Facility, 1941-2002

In 1953, President Eisenhower delivered a speech called "Atoms for Peace" to the United Nations General Assembly. He described the emergence of the atomic age and the weapons of mass destruction that were piling up in the storehouses of the American and Soviet nations. Although neither side was aiming for global destruction, Eisenhower wanted to "move out of the dark chambers of horrors into the light, to find a way by which the minds of men, the hopes of men, the souls of men everywhere, can move towards peace and happiness and well-being." One way Eisenhower hoped this could happen was by transforming the atom from a weapon of war into a useful tool for civilization. Many people believed that there were unprecedented opportunities for peaceful nuclear applications. These included hopeful visions of atomic-powered cities, cars, airplanes, and rockets. Nuclear power might also serve as an efficient way to generate electricity in space to support life and machines. Eisenhower wanted to provide scientists and engineers with "adequate amounts of fission- able material with which to test and develop their ideas." But, in attempting to devise ways to use atomic power for peaceful purposes, scientists realized how little they knew about the nature and effects of radiation. As a result, the United States began constructing nuclear test reactors to enable scientists to conduct research by producing neutrons.

Bowles, Mark D.↗
NASA NTRSDate not supplied

Multi-Vehicle (m:N) Operations in the NAS - NASA's Research Plans

The Advanced Air Mobility movement is occurring across the world with goals of enabling, affordable, efficient, accessible, and safe air transportation at a much larger scale than today’s operations, largely enabled by electrification and automation. Transformative and disruptive innovations are emerging that will support an ecosystem designed to transport goods and people to locations not traditionally served by air transportation. To realize the full vision of AAM, technology will be needed to allow a few operators to operate many vehicles (m:N). The benefits of m:N operations are described, along with the current state-of-the-art, barriers, need, and NASA’s plans to address some of the barriers, including a Multi-Vehicle (m:N) Working Group with goals of producing a community-developed operational approval roadmap for various domains.

multi-vehicle↗
NASA NTRS2006

Sensing Super-position: Visual Instrument Sensor Replacement

The coming decade of fast, cheap and miniaturized electronics and sensory devices opens new pathways for the development of sophisticated equipment to overcome limitations of the human senses. This project addresses the technical feasibility of augmenting human vision through Sensing Super-position using a Visual Instrument Sensory Organ Replacement (VISOR). The current implementation of the VISOR device translates visual and other passive or active sensory instruments into sounds, which become relevant when the visual resolution is insufficient for very difficult and particular sensing tasks. A successful Sensing Super-position meets many human and pilot vehicle system requirements. The system can be further developed into cheap, portable, and low power taking into account the limited capabilities of the human user as well as the typical characteristics of his dynamic environment. The system operates in real time, giving the desired information for the particular augmented sensing tasks. The Sensing Super-position device increases the image resolution perception and is obtained via an auditory representation as well as the visual representation. Auditory mapping is performed to distribute an image in time. The three-dimensional spatial brightness and multi-spectral maps of a sensed image are processed using real-time image processing techniques (e.g. histogram normalization) and transformed into a two-dimensional map of an audio signal as a function of frequency and time. This paper details the approach of developing Sensing Super-position systems as a way to augment the human vision system by exploiting the capabilities of the human hearing system as an additional neural input. The human hearing system is capable of learning to process and interpret extremely complicated and rapidly changing auditory patterns. The known capabilities of the human hearing system to learn and understand complicated auditory patterns provided the basic motivation for developing an image-to-sound mapping system.

Maluf, David A.↗