SEARCH · Engineering Papers

Results for “Vision transformers”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

All sources NASA NTRS DOE OSTI

DOE OSTI2022

NREL Stratus - Enabling Workflows to Fuse Data Streams, Modeling, Simulation, and Machine Learning

Integrating cloud services into advanced computing facilities provides significant new capabilities over focusing solely on traditional high performance computing (HPC) workloads. This brings complementary capabilities as well as enabling new focused roles for HPC. They are especially potent for workflows that fuse data streams, modeling and simulation ('modsim') and machine learning. A key challenge to adopting a hybrid edge-cloud-HPC model is to align optimal capability, data, and user intent on the right resources for each step in a workflow.?The NREL Stratus service provides a basis for this: Stratus layers capabilities needed to make?cloud services accessible to a lab-based scientific community on commercial offerings, and; currently supports upwards of 200 projects ranging from IOT integration to traditional modeling and simulation. This provides a real-world inventory of scientific workflow elements. A growing knowledge base enables placing these elements appropriately between the edge, cloud, and traditional HPC. This paper outlines a vision via reference architecture and the application of that architecture in a typical workflow highlighting multiple components: sensor data intake, cleaning and transforming (edge/cloud suitable); generation of synthetic data through modsim, computationally heavy ML training and hyperparameter optimization (HPC suitable), and; inference and deployment (cloud ideal). Every step in such a workflow involves a cost-benefit analysis regarding the data movement, computational efficiency, availability, latency, and resource capabilities. The reference architecture and examples outlined allow for understanding new opportunities in the context of emerging workflows that combine IOT, cloud, and HPC to bolster scientific productivity.

AI↗

DOE OSTI2022

28 NREL Stratus - Enabling Workflows to Fuse Data Streams, Modeling, Simulation, and Machine Learning: Preprint

AI↗

NASA NTRS2006

Effectively Transforming IMC Flight into VMC Flight: An SVS Case Study

A flight-test experiment was conducted using the NASA LaRC Cessna 206 aircraft. Four primary flight and navigation display concepts, including baseline and Synthetic Vision System (SVS) concepts, were evaluated in the local area of Roanoke Virginia Airport, flying visual and instrument approach procedures. A total of 19 pilots, from 3 pilot groups reflecting the diverse piloting skills of the GA population, served as evaluation pilots. Multi-variable Discriminant Analysis was applied to three carefully selected and markedly different operating conditions with conventional instrumentation to provide an extension of traditional analysis methods as well as provide an assessment of the effectiveness of SVS displays to effectively transform IMC flight into VMC flight.

Glaab, Louis J.↗

NASA NTRS2008

Onboard Image Registration from Invariant Features

This paper describes a feature-based image registration technique that is potentially well-suited for onboard deployment. The overall goal is to provide a fast, robust method for dynamically combining observations from multiple platforms into sensors webs that respond quickly to short-lived events and provide rich observations of objects that evolve in space and time. The approach, which has enjoyed considerable success in mainstream computer vision applications, uses invariant SIFT descriptors extracted at image interest points together with the RANSAC algorithm to robustly estimate transformation parameters that relate one image to another. Experimental results for two satellite image registration tasks are presented: (1) automatic registration of images from the MODIS instrument on Terra to the MODIS instrument on Aqua and (2) automatic stabilization of a multi-day sequence of GOES-West images collected during the October 2007 Southern California wildfires.

descriptors↗

NASA NTRSDate not supplied

Machine Learning Airport Surface Model

Future needs of the National Airspace System require decision support tools to adopt a service-oriented architecture in alignment with the FAA’s vision for an Info-Centric NAS. To achieve this, many existing systems will need to undergo a digital transformation from a monolithic decision support tool to a service-oriented architecture where individual services are exposed through well defined Application Programming Interfaces (APIs). To enable this transformation, NASA has developed the Digital Information Platform as a cloud based foundation for development of aviation services with a special focus towards Artificial Intelligence and Machine Learning (ML) services. This paper describes the work required for the transformation of NASA’s legacy surface management system to a real-time ML based decision support system deployed in the cloud. Details of the Machine Learning Operations (MLOps) infrastructure and best practices are described which enabled the end-toend lifecycle management of ML within an integrated software system. Validation results are provided from an operational field evaluation where performance was benchmarked against the legacy approach.

Jeremy Coupe↗

NASA NTRS1992

Visual information processing; Proceedings of the Meeting, Orlando, FL, Apr. 20-22, 1992

Topics discussed in these proceedings include nonlinear processing and communications; feature extraction and recognition; image gathering, interpolation, and restoration; image coding; and wavelet transform. Papers are presented on noise reduction for signals from nonlinear systems; driving nonlinear systems with chaotic signals; edge detection and image segmentation of space scenes using fractal analyses; a vision system for telerobotic operation; a fidelity analysis of image gathering, interpolation, and restoration; restoration of images degraded by motion; and information, entropy, and fidelity in visual communication. Attention is also given to image coding methods and their assessment, hybrid JPEG/recursive block coding of images, modified wavelets that accommodate causality, modified wavelet transform for unbiased frequency representation, and continuous wavelet transform of one-dimensional signals by Fourier filtering.

Huck, Friedrich O.↗

NASA NTRS2019

2040 Vision Study: an Enlargement of Model Based Engineering

Over the last few decades, advances in high-performance computing, new materials characterization methods, and, more recently, an emphasis on integrated computational materials engineering (ICME) and additive manufacturing have been a catalyst for multiscale modeling and simulation-based design of materials and structures in the aerospace industry. As a result, NASA's Transformational Tools and Technology (TTT) Project sponsored a study (performed by a team led by Pratt & Whitney) to define the potential 25-year future state required for integrated multiscale modeling of materials and systems (e.g., load-bearing structures) to accelerate the pace and reduce the expense of innovation in future aerospace and aeronautical systems. This talk will briefly review the findings of this 2040 Vision study (e.g., the 2040 vision state; the required interdependent core technical work areas, Key Element (KE); associated critical gaps and actions to close those gaps; and major recommendations). The study, NASA CR 2018- 219771, envisions the development of a cyber-physical-social ecosystem comprised of experimentally verified and validated computational models, tools, and techniques, along with the associated digital tapestry, that marries two non-mutually exclusive paradigms _ "design of the materials" (material scientist viewpoint) and "design with the materials" (structural analyst viewpoint) _ into a concurrent transformational paradigm that impacts the entire supply chain to enable cost-effective, rapid, and revolutionary design of fit-for-purpose materials, components, and systems. Although the vision focused on aeronautics and space applications, it is believed that other engineering communities (e.g., automotive, biomedical, etc.) can benefit as well from the proposed framework with only minor modifications. Finally, it is TTT's hope and desire that this vision provides the strategic guidance to both public and private research and development decision makers to make the proposed 2040 vision state a reality and thereby provide a significant advancement in the United States global competitiveness.

Arnold, Steven M.↗

NASA NTRSDate not supplied

2040 Vision Study: NASA’s T3 Implementation Activities

Over the last few decades, advances in high-performance computing, new materials characterization methods, and, more recently, an emphasis on integrated computational materials engineering (ICME) and additive manufacturing have been a catalyst for multiscale modeling and simulation-based design of materials and structures in the aerospace industry. As a result, NASA’s Transformational Tools and Technology (TTT) Project sponsored a study (performed by a team led by Pratt & Whitney) to define the potential 25-year future state required for integrated multiscale modeling of materials and systems (e.g., load-bearing structures) to accelerate the pace and reduce the expense of innovation in future aerospace and aeronautical systems. This talk will briefly review the findings of this 2040 Vision study (e.g., the 2040 vision state; the required interdependent core technical work areas, Key Element (KE); associated critical gaps and actions to close those gaps; and major recommendations) and discuss NASA’s TTT implementation activities, with special emphasis on recent accomplishments. The study, NASA CR 2018- 219771, envisions the development of a cyber-physical-social ecosystem comprised of experimentally verified and validated computational models, tools, and techniques, along with the associated digital tapestry, that marries two non-mutually exclusive paradigms – “design of the materials” (material scientist viewpoint) and “design with the materials” (structural analyst viewpoint) – into a concurrent transformational paradigm that impacts the entire supply chain to enable cost-effective, rapid, and revolutionary design of fit-for-purpose materials, components, and systems. Although the vision focused on aeronautics and space applications, it is believed that other engineering communities (e.g., automotive, biomedical, etc.) can benefit as well from the proposed framework with only minor modifications. Finally, it is TTT’s hope and desire that this vision provides the strategic guidance to both public and private research and development decision makers to make the proposed 2040 vision state a reality and thereby provide a significant advancement in the United State's global competitiveness

Materials↗

DOE OSTI2020

An image-driven machine learning approach to kinetic modeling of a discontinuous precipitation reaction

Micrograph quantification is an essential component of several materials science studies. Machine learning methods, in particular convolutional neural networks, have previously demonstrated performance in image recognition tasks across several disciplines (e.g. materials science, medical imaging, facial recognition). Here, we apply these well-established methods to develop an approach to microstructure quantification for kinetic modeling of a discontinuous precipitation reaction in a case study on the uranium-molybdenum system. Prediction of material processing history based on image data (classification), calculation of area fraction of phases present in the micrographs (segmentation), and kinetic modeling from segmentation results were performed. Results indicate that convolutional neural networks represent microstructure image data well, and segmentation using the k-means clustering algorithm yields results that agree well with manually annotated images. Classification accuracies of original and segmented images are both 94% for a 5-class classification problem. Kinetic modeling results agree well with previously reported data using manual thresholding. The image quantification and kinetic modeling approach developed and presented here aims to reduce researcher bias introduced into the characterization process, and allows for leveraging information in limited image data sets.

36 MATERIALS SCIENCE↗

NASA NTRS2004

National Aeronautics and Space Administration Exploration Systems Interim Strategy

Contents include the following: 1. The Exploration Systems Mission Directorate within NASA. Enabling the Vision for Space Exploration. The Role of the Directorate. 2. Strategic Context and Approach. Corporate Focus. Focused, Prioritized Requirements. Spiral Transformation. Management Rigor. 3. Achieving Directorate Objectives. Strategy to Task Process. Capability Development. Research and Technology Development. 4. Beyond the Horizon. Appendices.

Source record↗

DOE OSTI2022

Standard model physics and the digital quantum revolution: thoughts about the interface

Advances in isolating, controlling and entangling quantum systems are transforming what was once a curious feature of quantum mechanics into a vehicle for disruptive scientific and technological progress. Pursuing the vision articulated by Feynman, a concerted effort across many areas of research and development is introducing prototypical digital quantum devices into the computing ecosystem available to domain scientists. Through interactions with these early quantum devices, the abstract vision of exploring classically-intractable quantum systems is evolving toward becoming a tangible reality. Beyond catalyzing these technological advances, entanglement is enabling parallel progress as a diagnostic for quantum correlations and as an organizational tool, both guiding improved understanding of quantum many-body systems and quantum field theories defining and emerging from the standard model. Here, from the perspective of three domain science theorists, this article compiles thoughts about the interface on entanglement, complexity, and quantum simulation in an effort to contextualize recent NISQ-era progress with the scientific objectives of nuclear and high-energy physics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

NASA NTRS1991

Autonomous proximity operations using machine vision for trajectory control and pose estimation

A machine vision algorithm was developed which permits guidance control to be maintained during autonomous proximity operations. At present this algorithm exists as a simulation, running upon an 80386 based personal computer, using a ModelMATE CAD package to render the target vehicle. However, the algorithm is sufficiently simple, so that following off-line training on a known target vehicle, it should run in real time with existing vision hardware. The basis of the algorithm is a sequence of single camera images of the target vehicle, upon which radial transforms were performed. Selected points of the resulting radial signatures are fed through a decision tree, to determine whether the signature matches that of the known reference signatures for a particular view of the target. Based upon recognized scenes, the position of the maneuvering vehicle with respect to the target vehicles can be calculated, and adjustments made in the former's trajectory. In addition, the pose and spin rates of the target satellite can be estimated using this method.

Cleghorn, Timothy F.↗

NASA NTRS1993

DCT quantization matrices visually optimized for individual images

This presentation describes how a vision model incorporating contrast sensitivity, contrast masking, and light adaptation is used to design visually optimal quantization matrices for Discrete Cosine Transform image compression. The Discrete Cosine Transform (DCT) underlies several image compression standards (JPEG, MPEG, H.261). The DCT is applied to 8x8 pixel blocks, and the resulting coefficients are quantized by division and rounding. The 8x8 'quantization matrix' of divisors determines the visual quality of the reconstructed image; the design of this matrix is left to the user. Since each DCT coefficient corresponds to a particular spatial frequency in a particular image region, each quantization error consists of a local increment or decrement in a particular frequency. After adjustments for contrast sensitivity, local light adaptation, and local contrast masking, this coefficient error can be converted to a just-noticeable-difference (jnd). The jnd's for different frequencies and image blocks can be pooled to yield a global perceptual error metric. With this metric, we can compute for each image the quantization matrix that minimizes the bit-rate for a given perceptual error, or perceptual error for a given bit-rate. Implementation of this system demonstrates its advantages over existing techniques. A unique feature of this scheme is that the quantization matrix is optimized for each individual image. This is compatible with the JPEG standard, which requires transmission of the quantization matrix.

Watson, Andrew B.↗

NASA NTRS2012

Revitalization of the NASA Langley Research Center's Infrastructure

The NASA Langley Research Center (Langley) was founded in 1917 as the nation's first civilian aeronautical research facility and NASA's first field center. For nearly 100 years, Langley has made significant contributions to the Aeronautics, Space Exploration, and Earth Science missions through research, technology, and engineering core competencies in aerosciences, materials, structures, the characterization of earth and planetary atmospheres and, more recently, in technologies associated with entry, descent, and landing. An unfortunate but inevitable outcome of this rich history is an aging infrastructure where the longest serving building is close to 80 years old and the average building age is 44 years old. In the current environment, the continued operation and maintenance of this aging and often inefficient infrastructure presents a real challenge to Center leadership in the trade space of sustaining infrastructure versus not investing in future capabilities. To address this issue, the Center has developed a forward looking revitalization strategy that ties future core competencies and technical capabilities to the Center Master Facility Plan to maintain a viable Center well into the future. This paper documents Langley's revitalization strategy which integrates the Center's missions, the Langley 2050 vision, the Center Master Facility Plan, and the New Town repair-by-replacement program through the leadership of the Vibrant Transformation to Advance Langley (ViTAL) Team.

Weiser, Erik S.↗

DOE OSTI2020

Power Sector Transformation Pathways: Exploring Objectives, Factors, and Technology Innovations to Inform Power Sector Pathway Decisions

The power and heating sectors are responsible for around 30% of global CO2 emissions and this share is likely to grow as countries move towards electrification of the transportation and building sectors. Therefore, enabling forward-thinking, long term strategies in the power sector is a crucial area for international collaboration and support. The rapid transition of power systems toward modern, low-carbon pathways and technologies will be necessary to meet key climate goals while also enabling other critical objectives such as economic development, energy access, and energy system resiliency, among others. Many developed and developing countries are well-poised to champion power sector transformation (PST), however, further support is needed to identify pathways and implement critical near and long-term actions. To address this need, the Low Emission Development Strategies Global Partnership (LEDS GP) together with an expert team including Agora Energiewende, Energy Innovation, European Climate Foundation, Fraunhofer Institute for Systems and Innovation Research , Prayas Energy Group and LEDS Latin America and Caribbean Platform, developed a framework identifying four key pathways that can be integrated and combined to support low-carbon PST. These four pathways are: (1) Distributed Energy Resource Revolution, (2) Bulk Power Transformation, (3) Transmission and Distribution Interactivity, and (4) Distributed Transactional Future. To support exploration of pathways, this study examines PST objectives and factors that may lead countries or jurisdictions to place a greater relative emphasis on certain pathways as well as a framework and complementary tool for considering the emphasis in a hands on manner. The report provides case studies on application of the approach to bring life to the topic. The case studies include Haiti, Kenya, Mexico, Southeast Asia, and the European Union, among others. The report also presents actions to-be-taken in the near-, medium- and long-term to support the realization of pathways and long-term transformation of the power sector. The report, together with a complementary spreadsheet tool developed under the effort, can be used to enable stakeholder engagement and visioning for the power sector over the long-term, taking into account key factors and potential innovations. It can also be used to understand and inform relevant analysis tools and models based on which pathways are emphasized, and to identify key actions in the near- and medium-term to avoid lock-in of carbon-intensive technologies.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

NASA NTRS2010

Multi-Stage System for Automatic Target Recognition

A multi-stage automated target recognition (ATR) system has been designed to perform computer vision tasks with adequate proficiency in mimicking human vision. The system is able to detect, identify, and track targets of interest. Potential regions of interest (ROIs) are first identified by the detection stage using an Optimum Trade-off Maximum Average Correlation Height (OT-MACH) filter combined with a wavelet transform. False positives are then eliminated by the verification stage using feature extraction methods in conjunction with neural networks. Feature extraction transforms the ROIs using filtering and binning algorithms to create feature vectors. A feedforward back-propagation neural network (NN) is then trained to classify each feature vector and to remove false positives. The system parameter optimizations process has been developed to adapt to various targets and datasets. The objective was to design an efficient computer vision system that can learn to detect multiple targets in large images with unknown backgrounds. Because the target size is small relative to the image size in this problem, there are many regions of the image that could potentially contain the target. A cursory analysis of every region can be computationally efficient, but may yield too many false positives. On the other hand, a detailed analysis of every region can yield better results, but may be computationally inefficient. The multi-stage ATR system was designed to achieve an optimal balance between accuracy and computational efficiency by incorporating both models. The detection stage first identifies potential ROIs where the target may be present by performing a fast Fourier domain OT-MACH filter-based correlation. Because threshold for this stage is chosen with the goal of detecting all true positives, a number of false positives are also detected as ROIs. The verification stage then transforms the regions of interest into feature space, and eliminates false positives using an artificial neural network classifier. The multi-stage system allows tuning the detection sensitivity and the identification specificity individually in each stage. It is easier to achieve optimized ATR operation based on its specific goal. The test results show that the system was successful in substantially reducing the false positive rate when tested on a sonar and video image datasets.

Chao, Tien-Hsin↗

NASA NTRSDate not supplied

Defining Services, Functions, and Capabilities for an Advanced Air Mobility (AAM) In-time Aviation Safety Management System (IASMS)

NASA’s vision for Advanced Air Mobility (AAM) Mission is to help emerging aviation markets to safely develop an air transportation system that moves people and cargo between places previously not served or underserved by aviation. The integration of new operational paradigms and vehicle classes in this system requires a transformation of the National Airspace System (NAS) that includes substantive changes critical for assuring safety. These changes are compelled by unique challenges posed by AAM to the safety management system (SMS). These challenges were assessed by committees of the National Academies in their reports on a vision for an In-time Aviation Safety Management System (IASMS) and a blueprint for AAM [1,2]. In their description of an IASMS, the top recommendation was development of a concept of operations (ConOps) for IASMS. This paper describes the high-priority recommendations from the National Academies for its IASMS vision and how they are addressed through a distributed system-of-systems architecture. The IASMS architecture is structured on the services, functions, and capabilities (SFCs) necessary for In-time System-wide Safety Assurance (ISSA)initially developed for urban air mobility (UAM). The paper then posits where these SFCs would reside across vehicles, airspace, or service suppliers such as Supplemental Data Service Providers (SDSPs), and how SFCs scale with increasing complexity in design and operations of AAM. SFCs are foundational building blocks for a system that targets an individual or family of risks using a Monitor-Assess-Mitigate risk paradigm for anomalies, precursors and trends. An IASMS could be conceived that uses a portfolio of SFCs for AAM in general or prioritizes SFCs for a specific domain or operation.

K Ellis↗

NASA NTRS2010

The Spatial Vision Tree: A Generic Pattern Recognition Engine- Scientific Foundations, Design Principles, and Preliminary Tree Design

New foundational ideas are used to define a novel approach to generic visual pattern recognition. These ideas proceed from the starting point of the intrinsic equivalence of noise reduction and pattern recognition when noise reduction is taken to its theoretical limit of explicit matched filtering. This led us to think of the logical extension of sparse coding using basis function transforms for both de-noising and pattern recognition to the full pattern specificity of a lexicon of matched filter pattern templates. A key hypothesis is that such a lexicon can be constructed and is, in fact, a generic visual alphabet of spatial vision. Hence it provides a tractable solution for the design of a generic pattern recognition engine. Here we present the key scientific ideas, the basic design principles which emerge from these ideas, and a preliminary design of the Spatial Vision Tree (SVT). The latter is based upon a cryptographic approach whereby we measure a large aggregate estimate of the frequency of occurrence (FOO) for each pattern. These distributions are employed together with Hamming distance criteria to design a two-tier tree. Then using information theory, these same FOO distributions are used to define a precise method for pattern representation. Finally the experimental performance of the preliminary SVT on computer generated test images and complex natural images is assessed.

Rahman, Zia-ur↗