SEARCH · Engineering Papers

Results for “Vision transformers”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

All sources NASA NTRS DOE OSTI

NASA NTRS1995

Discrete Gabor Filters For Binocular Disparity Measurement

Discrete Gabor filters proposed for use in determining binocular disparity - difference between positions of same feature or object depicted in stereoscopic images produced by two side-by-side cameras aimed in parallel. Magnitude of binocular disparity used to estimate distance from cameras to feature or object. In one potential application, cameras charge-coupled-device video cameras in robotic vision system, and binocular disparities and distance estimates used as control inputs - for example, to control approaches to objects manipulated or to maintain safe distances from obstacles. Binocular disparities determined from phases of discretized Gabor transforms.

Weiman, Carl F. R.↗

DOE OSTI2025

ORBIT-2 Dataset for Scaling Exascale Vision Foundation Models for Weather and Climate Downscaling

This dataset release corresponds to the work conducted in ORBIT-2: Scaling Exascale Vision Foundation Models for Weather and Climate Downscaling, where large-scale AI methods were applied to improve climate and weather resolution. The collection integrates four widely used, publicly available datasets: ERA5, PRISM, DAYMET, and IMERG. To prepare the data for ORBIT-2 model training and evaluation, we applied a preprocessing pipeline that generates paired low-resolution and high-resolution samples, enabling supervised downscaling experiments. The transformation from coarse to fine scales was performed using bilinear regridding, consistent with the procedures described in WeatherBench2, a community benchmark for weather and climate AI models. This dataset supports the development and evaluation of foundation models designed for weather and climate downscaling at exascale. Additional details on methodology and applications can be found in Wang et al., ORBIT-2 (arXiv:2505.04802, 2025).

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2018

2040 Vision: A Roadmap for Integrated, Multiscale Materials and System Modeling and Simulation

Over the last few decades, advances in high-performance computing, new materials characterization methods, and, more recently, an emphasis on integrated computational materials engineering (ICME) and additive manufacturing have been a catalyst for multiscale modeling and simulation-based design of materials and structures in the aerospace industry. While these advances have driven significant progress in the development of aerospace components and systems, that progress has been limited by persistent technology and infrastructure challenges that must be overcome to realize the full potential of integrated materials and systems design and simulation modeling throughout the supply chain. As a result, NASA's Transformational Tools and Technology (TTT) Project sponsored a study (performed by a team led by Pratt & Whitney) to define the potential 25-year future state required for integrated multiscale modeling of materials and systems (e.g., load-bearing structures) to accelerate the pace and reduce the expense of innovation in future aerospace and aeronautical systems. This talk will describe the findings of this 2040 Vision study (e.g., the 2040 vision state; the required interdependent core technical work areas, Key Element (KE); associated critical gaps and actions to close those gaps; and major recommendations). This roadmap is a community consensus document and is a result of over 450 professionals input obtain via: i) four society workshops (AIAA, NAFEMS, and two TMS), ii) community-wide survey, and iii) the establishment of 9 expert panels (one per key element) consisting on average 10 non-team members from academia, government and industry to review, update content, and prioritize gaps and actions. It is NASA's hope and desire that this roadmap provides the strategic guidance to both public and private research and development decision makers to make the proposed 2040 vision state a reality and thereby provide a significant advancement in the United States global competitiveness.

Multiscale Modeling↗

NASA NTRS2018

Vision 2040: A Roadmap for Integrated, Multiscale Modeling and Simulation of Materials and Systems

Over the last few decades, advances in high-performance computing, new materials characterization methods, and, more recently, an emphasis on integrated computational materials engineering (ICME) and additive manufacturing have been a catalyst for multiscale modeling and simulation-based design of materials and structures in the aerospace industry. While these advances have driven significant progress in the development of aerospace components and systems, that progress has been limited by persistent technology and infrastructure challenges that must be overcome to realize the full potential of integrated materials and systems design and simulation modeling throughout the supply chain. As a result, NASA's Transformational Tools and Technology (TTT) Project sponsored a study (performed by a diverse team led by Pratt & Whitney) to define the potential 25-year future state required for integrated multiscale modeling of materials and systems (e.g., load-bearing structures) to accelerate the pace and reduce the expense of innovation in future aerospace and aeronautical systems. This report describes the findings of this 2040 Vision study (e.g., the 2040 vision state; the required interdependent core technical work areas, Key Element (KE); identified gaps and actions to close those gaps; and major recommendations) which constitutes a community consensus document as it is a result of over 450 professionals input obtain via: 1) four society workshops (AIAA, NAFEMS, and two TMS), 2) community-wide survey, and 3) the establishment of 9 expert panels (one per KE) consisting on average of 10 non-team members from academia, government and industry to review, update content, and prioritize gaps and actions. The study envisions the development of a cyber-physical-social ecosystem comprised of experimentally verified and validated computational models, tools, and techniques, along with the associated digital tapestry, that impacts the entire supply chain to enable cost-effective, rapid, and revolutionary design of fit-for-purpose materials, components, and systems. Although the vision focused on aeronautics and space applications, it is believed that other engineering communities (e.g., automotive, biomedical, etc.) can benefit as well from the proposed framework with only minor modifications. Finally, it is TTT's hope and desire that this vision provides the strategic guidance to both public and private research and development decision makers to make the proposed 2040 vision state a reality and thereby provide a significant advancement in the United States global competitiveness.

multi-scale modeling↗

NASA NTRS2015

The SMART-NAS Testbed

The SMART-NAS Testbed for Safe Trajectory Based Operations Project will deliver an evaluation capability, critical to the ATM community, allowing full NextGen and beyond-NextGen concepts to be assessed and developed. To meet this objective a strong focus will be placed on concept integration and validation to enable a gate-to-gate trajectory-based system capability that satisfies a full vision for NextGen. The SMART-NAS for Safe TBO Project consists of six sub-projects. Three of the sub-projects are focused on exploring and developing technologies, concepts and models for evolving and transforming air traffic management operations in the ATM+2 time horizon, while the remaining three sub-projects are focused on developing the tools and capabilities needed for testing these advanced concepts. Function Allocation, Networked Air Traffic Management and Trajectory Based Operations are developing concepts and models. SMART-NAS Test-bed, System Assurance Technologies and Real-time Safety Modeling are developing the tools and capabilities to test these concepts. Simulation and modeling capabilities will include the ability to assess multiple operational scenarios of the national airspace system, accept data feeds, allowing shadowing of actual operations in either real-time, fast-time and/or hybrid modes of operations in distributed environments, and enable integrated examinations of concepts, algorithms, technologies, and NAS architectures. An important focus within this project is to enable the development of a real-time, system-wide safety assurance system. The basis of such a system is a continuum of information acquisition, analysis, and assessment that enables awareness and corrective action to detect and mitigate potential threats to continuous system-wide safety at all levels. This process, which currently can only be done post operations, will be driven towards "real-time" assessments in the 2035 time frame.

Trajectory Based Operations↗

NASA NTRSDate not supplied

Real World Applications of AI/ML in Optimizing Airspace Operations

As National Airspace System (NAS) is going through the Digital Transformation journey, data science and analytics methods can significantly contribute to improving the traditional physics-based decision-making tools. The adoption of AI/ML methods will not only help accelerate Federal Aviation Administration (FAA)’s vision of Info-centric NAS but also contribute to the overall objective of sustainable aviation. AI/ML can improve the ground and airspace operations by enhancing the accuracy of current decision-making tools used by the airlines and the FAA to manage traffic on the ground and in the air. Huge amount of data that gets collected during a flight. AI/ML methods can extract information from this data and provide valuable insights to make better operational decisions. NASA has partnered with the FAA and commercial airlines such as American and Southwest Airlines on this effort and has successfully demonstrated the benefits of using ML in real world environment by reducing delays and optimizing ground operations at the US airports. In 2022 itself, NASA demonstrated real-world benefits (over 24K lbs. of fuel savings, over 76.6K lbs. CO2 emission savings, and several hours of delay savings) by deploying ML based prediction models to optimize ground operations at Dallas/Fort Worth International and Dallas Love Field Airports in Texas. These tools are being deployed on the cloud for broader deployment, adaptability, and scalability. NASA is developed a reference implementation of the cloud-based platform to significantly lower the bar to development and distribution of these digital services for aviation. In this talk, I will share information about the Digital Information Platform project, the novel AI/ML based approaches used for optimizing ground operations and the opportunities to partner with NASA on these demonstrations.

air traffic management↗

NASA NTRS1993

Prototype Optical Correlator For Robotic Vision System

Known and unknown images fed in electronically at high speed. Optical correlator and associated electronic circuitry developed for vision system of robotic vehicle. System recognizes features of landscape by optical correlation between input image of scene viewed by video camera on robot and stored reference image. Optical configuration is Vander Lugt correlator, in which Fourier transform of scene formed in coherent light and spatially modulated by hologram of reference image to obtain correlation.

Scholl, Marija S.↗

NASA NTRSDate not supplied

Ultraviolet Astronomy in the XXI Century

The US 2020 Astrophysics Decadal Survey (Astro2020) has recommended NASA develop the first observatory designed to search for signs of life on exoplanets and enable transformative astrophysics. These ambitious goals demand a large and highly capable space telescope with broad wavelength coverage from the far-UV to the near-IR, in the tradition of the Hubble Space Telescope. Realizing this vision will require aggressive technology development — as well as respect for and careful balancing of the needs of many scientific communities. In this talk, I will review the Decadal recommendations, including the development approach and timeline envisioned for the recommended UV/O/IR flagship. The LUVOIR and HabEx pre-Decadal mission concepts that fed into that flagship will also be reviewed. Finally, I’ll highlight some key technical considerations for the future UV/O/IR Great Observatory.

Aki Roberge↗

NASA NTRSDate not supplied

Materials Informatics at NASA GRC: Machine Learning Surrogate Modeling, Data Management, and Integrated Toolsets for Establishing/Maintaining the Digital Thread

Integrated Computational Materials Engineering (ICME) has recently received widespread attention due to its promises in reducing dependence on physical testing for engineering design by relying on simulation, reducing both time and cost to market for various applications. ICME however requires validated multiscale material models, which heavily depend on available test data with full material and test pedigree, including material processing, test and measurement equipment, raw data collection, and analysis methodology and results that is findable and usable, along with integrated, efficient toolsets for effectively passing information across various length and time scales across such models. At the NASA Glenn Research Center under the Transformational Tools and Technologies Project, significant recent efforts have been directed towards establishing the required cyberinfrastructure to enable optimized ICME processes and the design of “fit-for-purpose” materials to achieve the goals outlined in the NASA Vision 2040 report. Such efforts include development of multiscale physics-based material models, which can be used to train highly efficient surrogate machine learning models, development of best practices and infrastructure for effective, traceable materials information management, and development of toolsets that integrate with physics-based codes, machine learning models, and an information management system to enable high throughput of materials data collection and analysis, establishment of digital twins and the digital thread, and automation of the ICME design process for material optimization.

Machine Learning↗

DOE OSTI2025

Unveiling the Hidden Evolution of Crystal Defects and Disorder in Energy Materials

Control of point defects and disorder in functional thin films and 2D materials is critical to realizing their full potential in applications ranging from energy storage to advanced electronics. However, these phenomena are often poorly understood, difficult to characterize, and challenging to direct with precision. This presentation explores emerging multi-modal computer vision to decipher and predict order in materials across multiple length scales in the electron microscope, from the atomic to the nanoscale. By fusing data from diverse sources, these powerful models provide unprecedented insights into materials' lifecycles, enabling the control of defects and their associated properties at a fundamental level. This capability promises to transform materials design and accelerate the development of next-generation technologies.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1989

Techniques and potential capabilities of multi-resolutional information (knowledge) processing

A concept of nested hierarchical (multi-resolutional, pyramidal) information (knowledge) processing is introduced for a variety of systems including data and/or knowledge bases, vision, control, and manufacturing systems, industrial automated robots, and (self-programmed) autonomous intelligent machines. A set of practical recommendations is presented using a case study of a multiresolutional object representation. It is demonstrated here that any intelligent module transforms (sometimes, irreversibly) the knowledge it deals with, and this tranformation affects the subsequent computation processes, e.g., those of decision and control. Several types of knowledge transformation are reviewed. Definite conditions are analyzed, satisfaction of which is required for organization and processing of redundant information (knowledge) in the multi-resolutional systems. Providing a definite degree of redundancy is one of these conditions.

Meystel, A.↗

NASA NTRSDate not supplied

ICME: The Design of Fit-for-Purpose Materials

With the increased emphasis on reducing the cost and time to market of new materials, ICME (Integrated Computational Materials Engineering) has become a fast growing discipline within materials science and engineering. The vision of ICME is compelling in many respects, not only for the value added in reducing time to market for new products with advanced, tailored materials, but also for enhanced efficiency and performance of these materials. Although the challenges and barriers (both technical and cultural) are formidable, substantial cost, schedule, and technical benefits can result from broad development, implementation, and validation of ICME principles. ICME is an integrated approach to the design of products, and the materials that comprise them, by linking material and structural models at multiple time and length scales. NASA’s Transformational Tools and Technology (TTT) Project sponsored a study (performed by a team led by Pratt & Whitney) in 2016 to define the potential 25-year future state required for integrated multiscale modeling of materials and systems (e.g., load-bearing structures) to accelerate the pace and reduce the expense of innovation in future aerospace and aeronautical systems. This talk will briefly review ICME, the findings of the 2040 Vision study, and discuss NASA’s TTT 2040 implementation activities: with special emphasis on recent accomplishments. The 2040 study, NASA CR 2018- 219771, envisions the development of a cyber-physical-social ecosystem comprised of experimentally verified and validated computational models, tools, and techniques, along with the associated digital tapestry, that impacts the entire supply chain to enable cost-effective, rapid, and revolutionary design of fit-for-purpose materials, components, and systems by enabling the engineer to not only “design-with-the” material but also concurrently “design-the” material.

multiscale analysis↗

NASA NTRS2015

NASA's Vision for Potential Energy Reduction from Future Generations of Propulsion Technology

Through a robust partnership with the aviation industry, over the past 50 years NASA programs have helped foster advances in propulsion technology that enabled substantial reductions in fuel consumption for commercial transports. Emerging global trends and continuing environmental concerns are creating challenges that will very likely transform the face of aviation over the next 20-40 years. In recognition of this development, NASA Aeronautics has established a set of Research Thrusts that will help define the future direction of the agency's research technology efforts. Two of these thrusts, Ultra-Efficient Commercial Vehicles and Transition to Low-Carbon Propulsion, serve as cornerstones for the Advanced Air Transport Technology (AATT) project. The AATT project is exploring and developing high-payoff technologies and concepts that are key to continued improvement in energy efficiency and environmental compatibility for future generations of fixed-wing, subsonic transports. The AATT project is primarily focused on the N+3 timeframe, or 3 generations from current technology levels. As should be expected, many of the propulsion system architectures technologies envisioned for N+3 vary significantly from todays engines. The use of batteries in a hybrid-electric configuration or deploying multiple fans distributed across the airframe to enable higher bypass ratios are just two examples of potential advances that could enable substantial energy reductions over current propulsion systems.

Airbreathing Propulsion↗

NASA NTRS1984

Computer vision for real-time orbital operations. Center directors discretionary fund

Machine vision research is examined as it relates to the NASA Space Station program and its associated Orbital Maneuvering Vehicle (OMV). Initial operation of OMV for orbital assembly, docking, and servicing are manually controlled from the ground by means of an on board TV camera. These orbital operations may be accomplished autonomously by machine vision techniques which use the TV camera as a sensing device. Classical machine vision techniques are described. An alternate method is developed and described which employs a syntactic pattern recognition scheme. It has the potential for substantial reduction of computing and data storage requirements in comparison to the Two-Dimensional Fast Fourier Transform (2D FFT) image analysis. The method embodies powerful heuristic pattern recognition capability by identifying image shapes such as elongation, symmetry, number of appendages, and the relative length of appendages.

Vinz, F. L.↗

NASA NTRS1989

Implementation of an algorithm for cylindrical object identification using range data

One of the problems in 3-D object identification and localization is addressed. In robotic and navigation applications the vision system must be able to distinguish cylindrical or spherical objects as well as those of other geometric shapes. An algorithm was developed to identify cylindrical objects in an image when range data is used. The algorithm incorporates the Hough transform for line detection using edge points which emerge from a Sobel mask. Slices of the data are examined to locate arcs of circles using the normal equations of an over-determined linear system. Current efforts are devoted to testing the computer implementation of the algorithm. Refinements are expected to continue in order to accommodate cylinders in various positions. A technique is sought which is robust in the presence of noise and partial occlusions.

Bozeman, Sylvia T.↗

NASA NTRS2005

Demonstration of Four Operating Capabilities to Enable a Small Aircraft Transportation System

The Small Aircraft Transportation System (SATS) project has been a five-year effort fostering research and development that could lead to the transformation of our country s air transportation system. It has become evident that our commercial air transportation system is reaching its peak in terms of capacity, with numerous delays in the system and the demand keeps steadily increasing. The SATS vision is to increase mobility in our nation s transportation system by expanding access to more than 3400 small community airports that are currently under-utilized. The SATS project has focused its efforts on four key operating capabilities that have addressed new emerging technologies and procedures to pave the way for a new way of air travel. The four key operating capabilities are: Higher Volume Operations at Non-Towered/Non-Radar Airports, En Route Procedures and Systems for Integrated Fleet Operations, Lower Landing Minimums at Minimally Equipped Landing Facilities, and Increased Single Pilot Performance. These four capabilities are key to enabling low-cost, on-demand, point-to-point transportation of goods and passengers utilizing small aircraft operating from small airports. The focus of this paper is to discuss the technical and operational feasibility of the four operating capabilities and demonstrate how they can enable a small aircraft transportation system.

Viken, Sally A.↗

NASA NTRS2019

Safe2Ditch Steer-To-Clear Development and Flight Testing

This paper describes a series of small unmanned aerial system (sUAS) flights performed at NASA Langley Research Center in April and May of 2019 to test a newly added Steer-to-Clear feature for the Safe2Ditch (S2D) prototype system. S2D is an autonomous crash management system for sUAS. Its function is to detect the onset of an emergency for an autonomous vehicle, and to enable that vehicle in distress to execute safe landings to avoid injuring people on the ground or damaging property. Flight tests were conducted at the City Environment Range for Testing Autonomous Integrated Navigation (CERTAIN) range at NASA Langley. Prior testing of S2D focused on rerouting to an alternate ditch site when an occupant was detected in the primary ditch site. For Steer-to-Clear testing, S2D was limited to a single ditch site option to force engagement of the Steer-to-Clear mode. The implementation of Steer-to-Clear for the flight prototype used a simple method to divide the target ditch site into four quadrants. An RC car was driven in circles in one quadrant to simulate an occupant in that ditch site. A simple implementation of Steer-to- Clear was programmed to land in the opposite quadrant to maximize distance to the occupant’s quadrant. A successful mission was tallied when this occurred. Out of nineteen flights, thirteen resulted in successful missions. Data logs from the flight vehicle and the RC car indicated that unsuccessful missions were due to geolocation error between the actual location of the RC car and the derived location of it by the Vision Assisted Landing component of S2D on the flight vehicle. Video data indicated that while the Vision Assisted Landing component reliably identified the location of the ditch site occupant in the image frame, the conversion of the occupant’s location to earth coordinates was sometimes adversely impacted by errors in sensor data needed to perform the transformation. Logged sensor data was analyzed to attempt to identify the primary error sources and their impact on the geolocation accuracy. Three trends were observed in the data evaluation phase. In one trend, errors in geolocation were relatively large at the flight vehicle’s cruise altitude, but reduced as the vehicle descended. This was the expected behavior and was attributed to sensor errors of the inertial measurement unit (IMU). The second trend showed distinct sinusoidal error for the entire descent that did not always reduce with altitude. The third trend showed high scatter in the data, which did not correlate well with altitude. Possible sources of observed error and compensation techniques are discussed.

Petty, Bryan J.↗

NASA NTRS1991

Energy functions for regularization algorithms

Regularization techniques are widely used for inverse problem solving in computer vision such as surface reconstruction, edge detection, or optical flow estimation. Energy functions used for regularization algorithms measure how smooth a curve or surface is, and to render acceptable solutions these energies must verify certain properties such as invariance with Euclidean transformations or invariance with parameterization. The notion of smoothness energy is extended here to the notion of a differential stabilizer, and it is shown that to void the systematic underestimation of undercurvature for planar curve fitting, it is necessary that circles be the curves of maximum smoothness. A set of stabilizers is proposed that meet this condition as well as invariance with rotation and parameterization.

Delingette, H.↗