SEARCH · Engineering Papers

Results for “VISION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

All sources NASA NTRS DOE OSTI

NASA NTRS2018

Cobalt: Terrestrial Flight Test of Landing Navigation Using Lander Vision System with Navigation Doppler Lidar

COBALT (CoOperative Blending of Autonomous Landing Technologies) is a NASA technology development and test program to advance precision landing capabilities for future soft landers. The COBALT payload demonstrated terrain relative navigation utilizing the Lander Vision System and Navigation Doppler Lidar sensors on the Masten Space Systems Xodiac rocket. In spring 2017, the program culminated in two open-loop free flights to 500 m altitude with downrange diverts of 300 m. The COBALT system performed well, navigating within meters of the Xodiac vehicle’s GPS-based solution. This paper outlines details of the navigation filter and its performance during the test campaign.

Carson, John M. III↗

NASA NTRS2018

Onboard Stereo Vision for Drone Pursuit or Sense and Avoid

Wedescribeanew,on-board,shortrangeperceptionsystem that enables micro aerial vehicles (MAVs) to detect, track, and follow or avoid nearby drones (within 2-20 meters) in GPS-denied environments. Each vehicle is able to sense its neighborhood and adapt its motion accordingly without use of centralized reasoning or inter-vehicle communication. To enable a lightweight, low power solution, on-board stereo cameras are used for detection and tracking with depth images, while a downward-looking camera and an inertial measurement unit are used to estimate the position of the observer without use of GPS. We illustrate the robustness and accuracy of this approach through real-time, outdoor leader-follower experiments with three quadrotors. Our experiments show that state-of-art trackers are far less robust in detection against cluttered background. This demonstrates that stereo vision is a highly effective approach to perception for safe navigation of multiple MAVs in close proximity.

Matthies, Larry↗

NASA NTRS2020

The Mars 2020 Lander Vision System Field Test

The Mars 2020 Lander Vision System estimates position relative to a map and provides this information to the spacecraft so that large hazards can be avoided during landing. The LVS is a new mission critical sensor and as such requires extensive validation. A field test conducted in May 2019 was the primary means to prove that the LVS will operate as designed. During this test over 600 independent real-time runs on engineering model LVS hardware and software were executed and clearly showed that it could meet a 40m position estimation requirement over a wide operational envelope. This paper will describe the test approach, operations and results. Specific examples as well as aggregate per-formance will be discussed along with off-nominal testing and fault recovery.

Johnson, A.↗

NASA NTRS2021

Machine Vision based Sample-Tube Localization for Mars Sample Return

A potential Mars Sample Return (MSR) architecture is being jointly studied by NASA and ESA. As currently envisioned, the MSR campaign consists of a series of 3 missions: sample cache, fetch and return to Earth. In this paper, we focus on the fetch part of the MSR, and more specifically the problem of autonomously detecting and localizing sample tubes deposited on the Martian surface. Towards this end, we study two machine-vision based approaches: First, a geometrydriven approach based on template matching that uses hardcoded filters and a 3D shape model of the tube; and second, a data-driven approach based on convolutional neural networks (CNNs) and learned features. Furthermore, we present a large benchmark dataset of sample-tube images, collected in representative outdoor environments and annotated with ground truth segmentation masks and locations. The dataset was acquired systematically across different terrain, illumination conditions and dust-coverage; and benchmarking was performed to study the feasibility of each approach, their relative strengths and weaknesses, and robustness in the presence of adverse environmental conditions.

Detry, R.↗

NASA NTRS2016

Planet Formation Imager (PFI): Science Vision and Key Requirements

The Planet Formation Imager (PFI) project aims to provide a strong scientific vision for ground-based opticalastronomy beyond the upcoming generation of Extremely Large Telescopes. We make the case that a break-through in angular resolution imaging capabilities is required in order tounravel the processes involved in planetformation. PFI will be optimised to provide a complete census of the protoplanet population at all stellocentricradii and over the age range from 0.1 to∼100 Myr. Within this age period, planetary systems undergo dra-matic changes and the final architecture of planetary systems is determined. Our goal is to study the planetarybirth on the natural spatial scale where the material is assembled,which is the “Hill Sphere” of the formingplanet, and to characterise the protoplanetary cores by measuring their masses and physical properties. Ourscience working group has investigated the observational characteristics of these young protoplanets as well asthe migration mechanisms that might alter the system architecture. We simulated the imprints that the planetsleave in the disk and study how PFI could revolutionise areas ranging from exoplanet to extragalactic science.In this contribution we outline the key science drivers of PFI and discuss the requirements that will guide thetechnology choices, the site selection, and potential science/technology tradeoffs.

Stefan Kraus↗

NASA NTRSDate not supplied

Developing a Vision for Maturing the Heliophysics Infrastructure towards Open Science: The DIARieS Analysis Ecosystem

In the dawn of open science and the upcoming requirements, we speak about the existing state of Heliophysics infrastructure and detail the evolution required to address capability or interconnection shortcomings. Such a daunting barrier calls for an analysis ecosystem with multi-faceted capability. We propose such an ecosystem, called DIARieS, to be built upon five conceptual pillars: Discovery, Implementation, Analysis, Reproducibility, and Sharing of results. The combination of these concepts in a single platform will enable users to more intuitively combine recent advances in technology to create ‘DIARieS’ of their workflows, which can be easily made open to others in the community. The DIARieS ecosystem will also increase our efficiency by streamlining our various workflow processes, including automatic incorporation of the impending requirements of open science. The various components of the ecosystem will simplify software installation and data implementation, including automatically generated citation lists based on the components included. Automatic containerization and version control of the ecosystem will make the custom workflows easily reproducible. Employing widget technology will ease the difficulty of producing publication and commercial quality visualizations and applying common analyses techniques. Incorporating multiple technologies will streamline the various sharing methods common in our work environments today. Overall, the totality of capabilities to be offered by this analysis ecosystem will drastically simplify the application of open science principles to our work in addition to improving our efficiency and ease of collaboration. This talk summarizes a vision of the proposed ecosystem, which is described in more detail in Ringuette et al. (2022: https://doi.org/10.1016/j.asr.2022.05.012).

infrastructure↗

NASA NTRS2016

Planet Formation Imager (PFI): Science Vision and Key Requirements

The Planet Formation Imager (PFI) project aims to provide a strong scientific vision for ground-based optical astronomy beyond the upcoming generation of Extremely Large Telescopes. We make the case that a breakthrough in angular resolution imaging capabilities is required in order to unravel the processes involved in planet formation. PFI will be optimised to provide a complete census of the protoplanet population at all stellocentric radii and over the age range from 0.1 to ~ 100 Myr. Within this age period, planetary systems undergo dramatic changes and the final architecture of planetary systems is determined. Our goal is to study the planetary birth on the natural spatial scale where the material is assembled, which is the “Hill Sphere” of the forming planet, and to characterise the protoplanetary cores by measuring their masses and physical properties. Our science working group has investigated the observational characteristics of these young protoplanets as well as the migration mechanisms that might alter the system architecture. We simulated the imprints that the planets leave in the disk and study how PFI could revolutionise areas ranging from exoplanet to extragalactic science. In this contribution we outline the key science drivers of PFI and discuss the requirements that will guide the technology choices, the site selection, and potential science/technology tradeoffs.

Planet formation↗

NASA NTRSDate not supplied

Human Factors Research Needs for In-Time Aviation Safety Management Systems (IASMS) Design: Enabling the NASA “Sky for All” Future Airspace Vision

Integrated safety management will be paramount for safely enabling the envisioned transformations of the future National Airspace System. Addressing the increasing need for advanced data analytics and fusion of aviation safety data, managed by human decision-makers, is essential for realizing the vision. The proposal, if accepted, will discuss safety management system challenges and how the concept of In-time Aviation Safety Management Systems addresses the need. It will also discuss human factors challenges involved in future integrated safety management, including trust, over-reliance, human-optimized data visualization, human-autonomy teaming, training, communication and dissemination of data, situation awareness, task load, and accountability.

Lawrence J Prinzel III↗

NASA NTRS2023

Autonomy Verification & Validation Roadmap and Vision 2045

Advanced capabilities planned for the next generation of autonomous and increasingly autonomous air vehicles will include non-traditional components based on artificial intelligence, machine learning, and complex optimization and planning algorithms. These complex components will be used to provide enhanced safety and high-level decision-making functions. However, there are serious barriers to the deployment of autonomous aircraft in the National Airspace System (NAS). Current civil aviation certification processes are based on the concept that the correct behavior of a system or a component must be completely specified and verified prior to operation. This report from the Autonomy Verification and Validation (V&V) Roadmap and Vision 2045 project presents the most recent effort to build a comprehensive list of verification challenges and needs for autonomous aircraft, a roadmap to meet those autonomy V&V needs, the services they can enable, and point to the certification gaps they fill. To accomplish these goals, we assembled a team of world-class researchers from the aerospace industry (Boeing, Collins Aerospace, and GeneralElectric) and academia (University of Michigan, University of Texas, and Massachusetts Institute of Technology) with deep expertise in autonomy, aerospace systems, and assurance of Artificial Intelligence/machine learning systems.

Software Assurance↗

NASA NTRS2022

Camera Simulation for the Perseverance Rover’s Lander Vision System

On February 18, 2021, the Perseverance Rover safely landed on Mars at Jezero Crater. Part of the successful landing was due to the Lander Vision System (LVS), which takes descent images from the LVS Camera (LCAM) and IMU measurements and estimates the lander position relative to a map of the Jezero landing site. The LVS Simulation LCAM (LVSS LCAM) model is an image rendering program developed to test the LVS in a variety of scenarios to ensure performance amid uncertainty. The LVSS LCAM model includes a pointing misalignment model, an exposure timing model, shadowing, a terrain reflectance model, atmospheric attenuation from dust, and sensor effects. This model was used for performance analysis, verification, and validation of the LVS algorithms in a Mars-like simulation prior to landing. This paper describes the LVSS LCAM rendering algorithm and compares flight images from LVS operation during the Perseverance landing with their rendered counterparts.

Zheng, Jason↗

NASA NTRS2022

Mars 2020 Lander Vision System Flight Performance 1

The Mars 2020 Entry Descent and Landing (EDL) system delivered the Perseverance rover to the surface of Mars on February 18th, 2021. A large fraction of the Jezero Crater landing site was covered with landing hazards including cliffs, inescapable dune fields and rocks. These hazards were identified or inferred using orbital imagery before launch so that they could be avoided using Terrain Relative Navigation (TRN) which was composed of two parts: the Lander Vision System (LVS) and Safe Target Selection (STS). During EDL, the LVS successfully estimated map relative position by fusing landmarks matched between descent imagery and a map of the landing site with Inertial Measurement Unit (IMU) data. This position estimate was used by STS to identify the safest target for landing that was also reachable given fuel and other constraints. The EDL system then used the powered descent phase to retarget to this location and land safely. The overall error between the targeted location and actual landing location was 5m which was an order of magnitude less than the 60m touchdown error requirement. This paper will describe the final tests of the LVS before launch, the checkout of the LVS during operations and the LVS performance during EDL.

Zheng, Jason↗

NASA NTRSDate not supplied

ML/AI Applications to the Atmosphere Science Data and Simulations (Demonstration and Vision)

Artificial Intelligence has been recognized as one of the most powerful tools for scientific research. It has a wide range of applications in atmospheric science and plays a significant role in advancing our understanding of the Earth-Atmosphere system, as well as improving our ability to monitor, predict, and respond to atmospheric observations and simulations. Different AI architectures can help us handle various problems according to our research goals. In this presentation, we will introduce several use cases and models for applying computer vision to active remote sensing data from CALIOP, analyzing cloud dynamical relationships for climate model parameterizations, and building surrogate models for lidar simulations. The presentation will highlight the advantages that AI offers compared to traditional analytical methods. By assembling pieces of the multidimensional atmospheric science puzzle, we can integrate our knowledge from observations to simulations.

Shan Zeng↗

NASA NTRS2024

Effective Visualization of Radar Data for Users Impacted By Color Vision Deficiency

Color Vision Deficiency (CVD) is a decreased ability to discern between particular colors. Eight percent of genetic males and half a percent of genetic females have some form of CVD, with many in the radar community falling into this group. When presenting data on a two-dimensional plane, it is common to use colors to represent values via a colormap. Colormap choice in the radar community is influenced by the ability to highlight scientifically interesting features in data, institutional choices, and domain dominance of legacy colormaps. The problem with these current colormaps is that many do not project well for those with CVD (i.e., green next to red). In working with the CVD community to address this problem, multiple colormaps for moments such as equivalent reflectivity factor and Doppler velocity were created for users with forms of CVD such as deuteranomaly, protanomaly, protanopia, and deuteranopia using Python tools such as colorspacious and viscm. We show how these colormaps can improve interpretability for four cases: a mesoscale convective system, a pyrocumulonimbus storm, a wintertime mid-latitude cyclone, and widespread storms with a large bird migration. These new radar equivalent reflectivity factor, Doppler velocity, and polarization colormaps are designed to highlight rain, frozen precipitation, non-meteorological targets, velocity-based items, be perceptually uniform, and visually friendly for those with CVD.

Zachary Sherman↗

NASA NTRS2024

A Collaborative Vision for Deep Space Human Exploration

Artemis will be the first cooperative campaign among nations for crewed planetary exploration. This paradigm shift reflects a collaborative vision for deep space human exploration that embraces the concept that, “If you want to go fast, go alone; If you want to go far, go together.” This paper elaborates on the way the National Aeronautics and Space Administration(NASA)is striving to make its Moon to Mars effort a collaborative endeavor for long-term human exploration of deep space and for the international space community. The agency is making great strides in unifying its workforce, mission directorates, technical authorities, and centers behind shared goals and processes. Enhanced communication and a reinvigoration of systems engineering ideals have been a hallmark of that effort, guided by the Moon to Mars Architecture, which defines what NASA aims to accomplish and how it will execute those goals. This interdisciplinary approach ensures the Artemis campaign supports NASA’s engineering, science, and technology development goals. As of September 2024, over 43 nations have signed the Artemis Accords, which establish a common set of principles for peaceful cooperation in civil space exploration. Building off these efforts, NASA has been engaging in separate and distinct discussions about partner contributions to Artemis. International partnerships for the Artemis campaign include long-standing partners as well as agencies with which NASA has only more recently begun collaborating. The Gateway Program is an early example of both –benefitting from partnerships with Canada, Japan, and Europe forged though decades of cooperation on the International Space Station, as well as a new partnership with the United Arab Emirates. The agency’s Moon to Mars Objectives and Architecture unify the NASA workforce with common goals and shared systems-engineering processes. The architecture offers pathways for broader participation from industry, academia, and international partners. The agency evolves this collaborative approach through its annual Architecture Concept Review cycle, seeking input from the NASA workforce, and through workshops, from industry, academia, and the international space community to refine NASA’s roadmap for exploration. Exploring together, NASA and its partners are setting humanity on the path to long-term presence at the Moon and our eventual journey to Mars

Objective↗

NASA NTRSDate not supplied

Computer Vision Dataset for Aircraft Taxi Operations

The development and democratization of computer vision algorithms are contingent on the availability of high-quality datasets. In this paper, we introduce a database of forward-facing videos from taxiing aircraft as well as the time-correlated flight data at approximately 1 to10 Hz containing aircraft state data and environmental conditions. The video data is sourced from the National Aeronautics and Space Administration Airborne Science Program archive and includes over 33 hours of 4k, 1080p, and 720p video from twenty-two airports around the world. This paper describes the method of the database construction and a brief analysis of its contents.

Ryan Horn↗

NASA NTRSDate not supplied

Distributed Vision Sensing of Small Uncrewed Aircraft Systems in Urban Traffic Corridors

The NASA Advanced Air Mobility mission will enable widespread low altitude passenger travel, cargo delivery, and a variety of public services through the development of Uncrewed Aerial Systems (UAS) operations. Ensuring safe, autonomous operations in densely populated environments requires careful consideration towards hazards including other aircraft, infrastructure, and evolving weather. Small Uncrewed Aerial Systems (SUAS) present a unique hazard to UAS operations as they share airspace and may be readily operated in a non-cooperative fashion. This work investigates distributed sensing of SUAS traversing an air traffic corridor in an urban setting. This work develops a distributed vision detect and track strategy at NASA Langley Research Center. Three nodes, each with at least one global shutter camera, are distributed around a traffic corridor to surveil flight operations for two SUAS performing low altitude flight operations. Each node is equipped with a GPS and cellular modem to enable timestamping and remote control of acquisition. Node one faces a traffic roundabout with buildings in the background and achieves 99% surveillance coverage for two SUAS against building and tree backgrounds at ranges 50 to 130m. The second node points down Langley Boulevard with trees and buildings in the background and achieves 99% coverage at separation distances between 70 and 180m. The analysis for the second node is limited to ranges below 180m due to low contrast against dark, tree backgrounds. Finally, the third node points down Langley Boulevard from another perspective and achieves 99% coverage at ranges 60m to 200m against mostly building with a few sections of trees in the background.

Chester V Dolph↗

DOE OSTI2014

Shielding Analyses for VISION Beam Line at SNS

Full-scale neutron and gamma transport analyses were performed to design shielding around the VISION beam line, instrument shielding enclosure, beam stop, secondary shutter including a temporary beam stop for the still closed neighboring beam line to meet requirement is to achieve dose rates below 0.25 mrem/h at 30 cm from the shielding surface. The beam stop and the temporary beam stop analyses were performed with the discrete ordinate code DORT additionally to Monte Carlo analyses with the MCNPX code. Comparison of the results is presented.

Popova, Irina↗

DOE OSTI2015

A Vision for Systems Engineering Applied to Wind Energy (Presentation)

This presentation was given at the Third Wind Energy Systems Engineering Workshop on January 14, 2015. Topics covered include the importance of systems engineering, a vision for systems engineering as applied to wind energy, and application of systems engineering approaches to wind energy research and development.

17 WIND ENERGY↗