Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “machine vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
NASA NTRS2010

Fast Solution in Sparse LDA for Binary Classification

An algorithm that performs sparse linear discriminant analysis (Sparse-LDA) finds near-optimal solutions in far less time than the prior art when specialized to binary classification (of 2 classes). Sparse-LDA is a type of feature- or variable- selection problem with numerous applications in statistics, machine learning, computer vision, computational finance, operations research, and bio-informatics. Because of its combinatorial nature, feature- or variable-selection problems are NP-hard or computationally intractable in cases involving more than 30 variables or features. Therefore, one typically seeks approximate solutions by means of greedy search algorithms. The prior Sparse-LDA algorithm was a greedy algorithm that considered the best variable or feature to add/ delete to/ from its subsets in order to maximally discriminate between multiple classes of data. The present algorithm is designed for the special but prevalent case of 2-class or binary classification (e.g. 1 vs. 0, functioning vs. malfunctioning, or change versus no change). The present algorithm provides near-optimal solutions on large real-world datasets having hundreds or even thousands of variables or features (e.g. selecting the fewest wavelength bands in a hyperspectral sensor to do terrain classification) and does so in typical computation times of minutes as compared to days or weeks as taken by the prior art. Sparse LDA requires solving generalized eigenvalue problems for a large number of variable subsets (represented by the submatrices of the input within-class and between-class covariance matrices). In the general (fullrank) case, the amount of computation scales at least cubically with the number of variables and thus the size of the problems that can be solved is limited accordingly. However, in binary classification, the principal eigenvalues can be found using a special analytic formula, without resorting to costly iterative techniques. The present algorithm exploits this analytic form along with the inherent sequential nature of greedy search itself. Together this enables the use of highly-efficient partitioned-matrix-inverse techniques that result in large speedups of computation in both the forward-selection and backward-elimination stages of greedy algorithms in general.

Moghaddam, Baback↗
NASA NTRSDate not supplied

Improving Sim-to-Real Transfer in Vision-Based Robot Navigation Via Instance-Level GAN-Based Data Augmentation

Achieving robust vision-based robotic tasks requires large amounts of data, which are often difficult to obtain in real-world scenarios. Simulators and synthetic data offer a cost-effective alternative, but the visual gap between simulation and reality hinders the performance of models when deployed in real-world environments. In this paper, we present a data augmentation pipeline that integrates a foundation model (Segment Anything Model) with an unsupervised image-to-image translation model (CycleGAN) for instance-level domain transfer from simulation to reality. This pipeline enables the generation of realistic labeled data from synthetic images for training supervised machine learning models in vision-based navigation tasks. We evaluate our approach on real-world data for ego-vehicle pose estimation, a critical autonomous navigation task involving the prediction of cross-track position and heading angle relative to road center line markings. The results of our tests show that our GAN-based data augmentation pipeline significantly outperforms models trained solely on simulation data or on data processed with standard image augmentation methods for sim-to-real transfer, enhancing model robustness and generalizability in real-world scenarios. Our method provides a scalable and flexible data augmentation tool for leveraging large synthetic datasets to enhance vision-based robotic navigation tasks.

artificial intelligence↗
NASA NTRS2024

EdgeCortix SAKURA-I Machine-Learning, PCIe Accelerator SEE Heavy Ion Test Report

To enable autonomy in space, machine-learning and computer vision applications become invaluable for sensor processing. However, these algorithms are computationally complex and unfeasible for many embedded central processing units (CPUs) and usually require external coprocessors, such as graphics processing units (GPUs) or accelerators specific to the application, including application specific integrated circuits (ASICs). In power-constrained systems, GPUs tend to consume more power than is acceptable (>40W), so lower-power accelerators have shown promise to provide the performance needed under spacecraft constraints. For radiation engineers, developing methodologies that can properly test CPUs, GPUs, and accelerators, and enable comparisons between them remains a necessary complication to solve as the devices become more complex. The methodology in this test aims to be a start in developing a baseline single-event effect (SEE) test for client-device machine learning accelerators. This category of devices do not host their own operating system. This testing campaign is a continuation of a previous 200 MeV proton test performed in January 2024. This report covers two heavy ion tests of the SAKURA-I card: one in April 2024, and one in June 2024. Additional data was needed after the April test due to ion-range issues experienced at higher linear-energy transfers (LETs). These range issues are described in more detail in Section 8. This experiment characterizes SEEs and data error susceptibility of the EdgeCortix SAKURA-I machine-learning accelerator under heavy ions. The device was monitored for single event upsets (SEUs) and single event functional interrupts (SEFIs) at the Lawrence Berkeley National Laboratory’s 88-inch cyclotron. The SAKURA-I board accelerates machine-learning inference applications on a host computer through a PCIex16 connection. For the purposes of devising an end to end automated analysis workflow for this experiment, the YOLO-V5 and SSD300 objection-detection models, and the ResNet-50, EfficientNet, and MobileNetV2 image classification models were used as a representative suite of analytical machine-learning models.

Seth S Roffe↗
NASA NTRS2024

Search Technology for Optimal Rescue Missions (STORM)

Natural disasters, such as earthquakes, hurricanes, and wildfires are responsible for the deaths of 60,000 to 90,000 people per year. Today, search and rescue (SAR) operations heavily rely on humans to find and deliver life-saving supplies to those affected by these disasters. However, these operations have limits in visibility, navigation, communication systems, and data availability in the area affected, as well as endangering the SAR personnel. Search Technology for Optimal Rescue Missions (STORM) discusses a new system for SAR teams using autonomous drones able to find and deliver supplies to people, without risking more lives in the process. The concept includes the use of two drone types, STORM Search and STORM Rescue, which will survey and locate survivors and be able to drop equipment to the survivors identified, respectively. These two types of drones were optimized in drone design and durability (such as the use of dihedral wings and a toroidal propeller), detection and navigation systems (sturdy thermal and Light Detection and Ranging [LiDAR] cameras), automation and system design (Machine Learning and Computer Vision), server-drone communication (Meshnets), weight, and cost. Once implemented, the STORM concept is expected to improve, ease, and speed up SAR operations, and most important of all, rescue lives that would have never been currently possible to find.

Astha Ingole↗
NASA NTRS1990

Pyramid image codes

All vision systems, both human and machine, transform the spatial image into a coded representation. Particular codes may be optimized for efficiency or to extract useful image features. Researchers explored image codes based on primary visual cortex in man and other primates. Understanding these codes will advance the art in image coding, autonomous vision, and computational human factors. In cortex, imagery is coded by features that vary in size, orientation, and position. Researchers have devised a mathematical model of this transformation, called the Hexagonal oriented Orthogonal quadrature Pyramid (HOP). In a pyramid code, features are segregated by size into layers, with fewer features in the layers devoted to large features. Pyramid schemes provide scale invariance, and are useful for coarse-to-fine searching and for progressive transmission of images. The HOP Pyramid is novel in three respects: (1) it uses a hexagonal pixel lattice, (2) it uses oriented features, and (3) it accurately models most of the prominent aspects of primary visual cortex. The transform uses seven basic features (kernels), which may be regarded as three oriented edges, three oriented bars, and one non-oriented blob. Application of these kernels to non-overlapping seven-pixel neighborhoods yields six oriented, high-pass pyramid layers, and one low-pass (blob) layer.

Watson, Andrew B.↗
NASA NTRS2019

Enabling Real-time Multi-messenger Astrophysics Discoveries with Deep Learning

Multi-messenger astrophysics is a fast-growing, interdisciplinary field that combines data, which vary in volume and speed of data processing, from many different instruments that probe the Universe using different cosmic messengers: electromagnetic waves, cosmic rays, gravitational waves and neutrinos. In this Expert Recommendation, we review the key challenges of real-time observations of gravitational wave sources and their electromagnetic and astroparticle counterparts, and make a number of recommendations to maximize their potential for scientific discovery. These recommendations refer to the design of scalable and computationally efficient machine learning algorithms; the cyber-infrastructure to numerically simulate astrophysical sources, and to process and interpret multi-messenger astrophysics data; the management of gravitational wave detections to trigger real-time alerts for electromagnetic and astroparticle follow-ups; a vision to harness future developments of machine learning and cyber-infrastructure resources to cope with the big-data requirements; and the need to build a community of experts to realize the goals of multi-messenger astrophysics.

E A Huerta↗
NASA NTRS1975

Man-machine interactive imaging and data processing using high-speed digital mass storage

The role of vision in teleoperation has been recognized as an important element in the man-machine control loop. In most applications of remote manipulation, direct vision cannot be used. To overcome this handicap, the human operator's control capabilities are augmented by a television system. This medium provides a practical and useful link between workspace and the control station from which the operator perform his tasks. Human performance deteriorates when the images are degraded as a result of instrumental and transmission limitations. Image enhancement is used to bring out selected qualities in a picture to increase the perception of the observer. A general purpose digital computer, an extensive special purpose software system is used to perform an almost unlimited repertoire of processing operations.

Alsberg, H.↗
NASA NTRS1991

Welding technology transfer task/laser based weld joint tracking system for compressor girth welds

Sensors to control and monitor welding operations are currently being developed at Marshall Space Flight Center. The laser based weld bead profiler/torch rotation sensor was modified to provide a weld joint tracking system for compressor girth welds. The tracking system features a precision laser based vision sensor, automated two-axis machine motion, and an industrial PC controller. The system benefits are elimination of weld repairs caused by joint tracking errors which reduces manufacturing costs and increases production output, simplification of tooling, and free costly manufacturing floor space.

Looney, Alan↗
NASA NTRS2017

NASA Centennial Challenge: Three Dimensional (3D) Printed Habitat, Phase 2

The NASA Centennial Challenges: 3D-Printed Habitat Challenge seeks to develop the fundamental technologies necessary to manufacture an off-world habitat using mission recycled materials and/or local indigenous materials. The vision is that autonomous habitat manufacturing machines will someday be deployed to the Moon or Mars to construct shelters for human habitation. NASA and Bradley University, are holding a new US$ 2.5 million competition to design and build a 3-D printed habitat for deep space exploration, including the agency's journey to Mars. The multi-phase 3-D Printed Habitat Challenge, part of NASA's Centennial Challenges program, is designed to advance the additive construction technology needed to create sustainable housing solutions for Earth and beyond. The first phase of the competition ran through Sept. 27, 2015. This phase, a design competition, called on participants to develop state-of-the-art architectural concepts that take advantage of the unique capabilities 3-D printing offers. The top 3 prizes with a prize purse of $40,000 were awarded at the 2015 World Maker Faire in New York. The second phase of the competition is called the Structural Member Competition and it is divided into three levels happening in the spring and summer of 2017. The Compression Test Competition (Level 1) focuses on the fabrication technologies needed to manufacture structural components from a combination of indigenous materials and recyclables, or indigenous materials alone. For Level 1, teams will develop 3D printable materials, build a 3D printing machine, and print two specimens: a truncated cone and a cylinder. The Level 2 Beam Member Competition is the second of three sub-competitions within the overall Structural Member Competition. For Level 2, teams will print a beam that will be tested. The Level 3 Head to Head Competition is the third of three sub-competitions within the overall Structural Member Competition. For Level 3, teams will develop 3D printable materials, use a 3D printing machine, and print three compression specimens of the elected material, three flexural specimens of the elected material, and one dome structure. Tests conducted on the specimens and the dome structure will determine Level 3 scores and awards. On Earth these same habitat manufacturing capabilities could be used to produce housing wherever affordable housing is needed and access to conventional building materials and skills is limited. Terrestrially, it is envisioned that local indigenous materials (dirt, clay, sand, etc.) could be combined with readily available recyclable materials and used to construct semi-permanent shelters against environmental elements for human habitation. The goal of the 3D-Printed Habitat Challenge is to foster the development of new technologies necessary to additively manufacture a habitat using local indigenous materials with, or without, recyclable materials. This paper will summarize the Level 2 results of this NASA Centennial Challenge competition and it will discuss related technology advancement.

3D printing↗
NASA NTRSDate not supplied

Impact Ice Microstructure Segmentation Using Transfer Learned Model

A process of using machine learning to segment impact ice microstructure is presented and analyzed. The segmentation was conducted with the goal of obtaining average grain size estimations. The model was trained on a set of micrographs of impact ice grown at NASA Glenn’s Icing Research Tunnel. The model leveraged a model pre-trained on a large set of micrographs of various materials as a starting point. Post-processing of the segmented images was done to connect broken boundaries. An automatic method of determining grain size following an ASTM standard was implemented. Segmentation results using different training sets as well as different encoder and decoder pairs are presented. Calculated sizes are compared to manual grain size measurement methods. Results show promise in accuracy as well as a possible improvement in repeatability and consistency. Next steps for improving the model are suggested.

Machine learning↗
NASA NTRS2021

Future Model-Based Systems Engineering Vision and Strategy Bridge for NASA

A vision for the future of model-based systems engineering (MBSE) at NASA in 2029 and a strategy bridge towards that future are presented. Strategic thinking and leading change concepts were used to analyze reports and presentations on global trends and visionary thinking about the future of systems and digital engineering. The context, strategic time horizon, stakeholders, strategic challenges, strategic advantages, driving forces, and opportunities were considered. The analysis resulted in a future vision of MBSE that shows what NASA systems engineers and digital machines will do to perform rapid, extraordinary, and unprecedented missions. The NASA systems engineer, in this future vision, works with a global project team in a virtual and collaborative environment, engineers the system, and uses digital approaches as the routine and default way of working. The digital machines provide data-driven and automated mission designs; have a backbone of program and project management, systems engineering, and product life-cycle management; and are a knowledge-sharing infrastructure. The NASA systems engineer and the systems engineering team are envisioned to use digital machines to plan and perform rapid exploration missions, develop a digital twin that lasts across the life cycle, and develop enduring and adaptable systems. NASA has an engineering enterprise and a life-cycle management framework that endure, adapt, and respond. A strategy bridge based on the Baldrige Criteria for Performance Excellence Framework and lessons learned from a recent MBSE initiative illuminates a way forward from today to this desired future. The bridge lays out a strategy for leaders and recommends investments of today for immediate benefits and for benefits in 2029.

model-based systems engineering, digital engineeri↗
NASA NTRS1991

Human factors issues in the use of night vision devices

An account is given of the critical human factors that arise in field data on the differences between night vision displays and unaided day vision. Attention is given to the findings of empirical studies of performance on rotorcraft-flight-relevant perceptual tasks in which depth and distance perception are critical factors. Suggestions are made for man-machine-critical component design modifications in current night vision systems.

Kaiser, Mary K.↗
NASA NTRS1987

Some vision algorithms

The ability to determine the contents of a scene by a machine has obvious applications. There are reasons for seeking horizontal, vertical and diagonal line segments of varying lengths in order to interpret the content of a scene. Such line segments aid in determining edges that determine the boundaries of objects within the scene. Algorithms for each of the above as well as for data compacting are presented.

Johnson, Gordon G.↗
NASA NTRS1992

Operator vision aids for space teleoperation assembly and servicing

This paper investigates concepts for visual operator aids required for effective telerobotic control. Operator visual aids, as defined here, mean any operational enhancement that improves man-machine control through the visual system. These concepts were derived as part of a study of vision issues for space teleoperation. Extensive literature on teleoperation, robotics, and human factors was surveyed to definitively specify appropriate requirements. This paper presents these visual aids in three general categories of camera/lighting functions, display enhancements, and operator cues. In the area of camera/lighting functions concepts are discussed for: (1) automatic end effector or task tracking; (2) novel camera designs; (3) computer-generated virtual camera views; (4) computer assisted camera/lighting placement; and (5) voice control. In the technology area of display aids, concepts are presented for: (1) zone displays, such as imminent collision or indexing limits; (2) predictive displays for temporal and spatial location; (3) stimulus-response reconciliation displays; (4) graphical display of depth cues such as 2-D symbolic depth, virtual views, and perspective depth; and (5) view enhancements through image processing and symbolic representations. Finally, operator visual cues (e.g., targets) that help identify size, distance, shape, orientation and location are discussed.

Brooks, Thurston L.↗
NASA NTRS1994

Confessions of a robot lobotomist

Since its inception, numerically controlled (NC) machining methods have been used throughout the aerospace industry to mill, drill, and turn complex shapes by sequentially stepping through motion programs. However, the recent demand for more precision, faster feeds, exotic sensors, and branching execution have existing computer numerical control (CNC) and distributed numerical control (DNC) systems running at maximum controller capacity. Typical disadvantages of current CNC's include fixed memory capacities, limited communication ports, and the use of multiple control languages. The need to tailor CNC's to meet specific applications, whether it be expanded memory, additional communications, or integrated vision, often requires replacing the original controller supplied with the commercial machine tool with a more powerful and capable system. This paper briefly describes the process and equipment requirements for new controllers and their evolutionary implementation in an aerospace environment. The process of controller retrofit with currently available machines is examined, along with several case studies and their computational and architectural implications.

Gottshall, R. Marc↗
NASA NTRS2007

Launching to the Moon, Mars, and Beyond

America is returning to the Moon in preparation for the first human footprint on Mars, guided by the U.S. Vision for Space Exploration. This presentation will discuss NASA's mission today, the reasons for returning to the Moon and going to Mars, and how NASA will accomplish that mission. The primary goals of the Vision for Space Exploration are to finish the International Space Station, retire the Space Shuttle, and build the new spacecraft needed to return people to the Moon and go to Mars. Unlike the Apollo program of the 1960s, this phase of exploration will be a journey, not a race. In 1966, the NASA's budget was 4 percent of federal spending. Today, with 6/10 of 1 percent of the budget, NASA must incrementally develop the vehicles, infrastructure, technology, and organization to accomplish this goal. Fortunately, our knowledge and experience are greater than they were 40 years ago. NASA's goal is a return to the Moon by 2020. The Moon is the first step to America's exploration of Mars. Many questions about the Moon's history and how its history is linked to that of Earth remain even after the brief Apollo explorations of the 1960s and 1970s. This new venture will carry more explorers to more diverse landing sites with more capable tools and equipment. The Moon also will serve as a training ground in several respects before embarking on the longer, more perilous trip to Mars. The journeys to the Moon and Mars will require a variety of vehicles, including the Ares I Crew Launch Vehicle, the Ares V Cargo Launch Vehicle, the Orion Crew Exploration Vehicle, and the Lunar Surface Access Module. The architecture for the lunar missions will use one launch to ferry the crew into orbit on the Ares I and a second launch to orbit the lunar lander and the Earth Departure Stage to send the lander and crew vehicle to the Moon. In order to reach the Moon and Mars within a lifetime and within budget, NASA is building on proven hardware and decades of experience derived from the Apollo Saturn, Space Shuttle, and contemporary commercial launch vehicle programs. Less than one year after the Exploration Launch Projects Office was formed at NASA's Marshall Space Flight Center, engineers are testing engine components, firing test rocket motors, refining vehicle designs in wind tunnel tests, and building hardware for the first flight test of Ares I, scheduled for spring 2009. The Vision for Exploration will require this nation to develop tools, machines, materials, and processes never before invented, technologies and capabilities that can be turned over to the private sector to benefit nearly all aspects of life on Earth. This new pioneering venture, as did the Apollo Program before it, will contribute to America's economic leadership, national security, and technological global competitiveness and serve as an inspiration for all its citizens.

Sumrall, John P.↗