Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “machine vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Meta-optic accelerators for object classifiers

Rapid advances in deep learning have led to paradigm shifts in a number of fields, from medical image analysis to autonomous systems. These advances, however, have resulted in digital neural networks with large computational requirements, resulting in high energy consumption and limitations in real-time decision-making when computation resources are limited. Here, we demonstrate a meta-optic–based neural network accelerator that can off-load computationally expensive convolution operations into high-speed and low-power optics. In this architecture, metasurfaces enable both spatial multiplexing and additional information channels, such as polarization, in object classification. End-to-end design is used to co-optimize the optical and digital systems, resulting in a robust classifier that achieves 93.1% accurate classification of handwriting digits and 93.8% accuracy in classifying both the digit and its polarization state. This approach could enable compact, high-speed, and low-power image and information processing systems for a wide range of applications in machine vision and artificial intelligence.

42 ENGINEERING↗
DOE OSTI2022

To image, or not to image: class-specific diffractive cameras with all-optical erasure of undesired objects

Abstract Privacy protection is a growing concern in the digital era, with machine vision techniques widely used throughout public and private settings. Existing methods address this growing problem by, e.g., encrypting camera images or obscuring/blurring the imaged information through digital algorithms. Here, we demonstrate a camera design that performs class-specific imaging of target objects with instantaneous all-optical erasure of other classes of objects. This diffractive camera consists of transmissive surfaces structured using deep learning to perform selective imaging of target classes of objects positioned at its input field-of-view. After their fabrication, the thin diffractive layers collectively perform optical mode filtering to accurately form images of the objects that belong to a target data class or group of classes, while instantaneously erasing objects of the other data classes at the output field-of-view. Using the same framework, we also demonstrate the design of class-specific permutation and class-specific linear transformation cameras, where the objects of a target data class are pixel-wise permuted or linearly transformed following an arbitrarily selected transformation matrix for all-optical class-specific encryption, while the other classes of objects are irreversibly erased from the output image. The success of class-specific diffractive cameras was experimentally demonstrated using terahertz (THz) waves and 3D-printed diffractive layers that selectively imaged only one class of the MNIST handwritten digit dataset, all-optically erasing the other handwritten digits. This diffractive camera design can be scaled to different parts of the electromagnetic spectrum, including, e.g., the visible and infrared wavelengths, to provide transformative opportunities for privacy-preserving digital cameras and task-specific data-efficient imaging.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Exploiting universal nonlocal dispersion in optically active materials for spectro-polarimetric computational imaging

Recent years have seen significant advancements in exploring novel light-matter interactions such as hyperbolic dispersion within natural crystals. However, current studies have predominantly concentrated on local optical response of materials characterized by a dielectric tensor without spatial dispersion. Here, we investigate the nonlocal response in optically-active crystals with screw symmetries, revealing their lossless, super-dispersive properties compared to traditional optical response functions. We leverage this universal nonlocal dispersion, i.e. the dispersion of optical rotatory power, to explore a novel spectral de-multiplexing scheme compared to conventional gratings, prisms and metasurfaces. We design and demonstrate an ‘Nonlocal-Cam’ - a camera that exploits nonlocal dispersion through sampling of polarized spectral states and the application of computational spectral reconstruction algorithms. The Nonlocal-Cam captures information in both laboratory and outdoor field experiments which is unavailable to traditional intensity cameras - the spectral texture of polarization. Merging the fields of nonlocal electrodynamics and computational imaging, our work paves the way for exploiting nonlocal optics of optically active materials in a variety of applications, from biological microscopy to physics-driven machine vision and remote sensing.

Wang, Xueji [Purdue Univ., West Lafayette, IN (Uni↗
DOE OSTI2022

Radiographic Imaging and Tomography

Radiographic imaging and tomography (RadIT) come in many flavors such as X-ray imaging and tomography (IT), proton IT, neutron IT, muon IT, neutrino IT, etc. We identify five RadIT themes: Physics, Sources, Detectors, Methods, and Data Science, which are integral parts of image interpretation and three-dimensional (3D) tomographic reconstruction. Traditionally, RadIT have been driven by medicine, non-destructive testing, material sciences, and security applications. The latest thrusts of growth come from automation, machine vision, additive manufacturing and virtual reality (‘metaverse’). The five RadIT themes parallel their counterparts in optical IT. Synergies among different forms of RadIT and with optical IT motivate further advances towards multi-modal IT and quantum IT.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Porosity Determination and Classification of Laser Powder Bed Fusion AlSi10Mg Dogbones Using Machine Learning [Slides]

Angular pores (lack of fusion) pores are more detrimental to the health of the part due to induced stress concentrations. Three types of porosity found in AM parts: keyhole porosity, gas porosity, and lack of fusion porosity. In this research, we address the question, "Which machine learning and/or machine vision techniques work best to segment porosity and determine the type of porosity observed in the sample?"

42 ENGINEERING↗
DOE OSTI2022

Autonomous Aerial Power Plant Inspection in GPS-denied Environments

Inspection of coal-fired power plants is frequently dangerous, includes difficult places to reach, and can turn expensive due to the downtimes and cost of inspection crew. Robotic systems have shown capabilities to address some of these issues, but most of the current robotic inspection technology in power plants is designed for specific components. Conversely, recent advances in machine vision have empowered aerial platforms for long-range, remotely-controlled, GPS-based inspections of industrial plants. This capability has led to wide spread utilization of aerial robots (commonly termed Drones, UVS or UAS) platforms for inspection in less challenging environments where both collision avoidance, and GPS reception are not significant issues. The challenge in adapting airborne technology for power plant inspection lies in internal structures and the complex network of piping, and distribution systems, which impose significant risks for collision and can hinder the reception and transmission of GPS signals. The current state of the art in aerial inspection technology within the energy sector is controlled via radio control, and utilizes GPS-based navigation, for inspection of large-scale plants such as offshore platforms and wind turbine parks. Nevertheless, close-range and autonomous inspection in the GPS-denied environments of power plants has not yet been achieved, as it requires precise guidance and navigation with real-time situational awareness and obstacle avoidance capabilities. This endeavor introduced the use of rotary wing flying robots, due to their station keeping and vertical take-off capabilities for power plant components inspection. To enable close quarter inspection two methods were used. One method uses the 3D CAD (Three-dimensional Computer-Aided Design) model of the asset to inspect to generate the UAV’s inspection path. To acquire, analyze and process the 3D model, first, the STL file is produced to obtain surface points and vectors normal to the surface. Later, by introducing other variables such as wall offset and a controlled trajectory between each outline and each subsequent layer, the flight path is generated. The proposed framework will generate a path that will pass as close as desired from the surface and navigate in intricate environments. A second method, use advanced manufacturing techniques such as CNC (Computer Numerical Control) and additive manufacturing. Once the inspection flight path is obtained, vision-based navigation systems are employed to have the UAV autonomously tracking the provided trajectory. Finally, Artificial Intelligence-enabled developments are in charge of detecting cracks and corrosion in structural components of power plants. The proposed methods are validated in simulations, laboratory and industrial setups, where it is shown that the developed systems acting together enable close-quarter autonomous aerial inspection and mapping in power plant assets. The system can be further improved by adding more sensors to navigate in different GPS-denied environments, with non-homogeneous lighting conditions, dust and in general situations where vision-based systems may fail.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2021

SIS-AOP Cueing/Segmenting Algorithm (FOA_SIS-AOP) Using the Sandia FOA 4.0 Framework

For machine vision, one of the most important operations is fast and effective object cueing or segmentation. Sandia National Labs has a long history of development and implementation of very fast and effective cueing/segmentation algorithms. This report covers the history, motivation and implementation of evolving frameworks (Sandia FOA Frameworks) upon which this long legacy of successful algorithms are built. The report describes the innovative microprocessor implementation, enabling extremely fast morphological processing, combined with a novel adaptive quantization front - end and a feature - based backend that resulted in Sandia developing fast and effective cueing in a wide variety of applications, from defect detection to SAR ATR. The report covers evolution from Sandia FOA 1.0 Framework (1995) to current Sandia FOA 4.0 Framework (2021). Requirements for the cueing algorithm for SIS - AOP (FOA_SIS - AOP) that drove the Sandia FOA 4.0 Framework development are discussed, along with information on how to use the Sandia FOA Frameworks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Machine Learning for Predictive Performance Analysis in Charged Particle Beam Tools

Imaging methods driven by probes, electrons, and ions have played a dominant role in modern science and engineering. Opportunities for machine vision and AI that focus on consumer problems like driving and feature recognition, are now presenting themselves for automating aspects of the scientific processes. This proposal aims to enable and drive discovery in ultra-low energy implantation by taking advantage of faster processing, flexible control and detection methods, and architecture-agnostic workflows that will result in higher efficiency and shorter scientific development cycles. Custom microscope control, collection and analysis hardware will provide a framework for conducting novel in situ experiments revealing unprecedented insight into surface dynamics at the nanoscale. Ion implantation is a key capability for the semiconductor industry. As devices shrink, novel materials enter the manufacturing line, and quantum technologies transition to being more mainstream. Traditional implantation methods fall short in terms of energy, ion species, and positional precision. Here we demonstrate 1 keV focused ion beam Au implantation into Si and validate the results via atom probe tomography. We show the Au implant depth at 1 keV is 0.8 nm and that identical results for low energy ion implants can be achieved by either lowering the column voltage, or decelerating ions using bias – while maintaining a sub-micron beam focus. We compare our experimental results to static calculations using SRIM and dynamic calculations using binary collision approximation codes TRIDYN and IMSIL. A large discrepancy between the static and dynamic simulation is found that is due to lattice enrichment with high stopping power Au and surface sputtering. Additionally, we demonstrate how model details are particularly important to the simulation of these low-energy heavy-ion implantations. Finally, we discuss how our results pave a way to much lower implantation energies, while maintaining high spatial resolution.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

The VIBES Are Shifting: Assessing Emergent Capabilities in Multi-Modal Models

Researchers assessing open-source domains such as the internet, and particularly those studying information conflict, often have no single prescribed workflow. In the course of their research, they may need to perform a diverse array of tasks far beyond simply identifying an ever-changing set of objects. These analytical tasks can include ascertaining the provenance of images, understand an image in the context of accompanying text-based data, or identifying indicators of digital image manipulation. They must further be able to do this at the scale of tens of thousands of images or more. Traditional machine vision models have typically lacked the flexibility and breadth of performance sufficient for these needs. The research team from Pacific Northwest National Laboratory assessed the performance of a single baseline CLIP ViT-L model against a series of analytical tasks relevant for the study of online information conflict.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Automatic Image Point Matching

Sparse Image Point Matching (SIPM) is a foundational technology for photo triangulation, structure from motion (SfM), Simultaneous Location and Mapping (SLAM), and data fusion. The goal of the matching is to automatically generate sets of image coordinates that identify the same feature across images. Ideally, the process should be robust to lighting, scale, perspective, and modality changes. The scope of the image matching topic in the field of remote sensing (RS) is enormous because of the variety of collection platforms, modalities, sensor types, applications, and subjects. In this work, we report the history of and assess the state of the art of visible-spectrum (panchromatic and color) image matching of the Earth’s surface. Work specific to large-format images (LFI) (e.g., metric aerial cameras and Earth-observing satellites) will be highlighted. However, the state of the art in this century will mostly be traced through machine vision research and benchmarks because research specific to LFI is rare.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Measurements of Density of Liquid Oxides with an Aero-Acoustic Levitator

Densities of liquid oxide melts with melting temperatures above 2000 °C are required to establish mixing models in the liquid state for thermodynamic modeling and advanced additive manufacturing and laser welding of ceramics. Accurate measurements of molten rare earth oxide density were recently reported from experiments with an electrostatic levitator on board the International Space Station. In this work, we present an approach to terrestrial measurements of density and thermal expansion of liquid oxides from high-speed videography using an aero-acoustic levitator with laser heating and machine vision algorithms. The following density values for liquid oxides at melting temperature were obtained: Y 2 O 3 4.6 ± 0.15; Yb 2 O 3 8.4 ± 0.2; Zr 0.9 Y 0.1 O 1.95 4.7 ± 0.2; Zr 0.95 Y 0.05 O 1.975 4.9 ± 0.2; HfO 2 8.2 ± 0.3 g/cm 3 . The accuracy of density and thermal expansion measurements can be improved by employing backlight illumination, spectropyrometry and a multi-emitter acoustic levitator.

36 MATERIALS SCIENCE↗
NASA NTRS1986

Detector Arrays With Image-Plane Processing

Image detection and edge processing merged on same VLSI chip. Concept combines relatively large detector with small processor elements as VLSI chip features and has many specific embodiments. New device concept retains relatively large detector element sizes (perhaps 10 to 100 micrometers or larger in diameter) with processing-electronics components of much smaller size (2 micrometers or less), filling in gaps left between detectorelement active areas. Detector-array device helps to perform difference-ofGaussian operation for use in machine-vision edge enhancement and edge detection.

Jobson, D. J.↗
NASA NTRS1986

Automation and robotics for Space Station in the twenty-first century

Space Station telerobotics will evolve beyond the initial capability into a smarter and more capable system as we enter the twenty-first century. Current technology programs including several proposed ground and flight experiments to enable development of this system are described. Advancements in the areas of machine vision, smart sensors, advanced control architecture, manipulator joint design, end effector design, and artificial intelligence will provide increasingly more autonomous telerobotic systems.

Willshire, K. F.↗
NASA NTRS1985

Remotely manipulated and autonomous robotic welding fabrication in space

The results of a NASA sponsored study, performed in order to establish the feasibility of remotely manipulated or unmanned welding fabrication systems for space construction, are presented. Possible space welding fabrication tasks and operational modes are classified and the capabilities and limitations of human operators and machines are outlined. Human performance in remote welding tasks was experimentally tested under the sensing and actuation constraints imposed by remote manipulation in outer space environments. Proposals for the development of space welding technology are made and necessary future R&D efforts are identified. The development of improved visual sensing strategies and computer encoding of the human welding engineering expertise are identified as essential, both for human operator assistance and for autonomous operation in all phases of welding fabrication. Novel uses of machine vision for the determination of the weld joint and bead geometry are proposed, and a prototype of a rule-based expert system is described for the interpretation of the visually detected weld features and defects.

Agapakis, J. E.↗
NASA NTRS1987

Computing 3-D structure of rigid objects using stereo and motion

Work performed as a step toward an intelligent automatic machine vision system for 3-D imaging is discussed. The problem considered is the quantitative 3-D reconstruction of rigid objects. Motion and stereo are the two clues considered in this system. The system basically consists of three processes: the low level process to extract image features, the middle level process to establish the correspondence in the stereo (spatial) and motion (temporal) modalities, and the high level process to compute the 3-D coordinates of the corner points by integrating the spatial and temporal correspondences.

Nguyen, Thinh V.↗
NASA NTRS1988

The 1988 Goddard Conference on Space Applications of Artificial Intelligence

This publication comprises the papers presented at the 1988 Goddard Conference on Space Applications of Artificial Intelligence held at the NASA/Goddard Space Flight Center, Greenbelt, Maryland on May 24, 1988. The purpose of this annual conference is to provide a forum in which current research and development directed at space applications of artificial intelligence can be presented and discussed. The papers in these proceedings fall into the following areas: mission operations support, planning and scheduling; fault isolation/diagnosis; image processing and machine vision; data management; modeling and simulation; and development tools/methodologies.

Rash, James↗
NASA NTRS1987

The Flight Telerobotic Servicer (FTS) - A focus for automation and robotics on the Space Station

The concept, fundamental design principles, and capabilities of the FTS, a multipurpose telerobotic system for use on the Space Station and Space Shuttle, are discussed. The FTS is intended to assist the crew in the performance of extravehicular tasks; the telerobot will also be used on the Orbital Maneuvering Vehicle to service free-flyer spacecraft. The FTS will be capable of both teleoperation and autonomous operation; eventually it may also utilize ground control. By careful selection of the functional architecture and a modular approach to the hardware and software design, the FTS can accept developments in artificial intelligence and newer, more advanced sensors, such as machine vision and collision avoidance.

Hinkal, Sanford W.↗