Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Vision transformers”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Solving The Space Weather Problem: A 15+ Year Roadmap to Revolutionize Space Weather Research, Protect NASA Space Assets, and Enable Robust Operations

The White Paper (WP) describes a roadmap to address the Space Weather (SpWx) problem. It presents a strategic vision of how a community-wide effort could be organized and implemented to enable transformative advancement in SpWx research and ultimately, in applications. We envision a ‘system-of-systems’—an integrated web of SpWx stations and state-ofthe-art modeling facilities to enable a transformative advance in SpWx nowcasting and forecasting (Figure 1). The Space Weather Aggregated Network of Systems (SWANS) will enable space situational awareness for end-users invested in spaceflight operations, infrastructure risk mitigation, and future human endeavors in space exploration while profoundly transforming Heliophysics research.

A Vourrlidas↗

TRANSSFORM Workshop Empowering the US manufacturing industry proceedings report

The U.S. Department of Energy (DOE), Office of Energy Efficiency and Renewable Energy, and Advanced Manufacturing Office (AMO) hosted the TRANSSFORM (Transformative, Resilient, Adaptive, Nimble, Sustainable, Smart, Flexible, Optimal, Robust, and Model-based1 – A Bold Vision for the Future of U.S. Manufacturing) Workshop on September 8–10, 2021. The objective of the workshop was to hear from stakeholders about how manufacturing digitalization can improve manufacturing competitiveness and reduce energy consumption and emissions production from U.S. manufacturing, and what research, development, and demonstrations are needed to have the desired impact.

manufacturing digitalization, decarbonization, IoT↗

Computational models of human vision with applications

Perceptual problems in aeronautics were studied. The mechanism by which color constancy is achieved in human vision was examined. A computable algorithm was developed to model the arrangement of retinal cones in spatial vision. The spatial frequency spectra are similar to the spectra of actual cone mosaics. The Hartley transform as a tool of image processing was evaluated and it is suggested that it could be used in signal processing applications, GR image processing.

Wandell, B. A.↗

National Campaign Development Test Executive Summary

NASA’s vision for Advanced Air Mobility (AAM) is to provide safe, sustainable, accessible, and affordable aviation for transformational local and intraregional missions and includes the transportation of passengers and cargo as well as aerial work missions, such as infrastructure inspection or search and rescue operations. NASA’s technical expertise, intergovernmental relationships, and high level of public trust will help this technology come to market concurrent with infrastructure readiness, public acceptance, and constructive regulation. By advising and integrating disparate AAM efforts across the country and working collaboratively with the FAA, the National Campaign (NC) objective is to motivate industry progress and support the development of policy, regulatory, and technical standards in a manner that best ensures public safety and benefit to the American people. NC began with the Dry Run and Developmental Test (NC-DT), which served as a pathfinder for collaboration and direct involvement with industry partners in integrated simulation exercises and flight tests. NC-DT culminated with an acoustics-gathering flight test in September 2021 with industry partner Joby’s prototype S4 2.0 air vehicle, which delivered the first foundational baseline of noise levels present in Electric Vertical Takeoff and Landing (eVTOL) vehicles. Through the DT phase, the NC team built and tested the airspace and range infrastructure while assessing the readiness level of industry partners leading up to future NC events. The purpose of this paper is to provide an overview of NC-DT.

National Campaign↗

Use of computer vision for analysis of image datasets from high temperature plasma experiments

Great strides have been made in improving the quality of x-ray radiographs in high energy density plasma experiments, enabled in part by innovations in engineering and manufacturing of integrated circuits and materials. As a consequence, the radiographs of today are filled with a great deal of detail, but few of these features are extracted in a systematic way. Analysis techniques familiar to plasma physicists tend toward brittle 1D lineout or Fourier transform type analyses. The techniques applied to process our data have not kept pace with improvements in the quality of our data. Fortunately, the field of computer vision has a wealth of tools to offer, which have been widely used in industrial imaging and, more recently, adopted in biological imaging. We demonstrate the application of computer vision techniques to the analysis of x-ray radiographs from high energy density plasma experiments, as well as give a brief tutorial on the computer vision techniques themselves. These tools robustly extract 2D contours of shocks, boundaries of inhomogeneities, and secondary flows, thereby allowing for increased automation of analysis, as well as direct and quantitative comparisons with simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Restoration Hydro: A Watershed Approach to Standard Modular New Hydropower

The objectives of FOA DE- FOA-0001836- “Standard Modular Hydropower” included designing a standardized, modular, and environmentally compatible hydropower schematic for implementation in greenfield sites that generate up to 10 MW of capacity. Utilizing funds competitively awarded under DOE’s Water Power Technologies Office, the Natel Energy team developed a concept for modular new stream reach (NSR) hydropower that incorporates multi species upstream and downstream fish passage, improved river channel connectivity, and recreational modules. The in-stream design of the collective modules minimized site specific design and maximized the opportunities for modularity. Financial data was also presented using actual costs from regional suppliers, with figures provided in 2022 dollars. While the project team did not address potential permitting process improvements, the site selection criteria did consider established barriers to hydropower development such as tribal and preserved lands, interconnection proximity, and endangered species to exclude or deprioritize. The project’s design schematic met the objectives of the FOA, and presented a unique solution that targets alluvial pockets as natural features for sustainable development. Natel’s concept also incorporated the company's fish-safe Restoration Hydro Turbine for safe downstream passage, while featuring a rock arch that integrates fish passage, water, recreation, and grade control modules (including sediment). Alignment with the Department of Energy Office of Energy Efficiency and Renewable Energy (EERE) “Innovative Design Concepts for Standard Modular Hydropower and Pumped-Storage Hydropower” Program: According to the Hydropower Vision (DOE, 2016), approximately 16 GW of hydropower growth is possible with the development of technology solutions that balance efficiency, economics, and environmental sustainability. The desired outcome of the SMH program is transformational innovation specifically in the site identification, conceptual, and detailed design phases of technology development lifecycles (DOE, 2018). In developing the SMH design schematic, the team aimed to address the opportunities outlined in the Vision through an inverted design philosophy; rather than singularly prioritizing efficiency and power production, the team focused on integrating hydropower with restoration of degraded streams to optimal ecosystem function and provision of exceptional recreation value as design criteria. To achieve this, Restoration Hydro incorporates the principles of nature-based engineering (WWAP, 2018) and biomimicry (Biomimicry NL.) to strategically deploy complementary combinations of permanent, semi-permanent, and ephemeral low-head structures - such as natural and engineered log jams - that harness geomorphological and hydrological processes at the landscape-scale. Primary applications of Restoration Hydro include: 1) restoration of degraded watersheds’ natural ecological function and enhancement of hydrological connectivity; and 2) creation of associated co-benefits to hydro production, including increased groundwater recharge, improved sediment transport and management, improved water security and water quality. Restoration Hydro projects build upon proven watershed restoration engineering techniques by integrating hydropower turbines into low-head structures using innovative and evolving civil works concepts that facilitate fish and sediment passage, and in some cases create additional revenue-generating recreational opportunities. Powering low-head structures creates a directly monetizable layer of economic value in the form of flexible, reliable, renewable energy on top of the already high-value water, environmental and recreational benefits of watershed and river restoration. The approach aims to create a virtuous, self-reinforcing cycle whereby Restoration Hydro projects support the scaling of ecosystem restoration activities, creating a water-energy-carbon multiplier effect that, through the principles of adaptive change management: 1) improves the resilience of landscapes and downstream population centers for changing hydrological cycles; 2) creates a reliable energy resource that facilitates the integration of intermittent renewable power sources into grids; and 3) supports climate change mitigation through grid decarbonization and enhanced ecosystem carbon capture and retention.

13 HYDRO ENERGY↗

Database Integrity Monitoring for Synthetic Vision Systems Using Machine Vision and SHADE

In an effort to increase situational awareness, the aviation industry is investigating technologies that allow pilots to visualize what is outside of the aircraft during periods of low-visibility. One of these technologies, referred to as Synthetic Vision Systems (SVS), provides the pilot with real-time computer-generated images of obstacles, terrain features, runways, and other aircraft regardless of weather conditions. To help ensure the integrity of such systems, methods of verifying the accuracy of synthetically-derived display elements using onboard remote sensing technologies are under investigation. One such method is based on a shadow detection and extraction (SHADE) algorithm that transforms computer-generated digital elevation data into a reference domain that enables direct comparison with radar measurements. This paper describes machine vision techniques for making this comparison and discusses preliminary results from application to actual flight data.

Cooper, Eric G.↗

An autonomous robot for shell and tube heat exchanger inspection

Shell and tube heat exchangers (STHEs) are critical to energy conversion efficiency of power plants. Eddy current examination is a way to evaluate working conditions of these tubes. However, the current testing apparatus requires human to manually insert an eddy current testing (ECT) probe into and extract it out of individual tubes, and meanwhile monitor measurement results for diagnosis. It is a time-consuming and labor-intensive procedure even for an experienced technician. To tackle this challenge, in this study, we developed a robot enabled ECT system for autonomous inspection of STHEs. The robotic platform employs Mecanum wheeled chassis for high mobility, machine vision to locate tube bundle and tube inlets, a rotational Cartesian mechanism to operate at planes with all possible inclinations, and a task-specific mechanism for ECT probe delivery. Machine vision locates tube bundle and tube inlets by an April tag detection algorithm and a Circle Hough Transform algorithm, respectively. Assisted by a guiding cone, the ECT probe is continuously fed into the tubes with a fill factor of 0.819. In conclusion, during this process, the eddy current data are automatically collected and real-time analyzed by convolutional neural networks, showing accuracy of nearly 100% for identifying defective and nondefective tubes and 85% for four types of defective tubes and nondefective tubes.

42 ENGINEERING↗

Adventures in Astronomical Time Series Analysis

Welcome to a tour of the volatile, highly active Universe — in stark contrast to earlier serene ``clockwork’’ visions. Innovative data analysis techniques have illuminated explosive physical processes animating these systems. Examples include a Fourier transform suited to the irregular sampling characteristic of much astronomical data, but time domain techniques will be emphasized for these applications: gamma-ray activity in the Crab Nebula, gamma-ray bursts, active galactic nuclei, and gravitational waves. I hope this talk will change some of the ways you carry out statistical data analysis.

Jeffrey D Scargle↗

Automated Registration of Multi-Mode Nondestructive Evaluation Data

Registration techniques play a central role in applications of image processing to computer vision, medical imaging, and automatic target tracking. Feature-based techniques such as scale-invariant feature transform (SIFT) and speeded up robust features (SURF) are commonly used to register images derived from a single modality. However, SIFT and SURF struggle to register images from different modalities because the features tend to manifest rather differently and at sometimes very different length-scales. The most successful methods that have been developed to register multi-modal data use information-theoretic approaches. These methods play a key part in nondestructive evaluation scenarios where data that is collected by sensors of different modalities must be registered to be fused. In this paper, automated registration based on normalized mutual information is applied to align data derived from ultrasonic and radiographic inspections of (i) additively manufactured titanium alloy test coupons, and (ii) thin, lithium metal pouch-cell batteries. The quality of the registration is quantified in terms of computational resources and spatial accuracy. In the first case the X-ray computed tomography (XCT) data is captured on a region corresponding to a small subset of the ultrasonic data, while in the case of the lithium batteries the digital radiography (DR) captures a larger region of interest than the ultrasonic data. In both cases the radiographic data resolution is much higher than for ultrasound, but interestingly, in both cases the accuracy of the registration is approximately equal to two-to-three-pixel lengths in the ultrasonic images.

Nondestructive Evaluation↗

An Autonomous Robot for Shell and Tube Heat Exchanger Inspection

Shell and tube heat exchangers (STHEs) are critical to energy conversion efficiency of power plants. Eddy current examination is a way to evaluate working conditions of these tubes. However, the current testing apparatus requires human to manually insert an eddy current testing (ECT) probe into and extract it out of individual tubes, and meanwhile monitor measurement results for diagnosis. It is a time-consuming and labor-intensive procedure even for an experienced technician. To tackle this challenge, in this work, we developed a robot enabled ECT system for autonomous inspection of STHEs. The robotic platform employs Mecanum wheeled chassis for high mobility, machine vision to locate tube bundle and tube inlets, a rotational Cartesian mechanism to operate at planes with all possible inclinations, and a task-specific mechanism for ECT probe delivery. Machine vision locates tube bundle and tube inlets by an April tag detection algorithm and a Circle Hough Transform (CHT) algorithm, respectively. Assisted by a guidance cone, the ECT probe is continuously fed into the tubes with a fill factor of 0.819. During this process, the eddy current data are automatically collected and real-time analyzed by convolutional neural networks (CNN), showing accuracy of nearly 100% for identifying defective and non-defective tubes and 85% for four types of defective tubes and non-defective tubes.

autonomy, deep learning, eddy current testing, hea↗

Visual detection of spatial contrast patterns: evaluation of five simple models

The ModelFest Phase One dataset is a collection of luminance contrast thresholds for 43 two-dimensional monochromatic spatial patterns confined to an area of approximately two by two degrees. These data were collected by a collaboration among twelve laboratories, and were designed to provide a common database for calibration and testing of spatial vision models. Here I report fits of the ModelFest data with five models: Peak Contrast, Contrast Energy, Generalized Energy, a Gabor Channels model, and a Discrete Cosine Transform model. The Gabor Channels model provides the best fit, though the other, simpler models, with the exception of Peak Contrast, provide remarkably good fits as well. Though there are clear individual differences, regularities in the data suggest the possibility of constructing a standard observer for spatial vision. c2000 Optical Society of America.

NASA Discipline Space Human Factors↗

Optical See-Through Head Mounted Display Direct Linear Transformation Calibration Robustness in the Presence of User Alignment Noise

Augmented Reality (AR) is a technique by which computer generated signals synthesize impressions that are made to coexist with the surrounding real world as perceived by the user. Human smell, taste, touch and hearing can all be augmented, but most commonly AR refers to the human vision being overlaid with information otherwise not readily available to the user. A correct calibration is important on an application level, ensuring that e.g. data labels are presented at correct locations, but also on a system level to enable display techniques such as stereoscopy to function properly [SOURCE]. Thus, vital to AR, calibration methodology is an important research area. While great achievements already have been made, there are some properties in current calibration methods for augmenting vision which do not translate from its traditional use in automated cameras calibration to its use with a human operator. This paper uses a Monte Carlo simulation of a standard direct linear transformation camera calibration to investigate how user introduced head orientation noise affects the parameter estimation during a calibration procedure of an optical see-through head mounted display.

Axholt, Magnus↗

Chapter 11: Renewable Microgrids as a Foundation of the Future Sustainable Electrical Energy System

Renewable microgrids are an integral part of the future sustainable energy system. This chapter focuses on the role of renewable energy-based microgrids in the electricity system transformation. It is seen as a foundation that complements large-scale generation plants and high-voltage transmission lines by providing additional flexibility and resilience. This flexibility and resilience are crucial for balancing the energy system and ensuring its long-term sustainability, given the changing supply and demand patterns due to rooftop solar photovoltaics (PV), battery storage, electric mobility, and heat pumps. It is also an opportunity for residential and commercial consumers to become active participants in the energy market. Innovation, new technologies and business models will act as the key enabler for this transformation. The regulatory restructuring of the energy market will be crucial for successful integration of prosumers and aggregated energy communities. The chapter presents the vision of a sustainable, decentralized, and digitized energy future including market potential, most innovative case study projects and start-up companies, and the shifts needed in the regulatory landscape.

battery storage↗

Western Combined Heat and Power Technical Assistance Partnership (Final Technical Report)

Since 2018, the Western Combined Heat and Power Technical Assistance Partnership (CHP TAP) has been dedicated to advancing the adoption and implementation of Combined Heat and Power. The CHP TAP has diligently worked towards its mission of fostering end-user engagement, promoting technical solutions, and enhancing energy security within the region. As we reflect on our journey, we are proud to announce the completion of the required metrics set forth at the beginning of our endeavor. From the outset, our aim has been clear: to leverage CHP technology as a catalyst for bolstering American competitiveness, utilizing local fuels, and fortifying energy resilience. Through collaborative efforts with a diverse array of stakeholders, including manufacturing, commercial, institutional, and federal facilities, and campuses, we have strived to realize this vision. In this report, we outline the achievements, activities, and impact of the Western CHP TAP, highlighting the transformative journey undertaken since 2018. From providing technical assistance and guidance to conducting educational workshops and advocating for supportive policies, our initiatives have been guided by a commitment to excellence and innovation. As we celebrate the completion of our required metrics, we reaffirm our dedication to continuing our mission, building upon our accomplishments, and shaping a sustainable energy future for the Western region. Through ongoing collaboration and engagement, we are confident that the Western CHP TAP will continue to serve as a beacon of progress and a catalyst for positive change in the years to come.

03 NATURAL GAS↗

Real-time optical multiple object recognition and tracking system and method

System for optically recognizing and tracking a plurality of objects within a field of vision. Laser (46) produces a coherent beam (48). Beam splitter (24) splits the beam into object (26) and reference (28) beams. Beam expanders (50) and collimators (52) transform the beams (26, 28) into coherent collimated light beams (26', 28'). A two-dimensional SLM (54), disposed in the object beam (26'), modulates the object beam with optical information as a function of signals from a first camera (16) which develops X and Y signals reflecting the contents of its field of vision. A hololens (38), positioned in the object beam (26') subsequent to the modulator (54), focuses the object beam at a plurality of focal points (42). A planar transparency-forming film (32), disposed with the focal points on an exposable surface, forms a multiple position interference filter (62) upon exposure of the surface and development processing of the film (32). A reflector (53) directing the reference beam (28') onto the film (32), exposes the surface, with images focused by the hololens (38), to form interference patterns on the surface. There is apparatus (16', 64) for sensing and indicating light passage through respective ones of the positions of the filter (62), whereby recognition of objects corresponding to respective ones of the positions of the filter (62) is affected. For tracking, apparatus (64) focuses light passing through the filter (62) onto a matrix of CCD's in a second camera (16') to form a two-dimensional display of the recognized objects.

Chao, Tien-Hsin↗

An Automated Classification Technique for Detecting Defects in Battery Cells

Battery cell defect classification is primarily done manually by a human conducting a visual inspection to determine if the battery cell is acceptable for a particular use or device. Human visual inspection is a time consuming task when compared to an inspection process conducted by a machine vision system. Human inspection is also subject to human error and fatigue over time. We present a machine vision technique that can be used to automatically identify defective sections of battery cells via a morphological feature-based classifier using an adaptive two-dimensional fast Fourier transformation technique. The initial area of interest is automatically classified as either an anode or cathode cell view as well as classified as an acceptable or a defective battery cell. Each battery cell is labeled and cataloged for comparison and analysis. The result is the implementation of an automated machine vision technique that provides a highly repeatable and reproducible method of identifying and quantifying defects in battery cells.

McDowell, Mark↗

Advances in image compression and automatic target recognition; Proceedings of the Meeting, Orlando, FL, Mar. 30, 31, 1989

Various papers on image compression and automatic target recognition are presented. Individual topics addressed include: target cluster detection in cluttered SAR imagery, model-based target recognition using laser radar imagery, Smart Sensor front-end processor for feature extraction of images, object attitude estimation and tracking from a single video sensor, symmetry detection in human vision, analysis of high resolution aerial images for object detection, obscured object recognition for an ATR application, neural networks for adaptive shape tracking, statistical mechanics and pattern recognition, detection of cylinders in aerial range images, moving object tracking using local windows, new transform method for image data compression, quad-tree product vector quantization of images, predictive trellis encoding of imagery, reduced generalized chain code for contour description, compact architecture for a real-time vision system, use of human visibility functions in segmentation coding, color texture analysis and synthesis using Gibbs random fields.

Tescher, Andrew G.↗