Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Automated Progress Monitoring in Modular Construction Factories Using Computer Vision and Building Information Modeling

Modular construction methods have recently gained interest due to the advantages offered in terms of safety, quality, and productivity for projects. In this method, a significant portion of the construction is performed off-site in factories where modular components are built in different workstations, assembled on the production line, and shipped to the site for installation. Due to the labor-intensive nature of tasks, cycle times in modular construction factories are highly variable, which commonly leads to major bottlenecks and delays in construction projects. To remedy this effect, recent methods rely on sensors such as RFID to monitor the production process, which is reportedly expensive, and intrusive to the work process. Recently, computer vision-based methods have been proposed to track the production process in modular construction factories. However, these methods overlook monitoring the assembly process on the production line. Therefore, this paper presents a method to monitor the assembly process by integrating computer vision-based methods with Building Information Modeling (BIM). The proposed method detects the modular units using object segmentation; superimposes the installation area with the corresponding 2D region using BIM, and identifies the installation of the components using image processing techniques. The proposed method has been validated using surveillance videos captured from a modular construction factory in the US. Successful implementation of the proposed method can lead to timely identification of delays during the assembly process and reduce delays in modular integrated construction projects.

building information modeling↗

Bottleneck Detection in Modular Construction Factories Using Computer Vision

The construction industry is increasingly adopting off-site and modular construction methods due to the advantages offered in terms of safety, quality, and productivity for construction projects. Despite the advantages promised by this method of construction, modular construction factories still rely on manually-intensive work, which can lead to highly variable cycle times. As a result, these factories experience bottlenecks in production that can reduce productivity and cause delays to modular integrated construction projects. To remedy this effect, computer vision-based methods have been proposed to monitor the progress of work in modular construction factories. However, these methods fail to account for changes in the appearance of the modular units during production, they are difficult to adapt to other stations and factories, and they require a significant amount of annotation effort. Due to these drawbacks, this paper proposes a computer vision-based progress monitoring method that is easy to adapt to different stations and factories and relies only on two image annotations per station. In doing so, the Scale-invariant feature transform (SIFT) method is used to identify the presence of modular units at workstations, and the Mask R-CNN deep learning-based method is used to identify active workstations. This information was synthesized using a near real-time data-driven bottleneck identification method suited for assembly lines in modular construction factories. This framework was successfully validated using 420 h of surveillance videos of a production line in a modular construction factory in the U.S., providing 96% accuracy in identifying the occupancy of the workstations and an F-1 Score of 89% in identifying the state of each station on the production line. The extracted active and inactive durations were successfully used via a data-driven bottleneck detection method to detect bottleneck stations inside a modular construction factory. The implementation of this method in factories can lead to continuous and comprehensive monitoring of the production line and prevent delays by timely identification of bottlenecks.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

VISIONS: Remote Observations of a Spatially-Structured Filamentary Source of Energetic Neutral Atoms near the Polar Cap Boundary During an Auroral Substorm

We report initial results from the VISualizing Ion Outflow via Neutral atom imaging during a Substorm (VISIONS) rocket that flew through and near several regions of enhanced auroral activity and also sensed regions of ion outflow both remotely and directly. The observed neutral atom fluxes were largest at the lower energies and generally higher in the auroral zone than in the polar cap. In this paper, we focus on data from the latter half of the VISIONS trajectory when the rocket traversed the polar cap region. During this period, many of the energetic neutral atom spectra show a peak at 100 electronvolts. Spectra with peaks around 100 electronvolts are also observed in the Electrostatic Ion Analyzer (EIA) data consistent with these ions comprising the source population for the energetic neutral atoms. The EIA observations of this low energy population extend only over a few tens of kilometers. Furthermore, the directionality of the arriving energetic neutral atoms is consistent with either this spatially localized source of energetic ions extending from as low as about 300 kilometers up to above 600 kilometers or a larger source of energetic ions to the southwest.

Polar Cap↗

Technology for NASA's Planetary Science Vision 2050.

NASAs Planetary Science Division (PSD) initiated and sponsored a very successful community Workshop held from Feb. 27 to Mar. 1, 2017 at NASA Headquarters. The purpose of the Workshop was to develop a vision of planetary science research and exploration for the next three decades until 2050. This abstract summarizes some of the salient technology needs discussed during the three-day workshop and at a technology panel on the final day. It is not meant to be a final report on technology to achieve the science vision for 2050.

Vision↗

Wind Vision: Updating the DOE 20% Wind Energy by 2030 Report (Poster)

The 20% Wind Energy by 2030 report was developed as part of the Advanced Energy Initiative. Published in 2008, the report was largely based on information collected and analyzed in 2006. Much has changed since then, including shifts in technology, markets, and policy. The industry needs a new, clear, vision for wind power that is shared among stakeholders from the U.S. government, industry, academia, and NGO communities. At WINDPOWER 2013, the U.S. Department of Energy, in partnership with the American Wind Energy Association and the Wind Energy Foundation, launched a project to update the 20% report with new objectives. This conference poster outlines the elements of the new Wind Vision.

17 WIND ENERGY↗

Artificial Intelligence and Computer Vision for Cost-Effective Benthic Habitat Characterizations

Machine learning applied to computer vision and pattern recognition is a type of artificial intelligence that has advanced rapidly in the last 10 to 15 years, spurred forward by breakthroughs in deep convolutional neural networks. These state-of-the-art methods are poised to become widely used in environmental monitoring applications as a result of the increasing abundance of data available from different imaging platforms (e.g., fixed-point cameras, drone surveys, high-resolution satellite data) that can be analyzed to observe, model, and understand environmental conditions. Computer vision and pattern recognition (CVPR) tools advance our ability to use imagery and camera-based tools in cost-effective ways for environmental monitoring. Although these techniques offer great potential, some challenges remain, such as the need for large sets of labeled images for model training and validation and optimized hardware and software to ensure that the models can be trained effectively and in a reasonable amount of time. Here, we have overcome many of these rate-limiting challenges by using a diverse image library built across multiple projects coupled with staff expertise and onsite computing resources. We are working toward a fully automated SPI processing system and also are moving to develop CVPR analytical tools for other imaging platforms and data sets.

02 PETROLEUM↗

Improvements in Optical Surface Measurement Using Reflected Computer Vision Targets

Since 2021, NREL has been developing a system to measure heliostats by measuring the deflection of printed computer vision targets, called the Reflected Target Non-intrusive Assessment (ReTNA) [6], [7]. While this system will have lower resolution than a fringe deflectometry system, it has several important advantages that make it a complimentary technology: 2D surface slope measurement can be generated from a single image, it can operate in ambient lighting, target points can be directly located in 3D space with photogrammetry allowing for a non-flat target, and it's well suited to using a smaller target, and multiple images to measure larger optical surfaces. ReTNA has undergone several significant changes and improvements, described below. This talk will summarize new system layouts designed for commercial use, new computer vision algorithms used to automate the analysis process and validation campaigns for the ReTNA software.

computer vision↗

Advanced Fuels Campaign: Strategic Vision

The Advanced Fuels Campaign (AFC) is dedicated to propelling the United States to the forefront of nuclear fuel technology through a comprehensive strategic vision. The vision is structured around five key goals: driving U.S. leadership in nuclear fuel technology, expanding nuclear energy production from the existing fleet, completing the qualification basis for advanced reactor fuel technology, driving innovation in advanced nuclear fuel technology, and enabling a high-performing organization. By focusing on these goals, AFC aims to define and implement cutting-edge nuclear fuel technologies, support industry advancements, achieve critical fuel qualifications, foster innovative research, and ensure effective program management and stakeholder engagement. This strategic approach will solidify the United States’ position as a global leader in nuclear energy and fuel technology, while also preparing for the future of environmentally friendly and reliable nuclear power.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Advanced Fuels Campaign: Strategic Vision

The Advanced Fuels Campaign (AFC) is dedicated to propelling the United States to the forefront of nuclear fuel technology through a comprehensive strategic vision. The vision is structured around five key goals: driving U.S. leadership in nuclear fuel technology, expanding nuclear energy production from the existing fleet, completing the qualification basis for advanced reactor fuel technology, driving innovation in advanced nuclear fuel technology, and enabling a high-performing organization. By focusing on these goals, AFC aims to define and implement cutting-edge nuclear fuel technologies, support industry advancements, achieve critical fuel qualifications, foster innovative research, and ensure effective program management and stakeholder engagement. This strategic approach will solidify the United States’ position as a global leader in nuclear energy and fuel technology, while also preparing for the future of environmentally friendly and reliable nuclear power.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Automated Waterbox Inspection for Nuclear Power Plants Using Computer Vision - Based Change Detection

Nuclear power plant waterboxes require regular inspection for leaks, missing components, and structural damage during maintenance outages. Traditional manual inspection is time-consuming and poses safety risks from confined space entry. We developed an automated computer vision system for drone-based waterbox inspection in partnership with Florida Light and Power. Our approach uses feature detection and matching to identify critical changes between baseline and current inspection images, automatically flagging additions (leaks/debris), removals (missing plugs), and translations (displaced components) while compensating for drone movement and environmental variations. We systematically evaluated six feature matching methods, from classical approaches (SIFT+BF) to state-of-the-art neural networks (SuperPoint+SuperGlue), using both standard benchmarks (HPatches) and waterbox-specific validation with real-world augmentations. SuperPoint+SuperGlue achieved superior performance with 7.82 pixels RMSE and 100% success rate—2.8x better accuracy than our baseline. While the pre-trained model has commercial licensing restrictions for nuclear deployment, our findings validate this architecture for custom training. We implemented a real-time GUI demonstrating the SIFT+BF approach for immediate deployment, processing drone feeds at 30 FPS with color-coded change visualization. Future work includes training a custom SuperPoint+SuperGlue model on waterbox data and integrating Vision-Language Models for automated reporting and maintenance guidance.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Automatic identification and quantification of dense microcracks in high-performance fiber-reinforced cementitious composites through deep learning-based computer vision

Highlights: • A method is presented to detect, locate, quantify, and visualize dense microcracks in HPFRCC. • Quantification of dense microcracks is realized using deep learning method for the first time. • The presented method uses deep learning models that are trained using a realistic dataset size. • The presented method has a high computation efficiency for identifying and quantifying cracks. • The presented method provides crack width with errors up to 50 μm and a R{sup 2} value of 0.984. High-performance fiber-reinforced cementitious composites (HPFRCCs) feature high mechanical strengths, crack resistance, and durability. Under excessive loading, HPFRCCs demonstrate dense microcracks that are difficult to identify using existing methods. This study presents a computer vision method for identification, quantification, and visualization of microcracks in HPFRCCs based on deep learning. The presented method integrates multiple deep learning models and computer vision techniques in a hierarchical architecture. The crack pattern (e.g., number, width, and spacing of cracks) are automatically determined from pictures without human intervention. This study shows that the presented method achieves an accuracy of 0.992 for crack detection and an accuracy finer than 50 μm (R{sup 2} > 0.984) for quantification of crack width when deep learning models are trained using only 200 pictures of HPFRCCs and 200 pictures of conventional concrete with incorporation of data augmentation. The presented method is expected to be also applicable to other materials featuring complex cracks.

36 MATERIALS SCIENCE↗

Restoration of patterned vision with an engineered photoactivatable G protein-coupled receptor

Retinitis pigmentosa results in blindness due to degeneration of photoreceptors, but spares other retinal cells, leading to the hope that expression of light-activated signaling proteins in the surviving cells could restore vision. We used a retinal G protein-coupled receptor, mGluR2, which we chemically engineered to respond to light. In retinal ganglion cells (RGCs) of blind rd1 mice, photoswitch-charged mGluR2 (“SNAG-mGluR2”) evoked robust OFF responses to light, but not in wild-type retinas, revealing selectivity for RGCs that have lost photoreceptor input. SNAG-mGluR2 enabled animals to discriminate parallel from perpendicular lines and parallel lines at varying spacing. Simultaneous viral delivery of the inhibitory SNAG-mGluR2 and excitatory light-activated ionotropic glutamate receptor LiGluR yielded a distribution of expression ratios, restoration of ON, OFF and ON-OFF light responses and improved visual acuity. Thus, SNAG-mGluR2 restores patterned vision and combinatorial light response diversity provides a new logic for enhanced-acuity retinal prosthetics.

59 BASIC BIOLOGICAL SCIENCES↗

Author Correction: Restoration of patterned vision with an engineered photoactivatable G protein-coupled receptor

Retinitis pigmentosa results in blindness due to degeneration of photoreceptors, but spares other retinal cells, leading to the hope that expression of light-activated signaling proteins in the surviving cells could restore vision. We used a retinal G protein-coupled receptor, mGluR2, which we chemically engineered to respond to light. In retinal ganglion cells (RGCs) of blind rd1 mice, photoswitch-charged mGluR2 (“SNAG-mGluR2”) evoked robust OFF responses to light, but not in wild-type retinas, revealing selectivity for RGCs that have lost photoreceptor input. SNAG-mGluR2 enabled animals to discriminate parallel from perpendicular lines and parallel lines at varying spacing. Simultaneous viral delivery of the inhibitory SNAG-mGluR2 and excitatory light-activated ionotropic glutamate receptor LiGluR yielded a distribution of expression ratios, restoration of ON, OFF and ON-OFF light responses and improved visual acuity. Thus, SNAG-mGluR2 restores patterned vision and combinatorial light response diversity provides a new logic for enhanced-acuity retinal prosthetics.

Berry, Michael H.↗

Multichannel meta-imagers for accelerating machine vision

Rapid developments in machine vision technology have impacted a variety of applications, such as medical devices and autonomous driving systems. These achievements, however, typically necessitate digital neural networks with the downside of heavy computational requirements and consequent high energy consumption. As a result, real-time decision-making is hindered when computational resources are not readily accessible. Here we report a meta-imager designed to work together with a digital back end to offload computationally expensive convolution operations into high-speed, low-power optics. Further, in this architecture, metasurfaces enable both angle and polarization multiplexing to create multiple information channels that perform positively and negatively valued convolution operations in a single shot. We use our meta-imager for object classification, achieving 98.6% accuracy in handwritten digits and 88.8% accuracy in fashion images. Owing to its compactness, high speed and low power consumption, our approach could find a wide range of applications in artificial intelligence and machine vision applications.

47 OTHER INSTRUMENTATION↗

Computer Vision-Enabled Smart Traffic Monitoring for Sustainable Transportation Management

Transportation accounts for a significant portion of total global energy consumption. Excessive energy consumption usually occurs in urban traffic environments with congestion and travel delays. With the advancement of remote sensing and computer vision technologies, real-time traffic conditions can be monitored. Therefore, sustainable transportation management strategies can be developed to optimize the overall energy and environment performance and reduce congestion and emissions. This work presents a smart traffic monitoring system based on remote camera sensors. Real-time and historical traffic conditions at the US Department of Energy’s Oak Ridge National Laboratory (ORNL) were monitored and analyzed to develop optimal transportation management strategies for sustainability. Computer vision algorithms were developed and applied to process the real-time camera data to obtain complete traffic information across the ORNL campus. Weeks of historical data were collected and processed to analyze the traffic and identify bottlenecks. The proposed traffic monitoring and management approach can be applied and extended to benefit other campuses or urban areas.

Shao, Yunli↗

Structural and functional dynamics of human cone cGMP-phosphodiesterase important for photopic vision

Cone cGMP-phosphodiesterase (PDE6) is the key effector enzyme for daylight vision, and its properties are critical for shaping distinct physiology of cone photoreceptors. We determined the structures of human cone PDE6C in various liganded states by single-particle cryo-EM that reveal essential functional dynamics and adaptations of the enzyme. Our analysis exposed the dynamic nature of PDE6C association with its regulatory γ-subunit (Pγ) which allows openings of the catalytic pocket in the absence of phototransduction signaling, thereby controlling photoreceptor noise and sensitivity. We demonstrate evolutionarily recent adaptations of PDE6C stemming from residue substitutions in the Pγ subunit and the noncatalytic cGMP binding site and influencing the Pγ dynamics in holoPDE6C. Thus, our structural analysis sheds light on the previously unrecognized molecular evolution of the effector enzyme in cones that advances adaptation for photopic vision.

Science & Technology - Other Topics↗

Spatial profiling of the interplay between cell type- and vision-dependent transcriptomic programs in the visual cortex

How early sensory experience during “critical periods” of postnatal life affects the organization of the mammalian neocortex at the resolution of neuronal cell types is poorly understood. We previously reported that the functional and molecular profiles of layer 2/3 (L2/3) cell types in the primary visual cortex (V1) are vision-dependent [S. Chenget al.,Cell185, 311–327.e24 (2022)]. Here, we characterize the spatial organization of L2/3 cell types with and without visual experience. Spatial transcriptomic profiling based on 500 genes recapitulates the zonation of L2/3 cell types along the pial–ventricular axis in V1. By applying multitasking theory, we suggest that the spatial zonation of L2/3 cell types is linked to the continuous nature of their gene expression profiles, which can be represented as a 2D manifold bounded by three archetypal cell types. By comparing normally reared and dark reared L2/3 cells, we show that visual deprivation-induced transcriptomic changes comprise two independent gene programs. The first, induced specifically in the visual cortex, includes immediate-early genes and genes associated with metabolic processes. It manifests as a change in cell state that is orthogonal to cell-type-specific gene expression programs. By contrast, the second program impacts L2/3 cell-type identity, regulating a subset of cell-type-specific genes and shifting the distribution of cells within the L2/3 cell-type manifold. Through an integrated analysis of spatial transcriptomics with single-nucleus RNA-seq data, we describe how vision patterns cortical L2/3 cell types during the critical period.

Science & Technology - Other Topics↗