Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “photogrammetry”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Photogrammetry: Develop methods for detecting deviations from expected geometry of components in a glovebox environment (Lawrence Livermore National Laboratory Aging and Lifetimes Program FY23, Milestone 8651, Grading Criterion #4)

Measurements in glovebox environments are challenging to conduct. Currently deployed techniques are time consuming and provide limited information. These limitations make current disposition and future assessments of products challenging. In FY23 we developed methods for detecting deviations of components in a glovebox environment that address these shortcomings by rapidly collecting information-dense measurements. Conducted tests demonstrate that camera pose (position and orientation) can be derived for images utilized in the photogrammetry process. This information, in conjunction with common image processing techniques, enables automated detection and size estimation of surface features. First, image processing is used to identify marks, or localized regions, that standout from the surrounding area. Then, the physical size of the region can be estimated because scale can be determined for photogrammetry images. Development of this methods shows that photogrammetry can identify measurable deviations from expected geometries. Although measurement error when using this technique through a glovebox window still needs to be reduced, this capability shows promise for eliminating or reducing the use of tedious manual measurements.

42 ENGINEERING↗

A framework to enhance disaster debris estimation with AI and aerial photogrammetry

This study addresses the critical need to enhance disaster preparedness and response, focusing on hurricane impact assessment and debris estimation. Accurate assessments in this context are critical for post-event search-and-rescue (SAR) operations and resource distribution. Recent computing advancements are revealing the potential of unmanned aerial vehicles (UAVs) and artificial intelligence (AI) technologies in collecting data and assisting with post-hurricane reconnaissance. However, the use of AI and UAV photogrammetry for accurate disaster impact analysis remains underexplored. To this end, this study proposes a damage and debris analysis framework harnessing reality capture through aerial imagery and photogrammetry. Within this framework, a region-based neural network is leveraged to detect debris locations in aerial imagery with favorable performance. In a testbed within the Beaumont-Port Arthur region, in Southeast Texas, this study performs 3D reality captures of the built environment. Since the accuracy of the 3D reality capture is of importance in research areas associated with time-sensitive disaster response, we further investigate the optimal 2D aerial imagery overlap ratio required to generate a sufficiently accurate 3D model for disaster impact analysis and debris volume estimation. Results indicate that, in the case of aerial imagery for infrastructure systems, a minimum of 60 % overlap is recommended for damage assessment and debris analysis. In contrast, for flat green areas, a minimum of 50 % overlap is adequate. Overall, for disaster response applications, our study reveals that an overlap ratio between 60 % and 70 % is optimal for achieving a balance between time efficiency and data quality in aerial data collection. Furthermore, these quantitative recommendations are crucial for enabling efficient disaster response efforts. Additionally, our study outcomes will improve disaster impact analysis and facilitating timely and effective response strategies.

Artificial intelligence↗

Mission planning for photogrammetry-based autonomous 3D Mapping of Dams using a commercial UAV

The application of autonomous unmanned aerial vehicles (UAVs) for conducting inspections of dams represents an innovative approach aimed at enhancing safety, efficiency, and cost-effectiveness. In this context, this paper presents algorithms for UAV mission design in autonomous dam inspections that include the creation of a 3D map based on photogrammetry. The algorithms were systematically developed to incorporate a comprehensive set of parameters that account for the geometric characteristics of the dam and adhere to photogrammetry specifications. To validate the proposed methodology, we utilized a commercial programmable quadrotor, specifically the Parrot Anafi USA Gov drone, which is equipped with high-quality cameras and can be programmed with the help of a software development kit (SDK) provided by the manufacturer. Our results demonstrate the efficacy of our method, highlighting how the generated maps can be used for hazard detection in the downstream slope of dams.

42 ENGINEERING↗

Compact imaging system using a co-linear, high-intensity LED illumination unit to minimize window reflections for background-oriented schlieren, shadowgraph, photogrammetry and machine vision measurements

One aspect of the present disclosure is an imaging system including an optical sensor defining an optical axis. The system further includes a light source. The system may include an optical beam splitter, and may also include an optional diffusing lens that may be configured to diffuse and/or collimate light from the light source and direct light exiting the diffusing lens to the optical beam splitter. The optical beam splitter is configured to direct light from the light source along the optical axis of the optical sensor.

Bathel, Brett F.↗

Mapping snow depth and volume at the alpine watershed scale from aerial imagery using Structure from Motion

Time series mapping of snow volume in the mountains at global scales and at resolutions needed for water resource management is an unsolved challenge to date. Snow depth mapping by differencing surface elevations from airborne lidar is a mature measurement approach filling the observation gap operationally in a few regions, primarily in mountain headwaters in the Western United States. The same concept for snow depth retrieval from stereo- or multi-view photogrammetry has been demonstrated, but these previous studies had limited ability to determine the uncertainties of photogrammetric snow depth at the basin scale. For example, assessments used non-coincident or discrete points for reference, masked out vegetation, or compared a subset of the fully snow-covered study domain. Here, using a unique data set with simultaneously collected airborne data, we compare snow depth mapped from multi-view Structure from Motion photogrammetry to that mapped by lidar at multiple resolutions over an entire mountain basin (300 km 2 ). After excluding reconstruction errors (negative depths), SfM had lower snow-covered area (~27%) and snow volume (~16%) compared to lidar. The reconstruction errors were primarily in areas with vegetation, shallow snow (< 1 m), and steep slopes (> 60°C). Across the overlapping snow extent, snow depths compared well to lidar with similar mean values (< 0.03 m difference) and snow volume (± 5%) for output resolutions of 3 m and 50 m, and with a normalized median absolute deviation of 0.19 m. Our results indicate that photogrammetry from aerial images can be applied in the mountains but would perform best for deeper snowpacks above tree line.

54 ENVIRONMENTAL SCIENCES↗

A New Reflected Target Optical Assessment System - Stage 1 Development Results: Preprint

NREL has completed stage 1 development of an indoor optical measurement tool for fully assembled heliostats and single facets. This tool began as an indoor version of NREL's NIO technique. It uses similar techniques to other available tools (deflectometry, photogrammetry, etc.), but is designed require very little infrastructure, labor, and time to set up and collect surface slope and canting measurements on fully assembled heliostats and parabolic trough facets, making it a valuable tool for quality assurance and laboratory measurement of helio-stat optics. It accomplishes this by using computer vision, photogrammetry, and multiple images stitched together to minimize the printed target size and required setup precision. This adaptable setup is useful for taking measurements at a variety of heliostat pointing angles, and for measuring fully assembled heliostats on the assembly line. The measurement system's methodology and an analysis of its uncertainty, sensitivity and comparison with established optical measurement systems is described below.

canting↗

Improvements in Reflected Target Non-intrusive Assessment (ReTNA)

Accurate optical surfaces are a primary driver of concentrated solar power plant performance. Errors in pointing and tracking mirrors, the canting of individual mirror facets, and the surface slope of the mirror itself can be caused by errors during assembly, transportation, wind loading, gravity, and many other sources. The tools that exist to measure these error sources today largely rely on fringe deflectometry (SOFAST, QDec, others), or photogrammetry with targets attached to the mirror surface. In 2022, NREL presented a new indoor optical measurement system to measure fully assembled heliostats during development and on the assembly line for quality assurance purposes, which has undergone significant development in the last year, including the installation of a new, larger laboratory setup. This system, called ReTNA (Reflected Target Non-intrusive Assessment), uses a printed pattern as a deflectometry target. Using printed pattern features as deflectometry targets instead of fringes allows the software to measure the surface slope in two dimensions, eliminating the need to for changing, projected targets. In the last year, NREL's ReTNA tool has been adapted to use a tall, thin target, that only spans one dimension of the mirror, and a camera moving on an automatic track system. We will present these new developments, including the new setup, target patterns, software methodology for fast, automatic optical analysis, and important lessons learned throughout the process. ReTNA results will be compared to established tools, to establish the uncertainty of this new method. ReTNA leverages recent improvements in computer vision and photogrammetry to remove as much careful calibration from the setup process as possible, making the tool low cost, simple, and portable. While it will not achieve the resolution of a fringe deflectometry system, its advantages make it well suited for CSP evaluation, and allow it to fill a different industry need.

concentrating solar power↗

Grain size estimation in fluvial gravel bars using uncrewed aerial vehicles: A comparison between methods based on imagery and topography

Abstract Grain size assessments are necessary for understanding the various geomorphological, hydrological and ecological processes that occur within rivers. Recent research has shown that the application of Structure‐from‐Motion (SfM) photogrammetry to imagery from uncrewed aerial vehicles (UAVs) shows promise for rapidly characterising grain sizes along rivers in comparison to traditional field‐based methods. Here, we evaluated the applicability of different methods for estimating grain sizes in gravel bars along a study reach in the Olentangy River in Columbus, Ohio. We collected imagery of these gravel bars with a UAV and processed those images with SfM photogrammetry software to produce three‐dimensional point clouds and orthomosaics. Our evaluation compared statistical models calibrated on topographic roughness, which was computed from the point clouds, and to those based on image texture, which was computed from the orthomosaics. Our results showed that statistical models calibrated on image texture were more accurate than those based on topographic roughness. This might be because of site‐specific patterns of grain size, shape and imbrication. Such patterns would have complicated the detection of topographic signatures associated with individual grains. Our work illustrates that UAV‐SfM approaches show potential to be used as an accessible method for characterising surface grain sizes along rivers at higher spatial and temporal resolutions than those provided by traditional methods.

Wong, Tyler↗

Multi-Resolution UAV Path Replanning for Inspection of Tailings Dams

Autonomous inspection of large and complex structures with a commercial unmanned aerial vehicle (UAV) is a challenging problem that has been addressed in recent years. In this paper, we address the global motion planning problem of creating autonomous inspection missions for UAVs considering photogrammetry constraints. We focus on the inspection of large tailings dams, which are dam structures used to store waste byproducts of mining. Our method uses a prior sparse point cloud of the dam to generate a voxel grid, where paths satisfying photogrammetry constraints are tested for collisions. We then apply the A* algorithm as a local planner to avoid obstacles within the global mission. Moreover, we address the problem of changing routes online by using octree-based multi-resolution grids for efficient and fast pathfinding. Our results, obtained using tridimensional maps of an actual coal mine tailings dam, show that using octrees for multi-resolution motion planning is faster than using a fixed voxel grid in online missions while inspecting large structures.

42 ENGINEERING↗

Topography, surface water distribution and subsurface structure in 2023 across an Arctic coastal tundra site near Utqiagvik, Alaska

Subsurface electrical resistivity tomography (ERT), active layer thickness measurements, photogrammetry, and topographic data were collected in September 2023 along a 475 m long, 20 m wide corridor that traverses various polygon types within the Barrow Environmental Observatory (BEO) on the Alaskan Arctic Coastal Plain, approximately 4 miles from the Beaufort Sea near Utqiaġvik, Alaska. These measurements were designed to assess decadal changes in surface water distribution, topography, and subsurface structure across this dynamic landscape. This archive contains the datasets acquired in 2023 and references to the datasets acquired previously at the same location. The ERT survey was conducted along the 475 m transect using 0.5 m electrode spacing and a roll-along acquisition strategy. Thaw layer thicknesses were measured with a tile probe along the same transect. Photogrammetry data were acquired using an unoccupied aerial vehicle (UAV) and were used to generate a digital elevation model and an RGB mosaic. A real-time kinematic (RTK) GPS was used to survey the ERT electrodes and the ground control points for the aerial imagery. The dataset contains 5 *.csv data files, 6 *.csv metadata files, and 6 *.tif files.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Rays for Roots - Integrating Backscatter X-Ray Phenotyping, Modeling and Genetics to Increase Carbon Sequestration and Switchgrass Resource Use (Final Report)

To increase carbon (C) deposition in the soil and enhance crop resource use efficiency, characterizing root form and function is essential. Several root and soil traits have been linked to increased root-to-soil C transfer. Technology that could provide high-resolution characterization of many of these traits in field conditions would revolutionize our ability to study and understand how to increase C sequestration. In this effort, we developed an initial early prototype backscatter X-ray system for non-destructive imaging of root traits. We collected initial backscatter X-ray data in field and lab settings and carried out early analysis of these data. Along with this prototype, we also developed a suite of root phenotyping approaches including advanced minirhizotron image analysis, soil core imaging, and mesocosm imaging. Minirhizotron (MR) tubes are clear tubes inserted into the soil in the field and used to image roots and the surrounding soil. Our team has developed deep learning-based methods that can segment roots from soil that can learn from imprecise image-level labels. The ability to learn or fine-tune our deep learning algorithms from image-level labels allows easier and faster application of these approaches to new locations and new plant species. We have successfully implemented and applied our MR analysis approaches to thousands of switchgrass MR images collected across geographical regions. An advantage of MR imaging is the ability to collect root and soil images over time. Our soil core analysis included collecting hundreds of soil core samples from harvested switchgrass fields and imaging these cores with both X-ray CT and backscatter X-ray imaging. Initial segmentation approaches for the X-ray CT images of these cores have been developed and applied. An advantage of soil core analysis is that it preserves the three-dimensional structures of the roots and soil in the core collected. Our group also developed photogrammetry-based mesocosm root imaging and phenotyping approaches. In this approach, a plant was grown in a large mesocosm with a three-dimensional grid of thin supporting lines inserted throughout the mesocosm. After the plant (and, correspondingly, the root architecture is grown and established) the soil media was removed and the supporting lines approximately preserved the three-dimensional root architecture. Then, we applied photogrammetry techniques to create a three-dimensional digital representation of the root architecture for which we developed analysis algorithms including skeletonization. We carried out our phenotyping development with powerful switchgrass resources and physiological and agroecosystem modeling to deliver novel technology. This project contributes to multiple ARPA-E missions including reduction of foreign imports of energy, reduction of energy-related emissions including greenhouse gases, and ensuring that the United States maintains a technological lead in developing and deploying advanced energy technology. Furthermore, the developed tools could transform public and private plant breeding and could be broadly applicable to other crops and, potentially, other application areas. Our team of engineers, plant and soil scientists, and modelers i) developed an early prototype backscatter X-ray platform that can operate in field conditions; ii) developed a suite of root phenotyping and characterization approaches as described above; iii) developed and carried out plant biology and physiology roots studies and; iv) developed and implemented mechanistic physiological modeling.

42 ENGINEERING↗

Change Detection Applications in the Earth Sciences Using UAS-Based Sensing: A Review and Future Opportunities

Over the past decade, advancements in collection platforms such as unoccupied aerial systems (UAS), survey-grade GNSS, sensor packages, processing software, and spatial analytical tools have facilitated change detection analyses at an unprecedented resolution over broader spatial and temporal extents and in environments where such investigations present challenges. These technological improvements, coupled with the accessibility and versatility of UAS technology, have pushed the boundaries of spatial and temporal scales in geomorphic change detection. As a result, the cm-scale analysis of topographic signatures can detect and quantify surface anomalies during geomorphic evolution. This review focuses on the use of UAS photogrammetry for fine spatial (cm) and temporal (hours to days) scale geomorphic analyses, and it highlights analytical approaches to detect and quantify surface processes that were previously elusive. The review provides insight into topographic change characterization with precise spatial validations applied to landscape processes in various fields, such as the cryosphere and geosphere, as well as anthropogenic earth processes and national security applications. This work sheds light on previously unexplored aspects of both natural and human-engineered environments, demonstrating the potential of UAS observations in change detection. Our discussion examines the emerging horizons of UAS-based change detection, including machine learning and LIDAR systems. In addition, our meta-analysis of spatial and temporal UAS-based observations highlights the new fine-scale niche of UAS-photogrammetry. This scale advancement sets a new frontier in change detection, offering exciting possibilities for the future of land surface analysis and environmental monitoring in the field of Earth Science.

Andresen, Christian G.↗

A New Reflected Target Optical Assessment System: Stage 1 Development Results

NREL has completed stage 1 development of an indoor optical measurement tool for fully assembled heliostats and single facets. This tool began as an indoor version of NREL’s outdoor Non-Intrusive Optical (NIO) measurement technique [1]. It uses similar techniques to other available tools (deflectometry, photogrammetry, etc.), but is designed to require very little infrastructure, labor, and time to set up and collect surface slope and canting measurements, making it a valuable tool for quality assurance and laboratory measurement of heliostat optics. It accomplishes this by using computer vision, photogrammetry, and multiple images stitched together to minimize the printed target size and required setup precision. This adaptable setup is useful for taking measurements at a variety of heliostat pointing angles, and for measuring fully assembled heliostats on the assembly line. In this paper, we describe the methodology behind the measurement system, present an initial analysis of its uncertainty and sensitivity, and compare it with established optical measurement systems.

Kesseli, Devon (ORCID:0000000193113036)↗

Demonstration and Automation of Reflected Target Optical Measurement for Heliostats

Accurate optical surfaces are a primary driver of concentrated solar power plant performance. Errors in pointing and tracking mirrors, the canting of individual mirror facets, and the surface slope of the mirror itself can be caused by errors during assembly, transportation, wind loading, gravity, and many other sources. The tools that exist to measure these error sources today largely rely on fringe deflectometry (SOFAST, QDec, others), or photogrammetry with targets attached to the mirror surface. Since 2022, NREL has been developing a measurement method called the Reflected Target Non-intrusive Assessment (ReTNA) system. This system differs from most established methods in that we perform deflectometry with a pattern of coded targets, identified in space with photogrammetry. Reflected target systems have several advantages over traditional fringe deflectometry systems. Firstly, they can be operated in bright or ambient lighting, a challenge for fringe systems that use a projector and screen. Reflected target systems also can use a much lighter and less expensive target than projector-based systems. Lastly, 2D slope measurement can be solved from a single image, which leads to several advantages for accommodating faster measurements and smaller sized targets. These advantages make ReTNA particularly well-suited for applications where there are space or lighting constraints, like performing heliostat quality assurance on an assembly line. It's also useful when a lightweight, flexible system is needed, like for heliostat developers to quickly measure a new heliostat design at different orientations, to observe gravitational effects on the mirror surface shape. In the last year, significant improvements were made to this tool to make it more useful for these applications. These improvements were focused around validation of the ReTNA measurement system, and automation of the setup and measurement process. First, we present an improved ReTNA layout, for use on the heliostat assembly line. Next, we detail the various changes to the ReTNA software and computer vision methods to automate data collection in this new setup, and lessons learned from this process. The goal with this new setup is to perform a full heliostat surface characterization without removing the mirror from the assembly line. Lastly, we share results from several ReTNA validation studies undertaken over the last year. These include repeated ReTNA measurement on demonstration mirror facets, comparisons with other optical measurement tools, and some studies aimed at quantifying the uncertainty of ReTNA measurement under various constraints (mirror-target spacing, camera resolution, etc.). These results are compared with 2024 HelioCon performance targets, and our planned next steps for the ReTNA measurement system are presented.

CSP↗

Advancements in reflected target nonintrusive assessment (ReTNA) for large optical surface measurement

Reflected computer vision targets are a powerful tool for measurement of mirror surface shape, with several important advantages over traditional fringe deflectometry methods. This method was first presented in 2021 and has undergone significant improvement and demonstration since. We describe a new baseline system using reflected computer vision targets, and present results from a large-scale measurement campaign conducted on both commercial heliostats and test mirrors in the laboratory. Calibration of the measurement system with photogrammetry allows for accurate measurement without careful control of target shape or camera position. Overall, the results show that a baseline setup using this method achieves measurement uncertainties in the slope error root-mean-square less than ±0.11 milliradian due to a series of repeatability conditions, varying sample position, rotation, lighting, camera settings, and system rebuild and recalibration. We present a detailed description of the setup, the results generated by this measurement tool, repeated measurement results, and the strengths and limitations of this metrology system.

14 SOLAR ENERGY↗