Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Point Cloud Correspondance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Automated Point Cloud Correspondence Detection for Underwater Mapping Using AUVs

An algorithm for automating correspondence detection between point clouds composed of multibeam sonar data is presented. This allows accurate initialization for point cloud alignment techniques even in cases where accurate inertial navigation is not available, such as iceberg profiling or vehicles with low-grade inertial navigation systems. Techniques from computer vision literature are used to extract, label, and match keypoints between "pseudo-images" generated from these point clouds. Image matches are refined using RANSAC and information about the vehicle trajectory. The resulting correspondences can be used to initialize an iterative closest point (ICP) registration algorithm to estimate accumulated navigation error and aid in the creation of accurate, self-consistent maps. The results presented use multibeam sonar data obtained from multiple overlapping passes of an underwater canyon in Monterey Bay, California. Using strict matching criteria, the method detects 23 between-swath correspondence events in a set of 155 pseudo-images with zero false positives. Using less conservative matching criteria doubles the number of matches but introduces several false positive matches as well. Heuristics based on known vehicle trajectory information are used to eliminate these.

Sonar↗

Motion Estimation System Utilizing Point Cloud Registration

A system and method of estimation motion of a machine is disclosed. The method may include determining a first point cloud and a second point cloud corresponding to an environment in a vicinity of the machine. The method may further include generating a first extended gaussian image (EGI) for the first point cloud and a second EGI for the second point cloud. The method may further include determining a first EGI segment based on the first EGI and a second EGI segment based on the second EGI. The method may further include determining a first two dimensional distribution for points in the first EGI segment and a second two dimensional distribution for points in the second EGI segment. The method may further include estimating motion of the machine based on the first and second two dimensional distributions.

Chen, Qi↗

Automated cloud base height determination from high resolution Landsat data - A Hough transform approach

A direct method for determining the cloud base height derived from the displacement of the shadow from the cloud, and the solar azimuth and zenith angle is presented. Cumulus cloud scenes over land from Landsat MSS imagery are considered. The clouds are first matched with the corresponding shadows; the pixel distance of a reference point in the cloud is computed from the corresponding reference point in the shadow; and then the solar zenith angle is used to compute the cloud base height. Observations indicate that the cloud base height appears to be size-dependent with larger clouds generally associated with higher cloud bases and that clouds within the same size range and within the same scene region are approximately of the same height.

Sengupta, S. K.↗

Learning Canonical Embeddings for Unsupervised Shape Correspondence With Locally Linear Transformations

We present a new approach to unsupervised shape correspondence learning between pairs of point clouds. We make the first attempt to adapt the classical locally linear embedding algorithm (LLE)-originally designed for nonlinear dimensionality reduction-for shape correspondence. The key idea is to find dense correspondences between shapes by first obtaining high-dimensional neighborhood-preserving embeddings of low-dimensional point clouds and subsequently aligning the source and target embeddings using locally linear transformations. We demonstrate that learning the embedding using a new LLE-inspired point cloud reconstruction objective results in accurate shape correspondences. More specifically, the approach comprises an end-to-end learnable framework of extracting high-dimensional neighborhood-preserving embeddings, estimating locally linear transformations in the embedding space, and reconstructing shapes via divergence measure-based alignment of probability density functions built over reconstructed and target shapes. Our approach enforces embeddings of shapes in correspondence to lie in the same universal/canonical embedding space, which eventually helps regularize the learning process and leads to a simple nearest neighbors approach between shape embeddings for finding reliable correspondences. Comprehensive experiments show that the new method makes noticeable improvements over state-of-the-art approaches on standard shape correspondence benchmark datasets covering both human and nonhuman shapes.

deformation↗

Tightly-coupled camera/LiDAR integration for point cloud generation from GNSS/INS-assisted UAV mapping systems

Unmanned aerial vehicles (UAVs) equipped with integrated global navigation satellite systems/inertial navigation systems (GNSS/INS) together with cameras and/or LiDAR sensors are being widely used for topographic mapping in a variety of applications such as precision agriculture, coastal monitoring, and archaeological documentation. Integration of image-based and LiDAR point clouds can provide a comprehensive 3D model of the area of interest. For such integration, ensuring a good alignment between data from the different sources is critical. Although many works have been conducted on this topic, there is still a need for a rigorous integration approach that minimizes the discrepancy between camera and LiDAR data caused by inaccurate system calibration parameters and/or trajectory artifacts. This study proposes an automated tightly-coupled camera/LiDAR integration workflow for GNSS/INS-assisted UAV systems. The proposed strategy is conducted in three main steps. First, an image-based point cloud is generated using a LiDAR/GNSS/INS-assisted structure from motion (SfM) strategy. Then, feature correspondences between image-based and LiDAR point clouds are automatically identified. Finally, an integrated-bundle adjustment procedure including image points, LiDAR raw measurements, and GNSS/INS information is conducted to minimize the discrepancy between point clouds from different sensors while estimating system calibration parameters and refining the trajectory information. The proposed SfM strategy and integration framework are evaluated using five datasets. The SfM results show that using LiDAR data can facilitate feature matching and further increase the number of reconstructed 3D points. The experimental results also illustrate that the developed automated camera/LiDAR integration strategy is capable of accurately estimating system calibration parameters to achieve good alignment among camera/LiDAR data from single/multiple systems. Finally, an absolute accuracy in the range of 3–5 cm is achieved for the image/LiDAR point clouds after the integration process.

42 ENGINEERING↗

LiDAR-Aided Interior Orientation Parameters Refinement Strategy for Consumer-Grade Cameras Onboard UAV Remote Sensing Systems

Unmanned aerial vehicles (UAVs) are quickly emerging as a popular platform for 3D reconstruction/modeling in various applications such as precision agriculture, coastal monitoring, and emergency management. For such applications, LiDAR and frame cameras are the two most commonly used sensors for 3D mapping of the object space. For example, point clouds for the area of interest can be directly derived from LiDAR sensors onboard UAVs equipped with integrated global navigation satellite systems and inertial navigation systems (GNSS/INS). Imagery-based mapping, on the other hand, is considered to be a cost-effective and practical option and is often conducted by generating point clouds and orthophotos using structure from motion (SfM) techniques. Mapping with photogrammetric approaches requires accurate camera interior orientation parameters (IOPs), especially when direct georeferencing is utilized. Most state-of-the-art approaches for determining/refining camera IOPs depend on ground control points (GCPs). However, establishing GCPs is expensive and labor-intensive, and more importantly, the distribution and number of GCPs are usually less than optimal to provide adequate control for determining and/or refining camera IOPs. Moreover, consumer-grade cameras with unstable IOPs have been widely used for mapping applications. Therefore, in such scenarios, where frequent camera calibration or IOP refinement is required, GCP-based approaches are impractical. To eliminate the need for GCPs, this study uses LiDAR data as a reference surface to perform in situ refinement of camera IOPs. The proposed refinement strategy is conducted in three main steps. An image-based sparse point cloud is first generated via a GNSS/INS-assisted SfM strategy. Then, LiDAR points corresponding to the resultant image-based sparse point cloud are identified through an iterative plane fitting approach and are referred to as LiDAR control points (LCPs). Finally, IOPs of the utilized camera are refined through a GNSS/INS-assisted bundle adjustment procedure using LCPs. Seven datasets over two study sites with a variety of geomorphic features are used to evaluate the performance of the developed strategy. The results illustrate the ability of the proposed approach to achieve an object space absolute accuracy of 3–5 cm (i.e., 5–10 times the ground sampling distance) at a 41 m flying height.

47 OTHER INSTRUMENTATION↗

Cumulus cloud base height estimation from high spatial resolution Landsat data - A Hough transform approach

A semiautomated methodology is developed for estimating cumulus cloud base heights on the basis of high spatial resolution Landsat MSS data, using various image-processing techniques to match cloud edges with their corresponding shadow edges. The cloud base height is then estimated by computing the separation distance between the corresponding generalized Hough transform reference points. The differences between the cloud base heights computed by these means and a manual verification technique are of the order of 100 m or less; accuracies of 50-70 m may soon be possible via EOS instruments.

Berendes, Todd↗

Object Detection and Recognition with PointPillars in LiDAR Point Clouds – Comparisions

In the field of autonomous systems, neural networks have been leveraged for object detection and recognition in 2-dimensional images captured by cameras. Other types of sensors are available for sensing surroundings, including LiDAR sensors, and corresponding networks have been developed to perform detection and recognition in the point clouds generated by these sensors. The approaches are similar, both perform convolutions, but have distinct characteristics and challenges. In designing and configuring autonomous systems, a variety of LiDAR sensors are available, along with configurable deep neural networks to leverage their data. This work presents a review of the PointPillars network, an evolution of the seminal PointNet, comparing accuracy and training time relative to different LiDAR sensors, network and training parameters, CPU and GPU hardware, and the criticality of the use of reflective intensity as a feature. The value of using reflectivity as a predictive feature is explored and quantified to determine if it makes a significant difference in accuracy of the PointPillars network. Two separate LiDAR sensors are utilized, a 16-plane and a 32-plane, and corresponding accuracies and training times with the PointPillars network are evaluated.

LiDAR, machine learning, neural network, object re↗

A2Cloud‐RF : A random forest based statistical framework to guide resource selection for high‐performance scientific computing on the cloud

Summary This article proposes a random‐forest based A2Cloud framework to match scientific applications with Cloud providers and their instances for high performance. The framework leverages four engines for this task: PERF engine, Cloud trace engine, A2Cloud‐ext engine, and the random forest classifier (RFC) engine. The PERF engine profiles the application to obtain performance characteristics, including the number of single‐precision (SP) floating‐point operations (FLOPs), double‐precision (DP) FLOPs, x87 operations, memory accesses, and disk accesses. The Cloud trace engine obtains the corresponding performance characteristics of the selected Cloud instances including: SP floating point operations per second (FLOPS), DP FLOPS, x87 operations per second, memory bandwidth, and disk bandwidth. The A2Cloud‐ext engine uses the application and Cloud instance characteristics to generate objective scores that represent the application‐to‐Cloud match. The RFC engine uses these objective scores to generate two types of random forests to assist users with rapid analysis: application‐specific random forests (ARF) and application‐class based random forests. The ARF consider only the input application's characteristics to generate a random forest and provide numerical ratings to the selected Cloud instances. To generate the application‐class based random forests, the RFC engine downloads the application profiles and scores of previously tested applications that perform similar to the input application. Using these data, the RFC engine creates a random forest for instance recommendation. We exhaustively test this framework using eight real‐world applications across 12 instances from different Cloud providers. Our tests show significant statistical agreement between the instance ratings given by the framework and the ratings obtained via actual Cloud executions.

Samuel, David↗

Automatic Segmentation of Building Envelope Point Cloud Data Using Machine Learning

About 50% of buildings in the US were constructed before energy codes were introduced. Modular overclad panel retrofits, in which a new envelope is constructed over the existing building, are a promising solution given that it minimizes occupant disruption and shortens construction time at the jobsite. Current state-of-the-art retrofit panel layout and dimensioning consists of three steps: 1) 3D point cloud data generation of the building envelope using commonly available surveying equipment, 2) manual segmentation of 3D point cloud data by a trained professional to identify and dimension window openings, door openings, and other architectural features, and 3) modular panel layout optimization and dimensioning by an architect or engineer. Among these steps, the second one remains the most difficult and costly because it is very labor-intensive. We propose a methodology to automatically label 3D point cloud data to reduce the time and expense spent in manual segmentation. Machine learning methods were employed to classify the point cloud data into distinct groups, each of which corresponds to different features of the building envelope. After classification, a segmentation algorithm was developed to perform boundary detection and separate the components of the façade. Finally, the algorithm returns the relative positions and dimensions of the features in the building envelope. The measurements obtained with the proposed automated method were compared against the actual dimensions to determine the overall algorithm accuracy. The proposed algorithm can then be used to reduce manual efforts for 3D point cloud labeling before modular panel layout optimization is performed.

Maldonado Puente, Bryan↗

Quality control and crop characterization framework for multi-temporal UAV LiDAR data over mechanized agricultural fields

Recent developments in remote sensing are enabling automatic, high resolution, and non-destructive survey of agriculture fields, providing the key basis for advancing plant breeding. Among the used remote sensing modalities, LiDAR has attracted wide attention for its ability to directly provide accurate 3D information. Despite the increasing utilization of LiDAR technology in phenotyping, there is still a lack of effective quality control strategies, in particular, quality control of LiDAR data collected on a multi-temporal basis. This study proposes a targetless framework for multi-temporal LiDAR data quality control and crop characterization in mechanized agricultural fields. Features extracted from the fields – terrain patches and row/alley locations – are utilized for evaluating the vertical and planimetric relative accuracy of the point clouds. Row/alley locations in the field are automatically identified from the point clouds based on the assumption that higher point density and/or higher elevation correspond to plant locations. The performance of the proposed quality control strategies is evaluated using multi-temporal datasets collected in agricultural fields of different sizes, orientation, crops, and growth stages. The result shows that the net vertical and planimetric discrepancies between multi-temporal point clouds are ±3 cm and ±8 cm, respectively. While the former reflects the actual accuracy of the point clouds, the latter is a combined effect of the LiDAR point cloud accuracy, rasterization artifacts, crop type, growth pattern, and wind condition during data acquisition. In terms of row and alley detection, the result shows that the proposed strategy achieves high performance and can deal with different planting orientation, crop types, growth stages, canopy cover, and planting density. In conclusion, this study presents a quality control framework for multi-temporal LiDAR data. Finally, the row and alley detection leads to automated extraction of plots, and hence facilitates the use of remotely sensed data for automated phenotyping.

54 ENVIRONMENTAL SCIENCES↗

Saturation point structure of marine stratocumulus clouds

An investigation of the microstructure of a Pacific stratocumulus capped boundary layer is presented. A complex structure of three branches, identified using conserved variable diagrams, is found to correspond well to a conceptual model for the unstable, radiatively cooled cloud topped boundary layer. A simple conditional sampling method was used to identify saturation point pairs for ascending and descending branches of the internal boundary layer circulation. Results indicate a primary circulation scale of 5 km and provide a reasonable cloud top entrainment rate of 1 cm/s.

Boers, Reinout↗

Standoff inspection using geometry-informed full-wavefield response measurements

A vibrometer may measure acoustic responses in portions of a structure along a scan path to acoustic excitation of the structure. A ranging device may measure distances to the portions of the structure along the scan path. A three-dimensional point cloud may be generated based on the acoustic responses in the portions of the structure and the distances to the portions of the structure. The three-dimensional point cloud may include points representing geometry of the portions of the structure. The points may be associated with the acoustic responses in corresponding portions of the structure. One or more properties of the structure may be determined based on an analysis of the three-dimensional point cloud.

Flynn, Eric Brian↗

Creating User-Friendly Tools for Data Analysis and Visualization in K-12 Classrooms: A Fortran Dinosaur Meets Generation Y

During the summer of 2007, as part of the second year of a NASA-funded project in partnership with Christopher Newport University called SPHERE (Students as Professionals Helping Educators Research the Earth), a group of undergraduate students spent 8 weeks in a research internship at or near NASA Langley Research Center. Three students from this group formed the Clouds group along with a NASA mentor (Chambers), and the brief addition of a local high school student fulfilling a mentorship requirement. The Clouds group was given the task of exploring and analyzing ground-based cloud observations obtained by K-12 students as part of the Students' Cloud Observations On-Line (S'COOL) Project, and the corresponding satellite data. This project began in 1997. The primary analysis tools developed for it were in FORTRAN, a computer language none of the students were familiar with. While they persevered through computer challenges and picky syntax, it eventually became obvious that this was not the most fruitful approach for a project aimed at motivating K-12 students to do their own data analysis. Thus, about halfway through the summer the group shifted its focus to more modern data analysis and visualization tools, namely spreadsheets and Google(tm) Earth. The result of their efforts, so far, is two different Excel spreadsheets and a Google(tm) Earth file. The spreadsheets are set up to allow participating classrooms to paste in a particular dataset of interest, using the standard S'COOL format, and easily perform a variety of analyses and comparisons of the ground cloud observation reports and their correspondence with the satellite data. This includes summarizing cloud occurrence and cloud cover statistics, and comparing cloud cover measurements from the two points of view. A visual classification tool is also provided to compare the cloud levels reported from the two viewpoints. This provides a statistical counterpart to the existing S'COOL data visualization tool, which is used for individual ground-to-satellite correspondences. The Google(tm) Earth file contains a set of placemarks and ground overlays to show participating students the area around their school that the satellite is measuring. This approach will be automated and made interactive by the S'COOL database expert and will also be used to help refine the latitude/longitude location of the participating schools. Once complete, these new data analysis tools will be posted on the S'COOL website for use by the project participants in schools around the US and the world.

Chambers, L. H.↗

Simplified Approximations of Direct Cumulus Entrainment and Detrainment

Abstract In recent years, direct calculations of simulated cumulus entrainment and detrainment have facilitated new physical insights into these highly elusive but critically important processes. However, these calculations require substantial computational resources that may limit their widespread usage. To facilitate such calculations, two simplified approximations of direct cumulus entrainment and detrainment are examined herein. The first approximation, termed the “semidirect” method, follows a standard bulk approach but makes more realistic assumptions about the sources of entrained and detrained air near the cloud edges. In contrast, the second approximation (the “projection” method) uses the governing equations of motion to project whether grid points near the cloud edge will entrain or detrain as the mean cloud ascends by one grid point. Verification exercises using large-eddy simulations reveal that both methods generally agree better with corresponding direct entrainment/detrainment estimates than the traditional bulk formulation, with the projection method outperforming the semidirect method. The two methods can be used in a synergistic fashion, with the semidirect method helping to optimize the projection method, to suit a wide range of applications. Because the latter incorporates the essential dynamics of entrainment and detrainment at the local scale, it can be used to gain physical insight into the causal mechanisms regulating these complex processes.

Meteorology & Atmospheric Sciences↗

Superior performance biodiesel from biomass-derived fusel alcohols and low grade oils: Fatty acid fusel esters (FAFE)

We demonstrated production of a superior performance biodiesel referred to here as fatty acid fusel alcohol esters (FAFE) – by reacting fusel alcohols (isobutanol, 3-methyl-1-butanol, and (S)-(-)-2-methyl-1-butanol) with oil (glyceryl trioleate) using lipase from Aspergillus oryzae. Reaction conditions corresponding to a molar ratio of 5:1 (fusel alcohols to oil), enzyme loading of 2% w/w, reaction temperature of 35 °C, shaking speed of 250 rpm, and reaction time of 24 h achieved >97% conversion to FAFE. Further, FAFE obtained from reacting a fusel alcohol mixture with corn oil were evaluated for use as a fuel for diesel engines. FAFE mixtures showed superior combustion and cold-flow properties, with the derived cetane numbers up to 4.8 points higher, cloud points up to -6 °C lower, and the heat of combustion up to 2.1% higher than the corresponding FAME samples, depending on the fusel mixture used. This represents a significant improvement for all three metrics, which are typically anti-correlated. Finally, FAFE provides a new opportunity for expanded usage of biodiesel by addressing feedstock limitations, fuel performance, and low temperature tolerance.

09 BIOMASS FUELS↗

Mixtures of CO 2 and poly(fluoroacrylate) based on monomers containing only six or four fluorinated carbons: Phase behavior and solution viscosity

In this study, homopolymerization of fluoroacrylate monomers containing a segment with eight fluorinated carbons, (CH 2 CHCOO(CH 2 ) 2 (CF 2 ) 7 CF 3 ), yield poly(fluoroacrylate) (PFA) with remarkably high solubility in CO 2 , but the corresponding ultimate PFA degradation product perfluorooctanoic acid (PFOA) is bio-accumulative. Based on cloud point loci in the 1–4 wt% PFA in CO 2 concentration range at temperatures of 25, 50, 75, 100 and 125°C, it is shown that C 6 F 13 -based and C 4 F 9 -based PFA, with relatively benign degradation products perfluorohexanoic acid (PFHxA) and perfluorobutanoic acid (PFBA), respectively, retain the same level of CO 2 -solubility as that of C 8 F 17 -based PFA. Further, both C 6 F 13 -based and C 4 F 9 -based PFA can increase the viscosity of single-phase CO 2 -PFA solutions (i.e. thicken CO 2 ) as much as C 8 F 17 -based PFA in the 25–125°C range. Therefore, the design of CO 2 -soluble PFA need not be constrained to monomers containing the C 8 F 17 moiety; fluoroacrylate monomers containing shorter fluoroalkyl segments with only four or six fluorocarbons can be utilized.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Fusion of Surface Ceilometer Data and Satellite Cloud Retrievals in 2D Mesh Interpolating Model with Clustering

For accurate cloud ceiling information, a data fusion approach is proposed that utilizes satellite data to extend surface station information to much wider areas. Cloud base height (CBH) retrieved from satellite observations provides for much larger spatial coverage and higher resolution. The direct comparison of GOES-16 CBH with surface station ceiling yields a local bias that has to be corrected for in the initial GOES-16 cloud base information. This sparsely sampled bias correction presents an irregular 2D mesh of control points, which is then interpolated by constructing a continuous smooth field using polyharmonic splines. The influence of remote stations is restricted by grouping the control points into clusters depending on an effective distance. This cluster-based approach allows for constructing separate spline surfaces corresponding to physically different clouds. The obtained continuous bias correction function is then applied to the entire GOES-16 pixel level CBH except for areas far away from surface stations in data sparse regions such as offshore. The described method is currently being tested using daytime-only observations over the central and eastern United States. Overall, this approach has potential to provide more accurate, high spatial resolution cloud ceiling information for the aviation community.

Khlopenkov, Konstantin↗