Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Spatial data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Modified Recursive Hierarchical Segmentation of Data

An algorithm and a computer program that implements the algorithm that performs recursive hierarchical segmentation (RHSEG) of data have been developed. While the current implementation is for two-dimensional data having spatial characteristics (e.g., image, spectral, or spectral-image data), the generalized algorithm also applies to three-dimensional or higher dimensional data and also to data with no spatial characteristics. The algorithm and software are modified versions of a prior RHSEG algorithm and software, the outputs of which often contain processing-window artifacts including, for example, spurious segmentation-image regions along the boundaries of processing-window edges.

Tilton, James C.↗

Mapping Vegetation at Species Level with High-Resolution Multispectral and Lidar Data Over a Large Spatial Area: A Case Study with Kudzu

Mapping vegetation species is critical to facilitate related quantitative assessment, and mapping invasive plants is important to enhance monitoring and management activities. Integrating high-resolution multispectral remote-sensing (RS) images and lidar (light detection and ranging) point clouds can provide robust features for vegetation mapping. However, using multiple sources of high-resolution RS data for vegetation mapping on a large spatial scale can be both computationally and sampling intensive. Here, we designed a two-step classification workflow to potentially decrease computational cost and sampling effort and to increase classification accuracy by integrating multispectral and lidar data in order to derive spectral, textural, and structural features for mapping target vegetation species. We used this workflow to classify kudzu, an aggressive invasive vine, in the entire Knox County (1362 km2) of Tennessee (U.S.). Object-based image analysis was conducted in the workflow. The first-step classification used 320 kudzu samples and extensive, coarsely labeled samples (based on national land cover) to generate an overprediction map of kudzu using random forest (RF). For the second step, 350 samples were randomly extracted from the overpredicted kudzu and labeled manually for the final prediction using RF and support vector machine (SVM). Computationally intensive features were only used for the second-step classification. SVM had constantly better accuracy than RF, and the producer’s accuracy, user’s accuracy, and Kappa for the SVM model on kudzu were 0.94, 0.96, and 0.90, respectively. SVM predicted 1010 kudzu patches covering 1.29 km2 in Knox County. We found the sample size of kudzu used for algorithm training impacted the accuracy and number of kudzu predicted. The proposed workflow could also improve sampling efficiency and specificity. Our workflow had much higher accuracy than the traditional method conducted in this research, and could be easily implemented to map kudzu in other regions as well as map other vegetation species.

59 BASIC BIOLOGICAL SCIENCES↗

Graph convolutional networks applied to unstructured flow field data

Abstract Many scientific and engineering processes produce spatially unstructured data. However, most data-driven models require a feature matrix that enforces both a set number and order of features for each sample. They thus cannot be easily constructed for an unstructured dataset. Therefore, a graph based data-driven model to perform inference on fields defined on an unstructured mesh, using a graph convolutional neural network (GCNN) is presented. The ability of the method to predict global properties from spatially irregular measurements with high accuracy is demonstrated by predicting the drag force associated with laminar flow around airfoils from scattered velocity measurements. The network can infer from field samples at different resolutions, and is invariant to the order in which the measurements within each sample are presented. The GCNN method, using inductive convolutional layers and adaptive pooling, is able to predict this quantity with a validation R 2 above 0.98, and a Normalized Mean Squared Error below 0.01, without relying on spatial structure.

Ogoke, Francis (ORCID:0000000224327783)↗

Use of Mass spectrometry for imaging metabolites in plants

We discuss and illustrate recent advances that have been made to image the distribution of metabolites among cells and tissues of plants using different mass spectrometry technologies. These technologies include matrix-assisted laser desorption ionization, desorption electrospray ionization, and secondary ion mass spectrometry. These are relatively new technological applications of mass spectrometry and they are providing highly spatially resolved data concerning the cellular distribution of metabolites. We discuss the advantages and limitations of each of these mass spectrometric methods, and provide a description of the technical barriers that are currently limiting the technology to the level of single-cell resolution. However, we anticipate that advances in the next few years will increase the resolving power of the technology to provide unprecedented data on the distribution of metabolites at the subcellular level, which will increase our ability to decipher new knowledge concerning the spatial organization of metabolic processes in plants.

36 MATERIALS SCIENCE↗

Fine-scale structure in the far-infrared Milky-Way

This final report summarizes the work performed and which falls into five broad categories: (1) generation of a new data product (mosaics of the far-infrared emission in the Milky Way); (2) acquisition of associated data products at other wavelengths; (3) spatial filtering of the far-infrared mosaics and resulting images of the FIR fine-scale structure; (4) evaluation of the spatially filtered data; (5) characterization of the FIR fine-scale structure in terms of its spatial statistics; and (6) identification of interstellar counterparts to the FIR fine-scale structure.

Waller, William H.↗

Transportation Secure Data Center

The Transportation Secure Data Center (TSDC) provides free access to detailed transportation data from a variety of travel surveys and studies conducted across the nation. Data include global positioning system (GPS) readings for millions of miles of travel, along with vehicle characteristics and survey participant demographics. NREL screens the initial data for quality control, translates each data set into a consistent format, and interprets the data for spatial analysis. NREL's processing routines add information on vehicle fuel economy and road grades and join data points to the road network.

Array↗

Remote Sensing, Uncertainty Quantification, and a Theory of Data Systems; Workshop Report

The purpose of the workshop was to invite statisticians, applied mathematicians, computer scientists, data system architects, experts in remote sensing technology, and Climate and Earth System scientists to review, discuss, and plan research on issues related to large-scale, efficient analysis of distributed data using spatial statistical methods. Our motivation in organizing this event was to catalyze interchange among experts on the fast-emerging problem of analysis of distributed data. As part of SAMSI's 2017-2018 Program on Mathematical and Statistical Methods for Climate and the Earth System, a Working Group on Remote Sensing was established to address statistical and mathematical research problems in the analysis of remote sensing data. The Working Group has five subgroups: 1) Spatial Retrieval Methodology (the so-called \Spatial-X" subgroup); 2) Spatial Analysis for Hyperspectral Data (the so-called \Spatial-Y" subgroup); 3) Emulators for Complex Forward Models; 4) Optimization for Remote Sensing Retrievals; and 5) Theory of Data Systems (ToDS). The ToDS subgroup spent the first half of this academic year formulating a framework in which to consider the joint problem of a) optimizing statistical methods for environments where data are distributed and too large to move to a central location, and b) the design of data system infrastructures within which to implement those statistical methods. To x ideas, the Workshop focused on spatial statistical methods. To date there are many new spatial statistical methods designed with massive data sets in mind, in the literature. However, very few have been implemented for remote sensing data, and none have been implemented in operational settings like those used by NASA and NOAA. A major impediment to their use in these cases is that the data are not only massive, but are stored in different physical locations. These data must be brought together in some way in order to estimate spatial covariance functions, but moving data to a central location for analysis is tedious at best and impossible at worst. Some remote data reduction is almost certainly necessary, but how much? What are the consequences for inference? The fundamental issue underlying these questions is how to navigate the trade-space between costs and uncertainty in the estimates or inferences that are ultimately produced.

Braverman, Amy↗

Using spatial statistical methods to determine an effective minimum detectable activity - 15681

Instrument minimum detectable activity (MDA) is generally established by collecting multiple measurements over time of a single representative background location to estimate a probability distribution of instrument readings. A reading that is considered to be greater than would be expected from the background probability distribution (i.e., a low-probability event) is deemed to be sufficiently unlikely that it must be attributable to added radioactivity and is therefore used as the instrument MDA. An effective MDA can be determined from spatially distributed data that are much lower than the instrument MDA. This has been accomplished using a large number of spatially distributed data points (from a radiation survey) where patterns of elevated survey readings can be distinguished from background at levels. Given the variation of the instrument response and the relatively low regulatory action levels, it is vital to establish MDA thresholds that are well below corrective action levels. Processing of radiological survey data with the use of histogram binning and geo-statistics in enabling pattern recognition can be used to establish effective field MDAs that are much lower than instrument MDAs. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Spatial Variation of Surface Moisture Fluxes in SGP

Analysis of aircraft data in "spatial variations of surface moisture flux from aircraft data" indicates that the impact of small-scale surface heterogeneity on the spatial variation of surface moisture fluxes into the atmosphere is reduced by horizontal mixing. This mixing generally increases with the development of the daytime convective mixed layer, thus reducing the relative influence of surface heterogeneity on the spatial variation of moisture fluxes.

Mahrt, L.↗

A Method for Obtaining High Time and Spatial Resolution Convective Cloud Top Data for the TTL

A method for obtaining high time and spatial resolution convective cloud top data for the TTL Leonhard Pfister, Eric Jensen, Rei Ueyama, Eliot Atlas, and Maria Navarro Convective systems in the tropics have a maximum in the cloud top altitude distribution of about 13.5 km. However, there is a significant tail to this distribution -- a few percent reach the cold point tropopause (CPT) at 16.5 km, and there has been clear evidence of convective mass deposited as high as 19 km in the tropics. The region between 13.5 km and the cold point tropopause is transitional, between the free tropical troposphere where convective mixing dominates, and the stratosphere where slow upward ascent dominates. In this region (the Tropical Tropopause Layer), convective injection, slow ascent, and mixing from midlatitudes all have similar time scales. So, even though only a few percent of convective systems reach the CPT, convection is important. Space Based Lidar and cloud radar measurements have yielded information about long term average statistical distributions of cloud altitude as a function of location. However, we also need time-dependent cloud top altitude and cloud top potential temperature information, primarily to understand the water vapor and TTL cloud distributions. This is because the effect of convection depends on the local temperature, and on the subsequent temperature history. Time dependent cloud top information is also needed to understand short-lived tracers because cross-isentropic flow is time and space dependent. This paper presents a method of obtaining time and space dependent convective cloud top theta (and altitude) information using 3-hourly geostationary brightness temperature data, coupled with global 3 -hourly rainfall estimates and temperature analyses. We explore different mixing algorithms to obtain the most reasonable agreement with near-simultaneous observations by cloudsat and calipso. Observations of short-lived tracers from ATTREX, coupled with short-term trajectories are used to test the method's accuracy. An important caveat is the ambiguity of evaluating convective cloud top altitudes under from combined cloudsat and calipso measurements.

cold point tropopause (CPT)↗

Validation of finite-element models using full-field experimental data: Levelling finite-element analysis data through a digital image correlation engine

Full-field data from digital image correlation (DIC) provide rich information for finite-element analysis (FEA) validation. However, there are several inherent inconsistencies between FEA and DIC data that must be rectified before meaningful, quantitative comparisons can be made, including strain formulations, coordinate systems, data locations, strain calculation algorithms, spatial resolutions and data filtering. As such, in this paper, we investigate two full-field validation approaches: (1) the direct interpolation approach, which addresses the first three inconsistencies by interpolating the quantity of interest from one mesh to the other, and (2) the proposed DIC-levelling approach, which addresses all six inconsistencies simultaneously by processing the FEA data through a stereo-DIC simulator to ‘level’ the FEA data to the DIC data in a regularisation sense. Synthetic ‘experimental’ DIC data were generated based on a reference FEA of an exemplar test specimen. The direct interpolation approach was applied, and significant strain errorswere computed, even though therewas no model form error, because the filtering effect of theDIC enginewas neglected. In contrast, the levelling approach provided accurate validation results, with no strain error when no model form error was present. Next, model form error was purposefully introduced via a mismatch of boundary conditions. With the direct interpolation approach, the mismatch in boundary conditions was completely obfuscated, while with the levelling approach, it was clearly observed. Finally, the ‘experimental’ DIC datawere purposefully misaligned slightly fromthe FEA data. Both validation techniques suffered from the misalignment, thus motivating continued efforts to develop a robust alignment process. In conclusion, direct interpolation is insufficient, and the proposed levelling approach is required to ensure that the FEA and the DIC data have the same spatial resolution and data filtering. Only after the FEA data have been ‘levelled’ to the DIC data can meaningful, quantitative error maps be computed.

42 ENGINEERING↗

A means for utilizing ancillary information in multispectral classification

Attention is given to a method which makes it possible to incorporate information from ancillary data sources into the results of an existing classification of remotely sensed data. The method is based upon probabilistic label relaxation procedures which are used for imbedding spatial context data in image-labeling problems. The source of ancillary information is utilized in the form of a set of probabilities. These are introduced into a modified relaxation method called supervised relaxation labeling which, on application, develops a labeling for remotely sensed data that strikes a balance in consistency between spectral, spatial, and ancillary data sources of information. A description is given of results of a forestry classification in which accuracy is improved from 68% to 81% by incorporating topographic elevation in the outlined manner.

Richards, J. A.↗

Geographic Information Systems and Martian Data: Compatibility and Analysis

Planning future landed Mars missions depends on accurate, informed data. This research has created and used spatially referenced instrument data from NASA missions such as the Thermal Emission Imaging System (THEMIS) on the Mars Odyssey Orbiter and the Mars Orbital Camera (MOC) on the Mars Global Surveyor (MGS) Orbiter. Creating spatially referenced data enables its use in Geographic Information Systems (GIS) such as ArcGIS. It has then been possible to integrate this spatially referenced data with global base maps and build and populate location based databases that are easy to access.

Jones, Jennifer L.↗

Improvement in Recursive Hierarchical Segmentation of Data

A further modification has been made in the algorithm and implementing software reported in Modified Recursive Hierarchical Segmentation of Data (GSC- 14681-1), NASA Tech Briefs, Vol. 30, No. 6 (June 2006), page 51. That software performs recursive hierarchical segmentation of data having spatial characteristics (e.g., spectral-image data). The output of a prior version of the software contained artifacts, including spurious segmentation-image regions bounded by processing-window edges. The modification for suppressing the artifacts, mentioned in the cited article, was addition of a subroutine that analyzes data in the vicinities of seams to find pairs of regions that tend to lie adjacent to each other on opposite sides of the seams. Within each such pair, pixels in one region that are more similar to pixels in the other region are reassigned to the other region. The present modification provides for a parameter ranging from 0 to 1 for controlling the relative priority of merges between spatially adjacent and spatially non-adjacent regions. At 1, spatially-adjacent-/spatially- non-adjacent-region merges have equal priority. At 0, only spatially-adjacent-region merges (no spectral clustering) are allowed. Between 0 and 1, spatially-adjacent- region merges have priority over spatially- non-adjacent ones.

Tilton, James C.↗

A lightweight I/O scheme to facilitate spatial and temporal queries of scientific data analytics

In the era of petascale computing, more scientific applications are being deployed on leadership scale computing platforms to enhance the scientific productivity. Many I/O techniques have been designed to address the growing I/O bottleneck on large-scale systems by handling massive scientific data in a holistic manner. While such techniques have been leveraged in a wide range of applications, they have not been shown as adequate for many mission critical applications, particularly in data postprocessing stage. One of the examples is that some scientific applications generate datasets composed of a vast amount of small data elements that are organized along many spatial and temporal dimensions but require sophisticated data analytics on one or more dimensions. Including such dimensional knowledge into data organization can be beneficial to the efficiency of data post-processing, which is often missing from exiting I/O techniques. In this study, we propose a novel I/O scheme named STAR (Spatial and Temporal AggRegation) to enable high performance data queries for scientific analytics. STAR is able to dive into the massive data, identify the spatial and temporal relationships among data variables, and accordingly organize them into an optimized multi-dimensional data structure before storing to the storage. This technique not only facilitates the common access patterns of data analytics, but also further reduces the application turnaround time. In particular, STAR is able to enable efficient data queries along the time dimension, a practice common in scientific analytics but not yet supported by existing I/O techniques. In our case study with a critical climate modeling application GEOS-5, the experimental results on Jaguar supercomputer demonstrate an improvement up to 73 times for the read performance compared to the original I/O method.

Tian, Yuan↗

A Lightweight I/O Scheme to Facilitate Spatial and Temporal Queries of Scientific Data Analytics

In the era of petascale computing, more scientific applications are being deployed on leadership scale computing platforms to enhance the scientific productivity. Many I/O techniques have been designed to address the growing I/O bottleneck on large-scale systems by handling massive scientific data in a holistic manner. While such techniques have been leveraged in a wide range of applications, they have not been shown as adequate for many mission critical applications, particularly in data post-processing stage. One of the examples is that some scientific applications generate datasets composed of a vast amount of small data elements that are organized along many spatial and temporal dimensions but require sophisticated data analytics on one or more dimensions. Including such dimensional knowledge into data organization can be beneficial to the efficiency of data post-processing, which is often missing from exiting I/O techniques. In this study, we propose a novel I/O scheme named STAR (Spatial and Temporal AggRegation) to enable high performance data queries for scientific analytics. STAR is able to dive into the massive data, identify the spatial and temporal relationships among data variables, and accordingly organize them into an optimized multi-dimensional data structure before storing to the storage. This technique not only facilitates the common access patterns of data analytics, but also further reduces the application turnaround time. In particular, STAR is able to enable efficient data queries along the time dimension, a practice common in scientific analytics but not yet supported by existing I/O techniques. In our case study with a critical climate modeling application GEOS-5, the experimental results on Jaguar supercomputer demonstrate an improvement up to 73 times for the read performance compared to the original I/O method.

Temporal Queries↗

Interpreting mixing relationships in energetic melts to estimate vapor contribution and composition

Heterogeneous, glassy debris can be produced by energetic events such as near surface nuclear explosions and asteroid impacts. In these events, the resultant debris comprises a rapidly-cooled mixture of the projectile or bomb material with proximate materials such as soil and anthropogenic structures. Glasses formed in these events preserve inter and/or intra sample compositional variation reflecting complex mixtures of the precursor materials or their chemically fractionated products. Understanding formation mechanisms and chemical processes relating to energetic glass formation based on study of the end products requires an objective method for calculating the precursor components that mixed together to produce the final product. Here, we compare a set of multivariate linear-least squares approaches to address the unmixing problem of heterogeneous glasses including classical least squares (CLS), principal component analysis (PCA) and two multivariate curve resolution – alternating least squares (MCR-ALS) approaches. We generate a synthetic data set representing spatially resolved, compositional data in a set of heterogeneously mixed glasses to understand model sensitivity to precursor abundance and composition. We explore the impact of incomplete knowledge of the system prior to the formation of the melts on the resulting confidence and accuracy of the solution (i.e., the number, composition, and abundances of the precursor materials). We conclude that a closure and equality constrained MCR-ALS approach succeeds in identifying unrecognized precursor components and is a suitable alternative to CLS approaches when the investigator has incomplete knowledge of the starting precursor chemical compositions. Finally, we demonstrate application of this MCR-ALS approach to measurements of Trinitite.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Carbon Storage Technical Viability Approach (CS TVA) Database

The Carbon Storage Technical Viability Approach (CS TVA) database was developed to support the implementation of the CS TVA Matrix to a national data availability assessment for technically viable carbon storage. This database leverages the efforts of multiple adjacent and overlapping databases by non-redundantly combining the databases into a single database along with additionally providing tags facilitating the CS TVA. The non-redundant aspect of the database permits an accurate assessment of the concentration of available data, aiding in spatial and categorical data gaps analysis relative to the individual CS TVA Matrix Components. Version 2.0 of the database is an expansion of Version 1.0. Version 2.0 was created to include additional data gathered to fill gaps in the existing data set. Downloading the CS TVA v2.0 database will result in two separate databases, the version 1.0 original .gdb, and a second addendum .gdb with the new data gathered, together these two databases make up v2.0. Please see the ReadMe file below for full details, metadata information, use disclaimer, and attributions.

Coal↗