Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Spatial Metadata”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Eureka: Enabling Fine-Grained Access and Range Queries on Compressed Scientific Data via Data-Index Co-Compression

Handling large-scale scientific data in high-performance computing (HPC) environments poses significant challenges, including excessive I/O, high storage costs, and slow query performance. Traditional approaches often require full data decompression and scans, making them impractical for real-time or interactive analysis. To address these limitations, we introduce Eureka, a unified data-index co-compression framework that enables fine-grained access and efficient range queries on compressed scientific datasets. Eureka integrates spatial domain decomposition with block-wise error-bounded lossy compression to support selective decompression. It constructs a hierarchical AVL-tree index during compression to capture block-level value ranges, enabling fast pruning during query execution. To reduce metadata overhead, the index itself is also compressed while ensuring recall-preserving results. Experiments on six diverse HPC simulation datasets show that Eureka achieves up to 25x data compression and over 300x index compression, surpassing state-of-the-art compressors such as SZ3 and ZFP in rate-distortion performance. Additionally, Eureka delivers over 30x speedup for low-selectivity range queries, making it a scalable and efficient solution for modern scientific data analysis.

Yan, Ning↗

Value-added Data Services at the Goddard Earth Sciences Data and Information Services Center

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), in addition to serving the Earth Science community as one of the major Distributed Active Archives Centers (DAACs), provides much more than just data. Among the value-added services available to general users are subsetting data spatially and/or by parameter, online analysis (to avoid downloading unnecessarily all the data), and assistance in obtaining data from other centers. Services available to data producers and high-volume users include consulting on building new products with standard formats and metadata and construction of data management systems. A particularly useful service is data processing at the DISC (i.e., close to the input data) with the users algorithm. This can take a number of different forms: as a configuration-managed algorithm within the main processing stream; as a stand-alone program next to the on-line data storage; as build-it-yourself code within the Near-Archive Data Mining (NADM) system; or as an on-the-fly analysis with simple algorithms embedded into the web-based tools. Partnerships between the GES DISC and scientists, both producers and users, allow the scientists to concentrate on science, while the GES DISC handles the data management, e.g., formats, integration, and data processing. The existing data management infrastructure at the GES DISC supports a wide spectrum of options: from simple data support to sophisticated on-line analysis tools, producing economies of scale and rapid time-to-deploy. At the same time, such partnerships allow the GES DISC to serve the user community more efficiently and to better prioritize on-line holdings. Several examples of successful partnerships are described in the presentation.

Leptoukh, Gregory G.↗

Changuinola peat soil characteristics and gas emission raw data October 2019

This dataset comprises radiocarbon and geochemical measurements from peat and porewater samples collected across various depths at a site in Bocas del Toro, Panama. The study focuses on carbon cycling dynamics in tropical peatlands by examining carbon isotopic signatures (¹⁴C and ¹³C) and elemental compositions of bulk peat, dissolved organic carbon (DOC), carbon dioxide (CO₂), and methane (CH₄). Key parameters include radiocarbon ages and isotopic ratios (δ¹³C) of bulk peat, concentrations of carbon (%C) and nitrogen (%N), and radiocarbon content of porewater gases and dissolved organic carbon (DOC). The data provide insights into the vertical and spatial distribution of carbon sources and possible preservation and decomposition processes within tropical peat profiles, offering critical information for understanding carbon storage and greenhouse gas emissions in these ecosystems.This dataset is comprised of one main data folder containing (1) file-level metadata; (2) data dictionary; (3) field metadata; (4) carbon isotopic signatures (¹⁴C and ¹³C); (5) concentrations of carbon (%C) and nitrogen (%N); (6) radiocarbon content of porewater carbon dioxide (CO₂), and methane (CH₄) ; (7) porewater DOC; (8) bulk peat sampling protocol; (9) porewater sampling protocol; (10) porewater gas collection methods; and (11) gas extraction methods. All files are in .csv format and can be opened with any software that supports this file types.

54 ENVIRONMENTAL SCIENCES↗

Opening Historical Airborne Data to Present Day Researchers

For more than 50 years, NASA has flown airborne sensors to carry out research, validate satellite sensors, and test new instrument capabilities. Data collected prior to 2000 are typically analog and difficult to locate and use. The Airborne Data Management Group (ADMG) facilitates rescue of these valuable data to ensure easier discovery, access, and use. But opening historical data comes at a cost of both time and money. Careful decisions are required in assessing the return on investment. - Is there interest in the science community? - Are there government data requirements? - What is the temporal / spatial value of the data? - Can data be transformed to a digital format? - What is cost of transformation? - What time period is needed for rescue? Converting the data to today’s digital storage standards increases value and provides data access. The addition of metadata makes the data easier to search for.

Deborah Smith↗

Towards long-term standardised carbon and greenhouse gas observations for monitoring Europe’s terrestrial ecosystems: A review

Research infrastructures play a key role in launching a new generation of integrated long-term, geographically distributed observation programmes designed to monitor climate change, better understand its impacts on global ecosystems, and evaluate possible mitigation and adaptation strategies. The pan-European Integrated Carbon Observation System combines carbon and greenhouse gas (GHG; CO 2 , CH 4 , N 2 O, H 2 O) observations within the atmosphere, terrestrial ecosystems and oceans. High-precision measurements are obtained using standardised methodologies, are centrally processed and openly available in a traceable and verifiable fashion in combination with detailed metadata. The Integrated Carbon Observation System ecosystem station network aims to sample climate and land-cover variability across Europe. In addition to GHG flux measurements, a large set of complementary data (including management practices, vegetation and soil characteristics) is collected to support the interpretation, spatial upscaling and modelling of observed ecosystem carbon and GHG dynamics. The applied sampling design was developed and formulated in protocols by the scientific community, representing a trade-off between an ideal dataset and practical feasibility. Finally, the use of open-access, high-quality and multi-level data products by different user communities is crucial for the Integrated Carbon Observation System in order to achieve its scientific potential and societal value.

54 ENVIRONMENTAL SCIENCES↗

Multiscale maps of Active Layer Depth for Teller site Mile Marker 27 and Kougarok Mile Marker 80, Seward Peninsula, AK

Remote sensing maps of active layer depth derived from Unmanned Areal System (UAS) data. The UAS datasets were stepwise scaled until matching the AVIRIS-NG (Airborne Visible / Infrared Imaging Spectrometer - Next Generation) and Sentinel-2 spatial resolutions. Using the field observed Active Layer Depth (ALD) measurement in combination with spectral and topographic predictors derivatives from DJI UAS imagery, we used a spatially explicit RF regression model to predict and map ALD across our study landscapes. This package includes maps for Next-Generation Ecosystem Experiment Arctic (NGEE Arctic)’s Teller Mile Marker (MM) 27, and Kougarok MM80 (aka Mile 80) watersheds. The field, map data, and metadata are provided as geoTIF and text (*.csv) formats. These datasets are provided in support of Hantson et al., 2024 (accepted) “Scaling Arctic landscape and permafrost features improves active layer depth modeling”

54 ENVIRONMENTAL SCIENCES↗

Pan-Arctic daily streamflow at 0.5-degree resolution

Data was derived using daily runoff from models participating in the Coupled Model Intercomparison Project, version 6 (CMIP6) that have been routed through the Model for Scale Adaptive River Transport (MOSART) routing model to represent streamflow at individual streamflow gage locations. Data from 750 streamflow gage locations are represented, which are indexed by gage id according to the metadata.csv file. Streamflow gage location sites were based on gage records downloaded from the United States Geological Survey (USGS), National Water Data (HYDAT) Archive from Canada, and the State Hydrological Institute of Russia. Data are available from 11 Earth System Models (ESMs) in total at a daily timestep with a duration of 1920-2099 (1850-2014 for E3SM only). The spatial domain of the modeled data is 0.5 degree resolution. Earth System Models and Units of mean daily streamflow are presented in cubic meters per second (cms). Data files consist of 11 Earth System Model mean daily streamflow output per gage location in .csv format, 1 metadata file in .csv format and 1 Readme file in .docx format (13 files in total). These data were used to benchmark CMIP6 modeled representations of streamflow against gage records.

54 ENVIRONMENTAL SCIENCES↗

Thermal property characterization of phase change materials in building applications: A systematic review of fundamentals, recent progress, and future directions

Phase change materials (PCMs) can reduce building peak loads and enable demand-responsive thermal energy storage (TES), but their deployment depends on reliable measurement and interpretation of thermal properties across laboratory, intermediate, and application scales. Here, this review systematically examines characterization methods, testing protocols, and recent advances for neat PCMs and PCM composites, emphasizing thermal conductivity, enthalpy-related properties (phase change temperature, latent heat, specific heat), and cycling stability. For thermal conductivity, we compare steady-state and transient techniques and note limitations when phase transition and contact resistance affect measurements. For enthalpy–temperature characterization, we discuss differential scanning calorimetry together with intermediate- and bulk-scale methods, including T-history, heat flow meter testing, and three-layer calorimetry (3LC), to generate application-relevant enthalpy–temperature profiles. Cycling stability is organized into four experimental families: thermoelectric–air, fully thermoelectric, water-bath, and in situ chamber approaches, with attention to separating reversible supercooling from true degradation such as phase segregation. We highlight emerging noncontact diagnostics, including infrared thermography and embedded sensing, for spatially resolved validation and multiscale interpretation. Finally, we review the growing use of AI and machine learning for property prediction, inverse characterization from experimental signals, and real-time state estimation in building-integrated TES. Key needs include harmonized protocols, interlaboratory benchmarking, uncertainty reporting, and metadata-rich datasets to accelerate reproducible PCM qualification for grid-flexible buildings.

AI↗

Interactive Multi-Instrument Database of Solar Flares

The fundamental motivation of the project is that the scientific output of solar research can be greatly enhanced by better exploitation of the existing solar/heliosphere space-data products jointly with ground-based observations. Our primary focus is on developing a specific innovative methodology based on recent advances in "big data" intelligent databases applied to the growing amount of high-spatial and multi-wavelength resolution, high-cadence data from NASA's missions and supporting ground-based observatories. Our flare database is not simply a manually searchable time-based catalog of events or list of web links pointing to data. It is a preprocessed metadata repository enabling fast search and automatic identification of all recorded flares sharing a specifiable set of characteristics, features, and parameters. The result is a new and unique database of solar flares and data search and classification tools for the Heliophysics community, enabling multi-instrument/multi-wavelength investigations of flare physics and supporting further development of flare-prediction methodologies.

Heliophysics↗

Data from "A Bayesian Record Linkage Approach to Applications in Tree Demography Using Overlapping LiDAR Scans"

Processed LiDAR data and environmental covariates from 2015 and 2019 LiDAR scans in the Vicinity of Snodgrass Mountain (Western Colorado, USA), in a geographic subset used in primary analysis for the research paper.This package contains LiDAR-derived canopy height maps for 2015 and 2019, crown polygons derived from the height maps using a segmentation algorithm, and environmental covariates supporting the model of forest growth. Source datasets include August 2015 and August 2019 discrete-return LiDAR point clouds collected by Quantum Geospatial for terrain mapping purposes on behalf of the Colorado Hazard Mapping Program and the Colorado Water Conservation Board. Both datasets adhere to the USGS QL2 quality standard. The point cloud data were processed using the R package lidR to generate a canopy height model representing maximum vegetation height above the ground surface, using a pit-free algorithm.This dataset was compiled to assess how spatial patterns of tree growth in montane and subalpine forests are influenced by water and energy availability. Understanding these growth patterns can provide insight into forest dynamics in the Southern Rocky Mountains under changing climatic conditions.This dataset contains .tif, .csv, and .txt files. This dataset additionally includes a file-level metadata (flmd.csv) file that lists each file contained in the dataset with associated metadata; and a data dictionary (dd.csv) file that contains column/row headers used throughout the files along with a definition, units, and data type.

54 ENVIRONMENTAL SCIENCES↗

Towards scanning nanostructure X-ray microscopy

This article demonstrates spatial mapping of the local and nanoscale structure of thin film objects using spatially resolved pair distribution function (PDF) analysis of synchrotron X-ray diffraction data. This is exemplified in a lab-on-chip combinatorial array of sample spots containing catalytically interesting nanoparticles deposited from liquid precursors using an ink-jet liquid-handling system. A software implementation is presented of the whole protocol, including an approach for automated data acquisition and analysis using the atomic PDF method. The protocol software can handle semi-automated data reduction, normalization and modeling, with user-defined recipes generating a comprehensive collection of metadata and analysis results. By slicing the collection using included functions, it is possible to build images of different contrast features chosen by the user, giving insights into different aspects of the local structure.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Model Inputs, Outputs, and Scripts associated with: “Combined effects of stream hydrology and land use on basin-scale hyporheic zone denitrification in the Columbia River Basin”

This data package is associated with the publication “Combined effects of stream hydrology and land use on basin‐scale hyporheic zone denitrification in the Columbia River Basin”, published in Water Resource Research (Son et al.2022) available at https://doi.org/10.1029/2021WR031131. This data package includes the key model inputs/outputs of the river corridor model for the Columbia River Basin (CRB) and the model source codes used in the manuscript. The model is a carbon-nitrogen-coupled river corridor model (RCM), and the model is used to quantify hyporheic zone (HZ) denitrification at the NHDPLUS stream reach scales. The RCM used in this study combines empirical substrate models derived from observations and three microbially driven reactions, including two-step denitrification and aerobic respiration, are considered within the HZ. The key input data of the model are exchange flux, residence time, and stream solute (dissolved organic carbon (DOC), dissolved oxygen (DO), and nitrate concentrations). These inputs are constant over time and represent long-term averaged values. This study uses the RCM to explore the spatial patterns of HZ denitrification across reaches with different sizes and land use in the CRB. Our main objective is to use the RCM as a virtual reality model, and the machine-learning models as surrogates that encapsulate the complexities of the physics-based model while identifying the importance of different variables that are not evident in the model conceptualization. We do not include a direct comparison of the modeled HZ denitrification and measurements; however, the RCM can capture the overall spatial patterns of the HZ denitrification because the model inputs and its reaction networks are based on well-established theory and a physical-based model. The combination of the model-based predictions and a machine-learning approach (e.g., random forest) is used to improve our understanding of what variables of the model are associated with spatial patterns of the modeled denitrification across reaches with different sizes and land uses, and to develop a proxy model using measurable variables to reproduce the simulated patterns.This dataset contains five folders: (1) model_inputs, (2) model_outputs, (3) Rscripts, (4) figures, and (5) model_codes. It also contains a readme, file level metadata (FLMD), and data dictionary (dd). Please see the FLMD for a list of all the files contained in this data package and descriptions for each. The model_inputs folder contains the model inputs used to drive the model simulations. The model_outputs folder contains key model output files from the river corridor model. The Rscripts folder contains the Rscripts for pre- and post- processing model results. The figures folder contains the raw figures associated with the manuscript. The model_codes folder includes key model source codes/input files. All files are .jpg, .jpeg, .out, .e, .od, .dat, .sub, .F90, .0, .R, .sbx, .cpg, .sbn, .shx, .shp, .dbf, .prj, .tfw, .tif, .xml, .pdf, or .csv.

54 ENVIRONMENTAL SCIENCES↗

UAS remote sensing (DJI Phantom 4 RTK platform): RGB orthomosaic, digital surface and canopy height models, plant functional type map, Seward Peninsula, Alaska, 2019

Airborne remote sensing data collected using a DJI Phantom 4 RTK unoccupied aerial system (UAS) ? operated by the University of Maine Wheatland Geospatial Lab (https://wheatlandlab.org/). This package includes data from 17 flights flown over the NGEE-Arctic Council, Kougarok, Kougarok Mile80, Teller, and Teller Mile32 sites in July 2019. The Phantom 4 RTK is a drone platform that collects very high spatial resolution optical red/green/blue (RGB) imagery. Derived image products include point cloud, ortho-mosaiced RGB, a digital surface model (DSM) using the structure from motion (SfM) technique, and a canopy height model (CHM). Unprocessed and processed data products (1,000+ files) are included in this package (processing levels 0-3). Data and metadata are provided as text (*.txt, *.json, *hdr,), ENVI image file (*.dat), point cloud (*.laz) and image (*.jpg, *.tif, *png) formats. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Advanced simulation capability for environmental management, integrated tool-sets and simulator to enhance public communication - 15186

The U.S. Department of Energy (US DOE) Office of Environmental Management (EM), Office of Soil and Groundwater Remediation, is supporting multi-laboratory development of the Advanced Simulation Capability for Environmental Management (ASCEM). ASCEM is an open source and modular computing framework that incorporates new advances and tools for predicting contaminant fate and transport in natural and engineered systems. ASCEM facilitates transparent, efficient and integrated approaches to modeling and site characterization, and provides robust and standardized assessments of performance and risk for EM cleanup and closure activities. Site subsurface simulation modeling and performance assessments are complex and involve sensitivity evaluations and uncertainty quantification to better understand the risks at a site. The ASCEM tool-set was designed in close collaboration with the sites and other potential end-users (both the public and regulators) to allow better communication and understanding of these complex modeling efforts. ASCEM's integrated tool-sets provide a user interface and tools for managing work-flows, including conceptual model development, management of data and metadata for model input, sensitivity analysis, model calibration and uncertainty analysis, model execution on diverse computational platforms, and processing of model output, including visualization. The hierarchical and modular design of ASCEM HPC simulator Amanzi easily lends itself to translating this conceptual model of a site into a numerical model that can easily be spatially and temporally discretized to run on the HPC simulator. Together this integrated work-flow allows for a seamless and integrated analysis tracking all provenance information and modeling uncertainties. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Validation of ADAR System 5500 Digital Imagery: Delivery Task Order #1, Task Request #857 - Brookings, SD

This work was performed under NASA's Verification and Validation Program as an independent check of data supplied by Positive Systems, Inc. through the Earth Science Enterprise's Scientific Data Purchase (SDP) Program. This document serves as the basis for reporting results associated with validation of multispectral imagery according to the specifications of contract NAS 13-98049. The validation was performed under the Positive Systems Imaging System Validation Work Instruction CRSP-WI-28: Spectral registration, spatial resolution, endlaps, sidelaps, and image quality were evaluated. The validation was proceded by Shipment Verification, as described in the Work Instruction CRSP-WI-22: Every image was passed through an automatic ingest verification and thumbnail review process to identify omissions, problems with media integrity, and gross errors in data quality. Validation of metadata files is not within the scope of this report, but it was performed separately.

Blonski, Slawomir↗

THE DATA REDUCTION PIPELINE FOR THE SDSS-IV MaNGA IFU GALAXY SURVEY

Mapping Nearby Galaxies at Apache Point Observatory (MaNGA) is an optical fiber-bundle integral-field unit (IFU) spectroscopic survey that is one of three core programs in the fourth-generation Sloan Digital Sky Survey (SDSS-IV). With a spectral coverage of 3622–10354 Å and an average footprint of ∼500 arcsec{sup 2} per IFU the scientific data products derived from MaNGA will permit exploration of the internal structure of a statistically large sample of 10,000 low-redshift galaxies in unprecedented detail. Comprising 174 individually pluggable science and calibration IFUs with a near-constant data stream, MaNGA is expected to obtain ∼100 million raw-frame spectra and ∼10 million reduced galaxy spectra over the six-year lifetime of the survey. In this contribution, we describe the MaNGA Data Reduction Pipeline algorithms and centralized metadata framework that produce sky-subtracted spectrophotometrically calibrated spectra and rectified three-dimensional data cubes that combine individual dithered observations. For the 1390 galaxy data cubes released in Summer 2016 as part of SDSS-IV Data Release 13, we demonstrate that the MaNGA data have nearly Poisson-limited sky subtraction shortward of ∼8500 Å and reach a typical 10 σ limiting continuum surface brightness μ = 23.5 AB arcsec{sup −2} in a five-arcsecond-diameter aperture in the g -band. The wavelength calibration of the MaNGA data is accurate to 5 km s{sup −1} rms, with a median spatial resolution of 2.54 arcsec FWHM (1.8 kpc at the median redshift of 0.037) and a median spectral resolution of σ = 72 km s{sup −1}.

79 ASTRONOMY AND ASTROPHYSICS↗

Limiting Data Friction by Reducing Data Download Using Spatiotemporally Aligned Data Organization Through STARE

Current data processing practice limits the volume and variety of relevant geoscience data that can practically be applied to important problems. File archives in centralized data centers are the principal means by which Earth Science data are accessed. This approach, however, requires laborious search, retrieval, and eventual customization/adaptation for the data to be used. Such fractionation makes it even more difficult to share outcomes, i.e. research artifacts and data products, hampering reusability and repeatability, since end users generally have their own research agenda and preferences as well as scarce resources. Thus, while finding and downloading data files from central data centers are already costly for end users working in their own field, using data products from other disciplines rapidly becomes prohibitive. This curtails scientific productivity, limits avenues of study, and endangers quality and reproducibility. The Spatio-Temporal Adaptive Resolution Encoding (STARE) is a unifying scheme that facilitates the indexing, access, and fusion of diverse Earth Science data. STARE implements an innovative encoding of geo-spatiotemporal information, originally developed for aligning datasets with diverse spatiotemporal characteristics in an array database. The spatial component of STARE recursively quadfurcates a root polyhedron, producing a hierarchical scheme for addressing geographic locations and regions. The temporal component of STARE uses conventional date-time units as an indexing hierarchy. The additional encoding of spatial and temporal resolution information in STARE enables comparisons and conditional selections across diverse datasets. Moreover, spatiotemporal set-operations, e.g. union and intersection, are mapped to efficient integer operations with STARE. Applied to existing data models (point, grid, spacecraft swath) and corresponding granules, STARE indexes provide a streamlined description usable as geo-spatiotemporal metadata. When coupled with large scale, distributed hardware and software, STARE-based data access reduces pre-analysis data preparation costs by offering a convenient means to align different datasets spatiotemporally without specialized effort in parallel computing or distributed data management.

Kuo, Kwo-Sen↗

Advancing our predictive understanding of river corridor exchange

Despite decades of research, we lack an accurate framework to predict and manage hydrologic exchange in the river corridor and the associated ecosystem services and functions at the scales of stream reaches and entire networks. While many individual studies have been conducted to investigate specific mechanisms, they have not been synthesized to account for heterogeneity in space, nonstationarity, and multiscale feedbacks that typify the river corridor. As a result, contradictory predictions of exchange flux, geometry, and timescale are prevalent in the literature. We attribute these contradictions to (a) failure to account for multiscale feedbacks and (b) uncertainty in the information content of common measurement methods. Here, we apply the concept of interacting multiscale spatial and time‐variable domains to the river corridor to demonstrate why more complete multiscale characterization is necessary to achieve predictive understanding. Next, we highlight uncertainties and inconsistencies in measurement methods which may obfuscate our understanding of river corridor exchange. Finally, we briefly outline four necessary advances to achieve predictive understanding of river corridor exchange: standardization of metadata, critical evaluation of the information content and support volumes for measurement techniques, multiscale model‐data integration, and advancing theoretical models of river corridor exchange. This article is categorized under: Science of Water > Hydrological Processes Water and Life > Nature of Freshwater Ecosystems Science of Water > Methods

Ward, Adam S.↗