Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Metadata Normalization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

47 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Electrical Resistivity Tomography data from 2016 to 2018 at the Lower Montane site in the East River Watershed, Colorado

This dataset contains time-lapse Electrical Resistivity Tomography (ERT) data along a transect located on the northeast-facing hillslope at the lower montane site (Pumphouse site) in the upper East River Watershed. The monitoring dataset covers the period from November 2, 2016, to August 6, 2018. In addition, the archive also contains a baseline dataset from October 9, 2016. The ERT transect consisted of 128 electrodes with an electrode spacing of 1.25 m. The acquisition system was located in the middle of the transect, about 50 m on one side, and included an MPT (Multi-Phase Technologies) ERT system, a mini computer, and batteries with solar panels. Acquisition occurred daily under normal circumstances. The first 16 electrodes (from the upper end of the transect) could not be used after the cable was damaged during the 2017–2018 winter. Also, due to multiple failures in the power system, the temporal resolution of the data is much lower in 2018 compared to 2016 and 2017. The data have been processed and used in Dafflon et al., 2023, and the baseline dataset was used in Falco et al., 2019 (see reference list). This archive contains the measurements (ER.zip containing csv files) for each of the 326 acquisition times and a filtered version where only electrodes 17 to 128 are included (ERT_sm.zip containing csv files). The archive also contains the baseline dataset and two acquisitions with full reciprocals (ERT_RB.zip containing csv files), as well as all the raw MPT files (ERT_raw_MTP.zip). The geometry (electrode position and elevation) is provided in Universal Transverse Mercator (UTM) 13N Geoid2012AB in the file named ERT_Location.csv. The archive contains 1 *.csv data files, four *.zip files, and three metadata *.csv files. This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Blodgett 13C–labeled litter incubation 2016-2019

The dataset is from 13C-labelled (stable isotope of carbon) root-litter in-situ field incubation experiment based on the whole-soil warming experiment at the Blodgett Forest Research Station, CA, USA. The files are in both ".csv" and ".xlsx" versions, and can be opened in "maCOS numbers", and "Microsoft Excel". The files includes several sheets with all the data published in the paper: Sun, B., Zosso, C., Wiesenberg, G. L. B., Pegoraro, E., Torn, M. S., and Schmidt, M. W. I.: Warming accelerates the decomposition of root-derived hydrolysable lipids in a temperate forest and is depth- and compound class-dependent, SOIL, 11, 1077–1093, https://doi.org/10.5194/soil-11-1077-2025, 2025. This dataset includes bulk soil carbon, nitrogen, delta 13C values, the normalized concentration (to organic carbon) of hydrolysable lipids identified, the absolute concentration (normalized to bulk soil) of hydrolysable lipids, hydrolysable lipids recovery, and weighted 13C-excess of bulk soil carbon, and weighted 13C-excess of each compound class in hydrolysable lipids. These data aim to answer two research questions: 1) How will warming affect the decomposition of 13C-labelled root-litter at different depth? 2) Will the decomposition of root-derived hydrolysable lipids under warming differ among different compound classes? The experiment sites located on the foothills of the Sierra Nevada near Georgetown, CA (120°3904000W; 38°5404300 N) at 1370m above see level. The Blodgett Forest is a mixed-coniferous forest. The site has a Mediterranean climate with a mean annual air temperature of 12.5 °C and a mean annual precipitation of 1774mm.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

NLR HPC Kestrel Jobs Data

Overview: Anonymized job-level records from the Kestrel HPC system at the National Laboratory of the Rockies (NLR). Each record represents a Slurm batch job with scheduling metadata, resource requests, utilization, energy estimates, and efficiency metrics. Sensitive fields (user, account, job name, submit line, working directory, submit script, and job type) are replaced with 7-character cryptographic hashes. System & Timeframe: Kestrel is located at the NLR campus. Standard compute nodes have 104 cores and 256 GB RAM; bigmem nodes have 2,000 GB. GPU nodes (gpu-h100 partition) use NVIDIA H100 GPUs. Data covers jobs submitted August 2023 through December 2025. Funding provided by the U.S. Department of Energy, EERE. Files: esif.hpc.kestrel.job-anon.zip — Anonymized job records (Hive-partitioned Parquet) datacard.md — Full dataset documentation ~11 million rows, 50 variables. Readable with PyArrow, pandas, DuckDB, Apache Spark, or any Parquet-compatible tool. Data Collection: Jobs collected via sacct with timezone-aware export (SLURM_TIME_FORMAT="%Y-%m-%dT%H:%M:%S%z"), loaded into PostgreSQL. Calculated columns updated via database triggers and batch functions. All timestamps use timestamptz and correctly handle DST transitions. Preprocessing: Anonymization of name, user, account, submit_line, work_dir, submit_script, and job_type via 7-char hex hashes Derived columns: queue_wait, cpu_eff, max/min/avg_mem_eff, energy estimates Simplified job state mapping (e.g., "CANCELLED by 132357" → "CANCELLED") Boolean flags: python_job, reframe_job Temporal decomposition: year, month, day, day_of_week, hour, minute from submit_time Shared node tracking: shared_job_count, nodes_shared, jobs_shared Key Variables: Scheduling: job_id, partition, state_simple, submit_time, start_time, end_time, queue_wait Resources: nodes_req/used, processors_req/used, memory_req, wallclock_req/used, gpus_requested Efficiency: cpu_eff, max/min/avg_mem_eff Energy: cpu_energy_tdp_estimated_max/used_watt_hours, consumed_energy_raw_joules, consumed_energy_raw_watt_hours Sharing: shared_job_count, nodes_shared, jobs_shared Partitions: short, standard, debug, gpu-h100 Job States: CANCELLED, COMPLETED, FAILED, PENDING, RUNNING QoS Levels: normal, high Important Notes: Timestamps include timezone offsets; DST transitions are handled correctly, though adding intervals across DST boundaries requires offset adjustment shared_job_count reflects physical node co-residency, not use of the shared partition Job step records and raw Slurm JSONB fields are excluded Do not attempt to re-identify individuals from hashed fields

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

NLR HPC Eagle Jobs Data and Additional Energy Metrics

Overview: Anonymized job-level records from the Eagle high-performance computing (HPC) system at the National Laboratory of the Rockies (NLR). Each record represents a Slurm batch job with scheduling metadata, resource requests, resource utilization, CPU/GPU energy consumption, and efficiency metrics. Sensitive fields (user, account, job name) are replaced with cryptographic hashes. System & Timeframe: Eagle was a 2,000-node, 8-petaflop system operated at NLR from 2019–2024. Data covers the full operational lifetime of the system. Slurm data was processed nightly; timestamps are in Mountain Time. Funding provided by the U.S. Department of Energy, EERE. Files: esif.hpc.eagle.job-anon.zip — Core anonymized job records (Hive-partitioned Parquet) esif.hpc.eagle.job-anon-energy-metrics.zip — Same records with additional iLO and Ganglia energy metrics datacard.md — Full dataset documentation ~13.8 million rows, 62 variables. Readable with PyArrow, pandas, DuckDB, Apache Spark, or any Parquet-compatible tool. Data Collection: Jobs collected via sacct through a pipeline: Eagle Jobs API → Redpanda → StreamSets → HPCMON API → PostgreSQL. Node-level power from iLO (HP Integrated Lights-Out); GPU power from Ganglia monitoring, joined to jobs via node lists and time ranges. Preprocessing: Anonymization of name, user, and account fields via cryptographic hashing Derived columns: queue_wait, cpu_eff, max_mem_eff Simplified job state mapping (e.g., "CANCELLED BY 12345" → "CANCELLED") QoS accounting rules (buy-in, standby, or Slurm QoS value) CPU energy estimated from TDP (200W, Intel Xeon Gold 6154, 18 cores) Timezone-aware columns (_tz) sourced from LEX accounting database to correctly handle DST transitions Key Variables: Scheduling: job_id, partition, state_simple, submit_time_tz, start_time_tz, end_time_tz, queue_waitResources: nodes_req/used, processors_req/used, memory_req, wallclock_req/used, gpus_requested Efficiency: cpu_eff, max_mem_eff Energy: cpu_energy_tdp_estimated_max/used_watt_hours, node_energy_total_watt_hours (iLO), gpu0/1_energy_total_watt_hours (Ganglia) Partitions: bigmem, bigmem-8600, bigscratch, csc, dav, ddn, debug, gpu, haswell, long, mono, short, standard Job States: CANCELLED, COMPLETED, FAILED, NODE_FAIL, OUT_OF_MEMORY, PENDING, RUNNING, TIMEOUT QoS Levels: Unknown, normal, buy-in, debug, penalty, high, standby Important Notes: Non-_tz timestamp columns may be off by one hour across DST boundaries; use _tz columns for time difference calculations Energy fields are null for jobs without monitoring coverage Job step records and raw Slurm JSONB fields are excluded from this extract Do not attempt to re-identify individuals from hashed fields

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Data from: "Towards CONUS-Wide ML-Augmented Conceptually-Interpretable Modeling of Catchment-Scale Precipitation-Storage-Runoff Dynamics"

This data package was generated to support the manuscript “Towards CONUS-Wide Machine Learning-Augmented Conceptually Interpretable Modeling of Catchment-Scale Precipitation-Storage-Runoff Dynamics.” It provides input files, model outputs, plotting data, scripts, notebooks, and documentation used to develop, evaluate, and reproduce Mass-Conserving Perceptron (MCP)-based hydrologic modeling experiments across 513 selected Catchment Attributes and Meteorology for Large-sample Studies in the United States (CAMELS-US) basins. The files are organized by modeling component and analysis purpose, including rainfall–runoff experiments, snow module experiments, coupled hydrologic-snow experiments, Long Short-Term Memory (LSTM) benchmark results, model skill metrics, initialization and epoch records, cell-state normalization files, Akaike Information Criterion (AIC)-based model comparison files, and data used to generate manuscript figures. Tabular files can be opened using standard spreadsheet software or Python/R data-analysis tools. Python scripts, Jupyter notebooks, and selected MATLAB scripts are included for model execution, postprocessing, plotting, and statistical analysis. Quality assurance and quality control were conducted through the source-data selection and modeling workflow. Meteorological forcing, streamflow, and static catchment attributes were derived from the CAMELS-US dataset, and snow water equivalent data were derived from the University of Arizona (UA) Snow Water Equivalent dataset. Selected basins and time periods were screened during the associated research workflow to avoid missing observations or poor-quality cases. Static geospatial features were processed primarily using Quantum Geographic Information System (QGIS) and Geospatial Data Abstraction Library (GDAL) workflows. Additional details are provided in the associated manuscript and documentation.

ESS-DIVE CSV File Formatting Guidelines Reporting ↗
DOE OSTI2025

Data for Roebuck et al. (2025), "Differences in dissolved organic matter composition between rivers and estuaries is conserved across freshwater and saltwater coastal regions"

Dissolved organic matter (DOM) in coastal surface waters influences local water quality and is an important component of biogeochemical cycling in coastal systems, but the processes that alter DOM composition along lower reaches of rivers and estuarine waters are poorly understood. Roebuck et al. (2025) leveraged a spatially distributed community sampling effort in coastal ecosystems across two regions to identify broad spatial drivers of surface water DOM composition and identify transferable trends between saltwater and freshwater coastal systems. Samples were collected by community members from 47 locations within the mid-Atlantic and Great Lakes coastal regions.This dataset includes:* A selection of commonly reported absorbance and fluorescence peaks normalized to dissolved organic carbon concentrations* Parallel factor output from the EC1 fluorescence datasets* A selection of commonly reported absorbance and fluorescence peaks * Spectral indices output from matlab script for absorbance and fluorescence datasets* CO2sys calculations of pH changes under varying temperatures and a constant salinity, DIC, and alkalinity concentrationAll data files are plain-text CSV (comma separated value) and no special software is required to read them.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

The importance of accounting for landscape position when investigating grasslands: A multidisciplinary characterisation of a Californian coastal grassland

Data from the characterisation of the Point Reyes Field Site, published in AGU Earth's Future under the title: The importance of accounting for landscape position when investigating grasslands: A multidisciplinary characterisation of a Californian coastal grassland. This paper explored the effect of landscape position on the response of a Californian grassland to seasonal changes. All files are csv files. The EMI data contains 8 csv files with a metadata csv explaining the columns. The dataset also includes soil variables including total concentrations calculated from fused samples, then dissolved and measured on ICP-AES for whole-rock elements and ICP-MS for trace elements. Mineral composition was attained using X-ray diffraction at BL 11-3 at SSRL . Data was then run through the High Score database to characterise different mineral phases. total It also includes a table with bulk soil characteristics such as soil pH, cation exchange capacity, and soil textural data. Data from Teros 12 Meter soil moisture, electrical conductivity and temperature sensors are presented in SMS Csv file. While the WL bottom and top files contain data from Piezometers measuring the ground water table. We have included a csv file that contains soil CO2 efflux data from Feb 2021-Oct 2021 in the Point Reyes Grassland Experiment We have included the spatially orientated (easting northing) remotely sensed datasets that were used in the K-means clustering analysis conducted on our site with electrical conductivity, normalised difference vegetation index, elevation, slope, solar radiation, topographic position and wetness index, and a clustering score. Finally there is a list of all the identified grassland species at the site.For more information on flux data, please contact the corresponding author.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

iButton and Tinytag snow/ground interface temperature measurements at Teller 27 and Kougarok 64 from 2022-2023, Seward Peninsula, Alaska

Snow/ground interface temperature measurements were collected at the NGEE Arctic Teller Road Site at mile marker 27 (TL_MM27) and at the Kougarok Road Site at mile marker 64 (KG_MM64) on the Seward Peninsula, Alaska. Data were collected between October 1, 2022 to September 18, 2023 using iButton Link DS1921G-F5# Thermochron miniature temperature sensors (https://www.ibuttonlink.com/products/ds1921g) and Tinytag TGP-4017 internal sensors (https://www.micronmeters.com/product/tgp-4017-internal-sensor-40-to-85-c-40-f-to-185-f) deployed across the Kougarok and Teller sites. These sensors are a cost-efficient way to collect snowpack temperatures at a higher spatial resolution than what is normally achieved. iButton data were collected every 4 hours, while Tinytag data were collected every 30 minutes. In total, data were collected from 196 iButtons and 26 Tinytags. This dataset contains four *.csv files of near-ground surface temperatures at various locations throughout each study site and two *.kml files of sensor locations. Data were collected throughout the snow cover season so that snowpack characteristics could be derived using the temperature data. Sensors were placed both inside and outside of vegetation to better capture the spatial variability of snow properties across each domain.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic) was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy’s Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy’s Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

iButton snow temperature measurements at Teller 27 and Kougarok 64, Seward Peninsula, Alaska, 2019-2020

Snow temperature measurements were collected at the NGEE Arctic Teller Road Site at mile marker 27 (TL_MM27) and at the Kougarok Road Site at mile marker 64 (KG_MM64) on the Seward Peninsula. Data were collected from October 1, 2021 to August 16, 2022 using iButton Link DS1926-F5# Thermochron miniature temperature sensors (https://www.ibuttonlink.com/products/ds1921g) and Tinytag TGP-4017 internal sensors (https://www.micronmeters.com/product/tgp-4017-internal-sensor-40-to-85-c-40-f-to-185-f) deployed across the Kougarok and Teller sites. These sensors are a cost-efficient way to collect snowpack temperatures at a higher spatial resolution than what is normally achieved. iButton data were collected every 4 hours beginning on October 1, 2021. Tinytag data collection began between October 9, 2021 and October 12, 2021 depending on the specific Tinytag and data were collected every 30 minutes. In total, data were collected from 236 iButtons and 30 Tinytags. This dataset contains four *.csv files of near-ground surface temperatures at various locations throughout each study site and four *.shp files of sensor locations. Data were collected throughout the snow cover season so that snowpack characteristics could be derived using the temperature data. Sensors were placed both inside and outside of vegetation to better capture the spatial variability of snow properties across each domain.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

iButton and Tinytag snow temperature measurements at Teller 27 and Kougarok 64, Seward Peninsula, Alaska, 2021-2022

Snow temperature measurements were collected at the NGEE Arctic Teller Road Site at mile marker 27 (TL_MM27) and at the Kougarok Road Site at mile marker 64 (KG_MM64) on the Seward Peninsula. Data were collected from October 1, 2021 to August 16, 2022 using iButton Link DS1926-F5# Thermochron miniature temperature sensors (https://www.ibuttonlink.com/products/ds1921g) and Tinytag TGP-4017 internal sensors (https://www.micronmeters.com/product/tgp-4017-internal-sensor-40-to-85-c-40-f-to-185-f) deployed across the Kougarok and Teller sites. These sensors are a cost-efficient way to collect snowpack temperatures at a higher spatial resolution than what is normally achieved. iButton data were collected every 4 hours beginning on October 1, 2021. Tinytag data collection began between October 9 and October 12, 2021 depending on sensor installation date. Tinytag data were collected every 30 minutes. In total, data were collected from 236 iButtons and 30 Tinytags. This dataset contains four *.csv files of near-ground surface temperatures at various locations throughout each study site and four *.shp files of sensor locations. Data were collected throughout the snow cover season so that snowpack characteristics could be derived using the temperature data. Sensors were placed both inside and outside of vegetation to better capture the spatial variability of snow properties across each domain. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

iButton snow-ground interface temperature measurements in Los Alamos, New Mexico from 2023-2024

Snow/ground interface temperature measurements were collected at two sites in Los Alamos, New Mexico. Data were collected from November 29, 2023 to April 8, 2024 using iButton Link DS1921G-F5# Thermochron miniature temperature sensors (https://www.ibuttonlink.com/products/ds1921g). These sensors are a cost-efficient way to collect snowpack temperatures at a higher spatial resolution than what is normally achieved. iButton data were collected every 3 hours from a total of 19 iButtons. iButtons were placed in pairs, with one iButton placed at the ground surface and another buried 1 - 5 cm below the ground surface. One buried iButton did not successfully collect data, and therefore was excluded from this dataset. Data were collected throughout the snow cover season so that snowpack characteristics could be derived using the temperature data. Specifically, this dataset was used as a validation source for a novel machine learning approach to estimating snow depth (see related publication). Sensors were placed in areas with bare ground or minimal grass coverage, located away from any large vegetation. At Site A (TA51), manual snow depths were collected as validation data. These measurements were taken next to iButtons periodically throughout the winter, and notes on other precipitation types were also recorded. At Site B (TA6 Meteorological Station), a nearby sensor collected snow depths throughout the winter. This dataset contains one *.csv file of snow/ground interface temperatures at two sites, one *.csv file of manually collected snow depths, and one *.kml file of sensor locations. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic) was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy’s Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy’s Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗