Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “FILES”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

Electromagnetic Induction (EMI) Data, 2024, Trail Creek, Colorado

This dataset contains Electromagnetic Induction (EMI) data collected at Trail Creek, Colorado, in 2024. EMI surveys were conducted to investigate the spatial distribution of electrical conductivity in the subsurface, providing insights into soil moisture and subsurface geological features. The surveys were performed along multiple transects to capture variations in conductivity influenced by changes in soil composition, moisture content, and underlying geological structures. This dataset complements other geophysical data collected in the region, including Electrical Resistivity Tomography (ERT) and Terrestrial LiDAR Scanning (TLS), providing a detailed understanding of the subsurface and its impact on surface vegetation and hydrological processes. The data are valuable for environmental geophysics, ecological research, and hydrological modeling in mountainous ecosystems. The files include: - data.zip: the raw EMI data (.csv) - inversion.zip: the inverted resistivity model (.csv and .kml) - kriging.zip: the kriging resistivity model (.csv, .tif, .kmz) - flmd.csv: file level metadata file describing all files within this dataset - dd.csv: data dictionary file describing the column headers within CSV files This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

CMD Mini-Explorer↗

Leafweb: Leaf Gas Exchange and Pulse-Amplitude Modulated Fluorometry for C4 Species, June 2026 Release

This dataset contains leaf gas exchange and Pulse-Amplitude Modulated (PAM) fluorometry for 98 C4 species. The C4 photosynthetic pathway employs specialized CO2 concentration mechanisms and Kranz anatomy to enrich CO2 concentration around Rubisco, the enzyme that catalyzes carbon fixation in the Calvin-Benson cycle to suppress photorespiration and increase the use efficiencies of light, nitrogen, and water as compared to the C3 photosynthetic pathways. Large-scale C4 photosynthetic datasets are relatively scarce, which has affected C4 photosynthesis research. To improve C4 photosynthetic data availability, Leafweb organized an effort to systematically collect, compile, standardize, and organize measurements of leaf gas exchange and/or Pulse-Amplitude Modulated (PAM) fluorometry of C4 species. This derived a C4 photosynthetic dataset containing measurements made by independent researchers in multiple countries in various environments (field, garden, or greenhouse). It covers three biochemical subtypes – the nicotinamide adenine dinucleotide phosphate-malic enzyme (NADP-ME), nicotinamide adenine dinucleotide-malic enzyme (NAD-ME), and phosphoenolpyruvate carboxykinase (PEP-CK) subtypes. This dataset is useful for using Artificial Intelligence / Machine Learning and mechanistic models to study C4 photosynthesis and compare across different biochemical subtypes. This dataset contains 3 compressed (*.zip) folders containing 1,892 data files in comma-separate values (*.csv) format. Additional metadata are provided: one data dictionary and a file-level metadata file in comma-separate values (*.csv) format and a user guide in PDF (*.pdf) format.

Zhou, Haoran [Tianjin University, China]↗

SPRUCE Soil Volumetric Water Content in Experimental Plots, Marcell Experimental Forest, Minnesota, 2017-2025

This dataset contains soil volumetric water content (VWC) measurements from the Spruce and Peatland Responses Under Changing Environments (SPRUCE) Experiment. Measurements were made inside SPRUCE experimental plots in the S1 Bog at the US Forest Service Marcell Experimental Forest in northern Minnesota, USA from 2018-2025 (2018-06-14 to 2025-12-31). Observations were made with METER 10HS soil moisture sensors. To reduce bulk density related variability, 10HS sensors were placed inside mesh tubes filled with peat at a standard bulk density. The observations under standard bulk density represent relative differences in water content between hummock and hollow positions, and in response to experimental treatments. Productivity of peatlands, and their keystone species sphagnum, are highly dependent on water availability, which is affected by lateral inputs, precipitation, ground water depth and evapotranspiration. Knowledge of near surface and sphagnum water content is useful to understand peatland function. This dataset contains 8 data files in comma-separate values (.csv) format. Additional metadata are provided: one data dictionary and a file-level metadata file in comma-separate values (*.csv) format and a user guide in PDF (*.pdf) format.

Warren, Jeffrey [ORNL] (ORCID:0000000206804697)↗

SPRUCE Advanced Molecular Techniques Provide a Rigorous Method for Characterizing Organic Matter Quality in Complex Systems: Supporting Data

This dataset contains Fourier transform ion cyclotron resonance mass spectrometry-based measurements (FTICRMS), gas chromatography, and liquid chromatography data from the Spruce and Peatland Responses Under Changing Environments (SPRUCE) experimental site within the Marcell Experimental Forest in northern Minnesota, USA from 2011 to 2016. Measurement results demonstrate that optical characterization of peatland dissolved organic matter (DOM) may not fully capture classically identified chemical characteristics and may, therefore, not be the best measure of organic matter quality. Analyses show poor regression fits between optical characteristics and Fourier transform ion cyclotron resonance mass spectrometry-based measurements (FTICRMS). These data were used in Wilson and Tfaily (2018) and files are organized by which figure they were used to produce. Data underlying those regression analyses, as shown in Figures 1a and 1b of Wilson and Tfaily (2018), are provided in data files ds01 and ds02, respectively. ds01: Optically-derived specific ultraviolet absorbance method at 254 nm (SUVA254) values and Fourier transform ion cyclotron resonance mass spectrometry (FTICRMS) -derived double bond equivalences. ds02: Optically-derived spectral slopes and FTICRMS-derived average molecular weights. Results of analyses of a representative sample by FTICRMS and additional analytical techniques provide a broader picture of the compounds occurring in peatland dissolved organic matter (DOM) as shown in Figure 2 of Wilson and Tfaily (2018). The data underlying Figure 2 in are provided in data files ds03-ds07, organized by the respective analytical technique used to generate the data. ds03: Nitrogen containing compounds identified via FTICRMS. ds04: Compounds identified via FTICRMS which did not have nitrogen. ds05: Nuclear magnetic resonance (NMR) results. ds06: Gas chromatography mass spectrometry (GCMS) results. ds07: Liquid chromatography mass spectrometry (LCMS) results. This dataset contains seven data files in comma-separate values (*.csv) format. Additional metadata are provided: seven data dictionaries and a file-level metadata file in comma-separate values (.csv) format and a user guide in PDF (*.pdf) format.

54 ENVIRONMENTAL SCIENCES↗

SPRUCE Quantitative PCR (qPCR) of Microbial Gene Copy Numbers, 2021-2022

This dataset provides the results for quantitative polymerase chain reaction (qPCR) of peat samples collected from ambient and experimental plots in the Spruce and Peatland Responses Under Climatic and Environmental Change (SPRUCE) experiment site in June and August of 2021, and June of 2022. SPRUCE is located within the Marcell Experimental Forest in northern Minnesota, USA. The dataset includes bacterial, archaeal, fungal gene copy numbers, along with corresponding logarithmic values, at 11 depth increments of two-meter deep peat cores taken from 12 sampling sites locations inside SPRUCE plots (10 chambered and 2 ambient plots). The sampling, sample prep and analysis followed standard methods outlined in prior publications (Wilson et al. 2016; Kluber et al. 2020) except that a higher yielding Omega Bio-Tek Mag-Bind Environmental DNA 96 Kit was used for extractions and DNA was quantified using Qubit dsDNA High Sensitivity Assay Kit. qPCR subsamples of peat cores from the SPRUCE plots characterize changes in the abundance and composition of microbial communities of peat seasonally showing how composition varies under multiple levels of experimental peat warming and atmospheric CO2 concentrations. This dataset contains one data file in comma-separated values (.csv) format. Additional metadata are provided: one data dictionary and a file-level metadata file in comma-separated values (.csv) format and a user guide in PDF (*.pdf) format. On 2026-07-07 this dataset was updated to add three columns to the data file: ‘Fungal_copy_dry’, ‘Log_fungal_copy_dry’, ‘Fungal_copy_wet’. No previously released data values were altered. Additionally, the abstract, data dictionary, and user guide were updated, and a file-level metadata file was added.

Archaea↗

Soil Organic Horizon Exometabolomics Extracts and Soil Characteristics with Depth, Utqiagvik (Barrow), Alaska, 2014

This dataset includes chemical characterization data for four soil cores (organic horizon) collected in August 2014 from beneath two vegetation types (Eriophorum angustifolium and Carex aquatilis) from the centers of a low-centered and high-centered polygon at NGEE Areas A and B, respectively, on the Barrow Environmental Observatory near Barrow, Alaska. Measurements include gravimetric soil water content, total carbon and nitrogen, total organic carbon, and metabolomics data (low molecular weight organics). Data from the file Processed_LMW_DOM_Results_20190422.xlsx was separated out into csv files for interoperability. This dataset contains one xlsx file, twelve csv files, two pdf files, one txt file, and four zipped files.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Surface Water: Stage, Temperature and Discharge, Teller Road Mile Marker 27, Seward Peninsula, Alaska, 2016-2021

Surface water data were collected at one location in the Teller Mile 27 (TL_MM27) Research Basin Site, Seward Peninsula (N64 43' 35.29649", W165 56' 48.42823"). The site was installed and measurements collected from April 2016 to September 2021. During the pandemic, a combination of environmental factors (both animals and climate) led to a gap in the data record from late 2019 to June 2021. Station restarted in June 2021 with the same basin outlet and instrumentation type. These data are being collected to better understand the hydrology of this research basin. The data could also be used as supporting measurements for other research and modeling activities. Stream stage and water temperature are measured every 10 minutes. Discharge in the stream is also measured every site visit using one of two different methods. Most discharge measurements in this data set use the classic US Geological Survey (USGS) style wading rod to measure water velocity at multiple points (every 5 or 10 centimeters) across a known cross-section (https://pubs.usgs.gov/tm/tm3-a8/pdf/tm3-a8.pdf). The second method is the salt-slug mass diffusion method (https://www.uvm.edu/bwrl/lab_docs/protocols/2005_Moore_Slug_salt_dilution_gauging_volumetric_method_Streamline.pdf). Combining the continuous data record with the discrete observations, a stage-discharge relationship was developed. Dataset contains 14 *.csv files including a data dictionary and file-level metadata plus one user guide *.pdf file. DATASET UPDATE: The 2016-2019 data were published in 2019. Data collection continued through 2021 and were added to the dataset in 2025. There were no changes to the 2016-2019 data. Data files now have all years for a measurement combined into one file; whereas before, each measurement and each year had an individual file. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Low-Power, Flexible Sensor Arrays with Solderless Board-to-Board Connectors for Monitoring Soil Deformation and Temperature: Supporting Data

This dataset was used to assess the potential of a Soil Deformation and Temperature Monitoring System developed and presented in the article named "Low-Power, Flexible Sensor Arrays with Solderless Board-to-Board Connectors for Monitoring Soil Deformation and Temperature" and published in Sensors. There are 21 comma-delimited data files (.csv). 14 files contain current measurements performed in a lab setting, enabling the electrical evaluation of the sensor probe. These files are generated by the Keithley DMM6500 multimeter, and list the measured supply current (first column) as a function of time (3rd column). Another set of 6 files is also acquired in lab experiments, but contain soil temperature an deformation measurements, enabling an assessment of the developed device's accuracy. In these files, the first column contains the time (UTC), followed by the sensor's battery voltage and temperature and acceleration values (X, Y, Z) in subsequent columns. The measurements were acquired every 5 seconds. Another .csv file contains field data in a similar format (time, temperature, acceleration) collected at the Teller road (mile 27) site near Nome, Alaska with one probe. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Workload Characterization and Performance Implications of Large-Scale Blog Servers

With the ever-increasing popularity of social network services (SNSs), an understanding of the characteristics of these services and their effects on the behavior of their host servers is critical. However, there has been a lack of research on the workload characterization of servers running SNS applications such as blog services. To fill this void, we empirically characterized real-world web server logs collected from one of the largest South Korean blog hosting sites for 12 consecutive days. The logs consist of more than 96 million HTTP requests and 4.7 TB of network traffic. Our analysis reveals the followings: (i) The transfer size of non-multimedia files and blog articles can be modeled using a truncated Pareto distribution and a log-normal distribution, respectively; (ii) User access for blog articles does not show temporal locality, but is strongly biased towards those posted with image or audio files. We additionally discuss the potential performance improvement through clustering of small files on a blog page into contiguous disk blocks, which benefits from the observed file access patterns. Trace-driven simulations show that, on average, the suggested approach achieves 60.6% better system throughput and reduces the processing time for file access by 30.8% compared to the best performance of the Ext4 file system.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Improvements in 2016 to Natural Reservoir Analysis in Low-Temperature Geothermal Play Fairway Analysis for the Appalachian Basin

*These files add to and replace same-named files found within Submission 559 (hover over file display names to see actual file names in bottom-left corner of screen)* The files included in this submission contain all data pertinent to the methods and results of a cohesive multi-state analysis of all known potential geothermal reservoirs in sedimentary rocks in the Appalachian Basin region, ranked by their potential favorability. Favorability is quantified using three metrics: Reservoir Productivity Index for water; Reservoir Productivity Index; Reservoir Flow Capacity. The metrics are explained in the Reservoirs Methodology Memo (included in zip file). The product represents a minimum spatial extent of potential sedimentary rock geothermal reservoirs. Only natural porosity and permeability were analyzed. Shapefile and images of the spatial distributions of these reservoir quality metrics and of the uncertainty on these metrics are included as well. UPDATE: Accompanying geologic reservoirs data may be found at: https://gdr.openei.org/submissions/881 (linked below).

15 GEOTHERMAL ENERGY↗

FTICR-MS Data from Multi-continent River Water and Sediment and from Coastal River Fresh and Saline Sediment Associated with: “Dissolved Organic Matter Functional Trait Relationships are Conserved Across Rivers”

This data package is associated with the publication “Dissolved Organic Matter Functional Trait Relationships are Conserved Across Rivers” submitted to PNAS (Stegen et al., 2023). The study aims to understand large-scale spatial structure of the dissolved organic matter (DOM) thermodynamic traits and inter-trait relationships by investigating (1) river water and sediments collected along 97 rivers spanning 3 continents and (2) coastal sediment collected from fresh and saline locations in Pacific and Gulf/Atlantic rivers. Sediment extracts and water samples were analyzed using ultrahigh resolution Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS). This dataset is comprised of three folders (1) Coastal, (2) WHONDR_S19S, and (3) Data_Dictionaries. Coastal contains (1) a subfolder with processed FTICR-MS data as csv files and sample collection metadata, (2) a subfolder with R scripts used to process the data and create associated figures, (3) a subfolder with the raw, unprocessed FTICR-MS data as .xml files, and (4) a readme file with more information about the dataset and instructions for using Formularity (https://omics.pnl.gov/software/formularity). WHONDRS_S19S contains (1) a csv file with processed FTICR data, (2) a csv with sample collection metadata, (3) a csv with sample geospatial data, (4) a csv with simulated lambda model outputs, (5) a subfolder with R scripts used to process the data and create associated figures, and (6) a readme file with more information regarding WHONDRS raw FTICR data and processing scripts. Data_Dictionaries contains data dictionaries for each csv file in the data package. The 97 global river corridors were part of a WHONDRS (https://whondrs.pnnl.gov) study. The raw, unprocessed FTICR-MS data with additional data can be found at doi:10.15485/1729719 for sediments and doi:10.15485/1603775 for water. This data package contains the processed data used in the associated manuscript. The coastal data has not been previously published, and this data package contains both the raw and processed data. Version 3 of this data package published February 2023 includes updates to the title of the manuscript, additional data and data dictionary and updated scripts linked to new analysis.

54 ENVIRONMENTAL SCIENCES↗

Meteorological and hydrological parameters for 17 locations of meteorological stations of the East River Watershed

The Data Package includes a set of csv files of input meteorological parameters for locations of 17 meteorological stations within the East River watershed. These meteorological datasets were downloaded from the (1) PRISM database--monthly precipitation, air temperature (minimum, mean, and maximum), vapor pressure deficit (minimum and maximum), and dewpoint temperature, and (2) NCEP/NCAR Reanalysis database – wind database. The datasets were used for calculations of the Potential Evapotranspiration (ETo), Actual Evapotranspiration (ET), Standard Precipitation Index (SPI) , Standard Evapotranspiration-Precipitation Index (SPEI) for the period from 1966 to 2021. The main research questions addressed are: the evaluation of the long-term temporal trends of climatic parameters, hierarchical clustering, and areal mapping/zonation of the East River watershed. Calculations were conducted in the Rstudio environment. The dataset additionally includes a file-level metadata (flmd.csv) file that lists each file contained in the dataset with associated metadata; and a data dictionary (dd.csv) file that contains column/row headers used throughout the files along with a definition, units, and data type.The input datasets were downloaded from (a) PRISM database (the Northwest Alliance for Computational Science and Engineering at the Oregon State University), and (b) NCEP/NCAR Reanalysis database.

54 ENVIRONMENTAL SCIENCES↗

Data and scripts associated with “Point-scale organic-matter decomposition in streambeds is weakly associated with reach-scale respiration”

This data package is associated with “Point-scale organic-matter decomposition in streambeds is weakly associated with reach-scale respiration” published in EGU Biogeosciences (Stegen et al., 2026; https://doi.org/10.5194/bg-23-3981-2026). It contains cotton strip decomposition rates (Kcd and Kdd) collected across the Yakima River Basin (YRB), Washington, USA. These data were collected to support a broader study examining the drivers of spatial variability in sediment respiration rates in the Yakima River Basin. Associated data used in analysis, metadata, and field protocols can be accessed at https://data.ess-dive.lbl.gov/datasets/doi:10.15485/1923689, https://data.ess-dive.lbl.gov/datasets/doi:10.15485/1969566, and https://data.ess-dive.lbl.gov/datasets/doi:10.15485/1987520. This data package is associated with the repository found at https://github.com/river-corridors-sfa/rcsfa-ST-2B-SSS-cotton-strip. A preliminary version of this data package was published in December 2025 at the time of manuscript submission. It was updated in June 2026, at the time of manuscript acceptance, to include additional metadata (this readme, data dictionary, and file level metadata). The data did not change. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to a readme, this data package also includes a file-level metadata (FLMD) file that describes each file and a data dictionary (DD) that describes all column/row headers and variable definitions. This data package consists of (1) readme; (2) data dictionary (dd); (3) file level metadata (flmd); and (4) four folders: (1) R-scripts; (2) figures; (3) outputs from the scripts; and (4) published data. The published data folder contains a readme directing the user to download data in order to run the R-scripts. All files are .csv, .pdf, .R, .Rmd, and .txt. We acknowledge the Yakama Nation as owners and caretakers of the lands where we collected these data. We thank the Confederated Tribes and Bands of the Yakama Nation Tribal Council and Yakama Nation Fisheries for working with us to facilitate sample collection and optimization of data usage according to their values and worldview.

54 ENVIRONMENTAL SCIENCES↗

Data and scripts associated with “Non-random processes impacting organic matter chemistry are maximized in mid-order streams”

NOTE: The manuscript associated with this data package is currently in review. The data may be revised based on reviewer feedback. Upon manuscript acceptance, this data package will be updated with the final dataset and additional metadata. This data package is associated with the publication “Non-random processes impacting organic matter chemistry are maximized in mid-order streams” submitted to Limnology and Oceanography (L&O) by Danczak et al. (in review). This package contains data and scripts used to investigate dissolved organic matter (DOM) molecular chemistry and diversification processes across 47 surface-water sampling sites in the Yakima River Basin, Washington, USA, during an August 2021 sampling campaign. The package contains analyses of ultrahigh-resolution Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS), geochemical measurements, geospatial attributes, molecular diversity, and meta-metabolome ecological null models needed to reproduce the main manuscript results. The underlying field data were pulled from exising data packages at https://doi.org/10.15485/1892052 (Fulton et al., 2022) and https://doi.org/10.15485/1898914 (Grieger et al., 2022). For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. We thank the following organizations for providing access to field locations for sample collection: the United States Forest Service, Washington Department of Fish and Wildlife, Washington Department of Natural Resources, the Confederated Tribes and Bands of the Yakama Nation, and the Cowiche Canyon Conservatory. Research was conducted under Washington State Parks and Recreation Commission Scientific Research Permit #210901. We are grateful to the Yakama Nation Tribal Council and Yakama Nation Fisheries for their collaboration in facilitating sample collection and ensuring data usage aligns with their values and worldview. This data package contains an R-Markdown file for analyses and five folders: (1) Data, (2) Geospatial Data, (3) Supplemental_Files, (5) Figures_pdf, (4) and src. The Data folder contains tabular inputs and derived files used in the manuscript analysis. The Geospatial Data folder contains climate and water-balance, hydrologic, land-cover, population/regional water-use, stream, topographic, and stream-order attribute CSV files. The src folder contains scripts used to process data, run analyses, and generate figures. The Figures_pdf folder contains manuscript figure outputs. The Supplemental_Files folder contains supplemental analysis products. All files are .csv, .pdf, .html, .png, .R, .Rmd, .svg, or .tre. This data package is associated with the rcfsa-RC2-SPS_Null_Modeling repository found at https://github.com/river-corridors-sfa/rcfsa-RC2-SPS_Null_Modeling.

54 ENVIRONMENTAL SCIENCES↗

CHESS 2025: Waveform LiDAR data from NEON AOP surveys

This dataset provides Level 1 (L1) full-waveform light detection and ranging (LiDAR) data collected for the 2025 Colorado Headwaters Ecological Spectroscopy Study (CHESS). These data were acquired to enable characterization of vegetation structure and other three-dimensional features of the land surface, and to evaluate structural changes that may have occurred between a prior LiDAR acquisition in 2018 and the 2025 overflight. Waveform LiDAR data can provide more detailed information about objects on the ground than discrete point clouds typically do, and they are often used for granular target segmentation and characterization of subcanopy vegetation. The data were acquired over three study domains in the Upper Gunnison river basin: the upper East River watershed (CRBU); Almont Triangle and Taylor Canyon (ALMO); and Upper Taylor River watershed (UPTA) between 2025-06-13 and 2025-07-15. LiDAR data were acquired using the Optech Galaxy Prime Airborne LiDAR Terrain Mapper onboard the National Ecological Observatory Network (NEON) Airborne Observation Platform (AOP). These are the primary waveform LiDAR data delivered by NEON and are provided per flightline in compressed Pulsewaves format, an open-source binary file standard. A Pulsewaves object comprises a two files: a pulse (.pls) file, which stores the geographic origin, outgoing vector, and metadata for every laser pulse emitted by the scanner, and a wave file (.wvs), which stores the sequential amplitude samples of the outgoing pulse and the returning signals. The files are published here in their compressed forms (.plz, .wvz). All waveform data were processed following the theoretical workflow described in the NEON L0-to-L1 Waveform LiDAR Algorithm Theoretical Basis Document (Krause and Goulden 2022a); however, the Pulsewaves output format differs from a legacy format described in that document. Waveform amplitude samples are recorded at 1 nanosecond intervals. All coordinates are provided in meters. Horizontal coordinates are referenced in Universal Transverse Mercator (UTM) zone 13N and the World Geodetic System (WGS) 1984 ensemble datum. Elevations are referenced to Geoid12A. Waveform data for the UPTA survey area were collected without incident and the published records are complete. However, both the ALMO and CRBU collections experienced issues that resulted in incomplete data for those areas. On collection day 2018-06-16 a hardware failure caused the waveform digitizer to lose data from the eastern edge of the ALMO site (Figure 22). The waveform data for flightlines 2–20 could not be extracted from the digitizer, and the data proved unrecoverable. As a result, a portion of the site does not have coverage with waveform data. Although no hardware failure was observed during collection over the CRBU area, final waveform files generated by vendor software contained only ~25% of the expected number of return pulses. After discovery, NEON initiated troubleshooting with the vendor. The root cause of the data ablation had not been identified at the time of publication. Additional data will be published in an update to this package if further recovery proves successful. CHESS Project Description: The Colorado Headwaters Ecological Spectroscopy Study (CHESS) comprised a multi-week airborne remote sensing and field observation campaign in the Upper Gunnison Basin, Colorado, conducted in June and July of 2025. Airborne remote sensing was conducted by the National Ecological Observatory Network Airborne Observation Platform (NEON AOP), concurrent with a field campaign run by the Rocky Mountain Biological Laboratory (RMBL), the Lawrence Berkeley National Laboratory (LBNL) and SLAC National Accelerator Laboratory Watershed Function Science Focus Area (SFA), and NASA-JPL (Jet Propulsion Laboratory) Earth Surface Mineral Dust Source Investigation (EMIT) program. Between June 10 and July 18, 2025, the NEON AOP flight team collected high-resolution aerial imaging spectroscopy and Light Detection and Ranging (LiDAR) data over three domains: the Upper East River (CRBU), Almont Triangle (ALMO), and the Upper Taylor Basin (UPTA). In coordination with the flights, a field campaign acquired ground-truth observations, including observations of vegetation composition, foliar traits, forest demography, and subsurface properties in 18 core sampling areas within the domains. Additional surface water observations were taken at over 380 point locations. All CHESS campaign datasets can be found within the CHESS ESS-DIVE data portal: https://data.ess-dive.lbl.gov/portals/chess. Funding Acknowledgement: Field and remote-sensing data acquisition was performed under a grant from the National Aeronautics and Space Administration (80NSSC24K1005). This work was also supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

2018 NEON and 2025 CHESS Campaigns↗

Use of the ERD for administrative monitoring of Theta

Monitoring the state of an HPC cluster in a timely and accurate fashion is critical to most system administration functions. For many Cray users, the first step in monitoring is ingestion of log files. Unfortunately, log parsing is an inherently inefficient process, requiring multiple software components to read and write from files on disk. Cray's own utilities use a message bus, the Event Router Daemon (ERD), for a wide variety of purposes. At the Argonne Leadership Computing Facility (ALCF), we have begun to use this message bus for monitoring via a client library written in Go, allowing us to read in structured data directly from Cray's services and, in many instances, bypass log files entirely. In this paper, we will examine the implementation and utilization of this approach on our 4392 node XC40, Theta, as well as the overall benefits and drawbacks to using the ERD for real-time monitoring.

Cray↗

Throughput Analytics of Data Transfer Infrastructures

To support increasingly distributed scientific and big-data applications, powerful data transfer infrastructures are being built with dedicated networks and software frameworks customized to distributed file systems and data transfer nodes. The data transfer performance of such infrastructures critically depends on the combined choices of file, disk, and host systems as well as network protocols and file transfer software, all of which may vary across sites. The randomness of throughput measurements makes it challenging to assess the impact of these choices on the performance of infrastructure or its parts. We propose regression-based throughput profiles by aggregating measurements from sites of the infrastructure, with RTT as the independent variable. The peak values and convex-concave shape of a profile together determine the overall throughput performance of memory and file transfers, and its variations show the performance differences among the sites. We then present projection and difference operators, and coefficients of throughput profiles to characterize the performance of infrastructure and its parts, including sites and file transfer tools. In particular, the utilization-concavity coefficient provides a value in the range [0, 1] that reflects overall transfer effectiveness. We present results of measurements collected using (i) testbed experiments over dedicated 0–366 ms 10 Gbps connections with combinations of TCP versions, file systems, host systems and transfer tools, and (ii) Globus GridFTP transfers over production infrastructure with varying site configurations.

Rao, Nageswara S.↗

Reducing I/O variability using dynamic I/O path characterization in petascale storage systems

In petascale systems with a million CPU cores, scalable and consistent I/O performance is becoming increasingly difficult to sustain mainly because of I/O variability. Furthermore, the I/O variability is caused by concurrently running processes/jobs competing for I/O or a RAID rebuild when a disk drive fails. We present a mechanism that stripes across a selected subset of I/O nodes with the lightest workload at runtime to achieve the highest I/O bandwidth available in the system. In this paper, we propose a probing mechanism to enable application-level dynamic file striping to mitigate I/O variability. We also implement the proposed mechanism in the high-level I/O library that enables memory-to-file data layout transformation and allows transparent file partitioning using subfiling. Subfiling is a technique that partitions data into a set of files of smaller size and manages file access to them, making data to be treated as a single, normal file to users. Here, we demonstrate that our bandwidth probing mechanism can successfully identify temporally slower I/O nodes without noticeable runtime overhead. Experimental results on NERSC’s systems also show that our approach isolates I/O variability effectively on shared systems and improves overall collective I/O performance with less variation.

97 MATHEMATICS AND COMPUTING↗