Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “merging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

ParChain: a framework for parallel hierarchical agglomerative clustering using nearest-neighbor chain

This paper studies the hierarchical clustering problem, where the goal is to produce a dendrogram that represents clusters at varying scales of a data set. We propose the ParChain framework for designing parallel hierarchical agglomerative clustering (HAC) algorithms, and using the framework we obtain novel parallel algorithms for the complete linkage, average linkage, and Ward's linkage criteria. Compared to most previous parallel HAC algorithms, which require quadratic memory, our new algorithms require only linear memory, and are scalable to large data sets. ParChain is based on our parallelization of the nearest-neighbor chain algorithm, and enables multiple clusters to be merged on every round. We introduce two key optimizations that are critical for efficiency: a range query optimization that reduces the number of distance computations required when finding nearest neighbors of clusters, and a caching optimization that stores a subset of previously computed distances, which are likely to be reused. Experimentally, we show that our highly-optimized implementations using 48 cores with two-way hyper-threading achieve 5.8--110.1x speedup over state-of-the-art parallel HAC algorithms and achieve 13.75--54.23x self-relative speedup. Compared to state-of-the-art algorithms, our algorithms require up to 237.3x less space. Our algorithms are able to scale to data set sizes with tens of millions of points, which existing algorithms are not able to handle.

Computer Science↗
DOE OSTI2020

Utah FORGE: Phase 3 Magnetotelluric (MT) Data

New high-quality tensor MT data at 122 sites, including the vertical magnetic field and utilizing ultra-remote referencing, have been acquired over the Utah FORGE project area. The results will be used to delineate the densities of faults and fractures in crystalline basement rocks, to define the heat sources, and to derive baseline 3D resistivity structure for later MT monitoring of temporal changes in resistivity structure following well stimulation in the EGS reservoir. There are three files here related to Utah FORGE magnetotelluric (MT) data acquisition and processing. The FORGE MT EDIs zip file contains the observed MT responses in industry-standard EDI format. For each site, there is an EDI response file that utilized a local independent reference for noise cancellation, and a file that utilized a distant reference cancelling noise associated with the DC transmission line of the Delta IPP passing down the west side of Milford Valley. These two site files could be merged as appropriate. The FORGE Model Cell Center file contains the model volume of the 3D Forge MT inversion for characterizing the resistivity structure in the project area. It was derived using finite element inversion methodology described in Wannamaker et al, in the attached FORGE Phase3 Geophysics paper, from the MT observation EDI files. It is ASCII format (.dat) and entries are defined at top of the file in a simple x-y-z-Rho listing in UTM coordinates. The element layers drape the topography so the Rho value layers are not purely horizontal slices. This greatly simplifies the listing.

15 GEOTHERMAL ENERGY↗
DOE OSTI2023

Utah FORGE: Sanvean Technologies Drilling Data from Well 16B(78)-32

Included here is Sanvean Technologies bit sensor data amalgamated with data from National Oilwell Varco's (NOV) BlackBox tool for Reed Hycalog bits used during drilling of Well 16B(78)-32. The dataset contains information collected at the bit while drilling including rate of penetration (ROP), top drive torque, and bit box temperature. The data was recorded at the bit box and top sub of the motor. RPM was measured by onboard gyro recording continuously in each sensor, and shock levels were also recorded on X, Y and Z axis. This data was merged with EDR in time format and saved in file sets (the zipped files) then output into CSV files. Please note: fields in the CSV files, such as the date field, may need to be formatted to display properly. There is an additional zipped folder in each dataset that is password protected. Sanvean GameChanger Viewer software must be used to view this password protected data. Information on how to use and download this free software is also included here.

15 GEOTHERMAL ENERGY↗
DOE OSTI2024

Surface plasmon-cavity hybrid state and its graphene modulation at THz frequencies

Fabry–Pérot (F–P) cavity and metal hole array are classic photonic devices. Integrating F–P cavity with holey metal typically enhances interfacial reflection and dampens wave transmission. In this work, a hybrid bound surface state is found within rectangular metal holes on a silicon substrate by merging an extraordinary optical transmission (EOT) mode and a high-order F–P cavity mode both spatially and spectrally. Transmission, Q-factor, and bandwidth can be enhanced significantly with respect to the classical EOT and F–P interference by simply sweeping the cavity length. This state can provide EOT properties and ten times broader EOT bandwidth well below the effective plasma frequency of the periodic metal holes, where the metal holes typically show evanescent properties and do not support EOT in theory. Furthermore, a large modulation range of 25 % and 39 % is demonstrated with various graphene patterns for the transmittance of this hybrid state at 500 and 582 GHz, respectively.

36 MATERIALS SCIENCE↗
DOE OSTI2019

Genome-Wide Association Mapping of Anthracnose ( Colletotrichum sublineolum ) Resistance in NPGS Ethiopian Sorghum Germplasm

The National Plant Germplasm System (NPGS) Ethiopian sorghum [Sorghum bicolor (L.) Moench] collection of the United States is an important genetic resource for sorghum improvement. Anthracnose (Colletotrichum sublineolum) is one of the most harmful fungal diseases in humid sorghum production regions. Although multiple resistance sources have been identified in temperate-adapted germplasm in the Sorghum Association Panel (SAP), these resistance loci explain a limited portion of the total variation, and sources of resistance from tropical germplasm are not available for breeding programs at temperate regions. Using a core set of 335 previously genotyped NPGS Ethiopian accessions, we identified 169 accessions resistant to anthracnose. To identify resistance loci, we merged the genotypic and anthracnose response data for both NPGS Ethiopian germplasm and the SAP and performed genome-wide association scans using 219,037 single nucleotide polymorphisms and 617 accessions. The integrated data set enabled the detection of a locus on chromosome 9 present in the SAP at a low frequency. The locus explains a limited portion of the observed phenotypic variation ($r^2$ = 0.31), suggesting the presence of other resistance loci. The locus in chromosome 9 was constituted by three R genes clustered within a 47-kb region. The presence of multiple sources of resistance in NPGS Ethiopian germplasm and SAP requires the inclusion of other resistance response evaluation that could revealed others low frequency resistance alleles in the panel.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Cadillac CT6 Super Cruise On-road Data

This dataset encompasses about 60 individual drives of a 2019 Cadillac CT6 with Super Cruise in its relevant operational domain covering more than 1,000 miles. Adhering to the limited operational design domain of the investigated version of the Supercruise system, the majority of the data was collected during highway driving. Information collected includes vehicle CAN data as well as Lidar and camera data from a vehicle mounted sensor array. Vehicle CAN data and information on traffic surrounding the Ego-vehicle derived from the sensor array are postprocessed and merged to provide one combined CVS data file per drive. ![cadillac-ct6 image](ct6.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Tesla Model 3 Autopilot On-road Data

This dataset encompasses about 60 individual drives of a 2020 Tesla Model 3 with Autopilot in its relevant operational domain covering more than 1,000 miles. The majority of the data was collected during highway and suburban driving. Information collected includes vehicle CAN data as well as Lidar and camera data from a vehicle mounted sensor array. Vehicle CAN data and information on traffic surrounding the Ego-vehicle derived from the sensor array are postprocessed and merged to provide one combined CVS data file per drive. ![tesla m3 image](tesla-m3.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

NEON AOP foliar trait maps, maps of model uncertainty estimates, and conifer map, East River, CO 2018

This data package contains mapped trait estimates and their uncertainties, and conifer map, for the National Ecological Observatory Network's Airborne Observation Platform survey data acquired over the Upper East River, Colorado in 2018. For full details, please see associated reference. in brief, trait models were developed independently for needle and non-needle leaf species using partial least squares regression (PLSR) using ground data from additional datasets: doi:10.15485/1618130, doi:10.15485/1618132, and doi:10.15485/1631278, merged with extracted spectral data from doi:10.15485/1618131. We separated vegetated pixels into needle and non-needle classes in order to generate a classification map based on the spectral differences between these leaf types (conifer.tif). We trained a deep learning model with custom architecture, detailed in Chadwick et al. In Press. The model performed with 0.998 true positive rate and 0.982 true negative rate, with ‘positives’ being non-needle identification. We then utilized PLSR to generate models of foliar traits for each leaf type. So that we could also map uncertainty in these predictions, we generated ten different models for needle and non-needle leaf species using different testing holdout sets of discrete sites. Each of these models was developed with a 100-fold cross validation procedure that utilized a 70% training set and 30% validation set with each fold, and then assessed based on the 10% of testing sites that were not included in that model’s development. The mean predicted value across the 10 models is used for the trait estimate in each pixel across the study area. The models are applied according to the leaf type designation in the conifer.tif map. The errors are the standard deviation across the 10 different models developed, with high error suggesting instability in model prediction and areas where values may not be reliable for ecological inference. These maps are only applied to areas with a NDVI > 0.5 to exclude non-vegetated areas. Shade masks could be applied to these data (doi:10.15485/1618131), but have not been for this data package. These data are also available on Google Earth Engine: https://code.earthengine.google.com/?asset=users/kdc/ER_NEON

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Soil Environmental Conditions in the East River Watershed, CO

This dataset contains depth-resolved soil environmental variables collected between June 2016 and October 2018 from the Bradley Meadow site in the East River watershed. Datalogger output from 7 Campbell CS655 12 cm Soil Moisture and Temperature Sensors including depth, temperature, volumetric water content, and electrical conductivity are included in ‘BM_Merged_T_VWC_0616_10_18.csv’. Sensors were installed in June 2016. Data have been processed to merge raw sensor data and to remove additional variables. No additional QA/QC was performed. Measured pCO2 and depth are contained in ‘BM_EGM_WELL_CO2.csv’. These data represent gas well samples measured via injection using a PP Systems EGM-5 infra-red gas analyzer as described in the methods section. Measured CO2 surface flux values are contained in 'BM_EGM_Surface_Flux.csv'. These were measured using the PP Systems EGM-5 with the Soil Respiration Chamber attachment. Multiple reps are reported for each measurement including CO2 flux rate calculations using built-in linear and quadratic function methods, and average and standard deviations are taken across all reps and calculation methods.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Data and scripts associated with the manuscript evaluating the hydrologic responses of the Pacific Northwest watersheds to wildfires (v2)

This data package is associated with the publication “Evaluating Post-fire Watershed Response to Varying Burn Severity and Precipitation Regimes Using Fully-distributed and Integrated Hydrologic Models” submitted to Journal of Hydrology (Li et al. 2025). In this study, we employed the Advanced Terrestrial Simulator (ATS), an integrated watershed model that couples surface flow, subsurface flow, and canopy biophysical processes, to investigate post-fire hydrologic responses in a few selected watersheds with varying burn severity.The data package contains the required input data (meteorological forcing, Leaf Area Index, wildfire burn severities, etc.) to run the model, configuration files, the Jupyter notebooks in Python to pre-process and post-process data, the figures in the manuscript, and the modeling output files. The variables include watershed-averaged evapotranspiration, watershed-averaged surface/subsurface/canopy water content, and river discharge at watershed outlet.The data package contains a file-level metadata that lists and describes all the files contained in the data package (ATS_flmd.csv), a data dictionary file that defines columns headers across all csv files contained in the data package (ATS_dd.csv), a data package level readme file (the current file), and four zipped folders.The ‘data’ folder provides data needed to run the model in .h5, .i2s, .xyz, .shp, and .exo formats. The sub-folders are for each data types. The ‘model’ folder provides input files (.xml format) and essential model outputs. Each sub-folder provides the files from each simulated watershed. The ‘notebooks’ folder provides the Jupyter notebooks (.ipynb format) for pre- and post- processing model files, and for producing the figures in the manuscript. The ‘figures’ folder provides the figures associated with manuscript in .pdf and .png formats.The ‘model’ folder and the ‘data’ folder have been split into 5GB-large pieces using the Linux command ‘split -b 5120m model.zip model.zip.’ and ‘split -b 5120m data.zip data.zip.’, respectively. They can be merged back using the Linux command ‘cat model.zip.* > model.zip’ and ‘cat data.zip.* > data.zip’, respectively.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Water chemistry in flume channel and hyporheic zone (i.e., porewater) associated with: “Rethinking Aerobic Respiration in the Hyporheic Zone Under Variation in Carbon and Nitrogen Stoichiometry”

Dissolved oxygen (DO), total organic carbon (TOC), total nitrogen (TN), molecular data for organic matter, and biochemical reactions for surface water and porewater (i.e., hyporheic zone) collected from a water recirculating flume located at the University of Texas, Austin. The flume contained real river water from Lower Colorado River(Austin, TX) and clean sand. Hyporheic exchange in the flume was induced through The study aims to understand relationships between aerobic metabolism of organic matter and molecular characteristics of organic matter, such as thermodynamic signature and nitrogen content, through the extent of the hyporheic zone at 10 cm- resolution, and through time. During the experiment, organic matter (dry leaves) was added to the flume and removed after 24 hours. The water samples were collected before the addition of leaves, at the time of removal of leaves, and at hour 72. The water samples were analyzed using ultrahigh resolution Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) and total organic carbon (TOC) and total nitrogen (TN) analysis. Dissolved oxygen content throughout the surface water and the hyporheic zone of the flume was measured with a large planar optode. This data package is associated with the publication ’ Rethinking Aerobic Respiration in the Hyporheic Zone Under Variation in Carbon and Nitrogen Stoichiometry’ published in Environmental Science and Technology (Turețcaia et al., 2023 https://doi.org/10.1021/acs.est.3c04765). The dataset is comprised of five folders (1) Diss_O2_pic, (2) input_files (3) output_files; (4) python_code; and (5) R_code . Diss_O2_pic contains siximages of dissolved oxygen distribution in a bedform at hours 0, 24, and 72 of the experiment conducted in a large recirculation flume. Images are in separate R and G channels (i.e., RGB). The input_files contains (1) a csv file with FTICR peaks identified within each sample, (2) a csv file with molecular information pertinent to FTICR data with Gibbs free energy calculations adjusted for environmental temperature, (3) a csv file containing concentrations of non-purgeable organic carbon measured throughout the experiment , (4) a csv file containing concentrations of total nitrogen measured throughout the experiment, (5) a csv file containing total biochemical reactions (i.e., transformations) identified in the dataset, (6) a csv containing transformation profiles, and (7) a csv file containing transformations with formulas, and (8) a jpg file with schematic representation of locations for sample collection. The output_files contains (1) and xlsx file containing percent biochemical reactions containing nitrogen identified across all 39 sample, (2) a csv file of merged FTICR data and molecular information files, (3) a csv files containing average Gibbs free energy within sampling domains and at each sampling location, (4) a csv file with average concentrations of dissolved oxygen across sampling locations at hour 0, (5) a csv file with average concentrations of dissolved oxygen across sampling locations at hour 24, (6) a csv file with average concentrations of dissolved oxygen across sampling locations at hour 72, (7) a csv file with percent chemical classes identified across sampling locations at hour 0, (8) a csv file with percent chemical classes identified across sampling locations at hour 24, (9) a csv file with percent chemical classes identified across sampling locations at hour 72, and (10) a csv file containing percent nitrogen containing biochemical reactions identified across sampling locations at hours 0, 24, and 72. The python_code contains seven ipynb files which are Jupyter Notebooks used for data analysis and figures generation. The R_code contains 3 R files with R code used for data analysis and figures generation. This data package contains the processed data used in the associated manuscript. This data has not been previously published.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Stream bed topography in 2016 at the Lower Montane site in the East River Watershed, Colorado

This dataset contains stream bed topography data from the Lower Montane site in the East River Watershed, Colorado. It is intended to support hydro-biogeochemical analyses for the Watershed Function Scientific Focus Area (SFA). The stream bed was surveyed using a RTK-GPS (Real-Time Kinematic Global Positioning System) and a total station at hundreds of locations during two field campaigns, conducted in October 2015 and October 2016. The two surveys were merged into a single product under the assumption of minimal changes in stream bed topography between the years. A LiDAR (Light Detection and Ranging) derived ground surface elevation product from 2015 (see reference below) was used to interpolate the stream bed topography and estimate water depth at the time of the LiDAR survey. The dataset includes three GeoTIFF products, two *.csv data files, and three *.csv metadata files. Feel free to contact the author with any questions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Microbial community data from throughfall exclusion experiment: Metadata, SI, community composition, LefSe, and FunGuilR data tables from PARCHED Panama tropical forest soils, 2024-2025

Soil contains more carbon (C) than terrestrial vegetation and the atmosphere combined, with some of the largest terrestrial C stocks in tropical rainforests. Soil microbes decompose organic matter, playing a vital role in the storage or loss of soil C. With climate change, drought conditions are predicted to increase in many tropical regions, including both chronic drying and extended drought, potentially influencing these processes. This project explored the effects of chronic and seasonal drying on soil microbial communities across four distinct tropical forests in a long-term drying experiment. We investigated the effects of a chronic drying manipulation on soil microbial community abundance and variation across different forests and seasons. We also compared findings with previously published data from these forests after short-term drying. This project used soils from a long-term drying experiment established in 2018 across four seasonal lowland forests in Panama. Soils were collected from 0 – 10 cm depths during three seasonal periods in control and drying plots in 2024 and 2025 from a total of 32 plots (n = 4 per forest per treatment). The forests varied in baseline rainfall and soil fertility. We calculated alpha and beta diversity indices and compared taxonomic community composition. We found significant biogeographic variation in microbial diversity and taxonomy, with significant differences across the forests and significant effects of the drying treatment. Metadata and sample IDs are within Metadata_16S.csv and Metadata_ITS.csv. Relative abundance tables of every sample at every season are shown in the Excel workbooks 16S Relative Abundance.xlsx and ITS Relative Abundance.xlsx. They are then also shown in CSV files by each taxonomic level. Linear discriminant analysis effect size (LefSe) tables are shown for the full 16S and ITS datasets (n = 96), subsets for every site at every season (n = 8), and then for the forests with each plot merged by season (n = 8). FunGuildR data table of ITS data is uploaded.

Bacteria↗
DOE OSTI2021

Hierarchical model reduction driven by a proper orthogonal decomposition for parametrized advection-diffusion-reaction problems

This work combines the Hierarchical Model (HiMod) reduction technique with a standard Proper Orthogonal Decomposition (POD) to solve parametrized partial differential equations for the modeling of advection-diffusion-reaction phenomena in elongated domains (e.g., pipes). This combination leads to what we define as HiPOD model reduction, which merges the reliability of HiMod reduction with the computational efficiency of POD. Two HiPOD techniques are presented and assessed by an extensive numerical verification.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

A Comparison of Machine Learning Methods of Association Tested on Dense Nodal Arrays

The association of phase picks to form events is one of the fundamental components of seismology. Large and dense sensor networks, such as >1000 geophone arrays (and distributed acoustic sensing), offer unique challenges in association due to the vast numbers of observations and high likelihood of errant picks. In addition, the large number of stations can greatly increase the time it takes to perform the association. For this reason, machine learning (ML) methods might provide a more optimal method of association for such networks. In this work, we examine how well ML methods (e.g., Gaussian mixture model association, PhaseLink, and Graph Earthquake Neural Interpretation Engine) can incorporate dense seismic arrays into regional networks and how well they handle the increasing numbers of stations. Here, we test their capabilities on two dense seismic deployments, one within Rock Valley Nevada (52 nodes and a 9-station sparse local network), and the LArge-n Seismic Survey in Oklahoma dense nodal array (>1800 vertical-component geophones). Processing data from these two different styles of dense seismic deployments allows testing of how the ML algorithms can merge array data with a broader regional network, how they deal with poorly picked phases, and how they handle anthropogenic noise. We compare the ML-associated bulletins to those obtained using the Rapid Earthquake Association and Location algorithm, a more traditional method of association. We find that there are very small differences in results between the methods for small networks (<100 stations) with low pick rates. For large networks (>1000), there are enough errant picks that some of the ML methods start to create false events out of noise. We also find that the ML methods vary in computation time significantly but are all faster than the traditional method tested here.

58 GEOSCIENCES↗
DOE OSTI2020

Hydrogeologic Model Based on Reduced Complexity

This data set provides the basic hydrogeologic model used for development of the TOUGH2 reservoir modeling results for the Kimberlina site. The hydrogeologic model is based on the static geologic model provided as a separate data set but has some simplifications regarding the geologic layers. Some geologic layers have been merged for the hydrogeologic model because the hydrogeologic properties were very similar. The data set contains several files. The word file explains the structure of the data files. The pdf contains a table with the hydrogeologic properties. The data set also includes 15 thickness files for 15 geological layers (including 3 Vedder sand layers and 3 Vedder shale layers), three elevations files (with reference elevation at ground surface/model top at 9000 m), and one fault trace file for seven faults. Most users may only need 2-3 faults close to the injection well (also see the figure). The arrangement of these layer thickness and elevations files can be see from the three layer files (for Tecplot). To develop a grid structure, start with the Vedder top elevation (REFVedderTop.dat) and add/subtract the thicknesses of layers above/below.

3D Groundwater Model↗
DOE OSTI2024

IDAES-PSE 2.4.0 Release

The Institute for the Design of Advanced Energy Systems (IDAES) Integrated Platform is a versatile computational environment offering extensive process systems engineering (PSE) capabilities for optimizing the design and operation of complex, interacting technologies and systems. IDAES enables users to efficiently search vast, complex design spaces to discover the lowest cost, most environmentally sustainable solutions while supporting the full process modeling lifecycle, from conceptual design to dynamic optimization and control. The extensible, open platform empowers users to create models of novel processes and rapidly develop custom analyses, workflows, and end-user applications.. Deprecations • Convergence Analysis tool (idaes/core/util/convergence): deprecated in favor of new Parameter Sweep tools. To be removed in v3.0.0. New Beta Capabilities • Parameter Sweep Tool (idaes.core.util.parameter_sweep) o A new API for defining and performing parameter sweep studies on IDAES models has been developed • Diagnostics Tools (idaes.core.util.model_diagnostics) o New methods for identifying duplicate variables and constraints have been added to the diagnostics toolbox o New tools for detecting ill conditioning in Jacobians have been developed and are available in the model_diagnostics module. These provide alternatives to the existing DegeneracyHunter toolbox, and will eventually be merged with this capability, but initial working versions have been provided as beta capabilities for interested users o IpoptConvergenceAnalysis (replaces deprecated Convergence Analysis tool):  A new tool for performing convergence analysis studies that leverages the new Parameter Sweep tools has been developed. This tool allows users to define the input parameters to their model and sampling methods for these (leveraging Pysmo's sampling tools) and to then solve their model across the sampled domains and return a summary of the solver performance (IPOPT only) Improved Models • Thickener model (idaes.models.unit_models.solid_liquid.thickener) o Improved model to include predictive correlations for unit sizing based on settling velocity measurements (steady-state only) • Modular Property Packages o Added general support for calculating critical properties of mixtures using defined Equation of State modules. New API defined for Equation of State modules in order to define the necessary constraints for calculating critical properties (most EoS modules DO NOT support calculation of critical properties (yet)) o Added new methods to Cubic Equation of State module to support calculation of critical properties

DiagnosticsToolbox↗
DOE OSTI2021

The RCS Design Status for the Electron Ion Collider

The design of the Electron-Ion Collider Rapid Cycling Synchrotron (RCS) to be constructed at Brookhaven National Laboratory is advancing to meet the injection requirements for the Electron Storage Ring (ESR). Over the past year activities are focused on developing the approach to inject two 28 nC bunches every second, up from the original design of one 10nC bunch every second. The solution requires several key changes concerning the injection and extraction kickers, charge accumulation via bunch merging and a carefully calibrated RF acceleration profile to match the longitudinal emittance required by the ESR.

Ranjbar, V. H.↗