Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Cost of Fish Exclusion and Passage Technologies for Hydropower

Hydropower represents a reliable source of renewable energy and accounts for approximately 7% of the total electrical generation in the United States. Future expansion of hydropower is likely to be in the form of either smaller new stream development projects or powering existing non-powered dams. For these new projects to be successful, careful analysis of risks, costs, and uncertainty to offset reduced power production as well as ensuring the protection and safe passage of migratory fish to gain public support, will be required. Exclusion and passage are two common approaches to protect fish from entrainment and impingement at hydropower facilities. The thresholds for entrainment risk and requirements for exclusion and passage often differ depending on the species involved, the characteristics of the facility, and the goals of stakeholders. While the costs associated with environmental mitigations represent a large proportion of the total costs required for the licensing of hydropower facilities, little quantitative information is present within the literature regarding the specific costs of fish exclusion and passage. Working with FOA awardee Natel Energy, scientists at Oak Ridge National Laboratory were tasked with assessing the capital construction costs for downstream fish exclusion and passage infrastructure. This report used keyword searches of an existing environmental mitigation cost data set and manual extraction of additional cost data associated with protection, mitigation, and enhancement (PM&E) measures related to positive barrier screening and passage from regulatory licensing documents available in the Federal Energy Regulatory Commission (FERC) eLibrary. This approach yielded a total of 50 PM&E mitigation measures with estimated capital construction costs pertaining to positive barrier screens, 142 pertaining to passage studies, and 26 pertaining to passage-related studies. PM&E measures associated with positive barrier screens represented <10% of the 171 total FERC project dockets available in the data set. These data were highly skewed toward conventional relicensing projects, as <7% were associated with new stream development (NSD) projects. Results from these data indicate highly variable costs associated with fish screening, with flow-normalized costs one to two orders of magnitude higher for screening with the highest exclusion capability (≤0.09 in. spacing) compared with coarser screening (1 to 2 in.). Furthermore, estimated capital costs of passage infrastructure were positively related to the scale of the project based on installed capacity for some, but not all, types of passage. These data provide an initial baseline for estimating exclusion and passage costs for hydropower development and may help developers consider options for more fish-friendly generation technologies, though gaps remain relating to a lack of data, particularly for NSD projects. More data may still be available within the FERC eLibrary, but significant effort will be required to manually identify and extract the data for future analyses.

13 HYDRO ENERGY↗
DOE OSTI2020

A Lagrangian perturbation theory in the presence of massive neutrinos

We develop a Lagrangian Perturbation Theory (LPT) framework to study the clustering of cold dark matter (CDM) in cosmologies with massive neutrinos. We follow the trajectories of CDM particles with Lagrangian displacements fields up to third order in perturbation theory. Once the neutrinos become non-relativistic, their density fluctuations are modeled as being proportional to the CDM density fluctuations, with a scale-dependent proportionality factor. This yields a gravitational back-reaction that introduces additional scales to the linear growth function, which is accounted for in the higher order LPT kernels. Through non-linear mappings from Eulerian to Lagrangian frames, we ensure that our theory has a well behaved large scale behavior free of unwanted UV divergences, which are common when neutrino and CDM densities are not treated on an equal footing, and in resummation schemes that manifestly break Galilean invariance. We use our theory to construct correlation functions for both the underlying matter field, as well as for biased tracers using ConvolutionLPT. Redshift-space distortions effects are modeled using the Gaussian Streaming Model. When comparing our analytical results to simulated data from the Quijote 1 simulation suite, we find good accuracy down to r = 20 Mpc h -1 at redshift z = 0.5, for the real space and redshift space monopole particle correlation functions with no free parameters. The same accuracy is reached for the redshift space quadrupole if we additionally consider an effective field theory parameter that shifts the pairwise velocity dispersion. For modeling the correlation functions of tracers we adopt a simple Lagrangian biasing scheme with only density and curvature operators, which we find sufficient to reach down to r = 20 Mpc h -1 when comparing to simulated halos.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Heavy Flavor Physics at the sPHENIX Experiment

The sPHENIX experiment is a state-of-the-art jet and heavy flavor physics detector, which successfully recorded its first Au + Au collision data at 200 GeV at the Relativistic Heavy Ion Collider (RHIC). sPHENIX will provide heavy flavor physics measurements at RHIC, covering an unexplored kinematic region and unprecedented precision, to probe the parton energy loss mechanism, parton transport coefficients in quark–gluon plasma, and the hadronization process under various medium conditions. At the center of sPHENIX, the monolithic active pixel sensor (MAPS)-based VerTeX detector (MVTX) is a high-precision silicon pixel detector. The MVTX provides excellent position resolution and the capability of operating in continuous streaming readout mode, allowing precise vertex determination and recording a large data sample, both of which are particularly crucial for heavy flavor physics measurements. In this work, we will show the general performance of heavy-flavor hadron reconstruction. In addition, we will discuss the commissioning experience with sPHENIX. Finally, we will provide the projection of b-hadron and jet observables and discuss the estimated constraints on theoretical models.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

The Cocytos Stream: A Disrupted Globular Cluster from our Last Major Merger?

The census of stellar streams and dwarf galaxies in the Milky Way provides direct constraints on galaxy formation models and the nature of dark matter. The DESI Milky Way survey (with a footprint of 14,000$~deg{^2}$ and a depth of $r<19$ mag) delivers the largest sample of distant metal-poor stars compared to previous optical fiber-fed spectroscopic surveys. This makes DESI an ideal survey to search for previously undetected streams and dwarf galaxies. We present a detailed characterization of the Cocytos stream, which was re-discovered using a clustering analysis with a catalog of giants in the DESI year 3 data, supplemented with Magellan/MagE spectroscopy. Our analysis reveals a relatively metal-rich ([Fe/H]$=-1.3$) and thick stream (width$=1.5^\circ$) at a heliocentric distance of $\approx 25$ kpc, with an internal velocity dispersion of 6.5-9 km s$^{-1}$. The stream's metallicity, radial orbit, and proximity to the Virgo stellar overdensities suggest that it is most likely a disrupted globular cluster that came in with the Gaia-Enceladus merger. We also confirm its association with the Pyxis globular cluster. Our result showcases the ability of wide-field spectroscopic surveys to kinematically discover faint disrupted dwarfs and clusters, enabling constraints on the dark matter distribution in the Milky Way.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Rare earth metals from secondary sources: Review of potential supply from waste and byproducts

Current concerns about lack of diversity in supply of critical metals have spurred research into utilizing domestic sources, particularly from waste streams. Sustainability strategies like urban mining, industrial symbiosis, and the circular economy suggest avenues to realize new supplies of critical metals. In this work we explore the resource and economic potential for extracting rare earth elements (REEs) from industry byproducts (e.g. coal combustion products, red mud) and secondary sources (e.g. waste electronics and light bulbs). Combining materials flow analysis and characterization data, we find that while REE concentrations in waste and byproduct streams are mostly much lower than current REE ores, some secondary sources are richer than ores in high value REEs such as scandium. The quantities of REEs contained in secondary sources could meet current global demand even with low extraction yield rates. Phosphogypsum, coal ash and red mud from aluminum production stand out as promising candidates for recovery due to high concentrations of valuable REEs and sufficient quantities to potentially meet demand. Processes to extract REEs from secondary sources are under development, it is not clear yet which will be profitable at scale and which can be achieved at least environmental impact. This work provides high level guidance on the potential of secondary sources by characterizing quality (concentrations of different rare earths) and quantity (mass of rare earths in global scale wastes and byproducts). This significant first step helps clarify directions for policy and research and development investments.

42 ENGINEERING↗
DOE OSTI2026

Stable Water Isotope Data for the East River Watershed, Colorado (2014-2025)

The stable water isotope data for the East River Watershed, Colorado, consists of delta2H (hydrogen) and delta18O (oxygen) values from samples collected at multiple, long-term monitoring sites including streams, groundwater wells, springs, and a precipitation collector used to establish a local meteoric water line (LMWL) for the watershed. These locations represent important and/or unique end-member locations for which stable isotope values can be diagnostic of the connection between precipitation inputs as snow and rain and riverine export. Such locations include drainages underline entirely or largely by shale bedrock, land covered dominated by conifers, aspens, or meadows, and drainages impacted by historic mining activity and the presence of naturally mineralized rock. Developing a long-term record of water isotope values from a diversity of environments is a critical component of quantifying the impacts of both climate change and discrete climate perturbations, such as drought, forest mortality, and wildfire, on water export. Such data may be combined with stream gaging stations co-located at each surface water monitoring site to relate seasonal variations in water export to their stable isotopic signature. Data for liquid water delta2H and delta18O values are reported in units of parts per thousand (per-mil; ‰). This data package contains (1) a zip file (isotope_data_2014-2025.zip) containing a total of 95 files: 96 data files of isotope data from across the Lawrence Berkeley National Laboratory (LBNL) Watershed Function Scientific Focus Area (SFA) which is reported in .csv files per location and a locations.csv (1 file) with latitude and longitude for each location; (2) a file-level metadata (v6_20260901_flmd.csv) file that lists each file contained in the dataset with associated metadata; and (3) a data dictionary (v6_20260901_dd.csv) file that contains terms/column_headers used throughout the files along with a definition, units, and data type. Missing values within the anion data files are noted as either "-9999" or "0.0" for not detectable (N.D.) data. There are a total of 43 locations containing isotope data. Update on 2022-06-10: versioned updates to this dataset was made along with these changes: (1) updated isotope data for all locations up to 2021-12-31 and (2) the addition of the file-level metadata (flmd.csv) and data dictionary (dd.csv) were added to comply with the File-Level Metadata Reporting Format. Update on 2022-09-09: Updates were made to reporting format specific files (file-level metadata and data dictionary) to correct swapped file names, add additional details on metadata descriptions on both files, add a header_row column to enable parsing, and add version number and date to file names (v2_20220909_flmd.csv and v2_20220909_dd.csv). Update on 2023-08-08: Updates were made to both the data files and reporting format specific files. New available anion data was added, up until 2023-03-13. The file level metadata and data dictionary files were updated to reflect the additional data added. Update on 2024-03-11: Updates were made to both the data files and reporting format specific files. New available anion data was added, up until 2024-02-19. Further, revisions to the data files were made to remove incorrect data points (from 1970 and 2001). The reporting format specific files were updated to reflect the additional data added. Update on 2025-05-15: Updates were made to both the data files and reporting format specific files. New available isotope data was added, up until the end of WY2024 (September 30, 2024). International Generic Sample Numbers (IGSNs), when registered, were added to the data files. The reporting format specific files were updated to reflect the additional data added. Update on 2026-09-01: Updates were made to both the data files and reporting format specific files. New available isotope data was added, up until the end of WY2025 (September 30, 2025).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Solute chemistry for streams draining geomorphic features and varying land cover gradients in the East River watershed, Colorado

This dataset contains solute chemistry data and GPS coordinates for surface water samples collected in the East River watershed in the Elk and West Elk Ranges of Colorado from August 3rd through August 11th, 2022. Samples were collected from streams and groundwater seeps as part of a comprehensive analysis within the watershed of how different geomorphic features (such as landslides and rock glaciers) along with variations in land cover (such as the presence of vegetation) affect stream water quality in this Rocky Mountain headwater environment. This dataset includes concentrations of the following in a single csv file: fluoride, chloride, sulfate, nitrate, calcium, potassium, magnesium, sodium, silicon, and total organic carbon (TOC). All concentrations are reported in mg/L. The sulfate data in this version have been updated to account for an earlier ion chromatograph instrument method error whereby sulfate and bromide peaks overlapped in calibration solution samples, biasing calculated sulfate concentrations low by 30-50%. Sulfate data reported herein are from a re-run of the samples performed in December 2024 using a corrected instrument method. All samples were stored under refrigerated conditions and filtered on initial collection.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Anion Data for the East River Watershed, Colorado (2014-2025)

The anion data for the East River Watershed, Colorado, consist of fluoride, chloride, sulfate, nitrate, and phosphate concentrations collected at multiple, long-term monitoring sites that include stream, groundwater, and spring sampling locations. These locations represent important and/or unique end-member locations for which solute concentrations can be diagnostic of the connection between terrestrial and aquatic systems. Such locations include drainages underlined entirely or largely by shale bedrock, land covered dominated by conifers, aspens, or meadows, and drainages impacted by historic mining activity and the presence of naturally mineralized rock. Developing a long-term record of solute concentrations from a diversity of environments is a critical component of quantifying the impacts of both climate change and discrete climate perturbations, such as drought, forest mortality, and wildfire, on the riverine export of multiple anionic species. Such data may be combined with stream gauging stations co-located at each monitoring site to directly quantify the seasonal and annual mass flux of these anionic species out of the watershed. This data package contains (1) a zip file (anion_data_2014_2025.zip) containing a total of 386 files: 387 data files of anion data from across the Lawrence Berkeley National Laboratory (LBNL) Watershed Function Scientific Focus Area (SFA) which is reported in .csv files per location and a locations.csv (1 file) with latitude and longitude for each location; (2) a file-level metadata (v7_20260901_flmd.csv) file that lists each file contained in the dataset with associated metadata; (3) a data dictionary (v7_20260901_dd.csv) file that contains terms/column_headers used throughout the files along with a definition, units, and data type; and (4) a anion MDL fact sheet (anion_MDLs_202608 in PDF and docx formats). Missing values within the anion data files are noted as either "-9999" or "0.0" for not detectable (N.D.) data. There are a total of 47 locations containing anion data. Update on 2022-06-10: versioned updates to this dataset was made along with these changes: (1) updated anion data for all locations up to 2021-12-31, (2) removal of units from column headers in datafiles, (3) added row underneath headers to contain units of variables, (4) restructure of units to comply with CSV reporting format requirements, and (5) the addition of the file-level metadata (flmd.csv) and data dictionary (dd.csv) were added to comply with the File-Level Metadata Reporting Format. Update on 2022-09-09: Updates were made to reporting format specific files (file-level metadata and data dictionary) to correct swapped file names, add additional details on metadata descriptions on both files, add a header_row column to enable parsing, and add version number and date to file names (v2_20220909_flmd.csv and v2_20220909_dd.csv). Update on 2022-12-20: Updates were made to both the data files and reporting format specific files. Conversion issues affecting ER-PLM locations for anion data was resolved for the data files. Additionally, the flmd and dd files were updated to reflect the updated versions of these files. Available data was added up until 2022-03-14. Update on 2023-08-08: Updates were made to both the data files and reporting format specific files. New available anion data was added, up until 2023-05-19. The file level metadata and data dictionary files were updated to reflect the additional data added. Update on 2024-03-11: Updates were made to both the data files and reporting format specific files. New available anion data was added, up until 2023-09-11. Further, revisions to the data files were made to remove incorrect data points (from 1970 and 2001). The reporting format specific files were updated to reflect the additional data added. Update on 2025-05-15: Updates were made to both the data files and reporting format specific files. New available anion data was added, up until the end of WY2024 (September 30, 2024). International Generic Sample Numbers (IGSNs), when registered, were added to the data files. The reporting format specific files were updated to reflect the additional data added. Update on 2026-09-01: Updates were made to both the data files and reporting format specific files. New available anion data was added, up until the end of WY2025 (September 30, 2025). An anion MDL document was included in this update.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

UNITY: Unified Memory and Storage Space

UNITY is a 36-month project focused on providing design and evaluate a new distributed storage paradigm that unifies the traditionally distinct application views of memory- and file-based data storage into a single scalable and resilient environment. The project is a collaboration among Oak Ridge National Laboratory (ORNL, Lead institution), Los Alamos National Labs (LANL), and Georgia Tech (GT). The main contributions of the GT team have been around development of low level systems software for best leveraging the capabilities of new types of persistent memory technologies, and for development of methods for intelligent data management across memory/storage substrates with heterogeneous components. GT contributed the Phoenix library for optimized checkpoint/restart for HPC I/O for systems with non-volatile memory (NVM), the NVStream library for NVM-specialized streaming I/O for HPC workflows, the CoMerge, Mnemo and Kleio solutions for intelligent data management on NVM-based systems. These contributions result in significant improvements in both application performance and system efficiency.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Data and scripts associated with a manuscript investigating impacts of solid phase extraction on freshwater organic matter optical signatures and mass spectrometry pairing

This data package is associated with the publication “Investigating the impacts of solid phase extraction on dissolved organic matter optical signatures and the pairing with high-resolution mass spectrometry data in a freshwater system” submitted to “Limnology and Oceanography: Methods.” This data is an extension of the River Corridor and Watershed Biogeochemistry SFA’s Spatial Study 2021 (https://doi.org/10.15485/1898914). Other associated data and field metadata can be found at the link provided. The goal of this manuscript is to assess the impact of solid phase extraction (SPE) on the ability to pair ultra-high resolution mass spectrometry data collected from SPE extracts with optical properties collected on ambient stream samples. Forty-seven samples collected from within the Yakima River Basin, Washington were analyzed dissolved organic carbon (DOC, measured as non-purgeable organic carbon, NPOC), absorbance, and fluorescence. Samples were subsequently concentrated with SPE and reanalyzed for each measurement. The extraction efficiency for the DOC and common optical indices were calculated. In addition, SPE samples were subject to ultra-high resolution mass spectrometry and compared with the ambient and SPE generated optical data. Finally, in addition to this cross-platform inter-comparison, we further performed and intra-comparison among the high-resolution mass spectrometry data to determine the impact of sample preparation on the interpretability of results. Here, the SPE samples were prepared at 40 milligrams per liter (mg/L) based on the known DOC extraction efficiency of the samples (ranging from ~30 to ~75%) compared to the common practice of assuming the DOC extraction efficiency of freshwater samples at 60%. This data package folder consists of one main data folder with one subfolder (Data_Input). The main data folder contains (1) readme; (2) data dictionary (dd); (3) file-level metadata (flmd); (4) final data summary output from processing script; and (5) the processing script. The R-markdown processing script (SPE_Manuscript_Rmarkdown_Data_Package.rmd) contains all code needed to reproduce manuscript statistics and figures (with the exception of that stated below). The Data_Input folder has two subfolders: (1) FTICR and (2) Optics. Additionally, the Data_Input folder contains dissolved organic carbon (DOC, measured as non-purgeable organic carbon, NPOC) data (SPS_NPOC_Summary.csv) and relevant supporting Solid Phase Extraction Volume information (SPS_SPE_Volumes.csv). Methods information for the optical and FTICR data is embedded in the header rows of SPS_EEMs_Methods.csv and SPS_FTICR_Methods.csv, respectively. In addition, the data dictionary (SPS_SPE_dd.csv), file level metadata (SPS_SPE_flmd.csv), and methods codes (SPS_SPE_Methods_codes.csv) are provided. The FTICR subfolder contains all raw FTICR data as well as instructions for processing. In addition, post processed FTICR molecular information (Processed_FTICRMS_Mol.csv) and sample data (Processed_FTICRMS_Data.csv) is provided that can be directly read into R with the associated R-markdown file. The Optics subfolder contains all Absorbance and Fluorescence Spectra. Fluorescence spectra have been blank corrected, inner filter corrected, and undergone scatter removal. In addition, this folder contains Matlab code used to make a portion of Figure 1 within the manuscript, derive various spectral parameters used within the manuscript, and used for parallel factor analysis (PARAFAC) modeling. Spectral indices (SPS_SpectralIndices.csv) and PARAFAC outputs (SPS_PARAFAC_Model_Loadings.csv and SPS_PARAFAC_Sample_Scores.csv) are directly read into the associated R-markdown file. We acknowledge the Yakama Nation as owners and caretakers of the lands where we collected some of these data. We thank the Confederated Tribes and Bands of the Yakama Nation Tribal Council and Yakama Nation Fisheries for working with us to facilitate sample collection and optimization of data usage according to their values and worldview.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Model Data for the Mesh Convergence Study Demonstrating Benefits of Mixed-polyhedral Mesh in Integrated Hydrology Simulations

This archived model data is related to a study introducing a unique method that employs a stream-aligned mixed-polyhedral mesh to effectively and accurately represent river valleys, stream corridors, and narrow engineered channels in integrated hydrology simulations. The study finds that utilizing stream-aligned mixed-polyhedral meshes in integrated hydrology simulations achieves accuracy on par with a finely refined TIN-based mesh while markedly diminishing computational costs. This archive contains scripts and data files needed to generate the ATS model input, including mesh and ATS input files, for all mesh scenarios using the Watershed Workflow package. Additionally, this archive also provides key outputs from the model simulations that are used in the analysis and post-processing scripts to reproduce figures in the manuscript. The Watershed Workflow package is implemented in Python3. The Jupyter notebooks can be executed through multiple open-source tools, for example, Anaconda Jupyter Lab, VS Studio Code, etc. Other data files include CSV and HDF5 files, which can be read through Python scripts. The input files for the ATS model, open-source integrated hydrology, and transport model are in XML format and can be edited in any commonly used text editors.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Vehicle Powertrain Simulation Accuracy for Various Drive Cycle Frequencies and Upsampling Techniques

As connected and automated vehicle technologies emerge and proliferate, lower frequency vehicle trajectory data is becoming more widely available. In some cases, entire fleets are streaming position, speed, and telemetry at sample rates of less than 10 seconds. This presents opportunities to apply powertrain simulators such as the National Renewable Energy Laboratory's Future Automotive Systems Technology Simulator to model how advanced powertrain technologies would perform in the real world. However, connected vehicle data tends to be available at lower temporal frequencies than the 1-10 Hz trajectories that have typically been used for powertrain simulation. Higher frequency data, typically used for simulation, is costly to collect and store and therefore is often limited in density and geography. This paper explores the suitability of lower frequency, high availability, connected vehicle data for detailed powertrain simulation. A large data set of 1 Hz trajectories is used to quantify the accuracy loss when simulating energy consumption for conventional, hybrid, and battery electric powertrains using less than 1 Hz data. Techniques to upsample lower frequency drive cycle data in order to increase accuracy are also explored. Median energy consumption errors when simulating energy consumption for a 1/10 Hz trajectory are found to be 3-6% when compared to 1 Hz trajectories. Applying upsampling and interpolation techniques are shown to reduce the simulation errors by roughly 50%. The findings in this work can guide connected vehicle data collection specifications and processing techniques applied when using collected data for powertrain simulation.

ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2021

Tidal Energy Resource Characterization, Bottom Lander Measurements, Cook Inlet, AK, 2021

These datasets are from tidal resource characterization measurements collected on the Terrasond High Energy Oceanographic Mooring (THEOM) from 1 July 2021 to 30 August 2021 (60 days) in Cook Inlet, Alaska. The lander was deployed at 60.7207031 N, 151.4294998 W in ~50 m of water. The dataset contains raw and processed data from the following two instruments: 1. A Nortek Signature 500 kHz acoustic Doppler current profiler (ADCP). Data were recorded in 4 Hz in the beam coordinate system from all 5 beams. Processed data has been averaged into 5 minutes bins and converted to the East-North-Up (ENU) coordinate system. 2. A Nortek Vector acoustic Doppler velocimeter (ADV). Data were recorded at 8 Hz in the beam coordinate system. Processed data has been averaged into 5 minutes bins and converted to the Streamwise - Cross-stream - Vertical (Principal) coordinate system. Turbulence statistics were calculated from 5-minute bins, with an FFT length equal to the bin length, and saved in the processed dataset. Data was read and analyzed using the DOLfYN (version 1.0.2) python package and saved in MATLAB (.mat) and netCDF (.nc) file formats. Files containing analyzed data (".b1") were standardized using the TSDAT (version 0.4.2) python package. NetCDF files can be opened using DOLfYN (e.g., `dat = dolfyn.load(''*.nc")`) or the xarray python package (e.g. `dat = xarray.open_dataset("*.nc"). All distances are in meters (e.g., depth, range, etc), and all velocities in m/s. See the DOLfYN documentation linked in the submission, and/or the Nortek documentation for additional details.

16 TIDAL AND WAVE POWER↗
DOE OSTI2025

eCounter: Inline Per-IP Network Monitoring at Millisecond Resolution via eBPF

Scientific data acquisition (SciDAQ) systems are shifting from archive-based workflows to streaming paradigms, where real-time, fine-grained network monitoring becomes essential. While P4-enabled devices offer per-packet in-band observability, they require specialized switches and routers. Host-side tools like Prometheus exporters lack sufficient temporal granularity. To bridge this gap, we present eCounter, a lightweight, hardware-agnostic, inline telemetry agent built on extended Berkeley Packet Filter (eBPF). eCounter captures per-interface ingress and egress traffic, categorized by IP address and protocol, at millisecond to sub-millisecond resolution. In a 100 Gbps environment, it continuously exports up to 3,257 time-series bins per second with only 4% CPU utilization at a 35¿KiB/s data rate. We evaluate eCounter across diverse NIC MTU settings, hook types, CPU architectures and operating systems, and observed negligible impact on concurrent high-throughput streaming applications. Complexity analysis confirms that it can be readily scaled to distributed SciDAQ deployments.

Mei, Xinxin [Computational Sciences and Technology↗
DOE OSTI2024

Online randomized interpolative decomposition with a posteriori error estimator for temporal PDE data reduction

Traditional low-rank approximation is a powerful tool for compressing large data matrices that arise in simulations of partial differential equations (PDEs), but suffers from high computational cost and requires several passes over the PDE data. The compressed data may also lack interpretability thus making it difficult to identify feature patterns from the original data. Here, to address these issues, we present an online randomized algorithm to compute the interpolative decomposition (ID) of large-scale data matrices in situ. Compared to previous randomized IDs that used the QR decomposition to determine the column basis, we adopt a streaming ridge leverage score-based column subset selection algorithm that dynamically selects proper basis columns from the data and thus avoids an extra pass over the data to compute the coefficient matrix of the ID. In particular, we adopt a single-pass error estimator based on the non-adaptive Hutch++ algorithm to provide real-time error approximation for determining the best coefficients. As a result, our approach only needs a single pass over the original data and thus is suitable for large and high-dimensional matrices stored outside of core memory or generated in PDE simulations. A strategy to improve the accuracy of the reconstructed data gradient, when desired, within the ID framework is also presented. We provide numerical experiments on turbulent channel flow and ignition simulations, and on the NSTX Gas Puff Image dataset, comparing our algorithm with the offline ID algorithm to demonstrate its utility in real-world applications.

Column subset selection↗
DOE OSTI2026

A machine learning based approach to online electron reconstruction at CLAS12

Online reconstruction is key for monitoring purposes and real time analysis in High Energy and Nuclear Physics experiments. A necessary component of reconstruction algorithms is particle identification that combines information left by a particle passing through several detector components to identify the particle’s type. Of particular interest to electro-production Nuclear Physics experiments such as CLAS12 is electron identification which is used to trigger data recording. A machine learning approach was developed for CLAS12 to reconstruct and identify electrons by combining raw signals at the data acquisition level from several detector components. Here, this approach achieves an electron identification purity above 75% whilst retaining an efficiency close to 100%. The machine learning tools are capable of running at high rates exceeding the data acquisition rates and will allow electron reconstruction in real-time. This work enhances online analyses and monitoring and can contribute to improved triggering at CLAS12. This machine learning driven approach will also be crucial for experiments aiming to transition to streaming readout operations where online reconstruction will be a key component of the data taking paradigm.

Artificial intelligence↗
DOE OSTI2023

Impact of gel concentration on filter fluxes in microfiltration of Hanford tank wastes and simulants

Abstract Treatment processes have been proposed that will utilize crossflow filtration to concentrate sludge waste streams at the Department of Energy's Hanford Site. Challenges associated with solid–liquid separation of the waste streams drive a necessary evaluation of available Hanford high level waste (HLW) filtration data. Limiting flux conditions during crossflow filtration are elucidated with the formation of a cake layer on the membrane surface. A mass transfer coefficient between the gel and bulk concentrations plays a critical role in determining filter flux. A correlation between the gel concentration and mass transfer coefficient is made to assist in determining filter performance of select HLW streams. As a process alternative to crossflow filtration, gravity settling of waste streams may be deployed as a solid–liquid separation technique. However, this results in a contrasting performance with the centrifuged solids concentration. A method was developed to estimate expected filtration and settling performance based on physical characterization data for Hanford tank waste samples. By assessing the estimated processing performance of HLW, technical support can be provided during flowsheet planning.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗