Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68

Evaluation & Development of Algorithms & Techniques for Streaming Detector Readout

The advancement in microelectronics capabilities, computing, and data science in the last decade has been remarkable. With the start of the 12 GeV Science Program at Jefferson Lab (JLab) and the conceptual detector design for the upcoming Ion Collider (EIC) in mind, we have evaluated and developed the possibility of evolving and improving the existing nuclear science research workflow based on these advances. Specifically, we have prototyped components of streaming readout.

43 PARTICLE ACCELERATORS↗

Hydrological controls of a riparian wetland based on stable isotope data and model simulations

Isotopic evidence of groundwater and stream water is frequently used to investigate water exchanges with groundwater. Monthly sampling of rain, stream water, and groundwater was conducted at Tims Branch watershed in South Carolina for the oxygen and hydrogen stable isotope (δ 2 H and δ 18 O) measurement, as well as pH and oxidation–reduction potential (ORP). Together with a mass balance perspective, it was determined that it takes a few weeks to one month for groundwater in the hyporheic zone to fully exchange with stream water. From hydrodynamic modelling, we show that substantial (up to 70 %) groundwater exchange occurs at gaining and losing sites. Groundwater exfiltration, i.e. inflow into stream water, contributes up to 4 % to stream water, with the remainder from upstream exfiltration. A 2–4 % per day renewal rate of adjacent groundwater would indirectly indicate a groundwater residence time in the order of half a month to a full month (assuming either a well-mixed case or large dispersion rate in pulse flow case), in agreement with a greatly reduced variability of δ 2 H and δ 18 O of groundwater compared to stream water and rain. This reduced variability of stable isotope signal from groundwater confirms our hypothesis that riparian groundwater mixing at Tims Branch is more of a mixed type rather than a pulse flow type. As a result, a monthly time scale is sufficient for groundwater to become anoxic at exit points into stream water resulting in the episodic production of natural organic matter- and iron-rich flocs upon oxidation.

54 ENVIRONMENTAL SCIENCES↗

The magnificent ACT of flavor-specific neutrino self-interaction

Here we revisit the cosmology of neutrino self-interaction and use the latest cosmic microwave background data from the Atacama Cosmology Telescope (ACT) and the Planck experiment to constrain the interaction strength. In both flavor-universal and nonuniversal coupling scenarios, we find that the ACT data prefers strong neutrino self-interaction that delays neutrino free streaming until just before the matter-radiation equality. When combined with the Planck 2018 data, the preference for strong interaction decreases due to the Planck polarization data. For the combined dataset, the flavor-specific interaction still provides a better fit to the CMB data than ΛCDM. This trend persists even when neutrino mass is taken into account and extra radiation is added. We also study the prospect of constraining such strong interaction by future terrestrial and space telescopes, and find that the upcoming CMB-S4 experiment will improve the upper limit on neutrino self-interaction by about a factor of three.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Data and scripts associated with “Moisture content modulates DOM thermodynamic regulation of oxygen consumption in drying streambed sediments”

This data package is associated with the publication “Moisture content modulates DOM thermodynamic regulation of oxygen consumption in drying streambed sediments” published in Scientific Reports (Garayburu-Caruso et al., 2026). The package contains processed data products and scripts used to quantify how drying and re-inundation of riverbed sediments influence dissolved organic matter (DOM) thermodynamic properties and their relationship with sediment oxygen (O₂) consumption across 33 stream sites in the contiguous United States. The data package contains DOM thermodynamic metrics (e.g., Gibbs free energy of carbon oxidation and thermodynamic efficiency), and O₂ consumption along with watershed-scale climate and land-cover metrics used as explanatory variables in the analyses. Underlying unprocessed and processed ultrahigh-resolution mass spectrometry data, oxygen consumption rates from laboratory moisture-manipulation experiments, within-sample environmental properties, sediment moisture content and contextual field measurements are archived separately at https://data.ess-dive.lbl.gov/datasets/doi:10.15485/2428003 (Laan et al., 2024) and https://data.ess-dive.lbl.gov/datasets/doi:10.15485/1923689 (Forbes et al.,2023). A preliminary version of this data package was published in February 2026 at the time of manuscript submission. It was updated in June 2026, at the time of manuscript acceptance, to include the finalized data and additional metadata (readme, data dictionary, and file level metadata). For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to a readme, this data package also includes a file-level metadata (FLMD) file that describes each file and a data dictionary (DD) that describes all column/row headers and variable definitions. At the top level, the data package is organized into five main folders: (1) Data, (2)Figures, (3) Map, (4) GAM_Reulsts, and (5) src. The Data folder contains analysis-ready tabular files with oxygen consumption rates, DOM thermodynamic properties by site and treatment, site-level environmental variables, watershed-scale metrics, and other derived variables referenced in the manuscript. The Figures folder contains static image files associated with the main text and supplemental figures, while the Map folder includes spatial data and map-layer files used to create the sampling-location map. The GAM results folder contains the results for each of the general additive model (GAM).The src folder contains R scripts used to perform data processing, statistical analyses (including clustering, generalized additive models, and threshold analysis), and figure generation. This data package is associated with a GitHub repository found at https://github.com/WHONDRS-Hub/ECA_DOM_Thermodynamics.

Dissolved organic matter↗

The DECam MAGIC Survey $-$ Mapping the Ancient Galaxy in CaHK: Overview and Summary of Early Science

We present the DECam Mapping the Ancient Galaxy in CaHK (MAGIC) survey, a 54-night NOIRLab Survey Program to image $\gtrsim$5,000$\,$deg$^2$ of the southern hemisphere using a metallicity-sensitive narrow-band filter covering the Ca$\,$ii$\,$H&K lines centered at 3955$\,$A. This filter is installed on the Dark Energy Camera (DECam), mounted on the 4-m NSF Víctor M. Blanco Telescope. The survey reaches typical $10σ$ depths of $\text{mag}_{\text{CaHK}} \approx 22.5$, 3$-$4$\,$mag deeper than comparable surveys in the southern hemisphere. By combining photometry from this Ca$\,$ii$\,$H&K filter with existing DECam $g,r,i$ broadband photometry from the DECam Local Volume Exploration (DELVE) survey, MAGIC is deriving photometric metallicities for red giant branch stars down to the magnitude limit of usable proper motions from Gaia data release 3 (DR3). MAGIC has already imaged $\sim$3,000$\,$deg$^2$, supplemented by other affiliated observing programs that have used this filter to image star clusters, dwarf galaxies, and stellar streams. We overview MAGIC's survey strategy, describe data processing through the derivation of metallicities and photometric distances, and summarize early science results that have been published with this dataset. In addition, we present several new results, including the confirmation of a distant ($>5\,r_h$) member of the Reticulum II ultra-faint dwarf galaxy, on-sky density maps of low-metallicity stars into the distant Milky Way halo ($\sim150\,$kpc) recovering 13/14 ultra-faint dwarf galaxies in the current footprint, and a validation of our initial targeting of extremely metal-poor stars. Collectively, these results demonstrate that the MAGIC dataset enables cutting-edge studies of the faint, low-metallicity regime of the Milky Way and its substructures.

Chiti, A. [KIPAC, Menlo Park] (ORCID:0000000271556↗

Adding Data Management Services to Parallel File Systems

The objective of this project, called DAMASC for “Data Management in Scientific Computing”, is to coalesce data management with parallel file system management to present a declarative interface to scientists for managing, querying, and analyzing extremely large data sets efficiently and predictably. Managing extremely large data sets is a key challenge of exascale computing. The overhead, energy, and cost of moving massive volumes of data demand designs where computation is close to storage. In current architectures, compute/analysis clusters access data in a physically separate parallel file system and largely leave it scientist to reduce data movement. Over the past decades the high-end computing community has adopted middleware with multiple layers of abstractions and specialized file formats such as NetCDF-4 and HDF5. These abstractions provide a limited set of high-level data processing functions, but have inherent functionality and performance limitations: middleware that provides access to the highly structured contents of scientific data files stored in the (unstructured) file systems can only optimize to the extent that file system interfaces permit; the highly structured formats of these files often impedes native file system performance optimizations. We are developing Damasc, an enhanced high-performance file system with native rich data management services. Damasc will enable efficient queries and updates over files stored in their native byte-stream format while retaining the inherent performance of file system data storage via declarative queries and updates over views of underlying files. Damasc has four key benefits for the development of data-intensive scientific code: (1) applications can use important data-management services, such as declarative queries, views, and provenance tracking, that are currently available only within database systems; (2) the use of these services becomes easier, as they are provided within a familiar file-based ecosystem; (3) common optimizations, e.g., indexing and caching, are readily supported across several file formats, avoiding effort duplication; and (4) performance improves significantly, as data processing is integrated more tightly with data storage. Our key contributions are: SciHadoop which explores changes to MapReduce assumption by taking advantage of semantics of structured data while preserving MapReduce’s failure and resource management; DataMods which extends common abstractions of parallel file systems so they become programmable such that they can be extended to natively support a variety of data models and can be hooked into emerging distributed runtimes such as Stanford’s Legion; and Miso which combines Hadoop and relational data warehousing to minimize time to insight, taking into account the overhead of ingesting data into data warehousing.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Geoelectric Characterization of Hyporheic Exchange Flow in the Bedrock‐Lined Streambed of East Fork Poplar Creek, Oak Ridge, Tennessee

Abstract A multimethod geoelectric survey was implemented between January and March 2022 along a 220‐m long reach of the bedrock‐lined streambed of East Fork Poplar Creek in Oak Ridge, Tennessee to identify locations of surface‐water and groundwater exchange and characterize the subsurface flow paths that convey water between the stream and flood plain. A waterborne self‐potential (WaSP) survey was completed in January 2022 to measure the electric streaming‐potential field in the stream. Electric resistivity tomography (ERT) was performed in March 2022 on the flood plain adjacent to the WaSP survey reach to map the electric resistivity distribution and characterize the hydrogeology and subsurface flow paths that facilitate surface‐water and groundwater exchange in the bedrock‐lined stream. The combination of WaSP and ERT data support the qualitative interpretation that surface‐water and groundwater exchange likely occurs along fractures in outcropping bedrock and along two fault lines that intersect the limestone creek bed.

54 ENVIRONMENTAL SCIENCES↗

THE PAL 5 STAR STREAM GAPS

Pal 5 is a low-mass, low-velocity-dispersion, globular cluster with spectacular tidal tails. We use the Sloan Digital Sky Survey Data Release 8 data to extend the density measurements of the trailing star stream to 23 deg distance from the cluster, at which point the stream runs off the edge of the available sky coverage. The size and the number of gaps in the stream are measured using a filter which approximates the structure of the gaps found in stream simulations. We find 5 gaps that are at least 99% confidence detections with about a dozen gaps at 90% confidence. The statistical significance of a gap is estimated using bootstrap resampling of the control regions on either side of the stream. The density minimum closest to the cluster is likely the result of the epicyclic orbits of the tidal outflow and has been discounted. To create the number of 99% confidence gaps per unit length at the mean age of the stream requires a halo population of nearly a thousand dark matter sub-halos with peak circular velocities above 1 km s{sup -1} within 30 kpc of the galactic center. These numbers are a factor of about three below cold stream simulation at this sub-halo mass or velocity but, given the uncertainties in both measurement and more realistic warm stream modeling, are in substantial agreement with the LCDM prediction.

79 ASTRONOMY AND ASTROPHYSICS↗

Modelling the Milky Way – I. Method and first results fitting the thick disc and halo with DES-Y3 data

ABSTRACT We present a technique to fit the stellar components of the Galaxy by comparing Hess Diagrams (HDs) generated from trilegal models to real data. We apply this technique, which we call mwfitting, to photometric data from the first 3 yr of the Dark Energy Survey (DES). After removing regions containing known resolved stellar systems such as globular clusters, dwarf galaxies, nearby galaxies, the Large Magellanic Cloud, and the Sagittarius Stream, our main sample spans a total area of ∼2300 deg2. We further explore a smaller subset (∼1300 deg2) that excludes all regions with known stellar streams and stellar overdensities. Validation tests on synthetic data possessing similar properties to the DES data show that the method is able to recover input parameters with a precision better than 3 per cent. We fit the DES data with an exponential thick disc model and an oblate double power-law halo model. We find that the best-fitting thick disc model has radial and vertical scale heights of 2.67 ± 0.09 kpc and 925 ± 40 pc, respectively. The stellar halo is fit with a broken power-law density profile with an oblateness of 0.75 ± 0.01, an inner index of 1.82 ± 0.08, an outer index of 4.14 ± 0.05, and a break at 18.52 ± 0.27 kpc from the Galactic centre. Several previously discovered stellar overdensities are recovered in the residual stellar density map, showing the reliability of mwfitting in determining the Galactic components. Simulations made with the best-fitting parameters are a promising way to predict Milky Way star counts for surveys such as the LSST and Euclid.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Total metal, carbon, anion, iron speciation, and sulfide concentrations; Slate River, East River, and Trail Creek surface water and floodplains, Crested Butte, CO; May 2023–August 2023

This data package comprises analytical results and metadata from stream and groundwater samples collected from the Slate River, East River, Trail Creek, and their respective floodplains. This dataset contains five files: (1) a samples file (2023_SFA_Field_samples.csv) that contains site information; (2) a chemical analysis data file (2023_FieldWaterSampleData_IC__ICPOES__ICPMS__TOC__Fe__S_chem_data.csv) that contains sample analysis values; (3) a file-level metadata file (flmd.csv) that lists each file contained in the dataset with associated metadata; (4) a data dictionary file (dd.csv) that contains column/row headers used throughout the files along with definitions, units, and data types; and (5) a methods file (methods.csv) that contains ID, type, description, instrument, and lab information for each method.The samples’ anion concentrations were measured using ion chromatography (IC), total metal concentrations using inductively coupled plasma emission spectrometry (ICP-OES) and inductively coupled plasma mass spectrometry (ICP-MS), non-purgeable organic carbon using total organic carbon (TOC) analysis, dissolved sulfide concentration using methylene blue spectrophotometry, and iron speciation using the ferrozine assay. To support bulk chemical analyses and colloid characterization, samples were collected from multiple depths ranging from the surface to 3.5 meters below ground.Update on 2024-10-18: Updates were made to the 2023_FieldWaterSampleData_IC__ICPOES__ICPMS__TOC__Fe__S_chem_data.csv and dd.csv files to correct units (ppb instead of ppm).

54 ENVIRONMENTAL SCIENCES↗

Parallel Harness for Informatic Stream Hashing

PHISH is a lightweight framework which a set of independent processes can use to exchange data as they run on the same desktop machine, on processors of a parallel machine, or on different machines across a network. This enables them to work in a coordinated parallel fashion to perform computations on either streaming, archived, or self-generated data. The PHISH distribution includes a simple, portable library for performing data exchanges in useful patterns either via MPI message-passing or ZMQ sockets. PHISH input scripts are used to describe a data-processing algorithm, and additional tools provided in the PHISH distribution convert the script into a form that can be launched as a parallel job.

Plimpton, Steve↗

Parallel Harness for Informatic Stream Hashing

PHISH is a lightweight framework which a set of independent processes can use to exchange data as they run on the same desktop machine, on processors of a parallel machine, or on different machines across a network. This enables them to work in a coordinated parallel fashion to perform computations on either streaming, archived, or self-generated data. The PHISH distribution includes a simple, portable library for performing data exchanges in useful patterns either via MPI message-passing or ZMQ sockets. PHISH input scripts are used to describe a data-processing algorithm, and additional tools provided in the PHISH distribution convert the script into a form that can be launched as a parallel job.

Steve Plimpton, Tim Shead↗

Advancing stream temperature prediction with a generalizable large-sample framework across CONUS river reaches

Accurately predicting stream temperature in ungauged basins remains a critical challenge for water resource management, thermoelectric power plant cooling, and ecosystem conservation. Large-sample machine learning models trained on hundreds of well-monitored river basins have shown remarkable performance; however, such models have yet to be developed solely using forcing data that can be readily extracted to simulate stream temperatures anywhere in the contiguous United States (CONUS). In this study, we present a scalable, large-sample deep learning framework using Long Short-Term Memory (LSTM) networks to simulate daily stream temperatures in ungauged basins across the CONUS. The framework leverages both modeled reanalysis of meteorological and streamflow inputs as well as static attributes available for all 2.7 million CONUS river reaches in the National Hydrography Dataset Plus (NHDPlusV2). By generating dynamical inputs from predefined thermally relevant upstream contributing areas, rather than the entire upstream basin, the model also offers improvements in very large basins where full-basin averaging can dilute the most important influences on stream temperature. Evaluated across 300 basins, the model achieves a median Mean Absolute Error (MAE) of 1.1 °C and a Nash-Sutcliffe Efficiency (NSE) of 0.95 on temporally and spatially distinct test folds—comparable to models trained exclusively using meteorological and streamflow observational data. The flexible, high-performing framework generalizes to any unmonitored river reach without significant regulation or unnatural thermal input immediately upstream, substantially expanding predictive capabilities in data-scarce regions.

Hydrology↗

A Python Package for Fuel Cycle and Waste Management Analysis - 19545

The future of nuclear power utilization in the United States may involve a transition from the once-through light water reactor fuel cycle to a so-called advanced fuel cycle. An advanced fuel cycle may offer improvements in natural resource utilization, reactor safety, and environmental impact. In addition, adoption of an advanced fuel cycle will result in changes in the amount, composition, and disposal of the nuclear wastes they produce. Characteristics intrinsic to the wastes themselves, such as mass and radioactivity at specific times, were used as waste management metrics in the Department of Energy 2014 Fuel Cycle Evaluation and Screening (FCES) study. Binning of these metrics informed fuel cycle according to relative potential benefit. However, waste properties alone cannot qualify management strategy. Therefore, comparing fuel cycles from the perspective of waste management can provide additional insights. To that end, an object-oriented Python package has been developed to perform fuel cycle waste management calculations. The package, named nwpy (short for Nuclear Waste analysis in Python), mimics the mass flow operations reported in the FCES study and interfaces with the ORIGEN-S code to assess metric data as reported in the FCES. In addition, this Python package determines the loading of waste streams into forms suitable for final disposal in a geological repository and uses such data for repository performance assessment. This work describes the Python package methodology, assumptions, and capabilities. As input data, the package requires information about the fuel cycle such as the mass of fuel discharged, the cooling time between reactor discharge and subsequent operations, and the separations process efficiencies and waste forms it produces. In addition, the isotopic composition of the reactor discharge stream, such as that available from the FCES database, is required. With that, it can perform prescribed mass flow and decay operations throughout the back end of the fuel cycle, the latter carried out by the ORIGEN-S code distributed with the SCALE6.2 software suite. The result is time-dependent data characterizing the waste on a per-package basis. Package loading for waste streams depends on the stream form (i.e. UNF vs. HLW, or glass HLW from aqueous reprocessing vs. ceramic HLW from electrochemical processing) and is based on literature review and engineering assumption. As an example of the application of the code, calculations for the areal footprint of direct-contact repositories for different fuel cycles is shown. Development is ongoing, and the package is expected to grow incorporating capabilities for waste management analyses such as waste transportation and radionuclide transport through the biosphere. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Phoenix: A Scalable Streaming Hypergraph Analysis Framework

We present Phoenix, a scalable hypergraph analytics framework for data analytics and knowledge discovery that was implemented on the leadership class computing platforms at Oak Ridge National Laboratory (ORNL). Our software framework comprises a distributed implementation of a streaming server architecture which acts as a gateway for various hypergraph generators/external sources to connect. Phoenix has the capability to utilize diverse hypergraph generators, including HyGen, a very large-scale hypergraph generator developed by ORNL. Phoenix incorporates specific algorithms for efficient data representation by exploiting hidden structures of the hypergraphs. Our experimental results demonstrate Phoenix’s scalable and stable performance on massively parallel computing platforms. Phoenix’s superior performance is due to the merging of high-performance computing with data analytic.

Kurte, Kuldeep↗

Flexible and Accessible 4D Subsurface Visualization Using a Web-Based Platform

4D subsurface visualization using a web platform can provide improved communication, education and outreach to non-experts and stakeholders. It allows for the improved understanding of complex relationships and interactions that occur in inaccessible locations of which many experimental testbeds exist in. The use of a web-based visualization tool lessens the cognitive impact further by reducing the need of specialized software. Users can define their own exploration of a 3D or 4D scene, adding and removing data as needed and are able to make informed decisions based on accurate model visualizations, while providing a collaborative tool that can be accessed on any platform using a browser window. The tool is also able to point to real time streams to display up-to-the-second data as an experiment is ongoing. This level of latency can also provide operators with essential information that can direct an experiment’s progress. Additionally, this tool can leverage augmented and virtual reality (AR, VR) capabilities of certain mobile devices and head-mounted displays, providing further engaging visualization possibilities.

Pratt, Martin J.↗

On the Hunt for the Origins of the Orphan–Chenab Stream: Detailed Element Abundances with APOGEE and Gaia

Stellar streams in the Galactic halo are useful probes of the assembly of galaxies like the Milky Way. Many tidal stellar streams that have been found in recent years are accompanied by a known progenitor globular cluster or dwarf galaxy. However, the Orphan–Chenab (OC) stream is one case where a relatively narrow stream of stars has been found without a known progenitor. In an effort to find the parent of the OC stream, we use astrometry from the early third data release of ESA's Gaia mission (Gaia EDR3) and radial velocity information from the Sloan Digital Sky Survey (SDSS)-IV Apache Point Observatory Galactic Evolution Experiment (APOGEE) survey to find up to 13 stars that are likely members of the OC stream. We use the APOGEE survey to study the chemical nature (for up to 10 stars) of the OC stream in the α (O, Mg, Ca, Si, Ti, and S), odd-Z (Al, K, and V), Fe-peak (Fe, Ni, Mn, Co, and Cr), and neutron-capture (Ce) elemental groups. We find that the stars that make up the OC stream are not consistent with a monometallic population and have a median metallicity of -1.92 dex with a dispersion of 0.28 dex. Our results also indicate that the α elements are depleted compared to the known Milky Way populations and that its [Mg/Al] abundance ratio is not consistent with second-generation stars from globular clusters. The detailed chemical pattern of these stars, namely the [α/Fe]–[Fe/H] plane and the metallicity distribution, indicates that the OC stream progenitor is very likely to be a dwarf spheroidal galaxy with a mass of ~10 6 M ⊙ .

79 ASTRONOMY AND ASTROPHYSICS↗