Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Via Machinae 2.0 : Full-sky, model-agnostic search for stellar streams in Gaia DR2

ABSTRACT We present an update to Via Machinae, an automated stellar stream-finding algorithm based on the deep learning anomaly detector ANODE. Via Machinae identifies stellar streams within Gaia, using only angular positions, proper motions, and photometry, without reference to a model of the Milky Way potential for orbit integration or stellar distances. This new version, Via Machinae 2.0, includes many improvements and refinements to nearly every step of the algorithm, that altogether result in more robust and visually distinct stream candidates than our original formulation. In this work, we also provide a quantitative estimate of the false positive rate of Via Machinae 2.0 by applying it to a simulated Gaia-mock catalogue based on galaxia, a smooth model of the Milky Way that does not contain substructure or stellar streams. Finally, we perform the first full-sky search for stellar streams with Via Machinae 2.0, identifying 102 streams at high significance within the Gaia Data Release 2, of which only 10 have been previously identified. While follow-up observations for further confirmation are required, taking into account the false positive rate presented in this work, we expect approximately 90 of these stream candidates to correspond to real stellar structures.

Astronomy & Astrophysics↗
DOE OSTI2023

Long-Term Changes in Concentration and Yield of Riverine Dissolved Silicon From the Poles to the Tropics

Riverine exports of silicon (Si) influence global carbon cycling through the growth of marine diatoms, which account for ~25% of global primary production. Climate change will likely alter river Si exports in biome-specific ways due to interacting shifts in chemical weathering rates, hydrologic connectivity, and metabolic processes in aquatic and terrestrial systems. Nonetheless, factors driving long-term changes in Si exports remain unexplored at local, regional, and global scales. We evaluated how concentrations and yields of dissolved Si (DSi) changed over the last several decades of rapid climate warming using long-term data sets from 60 rivers and streams spanning the globe (e.g., Antarctic, tropical, temperate, boreal, alpine, Arctic systems). We show that widespread changes in river DSi concentration and yield have occurred, with the most substantial shifts occurring in alpine and polar regions. The magnitude and direction of trends varied within and among biomes, were most strongly associated with differences in land cover, and were often independent of changes in river discharge. These findings indicate that there are likely diverse mechanisms driving change in river Si biogeochemistry that span the land-water interface, which may include glacial melt, changes in terrestrial vegetation, and river productivity. Finally, trends were often stronger in months outside of the growing season, particularly in temperate and boreal systems, demonstrating a potentially important role of shifting seasonality for the flux of Si from rivers. Our results have implications for the timing and magnitude of silica processing in rivers and its delivery to global oceans.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

nng_stream

This project uses the NanoMsg next-generation library to receive data, temporarily store in an in-memory buffer, and then send it out. The buffer handles a high-bandwidth stream from multiple producers (sources) to multiple consumers (sinks).

Rogers, DavidM [Oak Ridge National Laboratory (ORN↗
DOE OSTI2025

ESnet-JLab FPGA Accelerated Transport (control plane) [EJFAT (udplbd2)] v2.0

The ESnet-JLab FPGA Accelerated Transport system is a solution for streaming high-speed scientific measurement data from Data Acquisition Systems (DAQs) to high-performance computing facilties. It is generally compatible with many science workflows, and makes no assumptions about the specifics of any particular experiment. This program (udplbd version 2) implements the control plane for the system. It is responsible for programming network forwarding rules into the data plane (implemented by the hardware designed named udplb, described separately). It also implements the control loop necessary to match up offered workload with available capacity on high-performance compute nodes.

Howard, Derek [Lawrence Berkeley National Laborato↗
DOE OSTI2022

Use Attainability Analysis Aquatic Life Uses for Perennial Reach of Sandia Canyon [Slides]

The following information will be presented during the February 23, 2022 Accord Pueblos Technical Meeting. The purpose of the study is to determine if natural thermal conditions are preventing the attainment of Coldwater Aquatic Life Use in the perennial reach of the upper Sandia Canyon Assessment Unit (Sandia AU). The New Mexico Water Quality Standards allow for a change in the designated use if a Use Attainability Analysis (UAA) demonstrates that the use is not attainable due to one or more of six factors listed in 40 CFR 131.10(g), including naturally occurring pollutant concentrations. The Sandia AU is located in a perennial reach of upper Sandia Canyon between Sigma Canyon and NPDES Outfall 001. The classified Segment 20.6.4.126 NMAC comprises perennial waters within Los Alamos National Laboratory boundaries and includes the Sandia AU. Persistent surface flows originate from NPDES permitted effluent releases. These releases have occurred since the early 1950’s and continue today. The UAA examines several lines of evidence. NMED’s Air-Water Temperature Correlation (AWTC) model is used for identifying appropriate stream classifications and attainable aquatic life use subcategories. The model correlates between July average air temperatures (ATEMP) and maximum weekly average stream temperatures. Air temperatures are obtained from PRISM and LANL Meteorological Towers and used to derive ATEMP. Thermographs were placed in the Sandia AU to obtain measured stream temperatures during summer months when stream temperatures are the highest. Measured data is used with AWTC modeled data to determine if the Sandia AU is meeting its natural air temperature driven thermal condition.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

National Energy Water Treatment & Speciation (NEWTS): A Water & Critical Minerals Database and Dashboard

The poster, presented at the American Geophysical Union (AGU) 2023 Conference, highlights NETL's National Energy Water Treatment & Speciation (NEWTS) Database & Dashboard. This poster reviews the work done to aggregate disparate water quality data for energy-related wastewater streams, to process and integrate the datasets, and enable easy integration with aqueous chemistry modeling software to support water management and beneficial reuse decision-making.

Wenzlick, Madison↗
DOE OSTI2025

RTN-011: Rubin Observatory Plans for an Early Science Program

This document outlines Rubin Observatory's plans for a dedicated \emph{Early Science Program} to enable high-impact science prior to the first annual data release of the Legacy Survey of Space and Time (LSST). Components of the Early Science Program include releasing science-grade commissioning data products via a series of ``Data Previews,'' ramping up of the transient alert stream during commissioning, implementing a program of incremental template generation to augment alert production in the early phases of the survey, and the first LSST Data Release, DR1, based on the first 6 months of data from the LSST. A detailed breakdown of which data products can be expected when is provided. The Rubin Operations team is working closely with the science community to optimize the Early Science Program for the time-domain and solar system science achievable in the first year of operations. This is a living document; both it and the Early Science Program will continue to evolve over the course of commissioning and pre-operations in response to the state of the as-built system and to community guidance.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Characterization and dynamics of the peculiar stream Jhelum: A tentative role for the Sagittarius dwarf galaxy

Stellar streams are a promising tool to study the Milky Way’s dark matter subhalo population, as interactions with subhalos are expected to leave visible imprints in the streams in the form of substructure. However, there may be other causes of substructure. Here we studied the kinematics and the unusual morphology of the stellar stream Jhelum. Using a combination of ground-based photometry and Gaia EDR3 astrometry, we characterized the morphology of Jhelum. We combined this new data with radial velocities from the literature to perform orbit integrations of the stream in static Galactic potentials. We also carried out N-body simulations in the presence of the Sagittarius dwarf galaxy. The new data reveal a previously unreported tertiary component in the stream, as well as several gaps and a kink-like feature in its narrow component. We find that for a range of realistic Galactic potentials, no single orbit is able to reproduce Jhelum’s radial velocity data entirely. A generic property of the orbital solutions is that they share a similar orbital plane to Sagittarius and this leads to repeated encounters with the stream. Using N-body simulations that include a massive Sagittarius, we explored its effect on Jhelum, and we show that these encounters are able to qualitatively reproduce the narrow and broad components in Jhelum, as well as create a tertiary component in some cases. We also find evidence that such encounters can result in an apparent increase in the velocity dispersion of the stream by a factor up to four due to overlapping narrow and broad components. Our findings suggest that the Jhelum stream is even more complex than once thought; however, its morphology and kinematics can tentatively be explained via the interactions with Sagittarius. In this scenario, the formation of Jhelum’s narrow and broad components occurs naturally, yet some of the smaller gap-like features remain to be explained.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Streaming readout for next generation electron scattering experiments

Current and future experiments at the high-intensity frontier are expected to produce an enormous amount of data that needs to be collected and stored for offline analysis. Thanks to the continuous progress in computing and networking technology, it is now possible to replace the standard ‘triggered’ data acquisition systems with a new, simplified and outperforming scheme. ‘Streaming readout’ (SRO) DAQ aims to replace the hardware-based trigger with a much more powerful and flexible software-based one, that considers the whole detector information for efficient real-time data tagging and selection. Considering the crucial role of DAQ in an experiment, validation with on-field tests is required to demonstrate SRO performance. In this paper, we report results of the on-beam validation of the Jefferson Lab SRO framework. In this work, we exposed different detectors (PbWO-based electromagnetic calorimeters and a plastic scintillator hodoscope) to the Hall-D electron-positron secondary beam and to the Hall-B production electron beam, with increasingly complex experimental conditions. By comparing the data collected with the SRO system against the traditional DAQ, we demonstrate that the SRO performs as expected. Furthermore, we provide evidence of its superiority in implementing sophisticated AI-supported algorithms for real-time data analysis and reconstruction.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

S $^{5}$: The Orbital and Chemical Properties of One Dozen Stellar Streams

We report the kinematic, orbital, and chemical properties of 12 stellar streams with no evident progenitors using line-of-sight velocities and metallicities from the Southern Stellar Stream Spectroscopic Survey (S $^{5}$), proper motions from Gaia EDR3, and distances derived from distance tracers or the literature. This data set provides the largest homogeneously analyzed set of streams with full 6D kinematics and metallicities. All streams have heliocentric distances between ∼10 and 50 kpc. The velocity and metallicity dispersions show that half of the stream progenitors were disrupted dwarf galaxies (DGs), while the other half originated from disrupted globular clusters (GCs), hereafter referred to as DG and GC streams. Based on the mean metallicities of the streams and the mass–metallicity relation, the luminosities of the progenitors of the DG streams range between those of Carina and Ursa Major I (−9.5 ≲ M $_{V}$ ≲ −5.5). Four of the six GC streams have mean metallicities of Fe/H < −2, more metal poor than typical Milky Way (MW) GCs at similar distances. Interestingly, the 300S and Jet GC streams are the only streams on retrograde orbits in our dozen-stream sample. Finally, we compare the orbital properties of the streams with known DGs and GCs in the MW, finding several possible associations. Some streams appear to have been accreted with the recently discovered Gaia–Enceladus–Sausage system, and others suggest that GCs were formed in and accreted together with the progenitors of DG streams whose stellar masses are similar to those of Draco to Carina (∼10$^{5}$–10$^{6}$ M $_{⊙}$).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Stream Chemistry, Synoptic Surveys, East Fork Poplar Creek Watershed, TN, USA; April 2023 to February 2025

Impacts of developed land cover on stream chemistry can be difficult to discern from natural variability, particularly in carbonate watersheds where weathering of urban infrastructure and lithology generate similar signatures. We evaluated how spatial patterns of stream chemistry varied across perennial and non-perennial tributaries spanning an urban-to-forested gradient in a mid-order, carbonate-dominated watershed. This data package contains a processed and compiled summary of stream chemistry and properties obtained from 12 synoptic surveys of 54 stream sites across the East Fork Poplar Creek watershed located near Oak Ridge, TN, United States. The sites include non-perennial tributaries, perennial tributaries, and the main stem and span forested to urban (highly developed) land cover gradients. The data package includes the processed and flagged chemical data (WaDE_SynopticSummary_FinalChemistry), metadata describing data flagging and analysis (WaDE_SynopticSummary_Metadata), information about each site and its contributing subcatchment (WaDE_SynopticSummary_SiteInformation), and a comparison of instrument and field detection limits used to determine method detection limits for the study (WaDE_SynopticSummary_DetectionLimitComparison). Stream chemistry includes stream parameters measured in situ using multiparameter probes (dissolved oxygen, pH, specific conductance, temperature) and solutes including nutrients (nitrate, ammonium, soluble reactive phosphorus), dissolved organic carbon, dissolved inorganic carbon, major cations (calcium, magnesium, potassium, sodium), major anions (chloride, sulfate), and a broad suite of minor and trace elements.

EARTH SCIENCE > TERRESTRIAL HYDROSPHERE > SURFACE ↗
DOE OSTI2020

Evaluation & Development of Algorithms & Techniques for Streaming Detector Readout

The advancement in microelectronics capabilities, computing, and data science in the last decade has been remarkable. With the start of the 12 GeV Science Program at Jefferson Lab (JLab) and the conceptual detector design for the upcoming Ion Collider (EIC) in mind, we have evaluated and developed the possibility of evolving and improving the existing nuclear science research workflow based on these advances. Specifically, we have prototyped components of streaming readout.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Hydrological controls of a riparian wetland based on stable isotope data and model simulations

Isotopic evidence of groundwater and stream water is frequently used to investigate water exchanges with groundwater. Monthly sampling of rain, stream water, and groundwater was conducted at Tims Branch watershed in South Carolina for the oxygen and hydrogen stable isotope (δ 2 H and δ 18 O) measurement, as well as pH and oxidation–reduction potential (ORP). Together with a mass balance perspective, it was determined that it takes a few weeks to one month for groundwater in the hyporheic zone to fully exchange with stream water. From hydrodynamic modelling, we show that substantial (up to 70 %) groundwater exchange occurs at gaining and losing sites. Groundwater exfiltration, i.e. inflow into stream water, contributes up to 4 % to stream water, with the remainder from upstream exfiltration. A 2–4 % per day renewal rate of adjacent groundwater would indirectly indicate a groundwater residence time in the order of half a month to a full month (assuming either a well-mixed case or large dispersion rate in pulse flow case), in agreement with a greatly reduced variability of δ 2 H and δ 18 O of groundwater compared to stream water and rain. This reduced variability of stable isotope signal from groundwater confirms our hypothesis that riparian groundwater mixing at Tims Branch is more of a mixed type rather than a pulse flow type. As a result, a monthly time scale is sufficient for groundwater to become anoxic at exit points into stream water resulting in the episodic production of natural organic matter- and iron-rich flocs upon oxidation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

The magnificent ACT of flavor-specific neutrino self-interaction

Here we revisit the cosmology of neutrino self-interaction and use the latest cosmic microwave background data from the Atacama Cosmology Telescope (ACT) and the Planck experiment to constrain the interaction strength. In both flavor-universal and nonuniversal coupling scenarios, we find that the ACT data prefers strong neutrino self-interaction that delays neutrino free streaming until just before the matter-radiation equality. When combined with the Planck 2018 data, the preference for strong interaction decreases due to the Planck polarization data. For the combined dataset, the flavor-specific interaction still provides a better fit to the CMB data than ΛCDM. This trend persists even when neutrino mass is taken into account and extra radiation is added. We also study the prospect of constraining such strong interaction by future terrestrial and space telescopes, and find that the upcoming CMB-S4 experiment will improve the upper limit on neutrino self-interaction by about a factor of three.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

Data and scripts associated with “Moisture content modulates DOM thermodynamic regulation of oxygen consumption in drying streambed sediments”

This data package is associated with the publication “Moisture content modulates DOM thermodynamic regulation of oxygen consumption in drying streambed sediments” published in Scientific Reports (Garayburu-Caruso et al., 2026). The package contains processed data products and scripts used to quantify how drying and re-inundation of riverbed sediments influence dissolved organic matter (DOM) thermodynamic properties and their relationship with sediment oxygen (O₂) consumption across 33 stream sites in the contiguous United States. The data package contains DOM thermodynamic metrics (e.g., Gibbs free energy of carbon oxidation and thermodynamic efficiency), and O₂ consumption along with watershed-scale climate and land-cover metrics used as explanatory variables in the analyses. Underlying unprocessed and processed ultrahigh-resolution mass spectrometry data, oxygen consumption rates from laboratory moisture-manipulation experiments, within-sample environmental properties, sediment moisture content and contextual field measurements are archived separately at https://data.ess-dive.lbl.gov/datasets/doi:10.15485/2428003 (Laan et al., 2024) and https://data.ess-dive.lbl.gov/datasets/doi:10.15485/1923689 (Forbes et al.,2023). A preliminary version of this data package was published in February 2026 at the time of manuscript submission. It was updated in June 2026, at the time of manuscript acceptance, to include the finalized data and additional metadata (readme, data dictionary, and file level metadata). For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to a readme, this data package also includes a file-level metadata (FLMD) file that describes each file and a data dictionary (DD) that describes all column/row headers and variable definitions. At the top level, the data package is organized into five main folders: (1) Data, (2)Figures, (3) Map, (4) GAM_Reulsts, and (5) src. The Data folder contains analysis-ready tabular files with oxygen consumption rates, DOM thermodynamic properties by site and treatment, site-level environmental variables, watershed-scale metrics, and other derived variables referenced in the manuscript. The Figures folder contains static image files associated with the main text and supplemental figures, while the Map folder includes spatial data and map-layer files used to create the sampling-location map. The GAM results folder contains the results for each of the general additive model (GAM).The src folder contains R scripts used to perform data processing, statistical analyses (including clustering, generalized additive models, and threshold analysis), and figure generation. This data package is associated with a GitHub repository found at https://github.com/WHONDRS-Hub/ECA_DOM_Thermodynamics.

Dissolved organic matter↗
DOE OSTI2026

The DECam MAGIC Survey $-$ Mapping the Ancient Galaxy in CaHK: Overview and Summary of Early Science

We present the DECam Mapping the Ancient Galaxy in CaHK (MAGIC) survey, a 54-night NOIRLab Survey Program to image $\gtrsim$5,000$\,$deg$^2$ of the southern hemisphere using a metallicity-sensitive narrow-band filter covering the Ca$\,$ii$\,$H&K lines centered at 3955$\,$A. This filter is installed on the Dark Energy Camera (DECam), mounted on the 4-m NSF Víctor M. Blanco Telescope. The survey reaches typical $10σ$ depths of $\text{mag}_{\text{CaHK}} \approx 22.5$, 3$-$4$\,$mag deeper than comparable surveys in the southern hemisphere. By combining photometry from this Ca$\,$ii$\,$H&K filter with existing DECam $g,r,i$ broadband photometry from the DECam Local Volume Exploration (DELVE) survey, MAGIC is deriving photometric metallicities for red giant branch stars down to the magnitude limit of usable proper motions from Gaia data release 3 (DR3). MAGIC has already imaged $\sim$3,000$\,$deg$^2$, supplemented by other affiliated observing programs that have used this filter to image star clusters, dwarf galaxies, and stellar streams. We overview MAGIC's survey strategy, describe data processing through the derivation of metallicities and photometric distances, and summarize early science results that have been published with this dataset. In addition, we present several new results, including the confirmation of a distant ($>5\,r_h$) member of the Reticulum II ultra-faint dwarf galaxy, on-sky density maps of low-metallicity stars into the distant Milky Way halo ($\sim150\,$kpc) recovering 13/14 ultra-faint dwarf galaxies in the current footprint, and a validation of our initial targeting of extremely metal-poor stars. Collectively, these results demonstrate that the MAGIC dataset enables cutting-edge studies of the faint, low-metallicity regime of the Milky Way and its substructures.

Chiti, A. [KIPAC, Menlo Park] (ORCID:0000000271556↗
DOE OSTI2023

Geoelectric Characterization of Hyporheic Exchange Flow in the Bedrock‐Lined Streambed of East Fork Poplar Creek, Oak Ridge, Tennessee

Abstract A multimethod geoelectric survey was implemented between January and March 2022 along a 220‐m long reach of the bedrock‐lined streambed of East Fork Poplar Creek in Oak Ridge, Tennessee to identify locations of surface‐water and groundwater exchange and characterize the subsurface flow paths that convey water between the stream and flood plain. A waterborne self‐potential (WaSP) survey was completed in January 2022 to measure the electric streaming‐potential field in the stream. Electric resistivity tomography (ERT) was performed in March 2022 on the flood plain adjacent to the WaSP survey reach to map the electric resistivity distribution and characterize the hydrogeology and subsurface flow paths that facilitate surface‐water and groundwater exchange in the bedrock‐lined stream. The combination of WaSP and ERT data support the qualitative interpretation that surface‐water and groundwater exchange likely occurs along fractures in outcropping bedrock and along two fault lines that intersect the limestone creek bed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Modelling the Milky Way – I. Method and first results fitting the thick disc and halo with DES-Y3 data

ABSTRACT We present a technique to fit the stellar components of the Galaxy by comparing Hess Diagrams (HDs) generated from trilegal models to real data. We apply this technique, which we call mwfitting, to photometric data from the first 3 yr of the Dark Energy Survey (DES). After removing regions containing known resolved stellar systems such as globular clusters, dwarf galaxies, nearby galaxies, the Large Magellanic Cloud, and the Sagittarius Stream, our main sample spans a total area of ∼2300 deg2. We further explore a smaller subset (∼1300 deg2) that excludes all regions with known stellar streams and stellar overdensities. Validation tests on synthetic data possessing similar properties to the DES data show that the method is able to recover input parameters with a precision better than 3 per cent. We fit the DES data with an exponential thick disc model and an oblate double power-law halo model. We find that the best-fitting thick disc model has radial and vertical scale heights of 2.67 ± 0.09 kpc and 925 ± 40 pc, respectively. The stellar halo is fit with a broken power-law density profile with an oblateness of 0.75 ± 0.01, an inner index of 1.82 ± 0.08, an outer index of 4.14 ± 0.05, and a break at 18.52 ± 0.27 kpc from the Galactic centre. Several previously discovered stellar overdensities are recovered in the residual stellar density map, showing the reliability of mwfitting in determining the Galactic components. Simulations made with the best-fitting parameters are a promising way to predict Milky Way star counts for surveys such as the LSST and Euclid.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗