Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Lead tungstate calorimeters at Jefferson Lab and perspectives for the Electron–Ion Collider

Electromagnetic calorimeters based on PbWO4 scintillating crystals have a widespread applica- tion in experiments at different accelerator facilities such as CERN, FNAL, GSI, and Jefferson Lab. The unique properties of PbWO4 crystals, including a small radiation length and Molire radius, make them ideal for building high-granularity, radiation-hard detectors. This enables excellent spa- tial separation and energy resolution of reconstructed electromagnetic showers, making PbWO4 crystals the material of choice for numerous experiments. Lead tungstate calorimeters have been successfully used in several experiments at Jefferson Lab. Two large-scale detectors have been re- cently fabricated for future experiments : the Neutral Particle Spectrometer and the lead tungstate calorimeter of the GlueX detector. The future application of PbWO4 crystals in the ElectronIon Collider further highlights their ongoing importance in advancing experimental capabilities. In planning new experiments, the development of calorimeter instrumentation technologies becomes paramount. The integration of modern photodetectors, such as Silicon photomultipliers that are capable of operating in strong magnetic fields, and the implementation of streaming readout data acquisition systems, sophisticated shower reconstruction algorithms, and real-time data analysis are some examples of the continuously growing requirements of experimental setups. I will give an overview of the lead tungstate scintillating calorimeters and discuss some recent advancement in the calorimeter instrumentation.

Somov, Alexander↗
DOE OSTI2025

Neutron Source Localization Using the NoMAD He-3 Detector [Slides]

With the goal of advancing criticality safety with neutron localization, the following tasks were successful: (1) demonstrated neutron source localization using a NoMAD detector and ML; and (2) developed a real-time system for streaming in data from NoMAD, verifying that the system works in experimental settings.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Surveilling Influenza Incidence With Centers for Disease Control and Prevention Web Traffic Data: Demonstration Using a Novel Dataset

Influenza epidemics result in a public health and economic burden worldwide. Traditional surveillance techniques, which rely on doctor visits, provide data with a delay of 1 to 2 weeks. A means of obtaining real-time data and forecasting future outbreaks is desirable to provide more timely responses to influenza epidemics. This study aimed to present the first implementation of a novel dataset by demonstrating its ability to supplement traditional disease surveillance at multiple spatial resolutions. We used internet traffic data from the Centers for Disease Control and Prevention (CDC) website to determine the potential usability of this data source. Additionally, we tested the traffic generated by 10 influenza-related pages in 8 states and 9 census divisions within the United States and compared it against clinical surveillance data.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Millinocket Stream, Maine Velocity and Bathymetry Measurements 2021

ORPC staff collected site characterization data on Millinocket Stream, downstream of the hydropower station at the former Great Northern Paper Mill site in Millinocket, Maine. Bathymetry was collected with a SonTek M9 using HydroSurveyor software package and velocity was collected using the SonTek M9 RiverSurveyor software package. Bathymetry only was collected on 9/30/21. Bathymetry and velocity were collected on 10/21/21.

16 TIDAL AND WAVE POWER↗
DOE OSTI2025

GD-1 Stellar Stream and Cocoon in the DESI Early Data Release

We present ∼115 new spectroscopically identified members of the GD-1 tidal stream observed with the 5000-fiber Dark Energy Spectroscopic Instrument (DESI). We confirm the existence of a “cocoon,” which is a broad (FWHM ∼ 2:932 ∼ 460 pc) and kinematically hot (velocity dispersion, σ ∼ 5–8 km s −1 ) component that surrounds a narrower (FWHM ∼ 0:353 ∼ 55 pc) and colder [(σ = 3.09 ± 0.76 km s −1 )] thin stream component (based on a median per star velocity precision of 2.7 km s −1 ). The cocoon extends over at least a 30 ∘ segment of the stream observed by DESI. The thin and cocoon components have similar mean values of [Fe/H]: −2.54 ± 0.04 dex and −2.47 ± 0.06 dex, suggestive of a common origin. The data are consistent with the following scenarios for the origin of the cocoon. The progenitor of the GD-1 stream was an accreted globular cluster (GC) and: (a) the cocoon was produced by pre-accretion tidal stripping of the GC while it was still inside its parent dwarf galaxy; (b) the cocoon comprises debris from the parent dwarf galaxy; (c) an initially thin GC tidal stream was heated by impacts from dark subhalos in the Milky Way; (d) an initially thin GC stream was heated by a massive Sagittarius dwarf galaxy; or a combination of some of these. Future DESI spectroscopy and detailed modeling may enable us to distinguish between these possible origins.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Prototype Data Acquisition and Slow Control Systems for the Mu2e Experiment

The Mu2e experiment at the Fermilab Muon Campus will search for the coherent neutrinoless conversion of a muon into an electron in the field of an aluminum nucleus with a sensitivity improvement by a factor of 10 000 over existing limits. Such a charged lepton flavor-violating reaction probes new physics at a scale unavailable with direct searches at either present or planned high-energy colliders. The Mu2e Trigger and Data Acquisition (TDAQ) system exploits otsdaq as its online Data Acquisition System (DAQ) solution. Furthermore, developed at Fermilab, otsdaq integrates both the artdaq DAQ and the art analysis frameworks for event transfer, filtering, and processing. otsdaq is an online DAQ software suite with a focus on flexibility and scalability and provides a multi-user, web-based, interface accessible through a web browser. The read out controllers (ROCs) stream out zero-suppressed data continuously from the detector subsystems to the data transfer controllers (DTCs). The data stream is then read over the peripheral component interconnect express (PCIe) bus to a software filter algorithm that selects events which are combined with the data flux coming from a cosmic-ray veto (CRV) system. The detector control system (DCS) has been developed using the experimental physics and industrial control system (EPICS) open source platform for monitoring, controlling, alarming, and archiving. The DCS has been integrated into otsdaq. A prototype of the TDAQ system and the DCS has been built at Fermilab's Feynman Computing Center. In this article, we report on the progress of the integration of this prototype in the online otsdaq software.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Simulation system for testing a radar system

A simulation system for use in testing a radar system comprises a coarse delay module, a fine delay module, and a doppler shift module. The coarse delay module is configured to receive a first stream of digital data samples that are sampled from a radar signal at a sample time period or a second stream of digital data samples that are processed by another simulation system component and delay the digital data samples by a selectable first delay time that is greater than or equal to the sample time period. The fine delay module is configured to receive the digital data samples and filter the digital data samples to represent delay by a selectable second delay time that is less than the sample time period. The doppler shift module is configured to receive the digital data samples and adjust a value of a frequency content of the fine delayed samples.

Chritton, Audrey L.↗
DOE OSTI2025

STZ: A High Quality and High Speed Streaming Lossy Compression Framework for Scientific Data

Error-bounded lossy compression is one of the most efficient solutions to reduce the volume of scientific data. For lossy compression, progressive decompression and random-access decompression are critical features that enable on-demand data access and flexible analysis workflows. However, these features can severely degrade compression quality and speed. To address these limitations, we propose a novel streaming compression framework that supports both progressive decompression and random-access decompression while maintaining high compression quality and speed. Our contributions are three-fold: (1) we design the first compression framework that simultaneously enables both progressive decompression and random-access decompression; (2) we introduce a hierarchical partitioning strategy to enable both streaming features, along with a hierarchical prediction mechanism that mitigates the impact of partitioning and achieves high compression quality—even comparable to state-of-the-art (SOTA) non-streaming compressor SZ3; and (3) our framework delivers high compression and decompression speed, up to 6.7 × faster than SZ3.

Wang, Daoce [University of Nebraska, Omaha]↗
DOE OSTI2023

Early Fault Detection in Particle Accelerator Power Electronics Using Ensemble Learning

Early fault detection and fault prognosis are crucial to ensure efficient and safe operations of complex engineering systems such as the Spallation Neutron Source (SNS) and its power electronics (high voltage converter modulators). Following an advanced experimental facility setup that mimics SNS operating conditions, the authors successfully conducted 21 early fault detection experiments, where fault precursors are introduced in the system to a degree enough to cause degradation in the waveform signals, but not enough to reach a real fault. Nine different machine learning techniques based on ensemble trees, convolutional neural networks, support vector machines, and hierarchical voting ensembles are proposed to detect the fault precursors. Although all 9 models have shown a perfect and identical performance during the training and testing phase, the performance of most models has decreased in the next test phase once they got exposed to realworld data from the 21 experiments. The hierarchical voting ensemble, which features multiple layers of diverse models, maintains a distinguished performance in early detection of the fault precursors with 95% success rate (20/21 tests), followed by adaboost and extremely randomized trees with 52% and 48% success rates, respectively. The support vector machine models were the worst with only 24% success rate (5/21 tests). The study concluded that a successful implementation of machine learning in the SNS or particle accelerator power systems would require a major upgrade in the controller and the data acquisition system to facilitate streaming and handling big data for the machine learning models. In addition, this study shows that the best performing models were diverse and based on the ensemble concept to reduce the bias and hyperparameter sensitivity of individual models.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

WHONDRS River Corridor Sediment and Water Geochemistry and In Situ Sensor Data from 7 Perennial and 7 Intermittent Streams across San Antonio, Texas (v3)

This dataset supports a broader study examining the effects of intermittency on sediment respiration. The dataset provides sediment and surface water geochemistry and in situ sensor data from 7 perennial and 7 intermittent streams in San Antonio, Texas. Each stream/site was visited both in summer during base flow (July-September 2023) and winter during peak flow (January-February 2024). Related data were collected and will be published separately in collaboration with A. Veach. The data package was originally published in April 2025. It was updated in June 2025 (v2; modified and new files) and September 2025 (v3; modified files). See the change history section in the readme for more details. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. This dataset is comprised of two folders of field photos and videos, one folder of raw Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) data and one main data folder containing (1) file-level metadata; (2) data dictionary; (3) field metadata; (4) readme; (5) international generic sample number (IGSN) mapping file; (6) field protocol; (7) a subfolder with sample data; and (8) a subfolder with sensor data. The sample data subfolder contains (1) surface water and sediment dissolved organic carbon (DOC, measured as non-purgeable organic carbon, NPOC) data and averages; (2) surface water and sediment total nitrogen data and averages; (3) sediment grain size data; (4) sediment iron (II) data and averages; (5) wet sediment mass, dry sediment mass, water mass, and wet sediment volume in incubation and sediment ICR vials; (7) sediment incubation respiration rate data and averages; (8) normalized respiration rate data and averages; (9) methods codes; (10) sediment percent carbon and nitrogen; (11) sediment X-ray diffraction (XRD) data; (12) gravimetric moisture and averages; (13) a subfolder with sediment incubation respiration data, scripts, and plots; (14) surface water and sediment FTICR methods; and (15) a subfolder of 9.4 Tesla (9.4T) FTICR-MS data. This folder contains five subfolders, one containing the sediment .xml data files, one containing the water .xml files, one containing the sediment CoreMS output files, one containing the water CoreMS output files, and the other containing instructions and scripts for processing the files in CoreMS (https://github.com/EMSL-Computing/CoreMS). The sensor data subfolder contains (1) a subfolder with miniDOT dissolved oxygen and temperature data and plots; (2) miniDOT dissolved oxygen and temperature summary data; and (3) miniDOT installation methods. All files are .csv, .pdf, .R, .xml, .d, .html, .Rmd, .py, .cal, .json, .jpg, .jpeg, .png, .mov, or .mp4. CORRECTION: The data processing methods for FTICR described in “v3_WHONDRS_AV1_Methods_Codes.csv” mistakenly indicate that users should process the data in Formultitude. The corrected description should read: “Both unprocessed and processed data are provided to allow users flexibility in data processing. Instructions and scripts for processing the data using CoreMS are included.” CORRECTION: Carbon and nitrogen content are reported as percentages. The current column headers "01395_C_percent_per_mg" and "01397_N_percent_per_mg" are incorrect. These should read "01395_C_percent" and "01397_N_percent" and will be corrected in the next version of this data package.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Ultrafast structural response to charge redistribution within a photosinthetic reaction centre

This data set contains stream files, difference maps and SVD maps obtained from data processing of time-resolved serial femtosecond crystallography measurements performed at LCLS XFEL, used to construct the images and perform the analysis published in the paper "Ultrafast structural response to charge redistribution within a photosinthetic reaction centre". Two (2) time points plus a dark state from 2015 ('a' label) as well as five (5) time points plus a dark state from 2016 ('b' label) are provided.

CXI↗
DOE OSTI2024

Once in a blue stream: Detection of recent star formation in the NGC 7241 stellar stream with MEGARA

Aims.In this work we study the striking case of a narrow blue stream with a possible globular cluster-like progenitor around the NGC 7241 galaxy and its foreground dwarf companion. We want to figure out if the stream was generated by tidal interaction with NGC 7241 or if it first interacted with the foreground dwarf companion and later both fell together toward NGC 7241. Methods.We used four sets of observations, including a follow-up spectroscopic study of this stream based on data taken with the MEGARA instrument at the 10.4 m Gran Telescopio Canarias using the integral field spectroscopy mode, the Mount Lemmon 0.80 m telescope, the Telescopio NazionaleGalileo, the DESI Imaging Legacy surveys, and GALEX archival data. We also used high-resolution zoomed-in cosmological simulations. Results.Our data suggest that the compact object we detected in the stream is a foreground Milky Way halo star. Near this compact object we detect emission lines overlapping a less compact, bluer, and fainter blob of the stream that is clearly visible in both ultraviolet and optical deep images. From its heliocentric systemic radial velocity derived from the [O III]λ5007 Å lines (V syst = 1548.58 ± 1.80 km s −1 ) and new UV and optical broadband photometry, we conclude that this overdensity could be the actual core of the stream, with an absolute magnitude ofM g ∼ −10 and ag − r = 0.08 ± 0.11, consistent with a remnant of a low-mass dwarf satellite undergoing a current episode of star formation. From the width of the stream and assuming a circular orbit, we calculate that the progenitor mass can be typical of a dwarf galaxy, but it could also be substantially lower if the stream is on a very radial orbit or if it was created by tidal interaction with the companion dwarf instead of with NGC 7241. These estimates also suggest that this is one of the lowest mass streams detected to date beyond the Local Group. Finally, we find that blue stellar streams containing star formation regions are commonly predicted by high-resolution cosmological simulations of galaxies lighter than the Milky Way. This scenario is consistent with the processes explaining the bursty star formation history of some dwarf satellites, which are followed by a gas depletion and a fast quenching once they enter within the virial radius of their host galaxies for the first time. Thus, it is likely that the stream’s progenitor is undergoing a star formation burst comparable to those that have shaped the star formation history of several Local Group dwarfs in the last few gigayears.

Astronomy & Astrophysics↗
DOE OSTI2023

Vis-SAGA: Visual Analytics for Situational Awareness of Grid Anomalies: Preprint

We describe supporting near real-time situational awareness of the electric distribution system by visualizing novel data from voltage sensors deployed on existing broadband cable television network equipment. Our scalable web-based visual analytics platform supports interactive geospatial exploration, time-series analysis, and summarization of grid behavior during potentially anomalous events. The broadband cable television sensor network provides observability of the electrical distribution system at a higher local spatial resolution than is typically available to most utilities, revealing the operational state of the network and aiding in the detection of abnormal behaviors or deviations from expected patterns, particularly across electric utility service areas. We outline the design and development of interactive geospatial and time-series visualization components and the scalable data services that supply metadata, historical, and real-time streams of sensor data across the network. We evaluate our platform during periods of extreme weather, demonstrating its ability to assist in detecting patterns of operation that affect power availability, quality, resiliency, and service restoration.

cable television↗
DOE OSTI2026

HPC ODA Commons [SWR-26-003]

HPC ODA Commons is a community-driven platform for standardizing HPC operational data analytics. HPC sites generate enormous volumes of operational data - scheduler logs, accounting records, monitoring streams - but turning that data into actionable insight is needlessly hard. Each site builds bespoke parsers, schemas, and evaluation pipelines. Results can't be compared across institutions. Promising analytics ideas stay siloed because there's no shared language for describing the data, the experiments, or the outcomes. HPC ODA Commons fixes this by establishing community-governed contracts - versioned schemas, canonical artifacts, and benchmark recipes - that make ODA workflows discoverable, reproducible, and comparable. It pairs these standards with a practical, CLI-first toolkit that lets operators and researchers go from raw logs to standardized results without sending data off-cluster.

Menear, Kevin [National Laboratory of the Rockies ↗