Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

NEWTS Coal Mine Drainage Dataset from Cravotta Brady (2015)

Data from Cravotta, Brady, "Priority pollutants and associated constituents in untreated and treated discharges from coal mining or processing facilities in Pennsylvania, USA". Applied Geochemistry, 2015. https://doi.org/10.1016/j.apgeochem.2015.03.001 Dataset includes information on water quality composition including inorganic compounds from untreated and treated streams of coal-mine discharge from coal mining and coal processing locations. Data is provided in the original version as well as in a summarized version for easy input into aqueous chemistry modeling software.

Aqueous Chemistry↗
DOE OSTI2022

Parametric model-order reduction for radiation transport using multi-resolution proper orthogonal decomposition

For parametric high-fidelity simulations, it is often desirable to utilize a reduced-order model (ROM) to emulate, at a reduced computational cost, parametric solutions of the governing partial differential equations (PDEs) for unseen parameter values. One commonly employed option is to utilize a data-driven, projection-based ROM supplemented with subspace identification via proper orthogonal decomposition (POD). POD discovers the ROM subspace by computing the singular value decomposition (SVD) of a set of training data from the full-order model (FOM). In streaming-dominated radiation transport simulations with localized sources, solutions often greatly vary over the spatial domain by many orders of magnitude. In such cases, machine-precision arithmetic can be insufficient to obtain an accurate SVD, resulting in a poorly performing ROM. We present a method called multiresolution POD (mrPOD) that mitigates these inaccuracies. The mrPOD method works by decomposing the spatial domain into regions and performing proper orthogonal decomposition on the training dataset separately in each region. In conclusion, mrPOD is tested on single energy group and multigroup atmospheric shielding transport problems and is shown to outperform classic POD.

42 ENGINEERING↗
DOE OSTI2022

TOMOCUPY

ANL REFERENCE SF-22-102 DESCRIPTION: Tomocupy is a Python package and a command-line interface for GPU reconstruction of tomographic/laminographic data in 16-bit and 32-bit precision. It implements an efficient data processing conveyor allowing to overlap all data transfers with computations. First, independent Python threads are started for reading data chunks from the hard disk into a Python data queue and for writing reconstructed chunks from the Python queue to the hard disk. Second, CPU-GPU data transfers are overlapped with GPU computations by using CUDA streams.

NIKITIN, VIKTOR↗
DOE OSTI2025

NOODLES Grid [SWR-25-93]

NOODLES Grid is a real-time visualization server for power system simulation data. It loads precomputed datasets, builds optimized instance renderings, and streams live interactive scenes to connected clients. It is built for high scalability, flexible visualization, and fast interaction. NOODLES is a cross-platform/device/tool protocol for collaborative visualization. NOODLES was Developed at the National Renewable Energy Laboratory (NREL) as a capability of the Insight Center https://www.nrel.gov/computational-science/insight-center.html

Brunhart-Lupo, Nicholas [National Renewable Energy↗
DOE OSTI2023

Thermal hydraulic characteristics of liquid sodium and supercritical CO 2 in a diffusion bonded heat exchanger

Compact heat exchangers are being examined for use in advanced, high-temperature nuclear or concentrated solar power plants to improve thermal efficiencies and reduce capital costs. At the time of this work, no experimental investigation of liquid sodium in the popular diffusion-bonded heat exchanger design had been performed. Herein this paper describes the thermal-hydraulic and overall operations performance observed during testing of a 316/L stainless steel “zig-zag” microchannel heat exchanger operating between a (0.5 kg/s) sodium loop and a (0.3 kg/s) recuperated supercritical CO 2 system with outlet conditions up to 550 °C at 16 MPa. Observed pressure drop is presented in the form of an effective friction factor correlation which aligns closely with recent experimental data. The thermal performance of this heat exchanger, measured by its overall conductance under various flow conditions, was decomposed to examine the independent convection behaviors of both the CO 2 and sodium streams. These results are presented in the form of Nusselt correlations fitted to the experimental data. The sodium heat transfer correlation aligns closely with the widely accepted Lubarsky-Kaufman correlation, while the CO 2 heat transfer correlation lies between previous correlations developed by computational and experimental methods. This was the first long-duration use of sodium in a microchannels (~1.8 mm hydraulic diameter) heat exchanger. The use of an oxide control system enabled trouble-free operation of the heat exchanger for over 150 h of high-temperature operation. This first-of-a-kind demonstration using liquid sodium and supercritical carbon dioxide shows great promise for further application of this technology in advanced nuclear or solar power plants.

42 ENGINEERING↗
DOE OSTI2023

Yakima River Basin Temporal Study: Sensor and Sample Data from Wenas Creek following the Evans Canyon Fire in Washington, USA

The Evans Canyon Fire occurred in Washington in August 2020 and burned 76,000 acres of the semi-arid shrub-steppe landscape at low to moderate severities. This fire burned across the Wenas Creek watershed, allowing for a sampling design that included a portion of the stream within the burned area and a reference site upstream of the burn. Monthly data was collected at an unburned (W10) and burned (W20) site from November 2020 to August 2022 for in situ hydrological and water chemistry sensor data, handheld sensor water chemistry data, general environmental context photos, and field metadata. This dataset is comprised of one folder with field photos and one main data folder containing (1) sensor and sample field protocols; (2) file-level metadata (flmd); (3) data dictionary (dd); (4) international geo-sample number (IGSN) mapping file; (5) field metadata; (6) readme; (7) methods codes; (8) dissolved organic carbon (DOC; measured as non-purgeable organic carbon; NPOC); (9) total nitrogen (TN); (10) total suspended solids (TSS); (11) sensor data (specific conductance, pH, total dissolved solids, temperature, pressure, dissolved oxygen, and turbidity) averages; and (12) sensor installation methods. All files are .csv, .jpg, .jpeg, or .pdf.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

FECM/NETL Unconventional Shale Well Economic Model (UShWEM): Production Data for UShWEM

The Production Data for UShWEM.xlsx is an Excel file that is formatted and organized similarly to the Production Streams sheet of the FECM/NETL Unconventional Shale Well Economic Model (UShWEM). The purpose of this file is to allow the user to import completion design and time-series production data for hundreds of wells into the UShWEM easily and quickly, and have their well data saved safely in an external location. For instructions on how to use the Production Data for UShWEM.xlsx file, see section 2.3 of the FECM/NETL Unconventional Shale Well Economic Model: User’s Manual.

Sheriff, Alana↗
DOE OSTI2021

Uncovering fossils of the distant Milky Way with UNIONS: NGC 5466 and its stellar stream

ABSTRACT We examine the spatial clustering of blue horizontal branch (BHB) stars from the u-band of the Canada–France Imaging Survey (CFIS, a component of the Ultraviolet Near-Infrared Optical Northern Survey, or UNIONS). All major groupings of stars are associated with previously known satellites, and among these is NGC 5466, a distant (16 kpc) globular cluster. NGC 5466 reportedly possesses a long stellar stream, although no individual members of the stream have previously been identified. Using both BHBs and more numerous red giant branch stars cross-matched to Gaia Data Release 2, we identify extended tidal tails from NGC 5466 that are both spatially and kinematically coherent. Interestingly, we find that this stream does not follow the same path as the previous detection at large distances from the cluster. We trace the stream across 31° of sky and show that it exhibits a very strong distance gradient in the range 10 < Rhelio < 30 kpc. We compare our observations to simple dynamical models of the stream and find that they are able to broadly reproduce the overall path and kinematics. The fact that NGC 5466 is so distant, traces a wide range of Galactic distances, has an identified progenitor, and appears to have recently had an interaction with the Galaxy’s disc makes it a unique test-case for dynamical modelling of the Milky Way.

Jensen, Jaclyn↗
DOE OSTI2022

DOE COVID-19 Data Curation Effort: Overview of Initial Data Collection Coverage (March - June 2020)

During the COVID-19 pandemic of 2020, major case reporting outlets quickly coalesced around two or three primary vendors. Johns Hopkins University and The New York Times were among the more prominent, and all were of great value to the nation, particularly during the uncertain early stages of the pandemic. They primarily focused on three major attributes: number of new cases, deaths, and recovery, but only at the state level. Recognizing that many states were reporting very detailed data sets (e.g., hospital beds) at a count level or finer, the ORNL Pandemic Modeling team embarked on a major data curation effort from March to June 2020 for the purpose of capturing this wealth of detailed data. The challenge of curating this data was daunting. The number of attributes reported by the states grew on almost on a weekly basis. States were routinely shifting their web tool strategies away from easily parsable HTML-based formatting to new Tableau and ArcGIS content. This growth in the sheer number of attributes combined with the unpredictable shifts in data format meant an aggressive and agile combination of automated scripting and manual scraping was required to capture new daily streams. To keep up, the team had to scale up staff and widen its approach for capture and storage. The DOE COVID-19 data collection effort resulted in over 11 million data points being collected, covering over 13,000 unique geographies and over 2,000 unique attributes that spanned predominantly from early March through the end of June 2020.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2020

Declaration of the Chemical Composition of Waste-products for the German Repository Konrad Using Substance Vectors - 20500

The waste acceptance criteria of the German repository Konrad require beside a radiological declaration a compositional declaration to be able to avoid negative impact on the groundwater by a presumed leakage into the groundwater after complete corrosion of the containers in the future. The declaration of the composition has to specify compounds and substances not element analyses, because the chemical behavior and toxicity especially of organic compounds varies strongly The relevant compounds have to be described and quantified using defined substance codes provided by the operator. For simple waste types like pure concrete or steel components, the definition of the composition is rather simple. The composition of more complex waste streams is generally declared using producer specific material vectors, which can be derived for defined waste types (e.g. grouted fluids, ash from combustion, super-compacted mixed waste etc.). Additional substance vectors exist for containers, drums and grout, which together with the waste composition yield the total composition of the waste packages. The substance vectors for homogeneous waste streams like cementitious demolition waste, solidified fluids and ash are mostly based on analyses provided by the waste owner. In some cases, analyses from non-radioactive analogues or data sheets can also be used to demonstrate the composition. For each qualified treatment of radioactive waste streams the material composition is described and balanced on the basis of specific material vectors, which are composed of material codes from the material and cask list provided by the Federal company for radioactive waste disposal. For mixed waste streams like super-compacted or grouted mixed waste or materials simply packed in containers an analyses cannot be used. In these cases, the compositional information from the bookkeeping can be used for the entire waste stream to calculate a mean composition including a compositional range (min / max composition). Only waste packages with an approved material description can be delivered to Konrad. Therefore, the material declaration of all waste streams and the resulting waste products is crucial for all waste owners in Germany to be able to have enough waste packages ready, when the repository is going to open in 2027. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Catalytic Reduction of Esters over Zirconia-Supported Metal Catalysts

Esters are often produced as unwanted byproducts during the catalytic upgrading of ethanol to diesel fuel precursors through Guerbet coupling. Removal of esters from the product stream is important to prevent the loss of downstream catalyst activity from ester-derived carboxylic acids. In this work, we studied ester hydrogenolysis to the parent alcohols as a viable route for enhanced diesel fuel production. Specifically, we investigated the reduction of hexyl acetate in butanol over ZrO 2 -supported Ni, Co, Cu, Rh, Pd, and Pt catalysts, where Cu/ZrO 2 was the most selective catalyst for the hydrogenolysis of hexyl acetate into hexanol and ethanol. Thermodynamic analysis reveals that a 90% alcohol yield can be obtained at 200 °C, 30 bar, and a relatively high H 2 :hexyl acetate molar ratio of 480:1. Experimentally, an alcohol yield of 88% yield was obtained with a 10 wt % Cu/ZrO 2 catalyst at these conditions with a residence time of 5.4 h kg cat kmol gas –1 . Catalytic tests on the support revealed that ZrO 2 catalyzes the transesterification reaction between hexyl acetate and butanol. However, only the Cu sites can catalyze the hydrogenolysis of the esters into the final alcohols. We developed a kinetic model for our experimental results, which shows that the transesterification and hydrogenolysis reactions run at two different timescales, the former being 10 times faster than the latter. Data regression has been used to develop a model to predict the mole fraction distribution of ester hydrogenolysis products over a wide range of contact times. Cu/ZrO 2 loses half its catalytic activity after 80 h of time on stream. Modeling of deactivation data reveals that the ZrO 2 support conserves a residual activity due to external active sites, while active sites over the Cu surface deactivate at different rates. Furthermore, the catalytic conversion of esters into their parent alcohols is relevant to the production of surrogate liquid fuels since alcohols can be bimolecularly dehydrated to produce a blend of ethers with diesel fuel-like properties.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Immersive Scientific Visualization of Molten-Salt Reactor Waste Characteristics Using Virtual Reality

Immersive visualization is changing how we explore, communicate, and understand complex scientific systems. In nuclear energy, an area in which data are often multidimensional, time-dependent, and difficult to interpret, virtual reality (VR) represents a powerful and intuitive informational medium. This work introduces a VR-based platform that visualizes the post-shutdown behavior and waste management lifecycle of molten-salt reactors (MSRs), a next-generation reactor type with unique operational and safety characteristics. The platform, built in Unity, is streamed on the Meta Quest 3 headset. It transforms high-fidelity simulation data into an interactive, immersive experience. Users can explore time-dependent reactor characteristics such as nuclide decay, which is a key factor for evaluating reactor waste strategies. The datasets were generated using the MOOSE (Multiphysics Object-Oriented Simulation Environment) framework and then processed through ParaView scripting for smooth integration into Unity. From a visualization standpoint, the platform emphasizes spatial storytelling, temporal exploration, and user-centered interaction. Users can navigate 3D reactor geometries, slice through volumetric data, and manipulate time to observe how physical phenomena evolve. Real-scale rendering and embodied interaction make the experience feel tangible. The interface is designed to be accessible, even to those without nuclear or simulation expertise. This lowers the barrier for stakeholders, policymakers, and the general public, while still supporting expert analysis and collaborative decision-making. This work shows how immersive visualization can function as both a scientific tool and a communication interface. By integrating simulation, processing, and visualization into a cohesive workflow, we offer a scalable framework for immersive scientific storytelling. The modular design supports future extensions to other reactor types and lifecycle stages, from shutdown to long-term storage, making the platform adaptable for both research and outreach.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

Assessing Historical Variability of South Asian Monsoon Lows and Depressions With an Optimized Tracking Algorithm

Abstract Cyclonic low‐pressure systems (LPS) produce abundant rainfall in South Asia, where they are traditionally categorized as monsoon lows, monsoon depressions, and more intense cyclonic storms. The India Meteorological Department (IMD) has tracked monsoon depressions for over a century, finding a large decline in their number in recent decades, but their methods have changed over time and do not include monsoon lows. This study presents a fast, objective algorithm for identifying monsoon LPS and uses it to assess interannual variability and trends in reanalyses. Variables and thresholds used in the algorithm are selected to best match a subjectively analyzed LPS data set while minimizing disagreement between four reanalyses in a training period. The stream function of 850 hPa horizontal wind is found to be optimal in this sense; it is less noisy than vorticity and represents the complete nondivergent wind, even when flow is not geostrophic. Using this algorithm, LPS statistics are computed for five reanalyses, and none show a detectable trend in monsoon depression counts since 1979. Both the Japanese 55‐year Reanalysis (JRA‐55) and the IMD data set show a step‐like reduction in depression counts when they began using geostationary satellite data, in 1979 and 1982, respectively; the 1958–2018 linear trend in JRA‐55, however, is smaller than in the IMD data set, and its error bar includes 0. There are more LPS in seasons with above‐average monsoon rainfall and in La Niña years, but few other large‐scale modes of interannual variability are found to modulate LPS counts, lifetimes, or track length consistently across reanalyses.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Advancing the Representation of Human Actions in Large‐Scale Hydrological Models: Challenges and Future Research Directions

Characterizing the impact of human actions on terrestrial water fluxes and storages at multi-basin, continental, and global scales has long been on the agenda of scientists engaged in climate science, hydrology, and water resources systems analysis. This need has resulted in a variety of modeling efforts focused on the representation of water infrastructure operations. Yet, the representation of human-water interactions in large-scale hydrological models is still relatively crude, fragmented across models, and often achieved at coarse resolutions (~10–100 km) that cannot capture local water management decisions. In this commentary, we argue that the concomitance of four drivers and innovations is poised to change the status quo: “hyper-resolution” hydrological models (~0.1–1 km), multi-sector modeling, satellite missions able to monitor the outcome of human actions, and machine learning are creating a fertile environment for human-water research to flourish. We then outline four challenges that chart future research in hydrological modeling: (a) creating hyper-resolution global data sets of water management practices, (b) improving the characterization of anthropogenic interventions on water quantity, stream temperature, and sediment transport, (c) improving model calibration and diagnostic evaluation, and (d) reducing the computational requirements associated with the successful exploration of these challenges. Overcoming them will require addressing modeling, computational, and data development needs that cut across the hydrology community, thereby requiring a major communal effort.

catchment hydrology↗
DOE OSTI2025

Toward a persistent event-streaming system for high-performance computing applications

High-performance computing (HPC) applications have traditionally relied on parallel file systems and file transfer services to manage data movement and storage. Alternative approaches have been proposed that use direct communications between application components, trading persistence and fault tolerance for speed. Event-driven architectures, as popularized in enterprise contexts, present a compelling middle ground, avoiding the performance cost and API constraints of parallel file systems while retaining persistence and offering impedance matching between application components. However, adapting streaming frameworks to HPC workloads requires addressing challenges unique to HPC systems. This paper investigates the potential for a streaming framework designed for HPC infrastructures and use cases. We introduce Mofka, a persistent event-streaming framework designed specifically for HPC environments. Mofka combines the capabilities of a traditional streaming service with optimizations tailored to the HPC context, such as support for massively multicore nodes, efficient scaling for large producer-consumer workflows, RDMA-enabled high-performance network communications, specialized network fabrics with multiple links per node, and efficient handling of large scientific data payloads. Built using the Mochi suite of HPC data service components, Mofka provides a lightweight, modular, and high-performance solution for persistent streaming in HPC systems. We present the architecture of Mofka and evaluate its performance against Kafka and Redpanda using benchmarks on diverse platforms, including Argonne's Polaris and Oak Ridge's Frontier supercomputers, showing up to 8× improvement in throughput in some scenarios. We then demonstrate its utility in several real-world applications: a tomographic reconstruction pipeline, a workflow for the discovery of metal-organic frameworks for carbon capture, and the instrumentation of Dask workflows for provenance tracking and performance analysis.

HPC↗
DOE OSTI2022

A signal packet router for the upgrade of the Muon spectrometer at the ATLAS experiment

Here, we present the design, characterization, and production of a signal packet router for the upgrade of the ATLAS forward muon detector. The router serves as a packet switch in one of the primary trigger paths. It handles up to 12 serial inputs at 4.8 Gbps/input from on-detector electronics and outputs four 4.8 Gbps to the trigger processing circuits. In the 12-to-4 packet switching process, the input streams are decoded and synchronized to a common clock domain for data packets forwarding and NULL packets suppression. Challenges in the design include operations of multi-giga hertz serial links with low and constant latency (<100 ns) for packet routing, as well as mitigation of radiation-induced effects in the harsh radiation environment over 10 years of detector operation. The Router design has been fully characterized and demonstrated to meet all specifications. In total 256 Routers were installed in the detector. Its design concept can be used in other similar applications, particularly in a radiation environment.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

River Geomorphology Affects Biogeochemical Responses to Hydrologic Events in a Large River Ecosystem

Shifts in the frequency and intensity of high discharge events due to climate change may have important consequences for the hydrology and biogeochemistry of rivers. However, our understanding of event-scale biogeochemical dynamics in large rivers lags that of small streams. To fill this gap, we used high-frequency sensor data collected during four consecutive summers from a main channel and backwater site of the Upper Mississippi River. We identified high discharge events and calculated event concentration-discharge responses for both physical-chemical (nitrate, turbidity, and fluorescent dissolved organic matter) and biological (chlorophyll-a and cyanobacteria) constituents using metrics of hysteresis and slope. We found a range of responses across events, particularly for nitrate. Although fluorescent dissolved organic matter (FDOM) and turbidity exhibited more consistent responses across events, contrasting hysteresis metrics indicated that FDOM was flushed to the river from more distant sources than turbidity. Biological responses (chlorophyll a and cyanobacteria) differed more between sites than physical and chemical constituents. Lastly, we found that the event characteristics best explaining concentration responses differed between sites, with event magnitude more frequently related to responses in the main channel, and antecedent wetness conditions associated with response variation in the backwater. Furthermore, our results indicate that event responses in large rivers are distinct across the diverse habitats and biogeochemical components of a large floodplain river, which has implications for local and downstream ecosystems as the climate shifts.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Operando high-pressure investigation of size-controlled CuZn catalysts for the methanol synthesis reaction

Although Cu/ZnO-based catalysts have been long used for the hydrogenation of CO 2 to methanol, open questions still remain regarding the role and the dynamic nature of the active sites formed at the metal-oxide interface. Here, we apply high-pressure operando spectroscopy methods to well-defined Cu and Cu 0.7 Zn 0.3 nanoparticles supported on ZnO/Al2O 3 , γ-Al 2 O 3 and SiO 2 to correlate their structure, composition and catalytic performance. We obtain similar activity and methanol selectivity for Cu/ZnO/Al 2 O 3 and CuZn/SiO 2 , but the methanol yield decreases with time on stream for the latter sample. Operando X-ray absorption spectroscopy data reveal the formation of reduced Zn species coexisting with ZnO on CuZn/SiO 2 . Near-ambient pressure X-ray photoelectron spectroscopy shows Zn surface segregation and the formation of a ZnO-rich shell on CuZn/SiO 2 . In this work we demonstrate the beneficial effect of Zn, even in diluted form, and highlight the influence of the oxide support and the Cu-Zn interface in the reactivity.

36 MATERIALS SCIENCE↗