Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “STREAMS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Hidden deep in the halo: selection of a reduced proper motion halo catalogue and mining retrograde streams in the velocity space

ABSTRACT The Milky Way halo is one of the few galactic haloes that provides a unique insight into galaxy formation by resolved stellar populations. Here, we present a catalogue of ∼47 million halo stars selected independent of parallax and line-of-sight velocities, using a combination of Gaia DR3 proper motion and photometry by means of their reduced proper motion. We select high tangential velocity (halo) main sequence stars and fit distances to them using their simple colour-absolute-magnitude relation. This sample reaches out to ∼21 kpc with a median distance of 6.6 kpc thereby probing much further out than would be possible using reliable Gaia parallaxes. The typical uncertainty in their distances is $0.57_{-0.26}^{+0.56}$ kpc. Using the colour range 0.45 < (G0 − GRP, 0) < 0.715, where the main sequence is narrower, gives an even better accuracy down to $0.39_{-0.12}^{+0.18}$ kpc in distance. The median velocity uncertainty for stars within this colour range is 15.5 km s−1. The distribution of these sources in the sky, together with their tangential component velocities, are very well-suited to study retrograde substructures. We explore the selection of two complex retrograde streams: GD-1 and Jhelum. For these streams, we resolve the gaps, wiggles and density breaks reported in the literature more clearly. We also illustrate the effect of the kinematic selection bias towards high proper motion stars and incompleteness at larger distances due to Gaia’s scanning law. These examples showcase how the full RPM catalogue made available here can help us paint a more detailed picture of the build-up of the Milky Way halo.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Extending the chemical reach of the H3 survey: detailed abundances of the dwarf-galaxy stellar stream Wukong/LMS-1

ABSTRACT We present the first detailed chemical-abundance analysis of stars from the dwarf-galaxy stellar stream Wukong/LMS-1 covering a wide metallicity range ($-3.5 \lt \rm [Fe/H] \lesssim -1.3$). We find abundance patterns that are effectively indistinguishable from the bulk of Indus and Jhelum, a pair of smaller stellar streams proposed to be dynamically associated with Wukong/LMS-1. We confirmed a carbon-enhanced metal-poor star ($\rm [C/Fe] \gt +0.7$ and $\rm [Fe/H] \sim -2.9$) in Wukong/LMS-1 with strong enhancements in Sr, Y, and Zr, which is peculiar given its solar-level [Ba/Fe]. Wukong/LMS-1 stars have high abundances of α elements up to $\rm [Fe/H] \gtrsim -2$, which is expected for relatively massive dwarfs. Towards the high-metallicity end, Wukong/LMS-1 becomes α-poor, revealing that it probably experienced fairly standard chemical evolution. We identified a pair of N- and Na-rich stars in Wukong/LMS-1, reminiscent of multiple stellar populations in globular clusters. This indicates that this dwarf galaxy contained at least one globular cluster that was completely disrupted in addition to two intact ones previously known to be associated with Wukong/LMS-1, which is possibly connected to similar evidence found in Indus. From these ≥3 globular clusters, we estimate the total mass of Wukong/LMS-1 to be ${\approx }10^{10} \, \mathrm{M}_\odot$, representing ∼1 per cent of the present-day Milky Way. Finally, the [Eu/Mg] ratio in Wukong/LMS-1 continuously increases with metallicity, making this the first example of a dwarf galaxy where the production of r-process elements is clearly dominated by delayed sources, presumably neutron-star mergers.

Limberg, Guilherme (ORCID:0000000292698287)↗
DOE OSTI2021

Beyond Ohm's law: Bernoulli effect and streaming in electron hydrodynamics

Recent observations of nonlocal transport in ultraclean two-dimensional materials raised the tantalizing possibility of accessing hydrodynamic correlated transport of a many-electron state. However, it has been pointed out that nonlocal transport can also arise from impurity scattering rather than interaction. At the crux of the ambiguity is the focus on linear effects, i.e., Ohm's law, which cannot easily differentiate among different modes of transport. Furthermore we propose experiments that can reveal rich hydrodynamic features in the system by tapping into the nonlinearity of the Navier-Stokes equation. Three experiments we propose will each manifest a unique phenomenon that is well known in classical fluids: the Bernoulli effect, Eckart streaming, and Rayleigh streaming. Analysis of known parameters confirms that the proposed experiments are feasible and the hydrodynamic signatures are within reach of graphene-based devices. Experimental realization of any one of the three phenomena will provide a stepping stone to formulating and exploring the notions of nonlinear electron fluid dynamics with an eye to celebrated examples from classical nonlaminar flows, e.g., pattern formation and turbulence.

2-dimensional systems↗
DOE OSTI2024

An Active Learning-Based Streaming Pipeline for Reduced Data Training of Structure Finding Models in Neutron Diffractometry

Structure determination workloads in neutron diffractometry are computationally expensive and routinely require several hours to many days to determine the structure of a material from its neutron diffraction patterns. The potential for machine learning models trained on simulated neutron scattering patterns to significantly speed up these tasks have been reported recently. However, the amount of simulated data needed to train these models grows exponentially with the number of structural parameters to be predicted and poses a significant computational challenge. To overcome this challenge, we introduce a novel batch-mode active learning (AL) policy that uses uncertainty sampling to simulate training data drawn from a probability distribution that prefers labelled examples about which the model is least certain. We confirm its efficacy in training the same models with ∼ 75% less training data while improving the accuracy. We then discuss the design of an efficient stream-based training workflow that uses this AL policy and present a performance study on two heterogeneous platforms to demonstrate that, compared with a conventional training workflow, the streaming workflow delivers ∼ 20% shorter training time without any loss of accuracy.

Wang, Tianle [Brookhaven National Laboratory (BNL)↗
DOE OSTI2026

A Brief Survey of Data Streaming Technologies

Streaming data is data that is emitted at variable volumes in a continuous, incremental manner with the goal of low-latency processing often at a different physical location. Network infrastructure is used to facilitate the connection between data sources and sinks, and must be robust to handle the requirements of the workflow. The U.S. Department of Energy Office of Science (DOE SC) a federal agency supporting fundamental scientific research for energy and the Nation’s largest supporter of basic research in the physical sciences. DOE SC has the responsibility for operating $\mathbf{1 0}$ National Laboratories, and 28 scientific user facilities supporting advanced supercomputers, particle accelerators, large x-ray light sources, neutron scattering sources, and other specialized facilities for nanoscience and genomics. This paper investigates the state of streaming data workfows, and details some of the approaches to this challenging problem.

Kissel, Ezra↗
DOE OSTI2025

Surface Texture of Macroplastic Pollution in Streams Alters the Physical Structure and Diversity of Biofilm Communities

ABSTRACT Biofilms can develop on nearly any surface, and in aquatic ecosystems they are essential components of biogeochemical cycles and food webs. Plastic waste in waterways is a new type of surface for biofilm colonisation. To analyse the influence of plastic pollution on the development and diversity of microbial freshwater biofilms that colonised them, we incubated 388 cm 2 veneers of high‐density polyethylene (HDPE) with two veneer textures, smooth and rough, and tulip tree wood ( Liriodendron tulipifera ), in three rural headwater streams at the Savannah River Site (Aiken, SC, USA). We collected biofilms from veneers after 14, 28 and 56 days of incubation and analysed 16S rRNA genes and biofilm properties. We found that plastic negatively affected species richness of biofilms compared with wood, but that evenness was greatest on rough textured HDPE. Beta diversity was primarily influenced by stream site. Beta diversity differed more between wood and plastic veneers than with plastic surface texture and became more different over time. Wood had nine times more biomass than rough HDPE and 40 times more biomass than smooth HDPE. Given the projected increase of macroplastic pollution in aquatic ecosystems, our findings emphasise the need to further understand its effects on biofilm characteristics.

Lopez Avila, Fabiola [Odum School of Ecology Unive↗
DOE OSTI2020

Temperature drives local contributions to beta diversity in mountain streams: stochastic and deterministic processes

Community variation (i.e. beta diversity) in geographical coenoclines is of substantial interest in ecology, yet the elevational patterns in beta diversity are still understudied, and no general conclusions have been reached. Here, we explored local contributions to beta diversity (LCBD) of stream bacteria, diatoms and macroinvertebrates on mountainsides. Across all taxa, we revealed a general U-shaped LCBD-elevation relationships (LCBDer), suggesting higher uniqueness of community composition at the two ends of the elevational gradients. This pattern was confirmed by coenocline simulations based on observed communities, and supported by the dominance of species replacement in total beta diversity. Across mountains and taxonomic groups, temperature was the main environmental factor underlying elevational patterns in LCBD and its metric relatives, which were also mediated by local environmental variables. The observed magnitudes of U-shaped LCBDer across mountains and taxonomic groups were specifically related to the heterogeneity of stream morphology, and the mean annual temperature on each mountain. U-shaped LCBDer were strengthened by the occurrence of generalist species with large elevational ranges, while rare species had a lesser effect on the patterns. Raup-Crick beta diversity indicated that both stochastic and deterministic processes drove the community assembly, and the latter one was positively related to the magnitudes of LCBDer. Our synthesis across mountains and taxonomic groups clearly shows that there are consistent elevational patterns in LCBD among taxonomic groups, and that these patterns are explained by similar ecological mechanisms, producing a more complete picture in understanding and bridging the spatial variation in biodiversity under changing climate.

Wang, Jianjun↗
DOE OSTI2025

Selective chemical looping combustion of acetylene in ethylene-rich streams

Here, the requirement for C 2 H 2 concentrations below 2 parts per million (ppm) in gas streams for C 2 H 4 polymerization necessitates its semihydrogenation to C 2 H 4 . Here, we demonstrate selective chemical looping combustion of C 2 H 2 in C 2 H 4 -rich streams by Bi 2 O 3 as an alternative catalytic pathway to reduce C 2 H 2 concentration below 2 ppm. Bi 2 O 3 combusts C 2 H 2 with a first-order rate constant that is 3000 times greater than the rate constant for C 2 H 4 combustion. In successive redox cycles, the lattice O of Bi 2 O 3 can be fully replenished without discernible changes in local Bi coordination or C 2 H 2 combustion selectivity. Heterolytic activation of C–H bonds across Bi–O sites and the higher acidity of C 2 H 2 results in lower barriers for C 2 H 2 activation than C 2 H 4 , enabling selective catalytic hydrocarbon combustion leveraging differences in molecular deprotonation energies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Geochemistry and Multiomics Data Differentiate Streams in Pennsylvania Based on Unconventional Oil and Gas Activity

Unconventional oil and gas (UOG) extraction is increasing exponentially around the world, as new technological advances have provided cost-effective methods to extract hard-to-reach hydrocarbons. While UOG has increased the energy output of some countries, past research indicates potential impacts in nearby stream ecosystems as measured by geochemical and microbial markers. Here, we utilized a robust data set that combines 16S rRNA gene amplicon sequencing (DNA), metatranscriptomics (RNA), geochemistry, and trace element analyses to establish the impact of UOG activity in 21 sites in northern Pennsylvania. These data were also used to design predictive machine learning models to determine the UOG impact on streams. We identified multiple biomarkers of UOG activity and contributors of antimicrobial resistance within the order Burkholderiales. Furthermore, we identified expressed antimicrobial resistance genes, land coverage, geochemistry, and specific microbes as strong predictors of UOG status. Of the predictive models constructed (n = 30), 15 had accuracies higher than expected by chance and area under the curve values above 0.70. The supervised random forest models with the highest accuracy were constructed with 16S rRNA gene profiles, metatranscriptomics active microbial composition, metatranscriptomics active antimicrobial resistance genes, land coverage, and geochemistry (n = 23). The models identified the most important features within those data sets for classifying UOG status. These findings identified specific shifts in gene presence and expression, as well as geochemical measures, that can be used to build robust models to identify impacts of UOG development.

16S rRNA↗
DOE OSTI2025

Streaming Data in HPC Workflows Using ADIOS

The “IO Wall” problem, in which the gap between computation rate and data access rate grows continuously, poses significant problems to scientific workflows which have traditionally relied upon using the filesystem for intermediate storage between workflow stages. One way to avoid this problem in scientific workflows is to stream data directly from producers to consumers and avoiding storage entirely. However, the manner in which this is accomplished is key to both performance and usability. This paper presents the Sustainable Staging Transport, an approach which allows direct streaming between traditional file writers and readers with few application changes. SST is an ADIOS “engine”, accessible via standard ADIOS APIs, and because ADIOS allows engines to be chosen at run-time, many existing file-oriented ADIOS workflows can utilize SST for direct application-to-application communication without any source code changes. This paper describes the design of SST and presents performance results from various applications that use SST, for feeding model training with simulation data with substantially higher bandwidth than the theoretical limits of Frontier’s file system, for strong coupling of separately developed applications for multiphysics multiscale simulation, or for in situ analysis and visualization of data to complete all data processing shortly after the simulation finishes.

Podhorszki, Norbert [ORNL] (ORCID:000000019647542X↗
DOE OSTI2022

R-Stream

R-Stream version 3.21.3, including its TensorFlow front-end (TFRCC) and LLVM 9 front-end. This version includes the features developed in the Portacy Phase II contract. R-Stream is a source-to-source automatic parallelization engine. For usage, please refer to the manuals (In particular, user guide and release notes) available in the package.

Meister, Benoit [Reservoir Labs, Inc., Portland, O↗
DOE OSTI2024

Arroyo Stream Processing Toolset (arroyopy) v0.1.0

Processing event or streaming data presents several technological challenges. A variety of technologies are often used by scientific user facilities. ZMQ is used to stream data and messages in a peer-to-peer fashion. Message brokers like Kafka, Redis Pubsub, EPICS PVA and RabbitMQ are often employed to route and pass messages from instruments to processing workflows. Arroyopy provides an API and structure to flexibly integrate with these tools and incorporate arbitrarily complex processing workflows, letting the hooks to the workflow code be independent of the connection code and hence reusable at a variety of instruments.

Chavez Esparza, Tanny Andrea [Lawrence Berkeley Na↗
DOE OSTI2020

Two-Stream Multi-Channel Convolutional Neural Network for Multi-Lane Traffic Speed Prediction Considering Traffic Volume Impact

Traffic speed prediction is a critically important component of intelligent transportation systems. Recently, with the rapid development of deep learning and transportation data science, a growing body of new traffic speed prediction models have been designed that achieved high accuracy and large-scale prediction. However, existing studies have two major limitations. First, they predict aggregated traffic speed rather than lane-level traffic speed; second, most studies ignore the impact of other traffic flow parameters in speed prediction. To address these issues, the authors propose a two-stream multi-channel convolutional neural network (TM-CNN) model for multi-lane traffic speed prediction considering traffic volume impact. In this model, the authors first introduce a new data conversion method that converts raw traffic speed data and volume data into spatial–temporal multi-channel matrices. Then the authors carefully design a two-stream deep neural network to effectively learn the features and correlations between individual lanes, in the spatial–temporal dimensions, and between speed and volume. Accordingly, a new loss function that considers the volume impact in speed prediction is developed. A case study using 1-year data validates the TM-CNN model and demonstrates its superiority. This paper contributes to two research areas: (1) traffic speed prediction, and (2) multi-lane traffic flow study.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Variable wildfire impacts on the seasonal water temperatures of western US streams: A retrospective study

Recent increases in the burn area and severity of wildfires in the western US have raised concerns about the impact on stream water temperature–a key determinant of cold-water fish habitats. However, the effect on seasonal water temperatures of concern, including winter and summer, are not fully understood. In this study, we assessed the impact of wildfire burns at Boulder Creek (Oregon), Elk Creek (Oregon), and Gibbon River (Wyoming) watersheds on the downstream winter and summer water temperatures for the first three post-fire years. To obtain results independent of the choice of the analytical method, we evaluated the consequence of each burn using three different statistical approaches that utilize local water temperature data. Our results from the three approaches indicated that the response of water temperatures to wildfire burns varied across seasons and sites. Wildfire burns were associated with a median increase of up to 0.56°C (Standard Error; S.E. < 0.23°C) in the summer mean water temperatures (MWT) and 62 degree-day Celsius (DDC; S.E. < 20.7 DDC) in the summer accumulated degree days (ADD) for the three subsequent years across studied stream sites. Interestingly, these burns also corresponded to a median decrease of up to 0.49°C (S.E. < 0.45°C) in the winter MWT and 39 DDC (S.E. < 40.5 DDC) in the winter ADD for the same period across sites. Wildfire effects on the downstream water temperatures diminished with increasing site distance from the burn perimeter. Our analyses demonstrated that analytical methods that utilize local watershed data could be applied to evaluate fire effects on downstream water temperatures.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Nitrate, ammonium, and DON mass time series output for East River stream, vadose zone and groundwater subwatersheds from HAN-SoMo model

There is a growing understanding of the role that bedrock weathering can play as a source of nitrogen (N) to soils, groundwater and river systems. The significance is particularly apparent in mountainous environments where weathering fluxes can be large. However, our understanding of the relative contributions of rock-derived, or geogenic, N to the total N supply of mountainous watersheds remains poorly understood. This dataset contains model output from the High-Altitude Nitrogen Suite of Models (HAN-SoMo), a watershed-scale ensemble of process-based models to quantify the relative sources, transformations, and sinks of geogenic and atmospheric N through a mountain watershed. Our study is based in the East River Watershed (ERW) in the Upper Colorado River Basin. The East River is a near-pristine headwater watershed underlain primarily by an N-rich Mancos Shale bedrock, enabling the timing and magnitude of geogenic and atmospheric contributions to watershed scale dissolved N-exports to be quantified. Six calibration scenarios were developed to explore equifinality using >1600 N concentration measurements from streams, groundwater, and vadose zone samples collected over the course of four years across the watershed, from 2014-2018. The files in this dataset are named according to which calibration scenario they represent (1, 2, 3, NM1, NM2, and NC), and include daily time series model output of nitrate, ammonium and dissolved organic nitrogen concentrations for all six calibration scenarios described in Maavara et al., 2021, "Modeling geogenic and atmospheric nitrogen through the East River Watershed, Colorado Rocky Mountains," PLOS One (in press), for the stream, vadose zone, and groundwater in the five discretized subwatersheds: Rustlers Gulch, Copper Creek, East above Quigley (EAQ), the Middle East River (ME), and Lower Triangle (LT) from Gothic to the Pumphouse. The READ_ME.txt file includes details on units and naming conventions in each of these files. Model files are in .mat format, to be opened in MATLAB.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Model data for numerical evaluation of photosensitive tracers as a strategy for separating surface and subsurface transient storage in streams

This model-data archive pertains to a study aimed at the numerical evaluation of the photosensitive tracers as a potential strategy for separating the effects of surface and hyporheic storage zones (SSZs and HSZs, respectively). Separating effects of SSZ and HSZ are important for accurately representing stream function as HSZs and SSZs expose solutes to significantly different biogeochemical conditions. We perform numerical experiments using a multiscale reactive transport model for stream corridors implemented in ATS code, which allows for representing multiple storage zones with their respective travel time distributions and biogeochemistry. For each of the numerical experiment, we provide in this model-data archive python wrapper to drive ATS (forward_model.py), synthetic observation (synthetic_btc.py, BTC_observed.csv), forward model files including ATS input (multiscale_transport.tpl), PFLOTRAN inputs (reactions_channel.tpl, reactions_hz.tpl, reactions_sz.tpl), MCMC (mcmc_run.py), predictive uncertainty (pred_uncert.py, BTCs_simulated_day.csv, BTCs_simulated_night.csv), MCMC outputs (tracer_test_GR.npy, tracer_test_logps.npy, tracer_test_parameters.npy) and Jupyter notebook for post-processing and visualization (post-processing.ipynb). For the denitrification application, ATS input file (denitrification_multisubgrid.tpl), PFLOTRAN input files (denitrification_channel.in, denitrification_hz.in), predictive uncertainty (pred_uncert_denitrification.py, BTCs_simulated_DO.csv, BTCs_simulated_DOC.csv, BTCs_simulated_Nitrate.csv).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Solute chemistry for streams draining geomorphic features and varying land cover gradients in the East River watershed, Colorado

This dataset contains solute chemistry data and GPS coordinates for surface water samples collected in the East River watershed in the Elk and West Elk Ranges of Colorado from August 3rd through August 11th, 2022. Samples were collected from streams and groundwater seeps as part of a comprehensive analysis within the watershed of how different geomorphic features (such as landslides and rock glaciers) along with variations in land cover (such as the presence of vegetation) affect stream water quality in this Rocky Mountain headwater environment. This dataset includes concentrations of the following in a single csv file: fluoride, chloride, sulfate, nitrate, calcium, potassium, magnesium, sodium, silicon, and total organic carbon (TOC). All concentrations are reported in mg/L. The sulfate data in this version have been updated to account for an earlier ion chromatograph instrument method error whereby sulfate and bromide peaks overlapped in calibration solution samples, biasing calculated sulfate concentrations low by 30-50%. Sulfate data reported herein are from a re-run of the samples performed in December 2024 using a corrected instrument method. All samples were stored under refrigerated conditions and filtered on initial collection.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Seismology in the Cloud: A New Streaming Workflow

Data-intensive research in seismology is experiencing a recent boom, driven in part by large volumes of available data and advances in the growing field of data science. However, there are significant barriers to processing large data volumes, such as long retrieval times from data repositories, complex data management, and limited computational resources. New tools and platforms have reduced the barriers to entry for scientific cluster computing, including the maturation of the commercial cloud as an accessible instrument for research. Here, we build a customized research cluster in the cloud to test a new workflow for large-scale seismic analysis, in which data are processed as a stream (retrieved on-the-fly and acted upon without storing), with data from the Incorporated Research Institutions for Seismology Data Management Center. We use this workflow to deploy a spectral peak detection algorithm over 5.6 TB of compressed continuous seismic data from 2074 stations of the USArray Transportable Array EarthScope network. Using a 50-node cluster in the cloud, we completed the noise survey in 80 hr, with an average data throughput of 1.7 GB per minute. By varying cluster sizes, we find the scaling of our analysis to be sublinear, due to a combination of algorithmic limitations and data center response times. The cloud-based streaming workflow represents an order-of-magnitude increase in acquisition and processing speed compared to a traditional download-store-process workflow, and offers the additional benefits of employing a flexible, accessible, and widely used computing architecture. It is limited, however, due to its reliance on Internet transfer speeds and data center service capacity, and may not work well for repeated analyses or those for which even higher data throughputs are needed. These research applications will require a new class of cloud-native approaches in which both data and analysis are in the cloud.

58 GEOSCIENCES↗