Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “consistent stream ordering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Virtual Log-Structured Storage for High-Performance Streaming

Over the past decade, given the higher number of data sources (e.g., Cloud applications, Internet of things) and critical business demands, Big Data transitioned from batch-oriented to real-time analytics. Stream storage systems, such as Apache Kafka, are well known for their increasing role in real-time Big Data analytics. For scalable stream data ingestion and processing, they logically split a data stream topic into multiple partitions. Stream storage systems keep multiple data stream copies to protect against data loss while implementing a stream partition as a replicated log. This architectural choice enables simplified development while trading cluster size with performance and the number of streams optimally managed. This paper introduces a shared virtual log-structured storage approach for improving the cluster throughput when multiple producers and consumers write and consume in parallel data streams. Stream partitions are associated with shared replicated virtual logs transparently to the user, effectively separating the implementation of stream partitioning (and data ordering) from data replication (and durability). We implement the virtual log technique in the KerA stream storage system. When comparing with Apache Kafka, KerA improves the cluster ingestion throughput by up to 4x when multiple producers write over hundreds of data streams.

consistent stream ordering↗

Spatiotemporal Variability in Transport and Reactive Processes Across a First- to Fifth-Order Fluvial Network

Fluvial networks integrate and transport constituents from terrestrial and aquatic ecosystems. To date, most research on water quality dynamics has focused on process understanding at individual streams and, as a result, there is a lack of studies analyzing how small-scale, physical and biogeochemical drivers scale across fluvial networks. We performed tracer tests in five stream orders of the Jemez River continuum in New Mexico, USA, to quantify reach-scale hyporheic exchange during two different seasonal periods to address: how do hyporheic zone contributions to riverine processing change with space and time? And does the spatiotemporal variability of hyporheic exchange scale across fluvial networks? Combining conservative (i.e., bromide) and reactive (i.e., resazurin) tracer analyses with solute transport modeling, we found a dominance of reaction-limited transport conditions in space (for all stream orders) and time (two contrasting flow regimes). Moreover, we found a trend toward more reaction-limited conditions with increasing discharge across all stream orders. While our studied fluvial network did not consistently follow the expectations of decreasing hyporheic exchange contributions with increasing stream order, as it has been previously suggested from modeling studies, we found that processing rate coefficients and Damköhler numbers consistently decreased along the continuum with increasing discharge. Our findings suggest that knowledge transferability of hyporheic zone processing along fluvial networks may be possible if the scaling patterns that we found hold true in other catchments. Thus, more research on scaling patterns along fluvial networks is highly needed.

Gootman, Kaylyn S.↗

Classification of the Z-Pinch Waste Stream as Low-Level Waste for Disposal

The purpose of this document is to describe the waste stream from Z-Pinch Residual Waste Project that due to worker safety concerns and operational efficiency is a candidate for blending Transuranic and low level waste together and can be safely packaged as low-level waste consistent with DOE Order 435.1 requirements and NRC guidance 10 CFR 61.42. This waste stream consists of the Pu-ICE post-shot containment systems, including plutonium targets, generated from the Z Machine experiments requested by LANL and conducted by SNL/NM. In the past, this TRU waste was shipped back to LANL after Sandia sends the TRU data package to LANL to certify the characterization (by CCP), transport and disposition at WIPP (CBFO) per LANL MOU-0066. The Low Level Waste is managed, characterized, shipped and disposed of at NNSS by SNL/NM per Sandia MOU # 11-S-560.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

The Helmholtz Hierarchy: phase space statistics of cold dark matter

We present a new formalism to study large-scale structure in the universe. The result is a hierarchy (which we call the ''Helmholtz Hierarchy'') of equations describing the phase space statistics of cold dark matter (CDM). The hierarchy features a physical ordering parameter which interpolates between the Zel'dovich approximation and fully-fledged gravitational interactions. The results incorporate the effects of stream crossing. We show that the Helmholtz hierarchy is self-consistent and obeys causality to all orders. We present an interpretation of the hierarchy in terms of effective particle trajectories.

79 ASTRONOMY AND ASTROPHYSICS↗

Application Crash Consistency and Performance with CCFS

Recent research has shown that applications often incorrectly implement crash consistency. In this paper, we present the Crash-Consistent File System (ccfs), a file system that improves the correctness of application-level crash consistency protocols while maintaining high performance. A key idea in ccfs is the abstraction of a stream. Within a stream, updates are committed in program order, improving correctness; across streams, there are no ordering restrictions, enabling scheduling flexibility and high performance. We empirically demonstrate that applications running atop ccfs achieve high levels of crash consistency. Further, we show that ccfs performance under standard file-system benchmarks is excellent, in the worst case on par with the highest performing modes of Linux ext4, and in some cases notably better. Finally, overall, we demonstrate that both application correctness and high performance can be realized in a modern file system.

97 MATHEMATICS AND COMPUTING↗

Application-based QoE support with P4 and OpenFlow

Although Software-Defined Wide Area Networks (SD-WANs) are now widely deployed in several production networks, they are largely restricted to traffic engineering approaches based on layer 4 (L4) of the network protocol stack that result in improved Quality-of-Service (QoS) of the network overall without necessarily focusing on a specific application. However, the emergence of application protocols such as QUIC and HTTP/2 needs an investigation of layer 5-based (L5) approaches in order to improve users’ Quality-of-Experience (QoE). In this paper, we leverage the capabilities of flexible, P4-based switches that incorporate protocol-independent packet processing in order to intelligently route traffic based on application headers. We use Adaptive Bit Rate (ABR) video streaming as an example to show how such an approach can not only provide flexible traffic management but also improve application QoE. Our evaluation consists of an actual deployment in a research testbed, Chameleon, where we leverage the benefits of fast paths in order to retransmit video segments in higher qualities. Further, we analyze real-world ABR streaming sessions from a large-scale CDN and show that our approach can successfully maximize QoE for all users in the dataset.

Bhat, Divyashri↗

Investigation of a Hybrid Carbon Capture System at a NGCC Power Plant That Performs Direct Air Capture During Off-Peak Hours

The goal of this project was to investigate the feasibility of coupling NGCC power plants with membrane and solid sorbent carbon capture to achieve net negative carbon emissions. This novel hybrid system has a couple of potential benefits: 1) the carbon capture systems could help the NGCC plant by minimizing its carbon footprint and giving it a new revenue stream from direct air capture, and 2) the NGCC plant could help direct air capture scale up quickly and costeffectively by providing it with electricity, steam and compressed air streams. In order to investigate this hybrid design, we developed a complex, integrated system model consisting of: 1) a NGCC power plant model developed by Dr. Bhattacharyya’s team at WVU, 2) a membrane carbon capture model developed by Dr. Lipscomb’s team at U Toledo, and 3) a solid sorbent carbon capture model developed by Dr. Hornbostel’s team at U Pittsburgh. Mr. Matuszewski’s team at AristoSys LLC integrated these three models into a single, integrated model using FOQUS, an optimization tool developed by the NETL CCSI 2 program. Optimizations were then performed on this integrated model to determine the cost and carbon capture rates under a range of electricity and carbon price scenarios.

20 FOSSIL-FUELED POWER PLANTS↗

CONUS-wide Projected Flood Frequency and Uncertainty Estimates, Version 1.0

This dataset presents a large-ensemble of CONUS-wide projected flood frequency and uncertainty estimates across ~2.7 million NHDPlusV2 river reaches over the CONUS. The framework producing this dataset leverages a multi-model, uncertainty-aware modeling framework that allows evaluating shifts in flood frequences at the stream reach level across the CONUS. CONUS-wide ensemble streamflow projections generated from hydrologic simulations driven by downscaled and bias-corrected Coupled Model Intercomparison Project Phase 6 (CMIP6) outputs are used to derive these flood frequency and uncertainty estimates over the period 1980 - 2099. A spatially consistent regional L-moment algorithm is applied across clusters defined by the US Hydrologic Unit Code Subregions (HUC4s and HUC8s) and NHDPlusV2 stream orders to estimate flood frequencies. The dataset also includes at-site based flood estimates that allow for the comparison between local and regional approach-based estimates, assess projected changes, and characterize their uncertainties. For more reliable estimation of rare flood frequencies such as 500 and 1000-year return periods, super-ensemble based estimates are also included in the dataset. This dataset is derived to support the "Impact-Informed Dam Safety Risk Assessment for Securing Hydropower Assests" project for the US Department of Energy (DOE) Hydropower and Hydrokinetic Office (H2O). For further details, refer to Kao et al. (2022), Ghimire et al. (2023), Ghimire et al. (2025), and Hosking and Wallis (1997).

Ghimire, Ganesh [ORNL] (ORCID:0000000242843941)↗

Predicting fine-scale distributions of peripheral aquatic species in headwater streams

Headwater species and peripheral populations that occupy habitat at the edge of a species range may hold an increased conservation value to managers due to their potential to maximize intraspecies diversity and species' adaptive capabilities in the context of rapid environmental change. The southern Appalachian Mountains are the southern extent of the geographic range of native Salvelinus fontinalis and naturalized Oncorhynchus mykiss and Salmo trutta in eastern North America. In this paper, we predicted distributions of these peripheral, headwater wild trout populations at a fine scale to serve as a planning and management tool for resource managers to maximize resistance and resilience of these populations in the face of anthropogenic stressors. We developed correlative logistic regression models to predict occurrence of brook trout, rainbow trout, and brown trout for every interconfluence stream reach in the study area. A stream network was generated to capture a more consistent representation of headwater streams. Each of the final models had four significant metrics in common: stream order, fragmentation, precipitation, and land cover. Strahler stream order was found to be the most influential variable in two of the three final models and the second most influential variable in the other model. Greater than 70% presence accuracy was achieved for all three models. The underrepresentation of headwater streams in commonly used hydrography datasets is an important consideration that warrants close examination when forecasting headwater species distributions and range estimates. Finally and additionally, it appears that a relative watershed position metric (e.g., stream order) is an important surrogate variable (even when elevation is included) for biotic interactions across the landscape in areas where headwater species distributions are influenced by topographical gradients.

59 BASIC BIOLOGICAL SCIENCES↗

AmeriFlux US-OPE Optimizing Production Inputs for Economic and Environmental Enhancement (OPE3)

This is the AmeriFlux version of the carbon flux data for the site US-OPE Optimizing Production Inputs for Economic and Environmental Enhancement (OPE3). Site Description - The Optimizing Production Inputs for Economic and Environmental Enhancement (OPE3) site is located at the Beltsville Agricultural Research Center in Prince George's County, MD, and consists of a 22-ha production field, with an adjacent riparian wetland and first-order stream. Scientists from several U.S. Federal agencies, universities (foreign and domestic), and private industry have conducted multidisciplinary research at this location since 1998.

Alfieri, Joe↗

AmeriFlux FLUXNET-1F US-OPE Optimizing Production Inputs for Economic and Environmental Enhancement (OPE3)

This is the AmeriFlux Management Project (AMP) created FLUXNET-1F version of the carbon flux data for the site US-OPE Optimizing Production Inputs for Economic and Environmental Enhancement (OPE3). This is the FLUXNET version of the carbon flux data for the site US-OPE Optimizing Production Inputs for Economic and Environmental Enhancement (OPE3) produced by applying the standard ONEFlux (1F) software. Site Description - The Optimizing Production Inputs for Economic and Environmental Enhancement (OPE3) site is located at the Beltsville Agricultural Research Center in Prince George's County, MD, and consists of a 22-ha production field, with an adjacent riparian wetland and first-order stream. Scientists from several U.S. Federal agencies, universities (foreign and domestic), and private industry have conducted multidisciplinary research at this location since 1998.

Alfieri, Joe [USDA-ARS Hydrology and Remote Sensin↗

Higher order solutions to ion-acoustic solitons in a weakly relativistic two-fluid plasma

The nonlinear wave structure of small amplitude ion-acoustic solitary waves (IASs) is investigated in a two-fluid plasma consisting of weakly relativistic streaming ions and electrons. Using the reductive perturbation theory, the basic set of governing equations is reduced to the Korteweg-de Vries (KdV) equation for the lowest order perturbation. This analysis is further extended using the renormalization technique for the inclusion of higher order nonlinear and dispersive effects for better accuracy. The effect of higher order correction and various parameters on the soliton characteristics is investigated and also discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DUST CAPTURE AND LONG-LIVED DENSITY ENHANCEMENTS TRIGGERED BY VORTICES IN 2D PROTOPLANETARY DISKS

We study dust capture by vortices and its long-term consequences in global two-fluid inviscid disk simulations using a new polar grid code RoSSBi. We perform the longest integrations so far, several hundred disk orbits, at the highest resolution attainable in global disk simulations with dust, namely, 2048 × 4096 grid points. We vary a wide range of dust parameters, most notably the initial dust-to-gas ratio ϵ varies in the range of 10{sup −4}–10{sup −2}. Irrespective of the value of ϵ , we find rapid concentration of the dust inside vortices, reaching dust-to-gas ratios of the order of unity inside the vortex. We present an analytical model that describes this dust capture process very well, finding consistent results for all dust parameters. A vortex streaming instability develops, which invariably causes vortex destruction. After vortex dissipation large-scale dust rings encompassing a disk annulus form in most cases, which sustain very high dust concentration, approaching ratios of the order of unity; they persist as long as the duration of the simulations. They are sustained by a streaming instability, which manifests itself in high-density dust clumps at various scales. When vortices are particularly long-lived, rings do not form but dust clumps inside vortices can survive a long time and would likely undergo collapse by gravitational instability. Rings encompass almost an Earth mass of solid material, while even larger masses of dust do accumulate inside vortices in the earlier stage. We argue that rapid planetesimal formation would occur in the dust clumps inside the vortices as well as in the post-vortex rings.

79 ASTRONOMY AND ASTROPHYSICS↗

The influence of burn severity on dissolved organic carbon concentrations across a stream network differs based on seasonal wetness conditions

Large, high-severity wildfires in many regions across the globe have increased concerns about their impacts on carbon cycling in watersheds. Altered sources of carbon and changes in catchment hydrology after wildfire can lead to shifts in dissolved organic carbon (DOC) concentrations in streams, which can have negative impacts on aquatic ecosystem health and downstream drinking-water treatment. Despite its importance, post-fire DOC responses remain relatively unconstrained in the literature, and we lack critical knowledge of how burn severity, landscape elements, and climate interact to affect DOC concentrations. To improve our understanding of the impact of burn severity on DOC concentrations, we measured DOC at 129 sites across a stream network extending upstream, within, and downstream of a large, high-severity wildfire in Oregon, USA. We collected samples across the study sub-basin during four distinct seasonal wetness conditions. We used our high-spatial-resolution data to develop spatial stream network (SSN) models to predict DOC across the stream network and to improve our understanding of the controls on DOC concentrations. Spatially, we found no obvious wildfire signal – instead, we observed a pattern of increasing DOC concentrations from the high-elevation headwaters to the sub-basin outlet, while the mainstem maintained consistently low DOC concentrations. This suggests that effects from large wildfires may be “averaged” out at higher stream orders and larger spatial scales. When we grouped DOC concentrations by burn severity group, we observed a significant decrease in the variability of DOC concentrations in the moderate and high burn severity sub-catchments. However, our SSN models were able to predict decreases in DOC concentrations with increases in burn severity across the stream network. Decreases in DOC concentrations were also highly variable across seasonal wetness conditions, with the greatest (–1.40 to –1.64 mg L –1 ) decrease occurring in the high-severity group during the wetting season. Additionally, our models indicated that in all seasons, baseflow index was more influential in predicting DOC concentrations than burn severity was, indicating that groundwater discharge can obscure the impacts of wildfire in a stream network. Overall, our results suggested that landscape characteristics can regulate the DOC response to wildfire. Moreover, our results also indicated that the seasonal timing of sampling can influence the observed response of DOC concentrations to wildfire.

54 ENVIRONMENTAL SCIENCES↗

Qubit lattice algorithm simulations of the scattering of a bounded two dimensional electromagnetic pulse from an infinite planar dielectric interface

Qubit lattice algorithm (QLA) simulations are performed for a two-dimensional spatially bounded pulse propagating onto a plane interface between two dielectric slabs. QLA is an initial value scheme that consists of a sequence of unitary collision and streaming operators, with appropriate potential operators, that recover Maxwell equations in inhomogeneous dielectric media to the second order in the lattice discreteness. For the case of total internal reflection, there is transient energy transfer into the second medium due to the evanescent fields as the Poynting unit vector of the pulse is rotated from its incident to reflected direction. Because of the finite spatial extent of the pulse, a self-consistent Goos–Hanchen-type displacement along the interface is found without imposing any explicit interface boundary conditions on the fields. For normal incidence, the standard Fresnel coefficients are recovered for appropriately averaged QLA fields. Energy is conserved at all times to seven significant figures.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Machine learning moment closure models for the radiative transfer equation I: Directly learning a gradient based closure

In this paper, we take a data-driven approach and apply machine learning to the moment closure problem for the radiative transfer equation in slab geometry. Instead of learning the unclosed high order moment, we propose to directly learn the gradient of the high order moment using neural networks. This new approach is consistent with the exact closure we derive for the free streaming limit and also provides a natural output normalization. Finally, a variety of benchmark tests, including the variable scattering problem, the Gaussian source problem with both periodic and reflecting boundaries, and the two-material problem, show both good accuracy and generalizability of our machine learning closure model.

Computer science↗

Consistent Controls on Trace Metal Micronutrient Speciation in Wetland Soils and Stream Sediments

Trace metal are essential for microbially-mediated biogeochemical processes occurring in anoxic wetland soils and stream bed sediments, but low availability of these elements may inhibit anaerobic element cycling and transformations. Solid-phase speciation is likely a critical control on trace metal availability but has seen limited study in anoxic systems having concentrations similar to geological background levels, where metal limitations may be most prevalent. We have investigated trace metal concentrations and solid-phase speciation in three freshwater subsurface aquatic systems: marsh wetland soils, riparian wetland soils, and the sediments of a streambed. These systems displayed low solid-phase trace metal concentrations, generally at or below geological background levels, which generally followed the trend Zn > Cu ≈ Ni > Co and showed no correlation with major element compositions. All soils and sediments were dominated by quartz but varied in clay mineralogy as well as the organic matter, total sulfur, and total iron contents. X-ray absorption near-edge structure (XANES) spectroscopy shows that sulfur speciation in both wetlands is dominated by organic sulfur. Elemental sulfur and iron sulfides together made up <25% of the sulfur in the wetland soils, but the distribution between inorganic and organic forms was reversed in the stream sediments. Ferrous and ferric iron in clay minerals were common species identified by both XANES and extended X-ray absorption fine structure (EXAFS) spectroscopies at all sites. Iron(III) oxides were substantial components in all but the marsh wetland soils. Quantitative analysis of copper, nickel, and zinc XANES spectra revealed similar metal speciation across all sites. Copper speciation was dominated by sulfides, adsorbed species, and minor amounts of copper bound to organic matter; no metallic copper was detected. Nickel speciation also varied little and was dominated by nickel in clay mineral octahedral sheets and nickel sulfide, with adsorbed species also present. Zinc speciation was slightly more varied, with the marsh wetland soils and stream bed sediments containing adsorbed species, zinc associated with clay mineral structures, and zinc bound to reduced sulfur groups on organic matter, whereas the riparian wetland soils lacked clay-associated zinc but contained zinc sulfide. Trace metals bound to reduced sulfur occurred at every site, with a greater sulfur-bound fraction for copper. The fractional abundance of sulfur-bound species showed no relationship with soil or sediment total sulfur content, which varied by two orders of magnitude. More broadly, the observations in this study suggest that trace metal speciation in freshwater wetland soils and stream sediments is consistently dominated by a small set of recurring components which are distinct for each metal. Furthermore, this may represent a general geochemical phenomenon in anoxic soils and sediments containing trace metals at background concentrations (as low as 3 µg g -1 ) that was not predicted from systems that are contaminated with or naturally-enriched in copper, nickel, or zinc.

54 ENVIRONMENTAL SCIENCES↗

COSMIC-RAY-INDUCED FILAMENTATION INSTABILITY IN COLLISIONLESS SHOCKS

We used unprecedentedly large two-dimensional and three-dimensional hybrid (kinetic ions-fluid electrons) simulations of non-relativistic collisionless strong shocks in order to investigate the effects of self-consistently accelerated ions on the overall shock dynamics. The current driven by suprathermal particles streaming ahead of the shock excites modes transverse to the background magnetic field. The Lorentz force induced by these self-amplified fields tends to excavate tubular, underdense, magnetic-field-depleted cavities that are advected with the fluid and perturb the shock surface, triggering downstream turbulent motions. These motions further amplify the magnetic field, up to factors of 50-100 in knot-like structures. Once downstream, the cavities tend to be filled by hot plasma plumes that compress and stretch the magnetic fields in elongated filaments; this effect is particularly evident if the shock propagates parallel to the background field. Highly magnetized knots and filaments may provide explanations for the rapid X-ray variability observed in RX J1713.7-3946 and for the regular pattern of X-ray bright stripes detected in Tycho's supernova remnant.

79 ASTRONOMY AND ASTROPHYSICS↗