Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “consistent stream ordering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Virtual Log-Structured Storage for High-Performance Streaming

Over the past decade, given the higher number of data sources (e.g., Cloud applications, Internet of things) and critical business demands, Big Data transitioned from batch-oriented to real-time analytics. Stream storage systems, such as Apache Kafka, are well known for their increasing role in real-time Big Data analytics. For scalable stream data ingestion and processing, they logically split a data stream topic into multiple partitions. Stream storage systems keep multiple data stream copies to protect against data loss while implementing a stream partition as a replicated log. This architectural choice enables simplified development while trading cluster size with performance and the number of streams optimally managed. This paper introduces a shared virtual log-structured storage approach for improving the cluster throughput when multiple producers and consumers write and consume in parallel data streams. Stream partitions are associated with shared replicated virtual logs transparently to the user, effectively separating the implementation of stream partitioning (and data ordering) from data replication (and durability). We implement the virtual log technique in the KerA stream storage system. When comparing with Apache Kafka, KerA improves the cluster ingestion throughput by up to 4x when multiple producers write over hundreds of data streams.

consistent stream ordering↗

An evaluation of Landsat 3 RBV imagery for an area of complex terrain in Southern Italy

Return Beam Videcon imagery from Landsat 3 was obtained in August, 1978 for part of Southern Italy in the regions of Basilicata and Apulia. The resolution of this imagery for medium contrast objects is approximately 40 meters and is shown to provide significant information concerning land cover and fluvial morphometry. Because of the wide spectral band width which is sensed (0.505-0.750 microns) by the RBV cameras, discrimination is only possible for spectrally distinct cover types, especially oak woodland. Fluvial morphometry can be readily described using the imagery. Because of the intense dissection of the area, the lowest order streams cannot be consistently mapped, but the rank order of the measured values of properties such as drainage density and link frequency for different lithologies corresponds closely to the actual ranking.

Townshend, J. R. G.↗

Online Access to Weather Satellite Imagery Through the World Wide Web

Both global area coverage (GAC) and high-resolution picture transmission (HRTP) data from the Advanced Very High Resolution Radiometer (AVHRR) are made available to laternet users through an online data access system. Older GOES-7 data am also available. Created as a "testbed" data system for NASA's future Earth Observing System Data and Information System (EOSDIS), this testbed provides an opportunity to test both the technical requirements of an onune'd;ta system and the different ways in which the -general user, community would employ such a system. Initiated in December 1991, the basic data system experienced five major evolutionary changes In response to user requests and requirements. Features added with these changes were the addition of online browse, user subsetting, dynamic image Processing/navigation, a stand-alone data storage system, and movement,from an X-windows graphical user Interface (GUI) to a World Wide Web (WWW) interface. Over Its lifetime, the system has had as many as 2500 registered users. The system on the WWW has had over 2500 hits since October 1995. Many of these hits are by casual users that only take the GIF images directly from the interface screens and do not specifically order digital data. Still, there b a consistent stream of users ordering the navigated image data and related products (maps and so forth). We have recently added a real-time, seven- day, northwestern United States normalized difference vegetation index (NDVI) composite that has generated considerable Interest. Index Terms-Data system, earth science, online access, satellite data.

Emery, W.↗

Spatiotemporal Variability in Transport and Reactive Processes Across a First- to Fifth-Order Fluvial Network

Fluvial networks integrate and transport constituents from terrestrial and aquatic ecosystems. To date, most research on water quality dynamics has focused on process understanding at individual streams and, as a result, there is a lack of studies analyzing how small-scale, physical and biogeochemical drivers scale across fluvial networks. We performed tracer tests in five stream orders of the Jemez River continuum in New Mexico, USA, to quantify reach-scale hyporheic exchange during two different seasonal periods to address: how do hyporheic zone contributions to riverine processing change with space and time? And does the spatiotemporal variability of hyporheic exchange scale across fluvial networks? Combining conservative (i.e., bromide) and reactive (i.e., resazurin) tracer analyses with solute transport modeling, we found a dominance of reaction-limited transport conditions in space (for all stream orders) and time (two contrasting flow regimes). Moreover, we found a trend toward more reaction-limited conditions with increasing discharge across all stream orders. While our studied fluvial network did not consistently follow the expectations of decreasing hyporheic exchange contributions with increasing stream order, as it has been previously suggested from modeling studies, we found that processing rate coefficients and Damköhler numbers consistently decreased along the continuum with increasing discharge. Our findings suggest that knowledge transferability of hyporheic zone processing along fluvial networks may be possible if the scaling patterns that we found hold true in other catchments. Thus, more research on scaling patterns along fluvial networks is highly needed.

Gootman, Kaylyn S.↗

Photointerpretation of Skylab photography

The author has identified the following significant results. In terms of film grain texture and object definition, the S190B color positive film is distinctly superior to the S190A films, when both are compared in the 9 x 9 inch format. Within the six S190A films, the panchromatic black and white films are superior to the infrared black and white, and the color positive film is superior to the color infrared. Minimum relief differences on the order of 500 to 100 feet could be detected by stereoscopic study, however, it is not possible to determine to what extent vegetation and cultural practices assist in such delineations. Water and wind gaps through major ridges were easily seen. Streams of third order and larger were clearly visible and easy to trace; second order streams were not identified with consistency. Differences in color, tone, and textural patterns rarely supplied clues for differentiating soils or bedrock. The separation of naturally forested areas from areas of cultivation and pasture was effective and a valuable clue to the underlying geology. Suburban and industrial developments were clearly differentiated from urban areas and surrounding agricultural fields. Soil associations could be identified on a regional basis, but no sharp boundary could be drawn separating soil associations.

Mcmurtry, G. J.↗

Classification of the Z-Pinch Waste Stream as Low-Level Waste for Disposal

The purpose of this document is to describe the waste stream from Z-Pinch Residual Waste Project that due to worker safety concerns and operational efficiency is a candidate for blending Transuranic and low level waste together and can be safely packaged as low-level waste consistent with DOE Order 435.1 requirements and NRC guidance 10 CFR 61.42. This waste stream consists of the Pu-ICE post-shot containment systems, including plutonium targets, generated from the Z Machine experiments requested by LANL and conducted by SNL/NM. In the past, this TRU waste was shipped back to LANL after Sandia sends the TRU data package to LANL to certify the characterization (by CCP), transport and disposition at WIPP (CBFO) per LANL MOU-0066. The Low Level Waste is managed, characterized, shipped and disposed of at NNSS by SNL/NM per Sandia MOU # 11-S-560.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

The Helmholtz Hierarchy: phase space statistics of cold dark matter

We present a new formalism to study large-scale structure in the universe. The result is a hierarchy (which we call the ''Helmholtz Hierarchy'') of equations describing the phase space statistics of cold dark matter (CDM). The hierarchy features a physical ordering parameter which interpolates between the Zel'dovich approximation and fully-fledged gravitational interactions. The results incorporate the effects of stream crossing. We show that the Helmholtz hierarchy is self-consistent and obeys causality to all orders. We present an interpretation of the hierarchy in terms of effective particle trajectories.

79 ASTRONOMY AND ASTROPHYSICS↗

Application Crash Consistency and Performance with CCFS

Recent research has shown that applications often incorrectly implement crash consistency. In this paper, we present the Crash-Consistent File System (ccfs), a file system that improves the correctness of application-level crash consistency protocols while maintaining high performance. A key idea in ccfs is the abstraction of a stream. Within a stream, updates are committed in program order, improving correctness; across streams, there are no ordering restrictions, enabling scheduling flexibility and high performance. We empirically demonstrate that applications running atop ccfs achieve high levels of crash consistency. Further, we show that ccfs performance under standard file-system benchmarks is excellent, in the worst case on par with the highest performing modes of Linux ext4, and in some cases notably better. Finally, overall, we demonstrate that both application correctness and high performance can be realized in a modern file system.

97 MATHEMATICS AND COMPUTING↗

Application-based QoE support with P4 and OpenFlow

Although Software-Defined Wide Area Networks (SD-WANs) are now widely deployed in several production networks, they are largely restricted to traffic engineering approaches based on layer 4 (L4) of the network protocol stack that result in improved Quality-of-Service (QoS) of the network overall without necessarily focusing on a specific application. However, the emergence of application protocols such as QUIC and HTTP/2 needs an investigation of layer 5-based (L5) approaches in order to improve users’ Quality-of-Experience (QoE). In this paper, we leverage the capabilities of flexible, P4-based switches that incorporate protocol-independent packet processing in order to intelligently route traffic based on application headers. We use Adaptive Bit Rate (ABR) video streaming as an example to show how such an approach can not only provide flexible traffic management but also improve application QoE. Our evaluation consists of an actual deployment in a research testbed, Chameleon, where we leverage the benefits of fast paths in order to retransmit video segments in higher qualities. Further, we analyze real-world ABR streaming sessions from a large-scale CDN and show that our approach can successfully maximize QoE for all users in the dataset.

Bhat, Divyashri↗

Investigation of a Hybrid Carbon Capture System at a NGCC Power Plant That Performs Direct Air Capture During Off-Peak Hours

The goal of this project was to investigate the feasibility of coupling NGCC power plants with membrane and solid sorbent carbon capture to achieve net negative carbon emissions. This novel hybrid system has a couple of potential benefits: 1) the carbon capture systems could help the NGCC plant by minimizing its carbon footprint and giving it a new revenue stream from direct air capture, and 2) the NGCC plant could help direct air capture scale up quickly and costeffectively by providing it with electricity, steam and compressed air streams. In order to investigate this hybrid design, we developed a complex, integrated system model consisting of: 1) a NGCC power plant model developed by Dr. Bhattacharyya’s team at WVU, 2) a membrane carbon capture model developed by Dr. Lipscomb’s team at U Toledo, and 3) a solid sorbent carbon capture model developed by Dr. Hornbostel’s team at U Pittsburgh. Mr. Matuszewski’s team at AristoSys LLC integrated these three models into a single, integrated model using FOQUS, an optimization tool developed by the NETL CCSI 2 program. Optimizations were then performed on this integrated model to determine the cost and carbon capture rates under a range of electricity and carbon price scenarios.

20 FOSSIL-FUELED POWER PLANTS↗

Multispacecraft observations of energetic ions upstream and downstream of the bow shock

Simultaneous measurements of energetic protons and alpha particles were obtained inside and outside of the magnetopause and upstream and downstream of the bow shock. In the magnetosheath, no gradient or streaming is found in the upstream direction. The present results are consistent with first-order Fermi acceleration at the bow shock and subsequent downstream convection, and exclude the possibility of a magnetospheric source for these particles.

Scholer, M.↗

CONUS-wide Projected Flood Frequency and Uncertainty Estimates, Version 1.0

This dataset presents a large-ensemble of CONUS-wide projected flood frequency and uncertainty estimates across ~2.7 million NHDPlusV2 river reaches over the CONUS. The framework producing this dataset leverages a multi-model, uncertainty-aware modeling framework that allows evaluating shifts in flood frequences at the stream reach level across the CONUS. CONUS-wide ensemble streamflow projections generated from hydrologic simulations driven by downscaled and bias-corrected Coupled Model Intercomparison Project Phase 6 (CMIP6) outputs are used to derive these flood frequency and uncertainty estimates over the period 1980 - 2099. A spatially consistent regional L-moment algorithm is applied across clusters defined by the US Hydrologic Unit Code Subregions (HUC4s and HUC8s) and NHDPlusV2 stream orders to estimate flood frequencies. The dataset also includes at-site based flood estimates that allow for the comparison between local and regional approach-based estimates, assess projected changes, and characterize their uncertainties. For more reliable estimation of rare flood frequencies such as 500 and 1000-year return periods, super-ensemble based estimates are also included in the dataset. This dataset is derived to support the "Impact-Informed Dam Safety Risk Assessment for Securing Hydropower Assests" project for the US Department of Energy (DOE) Hydropower and Hydrokinetic Office (H2O). For further details, refer to Kao et al. (2022), Ghimire et al. (2023), Ghimire et al. (2025), and Hosking and Wallis (1997).

Ghimire, Ganesh [ORNL] (ORCID:0000000242843941)↗

Predicting fine-scale distributions of peripheral aquatic species in headwater streams

Headwater species and peripheral populations that occupy habitat at the edge of a species range may hold an increased conservation value to managers due to their potential to maximize intraspecies diversity and species' adaptive capabilities in the context of rapid environmental change. The southern Appalachian Mountains are the southern extent of the geographic range of native Salvelinus fontinalis and naturalized Oncorhynchus mykiss and Salmo trutta in eastern North America. In this paper, we predicted distributions of these peripheral, headwater wild trout populations at a fine scale to serve as a planning and management tool for resource managers to maximize resistance and resilience of these populations in the face of anthropogenic stressors. We developed correlative logistic regression models to predict occurrence of brook trout, rainbow trout, and brown trout for every interconfluence stream reach in the study area. A stream network was generated to capture a more consistent representation of headwater streams. Each of the final models had four significant metrics in common: stream order, fragmentation, precipitation, and land cover. Strahler stream order was found to be the most influential variable in two of the three final models and the second most influential variable in the other model. Greater than 70% presence accuracy was achieved for all three models. The underrepresentation of headwater streams in commonly used hydrography datasets is an important consideration that warrants close examination when forecasting headwater species distributions and range estimates. Finally and additionally, it appears that a relative watershed position metric (e.g., stream order) is an important surrogate variable (even when elevation is included) for biotic interactions across the landscape in areas where headwater species distributions are influenced by topographical gradients.

59 BASIC BIOLOGICAL SCIENCES↗

AmeriFlux US-OPE Optimizing Production Inputs for Economic and Environmental Enhancement (OPE3)

This is the AmeriFlux version of the carbon flux data for the site US-OPE Optimizing Production Inputs for Economic and Environmental Enhancement (OPE3). Site Description - The Optimizing Production Inputs for Economic and Environmental Enhancement (OPE3) site is located at the Beltsville Agricultural Research Center in Prince George's County, MD, and consists of a 22-ha production field, with an adjacent riparian wetland and first-order stream. Scientists from several U.S. Federal agencies, universities (foreign and domestic), and private industry have conducted multidisciplinary research at this location since 1998.

Alfieri, Joe↗

AmeriFlux FLUXNET-1F US-OPE Optimizing Production Inputs for Economic and Environmental Enhancement (OPE3)

This is the AmeriFlux Management Project (AMP) created FLUXNET-1F version of the carbon flux data for the site US-OPE Optimizing Production Inputs for Economic and Environmental Enhancement (OPE3). This is the FLUXNET version of the carbon flux data for the site US-OPE Optimizing Production Inputs for Economic and Environmental Enhancement (OPE3) produced by applying the standard ONEFlux (1F) software. Site Description - The Optimizing Production Inputs for Economic and Environmental Enhancement (OPE3) site is located at the Beltsville Agricultural Research Center in Prince George's County, MD, and consists of a 22-ha production field, with an adjacent riparian wetland and first-order stream. Scientists from several U.S. Federal agencies, universities (foreign and domestic), and private industry have conducted multidisciplinary research at this location since 1998.

Alfieri, Joe [USDA-ARS Hydrology and Remote Sensin↗

Kinematics of the ion tail of comet P/Swift-Tuttle

We have obtained long-slit high resolution spectra of the H2O(+) 6199 A complex in the near tail of comet P/Swift-Tuttle. The observations were made using the Hamilton echelle spectrometer fed by the Lick Observatory 0.6 m coude auxiliary telescope. For most of our observations, the spectral slit was aligned along the Sun-tail axis and the cometary nucleus was placed at one end of the slit, giving us spectra having the spatial and spectral resolution needed to measure the radial velocity and velocity dispersion continuously down the cometary tail out to a distance of 4X10(exp 5) km. The radial velocities confirm the earlier more restricted observations by Rauer & Jockers (1993) and by Wyckoff & Lindholm (1994) showing that the tail motions are indeed bulk flows in the antisolar direction. Out to 3X10(exp 5) km in the tail typical bulk flows are at a speed of approximately 30 km/s. The velocity dispersion, (sigma(sub r)), of the H2O(+) lines follows a pattern that is quite systematic; sigma(sub r) is smallest near the cometary nucleus, and steadily increases down the tail. The highest velocity dispersions are found ahead of the nucleus and off the tail axis. These velocity dispersions are equivalent to ion temperatures ranging from 10(exp 5) to 10(exp 6) K. We note a clear anticorrelation between the H2O(+) line intensities (related to the ion density) and the bulk flow and dispersion velocities; direct mass loading of the solar wind by the observed water ions may be responsible. We discuss several approximate equipartition methods used to infer local magnetic fields induced by the interaction of the cometary ions with the solar wind particle/field stream. Typical fields derived are near 50 nT. The measured tailward accelerations are consistent with this order of magnitude B field.

Spinrad, Hyron↗

Higher order solutions to ion-acoustic solitons in a weakly relativistic two-fluid plasma

The nonlinear wave structure of small amplitude ion-acoustic solitary waves (IASs) is investigated in a two-fluid plasma consisting of weakly relativistic streaming ions and electrons. Using the reductive perturbation theory, the basic set of governing equations is reduced to the Korteweg-de Vries (KdV) equation for the lowest order perturbation. This analysis is further extended using the renormalization technique for the inclusion of higher order nonlinear and dispersive effects for better accuracy. The effect of higher order correction and various parameters on the soliton characteristics is investigated and also discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DUST CAPTURE AND LONG-LIVED DENSITY ENHANCEMENTS TRIGGERED BY VORTICES IN 2D PROTOPLANETARY DISKS

We study dust capture by vortices and its long-term consequences in global two-fluid inviscid disk simulations using a new polar grid code RoSSBi. We perform the longest integrations so far, several hundred disk orbits, at the highest resolution attainable in global disk simulations with dust, namely, 2048 × 4096 grid points. We vary a wide range of dust parameters, most notably the initial dust-to-gas ratio ϵ varies in the range of 10{sup −4}–10{sup −2}. Irrespective of the value of ϵ , we find rapid concentration of the dust inside vortices, reaching dust-to-gas ratios of the order of unity inside the vortex. We present an analytical model that describes this dust capture process very well, finding consistent results for all dust parameters. A vortex streaming instability develops, which invariably causes vortex destruction. After vortex dissipation large-scale dust rings encompassing a disk annulus form in most cases, which sustain very high dust concentration, approaching ratios of the order of unity; they persist as long as the duration of the simulations. They are sustained by a streaming instability, which manifests itself in high-density dust clumps at various scales. When vortices are particularly long-lived, rings do not form but dust clumps inside vortices can survive a long time and would likely undergo collapse by gravitational instability. Rings encompass almost an Earth mass of solid material, while even larger masses of dust do accumulate inside vortices in the earlier stage. We argue that rapid planetesimal formation would occur in the dust clumps inside the vortices as well as in the post-vortex rings.

79 ASTRONOMY AND ASTROPHYSICS↗