Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Streaming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65

Beyond Ohm's law: Bernoulli effect and streaming in electron hydrodynamics

Recent observations of nonlocal transport in ultraclean two-dimensional materials raised the tantalizing possibility of accessing hydrodynamic correlated transport of a many-electron state. However, it has been pointed out that nonlocal transport can also arise from impurity scattering rather than interaction. At the crux of the ambiguity is the focus on linear effects, i.e., Ohm's law, which cannot easily differentiate among different modes of transport. Furthermore we propose experiments that can reveal rich hydrodynamic features in the system by tapping into the nonlinearity of the Navier-Stokes equation. Three experiments we propose will each manifest a unique phenomenon that is well known in classical fluids: the Bernoulli effect, Eckart streaming, and Rayleigh streaming. Analysis of known parameters confirms that the proposed experiments are feasible and the hydrodynamic signatures are within reach of graphene-based devices. Experimental realization of any one of the three phenomena will provide a stepping stone to formulating and exploring the notions of nonlinear electron fluid dynamics with an eye to celebrated examples from classical nonlaminar flows, e.g., pattern formation and turbulence.

2-dimensional systems↗

Are cosmological neutrinos free-streaming?

Precision data from cosmology suggest neutrinos stream freely and hence interact very weakly around the epoch of recombination. We study this issue in a simple framework where neutrinos recouple instantaneously and stop streaming freely at a redshift z{sub i}. The latest cosmological data imply z{sub i} < or approx. 1500, the exact constraint depending somewhat on the assumed prior on z{sub i}. This bound can be translated into a bound on the coupling strength between neutrinos and majoronlike particles.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Two-fluid temperature-dependent relativistic waves in magnetized streaming pair plasmas

A relativistic two-fluid temperature-dependent approach for a streaming magnetized pair plasma is considered. Such a scenario corresponds to secondary plasmas created at the polar caps of pulsar magnetospheres. In the model the generalized vorticity rather than the magnetic field is frozen into the fluid. For parallel propagation four transverse modes are found. Two are electromagnetic plasma modes which at high temperature become light waves. The remaining two are Alfvenic modes split into a fast and slow mode. The slow mode is cyclotron two-stream unstable at large wavelengths and is always subluminous. We find that the instability cannot be suppressed by temperature effects in the limit of large (finite) magnetic field. The fast Alfven mode can be superluminous only at large wavelengths, however it is always subluminous at high temperatures. In this incompressible approximation only the ordinary mode is present for perpendicular propagation. For oblique propagation the dispersion relation is studied for finite and large strong magnetic fields and the results are qualitatively described.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

An Active Learning-Based Streaming Pipeline for Reduced Data Training of Structure Finding Models in Neutron Diffractometry

Structure determination workloads in neutron diffractometry are computationally expensive and routinely require several hours to many days to determine the structure of a material from its neutron diffraction patterns. The potential for machine learning models trained on simulated neutron scattering patterns to significantly speed up these tasks have been reported recently. However, the amount of simulated data needed to train these models grows exponentially with the number of structural parameters to be predicted and poses a significant computational challenge. To overcome this challenge, we introduce a novel batch-mode active learning (AL) policy that uses uncertainty sampling to simulate training data drawn from a probability distribution that prefers labelled examples about which the model is least certain. We confirm its efficacy in training the same models with ∼ 75% less training data while improving the accuracy. We then discuss the design of an efficient stream-based training workflow that uses this AL policy and present a performance study on two heterogeneous platforms to demonstrate that, compared with a conventional training workflow, the streaming workflow delivers ∼ 20% shorter training time without any loss of accuracy.

Wang, Tianle [Brookhaven National Laboratory (BNL)↗

Introducing Weirs: An Abstraction for Next Generation Streaming Workflows

In HPC applications, it is widely understood that in situ systems will play a significant role in next generation systems. The rate that next-generation leadership machines will be able to generate data will exceed the bandwidths of the planned I/O systems, leading to a need for in situ processing of the resulting data to reduce it. There have been a number of techniques proposed for in situ workflow systems; we are concerned here specifically with the needs of publish/subscribe or streaming-based approaches, which allow the in situ system to be composed of completely separate executables running concurrently on the hardware. In this paper we introduce an abstract known as a Weir. A weir is a useful mechanism to control state in a point to point streaming workflow in the absence of a third party publish subscribe system.

97 MATHEMATICS AND COMPUTING↗

Improving Quality of Observational Streaming Medical Data by Using Long Short-Term Memory Networks (LSTMs)

We present an exploration of the encoder-decoder structured Long Short-Term Memory Network (LSTM) as a detector of the anomalous missing observations in streaming medical data by using the difference between the LSTM-reconstructed and observed values as the anomaly detector. We experiment with time-series data from bedside monitoring devices from the available Medical Information Mart for Intensive Care Database (MIMIC). Our results show that not only encoder-decoder LSTM approach works well for detecting the difference between anomalous and normal missing observations in streaming medical data, but also has an imputation potential for the missing data.

Bowie, Michael B.↗

A Brief Survey of Data Streaming Technologies

Streaming data is data that is emitted at variable volumes in a continuous, incremental manner with the goal of low-latency processing often at a different physical location. Network infrastructure is used to facilitate the connection between data sources and sinks, and must be robust to handle the requirements of the workflow. The U.S. Department of Energy Office of Science (DOE SC) a federal agency supporting fundamental scientific research for energy and the Nation’s largest supporter of basic research in the physical sciences. DOE SC has the responsibility for operating $\mathbf{1 0}$ National Laboratories, and 28 scientific user facilities supporting advanced supercomputers, particle accelerators, large x-ray light sources, neutron scattering sources, and other specialized facilities for nanoscience and genomics. This paper investigates the state of streaming data workfows, and details some of the approaches to this challenging problem.

Kissel, Ezra↗

Mahanaxar: quality of service guarantees in high-bandwidth, real-time streaming data storage

Large radio telescopes, cyber-security systems monitoring real-time network traffic, and others have specialized data storage needs: guaranteed capture of an ultra-high-bandwidth data stream, retention of the data long enough to determine what is 'interesting,' retention of interesting data indefinitely, and concurrent read/write access to determine what data is interesting, without interrupting the ongoing capture of incoming data. Mahanaxar addresses this problem. Mahanaxar guarantees streaming real-time data capture at (nearly) the full rate of the raw device, allows concurrent read and write access to the device on a best-effort basis without interrupting the data capture, and retains data as long as possible given the available storage. It has built in mechanisms for reliability and indexing, can scale to meet arbitrary bandwidth requirements, and handles both small and large data elements equally well. Results from our prototype implementation shows that Mahanaxar provides both better guarantees and better performance than traditional file systems.

97 MATHEMATICS AND COMPUTING↗

Prescriptive provenance for streaming analysis of workflows at scale

Abstract- We extend our approach capturing and relating the provenance and performance metrics of computational workflows as a diagnostic tool for runtime optimization and placement. One important challenge is the volume of extracted data, both for performance metrics and provenance, even when specifying filters and focusing on quantities of interest in a simulation. We reduce this data by performing anomaly detection on streaming data and store provenance for the detected anomalies, an approach we call prescriptive provenance. This paper discusses the Chimbuko architecture enabling the approach. We present the use of a protein structure propagation workflow based on NWChemEx. We are testing algorithms for anomaly detection and present preliminary results here obtained with Local Outlier Factor. While scaling remains a challenge, these results show that our robust Chimbuko architecture for streaming analysis with prescriptive provenance is a promising approach.

97 MATHEMATICS AND COMPUTING↗

Streaming Solutions for Fine-Grained Network Traffic Measurements and Analysis

Online network traffic measurements and analysis is critical for detecting and preventing any real-time anomalies in the network. We propose, implement, and evaluate an online, adaptive measurement platform, which utilizes real-time traffic analysis results to refine subsequent traffic measurements. Central to our solution is the concept of Multi-Resolution Tiling (MRT), a heuristic approach that performs sequential analysis of traffic data to zoom into traffic subregions of interest. However, MRT is sensitive to transient traffic spikes. In this paper, we propose three novel traffic streaming algorithms that overcome the limitations of MRT and can cater to varying degrees of computational and storage budgets, detection latency, and accuracy of query response. We evaluate our streaming algorithms on a highly parallel and programmable hardware as well as a traditional software-based platforms. The algorithms demonstrate significant accuracy improvement over MRT in detecting anomalies consisting of synthetic hard-to-track elephant flows and global icebergs. Our proposed algorithms maintain the worst-case complexities of the MRT while incurring only a moderate increase in average resource utilization.

97 MATHEMATICS AND COMPUTING↗

Plant phylogenetic history explains in-stream decomposition at a global scale

1. Evolutionary history and adaptation to climate shape plant traits. Some include leaf traits that influence litter quality. As a result, evolutionary history should affect litter decomposition, a crucial ecosystem process. In addition, litter decomposition is directly influenced by climate. Similarly, we expect plant phylogeny, adaptation and climate to jointly influence litter decomposition. These effects and their interactions have yet to be untangled at a global scale. 2. Here we introduce an analysis of variation in litter decomposition rates in rivers and streams across 285 published studies for 239 species (from ferns to angiosperms) distributed at 494 locations world-wide. We estimated the relative contributions of climatic conditions and phylogenetic heritage on litter decomposition rates, partitioning phylogenetic from climatic effects at the site and species levels using phylogenetic eigenvector analysis and phylogenetic linear mixed models. In addition, we modelled transitions in decomposition rates under a suite of multiple adaptive-regime Ornstein–Uhlenbeck models to test the hypothesis that natural selection has shaped clade-level litter decomposition rates. 3. Leaf litter decomposition rate exhibited a significant phylogenetic signal. Modelling decomposition rate as a function of location, climatic niche and phylogeny consistently recovered phylogeny alone as one of the top models in species-level analyses. Since many previous studies have focused on the same species across many locations, we also conducted analyses at the species × site level. Both phylogenetic and climatic factors were favoured in models of this analysis, but the single most important predictor for angiosperms and for all taxa analysed together was phylogeny alone. 4. Synthesis. For plant species distributed globally at nearly 500 locations we found that plant phylogenetic history is a critically important predictor of litter decomposition rate in rivers and streams, explaining more of the variance in decomposition than site or climatic regime. Thus, our study demonstrates the influence of evolutionary history on suites of plant traits that shape a key ecosystem process.

54 ENVIRONMENTAL SCIENCES↗

Surface Texture of Macroplastic Pollution in Streams Alters the Physical Structure and Diversity of Biofilm Communities

ABSTRACT Biofilms can develop on nearly any surface, and in aquatic ecosystems they are essential components of biogeochemical cycles and food webs. Plastic waste in waterways is a new type of surface for biofilm colonisation. To analyse the influence of plastic pollution on the development and diversity of microbial freshwater biofilms that colonised them, we incubated 388 cm 2 veneers of high‐density polyethylene (HDPE) with two veneer textures, smooth and rough, and tulip tree wood ( Liriodendron tulipifera ), in three rural headwater streams at the Savannah River Site (Aiken, SC, USA). We collected biofilms from veneers after 14, 28 and 56 days of incubation and analysed 16S rRNA genes and biofilm properties. We found that plastic negatively affected species richness of biofilms compared with wood, but that evenness was greatest on rough textured HDPE. Beta diversity was primarily influenced by stream site. Beta diversity differed more between wood and plastic veneers than with plastic surface texture and became more different over time. Wood had nine times more biomass than rough HDPE and 40 times more biomass than smooth HDPE. Given the projected increase of macroplastic pollution in aquatic ecosystems, our findings emphasise the need to further understand its effects on biofilm characteristics.

Lopez Avila, Fabiola [Odum School of Ecology Unive↗

Acoustically Induced Streaming Flows near a Model Cod Otolith and their Potential Implications for Fish Hearing

The ears of fishes are remarkable sensors for the small acoustic disturbances associated with underwater sound. For example, each ear of the Atlantic cod (Gadus morhua) has three dense bony bodies (otoliths) surrounded by fluid and tissue, and detects sounds at frequencies from 30 to 500 Hz. Atlantic cod have also been shown to localize sounds. However, how their ears perform these functions is not fully understood. Steady streaming, or time-independent, flows near a 350% scale model Atlantic cod otolith immersed in a viscous fluid were studied to determine if these fluid flows contain acoustically relevant information that could be detected by the ear s sensory hair cells. The otolith was oscillated sinusoidally at various orientations at frequencies of 8 24 Hz, corresponding to an actual frequency range of 280 830 Hz. Phaselocked particle pathline visualizations of the resulting flows give velocity, vorticity, and rate of strain fields over a single plane of this mainly two-dimensional flow. Although the streaming flows contain acoustically relevant information, the displacements due to these flows are likely too small to explain Atlantic cod hearing abilities near threshold. The results, however, may suggest a possible mechanism for detection of ultrasound in some fish species.

54 ENVIRONMENTAL SCIENCES↗

Selective chemical looping combustion of acetylene in ethylene-rich streams

Here, the requirement for C 2 H 2 concentrations below 2 parts per million (ppm) in gas streams for C 2 H 4 polymerization necessitates its semihydrogenation to C 2 H 4 . Here, we demonstrate selective chemical looping combustion of C 2 H 2 in C 2 H 4 -rich streams by Bi 2 O 3 as an alternative catalytic pathway to reduce C 2 H 2 concentration below 2 ppm. Bi 2 O 3 combusts C 2 H 2 with a first-order rate constant that is 3000 times greater than the rate constant for C 2 H 4 combustion. In successive redox cycles, the lattice O of Bi 2 O 3 can be fully replenished without discernible changes in local Bi coordination or C 2 H 2 combustion selectivity. Heterolytic activation of C–H bonds across Bi–O sites and the higher acidity of C 2 H 2 results in lower barriers for C 2 H 2 activation than C 2 H 4 , enabling selective catalytic hydrocarbon combustion leveraging differences in molecular deprotonation energies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Geochemistry and Multiomics Data Differentiate Streams in Pennsylvania Based on Unconventional Oil and Gas Activity

Unconventional oil and gas (UOG) extraction is increasing exponentially around the world, as new technological advances have provided cost-effective methods to extract hard-to-reach hydrocarbons. While UOG has increased the energy output of some countries, past research indicates potential impacts in nearby stream ecosystems as measured by geochemical and microbial markers. Here, we utilized a robust data set that combines 16S rRNA gene amplicon sequencing (DNA), metatranscriptomics (RNA), geochemistry, and trace element analyses to establish the impact of UOG activity in 21 sites in northern Pennsylvania. These data were also used to design predictive machine learning models to determine the UOG impact on streams. We identified multiple biomarkers of UOG activity and contributors of antimicrobial resistance within the order Burkholderiales. Furthermore, we identified expressed antimicrobial resistance genes, land coverage, geochemistry, and specific microbes as strong predictors of UOG status. Of the predictive models constructed (n = 30), 15 had accuracies higher than expected by chance and area under the curve values above 0.70. The supervised random forest models with the highest accuracy were constructed with 16S rRNA gene profiles, metatranscriptomics active microbial composition, metatranscriptomics active antimicrobial resistance genes, land coverage, and geochemistry (n = 23). The models identified the most important features within those data sets for classifying UOG status. These findings identified specific shifts in gene presence and expression, as well as geochemical measures, that can be used to build robust models to identify impacts of UOG development.

16S rRNA↗

PlanetSense: A Real-time Streaming and Spatio-temporal Analytics Platform for Gathering Geo-spatial Intelligence from Open Source Data

Geospatial intelligence has traditionally relied on the use of archived and unvarying data for planning and exploration purposes. In consequence, the tools and methods that are architected to provide insight and generate projections only rely on such datasets. Albeit, if this approach has proven effective in several cases, such as land use identification and route mapping, it has severely restricted the ability of researchers to inculcate current information in their work. This approach is inadequate in scenarios requiring real-time information to act and to adjust in ever changing dynamic environments, such as evacuation and rescue missions. In this work, we propose PlanetSense, a platform for geospatial intelligence that is built to harness the existing power of archived data and add to that, the dynamics of real-time streams, seamlessly integrated with sophisticated data mining algorithms and analytics tools for generating operational intelligence on the fly. The platform has four main components – i) GeoData Cloud – a data architecture for storing and managing disparate datasets; ii) Mechanism to harvest real-time streaming data; iii) Data analytics framework; iv) Presentation and visualization through web interface and RESTful services. Using two case studies, we underpin the necessity of our platform in modeling ambient population and building occupancy at scale.

big data architecture↗

Streaming Data in HPC Workflows Using ADIOS

The “IO Wall” problem, in which the gap between computation rate and data access rate grows continuously, poses significant problems to scientific workflows which have traditionally relied upon using the filesystem for intermediate storage between workflow stages. One way to avoid this problem in scientific workflows is to stream data directly from producers to consumers and avoiding storage entirely. However, the manner in which this is accomplished is key to both performance and usability. This paper presents the Sustainable Staging Transport, an approach which allows direct streaming between traditional file writers and readers with few application changes. SST is an ADIOS “engine”, accessible via standard ADIOS APIs, and because ADIOS allows engines to be chosen at run-time, many existing file-oriented ADIOS workflows can utilize SST for direct application-to-application communication without any source code changes. This paper describes the design of SST and presents performance results from various applications that use SST, for feeding model training with simulation data with substantially higher bandwidth than the theoretical limits of Frontier’s file system, for strong coupling of separately developed applications for multiphysics multiscale simulation, or for in situ analysis and visualization of data to complete all data processing shortly after the simulation finishes.

Podhorszki, Norbert [ORNL] (ORCID:000000019647542X↗

Regex-Stream

Log files are typically semi-or un-structured. To be useable, they need to be parsed into a standard, structured format. Regex-Stream facilitates parsing text files into structured data (JSON) in streams of data.

Goodall, John↗