Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Streaming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Towards Flexible Exascale Stream Processing System Simulation

Stream processing is an important emerging computational model for performing complex operations on and across multi-source, high-volume, unpredictable dataflows. We present Flow, a platform for parallel and distributed stream processing system simulation that provides a flexible modeling environment for analyzing stream processing applications. The Flow stream processing system simulator is a high-performance, scalable simulator that automatically parallelizes chunks of the model space and incurs near-zero synchronization overhead for acyclic stream application graphs. We show promising parallel and distributed event rates exceeding 149 million events per second on a cluster with 512 processor cores.

99 GENERAL AND MISCELLANEOUS↗

FireHose Streaming Benchmarks

The FireHose Streaming Benchmarks are a suite of stream-processing benchmarks defined to enable comparison of streaming software and hardware, both quantitatively vis-a-vis the rate at which they can process data, and qualitatively by judging the effort involved to implement and run the benchmarks. Each benchmark has two parts. The first is a generator which produces and outputs datums at a high rate in a specific format. The second is an analytic which reads the stream of datums and is required to perform a well-defined calculation on the collection of datums, typically to find anomalous datums that have been created in the stream by the generator. The FireHose suite provides code for the generators, sample code for the analytics (which users are free to re-implement in their own custom frameworks), and a precise definition of each benchmark calculation.

Karl Anderson, Steve Plimpton↗

Apparatus for pneumatic shuttering of an aerosol particle stream

The invention provides pneumatic shuttering of a focused or collimated aerosol particle stream. The aerosol stream can be collimated by an annular sheath of inert or non-inert gas. The apparatus propagates a sheathed aerosol stream through a series of aerodynamic lenses along the axis of a flow cell. The final lens is typically positioned above a substrate, so that direct material deposition is provided. A substantially perpendicularly-flowing gas external to the aerodynamic lens system is used to redirect the particle stream away from the flow axis and through an exhaust port, thereby shuttering the collimated aerosol stream. The pneumatic shutter enables printing of discreet structures, with on/off shuttering times of approximately 1 to 100 milliseconds.

42 ENGINEERING↗

Real-time forecasting of electricity demand in a streams-based architecture with applications

A streams platform is used. Multiple streams of electricity usage data are received, each from an electrical meter providing periodic updates to electrical usage for devices connected to the electrical meter. Weather information is received corresponding to locations where the electrical meters are. Real-time predictive modeling of electricity demand is performed based on the received multiple streams of electricity usage data and the received weather information, at least by performing: updating a state space model for electrical load curves using the usage data from the streams and the weather, wherein the updating uses current load observations for the multiple streams for a current time period; and creating forecast(s) for the electricity demand. The forecast(s) of the electricity demand are output. Appliance-level predictions may be made and used, and substitution effects and load management functions may be performed.

Ghosh, Soumyadip↗

The Impact of Streaming Data on Sensemaking with Mixed-Initative Visual Analytics

Visual data analysis helps people gain insights into data via interactive visualizations. People generate and test hypotheses and questions about data in context of the domain. This process can generally be referred to as sensemaking. Much of the work on studying sensemaking (and creating visual analytic techniques in support of it) has been focused on static datasets. However, how do the cognitive processes of sensemaking change when data are changing? Further, what implication for design does this create for mixed-initiative visual analytics systems? This paper presents the results of a user study analyzing the impact of streaming data on sensemaking. To perform this study, we developed a mixed-initiative visual analytic prototype, the Streaming Canvas, that affords the analysis of streaming text data. We compare the sensemaking process of people using this tool for a static and streaming dataset. We present the results of this study and discuss the implications on future visual analytic systems that combine machine learning and interactive visualization to help people make sense of streaming data.

visualization↗

Potential flue gas impurities in carbon dioxide streams separated from coal-fired power plants

This study estimated the flue gas impurities to be included in the CO{sub 2} stream separated from a CO{sub 2} control unit for a different combination of air pollution control devices and different flue gas compositions. Specifically, the levels of acid gases and mercury vapor were estimated for the monoethanolamine (MEA)-based absorption process on the basis of published performance parameters of existing systems. Among the flue gas constituents considered, sulfur dioxide (SO{sub 2}) is known to have the most adverse impact on MEA absorption. When a flue gas contains 3000 parts per million by volume (ppmv) SO{sub 2} and a wet flue gas desulfurization system achieves its 95% removal, approximately 2400 parts per million by weight (ppmw) SO{sub 2} could be included in the separated CO{sub 2} stream. In addition, the estimated concentration level was reduced to as low as 135 ppmw for the SO{sub 2} of less than 10 ppmv in the flue gas entering the MEA unit. Furthermore, heat-stable salt formation could further reduce the SO{sub 2} concentration below 40 ppmw in the separated CO{sub 2} stream. In this study, it is realized that the formation rates of heat-stable salts in MEA solution are not readily available in the literature and are critical to estimating the levels and compositions of flue gas impurities in sequestered CO{sub 2} streams. In addition to SO{sub 2}, mercury, and other impurities in separated CO{sub 2} streams could vary depending on pollutant removal at the power plants and impose potential impacts on groundwater. Such a variation and related process control in the upstream management of carbon separation have implications for groundwater protection at carbon sequestration sites and warrant necessary considerations in overall sequestration planning, engineering, and management. 63 refs., 1 fig., 3 tabs.

01 COAL, LIGNITE, AND PEAT↗

Panel Session 76: US DOE Problematic Waste Streams and Policy Impacts

This panel provided an overview of DOE problematic waste streams including status and path forward. Potential policy implications that exist now and/or in the future were discussed. Topics included, greater-than-Class C low level waste, depleted uranium, and sodium waste. The panel also discussed potential treatment options for these wastes. As part of the introduction, Renee Echols welcomed the audience and went over a quick overview of what would be discussed on the panel. Theresa Kliczewski provided an overview of why this panel is relevant to US Department of Energy's Office of Environmental Management: there are problematic waste streams that still exist across the DOE cleanup complex. Theresa noted that the DOE EM Headquarters Office of Waste and Materials Management (EM-4.2), for which she is employed with, continues to work with the DOE cleanup sites on a path forward for these problematic waste streams. Presentations proposed include: 1 - Overview of Greater-Than-Class C Low-Level Radioactive Waste Disposal Path Forward (Theresa Kliczewski, US DOE EM (USA)); 2 - Status of Draft Supplemental Environmental Impact Statement for Disposition of Depleted Uranium Oxide Conversion Product Generated from DoE's Inventory of Depleted Uranium Hexafluoride (Jaffet Ferrer-Torres, US DOE (USA)); 3 - Problematic Waste Streams on the Oak Ridge Reservation (John Wrapp, UCOR (USA)); 4 - K Basin Sludge Removal (Ryan Covert, CH2M Hill PRC (USA)); 5 - Providing Technology Solutions for Treatment of Challenging Waste Streams (Tammy Monday, Perma-Fix Environmental Services (USA)); 6 - Treatment of Problematic Reactive Metal Waste Using the GeoMelt{sup R} In-Container Vitrification (ICV{sup TM}) Process (Ron Mitchell, Veolia Nuclear Solutions (USA))

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Energy deposition model in STREAM with photon transport

Recent efforts have been taken to implement a photon transport module for the neutron transport analysis code STREAM, considering the explicit photon energy distribution in the problem instead of using the locally deposition assumption as employed in previous STREAM versions. The current energy release model in STREAM based on the On-the-fly energy released per fission model is modified accordingly to account for the photon energy deposition computed explicitly by this module. The impacts of the modified energy release model with photon transport in STREAM on the power distribution, fuel temperature and other core parameters during depletion with feedback calculations are studied on several problems from the VERA benchmark suit. Overall, the photon transport provides a better power map for depletion and feedback calculations, especially when strong gamma emitters are present. The fuel temperature, in general, is decreased when the photon transport is employed because fission gammas have been transported out of their birthplace. The new energy deposition model in STREAM with photon transport indicates that gamma energy accounts for about 9.7% of the total energy released in a fresh VERA5 2D core and rises to 10.5% at the End of Cycle. Around 2.5% of the total energy released will be deposited in the coolant in this 2D core. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Streaming Compression of Hexahedral Meshes

We describe a method for streaming compression of hexahedral meshes. Given an interleaved stream of vertices and hexahedral our coder incrementally compresses the mesh in the presented order. Our coder is extremely memory efficient when the input stream documents when vertices are referenced for the last time (i.e. when it contains topological finalization tags). Our coder then continuously releases and reuses data structures that no longer contribute to compressing the remainder of the stream. This means in practice that our coder has only a small fraction of the whole mesh in memory at any time. We can therefore compress very large meshes - even meshes that do not file in memory. Compared to traditional, non-streaming approaches that load the entire mesh and globally reorder it during compression, our algorithm trades a less compact compressed representation for significant gains in speed, memory, and I/O efficiency. For example, on the 456k hexahedra 'blade' mesh, our coder is twice as fast and uses 88 times less memory (only 3.1 MB) with the compressed file increasing about 3% in size. We also present the first scheme for predictive compression of properties associated with hexahedral cells.

99 GENERAL AND MISCELLANEOUS↗

Consistent Controls on Trace Metal Micronutrient Speciation in Wetland Soils and Stream Sediments

Trace metal are essential for microbially-mediated biogeochemical processes occurring in anoxic wetland soils and stream bed sediments, but low availability of these elements may inhibit anaerobic element cycling and transformations. Solid-phase speciation is likely a critical control on trace metal availability but has seen limited study in anoxic systems having concentrations similar to geological background levels, where metal limitations may be most prevalent. We have investigated trace metal concentrations and solid-phase speciation in three freshwater subsurface aquatic systems: marsh wetland soils, riparian wetland soils, and the sediments of a streambed. These systems displayed low solid-phase trace metal concentrations, generally at or below geological background levels, which generally followed the trend Zn > Cu ≈ Ni > Co and showed no correlation with major element compositions. All soils and sediments were dominated by quartz but varied in clay mineralogy as well as the organic matter, total sulfur, and total iron contents. X-ray absorption near-edge structure (XANES) spectroscopy shows that sulfur speciation in both wetlands is dominated by organic sulfur. Elemental sulfur and iron sulfides together made up <25% of the sulfur in the wetland soils, but the distribution between inorganic and organic forms was reversed in the stream sediments. Ferrous and ferric iron in clay minerals were common species identified by both XANES and extended X-ray absorption fine structure (EXAFS) spectroscopies at all sites. Iron(III) oxides were substantial components in all but the marsh wetland soils. Quantitative analysis of copper, nickel, and zinc XANES spectra revealed similar metal speciation across all sites. Copper speciation was dominated by sulfides, adsorbed species, and minor amounts of copper bound to organic matter; no metallic copper was detected. Nickel speciation also varied little and was dominated by nickel in clay mineral octahedral sheets and nickel sulfide, with adsorbed species also present. Zinc speciation was slightly more varied, with the marsh wetland soils and stream bed sediments containing adsorbed species, zinc associated with clay mineral structures, and zinc bound to reduced sulfur groups on organic matter, whereas the riparian wetland soils lacked clay-associated zinc but contained zinc sulfide. Trace metals bound to reduced sulfur occurred at every site, with a greater sulfur-bound fraction for copper. The fractional abundance of sulfur-bound species showed no relationship with soil or sediment total sulfur content, which varied by two orders of magnitude. More broadly, the observations in this study suggest that trace metal speciation in freshwater wetland soils and stream sediments is consistently dominated by a small set of recurring components which are distinct for each metal. Furthermore, this may represent a general geochemical phenomenon in anoxic soils and sediments containing trace metals at background concentrations (as low as 3 µg g -1 ) that was not predicted from systems that are contaminated with or naturally-enriched in copper, nickel, or zinc.

54 ENVIRONMENTAL SCIENCES↗

Chamber measurements of high CO 2 emissions from a rainforest stream receiving old C-rich regional groundwater

Carbon emissions from fluvial systems are a key component of local and regional carbon cycles. We used floating chambers to investigate the CO 2 flux from stream water to air (f CO 2 ) in the Arboleda, a stream in the lowland rainforest of Costa Rica, fed partly by old regional groundwater high in dissolved inorganic carbon (DIC). Drifting and static chambers showed f CO 2 averaging 35.5 and 72.7 μmol C m –2 s –1 , respectively, bracketing the previously-published f CO 2 value of 56 μmol C m –2 s –1 obtained using tracer methods in this stream. These values are much higher than most f CO 2 data in the literature and reflect a large flux of deep crustal (non-biogenic) CO 2 out of the Arboleda, a flux that does not represent a component of ecosystem respiration. Static chambers appeared to overestimate f CO 2 by creating artificial turbulence, while drifting chambers may have underestimated f CO 2 by under-sampling areas of potentially high gas exchange (e.g., riffles around coarse woody debris obstructions). Both static and drifting chambers revealed high spatial heterogeneity in f CO 2 at the scale of 5–30 m reaches. Some observed temporal trends were localized, e.g., among three reaches with repeated measurements through the wet and dry seasons, (1) only the reach located between the other two showed significantly lower f CO 2 during the dry season, and (2) the highest and lowest f CO 2 were consistently observed in the reaches farthest upstream and downstream, respectively. As a result, streams like the Arboleda receiving significant inputs of high-DIC regional groundwater merit additional study as hotspots for C emissions from terrestrial ecosystems.

54 ENVIRONMENTAL SCIENCES↗

Advancing stream temperature prediction with a generalizable large-sample framework across CONUS river reaches

Accurately predicting stream temperature in ungauged basins remains a critical challenge for water resource management, thermoelectric power plant cooling, and ecosystem conservation. Large-sample machine learning models trained on hundreds of well-monitored river basins have shown remarkable performance; however, such models have yet to be developed solely using forcing data that can be readily extracted to simulate stream temperatures anywhere in the contiguous United States (CONUS). In this study, we present a scalable, large-sample deep learning framework using Long Short-Term Memory (LSTM) networks to simulate daily stream temperatures in ungauged basins across the CONUS. The framework leverages both modeled reanalysis of meteorological and streamflow inputs as well as static attributes available for all 2.7 million CONUS river reaches in the National Hydrography Dataset Plus (NHDPlusV2). By generating dynamical inputs from predefined thermally relevant upstream contributing areas, rather than the entire upstream basin, the model also offers improvements in very large basins where full-basin averaging can dilute the most important influences on stream temperature. Evaluated across 300 basins, the model achieves a median Mean Absolute Error (MAE) of 1.1 °C and a Nash-Sutcliffe Efficiency (NSE) of 0.95 on temporally and spatially distinct test folds—comparable to models trained exclusively using meteorological and streamflow observational data. The flexible, high-performing framework generalizes to any unmonitored river reach without significant regulation or unnatural thermal input immediately upstream, substantially expanding predictive capabilities in data-scarce regions.

Hydrology↗

Fast shared-memory streaming multilevel graph partitioning

In this report we show that a fast parallel graph partitioner can benefit many applications by reducing data transfers. The online methods for partitioning graphs have to be fast and they often rely on simple one-pass streaming algorithms, while the offline methods for partitioning graphs contain more involved algorithms and the most successful methods in this category belong to the multilevel approaches. In this work, we assess the feasibility of using streaming graph partitioning algorithms within the multilevel framework. Our end goal is to come up with a fast parallel offline multilevel partitioner that can produce competitive cutsize quality. We rely on a simple but fast and flexible streaming algorithm throughout the entire multilevel framework. This streaming algorithm serves multiple purposes in the partitioning process: a clustering algorithm in the coarsening, an effective algorithm for the initial partitioning, and a fast refinement algorithm in the uncoarsening. Its simple nature also lends itself easily for parallelization. The experiments on various graphs show that our approach is on the average up to 5.1x faster than the multi-threaded MeTiS, which comes at the expense of only 2x worse cutsize.

97 MATHEMATICS AND COMPUTING↗

Tidal Stream Energy Resource Characterization in the Salish Sea

Tidal stream energy holds great potential as a renewable energy source in regions of the world where tidal currents are strong and predictable. The tidal stream energy resource of a region is strongly controlled by its tidal wave characteristics, the local bathymetry, and coastal geometric features. The Salish Sea, a large estuary on the Pacific Northwest coast, represents a great tidal stream resource because of its strong tidal currents in many tidal channels. However, the tidal resource in the Salish Sea has not been systematically characterized, primarily because of its large area and complex bathymetry and coastlines. This paper presents a modeling study conducted to characterize the tidal energy resource of the Salish Sea based on a high-resolution three-dimensional tidal hydrodynamic model of the Salish Sea, which was extensively validated using data derived from 10 tidal gauge stations and 132 Acoustic Doppler Current Profiler stations. Model validation results indicated the Salish Sea hydrodynamic model is skillful in simulating tidal wave propagation and velocity distributions in the Salish Sea. Based on model results, a total of 16 tidal channels with strong tidal currents, 9 in the San Juan Islands and Rosario Strait regions and 7 in the Puget Sound, were identified as hotspots for potential tidal energy development. Velocity probability distributions and exceedance curves of cross-channel average velocity magnitudes were calculated at all 16 channels based on the recommendations of the International Electrotechnical Commission Technical Specifications for tidal energy resource characterization. The tidal energy resource at the 16 hotspots was also characterized using power density distributions and kinetic energy fluxes. The ranking of the kinetic energy fluxes suggested that Admiralty Inlet, Rosario Strait, and Middle Channel are the top three hotspot sites in the Salish Sea for tidal stream energy development. The study demonstrated the need for a high-resolution 3-D modeling framework for accurate simulation of tidal currents in large complex estuarine systems, in the context of tidal energy resource characterization.

tidal stream energy, resource characterization, Sa↗

Dynamic Responses of Trace Metal Bioaccessibility to Fluctuating Redox Conditions in Wetland Soils and Stream Sediments

Natural aquatic systems undergo fluctuating redox conditions due to microbial activity, varying water saturation levels, and nutrients dynamics. With fluctuating redox conditions, trace metals can mobilize or sequester in response to changes in iron and sulfur speciation and the concentrations and lability of organic carbon. This study examined the effect of redox fluctuations on trace metal mobility in samples collected from two different natural aquatic systems: riparian wetlands and a stream. The wetland soils contained low sulfur and total Fe contents as compared to stream sediments. The mineral composition at both sites was dominated by quartz. We incubated water-saturated soils under three cycles of anoxic-oxic conditions (τanoxic:τoxic = 3) spanning 24 days and monitored the change in dissolved and bioavailable metal concentrations. For both natural systems, reduction of iron oxides under anoxic conditions caused Co and Zn release. In contrast, oxidation of sulfides mobilized Cu under oxic conditions in both sites. In wetland soils, dissolution of Fe (hydr)oxides increased Ni solubility; however, in stream sediments, Ni release occurred when sulfides or organic matter were oxidized. For stream sediments, each subsequent redox cycle increased the bioavailability of trace metals. Redox fluctuations in wetland soils increased bioavailable Zn and Cu and decreased bioavailable Ni and Co. This study illustrates that different trace metals display distinct bioavailability patterns during redox fluctuations in natural environments. The biogeochemical cycling of nutrients in systems with redox fluctuations may be influenced by these trace metal availability patterns in addition to the availability of electron donors and acceptors.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Combined Effects of Stream Hydrology and Land Use on Basin‐Scale Hyporheic Zone Denitrification in the Columbia River Basin

Abstract Denitrification in the hyporheic zone (HZ) of river corridors is crucial to removing excess nitrogen in rivers from anthropogenic activities. However, previous modeling studies of the effectiveness of river corridors in removing excess nitrogen via denitrification were often limited to the reach‐scale and low‐order stream watersheds. We developed a basin‐scale river corridor model for the Columbia River Basin with random forest models to identify the dominant factors associated with the spatial variation of HZ denitrification. Our modeling results suggest that the combined effects of hydrologic variability in reaches and substrate availability influenced by land use are associated with the spatial variability of modeled HZ denitrification at the basin scale. Hyporheic exchange flux can explain most of spatial variation of denitrification amounts in reaches of different sizes, while among the reaches affected by different land uses, the combination of hyporheic exchange flux and stream dissolved organic carbon (DOC) concentration can explain the denitrification differences. Also, we can generalize that the most influential watershed and channel variables controlling denitrification variation are channel morphology parameters (median grain size (D50), stream slope), climate (annual precipitation and evapotranspiration), and stream DOC‐related parameters (percent of shrub area). The modeling framework in our study can serve as a valuable tool to identify the limiting factors in removing excess nitrogen pollution in large river basins where direct measurement is often infeasible.

54 ENVIRONMENTAL SCIENCES↗

Train, Inform, Borrow, or Combine? Approaches to Process–Guided Deep Learning for Groundwater–Influenced Stream Temperature Prediction

Although groundwater discharge is a critical stream temperature control process, it is not explicitly represented in many stream temperature models, an omission that may reduce predictive accuracy, hinder management of aquatic habitat, and decrease user confidence. We assessed the performance of a previously-described process-guided deep learning model of stream temperature in the Delaware River Basin (USA). We found lower accuracy (root mean square error [RMSE] of 1.71 versus 1.35°C) and stronger seasonal bias (absolute mean monthly bias of 1.06 vs. 0.68°C) for reaches primarily influenced by deep groundwater as compared to atmospheric conditions. We then tested four approaches for improving groundwater process representation: (a) a custom loss function leveraging the unique patterns of air and water temperature coupling characteristic of different temperature drivers, (b) inclusion of additional groundwater-relevant catchment attributes, (c) incorporation of additional process model outputs, and (d) a composite model. The custom loss function and the additional attributes significantly improved the predictive accuracy in groundwater-dominated reaches (RMSE of 1.37 and 1.26°C) and reduced the seasonal bias (absolute mean monthly bias of 0.44 and 0.48°C), but neither approach could identify holdout groundwater reaches. Variable importance analysis indicates the custom loss function nudges the model to use the existing inputs more efficiently, whereas with the added features the model relies on a broader suite of inputs. This analysis is a substantial step toward more accurately representing groundwater discharge processes in stream temperature models and will improve predictive accuracy and inform habitat management.

54 ENVIRONMENTAL SCIENCES↗

Two-dimensional single-stream electron motion in a coaxial diode with magnetic insulation

One of the most widespread models of electrons drifting around the cathode in magnetrons is the single-stream state, which is the Brillouin stream with purely azimuthal motion. We describe a single-stream state in which electrons not only move in the azimuthal direction, but also along the axial direction, which is useful for consideration, for example, of relativistic magnetrons, MILOs, and coaxial transmission lines. Relations are given for the conditions of magnetic insulation for 2D electron motion, for 1D azimuthal and axial motion, and for synchronism of these streams with the operating waves of M-type microwave sources. Relations are also provided for the threshold of generation in magnetrons with 2D electron motion.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗