SEARCH · Engineering Papers

Results for “stream storage”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Virtual Log-Structured Storage for High-Performance Streaming

Over the past decade, given the higher number of data sources (e.g., Cloud applications, Internet of things) and critical business demands, Big Data transitioned from batch-oriented to real-time analytics. Stream storage systems, such as Apache Kafka, are well known for their increasing role in real-time Big Data analytics. For scalable stream data ingestion and processing, they logically split a data stream topic into multiple partitions. Stream storage systems keep multiple data stream copies to protect against data loss while implementing a stream partition as a replicated log. This architectural choice enables simplified development while trading cluster size with performance and the number of streams optimally managed. This paper introduces a shared virtual log-structured storage approach for improving the cluster throughput when multiple producers and consumers write and consume in parallel data streams. Stream partitions are associated with shared replicated virtual logs transparently to the user, effectively separating the implementation of stream partitioning (and data ordering) from data replication (and durability). We implement the virtual log technique in the KerA stream storage system. When comparing with Apache Kafka, KerA improves the cluster ingestion throughput by up to 4x when multiple producers write over hundreds of data streams.

consistent stream ordering↗

DOE OSTI2023

Numerical evaluation of photosensitive tracers as a strategy for separating surface and subsurface transient storage in streams

For this work, we numerically evaluated photosensitive tracers as a potential strategy for separating the effects of surface and hyporheic storage zones (SSZs and HSZs, respectively) on stream corridor transport. Correctly separating HSZ and SSZ effects is critical to estimating the hydro-biogeochemical function of a stream because HSZs and SSZs expose solutes to significantly different biogeochemical conditions, like sunlight exposure, microbial processes, and oxygen availability. Our numerical experiments used a multiscale river-corridor transport model implemented in the ATS code, which accommodates multiple storage zones with distinct travel time distributions and biogeochemical reactions. For parameter inferences, we used Bayesian inverse modeling. We found that breakthrough curves for photo-decaying tracers from day and night injection can delineate surface and hyporheic transient storage contributions, but only when interpreted jointly through a two-storage zone model. Numerical experiments that used only daytime injection or interpreted breakthrough curves with a single storage zone model yielded good fit to breakthrough curves, but parameter estimates were biased and controlling processes misattributed, examples of good model fits for the wrong reasons. Using those biased parameter estimates in reactive transport simulations resulted in significantly different projections of denitrification, which underscores the potential for stream function to be mischaracterized if tracer tests are interpreted through an inappropriately simplified model for transient storage. More generally, this study highlights the role of modeling in evaluating the experimental design and identifying the potential of system mischaracterization and its implications.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Model data for numerical evaluation of photosensitive tracers as a strategy for separating surface and subsurface transient storage in streams

This model-data archive pertains to a study aimed at the numerical evaluation of the photosensitive tracers as a potential strategy for separating the effects of surface and hyporheic storage zones (SSZs and HSZs, respectively). Separating effects of SSZ and HSZ are important for accurately representing stream function as HSZs and SSZs expose solutes to significantly different biogeochemical conditions. We perform numerical experiments using a multiscale reactive transport model for stream corridors implemented in ATS code, which allows for representing multiple storage zones with their respective travel time distributions and biogeochemistry. For each of the numerical experiment, we provide in this model-data archive python wrapper to drive ATS (forward_model.py), synthetic observation (synthetic_btc.py, BTC_observed.csv), forward model files including ATS input (multiscale_transport.tpl), PFLOTRAN inputs (reactions_channel.tpl, reactions_hz.tpl, reactions_sz.tpl), MCMC (mcmc_run.py), predictive uncertainty (pred_uncert.py, BTCs_simulated_day.csv, BTCs_simulated_night.csv), MCMC outputs (tracer_test_GR.npy, tracer_test_logps.npy, tracer_test_parameters.npy) and Jupyter notebook for post-processing and visualization (post-processing.ipynb). For the denitrification application, ATS input file (denitrification_multisubgrid.tpl), PFLOTRAN input files (denitrification_channel.in, denitrification_hz.in), predictive uncertainty (pred_uncert_denitrification.py, BTCs_simulated_DO.csv, BTCs_simulated_DOC.csv, BTCs_simulated_Nitrate.csv).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Conservative solute transport processes and associated transient storage mechanisms: Comparing streams with contrasting channel morphologies, land use and land cover

Abstract Land use within a watershed impacts stream channel morphology and hydrology and, therefore, in‐stream solute transport processes and associated transient storage mechanisms. This study evaluated transport processes in two contrasting stream sites where channel morphology was influenced by the surrounding land use, land cover, climate and geologic controls: Como Creek, CO, a relatively undisturbed, high gradient, forested stream with a gravel bed and complex channel morphology, and Clear Creek, IA, an incised, low‐gradient stream with low‐permeability substrate draining an agricultural landscape. We performed conservative stream tracer injections at these sites to address the following questions: (1) How does solute transport vary between streams with differing morphologies? and (2) How does solute transport at each stream site change as a function of discharge? We analysed in‐stream tracer time series data and compared results quantifying solute attenuation in surface and subsurface transient storage zones. Significant trends were observed in these metrics with varying discharge conditions at the forested site but not at the agricultural site. There was a broad range of transport mechanisms and evidence of substantial exchange with both surface and hyporheic transient storage in the relatively undisturbed, forested stream. Changing discharge conditions activated or deactivated different solute transport mechanisms in the forested site and greatly impacted advective travel time. Conversely in the simplified agricultural stream, there was a narrow range of solute transport behaviour across flows and predominantly surface transient storage at all measured discharge conditions. These results demonstrate how channel simplification inhibits available solute transport mechanisms across varying discharge conditions.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

VDiSC: An Open Source Framework for Distributed Smart City Vision and Biometric Surveillance Networks

Recent global growth in the interest of smart cities has led to trillions of dollars of investment toward research and development. These connected cities have the potential to create a symbiosis of technology and society and revolutionize the cost of living, safety, ecological sustainability, and quality of life of societies on a world-wide scale. Some key components of the smart city construct are connected smart grids, self-driving cars, federated learning systems, smart utilities, large-scale public transit, and proactive surveillance systems. While exciting in prospect, these technologies and their subsequent integration cannot be attempted without addressing the potential societal impacts of such a high degree of automation and data sharing. Additionally, the feasibility of coordinating so many disparate tasks will require a fast, extensible, unifying framework. To that end, we propose the Distributed Smart City framework for Vision, or VDiSC. VDiSC serves as a unified biometric API harness that allows for seamless evaluation, deployment, and simple pipeline creation for heterogeneous biometric software. VDiSC additionally provides a fully declarative capability for defining and coordinating custom machine learning and sensor pipelines, allowing the distribution of processes across otherwise incompatible hardware and networks. VDiSC ultimately provides a way to quickly configure, hot-swap, and expand large coordinated or federated systems online without interruptions for maintenance. Because much of the data collected in a smart city contains Personally Identifying Information (PII), VDiSC also provides built-in tools and layers to ensure secure and encrypted streaming, storage, and access of PII data across distributed systems.

Brogan, Joel↗

DOE OSTI2024

Elastic deformation as a tool to investigate watershed storage connectivity

Storage-discharge relationships and dynamic changes in storage connectivity remain key unknowns in understanding and predicting watershed behavior. In this study, we use Global Positioning System measurements of load-induced Earth surface displacement as a proxy for total water storage change in four climatologically diverse mountain watersheds in the western United States. Comparing total water storage estimates with stream-connected storage derived from hydrograph analysis, we find that each of the investigated watersheds exhibits a characteristic seasonal pattern of connection and disconnection between total and stream-connected storage. We investigate how the degree and timing of watershed-scale connectivity is related to the timing of precipitation and seasonal changes in dominant hydrologic processes. Our results show that elastic deformation of the Earth due to water loading is a powerful new tool for elucidating dynamic storage connectivity and watershed discharge response across scales in space and time.

Environmental Sciences & Ecology↗

DOE OSTI2024

Semi–Analytical Modeling of Transient Stream Drawdown and Depletion in Response to Aquifer Pumping

Analytical and semi–analytical models for stream depletion with transient stream stage drawdown induced by groundwater pumping are developed to address a deficiency in existing models, namely, the use of a fixed stream stage condition at the stream–aquifer interface. Here field data are presented to demonstrate that stream stage drawdown does indeed occur in response to groundwater pumping near aquifer–connected streams. A model that predicts stream depletion with transient stream drawdown is developed based on stream channel mass conservation and finite stream channel storage. The resulting models are shown to reduce to existing fixed–stage models in the limit as stream channel storage becomes infinitely large, and to the confined aquifer flow with a no–flow boundary at the streambed in the limit as stream storage becomes vanishingly small. The model is applied to field measurements of aquifer and stream drawdown, giving estimates of aquifer hydraulic parameters, streambed conductance, and a measure of stream channel storage. The results of the modeling and data analysis presented herein have implications for sustainable groundwater management.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2007

Increased Water Storage at Ice-stream Onsets: A Critical Mechanism?

The interdependence of rapid ice flow, surface topography and the spatial distribution of subglacial water are examined by linking existing theories. The motivation is to investigate whether the acceleration of an ice-stream tributary contains a positive feedback that encourages the retention of subglacial water that leads to faster flow. Periodically varying surface and bed topographies are related through a linear ice-flow perturbation theory for various values of mean surface slope, perturbation amplitude and basal sliding speeds. The topographic variations lead to a periodic variation in hydraulic potential that is used to infer the tendency for subglacial water to be retained in local hydraulic potential minima. If water retention leads to enhanced basal sliding, a positive feedback loop is closed that could explain the transition from slower tributary flow to faster-streaming flow and the sustained downstream acceleration along the tributary-ice-stream system. A sensitivity study illustrates that the same range of topographic wavelengths most effectively transmitted from the bed to the surface also strongly influences the behavior of subglacial water. A lubrication index is defined to qualitatively measure the heterogeneity of the subglacial hydrologic system. Application of this index to field data shows that the transition from tributary to ice stream closely agrees with the location where subglacial water may be first stored.

Bindschadler, Robert↗

DOE OSTI2025

Electricity Markets and Long-Duration Energy Storage: A Survey of Grid Services and Revenue Streams

Purpose of Review Long Duration Energy Storage (LDES) is increasingly viewed as a potential resource for providing grid services that enhance the stability and flexibility of electricity systems. While some LDES services are integrated into existing market frameworks, traditional mechanisms may not fully account for their operational characteristics, potentially leading to undervaluation. Within this context, this paper reviews the literature and industry practices to assess potential grid services for LDES, evaluates existing compensation mechanisms, and identifies challenges to full market integration. Recent Findings We first review existing literature and identify key grid services unique to LDES, including enhancing grid resilience during extreme weather events, enabling long-term energy shifting, and providing flexible and firm energy in systems with limited dispatchable resources. Here, we also review how LDES services are compensated in current market frameworks and the challenges associated with the full realization of LDES values. Additionally, we summarize market mechanisms for storage technologies across U.S. wholesale markets. We find that some markets are adjusting incentive structures, such as incorporating storage duration in capacity accreditation, to better align with system needs and LDES contributions to the grid. However, further refinements in capacity remuneration and dispatch timeframes may be needed for more effective realization of LDES value. Summary This review evaluates potential grid services for LDES, examines existing compensation mechanisms for LDES technologies, and identifies gaps between these mechanisms and LDES operational characteristics. The review concludes by outlining potential market enhancements for more effective LDES integration and articulating additional research needs to support its efficient participation in future power systems.

Flexible resources↗

DOE OSTI2023

A Three-Tier Incremental Approach for Development of Smart Corridor Digital Twins

Development of an arterial smart corridor digital twin requires the integration of real time data streams, data storage, and simulation model execution. This process may be complex, time consuming, and susceptible to errors. To aid in smart corridor digital twin development this paper seeks to provide a framework, best practices, and development guidance. As such, a three-tier incremental approach to smart corridor digital twin development is presented. The paper highlights practical issues in digital twin construction along with key data challenges based on experiences from the development of digital twins for two large Smart Corridor deployments, one in Chattanooga, Tennessee, and the other in Atlanta, Georgia. The presented three-tier incremental approach includes: 1) development of a prepopulated offline simulation, 2) development of a pseudo digital twin that is driven by archived data, and 3) integration of real time data streams to create the online digital twin model. The three-tiered approach facilitates conducting multiple trials and scenarios with increasing complexity, allowing for incremental error processing and updating of the digital twin.

Saroj, Abhilasha↗

NASA NTRS2002

Adapting Digital Libraries to Continual Evolution

In this paper, we describe five investment streams (data storage infrastructure, knowledge management, data production control, data transport and security, and personnel skill mix) that need to be balanced against short-term operating demands in order to maximize the probability of long-term viability of a digital library. Because of the rapid pace of information technology change, a digital library cannot be a static institution. Rather, it has to become a flexible organization adapted to continuous evolution of its infrastructure.

Barkstrom, Bruce R.↗

NASA NTRS2013

Energy Harvesting Systems and Methods of Assembling Same

A method of assembling an energy harvesting system is provided. The method includes coupling at least one energy storage device in flow communication with at least one apparatus that is configured to generate thermal energy and to transfer the thermal energy into at least one fluid stream. The energy storage device is configured to store the fluid stream. Moreover, the method includes coupling at least one fluid transfer device downstream from the energy storage device. The fluid transfer device receives the fluid stream from the energy storage device. A bladeless turbine is coupled in flow communication with the fluid transfer device, wherein the bladeless turbine receives the fluid stream to generate power.

Cepeda-Rizo, Juan↗

DOE OSTI2022

Transient Storage Model Parameter Optimization Using the Simulated Annealing Method

Hyporheic exchange in streams is critical to ecosystem functions such as nutrient cycling along river corridors, especially for slowly moving or small stream systems. The transient storage model (TSM) has been widely used for modeling of hyporheic exchange. TSM calibration, for hyporheic exchange, is typically used to estimate four parameters, including the mass exchange rate coefficient, the dispersion coefficient, stream cross-sectional area, and hyporheic zone cross-sectional area. Prior studies have raised concerns regarding the non-uniqueness of the inverse problem for the TSM, that is, the occurrence of different parameter vectors resulting in TSM solution that reproduces the observed in-stream tracer break through curve (BTC) with the same error. This leads to practical non-identifiability in determining the unknown parameter vector values even when global-optimal values exist, and the parameter optimization becomes practically non-unique. To address this problem, we applied the simulated annealing method to calibrate the TSM to BTCs, because it is less susceptible to local minima-induced non-identifiability. A hypothetical (or synthetic) tracer test data set with known parameters was developed to demonstrate the capability of the simulated annealing method to find the global minimum parameter vector, and it identified the “hypothetically-true” global minimum parameter vector even with input data that were modified with up to 10% noise without increasing the number of iterations required for convergence. The simulated annealing TSM was then calibrated using two in-stream tracer tests conducted in East Fork Poplar Creek, Tennessee. In conclusion, simulated annealing was determined to be appropriate for quantifying the TSM parameter vector because of its search capability for the global minimum parameter vector.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Energy Storage Valuation: A Review of Use Cases and Modeling Tools

An enticing prospect that drives adoption of energy storage systems (ESS) is its ability to be used in a diverse set of use cases and the potential to take advantage of multiple unique value streams. The Energy Storage Grand Challenge (ESGC) technology development pathways for storage technologies draw from a set of use cases in the electrical power system, each with their own specific cost and performance needs. In addition to the need for cost and performance improvements for storage technologies, there a need for robust valuation methods to enable effective policy, investment, business models, and resource planning. There are numerous storage valuation tools available to the public, many of which can analyze the value of an ESS project with inputs and characteristics that reflect a specific storage use case. To effectively reach ESS stakeholders that may be interested in learning about valuation models, this report will draw from publicly available tools developed by the Department of Energy (DOE) and frame their functionalities and capabilities within the context of three distinct use case families. This report examines three of the ESGC use case families in depth and provides a methodology in which interested stakeholders can determine which DOE modeling tool is best suited to value ESS for their specific case. The high-level objectives for this report include: (1) Provide specific sub use-cases for each use case family for further characterization; (2) Provide technical parameters and relevant data for three example use cases that could be used in a valuation tool; (3) Identify a list of publicly available DOE tools that can provide energy storage valuation insights for ESS use case stakeholders; (4) Provide information on the capabilities and different options in each modeling tool; (5) Make conclusions on which are best suited for valuing certain functional/performance requirements and which tools might be applicable to other use cases; and (6) Show the methodology that informs a Model Selection Platform (MSP) framework that educates stakeholders on different DOE models and provides a streamlined way to choose the right model that most closely matches their needs.

25 ENERGY STORAGE↗

DOE OSTI2021

Energy Storage in South Asia: Understanding the Role of Grid-Connected Energy Storage in South Asia’s Power Sector Transformation

During the last decade, the cost of energy storage technologies, primarily lithium-ion battery energy storage systems (BESS), has declined rapidly and is projected to decline further over the next decade. This study provides a first-of-its-kind assessment of cost-effective opportunities for grid-scale energy storage deployment in South Asia both in the near term and the long term, including a detailed analysis of energy storage drivers, potential barriers, and the role of energy storage in system operations. We conduct scenarios-based capacity expansion modeling to assess when, where and how much energy storage can be cost-effectively deployed in India through 2050. The analysis relies on state-of-the-art modeling approaches to uncover and compare the value streams of battery storage with different durations as well as pumped storage hydropower. We also run hourly simulations of system operations in 2030 and 2050 to understand how energy storage will be utilized by system operators to help integrate RE and reduce operating costs. For Bangladesh, Bhutan, and Nepal, we use operational simulations to explore how increasing deployment of energy storage can help optimize the use of domestic resources and cross-border electricity trade.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2024

Toward a Universal Model of Hyporheic Exchange and Nutrient Cycling in Streams

In this paper we demonstrate that several ubiquitous hyporheic exchange mechanisms can be represented simply as a one-dimensional diffusion process, where the diffusivity decays exponentially with depth into the streambed. Based on a meta-analysis of 106 previously published laboratory measurements of hyporheic exchange (capturing a range of bed morphologies, hydraulic conditions, streambed properties, and experimental approaches) we find that the reference diffusivity and mixing length-scale are functions of the permeability Reynolds Number and Schmidt Number. These dimensionless numbers, in turn, can be estimated for a particular stream from the median grain size of the streambed and the stream's depth, slope, and temperature. Application of these results to a seminal study of nitrate removal in 72 headwater streams across the United States, reveals: (a) streams draining urban and agricultural landscapes have a diminished capacity for in-stream and in-bed mixing along with smaller subsurface storage zones compared to streams draining reference landscapes; (b) under steady-state conditions nitrate uptake in the streambed is primarily biologically controlled; and (c) median reaction timescales for nitrate removal in the hyporheic zone are 0.5 and 20 hr for uptake by assimilation and denitrification, respectively. While further research is needed, the simplicity and extensibility of the framework described here should facilitate cross-disciplinary discussions and inform reach-scale studies of pollutant fate and transport and their scale-up to watersheds and beyond.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Catalytic Removal of Oxygen Impurities from Pressurized Oxy-Combustion Flue Gas for the Production of High-Purity Carbon Dioxide

Flue gas purification is important for pressurized oxy-combustion systems to produce pure carbon dioxide (CO 2 ) streams ready for storage or utilization. A catalytic approach to removing oxygen (O 2 ) impurities from pressurized oxy-combustion flue gas via reduction with methane (CH 4 ) was investigated in this work. Two types of catalysts were studied: palladium (Pd)-based catalysts supported on titania (TiO 2 ) prepared by incipient wetness impregnation and cobalt–manganese (CoMn) composite catalysts prepared by coprecipitation. The performance of the catalysts was evaluated in a high-pressure–high-temperature, fixed-bed reactor at a pressure of 15 bar and a gas hourly space velocity of 30 000 h –1 (standard conditions), with a simulated feeding gas composed of 3 vol % O 2 , 1.5 vol % CH 4 , and CO 2 as the balance gas. Among the Pd catalysts, 5% Pd/TiO 2 achieved the maximum 86% O 2 removal at ≥350 °C. The CoMn oxide catalysts displayed comparable or better activities for O 2 reduction compared with the Pd catalysts. Among them, the Co 40 Mn 1 catalyst exhibited the best performance, able to reduce 99.9% of O 2 impurities at ~370 °C with negligible carbon monoxide (CO) formation (<10 ppmv). Both trivalent and divalent Co and Mn were detected on the catalyst surface, and the superior activity of Co 40 Mn 1 might be associated with the resultant disordered structure. Furthermore, the activity of the catalyst was not affected by the presence of a trace amount of nitric oxide (NO) gas contaminant. Results of this study provide the basis for scale-up studies in both the synthesis and performance of non-noble metal catalysts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

Accurate and confident prediction of electron beam longitudinal properties using spectral virtual diagnostics

Abstract Longitudinal phase space (LPS) provides a critical information about electron beam dynamics for various scientific applications. For example, it can give insight into the high-brightness X-ray radiation from a free electron laser. Existing diagnostics are invasive, and often times cannot operate at the required resolution. In this work we present a machine learning-based Virtual Diagnostic (VD) tool to accurately predict the LPS for every shot using spectral information collected non-destructively from the radiation of relativistic electron beam. We demonstrate the tool’s accuracy for three different case studies with experimental or simulated data. For each case, we introduce a method to increase the confidence in the VD tool. We anticipate that spectral VD would improve the setup and understanding of experimental configurations at DOE’s user facilities as well as data sorting and analysis. The spectral VD can provide confident knowledge of the longitudinal bunch properties at the next generation of high-repetition rate linear accelerators while reducing the load on data storage, readout and streaming requirements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗