Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stream storage”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Virtual Log-Structured Storage for High-Performance Streaming

Over the past decade, given the higher number of data sources (e.g., Cloud applications, Internet of things) and critical business demands, Big Data transitioned from batch-oriented to real-time analytics. Stream storage systems, such as Apache Kafka, are well known for their increasing role in real-time Big Data analytics. For scalable stream data ingestion and processing, they logically split a data stream topic into multiple partitions. Stream storage systems keep multiple data stream copies to protect against data loss while implementing a stream partition as a replicated log. This architectural choice enables simplified development while trading cluster size with performance and the number of streams optimally managed. This paper introduces a shared virtual log-structured storage approach for improving the cluster throughput when multiple producers and consumers write and consume in parallel data streams. Stream partitions are associated with shared replicated virtual logs transparently to the user, effectively separating the implementation of stream partitioning (and data ordering) from data replication (and durability). We implement the virtual log technique in the KerA stream storage system. When comparing with Apache Kafka, KerA improves the cluster ingestion throughput by up to 4x when multiple producers write over hundreds of data streams.

consistent stream ordering↗

Numerical evaluation of photosensitive tracers as a strategy for separating surface and subsurface transient storage in streams

For this work, we numerically evaluated photosensitive tracers as a potential strategy for separating the effects of surface and hyporheic storage zones (SSZs and HSZs, respectively) on stream corridor transport. Correctly separating HSZ and SSZ effects is critical to estimating the hydro-biogeochemical function of a stream because HSZs and SSZs expose solutes to significantly different biogeochemical conditions, like sunlight exposure, microbial processes, and oxygen availability. Our numerical experiments used a multiscale river-corridor transport model implemented in the ATS code, which accommodates multiple storage zones with distinct travel time distributions and biogeochemical reactions. For parameter inferences, we used Bayesian inverse modeling. We found that breakthrough curves for photo-decaying tracers from day and night injection can delineate surface and hyporheic transient storage contributions, but only when interpreted jointly through a two-storage zone model. Numerical experiments that used only daytime injection or interpreted breakthrough curves with a single storage zone model yielded good fit to breakthrough curves, but parameter estimates were biased and controlling processes misattributed, examples of good model fits for the wrong reasons. Using those biased parameter estimates in reactive transport simulations resulted in significantly different projections of denitrification, which underscores the potential for stream function to be mischaracterized if tracer tests are interpreted through an inappropriately simplified model for transient storage. More generally, this study highlights the role of modeling in evaluating the experimental design and identifying the potential of system mischaracterization and its implications.

54 ENVIRONMENTAL SCIENCES↗

Model data for numerical evaluation of photosensitive tracers as a strategy for separating surface and subsurface transient storage in streams

This model-data archive pertains to a study aimed at the numerical evaluation of the photosensitive tracers as a potential strategy for separating the effects of surface and hyporheic storage zones (SSZs and HSZs, respectively). Separating effects of SSZ and HSZ are important for accurately representing stream function as HSZs and SSZs expose solutes to significantly different biogeochemical conditions. We perform numerical experiments using a multiscale reactive transport model for stream corridors implemented in ATS code, which allows for representing multiple storage zones with their respective travel time distributions and biogeochemistry. For each of the numerical experiment, we provide in this model-data archive python wrapper to drive ATS (forward_model.py), synthetic observation (synthetic_btc.py, BTC_observed.csv), forward model files including ATS input (multiscale_transport.tpl), PFLOTRAN inputs (reactions_channel.tpl, reactions_hz.tpl, reactions_sz.tpl), MCMC (mcmc_run.py), predictive uncertainty (pred_uncert.py, BTCs_simulated_day.csv, BTCs_simulated_night.csv), MCMC outputs (tracer_test_GR.npy, tracer_test_logps.npy, tracer_test_parameters.npy) and Jupyter notebook for post-processing and visualization (post-processing.ipynb). For the denitrification application, ATS input file (denitrification_multisubgrid.tpl), PFLOTRAN input files (denitrification_channel.in, denitrification_hz.in), predictive uncertainty (pred_uncert_denitrification.py, BTCs_simulated_DO.csv, BTCs_simulated_DOC.csv, BTCs_simulated_Nitrate.csv).

54 ENVIRONMENTAL SCIENCES↗

Conservative solute transport processes and associated transient storage mechanisms: Comparing streams with contrasting channel morphologies, land use and land cover

Abstract Land use within a watershed impacts stream channel morphology and hydrology and, therefore, in‐stream solute transport processes and associated transient storage mechanisms. This study evaluated transport processes in two contrasting stream sites where channel morphology was influenced by the surrounding land use, land cover, climate and geologic controls: Como Creek, CO, a relatively undisturbed, high gradient, forested stream with a gravel bed and complex channel morphology, and Clear Creek, IA, an incised, low‐gradient stream with low‐permeability substrate draining an agricultural landscape. We performed conservative stream tracer injections at these sites to address the following questions: (1) How does solute transport vary between streams with differing morphologies? and (2) How does solute transport at each stream site change as a function of discharge? We analysed in‐stream tracer time series data and compared results quantifying solute attenuation in surface and subsurface transient storage zones. Significant trends were observed in these metrics with varying discharge conditions at the forested site but not at the agricultural site. There was a broad range of transport mechanisms and evidence of substantial exchange with both surface and hyporheic transient storage in the relatively undisturbed, forested stream. Changing discharge conditions activated or deactivated different solute transport mechanisms in the forested site and greatly impacted advective travel time. Conversely in the simplified agricultural stream, there was a narrow range of solute transport behaviour across flows and predominantly surface transient storage at all measured discharge conditions. These results demonstrate how channel simplification inhibits available solute transport mechanisms across varying discharge conditions.

54 ENVIRONMENTAL SCIENCES↗

VDiSC: An Open Source Framework for Distributed Smart City Vision and Biometric Surveillance Networks

Recent global growth in the interest of smart cities has led to trillions of dollars of investment toward research and development. These connected cities have the potential to create a symbiosis of technology and society and revolutionize the cost of living, safety, ecological sustainability, and quality of life of societies on a world-wide scale. Some key components of the smart city construct are connected smart grids, self-driving cars, federated learning systems, smart utilities, large-scale public transit, and proactive surveillance systems. While exciting in prospect, these technologies and their subsequent integration cannot be attempted without addressing the potential societal impacts of such a high degree of automation and data sharing. Additionally, the feasibility of coordinating so many disparate tasks will require a fast, extensible, unifying framework. To that end, we propose the Distributed Smart City framework for Vision, or VDiSC. VDiSC serves as a unified biometric API harness that allows for seamless evaluation, deployment, and simple pipeline creation for heterogeneous biometric software. VDiSC additionally provides a fully declarative capability for defining and coordinating custom machine learning and sensor pipelines, allowing the distribution of processes across otherwise incompatible hardware and networks. VDiSC ultimately provides a way to quickly configure, hot-swap, and expand large coordinated or federated systems online without interruptions for maintenance. Because much of the data collected in a smart city contains Personally Identifying Information (PII), VDiSC also provides built-in tools and layers to ensure secure and encrypted streaming, storage, and access of PII data across distributed systems.

Brogan, Joel↗

Elastic deformation as a tool to investigate watershed storage connectivity

Storage-discharge relationships and dynamic changes in storage connectivity remain key unknowns in understanding and predicting watershed behavior. In this study, we use Global Positioning System measurements of load-induced Earth surface displacement as a proxy for total water storage change in four climatologically diverse mountain watersheds in the western United States. Comparing total water storage estimates with stream-connected storage derived from hydrograph analysis, we find that each of the investigated watersheds exhibits a characteristic seasonal pattern of connection and disconnection between total and stream-connected storage. We investigate how the degree and timing of watershed-scale connectivity is related to the timing of precipitation and seasonal changes in dominant hydrologic processes. Our results show that elastic deformation of the Earth due to water loading is a powerful new tool for elucidating dynamic storage connectivity and watershed discharge response across scales in space and time.

Environmental Sciences & Ecology↗

Semi–Analytical Modeling of Transient Stream Drawdown and Depletion in Response to Aquifer Pumping

Analytical and semi–analytical models for stream depletion with transient stream stage drawdown induced by groundwater pumping are developed to address a deficiency in existing models, namely, the use of a fixed stream stage condition at the stream–aquifer interface. Here field data are presented to demonstrate that stream stage drawdown does indeed occur in response to groundwater pumping near aquifer–connected streams. A model that predicts stream depletion with transient stream drawdown is developed based on stream channel mass conservation and finite stream channel storage. The resulting models are shown to reduce to existing fixed–stage models in the limit as stream channel storage becomes infinitely large, and to the confined aquifer flow with a no–flow boundary at the streambed in the limit as stream storage becomes vanishingly small. The model is applied to field measurements of aquifer and stream drawdown, giving estimates of aquifer hydraulic parameters, streambed conductance, and a measure of stream channel storage. The results of the modeling and data analysis presented herein have implications for sustainable groundwater management.

54 ENVIRONMENTAL SCIENCES↗

Electricity Markets and Long-Duration Energy Storage: A Survey of Grid Services and Revenue Streams

Purpose of Review Long Duration Energy Storage (LDES) is increasingly viewed as a potential resource for providing grid services that enhance the stability and flexibility of electricity systems. While some LDES services are integrated into existing market frameworks, traditional mechanisms may not fully account for their operational characteristics, potentially leading to undervaluation. Within this context, this paper reviews the literature and industry practices to assess potential grid services for LDES, evaluates existing compensation mechanisms, and identifies challenges to full market integration. Recent Findings We first review existing literature and identify key grid services unique to LDES, including enhancing grid resilience during extreme weather events, enabling long-term energy shifting, and providing flexible and firm energy in systems with limited dispatchable resources. Here, we also review how LDES services are compensated in current market frameworks and the challenges associated with the full realization of LDES values. Additionally, we summarize market mechanisms for storage technologies across U.S. wholesale markets. We find that some markets are adjusting incentive structures, such as incorporating storage duration in capacity accreditation, to better align with system needs and LDES contributions to the grid. However, further refinements in capacity remuneration and dispatch timeframes may be needed for more effective realization of LDES value. Summary This review evaluates potential grid services for LDES, examines existing compensation mechanisms for LDES technologies, and identifies gaps between these mechanisms and LDES operational characteristics. The review concludes by outlining potential market enhancements for more effective LDES integration and articulating additional research needs to support its efficient participation in future power systems.

Flexible resources↗

A Three-Tier Incremental Approach for Development of Smart Corridor Digital Twins

Development of an arterial smart corridor digital twin requires the integration of real time data streams, data storage, and simulation model execution. This process may be complex, time consuming, and susceptible to errors. To aid in smart corridor digital twin development this paper seeks to provide a framework, best practices, and development guidance. As such, a three-tier incremental approach to smart corridor digital twin development is presented. The paper highlights practical issues in digital twin construction along with key data challenges based on experiences from the development of digital twins for two large Smart Corridor deployments, one in Chattanooga, Tennessee, and the other in Atlanta, Georgia. The presented three-tier incremental approach includes: 1) development of a prepopulated offline simulation, 2) development of a pseudo digital twin that is driven by archived data, and 3) integration of real time data streams to create the online digital twin model. The three-tiered approach facilitates conducting multiple trials and scenarios with increasing complexity, allowing for incremental error processing and updating of the digital twin.

Saroj, Abhilasha↗

Transient Storage Model Parameter Optimization Using the Simulated Annealing Method

Hyporheic exchange in streams is critical to ecosystem functions such as nutrient cycling along river corridors, especially for slowly moving or small stream systems. The transient storage model (TSM) has been widely used for modeling of hyporheic exchange. TSM calibration, for hyporheic exchange, is typically used to estimate four parameters, including the mass exchange rate coefficient, the dispersion coefficient, stream cross-sectional area, and hyporheic zone cross-sectional area. Prior studies have raised concerns regarding the non-uniqueness of the inverse problem for the TSM, that is, the occurrence of different parameter vectors resulting in TSM solution that reproduces the observed in-stream tracer break through curve (BTC) with the same error. This leads to practical non-identifiability in determining the unknown parameter vector values even when global-optimal values exist, and the parameter optimization becomes practically non-unique. To address this problem, we applied the simulated annealing method to calibrate the TSM to BTCs, because it is less susceptible to local minima-induced non-identifiability. A hypothetical (or synthetic) tracer test data set with known parameters was developed to demonstrate the capability of the simulated annealing method to find the global minimum parameter vector, and it identified the “hypothetically-true” global minimum parameter vector even with input data that were modified with up to 10% noise without increasing the number of iterations required for convergence. The simulated annealing TSM was then calibrated using two in-stream tracer tests conducted in East Fork Poplar Creek, Tennessee. In conclusion, simulated annealing was determined to be appropriate for quantifying the TSM parameter vector because of its search capability for the global minimum parameter vector.

54 ENVIRONMENTAL SCIENCES↗

Energy Storage Valuation: A Review of Use Cases and Modeling Tools

An enticing prospect that drives adoption of energy storage systems (ESS) is its ability to be used in a diverse set of use cases and the potential to take advantage of multiple unique value streams. The Energy Storage Grand Challenge (ESGC) technology development pathways for storage technologies draw from a set of use cases in the electrical power system, each with their own specific cost and performance needs. In addition to the need for cost and performance improvements for storage technologies, there a need for robust valuation methods to enable effective policy, investment, business models, and resource planning. There are numerous storage valuation tools available to the public, many of which can analyze the value of an ESS project with inputs and characteristics that reflect a specific storage use case. To effectively reach ESS stakeholders that may be interested in learning about valuation models, this report will draw from publicly available tools developed by the Department of Energy (DOE) and frame their functionalities and capabilities within the context of three distinct use case families. This report examines three of the ESGC use case families in depth and provides a methodology in which interested stakeholders can determine which DOE modeling tool is best suited to value ESS for their specific case. The high-level objectives for this report include: (1) Provide specific sub use-cases for each use case family for further characterization; (2) Provide technical parameters and relevant data for three example use cases that could be used in a valuation tool; (3) Identify a list of publicly available DOE tools that can provide energy storage valuation insights for ESS use case stakeholders; (4) Provide information on the capabilities and different options in each modeling tool; (5) Make conclusions on which are best suited for valuing certain functional/performance requirements and which tools might be applicable to other use cases; and (6) Show the methodology that informs a Model Selection Platform (MSP) framework that educates stakeholders on different DOE models and provides a streamlined way to choose the right model that most closely matches their needs.

25 ENERGY STORAGE↗

Energy Storage in South Asia: Understanding the Role of Grid-Connected Energy Storage in South Asia’s Power Sector Transformation

During the last decade, the cost of energy storage technologies, primarily lithium-ion battery energy storage systems (BESS), has declined rapidly and is projected to decline further over the next decade. This study provides a first-of-its-kind assessment of cost-effective opportunities for grid-scale energy storage deployment in South Asia both in the near term and the long term, including a detailed analysis of energy storage drivers, potential barriers, and the role of energy storage in system operations. We conduct scenarios-based capacity expansion modeling to assess when, where and how much energy storage can be cost-effectively deployed in India through 2050. The analysis relies on state-of-the-art modeling approaches to uncover and compare the value streams of battery storage with different durations as well as pumped storage hydropower. We also run hourly simulations of system operations in 2030 and 2050 to understand how energy storage will be utilized by system operators to help integrate RE and reduce operating costs. For Bangladesh, Bhutan, and Nepal, we use operational simulations to explore how increasing deployment of energy storage can help optimize the use of domestic resources and cross-border electricity trade.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Toward a Universal Model of Hyporheic Exchange and Nutrient Cycling in Streams

In this paper we demonstrate that several ubiquitous hyporheic exchange mechanisms can be represented simply as a one-dimensional diffusion process, where the diffusivity decays exponentially with depth into the streambed. Based on a meta-analysis of 106 previously published laboratory measurements of hyporheic exchange (capturing a range of bed morphologies, hydraulic conditions, streambed properties, and experimental approaches) we find that the reference diffusivity and mixing length-scale are functions of the permeability Reynolds Number and Schmidt Number. These dimensionless numbers, in turn, can be estimated for a particular stream from the median grain size of the streambed and the stream's depth, slope, and temperature. Application of these results to a seminal study of nitrate removal in 72 headwater streams across the United States, reveals: (a) streams draining urban and agricultural landscapes have a diminished capacity for in-stream and in-bed mixing along with smaller subsurface storage zones compared to streams draining reference landscapes; (b) under steady-state conditions nitrate uptake in the streambed is primarily biologically controlled; and (c) median reaction timescales for nitrate removal in the hyporheic zone are 0.5 and 20 hr for uptake by assimilation and denitrification, respectively. While further research is needed, the simplicity and extensibility of the framework described here should facilitate cross-disciplinary discussions and inform reach-scale studies of pollutant fate and transport and their scale-up to watersheds and beyond.

54 ENVIRONMENTAL SCIENCES↗

Catalytic Removal of Oxygen Impurities from Pressurized Oxy-Combustion Flue Gas for the Production of High-Purity Carbon Dioxide

Flue gas purification is important for pressurized oxy-combustion systems to produce pure carbon dioxide (CO 2 ) streams ready for storage or utilization. A catalytic approach to removing oxygen (O 2 ) impurities from pressurized oxy-combustion flue gas via reduction with methane (CH 4 ) was investigated in this work. Two types of catalysts were studied: palladium (Pd)-based catalysts supported on titania (TiO 2 ) prepared by incipient wetness impregnation and cobalt–manganese (CoMn) composite catalysts prepared by coprecipitation. The performance of the catalysts was evaluated in a high-pressure–high-temperature, fixed-bed reactor at a pressure of 15 bar and a gas hourly space velocity of 30 000 h –1 (standard conditions), with a simulated feeding gas composed of 3 vol % O 2 , 1.5 vol % CH 4 , and CO 2 as the balance gas. Among the Pd catalysts, 5% Pd/TiO 2 achieved the maximum 86% O 2 removal at ≥350 °C. The CoMn oxide catalysts displayed comparable or better activities for O 2 reduction compared with the Pd catalysts. Among them, the Co 40 Mn 1 catalyst exhibited the best performance, able to reduce 99.9% of O 2 impurities at ~370 °C with negligible carbon monoxide (CO) formation (<10 ppmv). Both trivalent and divalent Co and Mn were detected on the catalyst surface, and the superior activity of Co 40 Mn 1 might be associated with the resultant disordered structure. Furthermore, the activity of the catalyst was not affected by the presence of a trace amount of nitric oxide (NO) gas contaminant. Results of this study provide the basis for scale-up studies in both the synthesis and performance of non-noble metal catalysts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Accurate and confident prediction of electron beam longitudinal properties using spectral virtual diagnostics

Abstract Longitudinal phase space (LPS) provides a critical information about electron beam dynamics for various scientific applications. For example, it can give insight into the high-brightness X-ray radiation from a free electron laser. Existing diagnostics are invasive, and often times cannot operate at the required resolution. In this work we present a machine learning-based Virtual Diagnostic (VD) tool to accurately predict the LPS for every shot using spectral information collected non-destructively from the radiation of relativistic electron beam. We demonstrate the tool’s accuracy for three different case studies with experimental or simulated data. For each case, we introduce a method to increase the confidence in the VD tool. We anticipate that spectral VD would improve the setup and understanding of experimental configurations at DOE’s user facilities as well as data sorting and analysis. The spectral VD can provide confident knowledge of the longitudinal bunch properties at the next generation of high-repetition rate linear accelerators while reducing the load on data storage, readout and streaming requirements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Peatland hydrology across scale: a probabilistic framework for confronting variability, heterogeneity, and uncertainty (Final Report)

Our project aimed to guide the representations of peatland hydrology and water-carbon feedbacks within Earth System Models, by improving process understanding and developing parsimonious models that elucidate the effects of hydroclimatic variability and spatial heterogeneity. Our research questions centered on the three key drivers of peatland hydrology: (1) seasonal and interannual hydroclimatic fluctuations, (2) spatial heterogeneity of peatland microtopography, and (3) hydrological connectivity across landscape units within a peatland watershed. Our analyses and model testing used existing long-term datasets within the Marcell Experimental Forest (MEF), with new data collected whenever necessary. To date, we have demonstrated the strong influence of water table elevations on the temperature sensitivity of CH 4 emissions, using a newly developed eddy covariance dataset spanning eleven years at MEF. Specifically, higher water tables dampen the increase in CH 4 emissions in the spring as well as their decrease in the fall, resulting in hysteresis. These results imply that any hydroclimatological changes in peatlands that shift seasonal water availability from winter to summer will increase annual CH 4 emissions, even if soil temperature remains unchanged. To further investigate water table elevation change within the peatland microtopography, we installed automated water table gauges across four bog-forest transects (the “lagg”) in two peatland watersheds at MEF, which are hotspots of intense biogeochemical activity. These measurements will give us new information about the extent of lagg expansion and contraction during snowmelt and high intensity rainfall events, as well as the directionality of water and nutrient flow into the bog from the surrounding forests. Finally, we investigated the hydrological connectivity across the peatland watershed complex during early spring – a critical period where water table is elevated from snowmelt – using extended hydrological records from MEF (e.g., snow and frost depths, water table elevations, streamflow). The importance of thermal and wintertime processes within the Energy Exascale Earth System Model (E3SM) was determined through sensitivity analyses. Results from data analyses show that (i) streamflow has decreased over decades likely due to increased evapotranspiration rates (despite no detectable trends in precipitation), (ii) spring streamflow generation is controlled by a sequence of fill-and-spill pathways from the snowpack to the stream through peatland water stores, and (iii) frost depth is a key explanatory variable for the timing and magnitude of streamflow. These results suggest that frost plays an important role in connecting surface water storage in peatlands to stream outlets, and that the hydrological connectivity across the peatland watershed complex can mediate the sensitivity of hydrological responses to climate variations.

54 ENVIRONMENTAL SCIENCES↗

Energy Storage in Long-Term System Models: A Review of Considerations, Best Practices, and Research Needs

Technological change and policy support have heightened expectations for the role of energy storage in power systems, creating a need to enhance representations of energy storage in long-term models to inform decision-making. Energy storage technologies have complex and diverse cost, value, and performance characteristics that make them challenging to model, but there is limited guidance about best practices and research gaps for energy storage analysis. This paper reviews the literature and draws upon our collective experience to provide recommendations to analysts on approaches for representing energy storage in long-term electric sector models, navigating tradeoffs in model development, and identifying research gaps for existing tools and data. The review focuses on national-scale models with technological, temporal, and regional detail given their prevalence in planning and policy, though many insights are transferable to other modeling contexts. It also offers guidance to consumers of model outputs on proper use and interpretation based on model strengths and limitations. In particular, this review demonstrates the importance of capturing how the values of energy storage and other resources change as the system composition changes (e.g. with different levels of storage, renewables deployment, and emissions outcomes). These considerations require model detail like high spatiotemporal resolutions and endogenous investments that global integrated assessment models and price-taker frameworks do not typically resolve. Research gaps include linking tools of different resolutions, developing reduced-form representations of value streams, incorporating hybrid energy storage and renewable systems, and representing longer-duration energy storage technologies.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

SPECs Early-Stage Decision Model: User Manual

The SPECs Early-Stage Decision (ESD) model is central to the SPECs procurement solutions toolkit. The ESD model is an Excel-based spreadsheet model, which provides information about the economic and strategic value of a proposed battery-storage project or solar-plus-storage (solar-plus) project. The model can be used to explore combinations of storage-related project value streams in order to define a potential project, while educating co-op decision-makers about project benefits and costs. A sensitivity analysis function speeds the development of "what-if" scenarios. A gap analysis function solves for top-priority metrics and supports the inclusion of hard-to-monetize strategic values, such as the value of storage to defer costly system upgrades in light of increasing distributed solar and other distributed energy resources (DERs). Model outputs include the utility data, assumptions, and use-case scenarios that are recommended content for the requests for proposals (RFPs). The model may also provide an initial "sanity check" for RFP responses, supporting further discussions among utility staff, vendors and stakeholders. The ESD is not a "finance-grade" modeling tool, and users are cautioned to be mindful of its limitations, but the model has been reviewed by users, who recommend it as a way to drive faster and better project design and planning, as well as to facilitate better communications with vendors, grid partners, and stakeholders.

14 SOLAR ENERGY↗