Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data flow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Utah FORGE Hydrothermal Friction-Hydraulic Transmissivity Laboratory Experiments

Submission includes data from laboratory slide-hold-slide tests, combined with flow through tests, conducted on Westerly granite with 30 degree sawcut. Tests were conducted with a constant confining pressure of 30 MPa with an average pore pressure of 10 MPa at temperatures of 23 and 200 degC. Three fluid flow conditions were examined (1) no flow, (2) cycled flow, and (3) continuous flow. Data were collected to asses the effect of temperature and pore fluid on frictional healing rates in granite at geothermal conditions. Data is available in XML and JSON data types.

15 GEOTHERMAL ENERGY↗

AGR-2 Data Qualification Report for ATR Cycles 149B, 150A, 150B, 151A, and 151B

This report provides the data qualification status of AGR-2 fuel irradiation experimental data from Advanced Test Reactor (ATR) cycles 149B, 150A, 150B, 151A, and 151B), as recorded in the Nuclear Data Management and Analysis System (NDMAS). The AGR-2 data streams addressed include thermocouple temperatures, sweep gas data (flow rate, pressure, and moisture content), and fission product monitoring system (FPMS) data for each of the six capsules in the experiment. A total of 3,307,500 5-minute thermocouple and sweep gas data records were received and processed by NDMAS for this period. There are no AGR-2 data for cycle 150A because the experiment was removed from the reactor. Of these data, 82.2% were determined to be Qualified based on NDMAS accuracy testing and data validity assessment. There were 450,557 Failed temperature records due to thermocouple failures, and 138,528 Failed gas flow records due to gas flow cross-talk and leakage problems that occurred in the capsules after cycle 150A. For FPMS data, NDMAS received and processed preliminary release rate and release-to-birth rate ratio (R/B) data for the first three reactor cycles (cycles 149B, 150B, and 151B). This data consists of 45,983 release rate records and 45,235 R/B records for the 12 radionuclides reported. The qualification status of these FPMS data has been set to In Process until receipt of QA-approved data generator reports. All of the above data have been processed and tested using a SAS®-based enterprise application software system, stored in a secure Structured Query Language database, and made available on the NDMAS Web portal (http://ndmas.inl.gov) for both internal and external VHTR project participants.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

AGR 5/6/7 Data Qualification Report for ATR Cycles 162B through 168A

This report provides the qualification status of experimental data for the Advanced Gas Reactor (AGR) 5/6/7 fuel irradiation. AGR-5/6/7 was conducted in the Advanced Test Reactor (ATR) at Idaho National Laboratory (INL) in support of development and qualification of tri-structural isotropic (TRISO) low-enriched fuel for use in high temperature gas-cooled reactors. The objectives of the AGR-5/6/7 experiments are to: (i) irradiate reference-design fuel particles to support fuel qualification, (ii) establish operating margins for the fuel beyond normal operating conditions, and (iii) provide irradiated-fuel performance data and irradiated-fuel samples for post-irradiation examination (PIE) and safety testing. The test train contains five separate capsules that were independently controlled and monitored. Each capsule contains multiple 12.51-mm-long compacts filled with low enriched uranium carbide/oxide (UCO) TRISO fuel particles. The primary objective of the AGR-5/6 test (Capsules 1, 2, 4, and 5) is to verify successful performance of the reference-design fuel under normal operating conditions. The AGR-7 test (Capsule 3) was designed to explore fuel performance at higher temperatures to demonstrate the capability of the fuel to withstand conditions beyond normal operating conditions in support of plant design and licensing. AGR 5/6/7 will also provide irradiated-fuel performance data on fission-gas release from failed particles during irradiation. The AGR-5/6/7 capsules were irradiated in the ATR northeast flux trap location. The experiment began on February 16, 2018 and ended on July 22, 2020, spanning nine ATR cycles over two and a half years. Thus, the AGR-5/6/7 fuel compacts were irradiated for a total of 360.9 effective full power days. The AGR 5/6/7 experiment was able to remain in the reactor core during all three Powered Axial Locator Mechanism (PALM) cycles (163A, 165A, and 167A) without overheating its fuel compacts. This report includes irradiation monitoring data from nine ATR Cycles: 162B, 163A, 164A, 164B, 165A, 166A, 166B, 167A, and 168A, as stored in the Nuclear Data Management and Analysis System (NDMAS). During irradiation, data records consisted of instantaneous measurements recorded every minute and provided by text files automatically every 2 hours. The AGR 5/6/7 data streams addressed in this report include thermocouple (TC) temperatures, sweep gas data (flow rates [capsule inlet, outlet, and downstream at detector], pressure, and moisture content), and Fission Product Monitoring System (FPMS) data (release rates and release to birth rate ratios [R/Bs]) for each of the five capsules. A total of 94,989,908 TC temperature and sweep gas data records were received and processed by NDMAS for AGR 5/6/7 irradiation. Of these records, 41,593,387 (or 43.7% of the total) met data collection and accuracy requirements and are labeled as Qualified. A total of 57,746,693 TC temperature readings were captured from 54 installed TCs. Among them, 10,034,676 TC temperature records (only 17.4%) were Qualified and 47,701,371 TC temperatures (or 82.6%) are Failed due to 48 TC failures (63.5%) and due to missing values (19.1%). To assess performance of the operational TCs, analysis of daily correlations between TCs found no evidence of virtual junction failure for any TCs. Analyses on control charts of TC temperature differences revealed trending in TC readings for TC2, 4, 5, and 13 in Capsule 3, but there is no conclusive indication of TC drift failure that caused those trends. Therefore, TC control charts are not used to disqualify TC data, but only for users’ consideration. For sweep gas flow rates, a total of 31,519,747 gas flow records (84.4%) are Qualified for use for AGR-5/6/7 experiment; 5,723,468 gas flow records (15.4%) are Failed due mostly to missing values; and 74,641 high sweep gas flow rates (0.2 %) are Trend. A large number of Failed missing TC temperature and gas flow values were caused by an error in the data output script that outputted a ‘NULL’ value when values were unchanged. This problem was fixed during the outage of Cycle 166B, which led to a substantially decreased number of missing values during the last three cycles. Nonetheless, a large amount of non-missing data remained because of the high data acquisition frequency (1-minute) and still provided sufficient data to effectively monitor the experiment as designed. For FPMS data, NDMAS received and processed fission product release and R/B data for nine ATR cycles, when ATR core reached full power during AGR 5/6/7 irradiation. These data consist of 110,388 release rate records and 110,388 R/B records for the twelve radionuclides (Kr 85m, Kr 87, Kr 88, Kr 89, Kr 90, Xe 131m, Xe 133, Xe 135, Xe 135m, Xe 137, Xe 138, and Xe 139) for each of the five capsules. Equivalent numbers of uncertainty records associated the release rates and R/B values were provided. To date, qualification status of the FPMS data stored in the NDMAS dat

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Continental Scale Hydrostratigraphy: Comparing Geologically Informed Data Products to Analytical Solutions

Abstract This study synthesizes two different methods for estimating hydraulic conductivity (K) at large scales. We derive analytical approaches that estimate K and apply them to the contiguous United States. We then compare these analytical approaches to three‐dimensional, national gridded K data products and three transmissivity (T) data products developed from publicly available sources. We evaluate these data products using multiple approaches: comparing their statistics qualitatively and quantitatively and with hydrologic model simulations. Some of these datasets were used as inputs for an integrated hydrologic model of the Upper Colorado River Basin and the comparison of the results with observations was used to further evaluate the K data products. Simulated average daily streamflow was compared to daily flow data from 10 USGS stream gages in the domain, and annually averaged simulated groundwater depths are compared to observations from nearly 2000 monitoring wells. We find streamflow predictions from analytically informed simulations to be similar in relative bias and Spearman's rho to the geologically informed simulations. R ‐squared values for groundwater depth predictions are close between the best performing analytically and geologically informed simulations at 0.68 and 0.70 respectively, with RMSE values under 10 m. We also show that the analytical approach derived by this study produces estimates of K that are similar in spatial distribution, standard deviation, mean value, and modeling performance to geologically‐informed estimates. The results of this work are used to inform a follow‐on study that tests additional data‐driven approaches in multiple basins within the contiguous United States.

54 ENVIRONMENTAL SCIENCES↗

Deep Packet/Flow Analysis using GPUs

Deep packet inspection (DPI) faces severe performance challenges in high-speed networks (40/100 GE) as it requires a large amount of raw computing power and high I/O throughputs. Recently, researchers have tentatively used GPUs to address the above issues and boost the performance of DPI. Typically, DPI applications involve highly complex operations in both per-packet and per-flow data level, often in real-time. The parallel architecture of GPUs fits exceptionally well for per-packet network traffic processing. However, for stateful network protocols such as TCP, their data stream need to be reconstructed in a per-flow level to deliver a consistent content analysis. Since the flow-centric operations are naturally antiparallel and often require large memory space for buffering out-of-sequence packets, they can be problematic for GPUs, whose memory is normally limited to several gigabytes. In this work, we present a highly efficient GPU-based deep packet/flow analysis framework. The proposed design includes a purely GPU-implemented flow tracking and TCP stream reassembly. Instead of buffering and waiting for TCP packets to become in sequence, our framework process the packets in batch and uses a deterministic finite automaton (DFA) with prefix-/suffix- tree method to detect patterns across out-of-sequence packets that happen to be located in different batches. In conclusion, evaluation shows that our code can reassemble and forward tens of millions of packets per second and conduct a stateful signature-based deep packet inspection at 55 Gbit/s using an NVIDIA K40 GPU.

97 MATHEMATICS AND COMPUTING↗

Deep Packet/Flow Analysis using GPUs

aDeep packet inspection (DPI) faces severe performance challenges in high-speed networks (40/100 GE) as it requires a large amount of raw computing power and high I/O throughputs. Recently, researchers have tentatively used GPUs to address the above issues and boost the performance of DPI. Typically, DPI applications involve highly complex operations in both per-packet and per-flow data level, often in real-time. The parallel architecture of GPUs fits exceptionally well for per-packet network traffic processing. However, for stateful network protocols such as TCP, their data stream need to be reconstructed in a per-flow level to deliver a consistent content analysis. Since the flow-centric operations are naturally anti-parallel and often require large memory space for buffering out-of-sequence packets, they can be problematic for GPUs, whose memory is normally limited to several gigabytes. In this work, we present a highly efficient GPU-based deep packet/flow analysi s framework. The proposed design includes a purely GPU-implemented flow tracking and TCP stream reassembly. Instead of buffering and waiting for TCP packets to become in sequence, our framework process the packets in batch and uses a deterministic finite automaton (DFA) with prefix-/suffix- tree method to detect patterns across out-of-sequence packets that happen to be located in different batches. Evaluation shows that our code can reassemble and forward tens of millions of packets per second and conduct a stateful signature-based deep packet inspection at 55 Gbit/s using an NVIDIA K40 GPU.

Gong, Qian↗

Insights into Reactivity of Silicon Negative Electrodes: Analysis Using Isothermal Microcalorimetry

Silicon offers high theoretical capacity as a negative electrode material for lithium-ion batteries; however, high irreversible capacity upon initial cycling and poor cycle life have limited commercial adoption. Herein, we report an operando isothermal microcalorimetry (IMC) study of a model system containing lithium metal and silicon composite film electrodes during the first two cycles of (de)lithiation. The total heat flow data are analyzed in terms of polarization, entropic, and parasitic heat flow contributions to quantify and determine the onset of parasitic reactions. These parasitic reactions, which include solid–electrolyte interphase formation, contribute to electrochemical irreversibility. Cycle 1 lithiation demonstrates the highest thermal energy output at 1509 mWh/g, compared to cycle 1 delithiation and cycle 2. To complement the calorimetry, operando X-ray diffraction is used to track the phase evolution of silicon. During cycle 1 lithiation, crystalline Si undergoes transformation to amorphous lithiated silicon and ultimately to crystalline Li 15 Si 4 . The solid-state amorphization process is correlated to a decrease in entropic heat flow, suggesting that heat associated with the amorphization contributes significantly to the entropic heat flow term. In conclusion, this study effectively uses IMC to probe the parasitic reactions that occur during lithiation of a silicon electrode, demonstrating an approach that can be broadly applied to quantify parasitic reactions in other complex systems.

25 ENERGY STORAGE↗

From Edge to HPC: Investigating Cross-Facility Data Streaming Architectures

In this paper, we investigate three cross-facility data streaming architectures, Direct Streaming (DTS), Proxied Streaming (PRS), and Managed Service Streaming (MSS). We examine their architectural variations in data flow paths and deployment feasibility, and detail their implementation using the Data Streaming to HPC (DS2HPC) architectural framework and the SciStream memory-to-memory streaming toolkit on the production-grade Advanced Computing Ecosystem (ACE) infrastructure at Oak Ridge Leadership Computing Facility (OLCF). We present a workflow-specific evaluation of these architectures using three synthetic workloads derived from the streaming characteristics of scientific workflows. Through simulated experiments, we measure streaming throughput, round-trip time, and overhead under work sharing, work sharing with feedback, and broadcast and gather messaging patterns commonly found in AI-HPC communication motifs. Our study shows that DTS offers a minimal-hop path, resulting in higher throughput and lower latency, whereas MSS provides greater deployment feasibility and scalability across multiple users but incurs significant overhead. PRS lies in between, offering a scalable architecture whose performance matches DTS in most cases.

George, Anjus [ORNL] (ORCID:0000000179737061)↗

AGC-3 Experiment Irradiation Monitoring Data Qualification (Final Report)

The Graphite Technology Development Program will run a series of six experiments to quantify the effects of irradiation on nuclear grade graphite. The third experiment, Advanced Graphite Creep 3 (AGC 3), began with Advanced Test Reactor (ATR) Cycle 152B on November 27, 2012, and ended with ATR Cycle 155B on April 23, 2014. This report documents qualification of AGC 3 experiment irradiation monitoring data for use by the Very High Temperature Reactor (VHTR) Technology Development Office (TDO) Program for research and development activities required to design and license the first VHTR nuclear plant. Qualified data meet the requirements for data collection and use as described in the experiment planning and quality assurance documents. Failed data do not meet the requirements. Trend data may not meet the requirements, but may still provide some useable information. All thermocouples (TCs) functioned throughout the AGC 3 experiment. There was one interval between December 18, 2012, and December 20, 2012, where 10 NULL values were reported for various TCs. These NULL values were deleted from the Nuclear Data Management and Analysis System database. All temperature data are Qualified for use by the VHTR TDO Program. Argon, helium, and total gas flow data were within expected ranges and are Qualified for use by the VHTR TDO Program. Total gas flow was approximately 50 sccm through the AGC 3 experiment capsule. Helium gas flow was briefly increased to 100 sccm during ATR shutdowns. At the start of the AGC 3 experiment, moisture in the outflow gas line was stuck at a constant value of 335.6174 ppmv for the first cycle (Cycle 152B). When the AGC 3 experiment capsule was reinstalled in ATR for Cycle 154B, a new moisture filter was installed. Moisture data from Cycle 152B are Failed. All moisture data from the final three cycles (Cycles 154B, 155A, and 155B) are Qualified for use by the VHTR TDO Program.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Geothermal Target Areas in Colorado as Identified by Remote Sensing Techniques

This layer contains the areas identified as targets of potential geothermal activity. The Criteria used to identify the target areas include: hot/warm surface exposures modeled from ASTER/Landsat satellite imagery and geological characteristics, alteration mineral commonly associated with hot springs (clays, Si, and FeOx) modeled from ASTER and Landsat data, Colorado Geological Survey (CGS) known thermal hot springs/wells and heat-flow data points, Colorado deep-seated fault zones, weakened basement identified from isostatic gravity data, and Colorado sedimentary and topographic characteristics.

15 GEOTHERMAL ENERGY↗

Data and script associated with “Shifts in Rain-Snow Partitioning Drive Faster Water Transit Times in the US Pacific Northwest”

This data package contains the data and code to use and run the Water Tracer enabled version of the Weather Research and Forecasting Hydrologic model (WT-WRF-Hydro) with the Sequential Precipitation Input Tagging (SPIT) framework. It is associated with the publication “Shifts in Rain-Snow Partitioning Drive Faster Water Transit Times in the US Pacific Northwest” published in Scientific Reports (Butler et al., 2026; https://doi.org/10.1038/s41598-026-46539-1). We use the Continental U.S. (CONUSII; Rasmussen et al., 2021) dataset to force the model with an historical climate (2006–2013) and a future climate (2086–2093) with a representative carbon pathway (RCP) 8.5 scenario. We use the model to calculate water transit times in five headwater catchments within the U.S. Pacific Northwest. We also show key hydrologic and environmental variables that affect water transit times and changes in the future. Finally, we use observed data to validate the model such as stream water isotopes, snowpack characteristics, and stream discharge. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to a readme, this data package also includes a file-level metadata (FLMD) file that describes each file and a data dictionary (DD) that describes all column/row headers and variable definitions. The data package consists of 11 folders: (1) "Figures" contains the exported figures used in the manuscript; (2) "Model_Isotope_Date" contains the WT-WRF-Hydro isotope date used in model validation; (3) “Model_Outputs_Future” contains the WT-WRF-Hydro future climate outputs; (4) “Model_Outputs_Historical” contains the WT-WRF-Hydro historical climate outputs; (5) “Model_Outputs_Weights_Areas” contains the WT-WRF-Hydro weights per catchment used to calculate water transit times and isotopes in stream water; (6) “MODIS_data_scripts” contains data used to validate snow conditions in the study area; (7) “Observed_Flow_Data” contains the observed streamflow data used in model validation; (8) “Observed_Isotope_Data” contains the observed stream water isotope data used in model validation; (9) “Scripts” contains the Python scripts used to general results and the figures; (10) “Statistic_Outputs” contains the water transit time statistical outputs reported in this manuscript; (11) “Validation_SNOTEL” contains the SNOTEL data used in model validation. The files in this data package have the following file extensions: .tif, .txt, .csv, .pdf, .py, .jpg, and .png.

American River↗

AGR-3/4 Data Qualification Report for ATR Cycles 151A, 151B, 152A, 152B, 154A, and 154B

This data report provides the qualification status of Advanced Gas Reactor-3/4 (AGR-3/4) fuel irradiation experimental data from Advanced Test Reactor (ATR) Cycles 151A, 151B, 152A, 152B, 154A, and 154B, as recorded in the Nuclear Data Management and Analysis System (NDMAS). Of these cycles, ATR Cycle 152A is a low power cycle that occurred when the ATR core was briefly at low power. The irradiation data are not used for physics and thermal calculation, but the qualification status of these cycle data is still covered in this report. On the other hand, during ATR Cycles 153A (unplanned Outage cycle) and 153B (Power Axial Locator Mechanism [PALM] cycle), the AGR-3/4 was pulled out from the ATR core and stored in the canal to avoid being overheated. Therefore, qualification of the AGR-3/4 irradiation data from these 2 cycles was excluded in this report. By the end of ATR Cycle 154B, AGR-3/4 was irradiated for a total of 264.1 effective full power days. The AGR-3/4 data streams addressed in this report include thermocouple (TC) temperatures, sweep gas data (flow rates, pressure, and moisture content), and Fission Product Monitoring System (FPMS) data (release rates and release-to-birth rate ratios [R/Bs]) for each of the twelve capsules in the AGR-3/4 experiment. The final data qualification status for these data streams is determined by a Data Review Committee (DRC) composed of AGR technical leads, Sitewide Quality Assurance (QA), and NDMAS analysts. The DRC convened on February 12, 2014, reviewed the data acquisition process, and considered whether the data met the requirements for data collection as specified in QA-approved Very High Temperature Reactor (VHTR) Technology Development Office (TDO) data collection plans. The DRC also examined the results of NDMAS data testing and statistical analyses, and confirmed the qualification status of the data as given in this report.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A Study of the Transition to Turbulence in a Bed of 67 Spherical Pebbles

Packed beds are commonly found in many engineering systems and have been widely studied for decades. A relatively new packed bed system is the Pebble Bed Reactor, a type of generation-IV nuclear reactor. Unlike many of the packed beds encountered in chemical and process engineering applications, Pebble Bed Reactors are larger and operate at significantly higher Reynolds numbers. As a result of these differences, there is a very limited amount of information on the detailed flow physics that exist in these complex geometries. This work seeks to contribute to a growing database of flow data for Pebble Bed Reactor systems by performing Direct Numerical Simulations of the flow in an experimental bed of 67 pebbles for a range of conditions. Simulations are performed at a Prandtl number of 0.66 and Reynolds numbers from 300–600. These Reynolds numbers are chosen to gain additional knowledge on the spatial development of turbulence in these systems. Analysis of the Turbulent Kinetic Energy, turbulence anisotropy, and Turbulent Heat Flux is performed. Results demonstrate significant development of the TKE across the tested range of Reynolds numbers. Examination of both the TKE and THF reveal that development first occurs near the center of the bed and propagates radially as the flow moves further into the bed. Notable regions of negative production of turbulent kinetic energy are observed in regions where flow accelerates around pebble contact points. Furthermore, these regions are found to coincide with regions of 1-component turbulence.Kindly check and confirm, all authors email id is correctly identified.These are correct

Direct numberical simulation↗

Single-phase, natural circulation annular flow measurements for cartridge loop irradiation experiments

The nuclear industry is increasingly considering cartridge-style experiments for irradiation testing of advanced reactor fuels and materials under flowing conditions. Cartridge loops do not require the extensive support infrastructure that are necessary for external flow loops and minimize the possibility of coolant solidification over the long distance from the reactor to the external facilities. However, there is a general lack of quality flow data for internally heated fluids in an annular configuration representative of a cartridge-type irradiation experiment, particularly one with natural circulation. To address this data need, a series of experiments was conducted to measure the natural circulation flow rates of pressurized water in a sealed, internally heated vessel with annular flow conditions that represent a molten salt or sodium cartridge loop. Temperatures and flow rates were measured under steady-state and transient conditions. Here, this paper describes the facility, methods, and results of the experiments, including the determination of nondimensional parameters. A simple 1D model of the natural convection flow rates agrees well with the experimental results. Applying this model to simulate a liquid salt cartridge experiment predicts that natural circulation flow might be able to provide liquid salt Reynolds numbers similar to those of some molten salt reactor concepts at relevant power densities.

42 ENGINEERING↗

Systems Innovation: Modernization & Efficiencies for ESH&Q Reviews

Environmental compliance reviews at INL have traditionally been managed through fragmented systems, relying on multiple spreadsheets and manual processes. This inefficiency led to time-consuming status updates and redundant tasks, such as manually sending reminder emails and transferring data from Excel to the Environmental Review Process (ERP). Initial attempts to streamline these processes using Power Automate and Excel revealed significant limitations, necessitating a more comprehensive solution. To address these immediate inefficiencies, automated workflows were developed using Power Automate. These workflows were designed to send scheduled status update reminders and capture responses through standardized forms, with submitted data flowing directly into centralized Excel trackers. This automation reduced the administrative burden, improved data accuracy, and enabled faster, more consistent reporting. Specifically, email automation achieved a 65% efficiency gain, while data integration saw a 48% improvement, resulting in 91% of project statuses being updated within two months. Despite the improvements brought by Power Automate, the fragmented nature of the review processes persisted. To further enhance efficiency and accuracy, the Integrated Review Tool (IRT) was developed. The IRT aims to centralize review initiation and connect team systems, creating an interconnected data infrastructure that preserves team autonomy while enhancing overall efficiency. This tool automates email reminders, centralizes reviews, and streamlines data integration, significantly improving the accuracy and efficiency of environmental compliance reviews. The design and development of the IRT involved advanced systems methodology, process mapping, project management, and collaboration with subject matter experts. The minimum viable product design is 100% complete, and system development is currently underway, with expected outcomes including a centralized entry point for all ESH&Q reviews, automated routing, real-time tracking and analytics, AI integration, and a user-friendly interface. This project demonstrates the potential of leveraging automation and integrated systems to enhance efficiency, accuracy, and decision-making in environmental reporting and compliance processes at INL.

99 - GENERAL AND MISCELLANEOUS↗

A Few Thoughts on the E-Tunnel Discharge at Rainier Mesa, Nevada National Security Site

In reviewing the Quarterly Monitoring Reports assembled by Navarro for the Rainier Mesa E-Tunnel discharge for the past year (the “Navarro” data), Greg Raab of the Nevada Department of Environmental Proctection (NDEP) noticed a decreasing trend in the pH and was curious as to what was causing it. He noticed an upswing in the March 2016 data and speculated as to whether the trend would go up. Irene Farnham (Navarro) sent along the Navarro chemical and flow data from ETunnel, going back for some of the variables to 1997. Previously I was curious as to whether there was a trend in the discharge flow rates from E-Tunnel that corresponded to Greg Raab’s observations and comments about the decreasing trend in pH observed between 2015 and 2016. So, I plotted the two time series from the Navarro data over roughly the same time period that Greg looked at. There does not appear to be much of a correlation. (NB: The value of 7.1 for January 2016 differs from the value of ~6.55 in Greg’s data).

54 ENVIRONMENTAL SCIENCES↗

Object Proxy Patterns for Accelerating Distributed Applications

Workflow and serverless frameworks have empowered new approaches to distributed application design by abstracting compute resources. However, their typically limited or one-size-fits-all support for advanced data flow patterns leaves optimization to the application programmer—optimization that becomes more difficult as data become larger. The transparent object proxy, which provides wide-area references that can resolve to data regardless of location, has been demonstrated as an effective low-level building block in such situations. Here we propose three high-level proxy-based programming patterns—distributed futures, streaming, and ownership—that make the power of the proxy pattern usable for more complex and dynamic distributed program structures. We motivate these patterns via careful review of application requirements and describe implementations of each pattern. As a result, we evaluate our implementations through a suite of benchmarks and by applying them in three meaningful scientific applications, in which we demonstrate substantial improvements in runtime, throughput, and memory usage.

Distributed Computing↗