Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Modelling the Milky Way – I. Method and first results fitting the thick disc and halo with DES-Y3 data

ABSTRACT We present a technique to fit the stellar components of the Galaxy by comparing Hess Diagrams (HDs) generated from trilegal models to real data. We apply this technique, which we call mwfitting, to photometric data from the first 3 yr of the Dark Energy Survey (DES). After removing regions containing known resolved stellar systems such as globular clusters, dwarf galaxies, nearby galaxies, the Large Magellanic Cloud, and the Sagittarius Stream, our main sample spans a total area of ∼2300 deg2. We further explore a smaller subset (∼1300 deg2) that excludes all regions with known stellar streams and stellar overdensities. Validation tests on synthetic data possessing similar properties to the DES data show that the method is able to recover input parameters with a precision better than 3 per cent. We fit the DES data with an exponential thick disc model and an oblate double power-law halo model. We find that the best-fitting thick disc model has radial and vertical scale heights of 2.67 ± 0.09 kpc and 925 ± 40 pc, respectively. The stellar halo is fit with a broken power-law density profile with an oblateness of 0.75 ± 0.01, an inner index of 1.82 ± 0.08, an outer index of 4.14 ± 0.05, and a break at 18.52 ± 0.27 kpc from the Galactic centre. Several previously discovered stellar overdensities are recovered in the residual stellar density map, showing the reliability of mwfitting in determining the Galactic components. Simulations made with the best-fitting parameters are a promising way to predict Milky Way star counts for surveys such as the LSST and Euclid.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Total metal, carbon, anion, iron speciation, and sulfide concentrations; Slate River, East River, and Trail Creek surface water and floodplains, Crested Butte, CO; May 2023–August 2023

This data package comprises analytical results and metadata from stream and groundwater samples collected from the Slate River, East River, Trail Creek, and their respective floodplains. This dataset contains five files: (1) a samples file (2023_SFA_Field_samples.csv) that contains site information; (2) a chemical analysis data file (2023_FieldWaterSampleData_IC__ICPOES__ICPMS__TOC__Fe__S_chem_data.csv) that contains sample analysis values; (3) a file-level metadata file (flmd.csv) that lists each file contained in the dataset with associated metadata; (4) a data dictionary file (dd.csv) that contains column/row headers used throughout the files along with definitions, units, and data types; and (5) a methods file (methods.csv) that contains ID, type, description, instrument, and lab information for each method.The samples’ anion concentrations were measured using ion chromatography (IC), total metal concentrations using inductively coupled plasma emission spectrometry (ICP-OES) and inductively coupled plasma mass spectrometry (ICP-MS), non-purgeable organic carbon using total organic carbon (TOC) analysis, dissolved sulfide concentration using methylene blue spectrophotometry, and iron speciation using the ferrozine assay. To support bulk chemical analyses and colloid characterization, samples were collected from multiple depths ranging from the surface to 3.5 meters below ground.Update on 2024-10-18: Updates were made to the 2023_FieldWaterSampleData_IC__ICPOES__ICPMS__TOC__Fe__S_chem_data.csv and dd.csv files to correct units (ppb instead of ppm).

54 ENVIRONMENTAL SCIENCES↗

Advancing stream temperature prediction with a generalizable large-sample framework across CONUS river reaches

Accurately predicting stream temperature in ungauged basins remains a critical challenge for water resource management, thermoelectric power plant cooling, and ecosystem conservation. Large-sample machine learning models trained on hundreds of well-monitored river basins have shown remarkable performance; however, such models have yet to be developed solely using forcing data that can be readily extracted to simulate stream temperatures anywhere in the contiguous United States (CONUS). In this study, we present a scalable, large-sample deep learning framework using Long Short-Term Memory (LSTM) networks to simulate daily stream temperatures in ungauged basins across the CONUS. The framework leverages both modeled reanalysis of meteorological and streamflow inputs as well as static attributes available for all 2.7 million CONUS river reaches in the National Hydrography Dataset Plus (NHDPlusV2). By generating dynamical inputs from predefined thermally relevant upstream contributing areas, rather than the entire upstream basin, the model also offers improvements in very large basins where full-basin averaging can dilute the most important influences on stream temperature. Evaluated across 300 basins, the model achieves a median Mean Absolute Error (MAE) of 1.1 °C and a Nash-Sutcliffe Efficiency (NSE) of 0.95 on temporally and spatially distinct test folds—comparable to models trained exclusively using meteorological and streamflow observational data. The flexible, high-performing framework generalizes to any unmonitored river reach without significant regulation or unnatural thermal input immediately upstream, substantially expanding predictive capabilities in data-scarce regions.

Hydrology↗

Phoenix: A Scalable Streaming Hypergraph Analysis Framework

We present Phoenix, a scalable hypergraph analytics framework for data analytics and knowledge discovery that was implemented on the leadership class computing platforms at Oak Ridge National Laboratory (ORNL). Our software framework comprises a distributed implementation of a streaming server architecture which acts as a gateway for various hypergraph generators/external sources to connect. Phoenix has the capability to utilize diverse hypergraph generators, including HyGen, a very large-scale hypergraph generator developed by ORNL. Phoenix incorporates specific algorithms for efficient data representation by exploiting hidden structures of the hypergraphs. Our experimental results demonstrate Phoenix’s scalable and stable performance on massively parallel computing platforms. Phoenix’s superior performance is due to the merging of high-performance computing with data analytic.

Kurte, Kuldeep↗

Flexible and Accessible 4D Subsurface Visualization Using a Web-Based Platform

4D subsurface visualization using a web platform can provide improved communication, education and outreach to non-experts and stakeholders. It allows for the improved understanding of complex relationships and interactions that occur in inaccessible locations of which many experimental testbeds exist in. The use of a web-based visualization tool lessens the cognitive impact further by reducing the need of specialized software. Users can define their own exploration of a 3D or 4D scene, adding and removing data as needed and are able to make informed decisions based on accurate model visualizations, while providing a collaborative tool that can be accessed on any platform using a browser window. The tool is also able to point to real time streams to display up-to-the-second data as an experiment is ongoing. This level of latency can also provide operators with essential information that can direct an experiment’s progress. Additionally, this tool can leverage augmented and virtual reality (AR, VR) capabilities of certain mobile devices and head-mounted displays, providing further engaging visualization possibilities.

Pratt, Martin J.↗

On the Hunt for the Origins of the Orphan–Chenab Stream: Detailed Element Abundances with APOGEE and Gaia

Stellar streams in the Galactic halo are useful probes of the assembly of galaxies like the Milky Way. Many tidal stellar streams that have been found in recent years are accompanied by a known progenitor globular cluster or dwarf galaxy. However, the Orphan–Chenab (OC) stream is one case where a relatively narrow stream of stars has been found without a known progenitor. In an effort to find the parent of the OC stream, we use astrometry from the early third data release of ESA's Gaia mission (Gaia EDR3) and radial velocity information from the Sloan Digital Sky Survey (SDSS)-IV Apache Point Observatory Galactic Evolution Experiment (APOGEE) survey to find up to 13 stars that are likely members of the OC stream. We use the APOGEE survey to study the chemical nature (for up to 10 stars) of the OC stream in the α (O, Mg, Ca, Si, Ti, and S), odd-Z (Al, K, and V), Fe-peak (Fe, Ni, Mn, Co, and Cr), and neutron-capture (Ce) elemental groups. We find that the stars that make up the OC stream are not consistent with a monometallic population and have a median metallicity of -1.92 dex with a dispersion of 0.28 dex. Our results also indicate that the α elements are depleted compared to the known Milky Way populations and that its [Mg/Al] abundance ratio is not consistent with second-generation stars from globular clusters. The detailed chemical pattern of these stars, namely the [α/Fe]–[Fe/H] plane and the metallicity distribution, indicates that the OC stream progenitor is very likely to be a dwarf spheroidal galaxy with a mass of ~10 6 M ⊙ .

79 ASTRONOMY AND ASTROPHYSICS↗

Partitioning of Radionuclides in Various Streams of the Mo-99 Purification Process

The Universal Neutron Irradiator (UNI) was designed to irradiate a small volume of uranium solution and to achieve high fission power without creating a large radionuclide (RN) inventory. The UNI system is equipped with a fully enclosed off-gas system with online hydrogen gas monitoring to prevent the production of an explosive atmosphere, as well as storage cylinders for capturing fission gases. It also includes a catalytic recombiner in the target capsule (to immediately recombine radiolytic hydrogen and oxygen gas in the system) and access ports for sampling the target solution and capsule headspace. In UNI Phase I experiments, 50 mL of uranyl sulfate solution was irradiated at 0.3–0.5 W/mL fission power using a tantalum target assembly to produce photoneutrons via irradiation with an electron beam. The purposes of the Phase I experiments were to test the efficacy of adding 200 ppm Fe 2+ to the target solution to prevent uranyl peroxide precipitation under representative irradiation conditions, and to monitor iodine speciation in the irradiated uranyl sulfate solution. The focus of the UNI Phase II experiments was to use an irradiated uranyl sulfate solution containing a mixture of fission products and monitor their distribution in various streams during the primary recovery column (titania-based column) that separates Mo-99 from uranium. Irradiations were designed to create sufficient activity for tracking their distribution in various processing streams using a combination of gamma counting and inductively coupled plasma mass spectrometry (ICP-MS) analyses. Obtained data will be used to better understand the composition of waste streams, accumulation of RN on the titania column, and identify what RNs accumulate in the uranyl sulfate solution. Furthermore, this knowledge will allow us to determine waste classifications for various streams produced during the Mo-99 purification process and develop an appropriate waste clean-up strategy.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Comparison of fiber-optic distributed temperature sensing and high-sensitivity sensor spatial surveying of stream temperature

Measuring surface water temperature spatial variability is needed to estimate the interaction between surface water and groundwater, evaluate fish habitat and thermal inertia, and to estimate streamflow frequency and duration. Fiber optic distributed temperature sensing (FO-DTS) has been used in rivers and lakes, providing high-resolution and sensitive temperature monitoring over large temporal and spatial scales. However, in streams with cobbly or bedrock-lined streambeds and variable bathymetry, use of FO-DTS to measure temperature close to the surface water and groundwater interface can be challenging if even feasible. FO-DTS can also be costly, involve difficult installations, and require an advanced understanding of the technology, calibration, and data processing. In this study, we compared FO-DTS stream temperature survey results to an alternative temperature survey method employing a towed transect of high-resolution temperature loggers spaced at 1-m and transported in the stream along the study reach, to measure the spatial distribution of stream-water temperature in East Fork Poplar Creek near Oak Ridge, Tennessee, USA. We assessed the applicability and limitations of the two methods, and quantitatively compared in-situ temperature survey results measured simultaneously with each method. Regression results showed strong temporal and spatial correlation between the two methods. Differences were only elevated near the stream banks in areas that were coincident with correlation slope deviations from unity, which was attributed to shallower water and lower data density. Kriging standard errors were also low at channel center with minor increases near the stream banks. Furthermore, the results suggested that the array of the individual temperature sensors can provide a practical alternative to FO-DTS for thermal characterization of surface water, providing slightly lower spatial and temporal resolution, but with higher accuracy of temperature measurement, with greater simplicity, and with a broader range of conditions where it may be applied.

54 ENVIRONMENTAL SCIENCES↗

Energy Materials Chemistry Integrating Theory, Experiment and Data Science (Final Report)

The Energy Materials Chemistry Integrating Theory, Experiment and Data Science (EM-CITED) project is a multidisciplinary research effort focused on accelerating discovery of scientific knowledge via incorporation of data science and artificial intelligence in materials chemistry research. The project aims to advance materials chemistry-aware data science to unify theory and experiment knowledge streams. The work resulted in foundational AI frameworks for materials chemistry – Deep Reasoning Networks (DRNets), Hierarchical Correlation Learning for Multi-property Prediction (H-CLMP), and Material-to-Spectrum (Mat2Spec) prediction – as well as a host of strategies for accelerated scientific discoveries through principled incorporation of data science in computational and experimental research.

36 MATERIALS SCIENCE↗

Dataset for 'Stream Temperature Predictions for River Basin Management in the Pacific Northwest and Mid-Atlantic Regions Using Machine Learning', Water 2022

This data package presents forcing data, model code, and model output for classical machine learning models that predict monthly stream water temperature as presented in the manuscript ‘Stream Temperature Predictions for River Basin Management in the Pacific Northwest and Mid-Atlantic Regions Using Machine Learning’, Water (Weierbach et al., 2022). Specifically, for input forcing datasets we include two files each generated using the BASIN-3D data integration tool (Varadharajan et al., 2022) for stations in the Pacific Northwest and Mid Atlantic Hydrologic regions. Model code (written in python with the use of jupyter notebooks) includes codes for data preprocessing, training Multiple Linear Regression, Support Vector Regression, and Extreme Gradient Boosted Tree models, and additional notebooks for analysis of model output. We include specific model output files which represent modeling configurations presented in the manuscript also presented in an hdf5 format. Together, these data make up the workflow for predictions across three scenarios (single station, regional, and predictions in unmonitored basins) presented in the manuscript and allow for reproducibility of modeling procedures.

54 ENVIRONMENTAL SCIENCES↗

2032 and 2036 risk enhancement from NEOs in the Taurid stream: Is there a significant coherent component to impact risk?

Impact risk is normally quantified by summing the product of the probability of an event and some measure of its consequences over the set of all possible events. The probability factor is considered to be more objective and is based on the size frequency distribution of Near Earth objects (NEOs) and an implicit assumption of randomness, which can be described as “stochastic risk”. Impact frequency does change with time, however, and there have been episodes in the deep geological past when the flux has been much higher. The hypothesis of “coherent catastrophism” suggests large variations on shorter timescales. It postulates the existence of a “Taurid resonant swarm” (TRS) of debris associated with Comet Encke that is stabilized by Jupiter and in a 7:2 resonance with it. The hypothetical cluster orbits in the broad Taurid stream, which crosses Earth's orbit twice a year at its nodes. Whereas the most extreme and fanciful versions of coherent catastrophism in recent geologic history have been comprehensively refuted, the possibility of a significant component of coherent (time-dependent) risk, associated with non-random correlated events, remains. This paper incorporates recently published data from observational campaigns associated with the Taurid stream. There is no evidence for objects in the Taurid stream that are above the global catastrophe threshold, but the possibility of a few large objects and a significant population of objects the size of the Chelyabinsk or Tunguska bodies has not been eliminated. Eyewitness accounts and comparison of airburst models to ground truth suggest that the Tunguska object was a Beta Taurid. The Tunguska event is probably an outlier when compared to the size frequency distributions under stochastic assumptions, but if there is a significant coherent component it may be representative of events that take place far more frequently, and risk assessments may have underestimated the contribution from airbursts. If so, the Earth will experience increased risk from objects this size, peaking in November 2032 and June 2036. We recommend targeted survey campaigns during these hypothetical TRS node crossings to quantify the population, search for potentially hazardous objects, and identify imminent impactors.

79 ASTRONOMY AND ASTROPHYSICS↗

Demonstrating Cross-Facility Data Processing at Scale with Laue Microdiffraction

In February and April 2023 live, at-scale data processing demonstrations were conducted between the Advanced Photon Source (APS), a synchrotron light source, and the Argonne Leadership Computing Facility (ALCF). These tests were run as part of a novel beamline technique: coded aperture laue micro-diffraction. This technique requires a significant amount of compute to decode appeture patterns embedded in the detector stream. An autonomous system was able to send data to ALCF during an experiment, utilize 50 nodes of the Polaris supercomputer to process 6-12 hour scans, and return the data back to the APS within 12-15 minutes behind the detector. With scan points arriving every 72 seconds, the system kept up with the beamline, potentially enabling in-experiment analysis. The data processing system utilizes Globus infrastructure and an on-demand queue to dynamically acquire nodes on Polaris. The underlying reconstruction algorithms were parallelized via MPI and accelerated with custom CUDA kernels.

Prince, Michael↗

Retracted: Monitoring Hatchery Broodstock Composition and Genetic Variation of Spring/Summer Chinook Salmon in the Columbia River Basin with Multigeneration Pedigrees

Abstract Hatchery production of Chinook Salmon Oncorhynchus tshawytscha in the Columbia River basin comprises most of the anadromous salmonid production in this region. Hatchery facilities and programs serve to mitigate for impacts to salmonids due to the construction and operation of hydropower dams and habitat impacts from development in addition to the conservation and restoration of natural populations. A genetic method referred to as parentage-based tagging (PBT) enables highly reliable detection of hatchery-origin fish and inference of multigeneration pedigrees. This study compiles 11 years of PBT data from nearly 125,000 interior stream-type Chinook Salmon from 24 spawning hatcheries located in tributaries of the mid- and upper Columbia River as well as the Salmon, Clearwater, and Grande Ronde River subbasins. Multigenerational pedigrees allowed investigation of the proportion of natural- and hatchery-origin broodstock (pNOB and pHOB, respectively) for each hatchery and enumeration of the scale of production between segregated and integrated programs. We then compared how pHOB and the scale of production influenced the number of stray fish observed, genetic diversity, relatedness, and age-class compositions within broodstocks. Over 91.0% of hatchery broodstock could be assigned back to their parents, and there was an overall rate of less than 1.0% of broodstock that were unintentionally incorporated into nonnatal hatchery programs. We evaluated 14 segregated programs with 0.0–10.0% pNOB, 7 intermediate programs (10.1–50.0% pNOB), and 3 integrated programs (>50.0% pNOB). There was no correlation between the scale of production or pNOB with the level of genetic diversity, but as production size increased, so did the effective number of breeders. This study demonstrates the utility of PBT as a monitoring tool for hatchery broodstocks, and results suggest that segregated and integrated programs have tradeoffs that generally align with their intended broodstock management purpose of providing fish for harvest and/or fish for supplementation or reintroduction.

Horn, Rebekah L.↗

Multigeneration Pedigrees to Monitor Hatchery Broodstock Composition and Genetic Variation of Spring/Summer Chinook Salmon in the Columbia River Basin

Abstract Hatchery production of Chinook Salmon Oncorhynchus tshawytscha in the Columbia River basin comprises most of the anadromous salmonid production in this region. Hatchery facilities and programs serve to mitigate for impacts to salmonids due to the construction and operation of hydropower dams and habitat impacts from development in addition to the conservation and restoration of natural populations. A genetic method referred to as parentage-based tagging (PBT) enables highly reliable detection of hatchery-origin fish and inference of multigeneration pedigrees. This study compiles 11 years of PBT data from nearly 125,000 interior stream-type Chinook Salmon from 24 spawning hatcheries located on tributaries of the mid- and upper Columbia River and in the Salmon, Clearwater, and Grande Ronde River subbasins. Multigenerational pedigrees allowed for investigation of the proportions of natural- and hatchery-origin broodstock (pNOB and pHOB, respectively) for each hatchery and enumeration of the scale of production between segregated and integrated programs. We then compared how pHOB and the scale of production influenced the number of stray fish observed, genetic diversity, relatedness, and age-class compositions within broodstocks. Over 91.0% of hatchery broodstock could be assigned back to their parents, and overall less than 1.0% of broodstock consisted of fish that were unintentionally incorporated into nonnatal hatchery programs. We evaluated 11 segregated programs with 0.0–10.0% pNOB, 9 intermediate programs (10.1–50.0% pNOB), and 3 integrated programs (>50.0% pNOB). There was no correlation between the scale of production or pNOB with the level of genetic diversity, but as production size increased, so did the effective number of breeders. This study demonstrates the utility of PBT as a monitoring tool for hatchery broodstocks, and results suggest that segregated and integrated programs have tradeoffs that generally align with their intended broodstock management purpose of providing fish for harvest and/or fish for supplementation or reintroduction.

Horn, Rebekah L.↗

An empirical study of I/O separation for burst buffers in HPC systems

To meet the exascale I/O requirements for the High-Performance Computing (HPC), a new I/O subsystem, Burst Buffer, based on solid state drives (SSD), has been developed. However, the diverse HPC workloads and the bursty I/O pattern cause severe data fragmentation that requires costly garbage collection (GC) and increases the number of bytes written to the SSD. To address this data fragmentation challenge, a new multi-stream feature has been developed for SSDs. In this work, we develop an I/O Separation scheme called BIOS to leverage this multi-stream feature to group the I/O streams based on the user IDs. We propose a stream-aware scheduling policy based on burst buffer pools in the workload manager, and integrate the BIOS with the workload manager to optimize the I/O separation scheme in burst buffer. We evaluate the proposed framework with a burst buffer I/O traces from Cori Supercomputer including a diverse set of applications. Experimental results show that the BIOS could improve the performance by 1.44x on average and reduce the Write Amplification Factor (WAF) by up to 1.20x. Finally, these demonstrate the potential benefits of the I/O separation scheme for solid state storage systems.

97 MATHEMATICS AND COMPUTING↗

The ladder and readout cables of intermediate silicon strip detector for sPHENIX

A new silicon-strip-type detector was developed for precise charged-particle tracking in the central rapidity region of heavy ion collisions. A new detector and collaboration at the Relativistic Heavy Ion Collider at Brookhaven National Laboratory is sPHENIX, which is a major upgrade of the PHENIX detector. The intermediate tracker (INTT) is part of the advanced tracking system of the sPHENIX detector complex together with a CMOS monolithic-active-pixel-sensor based silicon-pixel vertex detector, a time-projection chamber, and a micromegas-based detector. The INTT detector is barrel shaped and comprises 56 silicon ladders. Two different types of strip sensors of 78 micron pitch and 320 micron thick are mounted on each half of a silicon ladder. Each strip sensor is segmented into 8 × 2 and 5 × 2 blocks with lengths of 16 and 20 mm. Strips are read out with a silicon strip-readout (FPHX) chip. In order to transmit massive data from the FPHX to the down stream readout electronics card (ROC), a series of long and high speed readout cables were developed. This document focuses on the silicon ladder, the readout cables, and the ROC of the INTT. The radiation hardness is studied for some parts of the INTT devices in the last part of this document, since the INTT employed some materials from the technology frontier of the industry whose radiation hardness is not necessarily well known.

43 PARTICLE ACCELERATORS↗

Iodine Flowsheet Status Report

A simplified flowsheet was developed to evaluate the impact of varied assumptions of I-129 decontamination factors on the overall I-129 material balance in the Direct Feed Low-Activity Waste (DFLAW) facility. The flowsheet allows inputs for I-129 feed and Decontamination Factors (DFs) for multiple DFLAW unit operations and provides information on I-129 partitioning to output streams. A series of 6 DFs were evaluated, including baseline DFs from a prior Waste Treatment and Immobilization Plant (WTP) study and refined values based on a Savannah River National Laboratory (SRNL) review. The Microsoft Excel flowsheet spreadsheet will be provided to WRPS to allow further evaluation of the impact of DF assumptions on output streams. The spreadsheet is not specific to iodine, the partitioning of any species can be estimated by entering the assumed DFs for each unit operation. Flowsheet outputs matched results from the prior WTP study and show that different assumptions for the DFs can greatly impact iodine partitioning to primary and secondary waste streams. Results from SRNL's baseline DF values suggest less than 50% of I-129 would be retained in glass versus the 96% when using the BNI DF values. In addition, the flowsheet demonstrated that more than 5 DFLAW operational cycles are required to achieve a steady-state of I-129 to the primary waste stream. It is not possible with the data available to determine whether the BNI approach or the approach taken in this study will be a better match for the iodine partitioning once the LAW facility begins operation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

NREL’s Cyber-Energy Emulation Platform for Research and System Visualization

This paper presents NREL’s Cyber Energy Emulation (CEE) Platform. This is a novel emulation platform for achieving real-time visualization of large-scale environments involving cyber-physical devices. It allows for the environment to include real, physical hardware, along with emulated devices communicating with each other as part of the same system. The CEE Platform is also capable of streaming, collecting, storing, transporting, and visualizing all data within the emulated environment. By providing this capability, it enables high-fidelity visual analysis of events to be performed in real time as well as the use of historical data for forensic analysis. This paper presents the design of the CEE Platform as well as several potential use cases and applications. It also aims to highlight why this type of visualization tool has potential for research and education about cyber-physical systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗