Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

National Energy Water Treatment & Speciation (NEWTS): A Water & Critical Minerals Database and Dashboard

The poster, presented at the American Geophysical Union (AGU) 2023 Conference, highlights NETL's National Energy Water Treatment & Speciation (NEWTS) Database & Dashboard. This poster reviews the work done to aggregate disparate water quality data for energy-related wastewater streams, to process and integrate the datasets, and enable easy integration with aqueous chemistry modeling software to support water management and beneficial reuse decision-making.

Wenzlick, Madison↗

Optimization of LAW Glass Former Additives

The primary objective of this work was to collect data to support processing Hanford LAW streams at higher rates through changes in mineralogy, forms, and grain sizes of the GFCs. This was achieved through assessment of LAW feeds with different GFCs by feed rheology testing, testing with a vertical gradient furnace (VGF) system to assess melt rates, and processing selected modified LAW feeds through a DM100 melter to measure glass production rates and processing behavior. A high waste loading glass formulation developed in earlier work [8] for an LAW composition specified by WTP was used for rheology, VGF, and melter testing. The glass composition, ORPLA20, is based on LAW tank AN-105; the glass has a waste loading of 31.4 wt% and a Na2O content of 24.0 wt%. Another high waste loading glass formulation developed in earlier work for an LAW composition specified by WTP was also used for VGF testing to investigate the effects of changes in GFCs on melt rate for a second waste and glass composition. That glass composition is ORPLD6, which is based on LAW tank AN-102; the glass has a waste loading of 25.9 wt% and a Na2O content of 22.0 wt%.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Customer service model for waste tracking at Los Alamos National Laboratory

The goal is to transition from five legacy database systems that have reached end-of-life to a single inventory system that supports workflow, data, and reporting for all waste streams. Plutonium Processing Facility (TA-55) Waste Team provides a high quality system that insures safe, efficient and compliant management of all radioactive and hazardous wastes generated, including waste characterization and repackaging of Transuranic Waste (TRU) and TRU mixed waste for shipment to the Waste Isolation Pilot Plant (WIPP).

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Faster Parallel Algorithm and Efficient Multithreaded Implementations for Evaluating Betweenness Centrality on Massive Datasets

We present a new lock-free parallel algorithm for computing betweenness centrality of massive small-world networks. With minor changes to the data structures, our algorithm also achieves better spatial cache locality compared to previous approaches. Betweenness centrality is a key algorithm kernel in the HPCS SSCA#2 Graph Analysis benchmark, which has been extensively used to evaluate the performance of emerging high-performance computing architectures for graph-theoretic computations. We design optimized implementations of betweenness centrality and the SSCA#2 benchmark for two hardware multithreaded systems: a Cray XMT system with the ThreadStorm processor, and a single-socket Sun multicore server with the UltraSparc T2 processor. For a small-world network of 134 million vertices and 1.073 billion edges, the 16-processor XMT system and the 8-core Sun Fire T5120 server achieve TEPS scores (an algorithmic performance count for the SSCA#2 benchmark) of 160 million and 90 million respectively, which corresponds to more than a 2X performance improvement over the previous parallel implementations. To better characterize the performance of these multithreaded systems, we correlate the SSCA#2 performance results with data from the memory-intensive STREAM and RandomAccess benchmarks. Finally, we demonstrate the applicability of our implementation to analyze massive real-world datasets by computing approximate betweenness centrality for a large-scale IMDb movie-actor network.

architecture comparison↗

A Nonrelational Data Warehouse for the Analysis of Field and Laboratory Data From Multiple Heterogeneous Photovoltaic Test Sites

A nonrelational, distributed computing, data warehouse, and analytics environment (Energy-CRADLE) was developed for the analysis of field and laboratory data from multiple heterogeneous photovoltaic (PV) test sites. This data informatics and analytics infrastructure was designed to process diverse formats of PV performance data and climatic telemetry time-series data collected from a PV outdoor test network, i.e., the Solar Durability and Lifetime Extension global SunFarm network, as well as point-in-time laboratory spectral and image measurements of PV material samples. Using Hadoop/HBase for the distributed data warehouse, Energy-CRADLE does not have a predefined data table schema, which enables ingestion of data in diverse and changing formats. For easy data ingestion and data retrieval, Energy-CRADLE utilizes Hadoop streaming to enable Python MapReduce and provides a graphical user interface, i.e., py-CRADLE. By developing the Hadoop distributed computing platform and the HBase NoSQL database schema for solar energy, Energy-CRADLE exemplifies an integrated, scalable, secure, and user-friendly data informatics and analytics system for PV researchers. Furthermore, an example of Energy-CRADLE enabled scalable, data-driven, analytics is presented, where machine learning is used for anomaly detection across 2.2 million real-world current-voltage (I–V) curves of PV modules in three distinct Koppen–Geiger climatic zones.

14 SOLAR ENERGY↗

RTN-011: Rubin Observatory Plans for an Early Science Program

This document outlines Rubin Observatory's plans for a dedicated \emph{Early Science Program} to enable high-impact science prior to the first annual data release of the Legacy Survey of Space and Time (LSST). Components of the Early Science Program include releasing science-grade commissioning data products via a series of ``Data Previews,'' ramping up of the transient alert stream during commissioning, implementing a program of incremental template generation to augment alert production in the early phases of the survey, and the first LSST Data Release, DR1, based on the first 6 months of data from the LSST. A detailed breakdown of which data products can be expected when is provided. The Rubin Operations team is working closely with the science community to optimize the Early Science Program for the time-domain and solar system science achievable in the first year of operations. This is a living document; both it and the Early Science Program will continue to evolve over the course of commissioning and pre-operations in response to the state of the as-built system and to community guidance.

79 ASTRONOMY AND ASTROPHYSICS↗

Characterization and dynamics of the peculiar stream Jhelum: A tentative role for the Sagittarius dwarf galaxy

Stellar streams are a promising tool to study the Milky Way’s dark matter subhalo population, as interactions with subhalos are expected to leave visible imprints in the streams in the form of substructure. However, there may be other causes of substructure. Here we studied the kinematics and the unusual morphology of the stellar stream Jhelum. Using a combination of ground-based photometry and Gaia EDR3 astrometry, we characterized the morphology of Jhelum. We combined this new data with radial velocities from the literature to perform orbit integrations of the stream in static Galactic potentials. We also carried out N-body simulations in the presence of the Sagittarius dwarf galaxy. The new data reveal a previously unreported tertiary component in the stream, as well as several gaps and a kink-like feature in its narrow component. We find that for a range of realistic Galactic potentials, no single orbit is able to reproduce Jhelum’s radial velocity data entirely. A generic property of the orbital solutions is that they share a similar orbital plane to Sagittarius and this leads to repeated encounters with the stream. Using N-body simulations that include a massive Sagittarius, we explored its effect on Jhelum, and we show that these encounters are able to qualitatively reproduce the narrow and broad components in Jhelum, as well as create a tertiary component in some cases. We also find evidence that such encounters can result in an apparent increase in the velocity dispersion of the stream by a factor up to four due to overlapping narrow and broad components. Our findings suggest that the Jhelum stream is even more complex than once thought; however, its morphology and kinematics can tentatively be explained via the interactions with Sagittarius. In this scenario, the formation of Jhelum’s narrow and broad components occurs naturally, yet some of the smaller gap-like features remain to be explained.

79 ASTRONOMY AND ASTROPHYSICS↗

THE SAGITTARIUS STREAMS IN THE SOUTHERN GALACTIC HEMISPHERE

The structure of the Sagittarius stream in the southern Galactic hemisphere is analyzed with the Sloan Digital Sky Survey Data Release 8. Parallel to the Sagittarius tidal track, but {approx}10 Degree-Sign away, there is another fainter and more metal-poor stream. We provide evidence that the two streams follow similar distance gradients but have distinct morphological properties and stellar populations. The brighter stream is broader, contains more metal-rich stars, and has a richer color-magnitude diagram with multiple turnoffs and a prominent red clump as compared to the fainter stream. Based on the structural properties and the stellar population mix, the stream configuration is similar to the Northern 'bifurcation'. In the region of the South Galactic Cap, there is overlapping tidal debris from the Cetus stream, which crosses the Sagittarius stream. Using both photometric and spectroscopic data, we show that the blue straggler population belongs mainly to Sagittarius and the blue horizontal branch stars belong mainly to the Cetus stream in this confused location in the halo.

79 ASTRONOMY AND ASTROPHYSICS↗

A SPATIOTEMPORAL APPROACH FOR HIGH RESOLUTION TRAFFIC FLOW IMPUTATION

Along with the rapid development of Intelligent Transportation Systems (ITS), traffic data collection technologies have been evolving dramatically. The emergence of innovative data collection technologies such as Remote Traffic Microwave Sensor (RTMS), Bluetooth sensor, GPS-based Floating Car method, automated license plate recognition (ALPR) (1), etc., creates an explosion of traffic data, which brings transportation engineering into the new era of Big Data. However, despite the advance of technologies, the missing data issue is still inevitable and has posed great challenges for research such as traffic forecasting, real-time incident detection and management, dynamic route guidance, and massive evacuation optimization, because the degree of success of these endeavors depends on the timely availability of relatively complete and reasonably accurate traffic data. A thorough literature review suggests most current imputation models, if not all, focus largely on the temporal nature of the traffic data and fail to consider the fact that traffic stream characteristics at a certain location are closely related to those at neighboring locations and utilize these correlations for data imputation. To this end, this paper presents a Kriging based spatiotemporal data imputation approach that is able to fully utilize the spatiotemporal information underlying in traffic data. Imputation performance of the proposed approach was tested using simulated scenarios and achieved stable imputation accuracy. Moreover, the proposed Kriging imputation model is more flexible compared to current models.

Han, Lee↗

Memory controller that forces prefetches in response to a present row address change timing constraint

An apparatus having a memory controller is described. The memory controller includes prefetch circuitry to prefetch, from a memory, data having a same row address in response to the memory controller's servicing of its request stream being stalled because of a timing constraint that prevents a change in row address. The memory controller also includes a cache to cache the prefetched data. The memory controller also includes circuitry to compare addresses of read requests in the memory controller's request stream against respective addresses of the prefetched data in the cache and to service those of the requests in the memory controller's request stream having a matching address with corresponding ones of the prefetched data in the cache.

97 MATHEMATICS AND COMPUTING↗

Interface Metaphors for Interactive Machine Learning

To promote more interactive and dynamic machine learn- ing, we revisit the notion of user-interface metaphors. User-interface metaphors provide intuitive constructs for supporting user needs through interface design elements. A user-interface metaphor provides a visual or action pattern that leverages a user’s knowledge of another domain. Metaphors suggest both the visual representations that should be used in a display as well as the interactions that should be afforded to the user. We argue that user-interface metaphors can also offer a method of extracting interaction-based user feedback for use in machine learning. Metaphors offer indirect, context-based information that can be used in addition to explicit user inputs, such as user-provided labels. Implicit information from user interactions with metaphors can augment explicit user input for active learning paradigms. Or it might be leveraged in systems where explicit user inputs are more challenging to obtain. Each interaction with the metaphor provides an opportunity to gather data and learn. We argue this approach is especially important in streaming applications, where we desire machine learning systems that can adapt to dynamic, changing data.

Interactive machine learning↗

Streaming readout for next generation electron scattering experiments

Current and future experiments at the high-intensity frontier are expected to produce an enormous amount of data that needs to be collected and stored for offline analysis. Thanks to the continuous progress in computing and networking technology, it is now possible to replace the standard ‘triggered’ data acquisition systems with a new, simplified and outperforming scheme. ‘Streaming readout’ (SRO) DAQ aims to replace the hardware-based trigger with a much more powerful and flexible software-based one, that considers the whole detector information for efficient real-time data tagging and selection. Considering the crucial role of DAQ in an experiment, validation with on-field tests is required to demonstrate SRO performance. In this paper, we report results of the on-beam validation of the Jefferson Lab SRO framework. In this work, we exposed different detectors (PbWO-based electromagnetic calorimeters and a plastic scintillator hodoscope) to the Hall-D electron-positron secondary beam and to the Hall-B production electron beam, with increasingly complex experimental conditions. By comparing the data collected with the SRO system against the traditional DAQ, we demonstrate that the SRO performs as expected. Furthermore, we provide evidence of its superiority in implementing sophisticated AI-supported algorithms for real-time data analysis and reconstruction.

47 OTHER INSTRUMENTATION↗

pnnl/safekit

Some of the most pressing machine learning applications such as cyber security and object recognition lack enough ground-truth training data to build a classifier. We solve this problem by using unsupervised deep learning techniques to determine when data were anomalous or deviated from the norm. Traditional methods require either specific context dependent expertise to construct models, or prior examples of events and large amounts of well-labeled data to perform machine learning. Some cutting-edge deep learning approaches have been used to characterize complex events, but these have not been applied to the streaming environment and require a great deal of data. We demonstrated the use of an autoencoder and relevant featurization techniques to both learn a feature space and then identify anomalous portions without the aid of labeled data or domain knowledge. In this way, we demonstrated the detection of anomalous features without domain knowledge or tagged examples, and delivered these features to users.

Central, PNNL Developer↗

Adsorption Model for Off-Gas Separation

The absence of industrial scale nuclear fuel reprocessing in the U.S. has precluded the necessary driver for developing the advanced simulation capability now prevalent in so many other countries. Thus, it is essential to model complex series of unit operations to simulate, understand, and predict inherent transient behavior and feedback loops. A capability of accurately simulating the dynamic behavior of advanced fuel cycle separation processes will provide substantial cost savings and many technical benefits. The specific fuel cycle separation process discussed in this report is the off-gas treatment system. The off-gas separation consists of a series of scrubbers and adsorption beds to capture constituents of interest. Dynamic models are being developed to simulate each unit operation involved so each unit operation can be used as a stand-alone model and in series with multiple others. Currently, an adsorption model has been developed in gPROMS software. Inputs include gas stream constituents, sorbent, and column properties, equilibrium and kinetic data, and inlet conditions. It models dispersed plug flow in a packed bed under non-isothermal and non-isobaric conditions for a multiple component gas stream. The simulation outputs component concentrations along the column length as a function of time from which the breakthrough data is obtained. It also outputs temperature along the column length as a function of time and pressure drop along the column length. Experimental data will be input into the adsorption model to develop a model specific for iodine adsorption on silver mordenite as well as model(s) specific for krypton and xenon adsorption. The model will be validated with experimental breakthrough curves. Another future off-gas modeling goal is to develop a model for the unit operation absorption. The off-gas models will be made available via the server or web for evaluation by customers.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

S $^{5}$: The Orbital and Chemical Properties of One Dozen Stellar Streams

We report the kinematic, orbital, and chemical properties of 12 stellar streams with no evident progenitors using line-of-sight velocities and metallicities from the Southern Stellar Stream Spectroscopic Survey (S $^{5}$), proper motions from Gaia EDR3, and distances derived from distance tracers or the literature. This data set provides the largest homogeneously analyzed set of streams with full 6D kinematics and metallicities. All streams have heliocentric distances between ∼10 and 50 kpc. The velocity and metallicity dispersions show that half of the stream progenitors were disrupted dwarf galaxies (DGs), while the other half originated from disrupted globular clusters (GCs), hereafter referred to as DG and GC streams. Based on the mean metallicities of the streams and the mass–metallicity relation, the luminosities of the progenitors of the DG streams range between those of Carina and Ursa Major I (−9.5 ≲ M $_{V}$ ≲ −5.5). Four of the six GC streams have mean metallicities of Fe/H < −2, more metal poor than typical Milky Way (MW) GCs at similar distances. Interestingly, the 300S and Jet GC streams are the only streams on retrograde orbits in our dozen-stream sample. Finally, we compare the orbital properties of the streams with known DGs and GCs in the MW, finding several possible associations. Some streams appear to have been accreted with the recently discovered Gaia–Enceladus–Sausage system, and others suggest that GCs were formed in and accreted together with the progenitors of DG streams whose stellar masses are similar to those of Draco to Carina (∼10$^{5}$–10$^{6}$ M $_{⊙}$).

79 ASTRONOMY AND ASTROPHYSICS↗

Stream Chemistry, Synoptic Surveys, East Fork Poplar Creek Watershed, TN, USA; April 2023 to February 2025

Impacts of developed land cover on stream chemistry can be difficult to discern from natural variability, particularly in carbonate watersheds where weathering of urban infrastructure and lithology generate similar signatures. We evaluated how spatial patterns of stream chemistry varied across perennial and non-perennial tributaries spanning an urban-to-forested gradient in a mid-order, carbonate-dominated watershed. This data package contains a processed and compiled summary of stream chemistry and properties obtained from 12 synoptic surveys of 54 stream sites across the East Fork Poplar Creek watershed located near Oak Ridge, TN, United States. The sites include non-perennial tributaries, perennial tributaries, and the main stem and span forested to urban (highly developed) land cover gradients. The data package includes the processed and flagged chemical data (WaDE_SynopticSummary_FinalChemistry), metadata describing data flagging and analysis (WaDE_SynopticSummary_Metadata), information about each site and its contributing subcatchment (WaDE_SynopticSummary_SiteInformation), and a comparison of instrument and field detection limits used to determine method detection limits for the study (WaDE_SynopticSummary_DetectionLimitComparison). Stream chemistry includes stream parameters measured in situ using multiparameter probes (dissolved oxygen, pH, specific conductance, temperature) and solutes including nutrients (nitrate, ammonium, soluble reactive phosphorus), dissolved organic carbon, dissolved inorganic carbon, major cations (calcium, magnesium, potassium, sodium), major anions (chloride, sulfate), and a broad suite of minor and trace elements.

EARTH SCIENCE > TERRESTRIAL HYDROSPHERE > SURFACE ↗

Transport and Loss of Ring Current Electrons Inside Geosynchronous Orbit During the 17 March 2013 Storm

Ring current electrons (1–100 keV) have received significant attention in recent decades, but many questions regarding their major transport and loss mechanisms remain open. In this study, we use the four-dimensional Versatile Electron Radiation Belt code to model the enhancement of phase space density that occurred during the 17 March 2013 storm. Our model includes global convection, radial diffusion, and scattering into the Earth's atmosphere driven by whistler-mode hiss and chorus waves. We study the sensitivity of the model to the boundary conditions, global electric field, the electric field associated with subauroral polarization streams, electron loss rates, and radial diffusion coefficients. The results of the code are almost insensitive to the model parameters above 4.5 R E R E , which indicates that the general dynamics of the electrons between 4.5 R E and the geostationary orbit can be explained by global convection. We found that the major discrepancies between the model and data can stem from the inaccurate electric field model and uncertainties in lifetimes. We show that additional mechanisms that are responsible for radial transport are required to explain the dynamics of ≥40-keV electrons, and the inclusion of the radial diffusion rates that are typically assumed in radiation belt studies leads to a better agreement with the data. The overall effect of subauroral polarization streams on the electron phase space density profiles seems to be smaller than the uncertainties in other input parameters. This study is an initial step toward understanding the dynamics of these particles inside the geostationary orbit.

79 ASTRONOMY AND ASTROPHYSICS↗

KINEMATICS AND CHEMISTRY OF STARS ALONG THE SAGITTARIUS TRAILING TIDAL TAIL AND CONSTRAINTS ON THE MILKY WAY MASS DISTRIBUTION

We present three-dimensional (3D) kinematics of Sagittarius (Sgr) trailing tidal debris in six fields located 70 Degree-Sign -130 Degree-Sign along the stream from the Sgr dwarf galaxy core. The data are from our proper-motion (PM) survey of Kapteyn's Selected Areas, in which we have measured accurate PMs to faint magnitudes in {approx}40' Multiplication-Sign 40' fields evenly spaced across the sky. The radial velocity (RV) signature of Sgr has been identified among our follow-up spectroscopic data in four of the six fields and combined with mean PMs of spectroscopically confirmed members to derive space motions of Sgr debris based on {approx}15-64 confirmed stream members per field. These kinematics are compared to predictions of the Law and Majewski model of Sgr disruption; we find reasonable agreement with model predictions in RVs and PMs along Galactic latitude. However, an upward adjustment of the local standard of rest velocity ({Theta}{sub LSR}) from its standard 220 km s{sup -1} to at least 232 {+-} 14 km s{sup -1} (and possibly as high as 264 {+-} 23 km s{sup -1}) is necessary to bring 3D model debris kinematics and our measurements into agreement. Satisfactory model fits that simultaneously reproduce known position, distance, and RV trends of the Sgr tidal streams, while significantly increasing {Theta}{sub LSR}, could only be achieved by increasing the Galactic bulge and disk mass while leaving the dark matter halo fixed to the best-fit values from Law and Majewski. We derive low-resolution spectroscopic abundances along this stretch of the Sgr stream and find a constant [Fe/H] {approx} -1.15 (with {approx}0.5 dex scatter in each field-typical for dwarf galaxy populations) among the four fields with reliable measurements. A constant metallicity suggests that debris along the {approx}60 Degree-Sign span of this study was all stripped from Sgr on the same orbital passage.

79 ASTRONOMY AND ASTROPHYSICS↗