Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

Laboratory time series moisture manipulative experiment from sediment across San Antonio, Texas: time series aerobic respiration and geochemistry

This dataset supports a broader study examining the effects of wetting and drying on hyporheic zone respiration. The dataset provides data generated from a laboratory moisture manipulation experiment. The contents include time series aerobic respiration and moisture; dissolved oxygen; sediment geochemistry data; and field metadata (including qualitative information on instream and river corridor characteristics). Samples were collected as part of the WHONDRS Allison Veach collaboration (AV1). The data package associated with the AV1 study is available at https://data.ess-dive.lbl.gov/datasets/doi:10.15485/2529428. AV1 sampling occurred across 7 perennial and 7 intermittent streams in San Antonio, Texas. Each stream/site was visited both in summer during base flow (July-September 2023) and winter during peak flow (January-February 2024). This study uses subsamples from a subset of AV1 samples. The original field samples were labeled as AV1_###. Subsequent subsamples for this study were labeled as EV_###. The labels from the field samples and the EV subsamples can be mapped directly based on the digits following the prefix and underscore (i.e., EV_001 is a subsample from AV1_001). See the critical details section below for more details on sample naming. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. This dataset is comprised of one main data folder containing (1) file-level metadata; (2) data dictionary; (3) field metadata; (4) readme; (5) field protocol; and a (6) a subfolder with sediment sample data from the incubation experiment. The sample data subfolder contains (1) effect size; (2) iron (II); (3) gravimetric moisture; (4) respiration rates; (5) raw dissolved oxygen values and plots; (6) specific conductance; (7) pH; (8) temperature; (9) a summary containing mean, median, and standard deviation values of each data type for each treatment (wet and dry); and (10) methods codes. All files are .csv or.pdf.

54 ENVIRONMENTAL SCIENCES↗

Impact of Control on Availability and Cycling of Residential HVAC in a Real-World Experiment

Demand response is an important emerging part of smart grids and there is a large stream of research from theoretical and modeling perspectives. However, there is relatively little experimental evidence that could help researchers and building operators make informed decisions on best practices for modeling, developing, and deployment of control mechanisms. We contribute to the body of experimental research by providing numerical insights into the role and availability of residential HVAC systems for control. We share the findings on the duration of the cooling cycle, off cycle, and temperature settling time of HVAC systems from data collected from a smart neighborhood located in Atlanta, GA.

cycling↗

Preliminary proof-of-concept of real-time divertor heat flux control from infrared cameras with nitrogen injection in the DIII-D tokamak

In future tokamak reactors like ITER and the Fusion Pilot Plant (FPP), real-time feedback control of heat flux to the plasma-facing components (PFC) will be critical for steady-state operation. This work presents the first experimental demonstration of real-time divertor heat flux estimation with infrared thermography and feedback control with impurity seeding on the DIII-D tokamak. The flexible infrastructure of the Plasma Control System (PCS) on DIII-D makes this new capability possible. The PCS software runs on a gateway computer system, and five real-time compute nodes. An array of low latency streaming digitizers from D-TACQ Solutions connects to these real-time computers to collect and process data, and send commands to actuators during plasma discharges. This system handles the signal IO from the tokamak and allows the PCS to utilize the diagnostic data necessary to perform control in real-time. Feedback control on heat flux was accomplished by feeding infrared camera data from the “Infrared TV” (IRTV) camera to a custom-developed User Datagram Protocol (UDP) server. This server transmits infrared data to a newly developed PCS algorithm that estimates the heat flux to PFC. Here, a proportional integral derivative (PID) controller minimizes the error between a heat flux reference and the real-time estimate by injecting nitrogen gas into the divertor.

Algorithm development↗

An Overview of Atmospheric Features Over the Western North Atlantic Ocean and North American East Coast—Part 2: Circulation, Boundary Layer, and Clouds

The Western North Atlantic Ocean (WNAO) is a complex land-ocean-atmosphere system that experiences a wide range of atmospheric phenomena, which in turn drive unique aerosol transport pathways, cloud morphologies, and boundary layer variability. This work, Part 2 of a 2-part paper series, provides an overview of the atmospheric circulation, boundary layer variability, three-dimensional cloud structure, and precipitation over the WNAO; the companion paper (Part 1) focused on chemical characterization of aerosol, gas, and wet deposition. Seasonal changes in the circulation and sea surface temperature explain a clear transition in cloud morphologies from small shallow cumulus clouds, convective clouds, and tropical storms in summer, to stratus/stratocumulus and multi-layer cloud systems associated with winter storms. Synoptic variability in cloud fields is estimated using satellite-based weather states, and the role of postfrontal conditions (cold-air outbreaks) in the development of stratiform clouds is further analyzed. Precipitation is persistent over the ocean, with a regional peak over the Gulf Stream path, where offshore sea surface temperature gradients are large and surface fluxes reach a regional peak. Satellite data show a clear annual cycle in cloud droplet number concentration along the coast in winter, and minima in summer, suggesting a marked annual cycle in aerosol-cloud interactions. The performance of four climate models are assessed against satellite cloud retrievals. The models qualitatively reproduce the annual cycle in cloud cover and liquid water path, but with large discrepancies across models, especially in the extra-tropics. The paper concludes with a summary of outstanding issues and recommendations for future work.

54 ENVIRONMENTAL SCIENCES↗

Data and scripts associated with “When do Riverine Systems 'Feel the Burn'? Simulating How Burn Extent and Severity Modulate Hydrologic Controls on Biogeochemical Export” (v2)

This data package is associated with the publication “When do Riverine Systems 'Feel the Burn'? Simulating How Burn Extent and Severity Modulate Hydrologic Controls on Biogeochemical Export” published in Water Resources Research (Wampler et al. 2025; preprint: https://doi.org/10.22541/essoar.174438106.63564767/v1). This study used the Soil and Water Assessment Tool (SWAT), a processed based model to explore the impacts of area burned and burn severity on streamflow, nitrate, and dissolved organic carbon (DOC) in two test basins: a semi-arid, mixed land use basin and a humid, primarily forested basin. We developed 1800 wildfire scenarios that we ran in each basin: 20 different burn extents (5 to 100% by 5%), 3 different burn severities (low, moderate, and high), and 30 different post-fire precipitation scenarios. We also ran an additional 30 scenarios associated with no wildfire for the 30 post-fire precipitation scenarios. For each scenario we were interested in the change in runoff ratio (streamflow) and average concentration and annual loads (nitrate and DOC) across the wildfire scenarios. This data package contains the data and scripts required to build SWAT models for the two test basins, create and run the wildfire scenarios, and generate the data summaries and figures used in the associated manuscript. This data package was originally published in March 2025. It was updated in January 2026 (v2; new and modified files) to include the final files after the manuscript went through reviews. See the change history section below for more details. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About.

54 ENVIRONMENTAL SCIENCES↗

NUMERICAL INVESTIGATION OF AIR DEHUMIDIFICATION THROUGH WATER DROPLETS DIELECTROPHORESIS

This paper numerically investigated the dehumidification of moist airflow in a converging rectangular duct with electrically enhanced condensation. The aim was to develop a condensation model that predicted water vapor condensation by employing the dielectrophoresis principle. The charged droplets were injected into the computational domain to produce a gradient electric field. The dielectrophoretic interaction between the droplets and vapor molecules of the humid air resulted in local water vapor condensation at the vapor and liquid droplet interface. This phenomenon is described in detail in this paper. A hybrid Eulerian-Lagrangian solver SprayFoam was developed based on OpenFOAM® to simulate condensation in two-phase gas-liquid mixtures. The following developments were made based on the standard compressible multiphase flow solver SprayFoam in OpenFOAM®: (1) Eulerian solver for gas phase (2) multi-component species transport, and (3) Lagrangian solver for gas-droplet two-phase flows and sub-models for liquid droplets. The newly developed numerical model was experimentally validated with data from a series of tests conducted in the authors' laboratory. The results showed that the simulations followed the same trends as the data, and the model predicted the condensation due to the electro-spray injection process in the air stream. The injected water droplets, which are electrically charged to their Rayleigh limits, increased in size while wiping out the humidity from the air. The simulations indicated that the dehumidification was about 1% for 0.5 cubic feet per minute airflow rate. Scaling up to larger flows is a future follow-up work.

Yel Mahi, *Maliha↗

Andrieslombaardite, RhSbS, a new platinum-group mineral from the platiniferous Onverwacht Pipe, Republic of South Africa

A hundred years after the discovery of the Merensky Reef in 1924, it is appropriate to present the new mineral andrieslombaardite in honour of Andries Frederik Lombaard who was instrumental in its discovery. Andrieslombaardite, RhSbS, was first described as an unknown mineral from placer deposits associated with the Tulameen Alaskan-Uralian type complex, British Colombia, Canada (Raicevic and Cabri, 1976) but has since been reported from several other deposits including the platiniferous Driekop, Mooihoek, and Onverwacht pipes in the eastern Bushveld Complex, South Africa. The mineral and the name were approved by the Commission on New Minerals Nomenclature and Classification (CNMNC) of the International Mineralogical Association (IMA no. 2022-076) based on data in the co-type samples from Onverwacht and a co-type sample from the Yubdo stream, Birbir River, Ethiopia. Andrieslombaardite in the Onverwacht sample is a single 8 x 20 μm grain attached to laurite in a matrix of altered silicate and Fe-oxyhydroxide minerals. In the Yubdo samples, there are many grains of pale brownish gray andrieslombaardite up to 25 x 55 μm in size, included in Pt-Fe alloys, some associated with erlichmanite, and others attached to bornite and chalcopyrite. The reflectance values (R%) measured in air and in oil at the COM wavelengths are 48.3 and 33.0 (470 nm), 49.3 and 34.0 (546 nm), 51.0 and 35.9 (589 nm), and 51.8 and 36.7 (650 nm). The colour values x, y, Y, λd, and Pe in air are 0.317, 0.322, 50.3, 580, and 3.2, and in oil are 0.319, 0.324, 35.6, 579, and 4.5. The composition of andrieslombaardite is ideally RhSbS, but it contains variable amounts of Fe, Pt, Pd, and Ir that may substitute for Rh. The mineral is cubic with unit-cell dimensions of a = 6.0278(4) Å, V = 219.01(6) Å 3 and Z = 4. It was synthesised at 400 and 550°C using stoichiometric elemental amounts. It is a member of the cobaltite group. The mineralisation of the intrusive dunite pipes was probably introduced at high temperatures, under magmatic conditions. The primary assemblages were to a certain degree overprinted and redistributed by low-temperature hydrothermal fluids. The Pt-Fe alloys from Yubdo containing PGM inclusions such as andrieslombaardite in the Yubdo-Alaskan-type complex were formed at some post-magmatic stage owing to PGE remobilisation during hydrothermal or metamorphic episodes.

58 GEOSCIENCES↗

Foundational Dataset for Developing Large-Sample Stream Temperature Models in the Conterminous United States

This dataset provides inputs, evaluation results, and trained weights from a large-sample Long Short-Term Memory (LSTM) model designed to predict daily stream temperatures across unregulated river reaches in the conterminous United States (CONUS). It includes dynamic meteorological and hydrologic forcings, static physiographic attributes, and model outputs from cross-validation experiments spanning 300 basins. It supports reproducible modeling, direct application for new basins, and provides data suitable for integration with reservoir and river simulations under current and future climates. It contains two .zip files described below · RQ-AI_runs.zip: Model outputs from 10-fold cross-validation experiments, including observed and predicted daily stream temperatures, along with test performance metrics for water years 2017–2019. Two versions are included: 1. Model trained and validated using subbasin-area weighted dynamic features. 2. Model trained and validated using whole-basin area weighted dynamic features. · RQ-AI_inputs.zip: Collection of all formatted dynamic and static predictor datasets (meteorological, hydrologic, and physiographic features) used in model training and analysis. Detailed instructions and data structure is held at the following GitLab repository: https://code.ornl.gov/tempwise/training.

Gomez-Velez, Jesus [Oak Ridge National Laboratory ↗

Stars in the local galactic thick disc and halo in Gaia EDR3: a catalogue of half a million local main-sequence stars with photometric metallicities

We present a catalogue of 551 214 main-sequence stars in the local (d < 2 kpc) Galactic thick disc and halo, based on a search of stars with large proper motions ($\mu _{\rm tot} \gt 40.0~\rm mas\, yr^{-1}$) in the Gaia Early Data Release 3. We derive photometric metallicity calibrated from the colour–luminosity–metallicity distribution of 20 047 stars with spectroscopic metallicities, collected from various spectroscopic surveys, including SDSS SEGUE/APOGEE, GALAH DR3, and LAMOST DR6. We combine these results to construct an empirical colour–magnitude–metallicity grid, which can be used to estimate photometric metallicities for low-mass metal-poor stars of K and M subtypes from their absolute G magnitude and colour values. We find that low-mass, high-velocity stars in our catalogue share similar kinematics as reported in recent studies of more luminous Galactic halo stars. The pseudo-kinematic analysis of our sample recovers the main local halo structures, including the Gaia–Enceladus Stream and the Helmi stream; aside from these, the local halo stars appear to show a remarkably smooth distribution in velocity space. Since the future Gaia data release will provide radial velocity measurements for only a small number of our sample, our catalogue provides targets of high interest for the future spectroscopic observation programs.

79 ASTRONOMY AND ASTROPHYSICS↗

Uptake and speciation of trace metal inputs to Wetland Soils from Illinois and South Carolina and Stream Sediments from Tennessee

Metals occur in all ecosystems, although their concentrations vary depending on their natural geologic conditions and surrounding human activities. In addition to metals intrinsically present from the geology of a particular system, metals can enter environmental systems from a wide variety of natural and anthropogenic sources, such as sediment re-suspension, mining operations, industrial processes, agricultural activities, and atmospheric deposition. While metals can be toxic at high concentrations, some metals serve as essential micronutrients for biogeochemical processes. Metal transport and availability in engineered and natural water systems depend on processes of adsorption/desorption, oxidation/reduction, dissolution/precipitation, and ligand complexation. Insights into the speciation of metals and their bioavailability will also help advance understanding of the roles of metals in the biogeochemical cycling of nutrients. We conducted batch experiments under anoxic conditions on soils and sediments collected from three different natural aquatic systems to understand their response to influxes of dissolved Cu, Ni and Zn. While soils and sediments from all sites could strongly bind added trace metals, there were substantial differences in trace metal uptake trends between different sites, especially for Cu. There was no distinct correlation between trace metal uptake and the total organic matter, iron, and sulfur content present in the samples. X-ray absorption spectroscopy indicated that the speciation of the freshly added metals taken up by the solids differs substantially from the speciation of the metals originally present in unamended samples. Cu sulfides dominated speciation at low loadings (1 µmol/g), whereas complexation to thiol groups and formation of metallic Cu governed speciation at high loadings (10 µmol/g). For Ni and Zn, adsorption to mineral surfaces and organic matter governed their speciation in materials from most sites. This study suggests that the background speciation of metals in natural aquatic systems is a poor predictor of the speciation and lability of metals introduced to terrestrial aquatic systems from anthropogenic or natural processes. Our findings imply that geochemical processes controlling trace metal speciation may vary considerably with metal loading in different natural systems. Data are provided for marsh wetland soils at Argonne National Laboratory (Marsh 1 and Marsh 2), riparian wetland soils (Riparian 1 and Riparian 2) in the Tims Branch watershed at Savannah River National Laboratory, and stream bed sediments (Stream 1 and Stream 2) from East Fork Poplar Creek near Oak Ridge National Laboratory. Data package includes the results of trace metal uptake experiments conducted on the selected sites for determining their capacity to immobilize metals under different loadings. XANES spectra for Cu, Ni, ad Zn at different loadings are included in the package. The abundance of different trace metal species obtained using linear combination fitting in ATHENA are also included in the data.

54 ENVIRONMENTAL SCIENCES↗

Feature Analysis, Tracking, and Data Reduction: An Application to Multiphase Reactor Simulation MFiX-Exa for In-Situ Use Case

As we enter the exascale computing regime, powerful supercomputers continue to produce much higher amounts of data than what can be stored for offline data processing. To utilize such high compute capabilities on these machines, much of the data processing needs to happen in situ, when the full high-resolution data is available at the supercomputer memory. In this article, we discuss our MFiX-Exa simulation, which models multiphase flow by tracking a very large number of particles through the simulation domain. In one of the use cases, the carbon particles interact with air to produce carbon dioxide bubbles from the reactor. These bubbles are of primary interest to the domain experts for these simulations. For this particle-based simulation, we propose a streaming technique that can be deployed in situ to efficiently identify the bubbles, track them over time, and use them to down-sample the data with minimal loss in these features.

97 MATHEMATICS AND COMPUTING↗

SCILLA Secondary Aerosol Volume Concentration Airborne Data

This data set contains secondary aerosol volume concentration in cubic micrometers per cubic centimeter (um^3/cm^3). The aerosol was generated in an oxidation flow reactor (OFR) and its volume concentration measured with a scanning mobility particle sizer (SMPS). Both components were designed and built at the University of California Riverside. Ambient particles were removed with a Teflon filter upstream of the OFR and then pure ammonium sulfate particles were added to create a stable aerosol surface area on which low-volatility oxidation products condense. High concentrations of hydroxyl radical (OH) formed inside the OFR accelerate the oxidative chemistry that would typically occur over a period of several days in the atmosphere, resulting in the production of secondary aerosol from precursor gases present in the ambient air. Concentrations of added ozone and water vapor were controlled to produce the desired and approximately constant level of photochemical aging. The reactor temperature was controlled, while the pressure was not, and was always slightly lower than that of the sampled outside air. Sampled air was pulled from above the Naval Postgraduate School’s (NPS) Twin Otter aircraft through a rear-facing, ¼” OD PFA Teflon tube. The sample stream was split between the OFR and several gas analyzers (NOx, CO, O3, and H2O). Though not contained in these files, data from an aerosol mass spectrometer intermittently operated downstream of the OFR are also available.

{"secondary aerosol concentration",aerosol_concent↗

Updated Baseline Cost Model for Hydropower (2023)

The "Updated Baseline Cost Model (BCM) for Hydropower" is an empirical model for estimating the costs of US hydropower projects in six categories (Non-Powered Dam (NPD), New Stream Development (NSD), Canal/Conduit, Pumped Storage Hydro (PSH), Capacity Expansion, Generator Rewind). The model equations have been estimated with data on existing or planned projects obtained from various sources. NOTE: This is a macro-enabled workbook, so Excel may block it on the first opening. In that case: 1. Save the workbook to a local directory 2. Right-click on the workbook in the local directory and select “Properties” 3. Then check “Unblock” at the bottom of the “General” tab.

13 HYDRO ENERGY↗

DMTN-165: A Hybrid Notification and Alert Retrieval Service

We consider the implications of providing a subset of alert packet contents in the alert stream, with the full alert packets available for rate-limited retrieval using an identifier included in the "lightweight" alert. This hybrid approach would enable much wider dissemination of the complete lightweight alert stream, potentially to thousands more users than is possible in the current baseline. In turn this "alerts on your laptop" access would allow users to conduct more sophisticated filtering and analysis than the current Alert Filtering Service, increasing the overall scientific returns of the alert stream. Community brokers would still be able to retrieve all of the contents of the full alert stream within the 60 second latency window and would gain greater control over their ingestion of the bulk alert data. Technically, this hybrid system may represent a modest increase in complexity over the current baseline but is likely to be more operationally robust.

79 ASTRONOMY AND ASTROPHYSICS↗

Event-to-Video Conversion for Overhead Object Detection

Collecting overhead imagery using an event camera is desirable due to the energy efficiency of the image sensor compared to standard cameras. However, event cameras complicate downstream image processing, especially for complex tasks such as object detection. In this paper, we investigate the viability of event streams for overhead object detection. We demonstrate that across a number of standard modeling approaches, there is a significant gap in performance between dense event representations and corresponding RGB frames. We establish that this gap is, in part, due to a lack of overlap between the event representations and the pre-training data that the object detectors were initially trained on through a number of experiments. Then, apply an off-the-shelf event-to-video conversion tool that converts event streams into gray-scale video to close this gap. We demonstrate that this approach results in a large performance increase, outperforming even event-specific object detection techniques on our overhead target task. These results suggest that better aligning event representations with existing large pre-trained models may result in greater short-term performance gains compared to end-to-end event-specific architectural improvements.

machine learning (ML), computer vision, Neuromorph↗

Robust Measurement of Stellar Streams around the Milky Way: Correcting Spatially Variable Observational Selection Effects in Optical Imaging Surveys

Observations of density variations in stellar streams are a promising probe of low-mass dark matter substructure in the Milky Way. However, survey systematics such as variations in seeing and sky brightness can also induce artificial fluctuations in the observed densities of known stellar streams. These variations arise because survey conditions affect both object detection and star–galaxy misclassification rates. To mitigate these effects, we use Balrog synthetic source injections in the Dark Energy Survey (DES) Y3 data to calculate detection rate variations and classification rates as functions of survey properties. We show that these rates are nearly separable with respect to survey properties and can be estimated with sufficient statistics from the synthetic catalogs. Applying these corrections reduces the standard deviation of relative detection rates across the DES footprint by a factor of 5, and our corrections significantly change the inferred linear density of the Phoenix stream when including faint objects. Additionally, for artificial streams with DES-like survey properties we are able to recover density power spectra with reduced bias. We also find that uncorrected power-spectrum results for Legacy Survey of Space and Time (LSST)-like data can be around 5 times more biased, highlighting the need for such corrections in future ground-based surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Expert and operator perspectives on barriers to energy efficiency in data centers

Abstract It was last estimated in 2016 that data centers (DCs) comprise approximately 2% of total US electricity consumption. However, this estimate is currently being updated to account for the massive increase in computing needs due to streaming, cryptocurrency, and artificial intelligence (AI). To prevent energy consumption that tracks with increasing computing needs, it is imperative we identify energy efficiency strategies and investments beyond the low-hanging fruit solutions. In a two-phased research approach, we ask: What non-technical barriers still impede energy efficiency (EE) practices and investments in the data center sector, and what can be done to overcome these barriers? In particular, we are focused on social and organizational barriers to EE. In Phase I, we performed a literature review and found that technical solutions are abundant in the literature, but fail to address the top-down cultural shifts that need to take place in order to adapt new energy efficiency strategies. In Phase II, reported here, we interviewed 16 data center operators/experts to ground-truth our literature findings. Our interview protocols focus on three aspects of DC decision-making: procurement practices, metrics and monitoring, and perceived barriers to energy efficiency. We find that vendors are the key drivers of procurement decisions, advanced efficiency metrics are facility-specific, and there is convergence in the design of advanced facilities due to the heat density of parallelized infrastructure. Our ultimate goals for our research are to design DC decarbonization policies that target organizational structure, empower individual staff, and foster a supportive external market.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The stable isotopes of natural waters at the Marcell Experimental Forest

Here, we present a new data set from the Marcell Experimental Forest (MEF) that compiles water isotope measurements from multiple research catchments, some of which have been studied since the 1960s. The MEF is located in northern Minnesota, USA, and is home to heavily studied and monitored forests, streams, bogs, and fens. Peat-forming systems (bogs and fens) are an important component of the MEF landscape and have a profound impact on the water cycle in these catchments. Within the last decade, analysis of stable isotopes of water (expressed as δD and δ 18 O) has been implemented to characterize the different components of the water budget, and to allow researchers to look at catchment and peatland-specific hydrologic effects in the watershed. This δD and δ 18 O data set of natural waters from MEF catchments is primarily composed of measurements from three peatlands (S1, S2, S6) during an 11-year period. More recently collection and analysis were expanded to also include samples from the Spruce and Peatland Responses Under Changing Environments (SPRUCE) project in the S1 bog, peatlands S3, S4, S5, as well as nearby lakes. We establish a local meteoric water line by analyzing the isotopic composition of precipitation, which fills a void in regional meteoric water lines for Minnesota. Furthermore, we establish baseline isotopic composition for bog outlet streams, bog porewater, aquifer groundwater, overland flow, subsurface stormflow, and snowpack, as well as runoff from the SPRUCE experimental chambers. These data are publicly available and will be expanded upon in the future.

54 ENVIRONMENTAL SCIENCES↗