Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99

DUNE Database Development

The DUNE experiment will produce vast amounts of metadata, which describe the data coming from the read-out of the primary DUNE detectors. Various databases will make up the overall DB architecture for this metadata. ProtoDUNE at CERN is the largest existing prototype for DUNE and serves as a testing ground for - among other things - possible database solutions for DUNE. The subset of all metadata that is accessed during offline data reconstruction and analysis is referred to as ‘conditions data’ and it is stored in a dedicated database. As offline data reconstruction and analysis will be deployed on HTC and HPC resources, conditions data is expected to be accessed at very high rates. It is therefore crucial to store it in a granularity that matches the expected access patterns allowing for extensive caching. This requires a good understanding of the sources and use cases of conditions data. This contribution will briefly summarize the database architecture deployed at ProtoDUNE and explain the various sources of conditions data. We will present how the conditions data is retrieved and streamed from the databases and how it is handled to match expected access patterns.

Vizcaya Hernandez, Ana Paula↗

Cosmological neutrino mass: a frequentist overview in light of DESI

We derive constraints on the neutrino mass using a variety of recent cosmological datasets, including DESI BAO, the full-shape analysis of the DESI matter power spectrum and the one-dimensional power spectrum of the Lyman-α forest (P1D) from eBOSS quasars as well as the cosmic microwave background (CMB). The constraints are obtained in the frequentist formalism by constructing profile likelihoods and applying the Feldman-Cousins prescription to compute confidence intervals. This method avoids potential prior and volume effects that may arise in a comparable Bayesian analysis. Parabolic fits to the profiles allow one to distinguish changes in the upper limits from variations in the constraining power σ of the different data combinations. We find that all profiles in the ΛCDM model are cut off by the ∑m ν ≥ 0 bound, meaning that the corresponding parabolas reach their minimum in the unphysical sector. The most stringent 95% C.L. upper limit is obtained by the combination of DESI DR2 BAO, Planck PR4 and CMB lensing at 53 meV, below the minimum of 59 meV set by the normal ordering. The corresponding constraining power σ is 43 meV, which highlights the importance of the cut-off by negative values in the determination of the upper limit. Extending ΛCDM to non-zero curvature and w 0 w a CDM relaxes the constraints past 59 meV again, but only w 0 w a CDM exhibits profiles with a minimum at a positive value. Additionally, we extend the formalism to constrain the lightest neutrino mass. For DESI DR2 BAO, Planck PR4 and CMB lensing, we find confidence limits at 20 and 19 meV for normal and inverted ordering, respectively. Using a combination of DESI DR1 full-shape, BBN and eBOSS Lyman-α P1D, we successfully constrain the neutrino mass independently of the CMB. This combination yields m l ≤ 97 and 98 meV in the normal and inverted orderings, and total neutrino mass ∑m ν ≤ 285 meV (95% C.L.). The addition of DESI full-shape or Lyman-α P1D to CMB and DESI BAO results in small but noticeable improvement of the constraining power of the data. Lyman-α free-streaming measurements especially improve the constraint. Since they are based on eBOSS data, this sets a promising precedent for upcoming DESI data.

Frequentist statistics↗

An Online Approach for Mining Collective Behaviors from Molecular Dynamics Simulations

Collective behavior involving distally separate regions in a protein is known to widely affect its function. In this article, we present an online approach to study and characterize collective behavior in proteins as molecular dynamics (MD) simulations progress. Our representation of MD simulations as a stream of continuously evolving data allows us to succinctly capture spatial and temporal dependencies that may exist and analyze them efficiently using data mining techniques. By using tensor analysis we identify (a) collective motions (i.e., dynamic couplings) and (b) time-points during the simulation where the collective motions suddenly change. We demonstrate the applicability of this method on two different protein simulations for barnase and cyclophilin A. We characterize the collective motions in these proteins using our method and analyze sudden changes in these motions. Taken together, our results indicate that tensor analysis is well suited to extracting information from MD trajectories in an online fashion.

59 BASIC BIOLOGICAL SCIENCES↗

Evaluating Text Analytic Frameworks for Mental Health Surveillance

Reducing suicide incidence among US veterans is one of the highest priorities for the US Department of Veterans Affairs (VA). We are implementing a suicide risk detection system, in collaboration with the VA, that would serve as a surveillance system for risk factors appearing in clinical text data. Primary requirements for this system are fast search capability, feature and information extraction, and delivery of data to up-stream natural language processing models. As such, we are evaluating scalable storage solutions on the basis of performance, fault tolerance, and scalability. In this paper we present our current approach to evaluation, preliminary findings, and the work in progress towards a more robust text analysis pipeline.

Mayer, Benjamin W.↗

Enhancing Smart Home Privacy: A Tutorial on Local Differential Privacy Techniques for Frequency and Mean Estimation

The ubiquity of Internet of Things (IoT) systems has seamlessly integrated into our daily lives, particularly in smart homes where devices continuously monitor and optimize our living environments. These systems significantly contribute to home automation, energy efficiency, and overall comfort. However, this widespread connectivity poses inherent risks linked to the streaming of sensitive household data, necessitating robust privacy preservation mechanisms. This tutorial systematically examines privacy preservation through local differential privacy (LDP), with a particular focus on frequency and mean estimation techniques for smart home applications. Here, we present a comprehensive taxonomy of smart home data formats and provide detailed implementation guidance for event-based and w-event LDP mechanisms. Through practical examples using smart thermostats and HVAC systems, we demonstrate how these techniques can be effectively deployed in real-world scenarios. The tutorial concludes by examining emerging research directions, including adaptive privacy budgets and federated learning approaches, establishing a foundation for privacy-preserving smart home deployments.

Kotevska, Olivera [Oak Ridge National Laboratory (↗

Radioactive source localization in urban environments with sensor networks and the Internet of Things

The use of radiation detectors as an element in the so-called “Internet of Things” has recently become viable with the available of low-cost, mobile radiation sensors capable of streaming geo-referenced data. New methods for fusing the data from multiple sensors on such a network is presented. The traditional simple and ordinary Kriging methods present a challenge for such a network since the assumption of a constant mean is not valid in this application. In conclusion, a variety of Kalman filters are introduced in an attempt to solve the problem associated with this variable and unknown mean. Results are presented on a deployed sensor network.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

ADARA

The ADARA software is a collection of programs which gather neutron scattering data from multiple detector banks, multiplex the data into a single stream and distribute that stream to analysis, reduction and translation utilities in real-time.

Miller, Ross↗

HIDES (Hybrid Intrusion Detection for Energy Systems) [SWR-19-65]

Hybrid Intrusion Detection for Energy Systems (HIDES) is a conglomerate detector that incorporates three major components: (1) Signature-based detection that involves information technology (IT) related anomaly detection rules, (2) Behavior-based detection that utilizes specially crafted rulesets for detecting abnormal behavior regarding the power system's supervisory control and data acquisition (SCADA) communication streams, and (3) Learning-based detection that combines SCADA communication with phasor measurements to identify otherwise non-detectible attack vectors. The software itself interconnects intrusion detection engine (IDE) enabling communications between the generated OT and IT alerts with phasor measurements for the learning-based detection system. The resulting detection system can detect a wide array of IT, OT, and physical attacks in a real-time setting.

Rivera, Joshua↗

Using High Performance Computing to Understand Roles of Labile and Nonlabile U(VI) on Hanford 300 Area Plume Longevity

Evolution of a hexavalent uranium [U(VI)] plume at the Hanford 300 Area bordering the Columbia River is investigated to evaluate the roles of labile and nonlabile forms of U(VI) on the longevity of the plume. A high fidelity, three-dimensional, field-scale, reactive flow and transport model is used to represent the system. Richards equation coupled to multicomponent reactive transport equations are solved for times up to 100 years taking into account rapid fluctuations in the Columbia River stage resulting in pulse releases of U(VI) into the river. The peta-scale computer code PFLOTRAN developed under a DOE SciDAC-2 project is employed in the simulations and executed on ORNL's Cray XT5 supercomputer Jaguar. Labile U(VI) is represented in the model through surface complexation reactions and its nonlabile form through dissolution of metatorbernite used as a surrogate mineral. Initial conditions are constructed corresponding to the U(VI) plume already in place to avoid uncertainties associated with the lack of historical data for the waste stream. The cumulative U(VI) flux into the river is compared for cases of equilibrium and multirate sorption models and for no sorption. The sensitivity of the U(VI) flux into the river on the initial plume configuration is investigated. The presence of nonlabile U(VI) was found to be essential in explaining the longevity of the U(VI) plume and the prolonged high U(VI) concentrations at the site exceeding the EPA MCL for uranium.

99 GENERAL AND MISCELLANEOUS↗

Land Surface Modeling 2.0 for agricultural climate change impact assessments

Focus Area: This white paper addresses DOE AI4ESP focus area #2 by providing a sketch blueprint for a next generation, hybrid AI/process-based global Land Surface Modeling (LSM) framework to improve projections of climate change impacts on the land surface system including agriculture and the hydrological cycle. Science Challenge: Climate change impacts on agriculture are highly uncertain: -50% to +150% global production changes for major grains under high-end climate change, for example. The core challenge in land surface system predictability is the large gap between the scale at which the relevant biological processes act and the scale at which the risks need to be assessed. Conventional empirical and process-based modeling approaches are insufficient. A new multi-scale modeling paradigm which employs AI/ML to learn from new streams of remote sensing data and targeted ’gene-to-global’ simulations is needed.

54 ENVIRONMENTAL SCIENCES↗

Colorado State University Extension Industrial Assessment Center

Since its inception in 1984, the Colorado State University Industrial Assessment Center has performed industrial assessments at more than 720 manufacturing facilities in Colorado, Montana, Nebraska, Nevada, New Mexico, North Dakota, South Dakota, Utah, and Wyoming. From 2017 to 2019 there was a funding gap and the IAC shutdown. In 2020 through DOE extension funding the University relaunched the IAC as an extension center in order to provide assessments to underserved areas. Under this award, the CSU Industrial Assessment Center (IAC) was rebuilt with the help of student employees and the director. The CSU team experienced difficulty as the program was in the process of being restarted right as the 2020 pandemic hit. Nonetheless, the CSU IAC was instrumental in providing energy assessments to manufacturers in Colorado and Wyoming during the period of performance of 09/2019 – 12/2022. The Department of Energy's Industrial Assessment Centers (IACs) provide a valuable service to small and medium-sized manufacturers seeking to optimize their operations. These university-based centers offer no-cost, on-site assessments conducted by engineering faculty and students, analyzing energy consumption, production processes, and waste streams. They utilize advanced data acquisition systems to record operational data, and then use the data to create assessment recommendations. These recommendations form the foundation of the comprehensive energy report. The comprehensive report delivers actionable recommendations for enhancing energy efficiency, reducing waste, and reducing greenhouse gas emissions and improving productivity, often identifying significant cost savings. Furthermore, IACs facilitate access to implementation grants, enabling the businesses to readily adopt these improvements. This program not only strengthens individual businesses but also contributes to national goals of training the next generation of energy experts, as well as increasing industrial competitiveness and reduced environmental impact.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

An Efficient Storage-Driven Machine Learning Model for Performance in the Era of Multimodal Scientific Data

Scientific workflows are increasingly relying on machine learning (ML), simulation, and hybrid techniques to predict, understand, and optimize the behavior of complex experiments. High-performance computing has greatly improved researchers’ ability to acquire diverse data modalities in these workflows. Recent studies suggest that the performance of machine learning models can be improved by integrating data from various sources. Unfortunately, these workloads pose unprecedent pressure on the network storage to meet the demands associated with accessing these multimodal data. To mitigate the impact of intensive IO, we propose a solution that utilizes a multi-tier High-Performance Computing (HPC) distributed storage and data processing framework, placing computation where the data resides for better performance. By adopting this project, the scientific community will gain new opportunities to explore multimodal storage-driven possibilities, integrating multiple scientific data sources with advanced streaming frameworks. Additionally, our framework effectively utilizes computing resources and bridges the gaps identified by HPC experts. Our proposed approach tackles scalability and persistence challenges by leveraging native persistency, which has posed difficulties in traditional approaches. Furthermore, we seek to enhance fault-tolerance and load-balance of computations by leveraging real-time streaming in diverse scientific computing environments, thereby propelling advanced scientific computing research into the next generation.

97 MATHEMATICS AND COMPUTING↗

Waveform Simulation Framework: User Manual with Tutorials

This manuscript describes the Waveform Simulation Framework (WSF), a Python-based framework that provides a unified, programmable interface for generating synthetic seismograms for applications such as seismic array design, method development, and special event analysis. WSF standardizes how users define sources, receivers, and velocity models while abstracting simulator-specific configuration details, enabling workflows that are largely independent of the underlying numerical engine. The document provides installation guidance and tutorial-driven examples for three WSF simulator wrappers—WSF PyFK, WSF SW4, and WSF SPECFEM2D—illustrating end-to-end workflows from forward waveform simulation to common post-processing tasks (e.g., visualization and backprojection) using consistent data products (e.g., ObsPy Stream objects and SAC files).

97 MATHEMATICS AND COMPUTING↗

Coherent Structures at Ion Scales in Fast Solar Wind: Cluster Observations

We investigate the nature of magnetic turbulent fluctuations, around ion characteristic scales, in a fast solar wind stream, by using Cluster data. Contrarily to slow solar wind, where both Alfvénic (δb{sub ⊥}≫δb{sub ∥}) and compressive (δb{sub ∥}≫δb{sub ⊥}) coherent structures are observed, the turbulent cascade of fast solar wind is dominated by Alfvénic structures, namely, Alfvén vortices, with a small and/or finite compressive part, with the presence also of several current sheets aligned with the local magnetic field. Several examples of vortex chains are also recognized. Although an increase of magnetic compressibility around ion scales is observed also for fast solar wind, no strongly compressive structures are found, meaning that the nature of the slow and fast winds is intrinsically different. Multispacecraft analysis applied to this interval of fast wind indicates that the coherent structures are almost convected by the flow and aligned with the local magnetic field, i.e., their normal is perpendicular to B, which is consistent with a two-dimensional turbulence picture. Understanding intermittency and the related generation of coherent structures could provide a key insight into the nonlinear energy transfer and dissipation processes in magnetized and collisionless plasmas.

79 ASTRONOMY AND ASTROPHYSICS↗

Turbulent mixing film cooling correlation

Film cooling effectiveness correlation predicts air flow requirement for cooling gas turbine combustors. Turbulent mixing model accounts for mixing rate between cooling film and hot gas stream. Resulting equation correlates data within plus or minus 20 percent.

Juhasz, A. J.↗

Nonuniform flow field generation for supersonic compressor stator development: Design and preliminary results

Design and preliminary results are given for a technique which can generate a nonuniform flow similar to the discharge of an impulse supersonic compressor rotor. The technique utilizes a carefully contoured, two-dimensional blunt body in a conventional hypersonic wind tunnel to generate the required flow field. To show the effects of the flow vorticity, a cascade of impulse-type blades was tested in this test stream. Some preliminary performance data are given along with comparison with previously determined uniform flow results.

Lipfert, F. W.↗

Applications of ERTS-A Data Collection System (DCS) in the Arizona Regional Ecological Test Site (ARETS)

The author has identified the following significant results. Preliminary analysis of DCS data from the USGS Verde River stream flow measuring site indicates the DCS system is furnishing high quality data more frequently than had been expected. During the 43-day period between Nov. 3, and Dec. 15, 1972, 552 DCS transmissions were received during 193 data passes. The amount of data received far exceeded the single high quality transmission per 12-hour period expected from the DCS system. The digital-parallel ERTS-1 data has furnished sufficient to accurately compute mean daily gage heights. These in turn, are used to compute average daily streamflow rates during periods of stable or slowly changing flow conditions. The digital-parallel data has also furnished useful information during peak flow periods. However, the serial-digital DCS capability, currently under development for transmitting streamflow data, should provide data of greater utility for determining times of flood peaks.

Schumann, H. H.↗