Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

On detrending stream velocity time series for robust tidal flow turbulence characterization

We investigated the impact of detrending techniques on turbulence quantities from tidal stream flow data, focusing on the autocorrelation function, $ρ_{uu}$, and velocity spectrum, $Φ(f)$. Standard detrending methods, including high-pass frequency-based and polynomial-based techniques, are examined, alongside a proposed alternative method, the empirical mode decomposition (EMD). Our results highlight that intervals of flow acceleration and deceleration, typical in tidal and riverine flows, significantly affect the estimation of turbulence quantities using high-pass frequency filtering and polynomial detrending of varying orders. These methods can strongly influence $ρ_{uu}$ and $Φ(f)$, thereby affecting the accurate estimation of derived quantities. We examine two variations of detrending data using EMD; the first removes only the EMD residue, and the second removes both the residue and the largest scale intrinsic mode function (IMF). By comparing the detrended spectra with the modeled von Kármán spectra, we demonstrate that the second variation (i.e., removing the residue and the largest scale IMF) successfully removed the large-scale trend of the data while retaining the energy of other scales.

Detrend↗

3D velocity map imaging of electrons with TPX3CAM

In this report we demonstrate three-dimensional velocity map imaging of low energy electrons using a TPX3CAM, where the three-dimensional momentum information [$p_x, p_y, p_z$] is encoded in position and timing [x, y, t] of hits on the camera sensor. We make use of the camera sensor for the [x, y] information and a constant fraction discriminator and fast time to digital converter in the camera for the time information. We illustrate the capabilities of our apparatus by presenting above threshold ionization measurements of xenon, which produces well defined structures in the momentum resolved photoelectron yield.

79 ASTRONOMY AND ASTROPHYSICS↗

Design and simulation of a muon detector to characterize geological overburden

This study presents the design, construction, and simulation of a mobile muon detector tailored for geological overburden characterization. The detector employs plastic scintillator paddles with silicon photomultipliers (SiPMs) and a QuarkNet data acquisition system, offering a portable solution suitable for remote field deployment. The simulator’s modular aluminum frame allows for adjustable geometry and directional sensitivity, while its battery system supports over a week of autonomous operation. Preliminary experimental tests confirmed that its muon flux measurements were consistent with theoretical expectations. A comprehensive simulation framework using Geant4 and CORSIKA was developed to model detector response and overburden effects. Analytical and Monte Carlo methods were used to assess quadrant resolution and infer muon directionality. This work lays the foundation for future overburden mapping and supports the development of reconstruction algorithms for geological applications.

72 - PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A novel method for thermal noise reduction, enabling measurements of broadband, low-amplitude electron temperature fluctuations using individual radiometer channels

A new analysis method has been developed for measurements of broadband, low-amplitude turbulent electron temperature fluctuations in fusion plasmas using individual radiometer channels of a correlation electron cyclotron emission diagnostic. This method takes advantage of differences in the correlation time of thermal noise compared to the correlation time of plasma fluctuations in fusion reactors. The validation of this single-channel method is demonstrated using comparisons with the standard dual-channel radiometer spectral decorrelation method for measurements of turbulent electron temperature fluctuations in the core and edge of low confinement (L), improved confinement (I), and high confinement (H)-mode plasmas at the ASDEX Upgrade tokamak.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

S 5 : Probing the Milky Way and Magellanic Clouds potentials with the 6D map of the Orphan–Chenab stream

We present a 6D map of the Orphan–Chenab (OC) stream by combining the data from Southern Stellar Stream Spectroscopic Survey (S 5 ) and Gaia. We reconstruct the proper motion, radial velocity, distance, on-sky track, and stellar density along the stream with spline models. The stream has a total luminosity of M V = -8.2 and metallicity of [Fe/H] = -1.9, similar to classical Milky Way (MW) satellites like Draco. The stream shows drastic changes in its physical width varying from 200 pc to 1kpc, but a constant line-of-sight velocity dispersion of 5 km s -1 . Despite the large apparent variation in the stellar number density along the stream, the flow rate of stars along the stream is remarkably constant. We model the 6D stream track by a Lagrange-point stripping method with a flexible MW potential in the presence of a moving extended Large Magellanic Cloud (LMC). This allows us to constrain the mass profile of the MW within the distance range 15.6 < r < 55∙5 kpc, with the best measured enclosed mass of (2.85 ± 0.1) X 10 11 M ⊙ within 32.4 kpc. Our stream measurements are highly sensitive to the LMC mass profile with the most precise measurement of its enclosed mass made at 32.8 kpc, 7.02 ± 0.9) X 10 11 M ⊙ . We also detect that the LMC dark matter halo extends to at least 53 kpc. The fitting of the OC stream allows us to constrain the past LMC trajectory and the degree of dynamical friction it experienced. We demonstrate that the stars in the OC stream show large energy and angular momentum spreads caused by LMC perturbation.

79 ASTRONOMY AND ASTROPHYSICS↗

Gaia: segmented germanium detector for high-energy X-ray fluorescence and spectroscopic imaging

We present Gaia, a monolithic array of 96 high-purity germanium pixel detectors integrated with a custom low-noise application-specific integrated circuit (ASIC) and a field-programmable gate array (FPGA)-based data acquisition system. The sensor operates at ∼100 K using a commercial closed-cycle cryocooler, with the in-vacuum electronics thermally isolated from the cold finger to ensure thermal stability. The system demonstrates an average energy resolution of 711 eV at 122 keV, measured using a 57 Co source, and 253 eV at 5.89 keV, measured with 55 Fe across all channels. The readout architecture incorporates a high-performance FPGA paired with a dual-core ARM processor, forming a complete embedded Linux-based computing platform. Communication between the processor and FPGA is handled via memory-mapped I/O, and data are streamed over high-speed gigabit Ethernet. A full-scale 384-pixel Gaia detector, based on this 96-element module, is currently under fabrication.

36 MATERIALS SCIENCE↗

Methods and Experiences for Developing Abstractions for Data-intensive, Scientific Applications

Developing software for scientific applications that require the integration of diverse types of computing, instruments, and data present challenges that are distinct from commercial software. These applications require scale, and the need to integrate various programming and computational models with evolving and heterogeneous infrastructure. Pervasive and effective abstractions for distributed infrastructures are thus critical; however, the process of developing abstractions for scientific applications and infrastructures is not well understood. While theory-based approaches for system development are suited for well-defined, closed environments, they have severe limitations for designing abstractions for scientific systems and applications. The design science research (DSR) method provides the basis for designing practical systems that can handle real-world complexities at all levels. In contrast to theory-centric approaches, DSR emphasizes both practical relevance and knowledge creation by building and rigorously evaluating all artifacts. In this work, we show how DSR provides a well-defined framework for developing abstractions and middleware systems for distributed systems. Specifically, we address the critical problem of distributed resource management on heterogeneous infrastructure over a dynamic range of scales, a challenge that currently limits many scientific applications. We use the pilot-abstraction, a widely used resource management abstraction for high-performance, high throughput, big data, and streaming applications, as a case study for evaluating the DSR activities. For this purpose, we analyze the research process and artifacts produced during the design and evaluation of the pilot-abstraction. We find DSR provides a concise framework for iteratively designing and evaluating systems. Finally, we capture our experiences and formulate different lessons learned.

97 MATHEMATICS AND COMPUTING↗

ICED: An Integrated CGRA Framework Enabling DFVS-Aware Acceleration

oarse-grained reconfigurable arrays (CGRAs) are a promising solution to enable energy-efficient acceleration of applications from different domains. By leveraging reconfiguration at the functional level, they can adapt to significantly different computational patterns. Existing CGRA mapping approaches extract instruction-level parallelism, exploit loop-pipelining opportunities, guarantee the data dependency, and target high throughput of a given loop. However, the recurrence data-dependency in the DFG and the mismatch between required and available computing/communication resources complicate the mapping, and might lead to significant unbalances in the utilization of the CGRA's tiles. This results in wasted power for tiles with low utilization. Applying dynamic voltage and frequency scaling (DVFS) can potentially solve this challenge and improve energy efficiency by adjusting voltage and frequency of different tiles independently. CGRAs have also been successful in accelerating data-dependent streaming applications. However, in these applications, the execution time of each kernel in the pipeline might dynamically vary depending on the characteristics of the input. This also leads to under-utilization of resources for the dynamically changing kernels that do not limit the application throughput. DVFS can also improve energy efficiency for these applications by dynamically changing the voltage and frequency levels of tiles that host non performance-constraining kernels. This paper proposes ICEDTEA -- an integrated DVFS-aware framework to map applications on CGRAs that support power islands. ICEDTEA proposes a CGRA architecture supporting DVFS islands at varying granularity (from a single tile to a group of tiles) and the related DVFS-aware compilation and mapping toolchain. ICEDTEA is the first work that introduces DVFS support for spatio-temporal CGRAs at power-island levels. The experimental evaluation shows that ICEDTEA improves average utilization by 2.3$\times$ and energy-efficiency by 1.32$\times$ over a conventional CGRA. With streaming applications, ICEDTEA improves energy efficiency by 1.12$\times$ over a state-of-the-art CGRA that introduces partial dynamic reconfiguration to adapt to variations in kernels' throughput.

Tan, Cheng↗

Extraction and Visualization of Power System Interarea Oscillatory Modes

Interarea oscillatory modes pose a threat to power system stability. An algorithm is presented for the identification and analysis of such modes from high resolution phasor measurement data. The entire process is outlined including data collection, conditioning, extraction of the primary oscillatory frequency, and determination of participating areas of the system. Additionally a visualization methodology is presented which displays these results. Using the tools developed here the dominant modes and their associated regions of influence in a power system can be determined directly from measurement data.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Development of a Host-Based Intrusion Detection and Control Device for Industrial Field Control Devices

Industrial control systems contain a multitude of devices deployed into the field to observe and control a physical process. Currently, most of these devices lack common host-based cybersecurity features, which can lead them to be seen as vulnerable targets. The Cymbiote device was developed to address this problem by examining multiple streams of data to determine what might indicate a potential threat, and to evaluate and execute appropriate response actions. This paper discusses the evolution of the Cymbiote device in response to evaluation and testing done on real-world hardware. Experimental results are discussed, as are the new developments that have been made to the device in response to the findings. In addition, we describe future research directions for this approach along with the experimental setup changes in response to the requirements for statistical rigor.

Rice, Theora R.↗

Online Power System Event Detection via Bidirectional Generative Adversarial Networks

Accurate and speedy detection of power system events is critical to enhancing the reliability and resiliency of power systems. Although supervised deep learning algorithms show great promise in identifying power system events, they require a large volume of high-quality event labels for training. This paper develops a bidirectional anomaly generative adversarial network (GAN)-based algorithm to detect power system events using streaming PMU data, which does not rely on a huge amount of event labels. By introducing conditional entropy constraint in the objective function of GAN and graph signal processing-based PMU sorting technique, our proposed algorithm significantly outperforms state-of-the-art event detection algorithms in terms of accuracy. To facilitate the adoption of the proposed algorithm, a prototype online platform is also developed using Apache Hadoop, Kafka, and Spark to enable real-time event detection. Here, the accuracy and computational efficiency of the proposed algorithm are validated using a large-scale real-world PMU dataset from the Eastern Interconnection of the United States.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Toward a Visualization-Supported Workflow for Cyber Alert Management using Threat Models and Human-Centered Design

Cyber network analysts follow complex processes in their investigations of potential threats to their network. Much research is dedicated to providing automated tool support in the effort to make their tasks more efficient, accurate, and timely. This tool support comes in a variety of implementations from machine learning algorithms that monitor streams of data to visual analytic environments for exploring rich and noisy data sets. Cyber analysts, however, often speak of a need for tools which help them merge the data they already have and help them establish appropriate baselines against which to compare potential anomalies. Furthermore, existing threat models that cyber analysts regularly use to structure their investigation are not often leveraged in support tools. We report on our work with cyber analysts to understand they analytic process and how one such model, the MITRE ATT&CK Matrix [32], is used to structure their analytic thinking. We present our efforts to map specific data needed by analysts into the threat model to inform our eventual visualization designs. We examine data mapping for gaps where the threat model is under-supported by either data or tools. We discuss these gaps as potential design spaces for future research efforts. We also discuss the design of a prototype tool that combines machine-learning and visualization components to support cyber analysts working with this threat model.

Cyber Security↗

The effects of rising CO 2 concentrations on terrestrial systems: scaling it up

Since the Industrial Revolution, atmospheric CO 2 concentrations have increased by c. 50%, from 280 ppm to a current level of 415 ppm and rising (Ciais et al., 2013). But CO 2 concentrations would be even higher if the terrestrial biosphere was not acting as a carbon sink, absorbing c. 30% of the CO 2 we emit every year (Le Quéré et al., 2016). Understanding how increasing CO 2 concentrations will alter the ability of vegetation and soils to sequester carbon is therefore critical for predicting the trajectory of future climate change, since a reduction in this carbon sink would cause a more rapid accumulation of CO2 in the atmosphere (Dusenge et al., 2019). In this issue of New Phytologist, Walker et al. (2021; pp. 2413–2445) synthesize data from an incredibly broad range of sources, including herbaria, free air CO 2 enrichment (FACE) studies, ice cores, eddy covariance sites, and remote sensing, and examine an enormous diversity of measurements (such as soil respiration rates, glucose isotopomers from leaves, tree ring width data, stream-gauges for runoff, and direct atmospheric CO 2 measurements) to address the question of how increasing CO2 concentrations are affecting the carbon uptake capacity of our planet.

54 ENVIRONMENTAL SCIENCES↗

Deep learning categorization of infrasound array data

Here we develop a deep learning-based infrasonic detection and categorization methodology that uses convolutional neural networks with self-attention layers to identify stationary and non-stationary signals in infrasound array processing results. Using features extracted from the coherence and direction-of-arrival information from beamforming at different infrasound arrays, our model more reliably detects signals compared with raw waveform data. Using three infrasound stations maintained as part of the International Monitoring System, we construct an analyst-reviewed data set for model training and evaluation. We construct models using a 4-category framework, a generalized noise vs non-noise detection scheme, and a signal-of-interest (SOI) categorization framework that merges short duration stationary and non-stationary categories into a single SOI category. We evaluate these models using a combination of k-fold cross-validation, comparison with an existing “state-of-the-art” detector, and a transportability analysis. Although results are mixed in distinguishing stationary and non-stationary short duration signals, f-scores for the noise vs non-noise and SOI analyses are consistently above 0.96, implying that deep learning-based infrasonic categorization is a highly accurate means of identifying signals-of-interest in infrasonic data records.

47 OTHER INSTRUMENTATION↗

interactEM v1.0

An interactive, container-based workflow tool for creating and spawning directed acyclic graphs (DAGs) of operators in a distributed environment. It has a microservices architecture, and flow-based programming model. Current tools like this do not enable streaming of data directly between operators.

Welborn, Sam [Lawrence Berkeley National Laborator↗

An MPI/OpenACC implementation of a high-order electromagnetics solver with GPUDirect communication

We present performance results and an analysis of a message passing interface (MPI)/OpenACC implementation of an electromagnetic solver based on a spectral-element discontinuous Galerkin discretization of the time-dependent Maxwell equations. The OpenACC implementation covers all solution routines, including a highly tuned element-by-element operator evaluation and a GPUDirect gather–scatter kernel to effect nearest neighbor flux exchanges. Modifications are designed to make effective use of vectorization, streaming, and data management. Performance results using up to 16,384 graphics processing units of the Cray XK7 supercomputer Titan show more than 2.5× speedup over central processing unit-only performance on the same number of nodes (262,144 MPI ranks) for problem sizes of up to 6.9 billion grid points. We discuss performance-enhancement strategies and the overall potential of GPU-based computing for this class of problems.

Computer Science↗

Real-Time Edge AI for Distributed Systems (READS): Progress on Beam Loss De-Blending for the Fermilab Main Injector and Recycler

The Fermilab Main Injector enclosure houses two accelerators, the Main Injector and Recycler. During normal operation, high intensity proton beams exist simultaneously in both. The two accelerators share the same beam loss monitors (BLM) and monitoring system. Beam losses in the Main Injector enclosure are monitored for tuning the accelerators and machine protection. Losses are currently attributed to a specific machine based on timing. However, this method alone is insufficient and often inaccurate, resulting in more difficult machine tuning and unnecessary machine downtime. Machine experts can often distinguish the correct source of beam loss. This suggests a machine learning (ML) model may be producible to help de-blend losses between machines. Work is underway as part of the Fermilab Real-time Edge AI for Distributed Systems Project (READS) to develop a ML empowered system that collects streamed BLM data and additional machine readings to infer in real-time, which machine generated beam loss.

43 PARTICLE ACCELERATORS↗