Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

Extraction and Visualization of Power System Interarea Oscillatory Modes

Interarea oscillatory modes pose a threat to power system stability. An algorithm is presented for the identification and analysis of such modes from high resolution phasor measurement data. The entire process is outlined including data collection, conditioning, extraction of the primary oscillatory frequency, and determination of participating areas of the system. Additionally a visualization methodology is presented which displays these results. Using the tools developed here the dominant modes and their associated regions of influence in a power system can be determined directly from measurement data.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Development of a Host-Based Intrusion Detection and Control Device for Industrial Field Control Devices

Industrial control systems contain a multitude of devices deployed into the field to observe and control a physical process. Currently, most of these devices lack common host-based cybersecurity features, which can lead them to be seen as vulnerable targets. The Cymbiote device was developed to address this problem by examining multiple streams of data to determine what might indicate a potential threat, and to evaluate and execute appropriate response actions. This paper discusses the evolution of the Cymbiote device in response to evaluation and testing done on real-world hardware. Experimental results are discussed, as are the new developments that have been made to the device in response to the findings. In addition, we describe future research directions for this approach along with the experimental setup changes in response to the requirements for statistical rigor.

Rice, Theora R.↗

Online Power System Event Detection via Bidirectional Generative Adversarial Networks

Accurate and speedy detection of power system events is critical to enhancing the reliability and resiliency of power systems. Although supervised deep learning algorithms show great promise in identifying power system events, they require a large volume of high-quality event labels for training. This paper develops a bidirectional anomaly generative adversarial network (GAN)-based algorithm to detect power system events using streaming PMU data, which does not rely on a huge amount of event labels. By introducing conditional entropy constraint in the objective function of GAN and graph signal processing-based PMU sorting technique, our proposed algorithm significantly outperforms state-of-the-art event detection algorithms in terms of accuracy. To facilitate the adoption of the proposed algorithm, a prototype online platform is also developed using Apache Hadoop, Kafka, and Spark to enable real-time event detection. Here, the accuracy and computational efficiency of the proposed algorithm are validated using a large-scale real-world PMU dataset from the Eastern Interconnection of the United States.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Toward a Visualization-Supported Workflow for Cyber Alert Management using Threat Models and Human-Centered Design

Cyber network analysts follow complex processes in their investigations of potential threats to their network. Much research is dedicated to providing automated tool support in the effort to make their tasks more efficient, accurate, and timely. This tool support comes in a variety of implementations from machine learning algorithms that monitor streams of data to visual analytic environments for exploring rich and noisy data sets. Cyber analysts, however, often speak of a need for tools which help them merge the data they already have and help them establish appropriate baselines against which to compare potential anomalies. Furthermore, existing threat models that cyber analysts regularly use to structure their investigation are not often leveraged in support tools. We report on our work with cyber analysts to understand they analytic process and how one such model, the MITRE ATT&CK Matrix [32], is used to structure their analytic thinking. We present our efforts to map specific data needed by analysts into the threat model to inform our eventual visualization designs. We examine data mapping for gaps where the threat model is under-supported by either data or tools. We discuss these gaps as potential design spaces for future research efforts. We also discuss the design of a prototype tool that combines machine-learning and visualization components to support cyber analysts working with this threat model.

Cyber Security↗

The effects of rising CO 2 concentrations on terrestrial systems: scaling it up

Since the Industrial Revolution, atmospheric CO 2 concentrations have increased by c. 50%, from 280 ppm to a current level of 415 ppm and rising (Ciais et al., 2013). But CO 2 concentrations would be even higher if the terrestrial biosphere was not acting as a carbon sink, absorbing c. 30% of the CO 2 we emit every year (Le Quéré et al., 2016). Understanding how increasing CO 2 concentrations will alter the ability of vegetation and soils to sequester carbon is therefore critical for predicting the trajectory of future climate change, since a reduction in this carbon sink would cause a more rapid accumulation of CO2 in the atmosphere (Dusenge et al., 2019). In this issue of New Phytologist, Walker et al. (2021; pp. 2413–2445) synthesize data from an incredibly broad range of sources, including herbaria, free air CO 2 enrichment (FACE) studies, ice cores, eddy covariance sites, and remote sensing, and examine an enormous diversity of measurements (such as soil respiration rates, glucose isotopomers from leaves, tree ring width data, stream-gauges for runoff, and direct atmospheric CO 2 measurements) to address the question of how increasing CO2 concentrations are affecting the carbon uptake capacity of our planet.

54 ENVIRONMENTAL SCIENCES↗

Deep learning categorization of infrasound array data

Here we develop a deep learning-based infrasonic detection and categorization methodology that uses convolutional neural networks with self-attention layers to identify stationary and non-stationary signals in infrasound array processing results. Using features extracted from the coherence and direction-of-arrival information from beamforming at different infrasound arrays, our model more reliably detects signals compared with raw waveform data. Using three infrasound stations maintained as part of the International Monitoring System, we construct an analyst-reviewed data set for model training and evaluation. We construct models using a 4-category framework, a generalized noise vs non-noise detection scheme, and a signal-of-interest (SOI) categorization framework that merges short duration stationary and non-stationary categories into a single SOI category. We evaluate these models using a combination of k-fold cross-validation, comparison with an existing “state-of-the-art” detector, and a transportability analysis. Although results are mixed in distinguishing stationary and non-stationary short duration signals, f-scores for the noise vs non-noise and SOI analyses are consistently above 0.96, implying that deep learning-based infrasonic categorization is a highly accurate means of identifying signals-of-interest in infrasonic data records.

47 OTHER INSTRUMENTATION↗

interactEM v1.0

An interactive, container-based workflow tool for creating and spawning directed acyclic graphs (DAGs) of operators in a distributed environment. It has a microservices architecture, and flow-based programming model. Current tools like this do not enable streaming of data directly between operators.

Welborn, Sam [Lawrence Berkeley National Laborator↗

An MPI/OpenACC implementation of a high-order electromagnetics solver with GPUDirect communication

We present performance results and an analysis of a message passing interface (MPI)/OpenACC implementation of an electromagnetic solver based on a spectral-element discontinuous Galerkin discretization of the time-dependent Maxwell equations. The OpenACC implementation covers all solution routines, including a highly tuned element-by-element operator evaluation and a GPUDirect gather–scatter kernel to effect nearest neighbor flux exchanges. Modifications are designed to make effective use of vectorization, streaming, and data management. Performance results using up to 16,384 graphics processing units of the Cray XK7 supercomputer Titan show more than 2.5× speedup over central processing unit-only performance on the same number of nodes (262,144 MPI ranks) for problem sizes of up to 6.9 billion grid points. We discuss performance-enhancement strategies and the overall potential of GPU-based computing for this class of problems.

Computer Science↗

Real-Time Edge AI for Distributed Systems (READS): Progress on Beam Loss De-Blending for the Fermilab Main Injector and Recycler

The Fermilab Main Injector enclosure houses two accelerators, the Main Injector and Recycler. During normal operation, high intensity proton beams exist simultaneously in both. The two accelerators share the same beam loss monitors (BLM) and monitoring system. Beam losses in the Main Injector enclosure are monitored for tuning the accelerators and machine protection. Losses are currently attributed to a specific machine based on timing. However, this method alone is insufficient and often inaccurate, resulting in more difficult machine tuning and unnecessary machine downtime. Machine experts can often distinguish the correct source of beam loss. This suggests a machine learning (ML) model may be producible to help de-blend losses between machines. Work is underway as part of the Fermilab Real-time Edge AI for Distributed Systems Project (READS) to develop a ML empowered system that collects streamed BLM data and additional machine readings to infer in real-time, which machine generated beam loss.

43 PARTICLE ACCELERATORS↗

Small File Aggregation with PLFS [Slides]

Today’s computational science demands have resulted in ever larger parallel computers, and storage systems have grown to match these demands. Parallel file systems used in this environment are increasingly specialized to extract the highest possible performance for large I/O operations, at the expense of other potential workloads. While some applications have adapted to I/O best practices and can obtain good performance on these systems, the natural I/O patterns of many applications result in the generation of a huge number of small files, the creation of which is poorly served by current parallel file systems at very large scale. This paper describes a new technique for optimizing small file access in parallel file systems for these very large scale systems. The idea is to use a virtual parallel log-structure file system on the compute nodes in order to aggregate large numbers of small files in compute node memory and then stream their data sequentially to a much smaller number of physical files on an underlying parallel file system. The technique is implemented and evaluated using PLFS as the aggregating middleware. We evaluate our system with micro-benchmarks on a local OSX filesystem and with an MPI extension of the standard Postmark to provide results at scale on both Lustre and PanFS parallel filesystems. We observe as much as a 33x improvement in small file create rates on a single host, and 30x improvement in small file write rates, compared to a baseline Lustre configuration on a leadership computing platform using 16,384 cores and achieve an unprecedented create rate of 200 million files per second.

97 MATHEMATICS AND COMPUTING↗

TSA Radiation Portal Monitor SC-770 Telnet Connection Using Tera Term

Tera Term is open-source telnet communications software, available from and other websites. This software provides a simple way to connect a computer to the Ethernet output of the SC-770 in a TSA radiation portal monitor (RPM). Streaming the data output can be useful for monitoring the status of an RPM, performing diagnostics, and recordkeeping.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Extraction-Scrub-Strip test results from the interim Salt Disposition Program Macrobatch 9 Tank 21H qualification samples

Savannah River National Laboratory (SRNL) analyzed samples from Tank 21H in support of qualification of Macrobatch (Salt Batch) 9 for the Interim Salt Disposition Program (ISDP). The Salt Batch 9 characterization results were previously reported. An Extraction-Scrub-Strip (ESS) test was performed to determine cesium distribution ratios (D (Cs) ) and cesium concentration in the strip effluent and decontaminated salt solution (DSS) streams; this data will be used by Tank Farm Engineering to project a cesium decontamination factor (DF). This test used actual Tank 21H material, and a blend solvent prepared by SRNL that mimics the solvent composition currently being used at the Modular Caustic-Side Solvent Extraction Unit (MCU). The ESS test showed acceptable performance with an extraction D (Cs) value of 52.4. This value is consistent with results from previous salt batch ESS tests using similar solvent formulations. This compares well against the predicted value of 56.5 from a recently created D (Cs) model

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Extraction, -scrub, -strip test results from the interim salt disposition program macrobatch 10 tank 21H qualification samples

Savannah River National Laboratory (SRNL) analyzed samples from Tank 21H in support of qualification of Macrobatch (Salt Batch) 10 for the Interim Salt Disposition Program (ISDP). The Salt Batch 10 characterization results were previously reported.ii,iii An Extraction, -Scrub, -Strip (ESS) test was performed to determine cesium distribution ratios (D(Cs)) and cesium concentration in the strip effluent (SE) and decontaminated salt solution (DSS) streams; this data will be used by Tank Farm Engineering to project a cesium decontamination factor (DF). This test used actual Tank 21H material, and a sample of the NGS Blend solvent currently being used at the Modular Caustic-Side Solvent Extraction Unit (MCU). The ESS test showed acceptable performance with an extraction D(Cs) value of 110. This value is consistent with results from previous salt batch ESS tests using similar solvent formulations. This is better than the predicted value of 39.8 from a recently created D(Cs) model.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Extraction, scrub, and strip test results for the salt waste processing facility caustic side solvent extraction solvent example

An Extraction, Scrub, and Strip (ESS) test was performed on a sample of Salt Waste Processing Facility (SWPF) Caustic-Side Solvent Extraction (CSSX) solvent and salt simulant to determine cesium distribution ratios (D(Cs)), and cesium concentration in the strip effluent (SE) and decontaminated salt solution (DSS) streams; this data will be used by Parsons to help determine if the solvent is qualified for use at the SWPF. The ESS test showed acceptable performance of the solvent for extraction, scrub, and strip operations. The extraction D(Cs) measured 12.9, exceeding the required value of 8. This value is consistent with results from previous ESS tests using similar solvent formulations. Similarly, scrub and strip cesium distribution ratios fell within acceptable ranges.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Extraction, scrub, and strip test results for the solvent transfer to salt waste processing facility

The Savannah River National Laboratory (SRNL) prepared approximately 240 gallons of Caustic-Side Solvent Extraction (CSSX) solvent for use at the Salt Waste Processing Facility (SWPF). An Extraction, Scrub, and Strip (ESS) test was performed on a sample of the prepared solvent using a salt solution prepared by Parsons to determine cesium distribution ratios (D(Cs)), and cesium concentration in the strip effluent (SE) and decontaminated salt solution (DSS) streams. This data will be used by Parsons to help qualify the solvent for use at the SWPF. The ESS test showed acceptable performance of the solvent for extraction, scrub, and strip operations. The extraction D(Cs) measured 15.5, exceeding the required value of 8. This value is consistent with results from previous ESS tests using similar solvent formulations. Similarly, scrub and strip cesium distribution ratios fell within acceptable ranges.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Extraction, Scrub, and Strip Test Results for the Salt Waste Processing Facility Caustic Side Solvent Extraction Solvent Sample

An Extraction, Scrub, and Strip (ESS) test was performed on a sample of Salt Waste Processing Facility (SWPF) Caustic-Side Solvent Extraction (CSSX) solvent and salt simulant to determine cesium distribution ratios (D( Cs )), and cesium concentration in the strip effluent (SE) and decontaminated salt solution (DSS) streams; this data will be used by Parsons to help determine if the solvent is qualified for use at the SWPF. The ESS test showed acceptable performance of the solvent for extraction, scrub, and strip operations. The extraction D( Cs ) measured 12.5, exceeding the required value of 8. This value is consistent with results from previous ESS tests using similar solvent formulations. Similarly, scrub and strip cesium distribution ratios fell within acceptable ranges. This revision was created to correct an error. The previous revision used an incorrect set of temperature correction coefficients which resulted in slight deviations from the correct D( Cs ) results.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Technology for Building Systems Integration and Optimization – Landscape Report

BTO's Commercial Building Integration (CBI) program helps advance a range of innovative building integration and optimization technologies and solutions, paving the way for high-performing buildings that could use 50-70% less energy than typical buildings. CBI’s work focuses on early stage technology innovation, with an emphasis on how components and systems work together and how whole buildings are integrated and optimized. This landscape study outlines the current body of knowledge, capabilities, and the broader array of solutions supporting integration and optimization in commercial buildings. CBI seeks to support solutions for both existing buildings and new construction, which often present very different challenges.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Extraction, Scrub, and Strip Test Results for the Second Solvent Lot Qualification Sample for the Salt Waste Processing Facility

An Extraction, Scrub, and Strip (ESS) test was performed on the qualification sample from the second lot of Caustic-Side Solvent Extraction (CSSX) solvent for the Salt Waste Processing Facility (SWPF). Testing used simulated salt solution to determine cesium distribution ratios (D( Cs )), and cesium concentration in the strip effluent (SE) and decontaminated salt solution (DSS) streams. This data will be used by Parsons to help determine if the solvent is qualified for use at the SWPF. The ESS test showed acceptable performance of the solvent for extraction, scrub, and strip operations. The extraction D( Cs ) measured 14.4, exceeding the required value of 8. This value is consistent with results from previous ESS tests using similar solvent formulations. Similarly, scrub and strip cesium distribution ratios fell within acceptable ranges.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗