SEARCH · Engineering Papers

Results for “Analytics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

All sources NASA NTRS DOE OSTI

DOE OSTI2017

Canopus: A Paradigm Shift Towards Elastic Extreme-Scale Data Analytics on HPC

Scientific simulations on high performance computing (HPC) platforms generate large quantities of data. To bridge the widening gap between compute and I/O, and enable data to be more efficiently stored and analyzed, simulation outputs need to be refactored, reduced, and appropriately mapped to storage tiers. However, a systematic solution to support these steps has been lacking on the current HPC software ecosystem. To that end, this paper develops Canopus, a progressive JPEGlike data management scheme for storing and analyzing big scientific data. It co-designs the data decimation, compression and data storage, taking the hardware characteristics of each storage tier into considerations. With reasonably low overhead, our approach refactors simulation data into a much smaller, reduced-accuracy base dataset, and a series of deltas that is used to augment the accuracy if needed. The base dataset and deltas are compressed and written to multiple storage tiers. Data saved on different tiers can then be selectively retrieved to restore the level of accuracy that satisfies data analytics. Thus, Canopus provides a paradigm shift towards elastic data analytics and enables end users to make trade-offs between analysis speed and accuracy on-the-fly. We evaluate the impact of Canopus on unstructured triangular meshes, a pervasive data model used by scientific modeling and simulations. In particular, we demonstrate the progressive data exploration of Canopus using the “blob detection” use case on the fusion simulation data.

Lu, Tao↗

DOE OSTI2021

A Conceptual Framework for HPC Operational Data Analytics

This paper provides a broad framework for under- standing trends in Operational Data Analytics (ODA) for High- Performance Computing (HPC) facilities. The goal of ODA is to allow for the continuous monitoring, archiving, and analysis of near real-time performance data, providing immediately actionable information for multiple operational uses. In this work, we combine two models to provide a comprehensive HPC ODA framework: one is an evolutionary model of analytics capabilities that consists of four types, which are descriptive, diagnostic, predictive and prescriptive, while the other is a four- pillar model for energy-efficient HPC operations that covers facility, system hardware, system software, and applications. This new framework is then overlaid with a description of current development and production deployments of ODA within leading- edge HPC facilities. Finally, we perform a comprehensive survey of ODA works and classify them according to our framework, in order to demonstrate its effectiveness.

Netti, Alessio↗

DOE OSTI2024

Grid Edge Waveform Analytics Framework for Event Detection and Classification

This paper provides a grid edge waveform analytics framework for power system event detection and classification in the local as well as in the wide area. This framework overviews data excellence for event detection and classification. The data excellence describes the data acquisition process and requirements, data processing, data quality, and data integrity. Power system event detection in the local area based on different features such as energy-based, cyclostationary approach, template matching, and wavelet transform are also discussed. Furthermore, local area event detection and classification using approaches such as statistical, signal processing, artificial intelligence, and hybrid are also discussed. Moreover, an overview of wide-area event detection and classification along with several other aspects such as wide-area events, wide-area event detection approaches, event location and system performance, event pattern recognition, inter-area oscillation, and wide-area frequency response under variable deployment of inverter-based resources are also provided. The proposed framework is the first step toward the goal of developing appropriate tools and methodologies to detect and classify local as well as wide-area events using waveform analytics. The appropriate event detection and classification framework development is especially important now as more and more grid edge devices with communication capabilities are being deployed in the modern power grid than ever before.

Bhusal, Narayan↗

DOE OSTI2022

Self-Protective Inverters Against Malicious Setpoints Using Analytical Reference Models

This paper presents the concept of self-protective inverters using reference models. In the proposed method, incoming setpoints from the utility operator or third-party aggregators are inspected using analytical reference models before engaging the setpoints to the inverter’s local controller. When a malicious setpoint passes the existing security layers, a smart inverter can examine the integrity of an incoming setpoint in real-time. The efficacy of the developed method has been tested using a laboratory setup, including a three-phase 3kVA SiC-MOSFET inverter and a 12kW NHR 9410 regenerative grid emulator. Furthermore, the results verify that the developed analytical models can provide device-level protection for grid-interactive inverters by inspecting and preventing harmful setpoints from getting engaged to the local controller.

42 ENGINEERING↗

DOE OSTI2019

Asset Monitoring using Smart Sensing and Advanced Analytics for the Distribution Network

As the electric grid transitions into a highly distributed and intelligent grid, electric utilities are becoming increasingly concerned with monitoring the health and performance of their distribution assets. As Internet of Things technologies and data analytics become inexpensive and ubiquitous, low-cost asset monitoring becomes more feasible. Moreover, using edge analytics, computations can be off-loaded to these intelligent sensors to report only actionable information to the cloud. This needs to be done in a highly distributed manner using non-intrusive sensors and device physics that seamlessly integrates with legacy infrastructure. Here, this paper reviews existing sensor based solutions, identifies t heir issues, proposes a novel solution by exploring the required attributes and proposes an approach for low-cost distribution transformer health monitoring.

Asset monitoring↗

DOE OSTI2024

Navigating Exascale Operational Data Analytics: From Inundation to Insight

In this paper, we address the challenges in achieving sustainable data-driven efficiency by providing a detailed exploration of the end-to-end operational data analytics (ODA) framework that evolved through two generations of supercomputer systems at the Oak Ridge Leadership Computing Facility (OLCF). This framework addresses large data streams ingested from heavily instrumented HPC environment that accumulates multi-terabytes per day. We outline the multifaceted data life cycle across HPC procurement, operations, and research & development, identifying key obstacles and design decisions that shape effective strategies in building and supporting data pipelines end-to-end. By sharing key insights and lessons learned from our experience, we offer recommendations for the HPC community on enabling sustainable operational data analytics and beyond. Our contributions aim to bridge the gap between potential and real benefits of operational data, guiding future efforts towards integrated and sustainable operational intelligence in high-performance computing environments.

Shin, Woong↗

DOE OSTI2026

OpenSAMPL: An Open Source Library for Timing and Synchronization Measurements and Analytics

Today's power grid operators are implementing timing and synchronization solutions that provide resilience to Global Navigation Satellite System (GNSS) vulnerabilities. These vendor-specific solutions often come with additional software applications that are designed to monitor that vendor's synchronization performance data. However, resilient timing architectures often resulting in multi-vendor solutions, including approaches that blend terrestrial clocks with space-based subscription services. In such an environment, collecting, analyzing, and visualizing data from a variety of sources within a single platform was heretofore not possible. To address this need, the US Department of Energy's Center for Alternative Synchronization and Timing (CAST) developed OpenSAMPL, the Open Synchronized Analytics and Monitoring Platform, an open-source Python framework for processing, loading, and observing clock measurement data from distributed devices. OpenSAMPL enables the ingestion of diverse clock-probe sources into a scalable time-series database and applies robust analytics. OpenSAMPL currently supports two vendor data pipelines, and will be extended to more in the near future, enabling seamless monitoring of a variety of timing and synchronization devices in a common environment.

Grant, Josh [ORNL] (ORCID:0000000163475060)↗

DOE OSTI2021

Analytical Bit-Error Model of NAND Flash Memories for Dosimetry Application

In this work, we provide an analytical model for the total ionizing dose (TID) effects on the bit error statistics of commercial flash memory chips. We have validated the model with experimental data collected by irradiating several commercial NAND flash memory chips from different technology nodes. We find that our analytical model can project bit errors at higher TID values (~ 20 krad(Si)) from measured data at lower TID values (<1 krad(Si)). Based on our model and the measured data, we have formulated basic design rules for using a commercial flash memory chip as a dosimeter. We discuss the impact of NAND chip-to-chip variability, noise margin and the intrinsic errors on the dosimeter design using detailed experimentation.

3-D NAND↗

DOE OSTI2017

Analytical Assessment for Transient Stability Under Stochastic Continuous Disturbances

Here, with the growing integration of renewable power generation, plug-in electric vehicles, and other sources of uncertainty, increasing stochastic continuous disturbances are brought to power systems. The impact of stochastic continuous disturbances on power system transient stability attracts significant attention. To address this problem, this paper proposes an analytical assessment method for transient stability of multi-machine power systems under stochastic continuous disturbances. In the proposed method, a probability measure of transient stability is presented and analytically solved by stochastic averaging. Compared with the conventional method (Monte Carlo simulation), the proposed method is many orders of magnitude faster, which makes it very attractive in practice when many plans for transient stability must be compared or when transient stability must be analyzed quickly. Also, it is found that the evolution of system energy over time is almost a simple diffusion process by the proposed method, which explains the impact mechanism of stochastic continuous disturbances on transient stability in theory.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2018

Analytic Analysis for Dynamic System Frequency in Power Systems Under Uncertain Variability

In this paper, a new systematic method is proposed to analyze the system frequency in power systems under uncertain variability (UV). UV gradually increases in power systems, which originates from the renewable energy generation, random loads, frequency measurement, and communication channels, exerting noteworthy impacts on dynamic system frequency. The UV is modeled as a stochastic process in this paper. Then, the stochastic differential equations are used to describe the dynamic system frequency response (SFR) of a power system under UV, which is based on the SFR model. To assess system frequency dynamics under UV, an index of intra-range probability is put forward. Based on stochastic analysis theory, an analytic method is proposed to analyze the system frequency under UV, by which the intra-range probability can be analytically solved. Compared with Monte Carlo simulation in a typical SFR case and the Iceland electricity transmission network, the proposed method shows almost the same results using much less computation resource. Finally, insights for improving the SFR under UV are provided. The proposed method can be used to quickly verify whether the system frequency could withstand the UV and stay in the security range.

42 ENGINEERING↗

DOE OSTI2020

Thermal Overloading Risk Mitigation With a Semi-Analytical Probabilistic Model on Branch Current

A semi-analytical formulation is presented in this paper for the probability computation of branch current in multiphase systems. The developed formula is derived based on the linear power flow model in rectangular coordinates. The system uncertainty injections can be renewable energy resources or loads and are modeled using a Gaussian mixture model (GMM). The developed formula can be used to compute the line current violation probability as well as integrate into optimal power flow problem as chance-constraint relaxation. Here, the proposed formula is first compared with the Matlab embedded numerical integration function to show its performance. Besides, the semi-analytical formula is validated and compared with the Monte Carlo simulation method using the IEEE 123-bus system, EPRI Ckt5, and Ckt7 systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

Resilience Analytics for Interdependent Power and Water Distribution Systems

The occurrence of large-scale outages in power distribution systems (PDSs) caused, for instance, by extreme weather events has raised concerns on the cascading impact of the power outages on the resilience of other critical infrastructures, including water distribution systems (WDSs), whose healthy operation highly relies on the availability of power from PDSs. Here, this paper proposes an analytics model for quantifying the interdependence between the resilience of power and water distribution systems. The proposed model first performs spatio-temporal outage analysis on the PDS and WDS to determine the PDS power serving capability and the resulting cascading impact on the WDS water serving capability during the occurrence of disruptions. The resilience interdependence is then determined by a proposed set of six metrics calculated using the power and water serving capability profiles, which trace and quantify the cascading impacts of power outages in the operation of WDSs during the degradation and recovery stages. The proposed analytics model is implemented on the IEEE 33-bus power distribution system supplying power for pumping stations of a 15-node test WDS, considering multiple cases of water storage capacity, single and multiple outage scenarios, and availability of distributed generation. The numerical results demonstrate that the proposed metrics track the temporal and spatial interdependence between the resilience of power and water distribution systems, providing a mechanism to identify weak spots, and assess options to enhance the resilience of the critical water infrastructure.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2024

Analytic Neural Network Gaussian Process Enabled Chance-Constrained Voltage Regulation for Active Distribution Systems with PVs, Batteries and EVs

This paper proposes an analytic neural network Gaussian process (NNGP)-based chance-constrained real-time voltage regulation method for active distribution systems with photovoltaics (PVs), batteries, and electric vehicles (EVs). NNGP can utilize historical measurement data to achieve real-time probabilistic node voltage estimation through Bayesian inference. Then, NNGP is fully analytically embedded into the optimal power flow model to perform voltage regulation and adapt to various topological changes. The uncertainties of voltage estimations are easily considered via the chance constraint, and it has been shown that the adoption of this chance constraint can significantly improve the reliability of voltage regulation under various scenarios. The comparison results with other methods, carried out on a real 759-node distribution system located in western Colorado, U.S., show that the proposed method can achieve accurate voltage estimation across different topologies and reliably perform voltage regulation considering PVs, batteries, and EVs.

active distribution systems↗

DOE OSTI2018

Towards Malware Detection via CPU Power Consumption: Data Collection Design and Analytics

This paper presents an experimental design and data analytics approach aimed at power-based malware detection on general-purpose computers. Leveraging the fact that malware executions must consume power, we explore the postulate that malware can be accurately detected via power data analytics. Our experimental design and implementation allow for programmatic collection of CPU power profiles for fixed tasks during uninfected and infected states using five different rootkits. To characterize the power consumption profiles, we use both simple statistical and novel, sophisticated features. We test a one-class anomaly detection ensemble (that baselines non-infected power profiles) and several kernel-based SVM classifiers (that train on both uninfected and infected profiles) in detecting previously unseen malware and clean profiles. The anomaly detection system exhibits perfect detection when using all features and tasks, with smaller false detection rate than the supervised classifiers. The primary contribution is the proof of concept that baselining power of fixed tasks can provide accurate detection of rootkits. Moreover, our treatment presents engineering hurdles needed for experimentation and allows analysis of each statistical feature individually. This work appears to be the first step towards a viable power-based detection capability for general-purpose computers, and presents next steps toward this goal.

Bridges, Robert↗

DOE OSTI2023

Analytical Large-Signal Modeling of Inverter-Based Microgrids With Koopman Operator Theory for Autonomous Control

The microgrid (MG) plays a crucial role in the energy transition, but its nonlinearity presents a significant challenge for large-signal power systems studies in the electromagnetic transient (EMT) time scale. In this paper, we develop a large-signal linear MG model that considers the detailed dynamics of the primary and zero-control levels based on the Koopman operator (KO) theory. Firstly, a set of observable functions is carefully designed to capture the nonlinear dynamics of the MG. The corresponding linear KO is then analytically derived based on these observables, resulting in the linear representation of the original nonlinear MG with observables as the new coordinate. The influence of external input on the system dynamics is also considered during the derivation, enabling control of the MG. We solve the voltage control problem using the traditional linear quadratic integrator (LQI) method to demonstrate that textbook linear control techniques can accurately control the original nonlinear MG via the developed KO-linearized MG model. Our proposed KO linearization method is generic and can be easily extended for different control objectives and MG structures using our analytical derivation procedure. Here, we validate the effectiveness of our methodology through various case studies.

25 ENERGY STORAGE↗

DOE OSTI2020

Towards Interactive, Reproducible Analytics at Scale on HPC Systems

The growth in scientific data volumes has resulted in a need to scale up processing and analysis pipelines using High Performance Computing (HPC) systems. These workflows need interactive, reproducible analytics at scale. The Jupyter platform provides core capabilities for interactivity but was not designed for HPC systems. In this paper, we outline our efforts that bring together core technologies based on the Jupyter Platform to create interactive, reproducible analytics at scale on HPC systems. Our work is grounded in a real world science use case-applying geophysical simulations and inversions for imaging the subsurface. Our core platform addresses three key areas of the scientific analysis workflow-reproducibility, scalability, and interactivity. We describe our implemention of a system, using Binder, Science Capsule, and Dask software. We demonstrate the use of this software to run our use case and interactively visualize real-Time streams of HDF5 data.

containers↗

DOE OSTI2016

Changes in geophysical properties caused by fluid injection into porous rocks: analytical models: Geophysical changes in porous rocks

Analytical models are provided that describe how the elastic compliance, electrical conductivity, and fluid-flow permeability of rocks depend on stress and fluid pressure. In order to explain published laboratory data on how seismic velocities and electrical conductivity vary in sandstones and granites, the models require a population of cracks to be present in a possibly porous host phase. The central objective is to obtain a consistent mean-field analytical model that shows how each modeled rock property depends on the nature of the crack population. We describe the crack populations by a crack density, a probability distribution for the crack apertures and radii, and the averaged orientation of the cracks. The possibly anisotropic nature of the elasticity, conductivity, and permeability tensors is allowed for; however, only the isotropic limit is used when comparing to laboratory data. For the transport properties of conductivity and permeability, the percolation effect of the crack population linking up to form a connected path across a sample is modeled. But, this effect is important only in crystalline rock where the host phase has very small conductivity and permeability. In general, the importance of the crack population to the transport properties increases as the host phase becomes less conductive and less permeable.

58 GEOSCIENCES↗

DOE OSTI2026

A Scoping Review of Mixed Initiative Visual Analytics in the Automation Renaissance

Artificial agents are increasingly integrated into data analysis workflows, carrying out tasks that were primarily done by humans. Our research explores how the introduction of automation recalibrates the dynamic between humans and automating technology. To explore this question, we conducted a scoping review encompassing twenty years of mixed-initiative visual analytic systems. To describe and contrast the relationship between humans and automation, we developed an integrated taxonomy to delineate the objectives of these mixed-initiative visual analytics tools, how much automation they support, and the assumed roles of humans. Here, we describe our qualitative approach of integrating existing theoretical frameworks with new codes we developed. Our analysis shows that the visualization research literature lacks consensus on the definition of mixed-initiative systems and explores a limited potential of the collaborative interaction landscape between people and automation. Our research provides a scaffold to advance the discussion of human-AI collaboration during visual data analysis. Our integrated taxonomy is available in the form of a web application on https://smonadjemi.github.io/miva.

Monadjemi, Shayan [ORNL] (ORCID:0000000293855969)↗