SEARCH · Engineering Papers
Results for “Data Distribution”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Machine Learning-Based Near-Realtime Leakage Detection for Caprock Integrity Monitoring using Distributed Acoustic Sensing (DAS) Data from Carbon Capture and Sequestration (CCS) Operations
16th International Conference on Greenhouse Gas Technologies (GHGT-16), Lyon, France, October 23-27, 2022
An Integrated Indexing and Search Service for Distributed File Systems
Data services such as search, discovery, and management in scalable distributed environments have traditionally been decoupled from the underlying file systems, and are often deployed using external databases and indexing services. However, modern data production rates, looming data movement costs, and the lack of metadata, entail revisiting the decoupled file system-data services design philosophy. In this article, we present TagIt, a scalable data management service framework aimed at scientific datasets, which can be integrated into prevalent distributed file system architectures. A key feature of TagIt is a scalable, distributed metadata indexing framework, which facilitates a flexible tagging capability to support data discovery. Furthermore, the tags can also be associated with an active operator, for pre-processing, filtering, or automatic metadata extraction, which we seamlessly offload to file servers in a load-aware fashion. We have integrated TagIt into two popular distributed file systems, i.e., GlusterFS and CephFS. Our evaluation demonstrates that TagIt can expedite data search operation by up to 10× over the extant decoupled approach.
Online Model-Free Chance-Constrained Distribution System Voltage Control Using DERs
This paper proposes an online data-driven distributed energy resource management system (DERMS) optimization method using chance-constrained formulation to address distribution system voltage regulation. This is achieved via the local sensitivity factor (LSF)-enabled reformulation of the DER control into a linear programming (LP) problem, which is easy and computationally efficient to solve. The LSF is estimated using online measurements and does not need the assumption of node load information. The latter is usually required for existing optimization-based methods but is difficult to obtain in practice. To mitigate measurement uncertainties, a scenario-based chance-constrained formulation is constructed. Compared with other control methods, the results carried out in a realistic distribution system show that the proposed method can effectively eliminate voltage violation issues.
Pooling Data Improves Multimodel IDF Estimates over Median-Based IDF Estimates: Analysis over the Susquehanna and Florida
Traditional multimodel methods for estimating future changes in precipitation intensity, duration, and frequency (IDF) curves rely on mean or median of models’ IDF estimates. Such multimodel estimates are impaired by large estimation uncertainty, shadowing their efficacy in planning efforts. Here, assuming that each climate model is one representation of the underlying data generating process, i.e., the Earth system, we propose a novel extension of current methods through pooling model data: (i) evaluate performance of climate models in simulating the spatial and temporal variability of the observed annual maximum precipitation (AMP), (ii) bias-correct and pool historical and future AMP data of reasonably performing models, and (iii) compute IDF estimates in a nonstationary framework from pooled historical and future model data. Pooling enhances fitting of the extreme value distribution to the data and assumes that data from reasonably performing models represent samples from the “true” underlying data generating distribution. Through Monte Carlo simulations with synthetic data, we show that return periods derived from pooled data have smaller biases and lesser uncertainty than those derived from ensembles of individual model data. We apply this method to NA-CORDEX models to estimate changes in 24-h precipitation intensity–frequency (PIF) estimates over the Susquehanna watershed and Florida peninsula. Our approach identifies significant future changes at more stations compared to median-based PIF estimates. The analysis suggests that almost all stations over the Susquehanna and at least two-thirds of the stations over the Florida peninsula will observe significant increases in 24-h precipitation for 2–100-yr return periods.
First Global Extraction of Generalized Parton Distributions from Experiment and Lattice Data with Next-to-Leading-Order Accuracy
We report the first global extraction of generalized parton distributions, GUMP 1.0, by combining deeply virtual Compton scattering and 𝜌-meson production data from Jefferson Lab and the Hadron-Electron Ring Accelerator with global fits of parton distribution functions, charge form factors, and lattice quantum chromodynamics simulations. Using a conformal moment space parametrization, we achieve a unified description across low- and high-𝑥 regions at next to leading order accuracy in perturbative corrections. The results provide state-of-the-art generalized parton distributions consistent with almost all known facts, enabling three-dimensional nucleon imaging in impact parameter space and, at the same time, establishing a benchmark for future theoretical and experimental studies of the nucleon structure.
DTS data from TRACER TBS
Distributed temperature-sensing data collected using a Silixa-XT DTS and 50/125 MM fiber. Data are calibrated using two water baths at the surface and an iMet aloft at the end of the fiber and tether. The data are then assigned an altitude for the TBS flight.
Data and scripts associated with a manuscript investigating dissolved organic matter and microbial community linkages across seven globally distributed rivers
This data package is associated with the publication “Meta-metabolome ecology reveals that geochemistry and microbial functional potential are linked to organic matter development across seven rivers” submitted to Science of the Total Environment. This data package includes the data necessary to replicate the analyses presented within the manuscript to investigate dissolved organic matter (DOM) development across broad spatial distances and within divergent biomes. Specifically, we included the Fourier transform ion cyclotron mass spectrometry (FTICR-MS) data, geochemistry data, annotated metagenomic data, and results from ecological null modeling analyses in this data package. Additionally, we included the scripts necessary to generate the figures from the manuscript. Complete metagenomic data associated with this data package can be found at the National Center for Biotechnology (NCBI) under Bioproject PRJNA946291. This dataset consists of (1) four folders; (2) a file-level metadata (flmd) file; (3) a data dictionary (dd) file; (4) a factor sheet describing samples; and (5) a readme. The FTICR Data folder contains (1) the processed Fourier transform ion cyclotron mass spectrometry (FTICR-MS) data; (2) a transformation-weighted characteristics dendrogram generated from the FTICR-MS data; and (3) the script used to generate all FTICR-MS related figures. The Geochemical Data folder contains (1) the single geochemistry data file and (2) the R script responsible for generating associated figures. The Metagenomic Data folder contains (1) annotation information across different levels; (2) carbohydrate active enzyme (CAZyme) information from the dbCAN database (Yin et al., 2012); (3) phylogenetic tree data (FASTAs, alignments, and tree file); and (4) the scripts necessary to analyze all of these data and generate figures. The Null Modeling Data folder contains (1) data generated during null modeling for each river and all rivers combined and (2) the R scripts necessary to process the data. All files are .csv, .pdf, .tsv, .tre, .faa, .afa, .tree, or .R.
Local measurements of the spatial magnetic field distribution in a z-pinch plasma during and near stagnation using polarization spectroscopy
We present here the detailed measurements of radial distribution of the magnetic field in a gas-puff z-pinch plasma at the final stages of the implosion phase and at stagnation. While the measurements are chordal, the radial distribution of different charge states was utilized to measure the magnetic field locally for certain radii, so that unlike chordal measurements in general, the magnetic field radial distribution was obtained with no need for the Abel inversion of the data. The distribution was measured using the Zeeman effect via a novel spectroscopic technique, at several axial locations, and demonstrates striking features such as the peak field remaining at a radius much larger than the stagnation radius at all times. Furthermore, while the distribution observed is sometimes monotonic with respect to the radius, it is often not, a behavior that can be linked to 2D features in the plasma column resulting from the Rayleigh–Taylor instability. The current flowing through the stagnating plasma was found to be a small fraction of the total current, resulting in clearly insufficient magnetic pressure to balance the plasma pressure at stagnation. The magnetic field data, taken over several axial positions, are used to obtain the true inductance in the imploding plasma for the first time; it is found that the data cannot explain the current turnover at stagnation. A simulation with the MACH2-Tabular Collisional-Radiative Equilibrium magnetohydrodynamics code in the r–z plane shows that the peak of the magnetic field pinches to a much smaller radius than is observed in the spectroscopic data. Furthermore, the depth of the computed current turnover at stagnation is smaller than the measured one. The two observed features of a radially extended magnetic field at stagnation together with a deep current turnover are a challenge to match in simulations. Various calculations and estimates of the inductive and resistive load voltages are examined to ascertain if they are responsible for the observed current notch. Lastly, the results demonstrate that the knowledge of the true inductance in the driven load requires such magnetic-field-distribution measurements and that imaging data or electrical measurements are insufficient.
DASSA v0.0.1
DASSA (Parallel DAS Data Storage and Analysis) provides a data storage engine and analysis engine for data from distributed acoustic sensing and other methods. It supports various data analysis operations, from FFT , signal filter, cross-correlation, compression, stacking etc.
Online Model-Free Chance-Constrained Distribution System Voltage Control Using DERs: Preprint
This paper proposes an online data-driven distributed energy resource management system (DERMS) optimization method using chance-constrained formulation to address distribution system voltage regulation. This is achieved via the local sensitivity factor (LSF)-enabled reformulation of the DER control into a linear programming (LP) problem, which is easy and computationally efficient to solve. The LSF is estimated using online measurements and does not need the assumption of node load information. The latter is usually required for existing optimization-based methods but is difficult to obtain in practice. To mitigate measurement uncertainties, a scenario-based chance-constrained formulation is constructed. Compared with other control methods, the results carried out in a realistic distribution system show that the proposed method can effectively eliminate voltage violation issues.
Risk-Aware Measurement Synchronization and Recovery for DSSE With Heterogeneous Data Sources
Power distribution systems are increasingly integrating heterogeneous sensors with varying data reporting rates and types, which pose challenges to achieving observability at the desired temporal resolution of distribution system state estimation (DSSE). Multisensor failures caused by extreme events exacerbate these issues, introducing substantial uncertainties into DSSE. This article proposes a novel solution to these challenges by ensuring high-resolution system observability despite heterogeneous data sources and multisensor failures. First, a deep learning architecture combining long short-term memory (LSTM) and graph convolutional network (GCN) is employed to synchronize meters with different reporting rates, aiming to achieve system observability. A random-walk-model-based approach is introduced to generate pseudo-measurements while properly characterizing their uncertainties under multisensor failures. Finally, a disaster-risk-informed observability metric (RiOM) is defined to quantify the uncertainty associated with state estimation results. The proposed framework offers deeper insights into the system observability on the fly compared with conventional analysis. The effectiveness of the framework is demonstrated on an IEEE standard test case and a large-scale real-world distribution feeder in mid-Minnesota in the U.S.
DTS data from SGP TBS
Distributed temperature-sensing data collected using a Silixa-XT DTS and 50/125 MM fiber. Data are calibrated using two water baths at the surface and an iMet aloft at the end of the fiber and tether. The data are then assigned an altitude for the TBS flight. Data collected prior to Febuary 11, 2020 were collected at the SGP Central Facility (CF). Data from 2/11/20 were collected with a Sensornet Oryx DTS at the E9 site, not at the CF. Data from May 2021 were collected with a Sensornet Oryx at the CF, and with a Silixa XT at the CF. Data from July 2021 were collected at the SGP CF, EF9, and EF36 with a Silixa XT. Data from October 2021 were collected at the SGP EF36 with a Silixa XT. Data from February 2022 were collected at the CF with a Silixa XT.
Cyber–Physical System Security of Distribution Systems
The Information and Communications Technology (ICT) for control and monitoring of power systems is a layer on top of the physical power system infrastructure. The cyber system and physical power system components form a tightly coupled Cyber–Physical System (CPS). Sources of vulnerabilities arise from the computing and communication systems of the cyber–power grid. Cyber intrusions targeting the power grid are serious threats to the reliability of electricity supply that is critical to society and the economy. In a typical Information Technology environment, numerous attack scenarios have shown how unauthorized users can access and manipulate protected information from a network domain. The need for cyber security has led to industry standards that power grids must meet to ensure that the monitoring, operation, and control functions are not disrupted by cyber intrusions. Cyber security technologies such as encryption and authentication have been deployed on the CPS. Intrusion or anomaly detection and mitigation tools developed for power grids are emerging. Furthermore, this survey paper provides the basic concepts of cyber vulnerabilities of distribution systems and CPS security. The important ICT subjects for distribution systems covered in this paper include Supervisory Control And Data Acquisition, Distributed Energy Resources, including renewable energy and smart meters.
dGen (Distributed Generation Market Demand) Model Data: Alpha Release
Open sourced data needed to run the basic alpha release version of the dGen model. Includes a pre-generated agent file of 100,000 agents in pickle file format along with the base schema and table data in parquet format that are needed to create a postgreSQL database for the model to interact with.
Enabling Interoperable SCADA Communications for PV Inverters through Embedded Controllers
The percentage integration of photovoltaic (PV) inverters in the field has increased significantly in the past 5 years. Regardless of the size of the PV plants and the inverters (residential vs. commercial), it is becoming crucial that these devices have the capability to communicate with peers (other smart devices) and with components that are at a hierarchy above the inverters (e.g., supervisory control and data acquisition (SCADA) systems, distributed controllers, and data managers). This project aims to develop a standard SCADA software code for inverters’ embedded controllers that will enable interoperability with other components in the system. To achieve this, the code will be developed using two different protocols: Distributed Network Protocol 3 and International Electrotechnical Commission 61850. The developed code is aimed to be deployed in simple embedded controllers. It will be tested in the National Renewable Energy Laboratory’s (NREL’s) Energy Systems Integration Facility. The tested code will then be made available through Triangle MicroWorks’s (TMW’s) software platform. The primary objectives of this project include training the NREL team with TMW’s embedded controller libraries, developing an interoperable communication code for embedded controllers, successfully testing and deploying the code, and demonstrating the newly developed code in a conference.
Achievements and Prospects of Global Broadband Seismographic Networks After 30 Years of Continuous Geophysical Observations
Global seismographic networks (GSNs) emerged during the late nineteenth and early twentieth centuries, facilitated by seminal international developments in theory, technology, instrumentation, and data exchange. The mid- to late-twentieth century saw the creation of the World-Wide Standardized Seismographic Network (1961) and International Deployment of Accelerometers (1976), which advanced global geographic coverage as seismometer bandwidth increased greatly allowing for the recording of the Earth's principal seismic spectrum. The modern era of global observations and rapid data access began during the 1980s, and notably included the inception of the GEOSCOPE initiative (1982) and GSN (1988). Through continual improvements, GEOSCOPE and the GSN have realized near-real time recording of ground motion with state-of-art data quality, dynamic range, and timing precision to encompass 180 seismic stations, many in very remote locations. Data from GSNs are increasingly integrated with other geophysical data (e.g., space geodesy, infrasound and Interferometric Synthetic Aperture Radar). Globally distributed seismic data are critical to resolving crust, mantle, and core structure; illuminating features of the plate tectonic and mantle convection system; rapid characterization of earthquakes; identification of potential tsunamis; global nuclear test verification; and provide sensitive proxies for environmental changes. As the global geosciences community continues to advance our understanding of Earth structure and processes controlling elastic wave propagation, GSN infrastructure offers a springboard to realize increasingly multi-instrument geophysical observatories. Here, we review the historical, scientific, and monitoring heritage of GSNs, summarize key discoveries, and discuss future associated opportunities for Earth Science.