Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Distribution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Distribution Grid Modeling Using Smart Meter Data

The knowledge of distribution grid models, including topologies and line impedances, is essential for grid monitoring, control and protection. However, such information is often unavailable, incomplete or outdated. The increasing deployment of smart meters (SMs) provides a unique opportunity to tackle this issue. This paper proposes a two-stage framework for distribution grid modeling using SM data. In the first stage, the network topology is identified by reconstructing a weighted Laplacian matrix of distribution networks. In the second stage, a least absolute deviations (LAD) regression model is developed for estimating line impedance of a single branch based on the nonlinear (inverse) power flow model, wherein a conductor library is leveraged to narrow down the solution space. The LAD regression model is originally a mixed-integer nonlinear program whose continuous relaxation is still non-convex. Furthermore, we specially address its convex relaxation and discuss the exactness. The modified regression model is then embedded within a bottom-up sweep algorithm to achieve the identification across the network in a branch-wise manner. Numerical results on the IEEE 13-bus, 37-bus and 69-bus test feeders validate the effectiveness of the proposed methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Asynchronous and Load-Balanced Union-Find for Distributed and Parallel Scientific Data Visualization and Analysis

We present a novel distributed union-find algorithm that features asynchronous parallelism and k-d tree based load balancing for scalable visualization and analysis of scientific data. Applications of union-find include level set extraction and critical point tracking, but distributed union-find can suffer from high synchronization costs and imbalanced workloads across parallel processes. In this study, we prove that global synchronizations in existing distributed union-find can be eliminated without changing final results, allowing overlapped communications and computations for scalable processing. We also use a k-d tree decomposition to redistribute inputs, in order to improve workload balancing. We benchmark the scalability of our algorithm with up to 1,024 processes using both synthetic and application data. Here, we demonstrate the use of our algorithm in critical point tracking and super-level set extraction with high-speed imaging experiments and fusion plasma simulations, respectively.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Deep learning ferroelectric polarization distributions from STEM data via with and without atom finding

Over the last decade, scanning transmission electron microscopy (STEM) has emerged as a powerful tool for probing atomic structures of complex materials with picometer precision, opening the pathway toward exploring ferroelectric, ferroelastic, and chemical phenomena on the atomic scale. Analyses to date extracting a polarization signal from lattice coupled distortions in STEM imaging rely on discovery of atomic positions from intensity maxima/minima and subsequent calculation of polarization and other order parameter fields from the atomic displacements. Here, we explore the feasibility of polarization mapping directly from the analysis of STEM images using deep convolutional neural networks (DCNNs). In this approach, the DCNN is trained on the labeled part of the image (i.e., for human labelling), and the trained network is subsequently applied to other images. We explore the effects of the choice of the descriptors (centered on atomic columns and grid-based), the effects of observational bias, and whether the network trained on one composition can be applied to a different one. This analysis demonstrates the tremendous potential of the DCNN for the analysis of high-resolution STEM imaging and spectral data and highlights the associated limitations.

36 MATERIALS SCIENCE↗
DOE OSTI2020

ServiceX A Distributed, Caching, Columnar Data Delivery Service

We will describe a component of the Intelligent Data Delivery Service being developed in collaboration with IRIS-HEP and the LHC experiments. ServiceX is an experiment-agnostic service to enable on-demand data delivery specifically tailored for nearly-interactive vectorized analysis. This work is motivated by the data engineering challenges posed by HL-LHC data volumes and the increasing popularity of python and Spark-based analysis workflows.ServiceX gives analyzers the ability to query events by dataset metadata. It uses containerized transformations to extract just the data required for the analysis. This operation is colocated with the data to avoid transferring unnecessary branches over the WAN. Simple filtering operations are supported to further reduce the amount of data transferred.Transformed events are cached in a columnar datastore to accelerate delivery of subsequent similar requests. ServiceX will learn commonly related columns and automatically include them in the transformation to increase the potential for cache hits by other users.Selected events are streamed to the analysis system using an efficient wire protocol that can be readily consumed by a variety of computational frameworks. This reduces time-to-insight for physics analysis by delegating to ServiceX the complexity of event selection, slimming, reformatting, and streaming.

Galewsky, B.↗
DOE OSTI2021

Mining Smart Meter Data to Enhance Distribution Grid Observability for Behind-the-Meter Load Control: Significantly improving system situational awareness and providing valuable insights

Distributed Energy Resources (DERs) are playing an increasingly important role in power systems. In 2023, five categories of DERs-distributed solar, electric vehicles (EVs), energy storage, residential smart thermostats, and small-scale combined heat and power-are expected to contribute about 104 GW to the U.S. summer peak (see GTM, 2018). With the increasing integration of DERs in power distribution systems, distributed load control is imperative to smooth the fluctuations that they introduce. However, a main challenge is that distribution systems lack systematic situational awareness because of their limited sensors. Furthermore, most customer-level behind-the-meter (BTM) DERs, such as rooftop photovoltaics (PVs), are being integrated into distribution systems, which complicates the system monitoring and control. Furthermore, enhanced electric grid monitoring is needed to promote renewable integration while ensuring reliability, but current approaches rely on expensive sensors.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1977

A distributed processing high data rate multiport wind-tunnel pressure measurement system

A multiport pressure measurement system has been developed for the high data rates and the in situ calibration of electronically scanned pressure (ESP) sensors. The system employs a stand-alone microcomputer, connected to a host computer, for data acquisition and preprocessing. The host computer provides several operational modes. Before each run the in situ calibration of each sensor is automatically performed. Using up to a maximum of 14 data acquisition and control units (DACU's), the system may be expanded from 16 to 10,752 pressure ports. Each DACU can make 20,000 measurements per second, average data, and perform statistical analyses before transferring data to the central unit. The system may be introduced into existing facilities and requires little user orientation.

Juanarena, D.↗
NASA NTRS1977

Seasat-A data acquisition and distribution

The instrument package of the Seasat-A satellite, scheduled for launch in 1978, consists of a short-pulse radar altimeter, a wind field scatterometer, a scanning multichannel microwave radiometer, and an experimental L-band synthetic aperture radar. Objectives of the mission include precision altimetry for marine geoid and sea surface topography assessments, the determination of wave directional spectra through radar scatterometry, and sea surface temperature measurements through microwave emission analysis. The synthetic aperture radar, operated selectively, is intended to yield land and sea imagery with a resolution of 25 m for such requirements as coastal surveys.

Dunne, J. A.↗
NASA NTRS1980

Large space systems technology electronics: Data and power distribution

The development of hardware technology and manufacturing techniques required to meet space platform and antenna system needs in the 1980s is discussed. Preliminary designs for manned and automatically assembled space power system cables, connectors, and grounding and bonding materials and techniques are reviewed. Connector concepts, grounding design requirements, and bonding requirements are discussed. The problem of particulate debris contamination for large structure spacecraft is addressed.

Dunbar, W. G.↗
NASA NTRS1979

User-oriented end-to-end transport protocols for the real-time distribution of telemetry data from NASA spacecraft

A set of standard telemetry protocols for downlink data flow facilitating the end-to-end transport of instrument data from the spacecraft to the user in real time is proposed. The direct switching of data by autonomous message 'packets' that are assembled by the source instrument on the spacecraft is discussed. The data system consists thus of a format on a message rather than word basis, and such packet telemetry would include standardized protocol headers. Standards are being developed within the NASA End-to-End Data System (NEEDS) program for the source packet and transport frame protocols. The source packet protocol contains identification of both the sequence number of the packet as it is generated by the source and the total length of the packet, while the transport frame protocol includes a sequence count defining the serial number of the frame as it is generated by the spacecraft data system, and a field specifying any 'options' selected in the format of the frame itself.

Hooke, A. J.↗
NASA NTRS1982

Statistical aspects of the 1980 solar flars. 1: Data base, frequency distributions, and overview remarks

AII1349 H alpha flares occurring in 1980 which have known start, maximum brightness, and end times, latitudes, and associated importance and X-ray classes were used to perform a statistical study of flare rise time, decay time, duration, latitude, importance (areal and relative intensity), and X-ray class. Frequency distributions of these parameters are tabulated and plotted.

Wilson, R. M.↗
NASA NTRS1990

Design and Evaluation of Candidate Pressure Distribution and Air Data System Tile Penetration for the Aeroassist Flight Experiment

This program objectives were to produce a pressure measurements system that penetrates the thermal protection system of a spacecraft and is able to obtain accurate pressure data. The design was tested vibro-acoustically, aerothermally, and structurally and found to be adequate. This design is a possible replacement of the current pressure system on the orbiter.

Vontheumer, Alfred E.↗
NASA NTRS1990

Low cost management of replicated data in fault-tolerant distributed systems

Many distributed systems replicate data for fault tolerance or availability. In such systems, a logical update on a data item results in a physical update on a number of copies. The synchronization and communication required to keep the copies of replicated data consistent introduce a delay when operations are performed. A technique is described that relaxes the usual degree of synchronization, permitting replicated data items to be updated concurrently with other operations, while at the same time ensuring that correctness is not violated. The additional concurrency thus obtained results in better response time when performing operations on replicated data. How this technique performs in conjunction with a roll-back and a roll-forward failure recovery mechanism is also discussed.

Joseph, Thomas A.↗