Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “STORED”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

Accelerating Multigrid-based Hierarchical Scientific Data Refactoring on GPUs

Rapid growth in scientific data and a widening gap between computational speed and I/O bandwidth make it increasingly infeasible to store and share all data produced by scientific simulations. Instead, we need methods for reducing data volumes: ideally, methods that can scale data volumes adaptively so as to enable negotiation of performance and fidelity tradeoffs in different situations. Multigrid-based hierarchical data representations hold promise as a solution to this problem, allowing for flexible conversion between different fidelities so that, for example, data can be created at high fidelity and then transferred or stored at lower fidelity via logically simple and mathematically sound operations. However, the effective use of such representations has been hindered until now by the relatively high costs of creating, accessing, reducing, and otherwise operating on such representations. We describe here highly optimized data refactoring kernels for GPU accelerators that enable efficient creation and manipulation of data in multigrid-based hierarchical forms. We demonstrate that our optimized design can achieve up to 250 TB/s aggregated data refactoring throughput—83% of theoretical peak—on 1024 nodes of the Summit supercomputer. We showcase our optimized design by applying it to a large-scale scientific visualization workflow and the MGARD lossy compression software.

Data refactoring↗

A Scalable Pipeline for Gigapixel Whole Slide Imaging Analysis on Leadership Class HPC Systems

Whole Slide Imaging (WSI) captures microscopic details of a patient's histopathological features at multiple res-olutions organized across different levels. Images produced by WSI are gigapixel-sized, and saving a single image in memory requires a few gigabytes which is scarce since a complicated model occupies tens of gigabytes. Performing a simple met-ric operation on these large images is also expensive. High-performance computing (HPC) can help us quickly analyze such large images using distributed training of complex deep learning models. One popular approach in analyzing these images is to divide a WSI image into smaller tiles (patches) and then train a simpler model with these reduced-sized but large numbers of patches. However, we need to solve three pre-processing challenges efficiently for pursuing this patch-based approach. 1) Creating small patches from a high-resolution image can result in a high number (hundreds of thousands per image) of patches. Storing and processing these images can be challenging due to a large number of I/O and arithmetic operations. To reduce I/Oand memory accesses, an optimal balance between the size and number of patches must exist to reduce I/O and memory accesses. 2) WSI images may have tiny annotated regions for cancer tissue and a significant portion with normal and fatty tissues; correct patch sampling should avoid dataset imbalance. 3) storing and retrieving many patches to and from disk storage might incur I/O latency while training a deep learning model. An efficient distributed data loader should reduce I/O latency during the training and inference steps. This paper explores these three challenges and provides empirical and algorithmic solutions deployed on the Summit supercomputer hosted at the Oak Ridge Leadership Computing Facility.

Dash, Sajal↗

The Empirical Effect of Fleet Optimization on Synchronization and Rebound Effects in Heat Pump Water Heaters

Demand response is a growing concept in light of the internet of things and an increasing need for grid flexibility. Water heaters are one of the preferred devices for providing demand response for grid services and peak management due to their capability to store energy. The efficient use of water heaters for demand response requires consideration of the associated load effects such as synchronization of device schedules and rebound effect. These effects present a significant challenge. Despite the importance of the mentioned effects for water heater queuing and scheduling, there has been no effort to quantify and empirically validate their impact. This study attempts to address this gap by offering two methods - Ward clustering and Euclidean K-means - to evaluate the extent of synchronization in a fleet of 42 water heaters in Atlanta, GA. Using the aforementioned methods on the measured data, we find evidence of convergence of water heater loads as a result of optimization compared to an idle period and analyzed their impact.

demand response↗

Improving Frequency Stability and Minimizing Load Shedding Events by Adopting Grid-Scale Energy Storage with Grid Forming Inverters

The upward adoption trend of renewable generation not only means cleaner energy integrated into modern power grids, but also that most new generation sources are based on front-end inverter bridges, used as interfaces to most wind generation and all the solar PV. It is well known that due to their power electronics-based construction rather than rotational shafts, these sources do not provide inertia inherently, nor substantial amounts of short-circuit currents. However, stable energy such as what can be stored in energy storage systems, although interfaced via inverters, can be controlled to respond to system disturbances in a manner that emulates inertial behavior. This paper focuses on the application of such energy storage systems to augment inertia in the island of Puerto Rico. To do so, a user defined inverter model that contains grid forming capabilities and fast frequency response is modeled and integrated into the real transmission system in power flow and dynamics software. Energy storage is then connected to two selected areas so that it not only provides frequency regulation to avoid widespread load shedding events, but also other tangible benefits. The simulated cases suggest that even relatively small energy storage systems can avert load shedding events if adequately placed in the transmission network.

Grid-forming inverters, IBR, Inertia↗

Persistent Memory Object Storage and Indexing for Scientific Computing

This paper presents Mosiqs, a persistent memory object storage framework with metadata indexing and querying for scientific computing. We design Mosiqs based on the key idea that memory objects on shared PM pool can live beyond the application lifetime and can become the sharing currency for applications and scientists. Mosiqs provides an aggregate memory pool atop an array of persistent memory devices to store and access memory objects. Mosiqs uses a lightweight persistent memory key-value store to manage the metadata of memory objects such as persistent pointer mappings, which enables memory object sharing for effective scientific collaborations. Mosiqs is implemented atop PMDK. We evaluate the proposed approach on many-core server with an array of real PM devices. The preliminary evaluation confirms a 100% improvement for write and 30% in read performance against a PM-aware file system approach.

Khan, Awais↗

Information-Theoretic Exploration of Multivariate Time-Varying Image Databases

Modern scientific simulations produce very large datasets, making interactive exploration of such data computationally prohibitive. An increasingly common data reduction technique is to store visualizations and other data extracts in a database. The Cinema project is one such approach, storing visualizations in an image database for post hoc exploration and interactive image-based analysis. This work focuses on developing efficient algorithms that can quantify various types of multivariate dependencies existing within multi-variable datasets. It applies specific mutual information measures for the quantification of salient regions from multivariate image data. Here, using such information measures, the opacity of the images is modulated so that the salient regions are automatically highlighted and the domain scientists can interactively explore the most relevant regions for scientific discovery.

97 MATHEMATICS AND COMPUTING↗

Using Synchronization as an Indicator of Controllability in a Fleet of Water Heaters

Peak reduction is an important concern that can help reduce the growing stress on distribution grid and allow to defer investments in new capacity. However, the growing concern for customer privacy and comfort may impact the performance of load control for residential devices. Water heaters represent a convenient way of reducing peak due to their ability to store thermal energy for future use. In this paper, we developed a methodology to help utilities gain more insight with respect to the impact of load control efforts for shaving peak with no necessary information about the water heaters except the device status (on/off). To this end, we use a fleet of water heaters in a controlled residential neighborhood in Atlanta, GA. Our findings show that convergence in device status can serve as a proxy for peak shifting during hours of the evening peak.

demand response↗

Frequency Support of PMSG-WTG Based on Improved Inertial Control

With increasing integrations of large-scale systems based on permanent magnet synchronous generator wind turbine generators (PMSG-WTGs), the overall inertial response of a power system will tend to deteriorate as a result of the decoupling of rotor speed and grid frequency through the power converter as well as the scheduled retirement of conventional synchronous generators. Thus, PMSG-WTGs can provide value to an electric grid by contributing to the system's inertial response by utilizing the inherent kinetic energy stored in their rotating masses and fast power control. In this work, an improved inertial control method based on the maximum power point tracking operation curve is introduced to enhance the overall frequency support capability of PMSG-WTGs in the case of large supply-demand imbalances. Moreover, this method is implemented in the CART2-PMSG integrated model in MATLAB/Simulink to investigate its impact on the wind turbine's structural loads during the inertial response process. Simulation results indicate that the proposed method can effectively reduce the frequency nadir, arrest the rate of change of frequency, and mitigate the secondary frequency drop while imposing no negative impact on the major mechanical components of the wind turbine.

17 WIND ENERGY↗

Torus CLAS12-Superconducting Magnet Quench Analysis

The JLAB Torus magnet system consists of six superconducting trapezoidal racetrack-type coils assembled in a toroidal configuration. These coils are wound with SSC-36 Nb-Ti superconductor and have the peak magnetic field of 3.6 T. The first coil manufacturing based on the JLAB design began at FNAL. The large magnet system dimensions (8 m diameter and 14 MJ of stored energy) dictate the need for quench protection. Each coil is placed in an aluminum case mounted inside a cryostat and cooled by 4.6 K supercritical helium gas flowing through a copper tube attached to the coil ID. The large coil dimensions and small cryostat thickness drove the design to challenging technical solutions, suggesting that Lorentz forces due to transport currents and eddy currents during quench and various failure scenarios are analyzed. The paper covers the magnet system quench analysis using the OPERA3d Quench code.

Kashikhin, V S↗

Can High Current Density HTS Magnets be Quench Protected Using Methods Used to Protect High Current Density LTS Magnets?

In the 1970s the Lawrence Berkeley Laboratory (LBL) was testing high current density magnets where the EJ 2 limit was up to two orders of magnitude higher than the quench protection methods of the period would permit at the time. LBL was designing a high current density (J) thin solenoid with a large volume and stored energy (E). The accepted EJ 2 limit at the time was ~10 23 J A 2 m -4 . In order to exceed the EJ 2 limit by two orders of magnitude, one had to greatly increase the quench protection voltages (V) and magnet current (I). In 1977, LBL tested four quench protection methods on a 2-meter diameter high current density solenoid with a stored energy of 2 MJ. Three of these quench protection methods worked well, but the fourth didn't appear to work. These methods will be discussed as to whether they can be applied to HTS or MgB 2 high current density magnets.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Quench Protection by Putting a Current-pulse Into a Coil Center-Tap in HTS Coils

Forty years ago, Lawrence Berkeley Laboratory (LBL) tested a pulsed current quench protection system for a high current density two-meter diameter two-layer solenoid at 4.5 K with a stored energy of 8.5 MJ. The energy needed to protect this magnet was 13.4 kJ from an electrolytic capacitor system charged to voltages 800 V. This method also involved the use of a well-coupled shorted secondary circuits and quench-back. The applicability of this quench protection method to HTS magnets operating at temperatures >25 K could be of interest. There are a number of questions that should be asked, as follows: 1) Can this method work for HTS coils operating at temperatures >25 K? 2) Are there batteries or capacitors that can store 2 MJ or more that have short enough discharge times for quench protection at voltages less than 2 kV? 3) Is this quench protection system cost low enough to be reasonable?

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Design of Hopfield Networks Based on Superconducting Coupled Oscillators

The global energy shortage has driven the development of many energy-efficient computational platforms beyond Moore's law, among which brain-inspired neuromorphic computing is one of the promising solutions. Associative memory and pattern recognition are important computations solved by brain-inspired Hopfield networks. Classical Hopfield networks store memories via fixed point attractors of their dynamics. In oscillatory Hopfield networks, these attractors are replaced by periodic orbits. Here, we design an oscillatory Hopfield network based on coupled superconducting oscillators. We first employ a mathematical phase reduction approach to map networks of coupled superconducting rapid single flux quantum (RSFQ) ring oscillators to coupled Kuramoto phase-oscillator networks. We use this theory to numerically optimize the hardware's mutual inductances in order to directly match the phase-reduced superconducting oscillators to a model of phase-oscillator-based Hopfield networks. The resulting network can store multiple oscillatory phase-locked memory patterns and recover the patterns based on the initial phase conditions. As different pattern recognition tasks, or learning, require tunable connectivity strengths between the oscillatory nodes, we further employ a coupler circuit that enables tuning the coupling strength between two oscillators by applying an external flux. We demonstrate the functionality of our design through numerical simulations of a small example network with oscillators operating at 86 GHz and recognizing patterns within 10 ns. Our approach enables the learning and retrieval of dynamical memory patterns with a wide range of applications where rhythmic dynamic output is beneficial.

Cheng, Ran↗

Superconducting Shuttle-Flux Shift Register for Race Logic and Its Applications

Here this paper presents a superconducting, magnetically-coupled, shuttle-flux shift register (SF-SR) that stores single flux quantum (SFQ) pulses. This shift register has a DC bias operating margin of ±34% at 10 GHz, with a power dissipation of 3.6 μW and 38% fewer Josephson junctions (JJs) when scaled up to multiple stages compared to a data flip-flop (DFF) based shift register. The clock input is inductively coupled and is independent from the data input. We then present three applications for our SF-SR. In the first application, we add two non-destructive readout (NDRO) cells to construct a buffer that temporarily stores the temporal information of a series of race logic (RL) pulses. The second application is a pseudo-random number generator based on a linear function shift register (LFSR). The third application is N parallel SF-SRs that can act similar to a deserializer or instead can emulate a single SF-SR of N times higher clock frequency. These three applications motivate deep shift registers with many shifting intervals, which our SF-SR can implement with fewer JJs and lower power consumption compared to DFF-based shift registers.

42 ENGINEERING↗

SIRIUS: Enabling Progressive Data Exploration for Extreme-Scale Scientific Data

Scientific simulations on high performance computing (HPC) platforms generate large quantities of data. To bridge the widening gap between compute and I/O, and enable data to be more efficiently stored and analyzed, simulation outputs need to be refactored, reduced, and appropriately mapped to storage tiers. However, a systematic solution to support these steps has been lacking in the current HPC software ecosystem. To that end, this paper develops SIRIUS, a progressive JPEG-like data management scheme for storing and analyzing big scientific data. It co-designs data decimation, compression, and data storage, taking the hardware characteristics of each storage tier into considerations. With reasonably low overhead, our approach refactors simulation data, using either topological or uniform decimation, into a much smaller, reduced-accuracy base dataset, and a series of deltas that is used to augment the accuracy if needed. The base dataset and deltas are compressed and written to multiple storage tiers. Data saved on different tiers can then be selectively retrieved to restore the level of accuracy that satisfies data analytics. Thus, SIRIUS provides a paradigm shift towards elastic data analytics and enables end users to make trade-offs between analysis speed and accuracy on-the-fly. This paper further develops algorithms to preserve statistics for data decimation, a common requirement for reducing data. Here, we assess the impact of SIRIUS on unstructured triangular meshes, a pervasive data model used in scientific simulations. In particular, we evaluate two realistic use cases: the blob detection in fusion and high-pressure area extraction in computational fluid dynamics.

97 MATHEMATICS AND COMPUTING↗

Muon Borehole Detector Design for Use in 4-D Density Overburden Monitoring

The increase of atmospheric CO2 concentrations has initiated research into carbon sequestration methods. One possibility is to store CO2 in subsurface porous reservoirs. The monitoring of the injected CO2 plume is vital because escaping CO2 poses health and environmental risks. Typically, seismic reflection methods are used to determine the change in density due to the replacement of brine by CO2 in the reservoir, but this is expensive and not continuous. A potential alternative is to use cosmic muon tomography to measure density changes in the reservoir as a function of time. This paper describes the development of a muon detector that will be capable of being deployed in boreholes. The detector has the required dimensions, an angular resolution of approximately 2 degrees, and is robust. The design is based on alternating layers of scintillating rods, which can provide 4-D tomographic data to detect small changes in density at depths up to approximately 2 km. Geant4, a Monte Carlo simulation code, is being used to develop models to guide the design of the physical configuration. Preliminary testing and measurements have been performed to validate the simulation predictions and optimize the performance of the system. The simulation and preliminary experimental results are presented here.

Borehole Detector, CO¬2 Sequestration, Geant4, Muo↗

funcX: Federated Function as a Service for Science

Here, funcX is a distributed function as a service (FaaS) platform that enables flexible, scalable, and high performance remote function execution. Unlike centralized FaaS systems, funcX decouples the cloud-hosted management functionality from the edge-hosted execution functionality. funcX's endpoint software can be deployed, by users or administrators, on arbitrary laptops, clouds, clusters, and supercomputers, in effect turning them into function serving systems. funcX's cloud-hosted service provides a single location for registering, sharing, and managing both functions and endpoints. It allows for transparent, secure, and reliable function execution across the federated ecosystem of endpoints-enabling users to route functions to endpoints based on specific needs. funcX uses containers (e.g., Docker, Singularity, and Shifter) to provide common execution environments across endpoints. funcX implements various container management strategies to execute functions with high performance and efficiency on diverse funcX endpoints. funcX also integrates with an in-memory data store and Globus for managing data that may span endpoints. We motivate the need for funcX, present our prototype design and implementation, and demonstrate, via experiments on two supercomputers, that funcX can scale to more than 130000 concurrent workers. We show that funcX's container warming-aware routing algorithm can reduce the completion time for 3,000 functions by up to 61% compared to a randomized algorithm and the in-memory data store can speed up data transfers by up to 3x compared to a shared file system.

97 MATHEMATICS AND COMPUTING↗

Scalable Hybrid Learning Techniques for Scientific Data Compression

Data compression is becoming critical for storing scientific data because many scientific applications need to store large amounts of data and post process this data for scientific discovery. Unlike image and video compression algorithms that limit errors to primary data (PD), scientists require compression techniques that accurately preserve derived quantities of interest (QoIs). Here, this article presents a physics-informed compression technique implemented as an end-to-end, scalable, GPU-based pipeline for data compression that addresses this requirement. Our hybrid compression technique combines machine learning techniques and standard compression methods. Specifically, we combine an autoencoder, an error-bounded lossy compressor to provide guarantees on raw data error, and a constraint satisfaction post-processing step to preserve the QoIs within a minimal error (generally less than floating point error). The effectiveness of the data compression pipeline is demonstrated by compressing nuclear fusion simulation data generated by a large-scale fusion code, XGC, which produces hundreds of terabytes of data in a single day. Our approach works within the ADIOS framework and results in compression by a factor of more than 150 while requiring only a few percent of the computational resources necessary for generating the data, making the overall approach highly effective for practical scenarios.

ITER↗

Optimizing Management of Persistent Data Structures in High-Performance Analytics

Large-scale data analytics workflows ingest massive input data into various data structures, including graphs and key-value datastores. These data structures undergo multiple transformations and computations and are typically reused in incremental and iterative analytics workflows. Persisting in-memory views of these data structures enables reusing them beyond the scope of a single program run while avoiding repetitive raw data ingestion overheads. Memory-mapped I/O enables persisting in-memory data structures without data serialization and deserialization overheads. However, memory-mapped I/O lacks the key feature of persisting consistent snapshots of these data structures for incremental ingestion and processing. The obstacles to efficient virtual memory snapshots using memory-mapped I/O include background writebacks outside the application’s control, and the significantly high storage footprint of such snapshots. To address these limitations, we present Privateer, a memory and storage management tool that enables storage-efficient virtual memory snapshotting while also optimizing snapshot I/O performance. Here, we integrated Privateer into Metall, a state-of-the-art persistent memory allocator for C++, and the Lightning Memory-Mapped Database (LMDB), a widely-used key-value datastore in data analytics and machine learning. Privateer optimized application performance by 1.22× when storing data structure snapshots to node-local storage, and up to 16.7× when storing snapshots to a parallel file system. Privateer also optimizes storage efficiency of incremental data structure snapshots by up to 11× using data deduplication and compression.

Computer science↗