Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed memory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Design of a neutral thermal scattering (NeTS) module for hydrogen in light water

The accurate representation of thermal scattering law (TSL) data is integral to the design and characterization of many modern nuclear systems, particularly those using light water as a moderator/coolant. As a material-dependent distribution over energy-momentum phase space, the TSL may exhibit a variety of unique and relevant conditional (e.g., temperature, pressure) and compositional (e.g., porosity, stoichiometry, radiation damage) dependencies. Currently, there are various approaches to incorporate temperature dependence, which is especially important in coupled neutronic-thermal hydraulic simulations. In each approach, there is an inherent tradeoff between memory consumption and accuracy. Some techniques require tens to hundreds of MBs or more, while others fail to reproduce the underlying data to within 10% error over the considered input domain, despite having a reduced storage burden. This work aims to address both sides of the tradeoff simultaneously by implementing a novel deep learning (DL) approach to TSL representation. The neural thermal scattering (NeTS) concept, which is amenable to an arbitrary number of dependencies, is demonstrated via the inclusion of temperature dependence into a highly compact, highly accurate functional form of the multi- variate TSL (i.e., S(α, β, T)) for hydrogen in light water. Resulting storage requirements are on the order of 100 kB, and median and maximum percent deviations are on the order of 0.1% and 1%, respectively. These measures represent a step improvement over previous techniques. Notably, the developed neural network and feature methodology build on those employed in prior work on beryllium oxide. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Progressive Tree-Based Compression of Large-Scale Particle Data

Scientific simulations and observations using particles have been creating large datasets that require effective and efficient data reduction to store, transfer, and analyze. However, current approaches either compress only small data well while being inefficient for large data, or handle large data but with insufficient compression. Toward effective and scalable compression/decompression of particle positions, we introduce new kinds of particle hierarchies and corresponding traversal orders that quickly reduce reconstruction error while being fast and low in memory footprint. Our solution to compression of large-scale particle data is a flexible block-based hierarchy that supports progressive, random-access, and error-driven decoding, where error estimation heuristics can be supplied by the user. For low-level node encoding, we introduce new schemes that effectively compress both uniform and densely structured particle distributions. Our proposed methods thus target all three phases of a tree-based particle compression pipeline, namely tree construction, tree traversal, and node encoding. In conclusion, the improved efficacy and flexibility of these methods over existing compressors are demonstrated through extensive experimentation, using a wide range of scientific particle datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Non-Markovian relaxation spectroscopy of fluxonium qubits

Recent studies have shown that parasitic two-level systems (TLS) in superconducting qubits, which are a leading source of decoherence, can have relaxation times longer than the qubits themselves. However, the standard techniques used to characterize qubit relaxation is only valid for measuring T 1 under the Born-Markov approximation and could mask environmental memory effects in practice. Here, we introduce two-timescale relaxometry, a technique to probe the qubit and environment relaxation simultaneously and efficiently. We apply it to high-coherence fluxonium qubits over a frequency range of 0.1-0.4 GHz, and reveal a discrete spectrum of TLS with millisecond lifetimes. Our analysis of the spectrum is consistent with a random distribution of TLS in the aluminum oxide tunnel barrier of the Josephson junction chain of the fluxonium, with a spectral and volumetric density and average electric dipole similar to previous TLS studies at much higher frequencies. Our study suggests that investigating and mitigating TLS in the junction chain is crucial to the development of various types of noise-protected qubits in circuit QED.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Model fusion with physics-guided machine learning: Projection-based reduced-order modeling

The unprecedented amount of data generated from experiments, field observations, and large-scale numerical simulations at a wide range of spatiotemporal scales has enabled the rapid advancement of data-driven and especially deep learning models in the field of fluid mechanics. Although these methods are proven successful for many applications, there is a grand challenge of improving their generalizability. This is particularly essential when data-driven models are employed within outer-loop applications like optimization. In this work, we put forth a physics-guided machine learning (PGML) framework that leverages the interpretable physics-based model with a deep learning model. Leveraging a concatenated neural network design from multi-modal data sources, the PGML framework is capable of enhancing the generalizability of data-driven models and effectively protects against or inform about the inaccurate predictions resulting from extrapolation. We apply the PGML framework as a novel model fusion approach combining the physics-based Galerkin projection model and long- to short-term memory (LSTM) network for parametric model order reduction of fluid flows. We demonstrate the improved generalizability of the PGML framework against a purely data-driven approach through the injection of physics features into intermediate LSTM layers. Our quantitative analysis shows that the overall model uncertainty can be reduced through the PGML approach, especially for test data coming from a distribution different than the training data. Moreover, we demonstrate that our approach can be used as an inverse diagnostic tool providing a confidence score associated with models and observations. The proposed framework also allows for multi-fidelity computing by making use of low-fidelity models in the online deployment of quantified data-driven models.

42 ENGINEERING↗
DOE OSTI2022

Design of functional materials based on new principles of disorder. Final Report

Disorder is present to some extent in every material. The disorder can be sparse and localized – individual defects – or globally such as in a glass. Normally disorder is considered to be detrimental to function. However, this is not necessarily always the case. This project addressed the question: How does disorder provide new potentialities for the behavior of a material that would be absent in a crystalline material of the same composition? We have discovered a new principle for disordered matter: Independence of bond-level response. This work has introduced the possibility of creating new classes of mechanical meta-materials with applications everywhere from microscopic biological molecules (allostery) to large scale architectural disordered networks. During the course of this grant, we have subsequently elaborated on these novel ideas about bond-level independence of properties in disordered materials. In particular, this study has required that we understand the limits of disorder. That is, if crystals are perfect order, is there another diametrically opposed pole which is the most disordered state? We have shown that, in a well-defined way, jamming is one extreme disordered pole of rigid matter. Jamming is a far-from-equilibrium way of creating a rigid solid by rapidly quenching a random distribution of particles to a mechanically stable system at zero temperature. To understand the jammed state of matter, we have elucidated the low-frequency excitation of these systems. This has allowed a new way of understanding materials that cannot be easily classified as crystals or glasses. These ideas can be extended to address the mechanical properties of polycrystalline matter. Memory formation in matter can take inspiration from memory that occurs in a biological context. The issue of memory formation raises another set of questions at the heart of how the energy landscape is organized and how it can be manipulated to store information in a solid. This project has explored how to understand the degree to which multiple memories can be stored in a single system and has created a holistic understanding of how inputs can be used to create a desired response.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Optimizing Distributed Training on Frontier for Large Language Models

Large language models (LLMs) have demonstrated remarkable success as foundational models, benefiting various downstream applications through fine-tuning. Loss scaling studies have demonstrated the superior performance of larger LLMs compared to their smaller counterparts. Nevertheless, training LLMs with billions of parameters poses significant challenges and requires considerable computational resources. For example, training a one trillion parameter GPT-style model on 20 trillion tokens requires a staggering 120 million exaflops. This research explores efficient distributed training strategies to extract this computation from Frontier, the world's first exascale supercomputer. We enable and investigate various model and data parallel training techniques, such as tensor parallelism, pipeline parallelism, and sharded data parallelism, to facilitate training a trillion-parameter model on Frontier. We empirically assess these techniques and their associated parameters to determine their impact on memory footprint, communication latency, and GPU's computational efficiency. We analyze the complex interplay among these techniques and find a strategy to combine them to achieve high throughput through hyperparameter tuning. We have identified efficient strategies for training large LLMs of varying sizes through empirical analysis and hyperparameter tuning. For 22 Billion, 175 Billion, and 1 Trillion parameters, we achieved GPU throughputs of 38.38%, 36.14%, and 31.96%, respectively. For the training of the 175 Billion parameter model and the 1 Trillion parameter model, we achieved 100% weak scaling efficiency on 1024 and 3072 Mi250X GPUs, respectively. We also achieved strong scaling efficiencies of 89% and 87% for these two models. We trained these models only tens of iterations instead of training till completion.

Yin, Junqi↗
DOE OSTI2021

Structural Simluation Toolkit (SST) v.11.0

The SST provides a parallel framework to perform system simulation of computer architectures to determine their performance and power consumption. Additionally, the SST contains basic models of a computer processor, and interconnect and can connect to an external memory simulator (DRAMSim II). The SST framework provides a simple interface by which other computer simulation models can be combined under a common parallel discrete event-based simulation environment. This allows design exploration of future architectures, analysis of how current computer programs will function on future architectures. The SST provides a parallel discrete event simulation framework, including partitioning and object distribution over MPI. It also provides a mechanism by which components can report their power consumption for analysis.

Rodrigues, ArunF.↗
DOE OSTI2024

HiFiPDV2 v. 2

SAND2024-01061O The HiFiPDV-2 software is similar to other photonic Doppler velocimetry (PDV) analysis codes in that it converts signals from intensity-time space to frequency-time space using a short-time Fourier transform (STFT). It then analyzes peaks of the resulting power spectral density information to extract the velocity-time history. The unique aspects of HiFiPDV and HiFiPDV-2 are that this reduction process is repeated for an array of reasonable STFT input variables. The resulting population distribution of output velocity-time histories is evaluated to determine the most likely velocity history and its associated uncertainty. This uncertainty is defined as the systematic uncertainty of the PDV signal as it is a function of input values to the reduction process. The HiFiPDV-2 program brings new functionality and efficiency to these calculations—most notably significant reductions in memory usage and calculation times, the ability to evaluate frequency-shifted signals, and the ability to filter out baseline signals. Developers recommend that users have at least 2 GB of RAM per CPU core in their system. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Voorhees, Travis↗
NASA NTRS2017

Device for Temporal Measurement of Loads in Parachute Suspension Systems

In order to understand the distribution of loads in parachutes, the NASA Low Density Supersonic Decelerators (LDSD) project developed a wireless instrument to measure loads in the parachute suspension lines. The load cells are titanium links that are connected in the primary structural load path of the parachute system. Strain gages measure the elongation of the links and an onboard data acquisition system records the data to ash memory. The load cells have onboard power, and include a radio transceiver that is used to receive timing information. The load cells are designed to be interfaced with cordage, packed in a parachute bag, and deployed with a standard parachute deployment. The devices are triggered passively during the deployment of the parachute. Prototype devices with a mass of 100 grams and a load capability of 16,000 lbs were built as a proof of concept.

Brandeau, Erich J.↗
DOE OSTI2026

On the Ordering Mechanism of Cu + in 2D van der Waals Multiferroic CuCrP 2 S 6

CuCrP 2 S 6 is a van der Waals multiferroic where the tunable Cu + sublattice underpins its exceptional ferroelectric and electronic switching properties. Yet, the microscopic mechanism governing Cu + ordering has remained elusive. Here, we combine single-crystal X-ray and neutron diffraction with pair distribution function analysis to uncover a temperature-driven evolution of Cu + ordering, giving rise to an incommensurate quasi-antipolar phase between the paraelectric and antiferroelectric states. The modulation originates from correlated Cu + occupancy redistribution coupled to breathing distortion of surrounding S 3 triangles, establishing a symmetry-adapted lattice distortion mode. Diffuse scattering persisting over 35 K above the transition confirms that the structural instability follows an order-disorder mechanism. The spontaneous off-centering of Cu + positions CuCrP 2 S 6 as a model platform for correlated order-disorder phenomena in 2D layered ferroics, and provides design principles for next-generation memory and logic devices.

ferroelectrics↗
NASA NTRS1972

Pyrometer for measurement of surface temperature distribution on a rotating turbine blade

A conceptual optical method and some test results are presented for measuring the surface temperature distribution on one of the rotating turbine blades with a surface resolution of 0.05 cm spot diameter at a tip speed of 400 m/sec. The blade is scanned line-by-line by a fixed optical system. During each line-scan, the detector analog output signal is converted to two hundred consecutive digital values that are temporarily stored in a high speed buffer memory, and then transferred at a slower rate to a computer for processing. The signal-to-noise ratio of the silicon avalanche detector is large enough to obtain an accuracy of one percent at 1050 K blade temperature. By averaging 25 scans of the same line the same accuracy can be obtained at 900 K.

Buchele, D. R.↗
NASA NTRS1972

Pyrometer for measurement of surface temperature distribution on a rotating turbine blade.

A conceptual optical method and some test results are presented for measuring the surface temperature distribution on one of the rotating turbine blades with a surface resolution of 0.05 cm spot diameter at a tip speed of 400 m/sec. The blade is scanned line-by-line by a fixed optical system. During each line-scan, the detector analog output signal is converted to 200 consecutive digital values that are temporarily stored in a high-speed buffer memory and then transferred at a slower rate to a computer for processing. The signal-to-noise ratio of the silicon avalanche detector is large enough to obtain an accuracy of 1% at 1050 K blade temperature. By averaging 25 scans of the same line the same accuracy can be obtained at 900 K.

Buchele, D. R.↗
NASA NTRS1980

Complete viscous flowfield solutions about a blunt parabolic body in a supersonic stream

A hybrid computational technique which splits the flowfield into inviscid and viscous regions is used to investigate the complete flowfield about axisymmetric parabolic blunt bodies in a supersonic stream. The solutions are carried out on the CDC CYBER-203 computer which, with its extensive memory, allows for the use of a large number of finite-difference mesh points, allowing resolution of important flowfield features. A range of freestream Mach number of 2-5 and a range of Re number based on nose radius of 500-125,000 was run for a sonic corner body. Contour plots of density, pressure, and Mach number, velocity vector plots, and surface distributions of pressure, heat transfer, and shear stress are presented. Also, correlations of the downstream extent of the base recirculation region with Re number based on nose radius are given.

Weilmuenster, K. J.↗
NASA NTRS1993

Use of common time base for checkpointing and rollback recovery in a distributed system

An approach to checkpointing and rollback recovery in a distributed computing system using a common time base is proposed. A common time base is established in the system using a hardware clock synchronization algorithm. This common time base is coupled with the idea of pseudo-recovery points to develop a checkpointing algorithm that has the following advantages: reduced wait for commitment for establishing recovery lines, fewer messages to be exchanged, and less memory requirement. These advantages are assessed quantitatively by developing a probabilistic model.

Ramanathan, Parameswaran↗
DOE OSTI2024

Diversity of visual inputs to Kenyon cells of the Drosophila mushroom body

The arthropod mushroom body is well-studied as an expansion layer representing olfactory stimuli and linking them to contingent events. However, 8% of mushroom body Kenyon cells in Drosophila melanogaster receive predominantly visual input, and their function remains unclear. Here, we identify inputs to visual Kenyon cells using the FlyWire adult whole-brain connectome. Input repertoires are similar across hemispheres and connectomes with certain inputs highly overrepresented. Many visual neurons presynaptic to Kenyon cells have large receptive fields, while interneuron inputs receive spatially restricted signals that may be tuned to specific visual features. Individual visual Kenyon cells randomly sample sparse inputs from combinations of visual channels, including multiple optic lobe neuropils. These connectivity patterns suggest that visual coding in the mushroom body, like olfactory coding, is sparse, distributed, and combinatorial. However, the specific input repertoire to the smaller population of visual Kenyon cells suggests a constrained encoding of visual stimuli.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Performance and power modeling and prediction using MuMMI and 10 machine learning methods

Energy-efficient scientific applications require insight into how high performance computing system features impact the applications' power and performance. This insight can result from the development of performance and power models. Here, in this article, we use the modeling and prediction tool MuMMI (Multiple Metrics Modeling Infrastructure) and 10 machine learning methods to model and predict performance and power consumption and compare their prediction error rates. We use an algorithm-based fault-tolerant linear algebra code and a multilevel checkpointing fault-tolerant heat distribution code to conduct our modeling and prediction study on the Cray XC40 Theta and IBM BG/Q Mira at Argonne National Laboratory and the Intel Haswell cluster Shepard at Sandia National Laboratories. Our experimental results show that the prediction error rates in performance and power using MuMMI are less than 10% for most cases. By utilizing the models for runtime, node power, CPU power, and memory power, we identify the most significant performance counters for potential application optimizations, and we predict theoretical outcomes of the optimizations. Based on two collected datasets, we analyze and compare the prediction accuracy in performance and power consumption using MuMMI and 10 machine learning methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Origins of magnetic memory and strong exchange bias bordering magnetic compensation in mixed-lanthanide systems

Here, the unexpected physical phenomena resulting from the seemingly inconsequential substitutions of chemically similar lanthanide elements in the Pr 1-x Gd x ScGe system are exploited to further the understanding of rare-earth magnetism and inform materials design. By directly probing magnetic moments of crystallographically indistinguishable Pr and Gd we solve the puzzles of how an unusual magnetic memory and strong exchange bias emerge at specific, easily predictable chemistries. Both effects are rooted in a robust antiparallel arrangement of large 4f magnetic moments of light and heavy lanthanides. This enables precise control of nearly zero net magnetization either opposed to, or aligned with, the external magnetic field that persists over a wide range of temperatures and fields. Further, spontaneous perturbations in the random distribution of lanthanide ions makes strong exchange bias possible in bulk single-phase compounds bordering magnetic compensation, consequently expanding the materials base beyond artificial magnetic multilayers and broadening the range of potential applications of the phenomenon.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

Parallel Memory-Independent Communication Bounds for SYRK

In this paper, we focus on the parallel communication cost of multiplying a matrix with its transpose, known as a symmetric rank-k update (SYRK). SYRK requires half the computation of general matrix multiplication because of the symmetry of the output matrix. Recent work (Beaumont et al., SPAA '22) has demonstrated that the sequential I/O complexity of SYRK is also a constant factor smaller than that of general matrix multiplication. Inspired by this progress, we establish memory-independent parallel communication lower bounds for SYRK with smaller constants than general matrix multiplication, and we show that these constants are tight by presenting communication-optimal algorithms. The crux of the lower bound proof relies on extending a key geometric inequality to symmetric computations and analytically solving a constrained nonlinear optimization problem. Here, the optimal algorithms use a triangular blocking scheme for parallel distribution of the symmetric output matrix and corresponding computation.

Communication costs↗