Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “sparse data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

Efficient convolutional sparse coding

Computationally efficient algorithms may be applied for fast dictionary learning solving the convolutional sparse coding problem in the Fourier domain. More specifically, efficient convolutional sparse coding may be derived within an alternating direction method of multipliers (ADMM) framework that utilizes fast Fourier transforms (FFT) to solve the main linear system in the frequency domain. Such algorithms may enable a significant reduction in computational cost over conventional approaches by implementing a linear solver for the most critical and computationally expensive component of the conventional iterative algorithm. The theoretical computational cost of the algorithm may be reduced from O(M.sup.3N) to O(MN log N), where N is the dimensionality of the data and M is the number of elements in the dictionary. This significant improvement in efficiency may greatly increase the range of problems that can practically be addressed via convolutional sparse representations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2013

STAR COUNT DENSITY PROFILES AND STRUCTURAL PARAMETERS OF 26 GALACTIC GLOBULAR CLUSTERS

We used an appropriate combination of high-resolution Hubble Space Telescope observations and wide-field, ground-based data to derive the radial stellar density profiles of 26 Galactic globular clusters from resolved star counts (which can be all freely downloaded on-line). With respect to surface brightness (SB) profiles (which can be biased by the presence of sparse, bright stars), star counts are considered to be the most robust and reliable tool to derive cluster structural parameters. For each system, a detailed comparison with both King and Wilson models has been performed and the most relevant best-fit parameters have been obtained. This collection of data represents the largest homogeneous catalog collected so far of star count profiles and structural parameters derived therefrom. The analysis of the data of our catalog has shown that (1) the presence of the central cusps previously detected in the SB profiles of NGC 1851, M13, and M62 is not confirmed; (2) the majority of clusters in our sample are fit equally well by the King and the Wilson models; (3) we confirm the known relationship between cluster size (as measured by the effective radius) and galactocentric distance; (4) the ratio between the core and the effective radii shows a bimodal distribution, with a peak at {approx}0.3 for about 80% of the clusters and a secondary peak at {approx}0.6 for the remaining 20%. Interestingly, the main peak turns out to be in agreement with that expected from simulations of cluster dynamical evolution and the ratio between these two radii correlates well with an empirical dynamical-age indicator recently defined from the observed shape of blue straggler star radial distribution, thus suggesting that no exotic mechanisms of energy generation are needed in the cores of the analyzed clusters.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

Performance optimization, modeling and analysis of sparse matrix-matrix products on multi-core and many-core processors

Sparse matrix-matrix multiplication (SpGEMM) is a computational primitive that is widely used in areas ranging from traditional numerical applications to recent big data analysis and machine learning. Although many SpGEMM algorithms have been proposed, hardware specific optimizations for multi- and many-core processors are lacking and a detailed analysis of their performance under various use cases and matrices is not available. In this work, we firstly identify and mitigate multiple bottlenecks with memory management and thread scheduling on Intel Xeon Phi (Knights Landing or KNL). Specifically targeting many-core processors, we develop a hash-table-based algorithm and optimize a heap-based shared-memory SpGEMM algorithm. We examine their performance together with other publicly available codes. Different from the literature, our evaluation also includes use cases that are representative of real graph algorithms, such as multi-source breadth-first search or triangle counting. Our hash-table and heap-based algorithms are showing significant speedups from libraries in the majority of the cases while different algorithms dominate the other scenarios with different matrix size, sparsity, compression factor and operation type. We wrap up in-depth evaluation results and make a recipe to give the best SpGEMM algorithm for target scenario. We build the performance model for hash-table and heap-based algorithms, which supports the recipe. A critical finding is that hash-table-based SpGEMM gets a significant performance boost if the nonzeros are not required to be sorted within each row of the output matrix. Finally, we integrate our implementations into a large-scale protein clustering code named HipMCL, accelerating its SpGEMM kernel by up to 10X and achieving an overall performance boost for the whole HipMCL application by 2.6X.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Discovering equations that govern experimental materials stability under environmental stress using scientific machine learning

Abstract While machine learning (ML) in experimental research has demonstrated impressive predictive capabilities, extracting fungible knowledge representations from experimental data remains an elusive task. In this manuscript, we use ML to infer the underlying differential equation (DE) from experimental data of degrading organic-inorganic methylammonium lead iodide (MAPI) perovskite thin films under environmental stressors (elevated temperature, humidity, and light). Using a sparse regression algorithm, we find that the underlying DE governing MAPI degradation across a broad temperature range of 35 to 85 °C is described minimally by a second-order polynomial. This DE corresponds to the Verhulst logistic function, which describes reaction kinetics analogous to self-propagating reactions. We examine the robustness of our conclusions to experimental variance and Gaussian noise and describe the experimental limits within which this methodology can be applied. Our study highlights the promise and challenges associated with ML-aided scientific discovery by demonstrating its application in experimental chemical and materials systems.

36 MATERIALS SCIENCE↗
DOE OSTI2013

Comparison of the biological effectiveness of 45 MeV C-ions and {gamma}-rays in inducing early and late effects in normal human primary fibroblasts

Investigation of the mechanisms underlying the biological effects induced by densely ionizing radiation has relevant implications in both radiation protection and therapy. In particular, the possible advantages of hadrontherapy with respect to conventional radiotherapy in terms of high conformal tumor treatment and sparing of healthy tissues are well known. Further improvements are limited by lack of radiobiological knowledge, particularly about the specific cellular response to the damage induced by particles of potential interest for tumor treatment. This study compares early and late effects induced in AG01522 normal human primary fibroblasts by {gamma}-rays and C-ions having E {approx} 45 MeV/u at the cell entrance, corresponding to LET (in water) {approx} 49 keV/{mu}m. Different end points have been investigated, namely: cell killing and lethal mutation, evaluated as early and delayed reproductive cell death, respectively; chromosome damage, as measured by micronuclei induction (MN); DNA damage, in terms of DSB induction and repair, as measured by the H2AX phosphorylation/dephosphorylation kinetics. Linear dose-response relationships were found for cell killing and induction of lethal mutations, with RBEs of about 1.3 and 1.6 respectively, indicating that the presence of genomic instability is greater in the progeny of C-ions irradiated cells. H2AX phosphorylation/dephosphorylation kinetics have shown a maximum foci number at 30 min after irradiation, higher for {gamma}-rays than for C-ions. However, in the first 12 h the fraction of residual {gamma}-H2AX foci was higher for C-ions irradiated cells, indicating a lower removal rate, possibly related to multiple/more complex damage along the particle track, with respect to the sparse lesions produced by {gamma}-rays. MN induction, observed after 72 h from irradiation, was also greater for C-ions. Overall, these data indicate a more severe DNA damage induced by 45 MeV/u C-ions with respect to {gamma}-rays, likely responsible of an increased cellular misrepair, leading to the greater observed levels of chromosome damage and, eventually, of genomic instability. They give strong support to the idea that higher damage severity at molecular level, determined by the typical deposition pattern of densely ionizing radiation, is the earliest relevant factor for the more severe late effects at cellular level.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2020

Measurement of Palladium Hydride and Palladium Deuteride Isotherms Between 130 K and 393 K

The data collected in the present work extend the measured phase diagram for palladium hydride and palladium deuteride to a region that has been sparsely reported in open literature. Absorption isotherms were measured using a 2.5-g bed of palladium powder at temperatures between 130 K and 393 K and pressures less than 1.3 x 10 5 Pa. Such low-pressure and low-temperature measurements are useful for characterizing palladium beds used for tritium pumping and storage. For tritium storage, pressures are kept below a few millibar for safety reasons. Low temperatures increase the tritium storage capacity of palladium. The measured absorption isotherms show the well-documented, two-phase behavior for this system: two solubility regions and a mixed, hydride-forming region. The isotherms show that an increased quantity of hydride is formed at lower temperatures, as marked by an increase in the hydride-forming region. This region exceeds hydrogen to metal ratios of 0.75 for T ≤ 273 K. Equilibrium pressures in the mixed region decrease with decreasing temperatures until a critical temperature is reached for each isotope. Below these critical temperatures, the rate of pressure decrease with decreasing temperature is significantly reduced. This change in trend suggests hydrogen isotopes are adsorbed onto the palladium surface, rather than forming a hydride. Using the equilibrium pressures recorded at temperatures between 236 K and 393 K for protium and between 211 K and 354 K for deuterium, the van’t Hoff constants were calculated to be A = –36 ± 1 kJ/mol and B = 88 ± 3 J/K for protium and A = -32 ± 2 kJ/mol and B = 88 ± 9 J/K for deuterium. As a result, these constants agree favorably with literature in the range where the temperatures of the measured isotherms overlap.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Randomized Algorithms for Symmetric Nonnegative Matrix Factorization

Symmetric Nonnegative Matrix Factorization (SymNMF) is a technique in data analysis and machine learning that approximates a matrix with a product of a nonnegative, low-rank matrix and it transpose. To design faster and more scalable algorithms for SymNMF we develop two randomized algorithms for its computation. The first method uses randomized matrix sketching to compute an initial low-rank approximation to the input matrix and proceeds to uses this as a low-rank input to rapidly compute a SymNMF. The second methods uses randomized leverage score sampling to approximately solve constrained least squares problems. Many successful methods for SymNMF rely on (approximately) solving sequences of constrained least squares problems. Here, we prove theoretically that leverage score sampling can approximately solve constrained least squares problems to e-accuracy. Finally we demonstrate both methods work in practice by applying them to graph clustering tasks on large real world data sets. These experiments show that our methods approximately maintain solution quality and achieve significant speed ups for both large dense and large sparse problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Sparse Matrix-Matrix Multiplication on Multilevel Memory Architectures: Algorithms and Experiments

Architectures with multiple classes of memory media are becoming a common part of mainstream supercomputer deployments. So called multi-level memories offer differing characteristics for each memory component including variation in bandwidth, latency and capacity. This paper investigates the performance of sparse matrix multiplication kernels on two leading highperformance computing architectures — Intel's Knights Landing processor and NVIDIA's Pascal GPU. We describe a data placement method and a chunking-based algorithm for our kernels that exploits the existence of the multiple memory spaces in each hardware platform. We evaluate the performance of these methods w.r.t. standard algorithms using the auto-caching mechanisms Our results show that standard algorithms that exploit cache reuse performed as well as multi-memory-aware algorithms for architectures such as Ki\iLs where the memory subsystems have similar latencies. However, for architectures such as GPUS where memory subsystems differ significantly in both bandwidth and latency, multi-memory-aware methods are crucial for good performance. In addition, our new approaches permit the user to run problems that require larger capacities than the fastest memory of each compute node without depending on the software-managed cache mechanisms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Understanding HPC Benchmark Performance on Intel Broadwell and Cascade Lake Processors

Hardware platforms in high performance computing are constantly getting more complex to handle even when considering multicore CPUs alone. Numerous features and configuration options in the hardware and the software environment that are relevant for performance are not even known to most application users or developers. Microbenchmarks, i.e., simple codes that fathom a particular aspect of the hardware, can help to shed light on such issues, but only if they are well understood and if the results can be reconciled with known facts or performance models. The insight gained from microbenchmarks may then be applied to real applications for performance analysis or optimization. In this paper we investigate two modern Intel x86 server CPU architectures in depth: Broadwell EP and Cascade Lake SP. We highlight relevant hardware configuration settings that can have a decisive impact on code performance and show how to properly measure on-chip and off-chip data transfer bandwidths. The new victim L3 cache of Cascade Lake and its advanced replacement policy receive due attention. Finally we use DGEMM, sparse matrix-vector multiplication, and the HPCG benchmark to make a connection to relevant application scenarios.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Technical Performance and Cost Optimization of Unobtrusive Multi-static Serial LiDAR Imager (UMSLI) for Wide-area Surveillance and Identification of Marine Life at Marine Energy Installations

Florida Atlantic University developed an underwater optical monitoring system prototype - Unobtrusive Multi-static Serial LiDAR Imager (UMSLI) - suitable for marine energy full project lifecycle observation (baseline, commissioning, and decommissioning), with an automated real-time classification of marine animals. With precursor 2014 DOE funding (award DE-EE0006787), a prototype UMSLI was demonstrated in a controlled laboratory environment and achieved a TRL 6. This EERE DE-EE0007828 award aimed to both increase the TRL of the UMSLI by improving the technology performance (e.g., increase distance of marine animal target detection capability, add additional species classification capabilities, improve the system performance during the day, etc.) and reduce the cost. The UMSLI presents a novel application of underwater distributed Light Detection And Ranging (LiDAR), an advanced remote sensing method that uses light in the form of laser pulses for an application, this paired with an algorithm provides 360 degrees underwater detection, imaging, and classification of marine life. This solution for underwater monitoring of biota preserves the advantages of traditional optical and acoustic solutions while overcoming many associated disadvantages for marine energy site environmental monitoring, such as difficulties in species detection and classification in low light or night and turbid environments. This new approach is a purposefully designed, reconfigurable adaptation of an existing class 3B laser technology into one UMSLI instrument that can be easily mounted on or around different classes of marine energy equipment, such as devices to capture ocean current energy or wave energy. The system uses relatively low average power, utilizes far-red (> 635nm) laser illumination to be invisible and eye-safe to marine animals, is compact, and cost-effective. The equipment is designed for long-term, maintenance-free operations (i.e., current design is targeting more than 7 days continuous operation), to inherently generate a sparse primary dataset that only includes detected anomalies, and to allow robust real-time automated animal classification and identification with a low data bandwidth requirement. The technology’s overarching goal for application, is a system that can be deployed to collect pre-installation baseline species observations at a proposed marine energy deployment site with minimal post-processing overhead. The envisioned system will also produce high-resolution imagery of marine animals through a wide range of conditions and support automated tracking and notification of the presence of managed animals within established perimeters of marine energy equipment to satisfy deployed marine energy projects’ endangered and threatened species monitoring requirements. Through the current project, we demonstrated the UMSLI prototype in an operational environment and increased the UMSLI’s Technology Readiness Level from 6 to 7. The project resulted in many novel technologies, including: 1) an eye-safe red laser based, low-cost LiDAR system that can detect targets up to 10 meters distance; 2) the GAN-based machine learning underwater LiDAR image enhancement technique (this is the first known application of GAN technique in underwater LiDAR); 3) LiDAR-based real-time automated detection capabilities; and 4) a template matching based automated classification tool. These technologies build a solid foundation for future efforts to develop an extended range electro-optical monitoring system suitable for marine energy deployments. In addition to technology development, a key lesson learned is that addressing regulatory and safety requirements must be front and center in any marine energy monitoring applications.

16 TIDAL AND WAVE POWER↗
DOE OSTI2020

Identifying Entangled Physics Relationships through Sparse Matrix Decomposition to Inform Plasma Fusion Design [Slides]

The National Ignition Facility (NIF), is a large laser-based inertial confinement fusion (ICF) research device and various input variables in the experimental data are described. The overview included sections on: high-dimensional experimental dataset; surrogate model selection; ML to interpret complex coupling between inputs; importance of variables; Surrogate performance; and, future work.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Data-Driven Multi-agent Deep Reinforcement Learning for Distribution System Decentralized Voltage Control with High Penetration of PVs

This paper proposes a novel model-free/data-driven centralized training and decentralized execution multi-agent deep reinforcement learning (MADRL) framework for distribution system voltage control with high penetration of PVs. The proposed MADRL can coordinate both the real and reactive power control of PVs with existing static var compensators and battery storage systems. Unlike the existing DRL-based voltage control methods, our proposed method does not rely on a system model during both the training and execution stages. This is achieved by developing a new interaction scheme between the surrogate modeling of the original system and the multi-agent soft actor critic (MASAC) MADRL algorithm. In particular, the sparse pseudo-Gaussian process with a few-shots of measurements is utilized to construct the surrogate model of the original environment, i.e., power flow model. This is a data-driven process and no model parameters are needed. Furthermore, the MASAC enabled MADRL allows to achieve better scalability by dividing the original system into different voltage control regions with the aid of real and reactive power sensitivities to voltage, where each region is treated as an agent. This also serves as the foundation for the centralized training and decentralized execution, thus significantly reducing the communication requirements as only local measurements are required for control. Comparative results with other alternatives on the IEEE 123-nodes and 342-nodes systems demonstrate the superiority of the proposed method.

14 SOLAR ENERGY↗
DOE OSTI2022

Data-driven surrogate modeling of hPIC ion energy-angle distributions for high-dimensional sensitivity analysis of plasma parameters' uncertainty

In this work, we present a data-driven strategy for effective construction of a surrogate model in high-dimensional parameter space for the ion energy-angle distribution (IEAD) output of hPIC simulations of plasma-surface interactions. The methodology is based on a bin-by-bin least-squares fitting of the IEAD in the parameter space. The fitting is performed in a transformed coordinate system to normalize the IEAD, and it employs sparse grids for sampling the parameter space to overcome sampling challenges in high dimensions. The surrogate model is significantly cheaper computationally than direct hPIC simulations yet maintains high fidelity to them, providing a fast emulator for hPIC simulations. Sensitivity analysis based on the surrogate model is utilized to characterize the dependence of the ion impact angle and energy moments on the physical parameters.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Measurement and applications: Exploring the challenges and opportunities of hierarchical federated learning in sensor applications

Sensor applications have become ubiquitous in modern society as the digital age continues to advance. AI-based techniques (e.g., machine learning) are effective at extracting actionable information from large amounts of data. An example would be an automated water irrigation system that uses AI-based techniques on soil quality data to decide how to best distribute water. However, these AI-based techniques are costly in terms of hardware resources, and Internet-of-Things (IoT) sensors are resource-constrained with respect to processing power, energy, and storage capacity. These limitations can compromise the security, performance, and reliability of sensor-driven applications. To address these concerns, cloud computing services can be used by sensor applications for data storage and processing. Unfortunately, cloud-based sensor applications that require real-time processing, such as medical applications (e.g., fall detection and stroke prediction), are vulnerable to issues such as network latency due to the sparse and unreliable networks between the sensor nodes and the cloud server [1]. As users approach the edge of the communications network, latency issues become more severe and frequent. A promising alternative is edge computing, which provides cloud-like capabilities at the edge of the network by pushing storage and processing capabilities from centralized nodes to edge devices that are closer to where the data are gathered, resulting in reduced network delays [2], [3].

Po-Leen Ooi, Melanie↗
DOE OSTI2025

Lattice structure and dynamics of sparse molecular crystals: OsO4 and RuO4

This dataset contains input and output files from DFT simulations used to reproduce the electronic and phonon calculations of bulk and molecular OsO₄ and RuO₄. The files include data from initial electronic structure and phonon calculations performed using different functionals: PBE, PBEsol, and vdW-DF-optB86b. The computed phonon frequencies are compared with Raman crystal and gas-phase frequencies from existing literature, while the calculated phonon density of states (PhDOS) is compared with experimental PhDOS data.

36 MATERIALS SCIENCE↗
DOE OSTI2017

HPC formulations of optimization algorithms for tensor completion

Tensor completion is a powerful tool used to estimate or recover missing values in multi-way data. It has seen great success in domains such as product recommendation and healthcare. Tensor completion is most often accomplished via low-rank sparse tensor factorization, a computationally expensive non-convex optimization problem which has only recently been studied in the context of parallel computing. In this work, we study three optimization algorithms that have been successfully applied to tensor completion: alternating least squares (ALS), stochastic gradient descent (SGD), and coordinate descent (CCD++). We explore opportunities for parallelism on shared- and distributed-memory systems and address challenges such as memory- and operation-efficiency, load balance, cache locality, and communication. Among our advancements are a communication-efficient CCD++ algorithm, an ALS algorithm rich in level-3 BLAS routines, and an SGD algorithm which combines stratification with asynchronous communication. Furthermore, we show that introducing randomization during ALS and CCD++ can accelerate convergence. We evaluate our parallel formulations on a variety of real datasets on a modern supercomputer and demonstrate speedups through 16384 cores. Further, these improvements reduce time-to-solution from hours to seconds on real-world datasets. We show that after our optimizations, ALS is advantageous on parallel systems of small-to-moderate scale, while both ALS and CCD++ provide the lowest time-to-solution on large-scale distributed systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

Modelling infrasound signal generation from two underground explosions at the Source Physics Experiment using the Rayleigh integral

For this study, we use the Rayleigh integral (RI) as an approximation to the Helmholtz–Kirchoff integral to model infrasound generation and propagation from underground chemical explosions at distances of 250 m out to 5 km as part of the Source Physics Experiment (SPE). Using a sparse network of surface accelerometers installed above ground zero, we are able to accurately create synthetic acoustic waveforms and compare them to the observed data. Although the underground explosive sources were designed to be symmetric, the resulting seismic wave at the surface shows an asymmetric propagation pattern that is stronger to the northeast of the borehole. This asymmetric bias may be attributed to the subsurface geology and faulting of the area and is observed in the acoustic waveforms. We compare observed and modelled results from two of the underground SPE tests with a sensitivity study to evaluate the asymmetry observed in the data. This work shows that it is possible to model infrasound signals from underground explosive sources using the RI and that asymmetries observed in the data can be modelled with this technique.

58 GEOSCIENCES↗
DOE OSTI2019

Generative model benchmarks for superconducting qubits

In this paper we demonstrate experimentally how generative model training can be used as a benchmark for small (fewer than five qubits) quantum devices. Performance is quantified using three data analytic metrics: the Kullback-Leibler divergence and two adaptations of the F 1 score. Using the 2×2 bars and stripes data set, we train several different circuit constructions for generative modeling with superconducting qubits. By taking hardware connectivity constraints into consideration, we show that sparsely connected shallow circuits outperform denser counterparts on noisy hardware.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗