Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “matrix formats”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Exploring Deep Learning and Sparse Matrix Format Selection

We proposed to explore the use of Deep Neural Networks (DNN) for addressing the longstanding barriers. The recent rapid progress of DNN technology has created a large impact in many fields, which has significantly improved the prediction accuracy over traditional machine learning techniques in image classifications, speech recognitions, machine translations, and so on. To some degree, these tasks resemble the decision makings in many HPC tasks, including the aforementioned format selection for SpMV and linear solver selection. For instance, sparse matrix format selection is akin to image classification—such as, to tell whether an image contains a dog or a cat; in both problems, the right decisions are primarily determined by the spatial patterns of the elements in an input. For image classification, the patterns are of pixels, and for sparse matrix format selection, they are of non-zero elements. DNN could be naturally applied if we regard a sparse matrix as an image and the format selection or solver selection as classification problems.

97 MATHEMATICS AND COMPUTING↗

A Study of Clustering Techniques and Hierarchical Matrix Formats for Kernel Ridge Regression

We present memory-efficient and scalable algorithms for kernel methods used in machine learning. Using hierarchical matrix approximations for the kernel matrix the memory requirements, the number of floating point operations, and the execution time are drastically reduced compared to standard dense linear algebra routines. We consider both the general H matrix hierarchical format as well as Hierarchically Semi-Separable (HSS) matrices. Furthermore, we investigate the impact of several preprocessing and clustering techniques on the hierarchical matrix compression. Effective clustering of the input leads to a ten-fold increase in efficiency of the compression. The algorithms are implemented using the STRUMPACK solver library. These results confirm that - with correct tuning of the hyperparameters - classification using kernel ridge regression with the compressed matrix does not lose prediction accuracy compared to the exact - not compressed - kernel matrix and that our approach can be extended to O(1M) datasets, for which computation with the full kernel matrix becomes prohibitively expensive. We present numerical experiments in a distributed memory environment up to 1,024 processors of the NERSC's Cori supercomputer using well-known datasets to the machine learning community that range from dimension 8 up to 784.

97 MATHEMATICS AND COMPUTING↗

Decreased Neointimal Extracellular Matrix Formation in RAGE-Knockout Mice After Microvascular Denudation

Purpose: To evaluate in vivo the role of RAGE (receptor for advanced glycated end products) in the development of restenosis and neointimal proliferation in RAGE-deficient knockout (KO) mice compared with wild-type (WT) mice in an animal model. Materials and Methods: Sixteen WT and 15 RAGE-deficient mice underwent microvascular denudation of the common femoral artery under general anaesthesia. Contralateral arteries underwent a sham operation and served as controls. Four weeks after the intervention, all animals were killed, and paraformaldehyde-fixed specimens of the femoral artery were analysed with different stains (hematoxylin and eosin and Elastica van Gieson) and several different types of immunostaining (proliferating cell nuclear antigen, {alpha}-actin, collagen, von Willebrand factor, RAGE). Luminal area, area of the neointima, and area of the media were measured in all specimens. In addition, colony-formation assays were performed, and collagen production by WT smooth muscle cells (SMCs) and RAGE-KO SMCs was determined. For statistical analysis, P < 0.05 was considered statistically significant. Results: Four weeks after denudation, WT mice showed a 49.6% loss of luminal area compared with 14.9% loss of luminal area in RAGE-deficient mice (sham = 0% loss) (P < 0.001). The neointima was 18.2 (*1000 {mu}m{sup 2} [n = 15) in the WT group compared with only 8.4 (*1000 {mu}m{sup 2} [n = 16]) in the RAGE-KO group. RAGE-KO SMCs showed significantly decreased proliferation activity and production of extracellular matrix protein. Conclusion: RAGE may be shown to play a considerable role in the formation of neointima leading to restenosis after vascular injury.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Matrix-formation dynamics dictate methyl nitrite conformer abundance

Methyl nitrite has two stable conformational isomers resulting from rotation about the primary C–O–N–O dihedral angle: cis-CH 3 ONO and trans-CH 3 ONO, with cis being more stable by ∼5 kJ/mol. Here, the barrier to rotational interconversion (∼45 kJ/mol) is too large for isomerization to occur under ambient conditions. This paper presents evidence of a change in conformer abundance when dilute CH 3 ONO is deposited onto a cold substrate; the relative population of the freshly deposited cis conformer is seen to increase compared to its gas-phase abundance, measured by in situ infrared spectroscopy. We observe abundance changes depending on the identity of the bath gas (N 2 , Ar, and Xe) and deposition angle. The observations indicate that the surface properties of the growing matrix influence conformer abundance—contrary to the widely held assumption that conformer abundance in matrices reflects gas-phase abundance. We posit that differences in the angle-dependent host-gas deposition dynamics affect the growing surfaces, causing changes in conformer abundances. Quantum chemistry calculations of the binding energies between CH 3 ONO and a single bath-gas component reveal that significant energetic stabilization is not observed in 1:1 complexes of N 2 :CH 3 ONO, Ar:CH 3 ONO, or Xe:CH 3 ONO. From our results, we conclude that the growing surface plays a significant role in trapping cis-CH 3 ONO more effectively than trans-CH 3 ONO, likely because cis-CH 3 ONO is more compact. Taken together, the observations highlight the necessity for careful characterization of conformers in matrix-isolated systems, emphasizing a need for further study into the deposition dynamics and surface structure of chemically inert matrices.

Hockey, Emily K.↗

The Biological Observation Matrix (BIOM) format or: how I learned to stop worrying and love the ome-ome

We present the Biological Observation Matrix (BIOM, pronounced “biome”) format: a JSON-based file format for representing arbitrary observation by sample contingency tables with associated sample and observation metadata. As the number of categories of comparative omics data types (collectively, the “ome-ome”) grows rapidly, a general format to represent and archive this data will facilitate the interoperability of existing bioinformatics tools and future meta-analyses. The BIOM file format is supported by an independent open-source software project (the biom-format project), which initially contains Python objects that support the use and manipulation of BIOM data in Python programs, and is intended to be an open development effort where developers can submit implementations of these objects in other programming languages. The BIOM file format and the biom-format project are steps toward reducing the “bioinformatics bottleneck” that is currently being experienced in diverse areas of biological sciences, and will help us move toward the next phase of comparative omics where basic science is translated into clinical and environmental applications. The BIOM file format is currently recognized as an Earth Microbiome Project Standard, and as a Candidate Standard by the Genomic Standards Consortium.

59 BASIC BIOLOGICAL SCIENCES↗

Structure and decomposition of the silver formate Ag(HCO{sub 2})

Crystal structure of the silver formate Ag(HCO{sub 2}) has been determined (orthorhombic, sp.gr. Pccn, a=7.1199(5), b=10.3737(4), c=6.4701(3)Å, V=477.88(4) Å{sup 3}, Z=8). The structure contains isolated formate ions and the pairs Ag{sub 2}{sup 2+} which form the layers in (001) planes (the shortest Ag–Ag distances is 2.919 in the pair and 3.421 and 3.716 Å between the nearest Ag atoms of adjacent pairs). Silver formate is unstable compound which decompose spontaneously vs time. Decomposition was studied using Rietveld analysis of the powder diffraction patterns. It was concluded that the diffusion of Ag atoms leads to the formation of plate-like metal particles as nuclei in the (100) planes which settle parallel to (001) planes of the silver formate matrix. - Highlights: • Silver formate Ag(HCO{sub 2}) was synthesized and characterized. • Layered packing of Ag-Ag pairs in the structure was found. • Decomposition of Ag(HCO{sub 2}) and formation of metal phase were studied. • Rietveld-refined micro-structural characteristics during decomposition reveal the space relationship between the matrix structure and forming Ag phase REPLACE with: Space relationship between the matrix structure and forming Ag phase.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Spectral Properties and Possibilities of meso-Substituted BODIPY Usage in Sol–Gel Process and Materials

Hybrid materials based on organically modified silica with immobilized boron-dipyrrins (BODIPY) dyes were obtained. Spectral characteristics of the dyes were measured during the matrix formation and in obtained materials. It was stated, that immobilization does not affect the character of the absorption and fluorescence spectra of the dye, but due to the effect of fluorescent molecular rotor observed for meso-substituted BODIPY, the fluorescent quantum yields were found to increase during the matrix sealing. Quantum yield increase is linear for all of the investigated matrices except phenyl-substituted one, where the π-π interactions of the dye molecule with matrix could be observed. This effect could be used for fine control of the matrix formation process and leads to increase of the dye emission in the final material for further practical applications. All obtained hybrid materials were found to be stable upon UV light irradiation, hence immobilization enhance the stability of the dye in comparison with the BODIPY in organic solvents.

74 ATOMIC AND MOLECULAR PHYSICS↗

Optimizing Sparse Matrix-Multiple Vectors Multiplication for Nuclear Configuration Interaction Calculations

Obtaining highly accurate predictions on the properties of light atomic nuclei using the configuration interaction (CI) approach requires computing a few extremal Eigen pairs of the many-body nuclear Hamiltonian matrix. In the Many-body Fermion Dynamics for nuclei (MFDn) code, a block Eigen solver is used for this purpose. Due to the large size of the sparse matrices involved, a significant fraction of the time spent on the Eigen value computations is associated with the multiplication of a sparse matrix (and the transpose of that matrix) with multiple vectors (SpMM and SpMM-T). Existing implementations of SpMM and SpMM-T significantly underperform expectations. Thus, in this paper, we present and analyze optimized implementations of SpMM and SpMM-T. We base our implementation on the compressed sparse blocks (CSB) matrix format and target systems with multi-core architectures. We develop a performance model that allows us to understand and estimate the performance characteristics of our SpMM kernel implementations, and demonstrate the efficiency of our implementation on a series of real-world matrices extracted from MFDn. In particular, we obtain 3-4 speedup on the requisite operations over good implementations based on the commonly used compressed sparse row (CSR) matrix format. The improvements in the SpMM kernel suggest we may attain roughly a 40% speed up in the overall execution time of the block Eigen solver used in MFDn.

97 MATHEMATICS AND COMPUTING↗

The basic matrix library (BML) for quantum chemistry

The basic matrix library package (BML) provides a common application programming interface (API) for linear algebra and matrix functions in C and Fortran for quantum chemistry codes. The BML API is matrix format independent. Currently the dense, compressed sparse row, and ELLPACK-R sparse matrix data types are available, each with different implementations. We show how the second-order spectral projection (SP2) algorithm used to compute the electronic structure of a molecular system represented with a tight-binding Hamiltonian can be successfully implemented with the aid of this library.

97 MATHEMATICS AND COMPUTING↗

Hierarchical off-diagonal low-rank approximation of Hessians in inverse problems, with application to ice sheet model initialization

Obtaining lightweight and accurate approximations of discretized objective functional Hessians in inverse problems governed by partial differential equations (PDEs) is essential to make both deterministic and Bayesian statistical large-scale inverse problems computationally tractable. The cubic computational complexity of dense linear algebraic tasks, such as Cholesky factorization, that provide a means to sample Gaussian distributions and determine solutions of Newton linear systems is a computational bottleneck at large-scale. These tasks can be reduced to log-linear complexity by utilizing hierarchical off-diagonal low-rank (HODLR) matrix approximations. In this work, we show that a class of Hessians that arise from inverse problems governed by PDEs are well approximated by the HODLR matrix format. In particular, we study inverse problems governed by PDEs that model the instantaneous viscous flow of ice sheets. In these problems, we seek a spatially distributed basal sliding parameter field such that the flow predicted by the ice sheet model is consistent with ice sheet surface velocity observations. Here, we demonstrate the use of HODLR Hessian approximation to efficiently sample the Laplace approximation of the posterior distribution with covariance further approximated by HODLR matrix compression. Computational studies are performed which illustrate ice sheet problem regimes for which the Gauss–Newton data-misfit Hessian is more efficiently approximated by the HODLR matrix format than the low-rank (LR) format. We then demonstrate that HODLR approximations can be favorable, when compared to global LR approximations, for large-scale problems by studying the data-misfit Hessian associated with inverse problems governed by the first-order Stokes flow model on the Humboldt glacier and Greenland ice sheet.

97 MATHEMATICS AND COMPUTING↗

Experimental and numerical investigation of flame stabilization and pollutant formation in matrix stabilized ammonia-hydrogen combustion

Ammonia (NH 3 ) is a carbon-free fuel that offers an attractive alternative for reducing greenhouse gas emissions. However, the slow flame speed, low heating value, and emissions of nitrogen-containing pollutants present significant issues for practical combustion applications. To address these issues, we investigate the use of matrix stabilized combustion. In this type of burner, combustion is performed within an inert porous ceramic foam, heat is recirculated by solid conduction and radiation, which enhances flame speed and combustion stabilization, thereby permitting combustion over a wide range of equivalence ratio conditions. We present a new porous media burner (PMB) capable of stabilizing NH 3 /air flames at ambient conditions. An extensive experimental characterization of the stability of this burner is conducted with up to 30% by volume of hydrogen (H 2 ) in the fuel stream. A 15:1 turndown ratio is demonstrated, with a high thermal power density of 62 MW m -3 . Concentrations of NO, unburnt NH 3 , and H 2 in the exhaust stream are measured. Two regimes are identified for low NO operation: rich and very lean. For rich conditions, NO emissions decrease with increasing equivalence ratio and decreasing H 2 blending. Unburnt NH 3 emissions follow opposite trends. These measurements are complemented by simulations in which the burner is represented by a coupled solid-gas reactor network. In conclusion, this model captures the burner’s pollutant emissions to good accuracy and is used to analyze the mechanisms of pollutant formation.

42 ENGINEERING↗

CSBCOO SPMM: Compressed Sparse Block Coordinate format sparse matrix dense vector multiply benchmark (CSBCOO SPMM) v1.0

The purpose of this microbenchmark is to provide a means to explore different programming methodologies using a simple, but not trivial, mathematical kernel. The kernel is based on the matrix vector product in the MFDn nuclear configuration interaction code's LOBPCG eigensolver. This particular mathematical operation is a key element in the solution of systems of equations and block eigensolvers.

Cook, Brandon↗

Scalable Matrix-Free Adaptive Product-Convolution Approximation for Locally Translation-Invariant Operators

We present an adaptive grid matrix-free operator approximation scheme based on a "product-convolution" interpolation of convolution operators. This scheme is appropriate for operators that are locally translation-invariant, even if these operators are high rank or full rank. Such operators arise in Schur complement methods for solving partial differential equations (PDEs), as Hessians in PDE-constrained optimization and inverse problems, as integral operators, as covariance operators, and as Dirichlet-to-Neumann maps. Constructing the approximation requires computing the impulse responses of the operator to point sources centered on nodes in an adaptively refined grid of sample points. A randomized a posteriori error estimator drives the adaptivity. Once constructed, the approximation can be efficiently applied to vectors using the fast Fourier transform. The approximation can be efficiently converted to hierarchical matrix (H-matrix) format, then inverted or factorized using scalable H-matrix arithmetic. The quality of the approximation degrades gracefully as fewer sample points are used, allowing cheap lower quality approximations to be used as preconditioners. Furthermore, this yields an automated method to construct preconditioners for locally translation-invariant Schur complements. We directly address issues related to boundaries and prove that our scheme eliminates boundary artifacts. We test the scheme on a spatially varying blurring kernel, on the nonlocal component of an interface Schur complement for the Poisson operator, and on the data misfit Hessian for an advection dominated advection-diffusion inverse problem. Numerical results show that the scheme outperforms existing methods.

97 MATHEMATICS AND COMPUTING↗

Geometry-aware training of factorized layers in tensor Tucker format

Reducing parameter redundancies in neural network architectures is crucial for achieving feasible computational and memory requirements during train and inference of large networks. Given its easy implementation and flexibility, one promising approach is layer factorization, which reshapes weight tensors into a matrix format and parameterizes it as the product of two rank-r matrices. However, this family of approaches often requires an initial full-model warm-up phase, prior knowledge of a feasible rank, and it is sensitive to parameter initialization.In this work, we introduce a novel approach to train the factors of a Tucker decomposition of the weight tensors. Our training proposal proves to be optimal in locally approximating the original unfactorized dynamics and stable for the initialization. Furthermore, the rank of each mode is dynamically updated during training.We provide a theoretical analysis of the algorithm, showing convergence, approximation and local descent guarantees. The method's performance is further illustrated through a variety of experiments, showing remarkable training compression rates and comparable or even better performance than the full baseline and alternative layer factorization strategies.

Zangrando, Emanuele [Gran Sasso Science Institute ↗

Hybrid programming-model strategies for GPU offloading of electronic structure calculation kernels

To address the challenge of performance portability and facilitate the implementation of electronic structure solvers, we developed the basic matrix library (BML) and Parallel, Rapid O(N), and Graph-based Recursive Electronic Structure Solver (PROGRESS) library. The BML implements linear algebra operations necessary for electronic structure kernels using a unified user interface for various matrix formats (dense and sparse) and architectures (CPUs and GPUs). Focusing on density functional theory and tight-binding models, PROGRESS implements several solvers for computing the single-particle density matrix and relies on BML. In this paper, we describe the general strategies used for these implementations on various computer architectures, using OpenMP target functionalities on GPUs, in conjunction with third-party libraries to handle performance critical numerical kernels. In this study, we demonstrate the portability of this approach and its performance in benchmark problems.

36 MATERIALS SCIENCE↗

Validation of a simple and fast method to quantify in vitro mineralization with fluorescent probes used in molecular imaging of bone

Highlights: •We validate a simple and fast method of quantification of in vitro mineralization. •Fluorescently labeled agents can detect calcium deposits in the mineralized matrix of cell cultures. •Fluorescent signals of the probes correlated with Alizarin Red S staining. -- Abstract: Alizarin Red S staining is the standard method to indicate and quantify matrix mineralization during differentiation of osteoblast cultures. KS483 cells are multipotent mouse mesenchymal progenitor cells that can differentiate into chondrocytes, adipocytes and osteoblasts and are a well-characterized model for the study of bone formation. Matrix mineralization is the last step of differentiation of bone cells and is therefore a very important outcome measure in bone research. Fluorescently labelled calcium chelating agents, e.g. BoneTag and OsteoSense, are currently used for in vivo imaging of bone. The aim of the present study was to validate these probes for fast and simple detection and quantification of in vitro matrix mineralization by KS483 cells and thus enabling high-throughput screening experiments. KS483 cells were cultured under osteogenic conditions in the presence of compounds that either stimulate or inhibit osteoblast differentiation and thereby matrix mineralization. After 21 days of differentiation, fluorescence of stained cultures was quantified with a near-infrared imager and compared to Alizarin Red S quantification. Fluorescence of both probes closely correlated to Alizarin Red S staining in both inhibiting and stimulating conditions. In addition, both compounds displayed specificity for mineralized nodules. We therefore conclude that this method of quantification of bone mineralization using fluorescent compounds is a good alternative for the Alizarin Red S staining.

60 APPLIED LIFE SCIENCES↗