Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “hidden systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

Crystalline Order Yet Glass-Like Heat Transport Driven by Hidden Local Distortions as the Structural Origin of Ultralow Thermal Conductivity in AgErTe 2

Given their rich chemical diversity and the interplay among the p-, d-, and f-orbitals of chalcogens, transition metals, and lanthanides, respectively, rare-earth transition-metal chalcogenides exhibit a wide variety of structural, magnetic, and transport phenomena. As a result, they form a particularly appealing platform for investigating structure–property relationships, emergent electronic and magnetic behaviors, and thermal transport. Here we investigate AgErTe 2 as a model system to understand phonon-glass behavior in ordered crystalline solids, which establishes the design principles for thermal barrier coatings and next-generation thermoelectrics. The local bonding asymmetry and lattice softness suppress the inherently low lattice thermal conductivity, resembling the characteristics of amorphous materials. This suppression is significantly influenced by local off-centering of Ag atoms, which breaks lattice periodicity while maintaining global crystallinity. The presence of antibonding states just below the Fermi level, arising from Ag 4d and Te 5p orbital interactions, leads to lattice softening and destabilizes ideal tetrahedral coordination, resulting in a pseudo Jahn–Teller distortion. Furthermore, the coexistence of weaker, more polarizable Ag–Te bonds and stronger Er–Te bonds creates a complex vibrational landscape enriched with low-frequency modes and enhanced phonon scattering. A pronounced disparity in interatomic force constants gives rise to highly localized, low-energy optical phonons linked to Ag rattling. These flat vibrational modes exhibit strong coupling with transverse acoustic phonons, resulting in ultrashort phonon lifetimes and mean free paths approaching interatomic distances. These features collectively enhance phonon scattering across a broad range of length and energy scales. This work offers a framework for engineering suppressed thermal conductivity in crystalline systems without the introduction of alloying elements.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Predictive Interfaces for Long-Distance Tele-Operations

We address the development of predictive tele-operator interfaces for humanoid robots with respect to two basic challenges. Firstly, we address automating the transition from fully tele-operated systems towards degrees of autonomy. Secondly, we develop compensation for the time-delay that exists when sending telemetry data from a remote operation point to robots located at low earth orbit and beyond. Humanoid robots have a great advantage over other robotic platforms for use in space-based construction and maintenance because they can use the same tools as astronauts do. The major disadvantage is that they are difficult to control due to the large number of degrees of freedom, which makes it difficult to synthesize autonomous behaviors using conventional means. We are working with the NASA Johnson Space Center's Robonaut which is an anthropomorphic robot with fully articulated hands, arms, and neck. We have trained hidden Markov models that make use of the command data, sensory streams, and other relevant data sources to predict a tele-operator's intent. This allows us to achieve subgoal level commanding without the use of predefined command dictionaries, and to create sub-goal autonomy via sequence generation from generative models. Our method works as a means to incrementally transition from manual tele-operation to semi-autonomous, supervised operation. The multi-agent laboratory experiments conducted by Ambrose et. al. have shown that it is feasible to directly tele-operate multiple Robonauts with humans to perform complex tasks such as truss assembly. However, once a time-delay is introduced into the system, the rate of tele\ioperation slows down to mimic a bump and wait type of activity. We would like to maintain the same interface to the operator despite time-delays. To this end, we are developing an interface which will allow for us to predict the intentions of the operator while interacting with a 3D virtual representation of the expected state of the robot. The predictive interface anticipates the intention of the operator, and then uses this prediction to initiate appropriate sub-goal autonomy tasks.

Wheeler, Kevin R.↗

Behavior of supercooled aqueous solutions stemming from hidden liquid–liquid transition in water

A popular hypothesis that explains the anomalies of supercooled water is the existence of a metastable liquid–liquid transition hidden below the line of homogeneous nucleation. If this transition exists and if it is terminated by a critical point, the addition of a solute should generate a line of liquid–liquid critical points emanating from the critical point of pure metastable water. We have analyzed thermodynamic consequences of this scenario. In particular, we consider the behavior of two systems, H{sub 2}O-NaCl and H{sub 2}O-glycerol. We find the behavior of the heat capacity in supercooled aqueous solutions of NaCl, as reported by Archer and Carter [J. Phys. Chem. B 104, 8563 (2000)], to be consistent with the presence of the metastable liquid–liquid transition. We elucidate the non-conserved nature of the order parameter (extent of “reaction” between two alternative structures of water) and the consequences of its coupling with conserved properties (density and concentration). We also show how the shape of the critical line in a solution controls the difference in concentration of the coexisting liquid phases.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Synthesis of Year Two Outcomes in the Smart Energy Analytics Campaign

Buildings are full of hidden energy savings potential that can be uncovered with the right analysis. With sophisticated software to inform and assist in building operations, building owners now are reducing energy and improving operations using building data analytics. The cornerstone of successful building data analytics is the ability to extract accurate and actionable insights from large amounts of data. Modern building automation systems (BAS) monitor hundreds of points per building, and an owner may have a portfolio generating many thousands of data points. The BAS can provide alarms for points out of range, but the analytical capabilities fall well short of helping achieve an optimized system. Further, common analysis tools for energy meter data tend to manage the monthly bills but do not support hourly interval data. Energy management and information systems (EMIS) are software that provide the needed analytical horsepower to building owners as they work to find meaning from data. This section highlights the benefits and challenges in using EMIS for continuous energy management.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Ejecta Generation and Redistribution on 433 Eros: Modeling Ejecta Launch Conditions

The NEAR-Shoemaker mission to asteroid 433 Eros presents an unprecedented opportunity to gain fundamental new knowledge about the processes governing regolith formation and redistribution on small bodies. NEAR-Shoemaker’s high-resolution imaging of the surface of Eros makes the asteroid a valuable and heretofore unparalleled laboratory for the detailed study of impact ejecta reaccretion and regolith redistribution on low-gravity (of order 10 -3 g) objects. Regolith is produced on asteroids by impact cratering, and the existence of regolith on the smallest solar system bodies supports the view that some of the ejecta from impact events on such objects may be retained. Impact craters and retained ejecta on low-gravity objects like Eros represent valuable natural laboratories for evaluating various models of impact cratering processes, since they may present crater structures or ejecta features that either do not form or are hidden on higher-gravity bodies like the Moon. Further, quantifying the extent to which impact processes generate and redistribute regoliths on small body surfaces (excavation depths, retained fraction, turnover timescales, etc.) is pivotal to the issue of how to relate meteoritical samples to their asteroidal parent bodies when surficial processes ( i.e., “space weathering”) may disguise or cover up underlying material and confound the ability of remote sensing techniques to provide reliable mineralogical assays of the parent objects. The rich variety of data on Eros’ regolith properties and distribution returned by NEAR-Shoemaker now require detailed analysis in order to take full advantage of the clues these observations offer for elucidating details of the impact cratering process on small bodies. Complicating simple interpretations of crater and ejecta morphology are dynamical effects on ejecta emplacement resulting from Eros’ irregular shape, rapid (5.27 hr) rotation, and low gravity. Figure 1 shows the very different ejecta deposit morphology that can result if the effects of rotation alone are neglected. Considering the additional complicating factors of Eros’ irregular shape and complex gravitational field, simple calculations of the extent and thickness of ejecta blankets and the spatial distribution of ejecta blocks from basic crater scaling laws or numerical hydrocodes alone do not suffice. In order to fully interpret the suite of NEAR-Shoemaker observations of regolith features across the surface of Eros and to evaluate various impact models for specific craters on the asteroid, detailed dynamical modeling of the deposition of crater ejecta from those craters is required . Here, I describe some modifications and improvements to the dynamical model being used for these studies.

D D Durda↗

WIDESPREAD AND HIDDEN ACTIVE GALACTIC NUCLEI IN STAR-FORMING GALAXIES AT REDSHIFT >0.3

We characterize the incidence of active galactic nuclei (AGNs) in 0.3 < z < 1 star-forming galaxies by applying multi-wavelength AGN diagnostics (X-ray, optical, mid-infrared, radio) to a sample of galaxies selected at 70 {mu}m from the Far-Infrared Deep Extragalactic Legacy survey (FIDEL). Given the depth of FIDEL, we detect 'normal' galaxies on the specific star formation rate (sSFR) sequence as well as starbursting systems with elevated sSFR. We find an overall high occurrence of AGN of 37% {+-} 3%, more than twice as high as in previous studies of galaxies with comparable infrared luminosities and redshifts but in good agreement with the AGN fraction of nearby (0.05 < z < 0.1) galaxies of similar infrared luminosities. The more complete census of AGNs comes from using the recently developed Mass-Excitation (MEx) diagnostic diagram. This optical diagnostic is also sensitive to X-ray weak AGNs and X-ray absorbed AGNs, and reveals that absorbed active nuclei reside almost exclusively in infrared-luminous hosts. The fraction of galaxies hosting an AGN appears to be independent of sSFR and remains elevated both on the sSFR sequence and above. In contrast, the fraction of AGNs that are X-ray absorbed increases substantially with increasing sSFR, possibly due to an increased gas fraction and/or gas density in the host galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗

Recovering noise-free quantum observables

We introduce a technique for recovering noise-free observables in noisy quantum systems by combining the results of many slightly different experiments. Our approach is applicable to a variety of quantum systems, but we illustrate it with applications to quantum information and quantum sensing. The approach corresponds to repeating the same quantum evolution many times with known variations on the underlying systems' error properties, e.g., the spontaneous emission and dephasing times $T_1$ and $T_2$. As opposed to standard quantum error correction methods, which have an overhead in the number of qubits (many physical qubits must be added for each logical qubit), our method has only an overhead in the number of evaluations, allowing the overhead to, in principle, be hidden via parallelization. We show that the effective spontaneous emission $T_1$ and dephasing $T_2$ times can be increased using this method in both simulation and experiments on an actual quantum computer. We also show how to correct more complicated entangled states and how Ramsey fringes relevant to quantum sensing can be significantly extended in time.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Microstructural characterization of a star-linear polymer blend under shear flow by using rheo-SANS

We present an investigation into the dynamic relaxation mechanisms of a polybutadiene blend composed of a four-arm star (10 wt. %) and a linear polymer matrix in the presence of an applied shear flow. Our focus was the response of the star polymer, which cannot be unambiguously assessed via linear viscoelastic measurements since the signature of the star polymer can barely be detected due to the dominant contribution of the linear matrix. By utilizing small-angle neutron scattering (SANS) coupled with a Couette shear device and a deuterated matrix polymer, we investigated the dynamics of the minority star component of the blend. Our results confirm that the stars deform anisotropically with increasing shear rate. We have compared the SANS data with predictions from the well-established scattering adaptation of the state-of-the-art tube model for entangled linear polymer melts undergoing shear, i.e., Graham, Likhtman, Milner, and McLeish (GLaMM) approach, appropriately modified following earlier studies in order to apply to the star. This modified model, GLaMM-R, includes the physics necessary to understand stress relaxation in both the linear and nonlinear flow regimes, i.e., contour length fluctuations, constraint release, convective constraint release, and chain retraction. The full scattering signal is due to the minority star component and, although the contribution of the linear chains is hidden from the neutron scattering, they still influence the star polymer molecular dynamics, with the applied shear rate ranging from approximately 8 to 24 s –1 , below the inverse relaxation time of the linear component. This study provides another confirmation that the combination of rheology and neutron scattering is an indispensable tool for investigating the nonlinear dynamics of complex polymeric systems.

36 MATERIALS SCIENCE↗

Use of interactive graphics to analyze QUICK-geometry

The QUICK InterActive Graphics Analysis (QUIAGA) program and its advantages for displaying aircraft QUICK-geometry to aid in detection and analysis of errors are described. The QUICK-geometry system generates a completely analytical aircraft geometry description for use by finite-difference flow codes. The QUIAGA program was developed to exercise the QUICK-geometry subroutines to examine the analytic definition of a configuration by plotting cross sections and body lines on a graphics terminal. A number of options are available, including multiple cross-section views, hidden-line removal, and display of control point locations. Use of these options for the detection and analysis of errors in the QUICK-geometry definition can be of great assistance in speedily arriving at a correct analytical geometry description for flow-field computation. The QUIAGA program has been used in developing a QUICK-geometry model of the NASA Space Shuttle Orbiter, and examples from this experience are given to show some of the program's features. Details of program usage and an example session are given in the appendixes.

Townsend, J. C.↗

Variation Principles and Applications in the Study of Cell Structure and Aging

In this report we have attempted to show that "some reality lies concealed in biological variation". This "reality" has its principles, laws, mechanisms, and rules, only a few of which we have sketched. A related idea we pursued was that important information may be lost in the process of ignoring frequency distributions of physiological variables (as is customary in experimental physiology and gerontology). We suggested that it may be advantageous to expand one's "statistical field of vision" beyond simple averages +/- standard deviations. Indeed, frequency distribution analysis may make visible some hidden information not evident from a simple qualitative analysis, particularly when the effect of some external factor or condition (e.g., aging, dietary chemicals) is being investigated. This was clearly illustrated by the application of distribution analysis in the study of variation in mouse liver cellular and fine structure, and may be true of fine structural studies in general. In living systems, structure and function interact in a dynamic way; they are "inseparable," unlike in technological systems or machines. Changes in fine structure therefore reflect changes in function. If such changes do not exceed a certain physiologic range, a quantitative analysis of structure will provide valuable information on quantitative changes in function that may not be possible or easy to measure directly. Because there is a large inherent variation in fine structure of cells in a given organ of an individual and among individuals, changes in fine structure can be analyzed only by studying frequency distribution curves of various structural characteristics (dimensions). Simple averages +/- S.D. do not in general reveal all information on the effect of a certain factor, because often this effect is not uniform; on the contrary, this will be apparent from distribution analysis because the form of the curves will be affected. We have also attempted to show in this chapter that similar general statistical principles and mechanisms may be operative in biological and technological systems. Despite the common belief that most biological and technological characteristics of interest have a symmetric bell-shaped (normal or Gaussian) distribution, we have shown that more often than not, distributions tend to be asymmetric and often resemble a so-called log-normal distribution. We saw that at least three general mechanisms may be operative, i.e., nonadditivity of influencing factors, competition among individuals for a common resource, and existence of an "optimum" value for a studied characteristic; more such mechanisms could exist.

Economos, Angelos C.↗

The hidden giant: discovery of an enormous Galactic dwarf satellite in Gaia DR2

ABSTRACT We report the discovery of a Milky Way satellite in the constellation of Antlia. The Antlia 2 dwarf galaxy is located behind the Galactic disc at a latitude of b ∼ 11° and spans 1.26°, which corresponds to ∼2.9 kpc at its distance of 130 kpc. While similar in spatial extent to the Large Magellanic Cloud, Antlia 2 is orders of magnitude fainter at MV = −9 mag, making it by far the lowest surface brightness system known (at ∼31.9 mag arcsec−2), ∼100 times more diffuse than the so-called ultra diffuse galaxies. The satellite was identified using a combination of astrometry, photometry, and variability data from Gaia Data Release 2, and its nature confirmed with deep archival DECam imaging, which revealed a conspicuous BHB signal. We have also obtained follow-up spectroscopy using AAOmega on the AAT, identifying 159 member stars, and we used them to measure the dwarf’s systemic velocity, 290.9 ± 0.5 km s−1, its velocity dispersion, 5.7 ± 1.1 km s−1, and mean metallicity, [Fe/H] = −1.4. From these properties we conclude that Antlia 2 inhabits one of the least dense dark matter (DM) haloes probed to date. Dynamical modelling and tidal-disruption simulations suggest that a combination of a cored DM profile and strong tidal stripping may explain the observed properties of this satellite. The origin of this core may be consistent with aggressive feedback, or may even require alternatives to cold dark matter (such as ultra-light bosons).

79 ASTRONOMY AND ASTROPHYSICS↗

Recent developments in chiral unitary theory of mesons and baryons

In this talk I summarize recent findings around the description of axial vector mesons as dynamically generated states from the interaction of pseudoscalar mesons and vector mesons, dedicating some attention to the two K{sub 1}(1270) states. Then I review the generation of open and hidden charm scalar and axial states, and how some recent experiment supports the existence of the new hidden charm scalar state predicted. I present recent results showing that the low lying 1/2{sup +} baryon resonances for S = -1 can be obtained as bound states or resonances of two mesons and one baryon in coupled channels. Then show the differences with the S = 0 case, where the N*(1710) appears also dynamically generated from the two pion one nucleon system, but the N*(1440) does not appear, indicating a more complex structure of the Roper resonance. Finally I shall show how the state X(2175), recently discovered at BABAR and BES, appears naturally as a resonance of the {phi}KK-bar system.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Visualization for Insight and Data Analysis in Energy Research

This talk explores how advanced visualization technologies are transforming analytical reasoning and knowledge discovery in energy research, drawing on recent work at the National Laboratory of the Rockies' Computational Science Center. Through a series of scientific case studies, we demonstrate how immersive and high-resolution visualization environments enable scientists and engineers to identify previously unseen patterns and features - insights that often remain hidden in traditional desktop-based analysis. By embedding richer information into interactive analytics tools, these approaches support the exploration of complex, multivariate parameter spaces, where interaction itself catalyzes understanding. Beyond capability, we emphasize the critical role of visualization design grounded in perception and cognition, showing how visual encodings directly influence analytical outcomes. Spanning applications from materials science to integrated energy systems, these visualization approaches accelerate innovation and improve decision-making by enabling deeper, more reliable insight into increasingly complex energy data.

97 MATHEMATICS AND COMPUTING↗

The Integration of COTS/GOTS within NASA's HST Command and Control System

NASA's mission critical Hubble Space Telescope (HST) command and control system has been re-engineered with commercial-off-the-shelf (COTS/GOTS) and minimal custom code. This paper focuses on the design of this new HST Control Center System (CCS) and the lessons learned throughout its development. CCS currently utilizes more than 30 COTS/GOTS products with an additional 1/2 million lines of custom glueware code; the new CCS exceeds the capabilities of the original system while significantly reducing the lines of custom code by more than 50%. The lifecycle of COTS/GOTS products will be examined including the package selection process, evaluation process, and integration process. The advantages, disadvantages, issues, concerns, and lessons learned for integrating COTS/GOTS into the NASA's mission critical HST CCS will be examined in detail. This paper will reveal the many hidden costs of COTS/GOTS solutions when compared to traditional custom code development efforts; this paper will show the high cost of COTS/GOTS solutions including training expenses, consulting fees, and long-term maintenance expenses.

Pfarr, Thomas↗

Progress on the James Webb Space Telescope

I will describe the scientific program anticipated for the James Webb Space Telescope and the progress in its construction. When the JWST was conceived in 1995 it was expected to make its greatest contributions in the study of the first objects to form after the Big Bang, in the evolution of galaxies, and in the formation and evolution of stars and planetary systems. Since then, the age-distance-redshift relation has become clear with the precise measurement of the Hubble constant, the discovery of the accelerating universe, and the remarkable agreement of CMBR calculations with direct measurements of the large-scale structure. So what is left and what has changed? Galaxy formation and growth is still mysterious, star formation is still hidden, the dark matter and dark energy are still unobservable, and the tools at hand may or may not help enough. But the JWST, as a general-purpose observatory, will be available for imaginative use, and is just what Simon White's polemic seems to request. As an example, the JWST should be quite capable of observing transiting exoplanets with remarkable precision, even though there was no requirement to do so, and its coronagraphs will be very good even without a monolithic primary mirror. The JWST mission has now been officially approved by NASA and is in the Federal budget. It is planned for launch in 2014. Flight instruments will begin to arrive at Goddard in mid-2010, and the first flight mirror segments have already passed their first cryogenic tests. The flight detectors have been selected and have remarkable performance; for example, the near IR detectors have dark currents of the order of 10 electrons per pixel per hour.

Mather, John C.↗

Applying Gaussian Process Machine Learning and Modern Probabilistic Programming to Satellite Data to Infer CO 2 Emissions

Satellite data provides essential insights into the spatiotemporal distribution of CO 2 concentrations. However, many atmospheric inverse models fail to adequately incorporate the spatial and temporal correlations inherent in satellite observations and often lack rigorous methods for estimating parameters like spatial length scales. We introduce an inference model that processes the spatiotemporal covariance in satellite data and estimates hyperparameters such as covariance length scales. Our approach uses the Gaussian process (GP) machine learning (ML) and modern probabilistic programming languages (PPLs) to perform atmospheric inversions of emissions from satellite data. We develop a GP ML inversion system based on modern PPLs and the GEOS-Chem chemical transport model, simulating atmospheric CO 2 concentrations corresponding to the Orbiting Carbon Observatory-2/3 (OCO-2/3) data for July 2020. In our supervised learning framework, we treat the GEOS-Chem simulated data set as the target, with predictors derived by scaling the target with sector-specific factors hidden from the GP machine. Our results show that the GP model, combined with GPU-enabled PPLs, effectively retrieves true emission scaling factors and infers noise levels concealed within the data. This suggests that our method could be applied over larger areas with more complex covariance structures, enabling comprehensive analysis of the spatiotemporal patterns observed in OCO-2/3 and similar satellite data sets.

54 ENVIRONMENTAL SCIENCES↗

Advancing Understanding of the Role of Belowground Processes in Terrestrial Carbon Sinks trhrough Ground-Penetrating Radar. Final Report

Coarse roots play a significant role in belowground carbon cycling and will likely play an increasingly crucial role in belowground carbon sequestration as atmospheric CO 2 levels continue to rise, yet they are one of the most difficult ecosystem parameters to quantify. Despite promising results with ground-penetrating radar (GPR) as a nondestructive method of quantifying biomass of coarse roots, this application of GPR is in its infancy and neither the complete potential nor limitations of the technology have been fully evaluated. The primary goals and questions of this study fell into four groups: (1) GPR methods: Can GPR detect change in root biomass over time, differentiate live roots from dead roots, differentiate between coarse roots, fine roots bundled together, and a fine root mat, remain effective with varied soil moisture, and detect shadowed roots (roots hidden below larger roots); (2) CO 2 enrichment study at Kennedy Space Center in Brevard County, Florida: Are there post-fire legacy effects of CO 2 fertilization on plant carbon pools following the end of CO 2 application ? (3) Disney Wilderness Study: What is the overall coarse root biomass and potential for belowground carbon storage in a restored longleaf pine flatwoods system? Can GPR effectively quantify coarse roots in soils that are wetter than the previous sites and that have a high percentage of saw palmetto rhizomes present? (4) Can GPR accurately represent root architecture in a three-dimensional model? When the user is familiar with the equipment and software in a setting that minimizes unsuitable conditions, GPR is a relatively precise, non-destructive, useful tool for estimating coarse root biomass. However, there are a number of cautions and guidelines that should be followed to minimize inaccuracies or situations that are untenable for GPR use. GPR appears to be precise as it routinely predicts highly similar values for a given area across multiple scanning events; however, it appears to lack sufficient accuracy at small scales. Knowledge of soil conditions and their effects on GPR wave propagation and reception are paramount for the collection of useful data. Strong familiarity with the software and equipment is both important and necessary for GPR use in estimating coarse root biomass. GPR must be utilized at low soil moisture levels in order to accurately represent existing coarse root structures. Our results from Disney Wilderness Preserve highlight the need for a strong understanding of the limitations of GPR, specifically knowledge of root structures (saw palmetto rhizomes) or environmental factors (low moisture content) that may hinder its application within a given system. The 3D modeling of course roots with GPR appears quite promising, as it has become more accurate and precise as the software has advanced and become more robust, but there is still a need for more precision before it will likely be able to model anything more than simple root systems comprised mostly of large diameter roots. Our results from Kennedy Space Center suggest that there are legacy effects from CO 2 fertilization in the form of more root mass providing a greater capacity for aboveground plant regrowth following fire, even 7 years after treatment ended.

54 ENVIRONMENTAL SCIENCES↗

Distributed out-of-memory NMF on CPU/GPU architectures

We propose an efficient distributed out-of-memory implementation of the non-negative matrix factorization (NMF) algorithm for heterogeneous high-performance-computing systems. The proposed implementation is based on prior work on NMFk, which can perform automatic model selection and extract latent variables and patterns from data. In this work, we extend NMFk by adding support for dense and sparse matrix operation on multi-node, multi-GPU systems. The resulting algorithm is optimized for out-of-memory problems where the memory required to factorize a given matrix is greater than the available GPU memory. Memory complexity is reduced by batching/tiling strategies, and sparse and dense matrix operations are significantly accelerated with GPU cores (or tensor cores when available). Input/output latency associated with batch copies between host and device is hidden using CUDA streams to overlap data transfers and compute asynchronously, and latency associated with collective communications (both intra-node and inter-node) is reduced using optimized NVIDIA Collective Communication Library (NCCL) based communicators. Benchmark results show significant improvement, from 32X to 76x speedup, with the new implementation using GPUs over the CPU-based NMFk. Good weak scaling was demonstrated on up to 4096 multi-GPU cluster nodes with approximately 25,000 GPUs when decomposing a dense 340 Terabyte-size matrix and an 11 Exabyte-size sparse matrix of density 10 -6 .

97 MATHEMATICS AND COMPUTING↗