Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Thinking Bayesian for plasma physicists

Bayesian statistics offers a powerful technique for plasma physicists to infer knowledge from the heterogeneous data types encountered. To explain this power, a simple example, Gaussian Process Regression, and the application of Bayesian statistics to inverse problems are explained. The likelihood is the key distribution because it contains the data model, or theoretic predictions, of the desired quantities. By using prior knowledge, the distribution of the inferred quantities of interest based on the data given can be inferred. Because it is a distribution of inferred quantities given the data and not a single prediction, uncertainty quantification is a natural consequence of Bayesian statistics. The benefits of machine learning in developing surrogate models for solving inverse problems are discussed, as well as progress in quantitatively understanding the errors that such a model introduces.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Software-Hardware Co-design of Heterogeneous SmartNIC System for Recommendation Models Inference and Training

Deep Learning Recommendation Models (DLRMs) are critical applications in various domains and have evolved as one of the single largest machine learning applications. Trillions of DLRM parameters exceed the on-chip memory capacity of GPUs. Large-scale multi-node systems are required for distributed DLRM inference and training, which suffer from the all-to-all communication bottleneck, mainly limiting the scalability of ever-growing DLRMs. In recent years, SmartNICs have evolved with coupled computation and communication capabilities providing opportunities for a powerful heterogeneous device in the system. However, there isn't such a distributed system that fully leverages the abundant smartNIC resources that resolve the scalability issue of DLRMs. In this work, we proposed a software-hardware co-design of a heterogeneous smartNIC system that resolves the communication bottleneck of distributed DLRMs, mitigates the memory bandwidth pressure, and improves computation efficiency. We provide a set of smartNIC designs of cache systems (including local cache and remote cache) and smartNIC computation kernels which reduce data movement, relieve memory lookup intensity, and improve the GPU's computation efficiency. In addition, we propose a graph algorithm that improves the data locality of queries within batches which optimizes the overall system performance with higher data reuse. Our evaluation shows that our system achieves 2.1x latency speedup for inference and 1.6x throughput speedup for training.

Guo, Anqi↗

The age distribution of global soil carbon inferred from radiocarbon measurements

Soils contain more carbon than the atmosphere and vegetation combined. An increased flow of carbon from the atmosphere into soil pools could help mitigate anthropogenic emissions of carbon dioxide and climate change. Yet we do not know how quickly soils might respond because the age distribution of soil carbon is uncertain. Here we used 789 radiocarbon (Δ 14 C) profiles, along with other geospatial information, to create globally gridded datasets of mineral soil Δ 14 C and mean age. We found that soil depth is a primary driver of Δ 14 C, whereas climate (for example, mean annual temperature) is a major control on the spatial pattern of Δ 14 C in surface soil. Integrated to a depth of 1m, global soil carbon has a mean age of 4,830 ± 1,730 yr, with older carbon in deeper layers and permafrost regions. In contrast, vertically resolved land models simulate Δ 14 C values that imply younger carbon ages and a more rapid carbon turnover. Overall, our data-derived estimates of older mean soil carbon age suggest that soils will accumulate less carbon than predicted by current Earth system models over the twenty-first century. Reconciling these models with the global distribution of soil radiocarbon will require a better representation of the mechanisms that control carbon persistence in soils.

58 GEOSCIENCES↗

Reliable extrapolation of deep neural operators informed by physics or sparse observations

Deep neural operators can learn nonlinear mappings between infinite-dimensional function spaces via deep neural networks. As promising surrogate solvers of partial differential equations (PDEs) for real-time prediction, deep neural operators such as deep operator networks (DeepONets) provide a new simulation paradigm in science and engineering. Pure data-driven neural operators and deep learning models, in general, are usually limited to interpolation scenarios, where new predictions utilize inputs within the support of the training set. However, in the inference stage of real-world applications, the input may lie outside the support, i.e., extrapolation is required, which may result to large errors and unavoidable failure of deep learning models. Here, we address this challenge of extrapolation for deep neural operators. First, we systematically investigate the extrapolation behavior of DeepONets by quantifying the extrapolation complexity, via the 2-Wasserstein distance between two function spaces and propose a new strategy of bias–variance trade-off for extrapolation with respect to model capacity. Subsequently, we develop a complete workflow, including extrapolation determination, and we propose five reliable learning methods that guarantee a safe prediction under extrapolation by requiring additional information—the governing PDEs of the system or sparse new observations. The proposed methods are based on either fine-tuning a pre-trained DeepONet or multifidelity learning. We demonstrate the effectiveness of the proposed framework for various types of parametric PDEs. Furthermore, our systematic comparisons provide practical guidelines for selecting a proper extrapolation method depending on the available information, desired accuracy, and required inference speed.

42 ENGINEERING↗

On the inviscid rolled-up structure of lift generated vortices

A simple form is presented of the relationships for the inviscid, fully developed structure of lift-generated vortices behind aircraft wings. The method is then extended to arbitrary span-load distributions by inferring guidelines for the selection of rollup centers for the vortex sheet, along with rules for calculating the fully developed structure of the resulting multiple vortices. These techniques yield realistic estimates of the rolled-up structure of vortices produced by a wider variety of span-load distributions than possible with the original form of the theory.

Rossow, V. J.↗

An Assessment of the Regional Distribution of the Oxygen-Isotope Ratio in Northeastern Canada

A compilation of mean values of the oxygen-isotope ratio relative to standard mean ocean Water for 22 sites representative of conditions in north-eastern Canada is complemented with data on mean annual surface temperature, latitude, surface elevation, and mean annual shortest distance to open ocean denoted by the 10% sea-ice concentration boundary. Stepwise regression analysis is used to develop a multivariate model suitable to infer the distribution of 6 1"0 in an area of complex topography and possibly mixed source of advected water vapor. The best model is produced by a run in the backward mode at the 95% confidence level in which only temperature, latitude and distance to the open ocean remain in the model (the correlation coefficient is 0.915, the adjusted coefficient of determination is 0.809, the root mean square residual is 1.62). This model is similar to the best 6180 predictive model derived elsewhere for Greenland, suggesting a common principal source of advected moisture.

Giovinetto, Mario B.↗

Remote probing of atmospheric particulates from radiation extinction experiments: A review of methods

The existing methodology for reconstructing the particle size distribution and inferring the refractive index of absorbing and scattering atmospheric particulates is critically reviewed. Emphasis is placed on method capabilities and shortcomings and, wherever possible, on achievable accuracy. The nature of the associated remote probing problem is analyzed with regard to the effects of the particulates on EM wave propagation in the atmosphere. The parameterization of size distribution is studied within the unifying framework of Pearson's distribution curves. The inversions of extinction measurements and their ratios are considered separately, and the potentialities of each type of measurement are identified. Work lacking in each of the methods reviewed is indicated. A method of determining both the effective complex refractive index and size distribution model parameters from the same data is also presented. Lastly, determination from extinction ratio data of the complex refractive index independent of size distribution is discussed and error analyzed.

Fymat, A. L.↗

The nature of cometary dust as determined from infrared observations

The infrared measurements of comets, the compositional information available from interplanetary dust particles (IDPs), and the recent results of flybys to Comet Halley can help in restricting the nature and composition of cometary dust models (c.f., Proceedings of the 20th ESLAB Symposium on Exploration of Halley's Comet, 1986). Researchers tried to incorporate some of these results into a coherent model to account for the observed cometary infrared emission. The presence of 10 and 3.4 micron features in Comet Halley (c.f. Bregman et al. 1987; Wickramasinghe and Allen 1986) indicated the presence of at least two components in the grain material, namely silicates and some form of amorphous carbon. These two components could reside in separate grains or may be parts of composite particles. Both these cases have been considered (see Krishna Swamy el a. 1988a, 1988b). In the absence of refractive index data for cometary analogs, the authors used the optical constants of olivine-rich lunar material 12009.48 (Perry et al. 1972) for the infrared region and that of alpha:C-H film for amorphous carbon (angus et al. 1986). For the visible region, a value of m = 1.38-0.39i was used for the silicates, and values published by Arakawa et al. (1985) were used for the amorphous carbon. These materials should give a representative behavior of the expected results. The model results were compared to observational data. The strength of the 3.4 micron and 10 micron features relative to the adjacent continuum, as well as the slope of the continuum between 2500 and 1250 cm(exp -1) (4 to 8 microns), were used as criteria for comparison. Model calculations with alpha approx. equals -3.5, and also the size distribution function inferred for Comet Halley, with a mass fraction (X) of silicate to amorphous carbon grains of about 40 to 1 can fit the data. A good match is obtained for the infrared spectra of Comets Halley and West from a 40 to 1 mixture of silicate and amorphous carbon grains with a a(exp -3.5) size distribution function. The results are consistent with compositional constraints provided by interplanetary dust particles (IPDs) and Halley flyby data. The variation of grain temperature with heliocentric distance appears to account for the major changes observed in cometary spectra.

Swamy, K. S. Krishna↗

Distribution of Mount St. Helens dust inferred from satellites and meteorological data

Visible and infrared pictures from two Geostationary Operational Environmental Satellite Systems satellites, in circular orbits at about 19,000 nautical miles, are available continuously at approximately 30 minute intervals. Still pictures and film loops from this system vividly depict the events associated with the May 18, 1980 eruption of Mount St. Helens. The initial explosion, shock wave, and visible horizontal dust distribution during the following week are readily apparent. Meteorological wind and height fields permit the inference of the vertical distribution of volcanic dust as well as explain the atmospheric behavior which caused the visible and nonvisible dust distribution.

Laver, J. D.↗

Computation of Jupiter interior models from gravitational inversion theory

Spacecraft measurements of Jupiter have provided the mass, standard pressure level radius, rotation law, internal mass distribution multipole moments, and internal composition and temperature distribution constraints, for the present implementation of a method for deriving planetary interior models that exactly satisfy a set of N gravitational constraints by means of appropriate iteration. The models are not forced to fit the more indirectly derived constraints, which are instead used as conistency checks. In the case of an He mass fraction in the envelope Y of 0.2, the inferred pressure at a mass density of about 0.2 g/cu cm is about a factor of 2 higher than would be indicated by experimental H compression data in the relevant pressure range of 100,000 to one million bar. The inferred pressure distribution is in better agreement with the shock data for a nominal Y value of 0.3 + or - 0.05.

Hubbard, W. B.↗

Mountain-wave drag in the stratosphere and mesosphere inferred from observed winds and a simple mountain-wave parameterization scheme

A daily analysis of mountain-wave propagation through observed, global wind, and temperature fields in January and August is presented. Winds and temperatures are obtained from the daily 18-level NMC Climate Analysis Center. Mountain-wave properties are deduced from a simple, gravity wave parameterization scheme in which the effects of topographic anisotropy (ridge orientation) are explicitly included. Planetary waves in the northern winter stratosphere are found to play an important role in modulating the magnitude and distribution of inferred mountain-wave drag in the middle atmosphere. The Aleutian anticyclone is found to effectively block mountain waves generated over western North America from reaching the mesosphere by inducing local mountain-wave-critical levels in the stratosphere. Stratospheric sudden warmings have a similar effect at all longitudes so that during months with sudden warmings the average inferred drag in the mesosphere is reduced by a factor of 4 to 5 from its normal value. Partly as a consequence of larger planetary-wave filtering in the Northern Hemisphere, inferred mountain-wave drag in the southern winter mesosphere is found to be comparable to that in the northern winter mesosphere. Almost all of the mountain wave drag exerted on the southern middle atmosphere is found to originate over the southern Andes and Antarctic Peninsula.

Bacmeister, Julio T.↗

Qualitative Assessment of the Acoustic Disturbance Environment in the NASA LaRC 20-Inch MACH 6 Wind Tunnel

An experimental investigation was conducted on a 5-degree-half-angle cone with a flare in a conventional Mach 6 wind tunnel to examine the effect of facility noise on boundary layer transition. The effect of tunnel noise was inferred by comparing transition onset locations determined from the present test to that previously obtained in a Mach 6 quiet tunnel. Together, the two sets of experiments are believed to represent the first direct comparison of transition onset between a conventional and a quiet hypersonic wind tunnel using a common test model. In the present conventional hypersonic tunnel experiment, adiabatic wall temperatures were measured and heat transfer distributions were inferred on the cone flare model at zero degree angle of attack over a range of length Reynolds numbers (2 x 10(exp 6) to 10 x 10(exp 6)) which resulted in laminar and turbulent flow. Wall-to-total temperature ratio for the transient heating measurements and the adiabatic wall temperature measurements were 0.69 and 0.86, respectively. The cone flare nosetip radius was varied from 0.0001 to 0.125-inch to examine the effects of bluntness on transition onset. At comparable freestream conditions the transition onset Reynolds number obtained on the cone flare model in the conventional "noisy" tunnel was approximately 25% lower than that measured in the low disturbance tunnel.

Horvath, Thomas J.↗

Mechanisms of Ionospheric Mass Escape

The dependence of ionospheric O+ escape flux on electromagnetic energy flux and electron precipitation into the ionosphere is derived for a hypothetical ambipolar pick-up process, powered the relative motion of plasmas and neutral upper atmosphere, and by electron precipitation, at heights where the ions are magnetized but influenced by photo-ionization, collisions with gas atoms, ambipolar and centrifugal acceleration. Ion pick-up by the convection electric field produces "ring-beam" or toroidal velocity distributions, as inferred from direct plasma measurements, from observations of the associated waves, and from the spectra of incoherent radar echoes. Ring-beams are unstable to plasma wave growth, resulting in rapid relaxation via transverse velocity diffusion, into transversely accelerated ion populations. Ion escape is substantially facilitated by the ambipolar potential, but is only weakly affected by centrifugal acceleration. If, as cited simulations suggest, ion ring beams relax into non-thermal velocity distributions with characteristic speed equal to the local ion-neutral flow speed, a generalized "Jeans escape" calculation shows that the escape flux of ionospheric O+ increases with Poynting flux and with precipitating electron density in rough agreement with observations.

Moore, T. E.↗

Creating Seasonal Climatologies of Aerosol Lidar Ratios Over Ocean Using MODIS AOD Constrained Retrievals and GOCART Model Simulations

The current CALIPSO algorithms assign one lidar ratio (i.e., extinction-to-backscatter ratio; LR) value globally for each of the seven tropospheric aerosol types. In a future data products release, the CALIPSO project aims to improve these algorithms through the development of regional and seasonal LR climatologies. In this work, aerosol LRs are inferred through CALIOP backscatter profiles constrained by collocated aerosol optical depth (AOD) from Aqua Moderate Resolution Imaging Spectroradiometer (MODIS) data. This analysis is subsampled for those profiles that are cloud-free and contain only one CALIOP-classified aerosol type (e.g., marine). The CALIOP profiles are then collocated with aerosol volume fractions obtained through Goddard Chemistry Aerosol Radiation and Transport (GOCART) model simulations. In this poster, we show twelve-year (June 2006-August 2018) mean spatial distributions of inferred aerosol LRs for CALIOP-classified marine aerosols and how they correspond inversely with patterns of GOCART sea salt volume fraction (SSVF). Near land masses, smaller SSVFs and larger LRs are found (due to the influence of over-land aerosols). In the remote ocean regions (likely less impacted by over-land aerosols), larger SSVFs and smaller LRs are found. The developed relationship between the GOCART model SSVFs and MODIS AOD constrained LRs is used to create model-assisted seasonal LR maps. Additionally, we show maps of inferred LRs from constrained retrievals using the CALIPSO Ocean Derived Column Optical Depth (ODCOD) product and comparisons with those from the MODIS analyses. The technique demonstrated here benefits CALIPSO in the near-term, but similar methods can also be applied to the next generation space-based elastic backscatter lidars with collocated passive sensors, such as those of the upcoming NASA Atmosphere Observing System (AOS).

Travis Toth↗

Mapping Aerosol Lidar Ratios Over Ocean for CALIPSO Using Modis AOD-Constrained Retrievals and A Global Aerosol Model

The CALIPSO aerosol algorithms currently assign one lidar ratio value for each of the seven tropospheric aerosol types. In a future data products release, the CALIPSO project aims to improve these algorithms by developing regional and seasonal lidar ratio climatologies. In this study, aerosol lidar ratios are inferred through Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) backscatter profiles constrained by collocated aerosol optical depth from Aqua Moderate Resolution Imaging Spectroradiometer (MODIS) datasets. The analysis is subsampled for only those profiles that are cloud-free and contain one aerosol type (based on CALIOP feature classification). In addition, the CALIOP profiles are collocated with aerosol volume fractions simulated by the Goddard Chemistry Aerosol Radiation and Transport (GOCART) model. In this talk, the twelve-year (2006-2017) mean spatial distributions of inferred aerosol lidar ratios for CALIOP-classified marine aerosols and the corresponding modeled sea salt volume fractions (SSVF) will be shown. Model-assisted climatological lidar ratio maps on a seasonal scale will also be presented, developed from the empirical relationship found between the modeled SSVF and lidar ratios. A comparison with past studies will be provided as well as results of a sensitivity study regarding the variability of retrieved lidar ratios as a function of horizontal averaging resolution. While the majority of this talk will focus on lidar ratios for CALIOP-classified marine aerosols, preliminary results will be shown for other aerosol types over ocean, such as dust and elevated smoke.

Travis Toth↗

Distributed-Memory Sparse Deep Neural Network Inference Using Global Arrays

Partitioned Global Address Space (PGAS) models exhibit tremendous promise in developing efficient and productive distributed-memory parallel applications. They have been used extensively in scientific computations due to conveniently offering a ``shared-memory''-like model and convenient interfaces that separate communication with synchronization. Traditionally, PGAS communication models have been applied to dense/contiguously distributed data, but most modern applications depict varied levels of sparsity. Existing PGAS models require certain adaptations to support distributed sparse computations, since associated computations often require matrix arithmetic, in addition to data movement. The Global Arrays toolkit from Pacific Northwest National Laboratory (PNNL) is one of the earliest PGAS models to combine one-sided data communication and distributed matrix operations and is still used in the popular NWChem quantum chemistry suite. Recently, we have expanded the Global Arrays toolkit to support common sparse operations, like sparse matrix-dense matrix multiplies (SpMM), sparse matrix-sparse matrix multiplication (SpGEMM) and Sampled Dense-Dense Matrix Multiplication (SDDMM). As it turns out, these operations are the bedrock of sparse Deep Learning (DL); sparse deep neural networks and Graph Neural Networks (GNNs) have gained increasing attention recently in achieving speedups on training and inference with reduced memory footprints. Unlike scientific applications in High Performance Computing (HPC), modern (distributed-memory capable) DL toolkits often rely on non-standardized and closed-source vendor software optimizations, creating challenges in software-hardware co-design at scale. Our goal is to support a variety of distributed-memory sparse matrix operations and helper functions in the newly created Sparse Global Arrays (SGA), such that it is possible to build portable and productive Machine Learning scenarios for algorithm/software and hardware codesign purposes. Contemporary data-parallel schemes for training/inference are undergoing a major overhaul since model replication limits scalability and causes resource inefficiencies. As such, we have adopted tensor parallelism in decomposing the model and inputs, to mitigate memory issues. Current implementation is built on top of MPI and uses CPUs to maximize the portability across the platforms.

Distributed computing, machine learning↗

Mapping Aerosol Lidar Ratios Over Ocean Using Constrained Retrievals and A Global Aerosol Model

The current NASA Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) algorithms assign one lidar ratio (i.e., extinction-to-backscatter ratio; LR) value globally for each of the seven tropospheric aerosol types. In a future data products release, the CALIPSO project aims to improve these algorithms through the development of regional and seasonal LR climatologies. In this work, aerosol LRs are inferred through Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) backscatter profiles constrained by collocated aerosol optical depth (AOD) from Aqua Moderate Resolution Imaging Spectroradiometer (MODIS) data. This analysis is subsampled for those profiles that are cloud-free and contain only one CALIOP-classified aerosol type (e.g., marine). The CALIOP profiles are then collocated with aerosol volume fractions obtained through Goddard Chemistry Aerosol Radiation and Transport (GOCART) model simulations. In this presentation, we show that the twelve-year (June 2006-August 2018) mean spatial distributions of inferred aerosol LRs for CALIOP-classified marine aerosols correspond inversely with patterns of GOCART sea salt volume fraction (SSVF). For example, smaller SSVFs (< 65%) and larger LRs (> 55 sr), are found near land masses. This is indicative of the influence of over-land aerosols (e.g., pollution and biomass burning smoke). In the remote oceans (i.e., regions likely less impacted by non-sea salt aerosols), larger SSVFs (> 95%) and smaller LRs (< 25 sr) are found. The developed relationship between the GOCART SSVFs and MODIS AOD constrained LRs (polynomial fit intersect values of ~56 sr for SSVF of 0% and ~21 sr for SSVF of 100%) is used to produce model-assisted climatological LR maps on seasonal scales. Additionally, we show maps of inferred LRs from constrained retrievals using the CALIPSO Ocean Derived Column Optical Depth (ODCOD) product and comparisons with those from the MODIS analyses. The technique demonstrated in this study not only benefits CALIPSO in the near-term, but similar methods can be applied to future spaceborne elastic backscatter lidars with collocated passive sensors, such as those associated with the upcoming NASA Atmosphere Observing System (AOS).

Travis Toth↗

Mapping Aerosol Lidar Ratios Over Ocean using MODIS AOD Constrained Retrievals and GOCART Model Simulations

After 17 years, the NASA Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) mission ceased science operations in August 2023. For the final CALIPSO data products release (Version 5), the CALIPSO project seeks to improve the accuracy of its aerosol extinction by advancing knowledge of aerosol lidar ratios (i.e., extinction-to-backscatter ratios; LRs) for various aerosol types. The current algorithm assigns one LR value globally for each of the seven tropospheric aerosol types. The CALIPSO team aims to improve the retrieval algorithm through the development of regional and seasonal LR climatologies for the same aerosol types. In this study, aerosol LRs are inferred through Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) backscatter profiles constrained by collocated aerosol optical depth (AOD) from Aqua Moderate Resolution Imaging Spectroradiometer (MODIS) data over oceans during daytime. This analysis is subsampled for those profiles that are cloud-free and contain only one CALIOP-classified aerosol type. The CALIOP profiles are then collocated with aerosol volume fractions obtained through Goddard Chemistry Aerosol Radiation and Transport (GOCART) model simulations. This presentation will reveal findings that the 12-year (June 2006-August 2018) mean spatial distributions of inferred aerosol LRs for CALIOP-classified marine and dusty marine aerosols correspond inversely with patterns of GOCART sea salt volume fraction (SSVF). For example, smaller SSVFs (< 65%) and larger LRs (> 55 sr), are found near land masses (Fig. 1). This indicates the influence of advected anthropogenic aerosols (e.g., pollution and biomass burning smoke). In the remote oceans (i.e., regions likely less impacted by non-sea salt aerosols), the SSVFs are larger (> 95%) and the LRs are smaller (< 25 sr) (Fig. 1). A polynomial fit of the MODIS AOD constrained LRs to the corresponding GOCART SSVFs (intersect values of ~58 sr for SSVF of 0% and ~21 sr for SSVF of 100%) is further used to produce model-assisted climatological LR maps on seasonal scales. Additionally, we will show results of a LR validation analysis for which we compare the revised CALIPSO AODs obtained by applying the seasonal/regional constrained LRs against CALIPSO Version 4.51 Ocean Derived Column Optical Depth (ODCOD). While the majority of the presentation will focus on LRs for CALIOP-classified marine and dusty marine aerosols, an overview of LR results will show preliminary results for other aerosol types over ocean, such as dust and elevated smoke. The technique demon-strated in this study highlights the benefits not only to the final planned CALIPSO data release in 2025, but similar methods can be applied to future spaceborne elastic backscatter lidars with collocated passive sensors (e.g., such as those associated with NASA’s proposed Atmosphere Observing System).

Travis D Toth↗