Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “CLOUD COMPUTING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Finding "Models" in Clouds

Internationally recognized Climate Scientist Ruby Leung is a cloud gazer. But rather than looking for shapes, Ruby’s life’s calling is to develop regional atmospheric models to better predict and understand the effects of global climate change at scales relevant to humans and the environment. Ruby’s accomplishments include developing novel methods for modeling mountain clouds and precipitation in climate models, and improving understanding of hydroclimate variability and change. She also has led efforts to develop regional climate modeling capabilities in the Weather Research and Forecasting model that is widely adopted by scientists worldwide. Ruby is part of a team of PNNL researchers studying the impacts of global warming.

54 ENVIRONMENTAL SCIENCES↗

The Implementation of Framework for Improvement by Vertical Enhancement Into Energy Exascale Earth System Model

Abstract The low cloud bias in global climate models (GCMs) remains an unsolved problem. Coarse vertical resolution in GCMs has been suggested to be a significant cause of low cloud bias because planetary boundary layer parameterizations cannot resolve sharp temperature and moisture gradients often found at the top of subtropical stratocumulus layers. This work aims to ameliorate the low cloud problem by implementing a new computational method, the Framework for Improvement by Vertical Enhancement (FIVE), into the Energy Exascale Earth System Model (E3SM). Three physics schemes representing microphysics, radiation, and turbulence as well as vertical advection are interfaced to vertically enhanced physics (VEP), which allows for these processes to be computed on a higher vertical resolution grid compared to the rest of the E3SM model. We demonstrate the better representation of subtropical boundary layer clouds with FIVE while limiting additional computational cost from the increased number of levels. When the vertical resolution approaches the large eddy simulation‐like vertical resolution in VEP, the climatological low cloud amount shows a significant increase of more than 30% in the southeastern Pacific Ocean. Using FIVE to improve the representation of low‐level clouds does not come with any negative side effects associated with the simulation of mid‐ and high‐level cloud and precipitation, that can occur when running the full model at higher vertical resolution.

54 ENVIRONMENTAL SCIENCES↗

A Biosequence-based Approach to Software Characterization

For many applications, it is desirable to have some process for recognizing when software binaries are closely related without relying on them to be identical or have identical segments. Some examples include monitoring utilization of high performance computing centers or service clouds, detecting freeware in licensed code, and enforcing application whitelists. But doing so in a dynamic environment is a nontrivial task because most approaches to software similarity require extensive and time-consuming analysis of a binary, or they fail to recognize executables that are similar but nonidentical. Presented herein is a novel biosequence-based method for quantifying similarity of executable binaries. Using this method, it is shown in an example application on large-scale multi-author codes that 1) the biosequence-based method has a statistical performance in recognizing and distinguishing between a collection of real-world high performance computing applications better than 90% of ideal; and 2) an example of using family tree analysis to tune identification for a code subfamily can achieve better than 99% of ideal performance.

cyber security↗

ATLAS Data Analysis using a Parallel Workflow on Distributed Cloud-based Services with GPUs

A new type of parallel workflow is developed for the ATLAS experiment at the Large Hadron Collider, that makes use of distributed computing combined with a cloud-based infrastructure. This has been developed for a specific type of analysis using ATLAS data, one popularly referred to as Simulation-Based Inference (SBI). The JAX library is used for the parts of the workflow to compute gradients as well as accelerate program execution using just-in-time compilation, which becomes essential in a full SBI analysis and can also offer significant speed-ups in more traditional types of analysis.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Observational-numerical Study of Maritime Extratropical Cyclones Using FGGE Data

The accomplishments, current research, and future plans of a study investigating the development, maturation, and decay of maritime extratropical cyclones are reported. Three cases of explosive cyclogenesis during the first GARP global experiment (FGGE) DOP-1 were studied diagnostically using storm-following budgets derived from the ECMWF and GLAS level III-b analyses. Mass, vorticity and angular momentum budgets for the moving storm environment were computed for each case. Key results from these studies include: (1) demonstration that the FGGE analyses can be used to explore oceanic circulations; (2) isolation of the role of upper level jet streaks in the initiation of the explosive period in all three cases; and (3) illustration of the lower tropospheric destabilization during each rapid deepening period, which is primarily due to sensible heating of the cold air by the warmer ocean surface. The physics package of the Navy global forecast model was successfully utilized in a semi-prognostic mode to estimate diabatic components of oceanic cyclone systems. Fields of sensible and latent heat fluxes, radiational heating and inferred cloud structures were also computed.

Wash, C. H.↗

Accuracy of Vaisala RS41 and RS92 Upper Tropospheric Humidity Compared to Satellite Hyperspectral Infrared Measurements

Radiosondes are important for calibrating satellite sensors and assessing sounding retrievals. Vaisala RS41 radiosondes have mostly replaced RS92 in the Global Climate Observing System (GCOS) Reference Upper Air Network (GRUAN) and the conventional network. This study assesses RS41 and RS92 upper tropospheric humidity (UTH) accuracy by comparing with Infrared Atmospheric Sounding Interferometer (IASI) upper tropospheric water vapor absorption spectrum measurements. Using single RS41 and RS92 soundings at three GRUAN and DOE Atmospheric Radiation Measurement (ARM) sites and dual RS92/RS41 launches at three additional GRUAN sites, collocated with cloud-free IASI radiances (OBS), we compute Line-by-Line Radiative Transfer Model radiances for radiosonde profiles (CAL). We analyze OBS-CAL differences from 2015 to 2020, for daytime, nighttime, and dusk/dawn separately if data is available, for standard (STD) RS92 and RS41 processing, and RS92 GRUAN Data Processing (GDP; RS41 GDP is in development). We find that daytime RS41 (even without GDP) has ~1% smaller UTH errors than GDP RS92. RS41 may still have a dry bias of 1–1.5% for both daytime and nighttime, and a similar error for nighttime RS92 GDP, while standard RS92 may have a dry bias of 3–4%. These sonde humidity biases are probably upper limits since “cloud-free” scenes could still be cloud contaminated. Radiances computed from European Centre for Medium-Range Weather Forecasts (ECMWF) analyses match better than radiosondes with IASI measurements, perhaps because ECMWF assimilates IASI measurements. Relative differences between RS41 STD and RS92 GDP, or between radiosondes and ECMWF humidity profiles obtained from the radiance analysis, are consistent with their differences obtained directly from the RH measurements.

54 ENVIRONMENTAL SCIENCES↗

Global Energy and Water Exchanges Program Surface Radiation Budget Release 4 Integrated Product: Algorithm Theoretical Basis Document

This document represents the Algorithm Theoretical Basis Document (ATBD) describing the NASA Langley Research Center's Surface Radiation budget (SRB) developed in collaboration with the World Research Climate Programme's Global Energy and Water Exchanges Program. The top of atmosphere and surface fluxes span from July 1, 1983 through June 30, 2017. The shortwave or solar wavelengths span the entire record. The thermal infrared or longwave fluxes span globally from January 1, 1988 to December 30, 2009. Before 1988, only the land-only fluxes are available. After 2009 only the ocean fluxes are available. This document describes all the inputs and radiative transfer algorithms used to generate the TOA and surface radiative fluxes. The fluxes include upward and downward, all-sky, clear-sky and pristine sky conditions. Surface net fluxes and cloud radiative effect are computed and presented as part of the analysis. Comparisons to other data products are made to assess the top-of-atmosphere and surface fluxes. Additionally, surface measurements are utilized to validation the surface fluxes. The surface validation analysis shows the the radiative fluxes are improved compared to the previous version. Data set cautions are also presented.

surface radiation budget↗

Portability for GPU-accelerated molecular docking applications for cloud and HPC: can portable compiler directives provide performance across all platforms?

High-throughput structure-based screening of drug-like molecules has become a common tool in biomedical research. Recently, acceleration with graphics processing units (GPUs) has provided a large performance boost for molecular docking programs. Both cloud and high-performance computing (HPC) resources have been used for large screens with molecular docking programs; while NVIDIA GPUs have dominated cloud and HPC resources, new vendors such as AMD and Intel are now entering the field, creating the problem of software portability across different GPUs. Ideally, software productivity could be maximized with portable programming models that are able to maintain high performance across architectures. While in many cases compiler directives have been used as an easy way to offload parallel regions of a CPU-based program to a GPU accelerator, they may also be an attractive programming model for providing portability across different GPU vendors, in which case the porting process may proceed in the reverse direction: from low-level, architecture-specific code to higher-level directive-based abstractions. MiniMDock is a new mini-application (miniapp) designed to capture the essential computational kernels found in molecular docking calculations, such as are used in phar-maceutical drug discovery efforts, in order to test different solutions for porting across GPU architectures. Here we extend MiniMDock to GPU offloading with OpenMP directives, and compare to performance of kernels using CUDA and HIP on NVIDIA and AMD GPUs, respectively, as well as across different compilers, exploring performance bottlenecks. We document this reverse-porting process, from highly optimized device code to a higher-level version using directives, compare code structure, and describe barriers that were overcome in this effort.

Thavappiragasam, Mathialakan↗

Mesoscale Organization in Cumulus-Coupled Stratocumulus

Marine cloud systems cover a substantial portion of the world’s oceans. Most of these clouds form relatively close to the ocean surface, typically within one to two kilometers, a region referred to by meteorologists as the marine boundary layer. They are composed predominantly of liquid water, although ice particles can occur in mid- and high-latitude marine clouds during winter. In satellite imagery, these clouds appear bright against the darker ocean surface below, reflecting a large fraction of incoming sunlight back into space that would otherwise warm the ocean. Because marine boundary layer clouds cover such an extensive area of the ocean, they exert a significant influence on Earth’s overall transfer of solar energy absorbed by the surface and thermal energy emitted to space, a balance known as the planetary radiation budget. Marine boundary layer clouds are typically thin, and their formation and dissipation depend on a delicate balance between processes acting at the ocean surface below and the warm, dry air above. They are notoriously difficult to simulate accurately in weather forecast models, which often produce too few marine low clouds in midlatitudes and clouds in tropical regions that are excessively bright, meaning they reflect too much solar radiation. The marine boundary layer is frequently characterized by widespread overcast cloud cover that often transitions from a continuous, single-layer deck to more broken cloud fields toward the tropics. These transitions typically proceed through an intermediate stage in which shallow, broken clouds form beneath the overlying stratiform cloud deck. Once broken clouds develop below the overcast, they frequently self-organize into cloud clusters known as marine boundary layer convective complexes (MBLCCs), although the mechanisms governing the formation and organization of MBLCCs remain poorly understood. Accurately representing these transitions in long-range weather forecast models is essential because they influence the properties of air masses advected over the continental United States and Europe, and they become increasingly important for forecasts on seasonal and longer timescales. We employed two complementary approaches to investigate the processes controlling MBLCCs and their impact on marine cloud cover. Long-term observations from the U.S. Department of Energy’s Eastern North Atlantic (ENA) Observatory provided a unique dataset that allowed us to characterize fundamental properties of MBLCCs, including their typical size and frequency of occurrence. These observations were combined with high-resolution numerical simulations performed on supercomputers to examine the evolution of MBLCCs during cold-air outbreaks over the ENA region.

54 ENVIRONMENTAL SCIENCES↗

Comparison of Three Multicylinder Icing Meters and Critique of Multicylinder Method

Three multicylinder cloud meters, fundamentally similar but differing in important details, were compared in use at the Mount Washington Observatory. Determinations of liquid water content were found to agree within the limits of the probable error, but the two instruments designed by the National Advisory Committee for Aeronautics indicated larger drop sizes than did the Observatory's instrument, apparently because of spurious ice catch on the rather rough surface of the larger cylinders. Comparisons of drop-size distribution were largely indeterminate., In a critique of the method, the probable error of determination of liquid water content was found to be +/-8 percent; of drop size, +/-6 percent; and of drop-size distribution, about +/-0.7 unit of the modulus of distribution. Of the systematic errors, run-off of unfrozen water is most important, blow-off and erosion seldom being hampering. Revision of collection-efficiency computations for cylinders in clouds with distributed drop sizes was found necessary and also revision of one of the correction-factor graphs heretofore used. The assumption of constant ice density in deriving cylinder size was found to be permissible for cylinders 1 inch or more in diameter.

Howell, Wallace E.↗

The spectral correlation of functional clouds: a statistical test for theoretical models

We compute the spectral correlation function (SCF) of CO J=1-0 maps of moleculary cloud complexes. The SCF is a power law over approximately an order of magnitude in spatial separation in every map. The power law slope of the SCF, its normalization, and the spectral line width averaged over the whole map, are computed for all the observational maps.

turbulence kinematics↗

The Martian polar cap - Radiative effects of ozone, clouds, and airborne dust

The solar and thermal flux striking the polar cap of Mars is computed for various ozone, dust, and cloud abundances and for three solar zenith angles. Ozone does not significantly affect the total energy budget of the polar cap. Hence the observed hemispherical asymmetry in ozone abundance causes only an insignificant hemispherical asymmetry in the polar caps. Vertical optical depths of dust and cloud ranging from zero to 1 cause little change in the total flux absorbed by the polar cap near its edge but increase the absorbed flux significantly as one travels poleward. Hemispherical asymmetries in dust abundance, cloud cover, and surface pressure combine to cause a significant hemispherical asymmetry in the total flux absorbed by the residual polar caps, which helps to explain the dichotomy in the residual polar caps on Mars. Other processes which affect the energy budget of the polar cap are proposed and reviewed, particularly with respect to their interaction with the radiative effects of clouds and dust.

Lindner, Bernhard Lee↗

A Multi-Scale Modeling System with Unified Physics

Numerical cloud models, which are based the non-hydrostatic equations of motion, have been extensively applied to cloud-scale and mesoscale processes during the past four decades. Because cloud-scale dynamics are treated explicitly, uncertainties stemming from convection that have to be parameterized in (hydrostatic) large-scale models are obviated, or at least mitigated, in cloud models. Global models will use the non-hydrostatic framework when their horizontal resolution becomes about 10 km, the theoretical limit for the hydrostatic approximation. This juncture will be reached one to two decades from now. In recent years, exponentially increasing computer power has extended cloud-resolving-mode1 integrations from hours to months, the number of computational grid points from less than a thousand to close to ten million. Three-dimensional models are now more prevalent. Much attention is devoted to precipitating cloud systems where the crucial 1-km scales are resolved in horizontal domains as large as 10,000 km in two-dimensions, and 1,000 x 1,000 km2 in three-dimensions. Cloud resolving models now provide statistical information useful for developing more realistic physically based parameterizations for climate models and numerical weather prediction models. It is also expected that NWP and mesoscale model can be run in grid size similar to cloud resolving model through nesting technique.

Tao, Wei-Kuo↗

Description of the Three-Dimensional Large-Scale Forcing Data from the 3D Constrained Variational Analysis (VARANAL3D)

This technical report introduces a Three-Dimensional Constrained Variational Analysis (3DCVA) (Tang and Zhang 2015) and its product of three-dimensional large-scale forcing data to drive single-column models (SCM), cloud-resolving models (CRM), and large-eddy simulation (LES) models, and to evaluate model results. The 3DCVA algorithm is an extension of the original 1D constrained variational analysis (1DCVA) (Zhang and Lin 1997, Zhang et al. 2001). The three-dimensional structure of the forcing data allows studies of spatial variation of the large-scale forcing fields and tests of physical parameterizations across scales. In the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility, the 3D forcing data are assigned the datastream name varanal3d. In this technical report, 3DCVA will be used to refer to the algorithm, while VARANAL3D will be used to refer to the data product.

54 ENVIRONMENTAL SCIENCES↗

Learning Canonical Embeddings for Unsupervised Shape Correspondence With Locally Linear Transformations

We present a new approach to unsupervised shape correspondence learning between pairs of point clouds. We make the first attempt to adapt the classical locally linear embedding algorithm (LLE)-originally designed for nonlinear dimensionality reduction-for shape correspondence. The key idea is to find dense correspondences between shapes by first obtaining high-dimensional neighborhood-preserving embeddings of low-dimensional point clouds and subsequently aligning the source and target embeddings using locally linear transformations. We demonstrate that learning the embedding using a new LLE-inspired point cloud reconstruction objective results in accurate shape correspondences. More specifically, the approach comprises an end-to-end learnable framework of extracting high-dimensional neighborhood-preserving embeddings, estimating locally linear transformations in the embedding space, and reconstructing shapes via divergence measure-based alignment of probability density functions built over reconstructed and target shapes. Our approach enforces embeddings of shapes in correspondence to lie in the same universal/canonical embedding space, which eventually helps regularize the learning process and leads to a simple nearest neighbors approach between shape embeddings for finding reliable correspondences. Comprehensive experiments show that the new method makes noticeable improvements over state-of-the-art approaches on standard shape correspondence benchmark datasets covering both human and nonhuman shapes.

deformation↗

Cloudiness transitions within shallow marine clouds near the Azores. Final report

The investigator and DOE-supported student [1] retrieved vertical air velocity and microphysical fall velocity retrieval for VOCALS and CAP-MBL homogeneous clouds. [2] Calculated in-cloud and cloud top dissipation calculation and diurnal cycle computed for VOCALS. [3] Compared CAP-MBL Doppler cloud radar scenes with (Remillard et al. 2012) automated classification.

58 GEOSCIENCES↗

Moving small files in a networked environment

Globally distributed computing infrastructures, such as clouds and supercomputers, are currently used to manage data that is generated with an unprecedented speed from a variety of resources. Coping with this trend, the volume of data exchanged across distant sites increases substantially. To accelerate data transfer, high-speed networks are provided to connect remote sites. Most existing data movement solutions are optimized for moving large files. However, it is still challenging to transfer a large number of small files across networks. This disadvantage not only lowers data transfer performance, but also decreases overall system utilization. Here, we identify that moving small files is mainly constrained by degraded file system throughput, not just network performance as might be suspected. We have built a data transfer pipeline model to analyze the impact of small network I/O and storage I/O on data movement. Extending one of the widely used open source data movement solutions, GridFTP, we demonstrate several appropriate engineering approaches that mitigate the bottleneck and increase data transfer efficiency. We show optimizations that improve data transfer performance more than 5 times. In comparison to existing solutions, our approaches can save a significant amount of system resources for moving lots of small files.

97 MATHEMATICS AND COMPUTING↗

Description of the ARM Large-Scale Forcing Data from the Constrained Variational Analysis (VARANAL) Version 2

This technical report represents an update of the previous technical report written by Zhang et al. (2001a) (available at http://www.arm.gov/publications/tech_reports/arm-tr-005.pdf), which described the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility constrained variational analysis (VARANAL) that is used to develop the large-scale forcing data for driving single-column models (SCMs), cloud-resolving models (CRMs), and large-eddy simulation models (LES). The VARANAL algorithm was originally developed by Zhang and Lin (1997) and Zhang et al. (2001b) at Stony Brook University and was migrated to the Lawrence Livermore National Laboratory (LLNL) as the ARM operational objective analysis system in May 1999. Since then, the algorithm has been evolved with time along with the availability of new observations and techniques to meet various modeling needs. Major updates include: (1) The method used to develop multi-year continuous forcing data (Xie et al. 2004), (2) The incorporation of eddy correlation flux measurement system (ECOR) turbulent fluxes into the analysis (Tang et al. 2019), and (3) Improvements to the workflow (e.g., implementing part of the code into the ARM Data Integrator [ADI]) to increase efficiency. The ARM large-scale forcing data have been widely used for SCM/CRM/LES to understand and improve physical processes in models. Zhang et al. (2016) has provided a comprehensive review of the SCM concept, early efforts to derive forcing data for SCM studies, efforts of the ARM constrained variational analysis, and previous SCM studies using ARM cases. This technical report focuses on the constrained variational analysis algorithm and the introduction of the ARM VARANAL products.

58 GEOSCIENCES↗