Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “CLOUD COMPUTING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

North Atlantic Aerosol Radiative Effects Based on Satellite Measurements and Aerosol Intensive Properties from TARFOX and ACE-2

We estimate the impact of North Atlantic aerosols on the net shortwave flux at the tropopause by combining maps of satellite-derived aerosol optical depth (AOD) with model aerosol properties. We exclude African dust, primarily by restricting latitudes to 25-60 N. Aerosol properties were determined via column closure analyses in two recent experiments, TARFOX and ACE 2. The analyses use in situ measurements of aerosol composition and air- and ship-borne sunphotometer measurements of AOD spectra. The resulting aerosol model yields computed flux sensitivities (dFlux/dAOD) that agree with measurements by airborne flux radiometers in TARFOX. It has a midvisible single-scattering albedo of 0.9, which is in the range obtained from in situ measurements of aerosol scattering and absorption in both TARFOX and ACE 2. Combining seasonal maps of AVHRR-derived midvisible AOD with the aerosol model yields maps of 24-hour average net radiative flux changes at the tropopause. For cloud-free conditions, results range from -9 W/sq m near the eastern US coastline in the summer to -1 W/sq m in the mid-Atlantic during winter; the regional annual average is -3.5 W/sq m. Using a non- absorbing aerosol model increases these values by about 30%. We estimate the effect of clouds using ISCCP cloud-fraction maps. Because ISCCP midlatitude North Atlantic cloud fractions are relatively large, they greatly reduce the computed aerosol-induced flux changes. For example, the regional annual average decreases from -3.5 W/sq m to -0.8 W/sq m. We compare results to previous model calculations for a variety of aerosol types.

Bergstrom, Robert W.↗

Surface Irradiances of Edition 4.0 Clouds and the Earth's Radiant Energy System (CERES) Energy Balanced and Filled (EBAF) Data Product

The algorithm to produce the Clouds and the Earth’s Radiant Energy System (CERES) Edition 4.0 (Ed4) Energy Balanced and Filled (EBAF)-surface data product is explained. The algorithm forces computed topof- atmosphere (TOA) irradiances to match with Ed4 EBAF-TOA irradiances by adjusting surface, cloud, and atmospheric properties. Surface irradiances are subsequently adjusted using radiative kernels. The adjustment process is composed of two parts: bias correction and Lagrange multiplier. The bias in temperature and specific humidity between 200 and 500 hPa used for the irradiance computation is corrected based on observations by Atmospheric Infrared Sounder (AIRS). Similarly, the bias in the cloud fraction is corrected based on observations by Cloud–Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) and CloudSat. Remaining errors in surface, cloud, and atmospheric properties are corrected in the Lagrange multiplier process. Ed4 global annual mean (January 2005 through December 2014) surface net shortwave (SW) and longwave (LW) irradiances increase by 1.3Wm22 and decrease by 0.2Wm22, respectively, compared to EBAF Edition 2.8 (Ed2.8) counterparts (the previous version), resulting in an increase in net SW 1LWsurface irradiance of 1.1Wm22. The uncertainty in surface irradiances over ocean, land, and polar regions at various spatial scales are estimated. The uncertainties in all-sky global annual mean upward and downward shortwave irradiance are 3 and 4Wm22, respectively, and the uncertainties in upward and downward longwave irradiance are 3 and 6Wm22, respectively. With an assumption of all errors being independent, the uncertainty in the global annual mean surface LW 1 SW net irradiance is 8Wm22.

Kato, Seiji↗

Dependable classical-quantum computing systems engineering

Increasing evidence suggests quantum computing (QC) complements traditional High-Performance Computing (HPC) by leveraging its unique capabilities, leading to the emergence of a new, hybrid paradigm, QHPC. However, this integration introduces new challenges, with dependability–defined by reproducibility, resiliency, and security and privacy–emerging as a central concern for building trustworthy systems that provide an advantage to the users. This paper proposes a framework for dependable QHPC system design, organized around these three pillars. We identify integration challenges, anticipate roadblocks, and highlight productive synergies across QC, HPC, cloud platforms, and network security. Drawing from both classical computing principles and quantum-specific insights, we present a roadmap for co-design that supports robust hybrid architectures. Our approach offers concrete metrics for assessing dependability, provides design guidance for engineers working at the QC-HPC interface, and surfaces new engineering questions around complexity, scale, and fault tolerance. Ultimately, designing for dependability is key to realizing practical, scalable QHPC systems and accelerating the broader quantum ecosystem capable of translating quantum promises into actual application delivery.

HPC↗

Monte Carlo Calculations of Polarized Microwave Radiation Emerging from Cloud Structures

The last decade has seen tremendous growth in cloud dynamical and microphysical models that are able to simulate storms and storm systems with very high spatial resolution, typically of the order of a few kilometers. The fairly realistic distributions of cloud and hydrometeor properties that these models generate has in turn led to a renewed interest in the three-dimensional microwave radiative transfer modeling needed to understand the effect of cloud and rainfall inhomogeneities upon microwave observations. Monte Carlo methods, and particularly backwards Monte Carlo methods have shown themselves to be very desirable due to the quick convergence of the solutions. Unfortunately, backwards Monte Carlo methods are not well suited to treat polarized radiation. This study reviews the existing Monte Carlo methods and presents a new polarized Monte Carlo radiative transfer code. The code is based on a forward scheme but uses aliasing techniques to keep the computational requirements equivalent to the backwards solution. Radiative transfer computations have been performed using a microphysical-dynamical cloud model and the results are presented together with the algorithm description.

Kummerow, Christian↗

Modelling of IR emission of interstellar clouds. I - Emission of isolated clouds and dust abundance variations

A model for the IR emission and extinction properties of small dust particles is used here to compute the IR emissions in the IRAS photometric bands for a set of isolated, spherical, and nonhomogeneous clouds heated by the local interstellar radiation field. It is predicted that the IR limb brightening (LB) in the IRAS photometric bands caused by selective absorption of UV photons of different energies in the cloud generally happens for central extinctions over 4 mag at 12 microns and greater than 10 mag at 100 microns and intermediate extinctions for the other IRAS bands. The surface brightness in the four IRAS bands is limited to about 0.4, 0.6, 3, and 10 MJy/sr at 12, 25, 60, and 100 microns respectively when no strong density discontinuity is present at the cloud edge.

Bernard, J. P.↗

ProvLight: Efficient Workflow Provenance Capture on the Edge-to-Cloud Continuum

Modern scientific workflows require hybrid infrastructures combining numerous decentralized resources on the IoT/Edge interconnected to Cloud/HPC systems (aka the Computing Continuum) to enable their optimized execution. Understanding and optimizing the performance of such complex Edge-to-Cloud workflows is challenging. Capturing the provenance of key performance indicators, with their related data and processes, may assist in understanding and optimizing workflow executions. However, the capture overhead can be prohibitive, particularly in resource-constrained devices, such as the ones on the IoT/Edge.To address this challenge, based on a performance analysis of existing systems, we propose ProvLight, a tool to enable efficient provenance capture on the IoT/Edge. We leverage simplified data models, data compression and grouping, and lightweight transmission protocols to reduce overheads. We further integrate ProvLight into the E2Clab framework to enable workflow provenance capture across the Edge-to-Cloud Continuum. This integration makes E2Clab a promising platform for the performance optimization of applications through reproducible experiments.We validate ProvLight at a large scale with synthetic workloads on 64 real-life IoT/Edge devices in the FIT IoT LAB testbed. Evaluations show that ProvLight outperforms state-of-the-art systems like ProvLake and DfAnalyzer in resource-constrained devices. ProvLight is 26—37x faster to capture and transmit provenance data; uses 5—7x less CPU; 2x less memory; transmits 2x less data; and consumes 2—2.5x less energy. ProvLight [1] and E2Clab [2] are available as open-source tools.

Rosendo, Daniel↗

Scattering Properties and Brightness Temperatures Associated with Solid Precipitation

In the past few years, early solid precipitation detection and retrieval algorithms have been developed and shown to be applicable for snowing clouds and blizzards. NOAA has an operational snow versus rain classifier based on AMSU-B observations. Solid precipitation retrieval algorithms reported in the literature over the past two years include those that rely on neural nets, statistics, or physical relationships. All of the algorithms require the use of millimeter-wave radiometer observations. The millimeter-wave frequencies are especially sensitive to the scattering and emission properties of frozen particles due to the ice particle refractive index. Passive radiometric channels respond to both the integrated particle mass throughout the volume and field of view, and to the amount, location, and size distribution of the frozen (and liquid) particles with the sensitivity varying for different frequencies and hydrometeor types. This investigation probes the sensitivity of scattering and absorption coefficients, and hence computed brightness temperatures, resulting from variations in solid precipitation cloud profiles. The first study compares the single scattering, absorption, and asymmetry parameters associated with snow particles in clouds. Several methodologies are used to convert the physical characteristics (e.g., shape, size distributions, ice-air-water ratios) of ice particles to electromagnetic properties (e.g., absorption, scattering, and asymmetry factors). These methodologies include: conversion to solid ice particles, homogeneous dielectric mixing, or discrete dipole approximation. Changes in the conversion methodology can produce computed brightness temperature differences greater than 50 Kelvin.

Skofronick-Jackson, Gail M.↗

Quantum computation of silicon electronic band structure

Development of quantum architectures during the last decade has inspired hybrid classical–quantum algorithms in physics and quantum chemistry that promise simulations of fermionic systems beyond the capability of modern classical computers, even before the era of quantum computing fully arrives. Strong research efforts have been recently made to obtain minimal depth quantum circuits which could accurately represent chemical systems. Here, we show that unprecedented methods used in quantum chemistry, designed to simulate molecules on quantum processors, can be extended to calculate properties of periodic solids. In particular, we present minimal depth circuits implementing the variational quantum eigensolver algorithm and successfully use it to compute the band structure of silicon on a quantum machine for the first time. We are convinced that the presented quantum experiments performed on cloud-based platforms will stimulate more intense studies towards scalable electronic structure computation of advanced quantum materials.

36 MATERIALS SCIENCE↗

Clouds and Earth Radiant Energy System (CERES), a Review: Past, Present and Future

The Clouds and Earth Radiant Energy System (CERES) project s objectives are to measure the reflected solar radiance (shortwave) and Earth-emitted (longwave) radiances and from these measurements to compute the shortwave and longwave radiation fluxes at the top of the atmosphere (TOA) and the surface and radiation divergence within the atmosphere. The fluxes at TOA are to be retrieved to an accuracy of 2%. Improved bidirectional reflectance distribution functions (BRDFs) have been developed to compute the fluxes at TOA from the measured radiances with errors reduced from ERBE by a factor of two or more. Instruments aboard the Terra and Aqua spacecraft provide sampling at four local times. In order to further reduce temporal sampling errors, data are used from the geostationary meteorological satellites to account for changes of scenes between observations by the CERES radiometers. A validation protocol including in-flight calibrations and comparisons of measurements has reduced the instrument errors to less than 1%. The data are processed through three editions. The first edition provides a timely flow of data to investigators and the third edition provides data products as accurate as possible with resources available. A suite of cloud properties retrieved from the MODerate-resolution Imaging Spectroradiometer (MODIS) by the CERES team is used to identify the cloud properties for each pixel in order to select the BRDF for each pixel so as to compute radiation fluxes from radiances. Also, the cloud information is used to compute radiation at the surface and through the atmosphere and to facilitate study of the relationship between clouds and the radiation budget. The data products from CERES include, in addition to the reflected solar radiation and Earth emitted radiation fluxes at TOA, the upward and downward shortwave and longwave radiation fluxes at the surface and at various levels in the atmosphere. Also at the surface the photosynthetically active radiation and ultraviolet radiation (total, UVA and UVB) are computed. The CERES instruments aboard the Terra and Aqua spacecraft have served well past their design life times. A CERES instrument has been integrated onto the NPP platform and is ready for launch in 2011. Another CERES instrument is being built for launch in 2014, and plans are being made for a series of follow-on missions.

Smith, G. L.↗

Automated Tracking of Shallow Maritime Clouds on Geostationary Imagery to Extract Lifecycle Characteristics

Shallow moist convection is ubiquitous throughout the tropics and represents a key player in boundary layer processes. Satellites have provided many statistics on shallow clouds, such as size, structure, and geographical coverage, from static views of recurring cloud fields. But determining why certain cloud features appear and persist for different periods requires a time-evolving view of their behaviors. Geostationary satellites provide a unique opportunity to follow the time evolution of individual convective features, given their enhanced spatial and temporal sampling. A cloud-tracking tool was developed to identify properties of cloud lifecycle from the NASA Cloud, Aerosol, and Monsoon Processes Philippines Experiment (CAMP2EX) field campaign of 2019. The mission conducted intensive sampling of shallow cumulus in the West Pacific Ocean, in tandem with Rapid Scan imagery from the Advanced Himawari Imager (AHI) on the Japan Meteorological Agency’s (JMA) Himawari-8 satellite. Shallow cumulus was segmented according to thresholds in 0.5-km visible reflectance and with blurring techniques. Despite being limited to daytime hours, the segmentations yielded the best resolution possible for capturing cloud initiation and decay. The tracking procedure is based on a computer vision package that includes Kalman filters for motion prediction, object overlap search, and the Hungarian (or Kuhn-Munkres) matching algorithm for track designation. AHI radiances available within the tracked cloud boundaries are assembled to form individual spectral histories. The resulting catalog provides thousands of cloud histories for domains measuring only a few degrees in latitude and longitude. We present an overview of the cloud-tracking tool, strategies to identify development stages from cloud tracks, and preliminary results that document cumulus lifecycle properties from satellite. The application of AHI 0.5-km reflectance has both strengths and limitations when attempting to track lifecycles of the smallest resolvable clouds. We show that by aggregating cloud tracks from a few case studies of CAMP2EX, we can discern differences in cloud lifetime and development according to ensembles selected from areas of interest. The results demonstrate an ability to quantify lifetimes and assess rates of change in cloud characteristics that are likely controlled by the surrounding environment and meteorology.

Cloud Tracking↗

3D Cloud Masking Across A Broad Swath Using Multi-Angle Polarimetry and Deep Learning

Understanding the 3-dimensional structure of clouds is of crucial importance to modeling our changing climate. Active sensors, such as radar and lidar, provide accurate vertical cloud profiles, but are mostly restricted to along-track sampling. Passive sensors can capture a wide swath, but struggle to see beneath cloud tops. In essence, both types of products are restricted to two dimensions: as a cross-section in the active case, and an image in the passive case. However, multi-angle sensor configurations contain implicit information about 3D structure, due to parallax and atmospheric path differences. Extracting that implicit information can be challenging, requiring computationally expensive radiative transfer techniques. Machine learning, as an alternative, may be able to capture some of the complexity of a full 3D radiative transfer solution with significantly less computational expense. In this work, we make three contributions towards understanding 3D cloud structure from multi-angle polarimetry. First, we introduce a large-scale, publicly available dataset that fuses existing cloud products into a format more amenable to machine learning. This dataset treats multi-angle polarimetry as an input, and radar-based vertical cloud profiles as an output. Second, we describe and evaluate strong baseline machine learning models based that predict these profiles from the passive imagery. Notably, these models are trained only on center-swath labels, but can predict cloud profiles over the entire passive imagery swath. Third, we leverage the information-theoretic nature of machine learning to draw conclusions about the relative utility of various sensor configurations, including spectral channels, viewing angles, and polarimetry. These findings have implications for Earth-observing missions such as NASA’s Plankton, Aerosol, Cloud-ocean Ecosystem (PACE) and Atmosphere Observing System (AOS) missions, as well as in informing future applications of computer vision to atmospheric remote sensing.

clouds↗

Workflows Community Summit 2022: A Roadmap Revolution

Scientific workflows have become integral tools in broad scientific computing use cases. Science discovery is increasingly dependent on workflows to orchestrate large and complex scientific experiments that range from the execution of a cloud-based data preprocessing pipeline to multi-facility instrument-to-edge-to-HPC computational workflows. Given the changing landscape of scientific computing (often referred to as a computing continuum) and the evolving needs of emerging scientific applications, it is paramount that the development of novel scientific workflows and system functionalities seek to increase the efficiency, resilience, and pervasiveness of existing systems and applications. Specifically, the proliferation of machine learning/artificial intelligence (ML/AI) workflows, need for processing large-scale datasets produced by instruments at the edge, intensification of near real-time data processing, support for long-term experiment campaigns, and emergence of quantum computing as an adjunct to HPC, have significantly changed the functional and operational requirements of workflow systems. Workflow systems now need to, for example, support data streams from the edge-to-cloud-to-HPC, enable the management of many small-sized files, allow data reduction while ensuring high accuracy, orchestrate distributed services (workflows, instruments, data movement, provenance, publication, etc.) across computing and user facilities, among others. Further, to accelerate science, it is also necessary that these systems implement specifications/standards and APIs for seamless (horizontal and vertical) integration between systems and applications, as well as enable the publication of workflows and their associated products according to the FAIR principles.

97 MATHEMATICS AND COMPUTING↗

Criteria for fragmentation in a collapsing rotating cloud

The isothermal collapse of a rotating protostar with pressure and self-gravity is calculated by a hydrodynamic computer code that treats three space dimensions. A number of initial conditions are tested to determine the conditions under which a cloud is unstable to fragmentation. It is shown that fragmentation does not proceed to a significant extent during the first free-fall time, but that in most cases fragmentation has occurred by 1.5 to 2 times the initial free-fall time. The extent to which the density in the fragments is enhanced over that in their surroundings on this time scale depends on the initial ratio of thermal to gravitational energy, but is only weakly dependent on the type and amplitude of the perturbation and on the initial rotational energy.

Bodenheimer, P.↗

A Principal Component-Based Radiative Transfer Forward Model (PCRTM) for Vertically in Homogeneous Cloud

A principal-component based radiative transfer model (PCRTM) is developed for simulating the infrared spectral radiance at the top of the atmosphere (TOA). The PCRTM approach removes the redundancy in radiative transfer calculation in high resolution infrared spectra, and saves significant amount of computational time with great accuracy. In PCRTM, both ice and water clouds are treated as effective transmissivity and reflectivity stored in a pre-calculated lookup tables. These quantities are calculated using cloud single scattering properties such as cloud optical depth, cloud particle size, cloud phase, etc. The cloud can be inserted into any pressure layer in the PCRTM model (up to 100 layers). The effective temperature of each cloud layer is treated as a function of its optical depth. To test the accuracy of this approximation, the results are compared with the more rigorous DISORT model, which treats cloud as a plane parallel layer. The root-mean-square error of PCRTM, with respect to DISORT results, is generally less than 0.5 K in brightness temperature. However, the CPU time required by PCRTM was approximately two orders of magnitude less than that required by DISORT.

Li, Hui↗

Senstitivity analysis of horizontal heat and vapor transfer coefficients for a cloud-topped marine boundary layer during cold-air outbreaks

The effects of external parameters on the surface heat and vapor fluxes into the marine atmospheric boundary layer (MABL) during cold-air outbreaks are investigated using the numerical model of Stage and Businger (1981a). These fluxes are nondimensionalized using the horizontal heat (g1) and vapor (g2) transfer coefficient method first suggested by Chou and Atlas (1982) and further formulated by Stage (1983a). In order to simplify the problem, the boundary layer is assumed to be well mixed and horizontally homogeneous, and to have linear shoreline soundings of equivalent potential temperature and mixing ratio. Modifications of initial surface flux estimates, time step limitation, and termination conditions are made to the MABL model to obtain accurate computations. The dependence of g1 and g2 in the cloud topped boundary layer on the external parameters (wind speed, divergence, sea surface temperature, radiative sky temperature, cloud top radiation cooling, and initial shoreline soundings of temperature, and mixing ratio) is studied by a sensitivity analysis, which shows that the uncertainties of horizontal transfer coefficients caused by changes in the parameters are reasonably small.

Chang, Y. V.↗

Validation of the National Solar Radiation Database (NSRDB) (2005-2012): Preprint

Publicly accessible, high-quality, long-term, satellite-based solar resource data is foundational and critical to solar technologies to quantify system output predictions and deploy solar energy technologies in grid-tied systems. Solar radiation models have been in development for more than three decades. For many years, the National Renewable Energy Laboratory (NREL) developed and/or updated such models through the National Solar Radiation Data Base (NSRDB). There are two widely used approaches to derive solar resource data from models: (a) an empirical approach that relates ground-based observations to satellite measurements and (b) a physics-based approach that considers the radiation received at the satellite and creates retrievals to estimate clouds and surface radiation. Although empirical methods have been traditionally used for computing surface radiation, the advent of faster computing has made operational physical models viable. The Global Solar Insolation Project (GSIP) is an operational physical model from the National Oceanic and Atmospheric Administration (NOAA) that computes global horizontal irradiance (GHI) using the visible and infrared channel measurements from the Geostationary Operational Environmental Satellites (GOES) system. GSIP uses a two-stage scheme that first retrieves cloud properties and then uses those properties in the Satellite Algorithm for Surface Radiation Budget (SASRAB) model to calculate surface radiation. NREL, the University of Wisconsin, and NOAA have recently collaborated to adapt GSIP to create a high temporal and spatial resolution data set. The product initially generates the cloud properties using the AVHRR Pathfinder Atmospheres-Extended (PATMOS-x) algorithms [3], whereas the GHI is calculated using SASRAB. Then NREL implements accurate and high-resolution input parameters such as aerosol optical depth (AOD) and precipitable water vapor (PWV) to compute direct normal irradiance (DNI) using the DISC model. The AOD and PWV, temperature, and pressure data are also combined with the MMAC model to simulate solar radiation under clear-sky conditions. The current NSRDB update is based on a 4-km x 4-km resolution at a 30-minute time interval, which has a higher temporal and spatial resolution. This paper demonstrates the evaluation of the data set using ground-measured data and detailed evaluation statistics. The result of the comparison shows a good correlation to the NSRDB data set. Further, an outline of the new version of the NSRDB and future plans for enhancement and improvement are provided.

14 SOLAR ENERGY↗

Large-Scale and Extreme-Scale Computing with Stranded Green Power: Opportunities and Costs

Power consumption and associated carbon emissions are increasingly critical challenges for large-scale computing. Recent research proposes exploiting stranded power-uneconomic renewable power-for green supercomputing in a system called Zero-Carbon Cloud (ZCCloud). These efforts studied production supercomputing workloads on stranded-power based computing resources, demonstrating their achievable productivity. We explore economic viability of stranded-power based supercomputing, using three datacenter total-cost-of-ownership (TOO) models to study cost-effectiveness. These studies show that ZCCloud's approach can be cost-effective in the USA today, and is even more attractive in regions with higher power prices (e.g., Japan, Germany), achieving cost advantages as large as 50 percent. Environmental and power-grid benefits are a further advantage. We also explore the sensitivity of these results to changes in hardware TOO; cheaper hardware or longer lifetimes magnify the attractiveness of stranded-power based approaches, yielding advantages as large as 91 percent. These results are robust across different TCO models. Lastly, we study extreme-scale supercomputers ( >100 MW), finding stranded-power can increase peak capability per cost by as much as 80 percent.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Entrainment rate diurnal cycle in marine stratiform clouds estimated from geostationary satellite retrievals and a meteorological forecast model: Entrainment Rate in Stratiform Clouds

The mean diurnal cycle of cloud entrainment rate (w e ) over the northeast Pacific region is for the first time computed by combining, in a mixed-layer model framework, the hourly composited GOES-15 satellite-based cloud top height (H T ) tendency, advection, and large-scale vertical velocity (w) during May to September 2013, with horizontal winds and w taken from the European Centre for Medium-Range Weather Forecasts (ECMWF) model. The tendency term dominates the magnitude and phase of the w e diurnal cycle, with a secondary role of w, and a modest advective contribution. The peak and minimum in w e occur between 20:00–22:00 LT and 9:00–11:00 LT, respectively, in close agreement with the diurnal cycle of turbulence driven by cloud top longwave cooling. Uncertainties in H T and ECMWF fields are assessed with in situ observations and three meteorological reanalysis data sets. This study provides the basis for constructing nearly global climatologies of w e by combining a suite of well-calibrated geostationary satellites.

54 ENVIRONMENTAL SCIENCES↗