Results for “Cloud computing” — Page 39

NASA NTRS2014

Assessment of the Accuracy of the Conventional Ray-Tracing Technique: Implications in Remote Sensing and Radiative Transfer Involving Ice Clouds.

A fundamental problem in remote sensing and radiative transfer simulations involving ice clouds is the ability to compute accurate optical properties for individual ice particles. While relatively simple and intuitively appealing, the conventional geometric-optics method (CGOM) is used frequently for the solution of light scattering by ice crystals. Due to the approximations in the ray-tracing technique, the CGOM accuracy is not well quantified. The result is that the uncertainties are introduced that can impact many applications. Improvements in the Invariant Imbedding T-matrix method (II-TM) and the Improved Geometric-Optics Method (IGOM) provide a mechanism to assess the aforementioned uncertainties. The results computed by the II-TMþIGOM are considered as a benchmark because the IITM solves Maxwell's equations from first principles and is applicable to particle size parameters ranging into the domain at which the IGOM has reasonable accuracy. To assess the uncertainties with the CGOM in remote sensing and radiative transfer simulations, two independent optical property datasets of hexagonal columns are developed for sensitivity studies by using the CGOM and the II-TMþIGOM, respectively. Ice cloud bulk optical properties obtained from the two datasets are compared and subsequently applied to retrieve the optical thickness and effective diameter from Moderate Resolution Imaging Spectroradiometer (MODIS) measurements. Additionally, the bulk optical properties are tested in broadband radiative transfer (RT) simulations using the general circulation model (GCM) version of the Rapid Radiative Transfer Model (RRTMG) that is adopted in the National Center for Atmospheric Research (NCAR) Community Atmosphere Model (CAM, version 5.1). For MODIS retrievals, the mean bias of uncertainties of applying the CGOM in shortwave bands (0.86 and 2.13 micrometers) can be up to 5% in the optical thickness and as high as 20% in the effective diameter, depending on cloud optical thickness and effective diameter. In the MODIS infrared window bands centered at 8.5, 11, and 12 micrometers biases in the optical thickness and effective diameter are up to 12% and 10%, respectively. The CGOM-based simulation errors in ice cloud radiative forcing calculations are on the order of 10Wm(exp 2).

remote sensing↗

DOE OSTI2021

Fast All-sky Radiation Model for Solar applications (FARMS) [SWR-16-18]

The Fast All-sky Radiation Model for Solar applications (FARMS) is used to compute cloudy irradiance. Radiative transfer (RT) models simulating broadband solar radiation have been widely used by atmospheric scientists to model solar resources for various energy applications such as operational forecasting. Due to the complexity of solving the RT equation, the computation under cloudy conditions can be extremely time consuming though many approximations (e.g. two-stream approach and delta-M truncation scheme) have been utilized. Thus, a more efficient RT model is crucial for model developers as a new option for approximating solar radiation at the land surface with minimal loss of accuracy. We have developed a fast all-sky radiation model for solar applications (FARMS) using the simplified clear-sky RT model, REST2, and simulated cloud transmittances and reflectances from the Rapid Radiation Transfer Model (RRTM) with a sixteen-stream Discrete Ordinates Radiative Transfer (DISORT). Simulated lookup tables (LUTs) of cloud transmittances and reflectances were created by varying cloud optical thicknesses, cloud particle sizes, and solar zenith angles. Equations with optimized parameters were fitted to the cloud transmittances and reflectances to develop the model. Using this model the all-sky solar irradiance at the land surface can be computed rapidly by combining REST2 with the cloud transmittances and reflectances. This new RT model is more than 1000 times faster than those currently utilized in solar resource assessment and forecasting since it does not explicitly solve the RT equation for each individual cloud condition. Our results indicate the accuracy of the fast radiative transfer model is comparable to or better than two-stream approximation in term of computing cloud transmittance and solar radiation.

Xie, Yu↗

DOE OSTI2023

Fast All-sky Radiation Model for Solar applications (FARMS) 2023 [SWR-16-18]

The Fast All-sky Radiation Model for Solar applications (FARMS) is used to compute cloudy irradiance. Radiative transfer (RT) models simulating broadband solar radiation have been widely used by atmospheric scientists to model solar resources for various energy applications such as operational forecasting. Due to the complexity of solving the RT equation, the computation under cloudy conditions can be extremely time consuming though many approximations (e.g. two-stream approach and delta-M truncation scheme) have been utilized. Thus, a more efficient RT model is crucial for model developers as a new option for approximating solar radiation at the land surface with minimal loss of accuracy. We have developed a fast all-sky radiation model for solar applications (FARMS) using the simplified clear-sky RT model, REST2, and simulated cloud transmittances and reflectances from the Rapid Radiation Transfer Model (RRTM) with a sixteen-stream Discrete Ordinates Radiative Transfer (DISORT). Simulated lookup tables (LUTs) of cloud transmittances and reflectances were created by varying cloud optical thicknesses, cloud particle sizes, and solar zenith angles. Equations with optimized parameters were fitted to the cloud transmittances and reflectances to develop the model. Using this model the all-sky solar irradiance at the land surface can be computed rapidly by combining REST2 with the cloud transmittances and reflectances. This new RT model is more than 1000 times faster than those currently utilized in solar resource assessment and forecasting since it does not explicitly solve the RT equation for each individual cloud condition. Our results indicate the accuracy of the fast radiative transfer model is comparable to or better than two-stream approximation in term of computing cloud transmittance and solar radiation.

Xie, Yu↗

DOE OSTI2021

Two–Dimensional Idealized Hadley Circulation Simulation for Global High Resolution Model Development

A new framework for the development of global high resolution models using a vertical- meridional, two-dimensional pole-to-pole domain is proposed. Compared with the three-dimensional global model, the two-dimensional framework can simulate cloud-scale convection at significantly reduced computational cost, data volume, and turn-around time, and accelerate the development phase. Although idealized, it allows for simulation of various clouds and scale interactions under a wide range of environmental conditions, even though zonal waves such as mid latitude storms cannot be simulated. Physics schemes can be tested and assessed over a full array of simultaneously occurring cloud regimes. The framework can serve as an intermediate step between a one-dimensional simulation and a full three-dimensional global model. Using this framework, we analyze the resolution dependencies of simulated clouds and the Hadley circulation in a range of global high resolution models by performing multiple 1000-day simulations; for some resolutions tested, for example, 2 km horizontal resolution, three-dimensional simulation is not feasible at the present time. Analysis shows that both horizontal and vertical resolution determine the properties of the Hadley circulation and clouds, and that the differences among the simulated Hadley circulations are understood as differences in scale interactions influenced by resolution.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2013

A Novel Method for Estimating Shortwave Direct Radiative Effect of Above-cloud Aerosols over Ocean Using CALIOP and MODIS Data

This paper describes an efficient and unique method for computing the shortwave direct radiative effect (DRE) of aerosol residing above low-level liquid-phase clouds using CALIOP and MODIS data. It accounts for the overlapping of aerosol and cloud rigorously by utilizing the joint histogram of cloud optical depth and cloud top pressure. Effects of sub-grid scale cloud and aerosol variations on DRE are accounted for. It is computationally efficient through using grid-level cloud and aerosol statistics, instead of pixel-level products, and a pre-computed look-up table in radiative transfer calculations. We verified that for smoke over the southeast Atlantic Ocean the method yields a seasonal mean instantaneous shortwave DRE that generally agrees with more rigorous pixel-level computation within 4%. We have also computed the annual mean instantaneous shortwave DRE of light-absorbing aerosols (i.e., smoke and polluted dust) over global ocean based on 4 yr of CALIOP and MODIS data. We found that the variability of the annual mean shortwave DRE of above-cloud light-absorbing aerosol is mainly driven by the optical depth of the underlying clouds.

CALIOP and MODIS↗

DOE OSTI2024

Portable Acceleration of CMS Computing Workflows with Coprocessors as a Service

Computing demands for large scientific experiments, such as the CMS experiment at the CERN LHC, will increase dramatically in the next decades. To complement the future performance increases of software running on central processing units (CPUs), explorations of coprocessor usage in data processing hold great potential and interest. Coprocessors are a class of computer processors that supplement CPUs, often improving the execution of certain functions due to architectural design choices. We explore the approach of Services for Optimized Network Inference on Coprocessors (SONIC) and study the deployment of this as-a-service approach in large-scale data processing. In the studies, we take a data processing workflow of the CMS experiment and run the main workflow on CPUs, while offloading several machine learning (ML) inference tasks onto either remote or local coprocessors, specifically graphics processing units (GPUs). With experiments performed at Google Cloud, the Purdue Tier-2 computing center, and combinations of the two, we demonstrate the acceleration of these ML algorithms individually on coprocessors and the corresponding throughput improvement for the entire workflow. This approach can be easily generalized to different types of coprocessors and deployed on local CPUs without decreasing the throughput performance. We emphasize that the SONIC approach enables high coprocessor usage and enables the portability to run workflows on different types of coprocessors.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

NASA NTRS2003

Obliquity Driven Climate Change in Mars' Recent Past

We use the NASA/Ames grid Mars general circulation model with an updated radiation code and cloud nlicrophysics scheme. To speed up the simulations, we run the model at fairly coarse resolution (7.5" latitude x 22.5" longitude). Radiation Code Fluxes and heating rates are calculated from a radiation code based on the two-stream solution to radiative transfer that fully accounts for multiple scattering in the presence of gaseous absorp- tion. The model has 12 spectral intervals. Dust and water ice scattering properties are included. For dust, we use the Ockert-Bell [9] values in the visible, and Forget [IO] values in the infrared. For ice, we can either compute them online as the cloud evolves, or we can specify them. Gaseous opacities for water vapor and CO2 are calculated from correlated k-distributions taken from full line-by-line models. Cloud Microphysics Our cloud scheme is based on momentlorder scheme in which the mass mixing ratio and number density of the cloud ensemble are the advected species. From these we obtain a mean particle size and an estimate or the particle size distribution assuming a variance) which we then divide into 8 bins. Cloud microphysics is performed in each of these bins and includes nucleation, condensation, and gravitational settling. Dust is treated as a tracer and serves as condensation nuclei. The altered size distribution is then converted back into a mean size, a mixing ratio, and a particle number density.

Haberle, R. M.↗

NASA NTRS1991

A satellite-based radar wind sensor

The objective is to investigate the application of Doppler radar systems for global wind measurement. A model of the satellite-based radar wind sounder (RAWS) is discussed, and many critical problems in the designing process, such as the antenna scan pattern, tracking the Doppler shift caused by satellite motion, and backscattering of radar signals from different types of clouds, are discussed along with their computer simulations. In addition, algorithms for measuring mean frequency of radar echoes, such as the Fast Fourier Transform (FFT) estimator, the covariance estimator, and the estimators based on autoregressive models, are discussed. Monte Carlo computer simulations were used to compare the performance of these algorithms. Anti-alias methods are discussed for the FFT and the autoregressive methods. Several algorithms for reducing radar ambiguity were studied, such as random phase coding methods and staggered pulse repitition frequncy (PRF) methods. Computer simulations showed that these methods are not applicable to the RAWS because of the broad spectral widths of the radar echoes from clouds. A waveform modulation method using the concept of spread spectrum and correlation detection was developed to solve the radar ambiguity. Radar ambiguity functions were used to analyze the effective signal-to-noise ratios for the waveform modulation method. The results showed that, with suitable bandwidth product and modulation of the waveform, this method can achieve the desired maximum range and maximum frequency of the radar system.

Xin, Weizhuang↗

NASA NTRS2011

Allowing for Horizontally Heterogeneous Clouds and Generalized Overlap in an Atmospheric GCM

While fully accounting for 3D effects in Global Climate Models (GCMs) appears not realistic at the present time for a variety of reasons such as computational cost and unavailability of 3D cloud structure in the models, incorporation in radiation schemes of subgrid cloud variability described by one-point statistics is now considered feasible and is being actively pursued. This development has gained momentum once it was demonstrated that CPU-intensive spectrally explicit Independent Column Approximation (lCA) can be substituted by stochastic Monte Carlo ICA (McICA) calculations where spectral integration is accomplished in a manner that produces relatively benign random noise. The McICA approach has been implemented in Goddard's GEOS-5 atmospheric GCM as part of the implementation of the RRTMG radiation package. GEOS-5 with McICA and RRTMG can handle horizontally variable clouds which can be set via a cloud generator to arbitrarily overlap within the full spectrum of maximum and random both in terms of cloud fraction and layer condensate distributions. In our presentation we will show radiative and other impacts of the combined horizontal and vertical cloud variability on multi-year simulations of an otherwise untuned GEOS-5 with fixed SSTs. Introducing cloud horizontal heterogeneity without changing the mean amounts of condensate reduces reflected solar and increases thermal radiation to space, but disproportionate changes may increase the radiative imbalance at TOA. The net radiation at TOA can be modulated by allowing the parameters of the generalized overlap and heterogeneity scheme to vary, a dependence whose behavior we will discuss. The sensitivity of the cloud radiative forcing to the parameters of cloud horizontal heterogeneity and comparisons of CERES-derived forcing will be shown.

Lee, D.↗

DOE OSTI2022

Smart connected worker edge platform for smart manufacturing: Part 1—Architecture and platform design

Abstract The challenge of sustainably producing goods and services for healthy living on a healthy planet requires simultaneous consideration of economic, societal, and environmental dimensions in manufacturing. Enabling technology for data driven manufacturing paradigms like Smart Manufacturing (a.k.a. Industry 4.0) serve as the technological backbone from which sustainable approaches to manufacturing can be implemented. Unfortunately, these technologies are typically associated with broader and deeper factory automation that is often too expensive and complex for the small and medium sized manufacturers (SMMs) that comprise the majority of manufacturing business in the USA and for whom their most valuable asset are the people whose jobs automation while replace. This paper describes an edge intelligent platform to integrate internet‐of‐things technologies with computing hardware, software, computational workflows for machine learning, and data ingestion, enabling SMMs to transition into smart manufacturing paradigms by leveraging the intelligence of their people. The platform leverages consumer grade electronics and sensors (affordable and portable), customized software with open source software packages (accessible), and existing communication network infrastructures (scalable). The software systems are implemented via Kubernetes orchestration of Docker containerization to ensure scalability and programmability. The platform is adaptive via computational workflow engines that produce information from data by processing with low‐cost edge computing devices while efficiently accessing resources of cloud servers as needed. The proposed edge platform connects workers to technological resources that provide computational intelligence (i.e., silicon‐based sensing and computation for data collection and contextualization) to enable decision making at the edge of advanced manufacturing.

Kim, Yoon G.↗

NASA NTRS1976

A comparison of low-cloud satellite wind estimates with analyses based on aircraft observations in a disturbed tropical regime

Low-level, ATS-3 satellite wind estimates are compared with values of wind direction and speed interpolated from analyses based on research aircraft observations of a synoptic tropical wave of moderate intensity on 26 July 1969 during BOMEX. The data were stratified according to whether a satellite estimate was positioned in one of three regions; namely, east or west of the wave trough or north of the disturbance center. When cloud and analysis vector magnitude deviations were computed, regional differences became apparent. These differences are attributed to the physical behavior of the cloud targets tracked under the influence of the surrounding large-scale environment.

Smith, C. L.↗

DOE OSTI2022

Numerical simulation of a relativistic magnetron using a fluid electron model

An approach to numerically modeling relativistic magnetrons, in which the electrons are represented with a relativistic fluid, is described. A principal effect in the operation of a magnetron is space-charge-limited (SCL) emission of electrons from the cathode. We have developed an approximate SCL emission boundary condition for the fluid electron model. This boundary condition prescribes the flux of electrons as a function of the normal component of the electric field on the boundary. Here we show the results of a benchmarking activity that applies the fluid SCL boundary condition to the one-dimensional Child–Langmuir diode problem and a canonical two-dimensional diode problem. Simulation results for a two-dimensional A6 magnetron are then presented. Computed bunching of the electron cloud occurs and coincides with significant microwave power generation. Numerical convergence of the solution is considered. Sharp gradients in the solution quantities at the diocotron resonance, spanning an interval of three to four grid cells in the most well-resolved case, are present and likely affect convergence.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NASA NTRSDate not supplied

Use NASA Earthdata in the Cloud

With the impending arrival of new, high-data-volume Earth observation missions, NASA’s ability to effectively ingest, process, and archive large amounts of data requires the most cost-effective, flexible, and scalable data-management architectures and technologies. To meet these demands, NASA's Earth Science Data Systems (ESDS) Program is implementing a strategic vision to develop and operate multiple components of NASA's Earth Observing System Data and Information System (EOSDIS) in a commercial cloud environment. As more earth observing data is moved into the cloud, NASA EOSDIS wants to share our reasoning for moving data into the commercial cloud, as well as demonstrate how end-users can take advantage of both data in the cloud and cloud-deployed services. This presentation explains the enterprise reasons for moving data into the cloud, specifically the scalability of cloud systems, the flexibility to pivot to the most optimal language/system/architecture, and the reduced redundancy of a common architecture. Then we primarily focus on the user-driven reasons for moving to the cloud. Equal access to high performance computing helps all parties, especially users that don't have access to their own on-premise computing infrastructure. Rapid deployment allows users to spin up their own systems without needing the extensive platform previously required for large scale development. Cost effectiveness allows users a wide breadth of computing options, from super computer ability to small scale development, which can help underserved communities. Finally we link to internal resources that users can utilize to begin their cloud based development journey without having to be an expert in the field.

Nicholas Doty↗

NASA NTRS1975

Man-Computer Interactive Data Access System (McIDAS). Continued development of McIDAS and operation in the GARP Atlantic tropical experiment

The complete output of the Synchronous Meteorological Satellite was recorded on one inch magnetic tape. A quality control subsystem tests cloud track vectors against four sets of criteria: (1) rejection if best match occurs on correlation boundary; (2) rejection if major correlation peak is not distinct and significantly greater than secondary peak; (3) rejection if correlation is not persistent; and (4) rejection if acceleration is too great. A cloud height program determines cloud optical thickness from visible data and computer infrared emissivity. From infrared data and temperature profile, cloud height is determined. A functional description and electronic schematics of equipment are given.

Suomi, V. E.↗

NASA NTRS1974

Aircraft observations of Venus' near-infrared reflection spectrum - Implications for cloud composition

A comparison of aircraft-based measurement data on Venus' near-infrared (1.2- to 4.1-micron) reflection spectrum with computer generated spectra of a number of cloud candidates shows a 75-% or more concentrated water solution of sulfuric acid to give the only acceptable match to the profile of Venus' strong 3-micron absorption feature. However, the measurement data obtained also show a modest decline in reflectivity from 2.3-micron to 1.2-micron wavelength, which is inconsistent with the flat spectrum of sulfuric acid in this spectral region. It is hypothesized that this decline is due to impurities in the sulfuric acid droplets.

Pollack, J. B.↗

NASA NTRS2014

A Novel Method for Estimating Shortwave Direct Radiative Effect of Above-Cloud Aerosols Using CALIOP and MODIS Data

This paper describes an efficient and unique method for computing the shortwave direct radiative effect (DRE) of aerosol residing above low-level liquid-phase clouds using CALIOP and MODIS data. It addresses the overlap of aerosol and cloud rigorously by utilizing the joint histogram of cloud optical depth and cloud top pressure while also accounting for subgrid-scale variations of aerosols. The method is computationally efficient because of its use of grid-level cloud and aerosol statistics, instead of pixel-level products, and a pre-computed look-up table based on radiative transfer calculations. We verify that for smoke over the southeast Atlantic Ocean the method yields a seasonal mean instantaneous (approximately 1:30PM local time) shortwave DRE of above cloud aerosol (ACA) that generally agrees with more rigorous pixel-level computation within 4 percent. We also estimate the impact of potential CALIOP aerosol optical depth (AOD) retrieval bias of ACA on DRE. We find that the regional and seasonal mean instantaneous DRE of ACA over southeast Atlantic Ocean would increase, from the original value of 6.4 W m(-2) based on operational CALIOP AOD to 9.6 W m(-2) if CALIOP AOD retrieval are biased low by a factor of 1.5 (Meyer et al., 2013) and further to 30.9 W m(-2) if CALIOP AOD retrieval are biased low by a factor of 5 as suggested in (Jethva et al., 2014). In contrast, the instantaneous ACA radiative forcing efficiency (RFE) remains relatively invariant in all cases at about 53 W m(-2) AOD(-1), suggesting a near linear relation between the instantaneous RFE and AOD. We also compute the annual mean instantaneous shortwave DRE of light-absorbing aerosols (i.e., smoke and polluted dust) over global oceans based on 4 years of CALIOP and MODIS data. We find that the variability of the annual mean shortwave DRE of above-cloud light-absorbing aerosol is mainly driven by the optical depth of the underlying clouds. While we demonstrate our method using CALIOP and MODIS data, it can also be extended to other satellite data sets, as well as climate model outputs.

CALIOP and MODIS↗

NASA NTRS1990

Stratus: An interactive steady state mixed layer model for personal computers

A steady-state, horizontally homogeneous, cloud-topped marine boundary layer model based primarily on the work of Lilly (1968) and Schubert et al., (1979) is presented. The conservative thermodynamic variables are equivalent potential temperature, theta(sub e), and total water mixing ratio, q + l. Some of the differences between this and Lilly's (1968) model are: radiation is allowed to penetrate into the boundary layer; cloud top values of longwave radiation, equivalent potential temperature, and water vapor mixing ratio are linear functions of height derived from climatological data at California coastal stations; and the closure assumption assumes a weighted average of Lilly's (1968) maximum and minimum entrainment theories. This model was programmed in FORTRAN and will run interactively on an IBM-compatible personal computer. The program allows the user to specify the geographical location, the wind speed, the sea-surface temperature, the large scale horizontal divergence, and the initial guess for cloud top height. Output includes the steady state values of cloud top and cloud base height, mixed layer equivalent potential temperature and total water mixing ratio, and the associated convective and radiative fluxes.

Guinn, Thomas A.↗

DOE OSTI2020

The Silver Lining

Clouds are shareable scientific instruments that create the potential for reproducibility by ensuring that all investigators have access to a common execution platform on which computational experiments can be repeated and compared. By virtue of the interface they present, they also lead to the creation of digital artifacts compatible with the cloud, such as images or orchestration templates, that go a long way-and sometimes all the way-to representing an experiment in a digital, repeatable form. In this article, I describe how we developed these natural advantages of clouds in the Chameleon testbed and argue that we should leverage them to create a digital research marketplace that would make repeating experiments as natural and viable part of research as sharing ideas via reading papers is today.

Cloud computing↗