Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Cloud Computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

Virtual machine provisioning, code management, and data movement design for the Fermilab HEPCloud Facility

The Fermilab HEPCloud Facility Project has as its goal to extend the current Fermilab facility interface to provide transparent access to disparate resources including commercial and community clouds, grid federations, and HPC centers. This facility enables experiments to perform the full spectrum of computing tasks, including data-intensive simulation and reconstruction. We have evaluated the use of the commercial cloud to provide elasticity to respond to peaks of demand without overprovisioning local resources. Full scale data-intensive workflows have been successfully completed on Amazon Web Services for two High Energy Physics Experiments, CMS and NOνA, at the scale of 58000 simultaneous cores. This paper describes the significant improvements that were made to the virtual machine provisioning system, code caching system, and data movement system to accomplish this work. The virtual image provisioning and contextualization service was extended to multiple AWS regions, and to support experiment-specific data configurations. A prototype Decision Engine was written to determine the optimal availability zone and instance type to run on, minimizing cost and job interruptions. We have deployed a scalable on-demand caching service to deliver code and database information to jobs running on the commercial cloud. It uses the frontiersquid server and CERN VM File System (CVMFS) clients on EC2 instances and utilizes various services provided by AWS to build the infrastructure (stack). We discuss the architecture and load testing benchmarks on the squid servers. We also describe various approaches that were evaluated to transport experimental data to and from the cloud, and the optimal solutions that were used for the bulk of the data transport. Finally, we summarize lessons learned from this scale test, and our future plans to expand and improve the Fermilab HEP Cloud Facility.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2016

Community Project for Accelerator Science and Simulation (ComPASS) Final Report

Tech-X participated across the full range of ComPASS activities, with efforts in the Energy Frontier primarily through modeling of laser plasma accelerators and dielectric laser acceleration, in the Intensity Frontier primarily through electron cloud modeling, and in Uncertainty Quantification being applied to dielectric laser acceleration. In the following we present the progress and status of our activities for the entire period of the ComPASS project for the different areas of Energy Frontier, Intensity Frontier and Uncertainty Quantification.

43 PARTICLE ACCELERATORS↗
DOE OSTI2021

Collaborative Research: Improved Efficiency and Coupling of the Radiation Code in the ACME Earth System Model (Final Report)

The complexity of radiative transfer, its importance to the exchange of energy in the climate system, and its high computational cost establishes importance of an accurate and efficient radiative transfer parameterization for climate simulation. Previous work by the proposing team at AER led to the development of the radiation code, RRTMG, which has been widely accepted by the global modeling community as a fast and accurate advancement over the previous generation of radiation codes. It has been in use in the NCAR CESM for many years, and it has been implemented in the initial version the DOE E3SM model. However, its computational cost remains high relative to other components in part due to its complexity and to its inefficient use of modern optimization strategies, and this project helped address this limitation for the code’s application in E3SM. Under other funding, the Investigators of this project led an effort to develop a high-performance broadband radiation code, called RTE+RRTMGP, which is a completely restructured code that will take advantage of modern computational capabilities to enhance its performance while retaining the strengths and accuracy of the original code. Designed to perform over a range of computer architectures, RTE+RRTMGP makes extensive use of Fortran 2003 features to improve both its efficiency and its use of memory. RTE+RRTMGP is expected to be adopted in the next generation of RTE+RRTMGP. This project allowed for advancements to the code’s computational capabilities and adding new and enhanced features. This included revising RTE+RRTMGP to run on GPU processors, analysis of and improvements to the code’s timing, modifying the gas optics in RRTMGP to increase the code’s accuracy, extensive validation of computed fluxes, heating rates and forcings, generating a cloud optical property and vertical sampling capabilities for RTE+RRTMGP, implementing a fast and accurate longwave scattering capability, and groundwork for the inclusion of a capability to specify solar variability. Many of the accomplishment in this project necessitated significant collaboration with the E3SM development team. The result of this project was optimization of a key physical component (radiative transfer calculations) of E3SM, directly supporting E3SM’s overarching global modeling objectives. More broadly, this project provided overall advancements in the use of radiative transfer calculations in atmospheric modeling and simulation, particularly for climate.

58 GEOSCIENCES↗
DOE OSTI2021

Building an AI-enhanced modeling framework to address multiscale predictability challenges

Focal Area(s): Build an AI-enhanced modeling framework that integrates the three focus areas in the solicitation. Science Challenge: The 4M-2N complexities (Multiscale, Multiphysics, Multibody, Multidimension, Non-linearity, and Non-Gaussianality) of atmospheric aerosol-cloud-precipitation-turbulence-radiation system poses physical and computational challenges to further advance predictive models; We plan to address the challenges by developing an AI-enhanced modeling framework that facilitates automated calibration and improvement of subgrid parameterizations, enhance data assimilation of measurements to improve initial and boundary conditions used to drive the physical model, and optimally blends data-driven and physics-based forecasting models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

hsrl (01)

High-spectral-resolution lidar (HSRL) systems collect data about clouds and aerosols. These systems provide vertical profiles of optical depth, backscatter cross-section, depolarization, and backscatter phase function. All HSRL measurements are absolutely calibrated by reference to molecular scattering, which is measured at each point in the lidar profile. Like the Raman lidar, but unlike simple backscatter lidars such as the micropulse lidar, the HSRL can measure backscatter cross-sections and optical depths without prior assumptions about the scattering properties of the atmosphere. The depolarization observations also allow robust discrimination between ice and water clouds. In addition, rigorous error estimates can be computed for all measurements. A very narrow, angular field of view reduces multiple scattering contributions. The small field of view, coupled with a narrow optical bandwidth, nearly eliminates noise due to scattered sunlight. ARM operates two HSRL systems, one at the Barrow, North Slope of Alaska (NSA) site and the other in the second ARM Mobile Facility (AMF2), which is deployed at various locations on field campaigns.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1979

The effect of surface reflection and clouds on the estimation of total ozone from satellite measurements

The total amount of ozone in a vertical column is being measured by Nimbus 4 and 7 observations of the intensity of ultraviolet sunlight scattered from the earth. The algorithm for deriving the amount of ozone from the observations uses the assumption that the surface reflects the light isotropically and the albedo is independent of wavelength. The effects of anisotropic surfaces and clouds on the estimate of total ozone are computed for models of the earth-atmosphere system.

Fraser, R. S.↗
NASA NTRS1980

Snow extent measurements from geostationary satellites using an interactive computer system

The author has identified the following significant results. A time series of GOES full resolution visible image sectors was viewed on the McIDAS video component in chronological order and registered to within plus or minus 1 image pixel to compute real time snow melting rates. Synoptic scale clouds were eliminated to create a snow covered area from a composite image. Results show good agreement with NESS products although a significant difference was noted for one two-day period when the NESS products showed an increase in the snow cover for the Verde Basin, while the GOES/McIDAS product implied no change in the snow cover for approximately the same period. A check of NWS radar reports indicated no precipitation had occurred within the Verde basin. The use of the registered image sequence eliminates instrument error since small changes in the snow cover between any two days are easily detected.

Gird, R. S.↗
NASA NTRS1984

Simulations of the stratocumulus-topped boundary layer with a third-order closure model

A third order closure model is proposed by Andre et al. (1982), in which the time rate of change terms, the relaxation and rapid effects for the pressure related terms, and the clipping approximation are included along with the quasi-normal closure, to study turbulence in a cloudy layer which is cooled radiatively from above. A spurious oscillation which is strongest near the inversion occurs. An analysis of the problem shows that the oscillation arises from the mean gradient and buoyancy terms of the triple moment equations; these terms are largest near the cloud top. The oscillation is physical, rather than computational. In nature the oscillation is effectively damped, by a mechanism which apparently is not included in our model. In the stably stratified layer just above the mixed layer top, turbulence can excite gravity waves, whose energy is radiated away. Because the closure assumption for the pressure terms does not take into account the transport of wave energy, the model generates spurious oscillations. Damping of the oscillations is possible by introducing diffusion terms into the triple moment equations. With a large enough choice for the diffusion coefficient, the oscillation is effectively eliminated. The results are quite sensitive to the ad hoc eddy coefficient.

Moeng, C. H.↗
NASA NTRS1985

Remote sensing of severe convective storms

The Tibet Plateau significantly affects the initiation and development of heavy rainfall and severe storms in China, just as the Rocky Mountains influence local severe storms in the United States. The study shows that the heavy rainfall in the Plateau area is usually preceded by a high growth rate of the convective clouds, followed by a rapid collapse of the cloud top. The study also shows that the tops of the convective clouds associated with heavy rainfall over the Plateau usually lie between the altitude of the two tropopauses which exist over the Plateau. There is good agreement between the collapsing of the cloud as observed from the satellite imagery, and the beginning of the rainfall observed by the ground stations and also between the dissipation of the cloud observed from the satellite infrared imagery, and the ending of the rainfall, observed by the ground stations. Comparison of the volumetric dissipation of clouds per unit area over the location of the ground station with the rainfall recorded at that station shows a linear relationship for rainfall mounts exceeding 8 mm. The ratio of observed rainfall at the ground station over the satellite observed cloud volume dissipation per unit area was also computed. The result shows that the ratio is almost constant with the value of 9.55 mm/(pixel . km/pixel) for rainfall amounts exceeding 15 mm; and the variation is less then 10 percent for rainfall mounts between 8 and 15 mm. Needless to say, further investigation is required to verify this ratio.

Hung, R. J.↗
NASA NTRS1990

Cloud parameters from GOES visible and infrared radiances during the FIRE Cirrus IFO, October 1986

Visible (VIS, 0.65 micron) and infrared (IR, 10.5 microns) channels on geostationary satellites are the key elements of the International Satellite Cloud Climatology Project (ISCCP). All daytime ISCCP cloud parameters are derived from a combination of VIS and IR data. Validation and improvement of the ISCCP and other cloud retrieval algorithms are important components of the First ISCCP Regional Experiment (FIRE) Intensive Field Observations (IFO). Data from the Cirrus IFO (October 19 to November 2, 1986) over Wisconsin are available for validating cirrus cloud retrievals from satellites. The Geostationary Operational Environmental Satellite (GOES) located over the Equator at approximately 100 deg W provided nearly continuous measurements of VIS and IR radiances over the IFO areas. The preliminary results of cloud parameters derived from the IFO GOES data are presented. Cloud attitudes are first derived using an algorithms without corrections for cloud emissivity. These same parameters will then be computed from the same data relying on an emissivity correction algorithm based on correlative data taken during the Cirrus IFO.

Heck, Patrick W.↗
NASA NTRS2000

North Atlantic Aerosol Radiative Impacts Based on Satellite Measurements and Aerosol Intensive Properties from TARFOX and ACE-2

We estimate the impact of North Atlantic aerosols on the net shortwave flux at the tropopause by combining maps of satellite-derived aerosol optical depth (AOD) with model aerosol properties. We exclude African dust, primarily by restricting latitudes to 25-60 N. Aerosol properties were determined via column closure analyses in two recent experiments, TARFOX and ACE 2. The analyses use in situ measurements of aerosol composition and air- and ship-borne sunphotometer measurements of AOD spectra. The resulting aerosol model yields computed flux sensitivities (dFlux/dAOD) that agree with measurements by airborne flux radiometers in TARFOX. It has a midvisible single- scattering albedo of 0.9, which is in the range obtained from in situ measurements of aerosol scattering and absorption in both TARFOX and ACE 2. Combining seasonal maps of AVHRR-derived midvisible AOD with the aerosol model yields maps of 24-hour average net radiative flux changes at the tropopause. For cloud-free conditions, results range from -9 W/sq m near the eastern US coastline in the summer to -1 W/sq m in the mid-Atlantic during winter; the regional annual average is -3.5 W/sq m. Using a non- absorbing aerosol model increases these values by about 30%. We estimate the effect of clouds using ISCCP cloud-fraction maps. Because ISCCP midlatitude North Atlantic cloud fractions are relatively large, they greatly reduce the computed aerosol-induced flux changes. For example, the regional annual average decreases from -3.5 W/sq m to -0.8 W/sq m. We compare results to previous model calculations for a variety of aerosol types.

Bergstrom, Robert A.↗
NASA NTRS2000

Light Scattering By Nonspherical Particles: Current Status and Challenging Issues

Quantitative analyses of remote sensing measurements of aerosols, clouds, precipitation, and particulate surfaces as well as computations of the Earth's radiation balance require detailed understanding of the interaction of small particles with light and other electromagnetic radiation. The convenient availability of the Lorenz-Mie theory has led to a widespread practice of treating all particles as if they were spheres. However, many natural and anthropogenic particles have nonspherical shapes, and the accumulated knowledge suggests that their scattering and radiative properties can be dramatically different from those of equivalent spheres. This presentation will summarize the recent significant progress achieved in the area of electromagnetic scattering by nonspherical particles and outline major problems that still await solution. The talk will cover the following specific topics: (1) comparison of most widely used exact and approximate theoretical techniques; (2) outline of laboratory and field measurement techniques; (3) compare theory and experiment; (4) need for a statistical approach in dealing with natural particles; (5) remote sensing and radiative transfer applications; and (6) major unsolved problems.

Mishchenko, Michael↗
NASA NTRS2002

Software for Simulation of Hyperspectral Images

A package of software generates simulated hyperspectral images for use in validating algorithms that generate estimates of Earth-surface spectral reflectance from hyperspectral images acquired by airborne and spaceborne instruments. This software is based on a direct simulation Monte Carlo approach for modeling three-dimensional atmospheric radiative transport as well as surfaces characterized by spatially inhomogeneous bidirectional reflectance distribution functions. In this approach, 'ground truth' is accurately known through input specification of surface and atmospheric properties, and it is practical to consider wide variations of these properties. The software can treat both land and ocean surfaces and the effects of finite clouds with surface shadowing. The spectral/spatial data cubes computed by use of this software can serve both as a substitute for and a supplement to field validation data.

Richtsmeier, Steven C.↗
NASA NTRS2004

The Goddard Profiling Algorithm (GPROF): Description and Current Applications

Atmospheric scientists use different methods for interpreting satellite data. In the early days of satellite meteorology, the analysis of cloud pictures from satellites was primarily subjective. As computer technology improved, satellite pictures could be processed digitally, and mathematical algorithms were developed and applied to the digital images in different wavelength bands to extract information about the atmosphere in an objective way. The kind of mathematical algorithm one applies to satellite data may depend on the complexity of the physical processes that lead to the observed image, and how much information is contained in the satellite images both spatially and at different wavelengths. Imagery from satellite-borne passive microwave radiometers has limited horizontal resolution, and the observed microwave radiances are the result of complex physical processes that are not easily modeled. For this reason, a type of algorithm called a Bayesian estimation method is utilized to interpret passive microwave imagery in an objective, yet computationally efficient manner.

Olson, William S.↗
NASA NTRS2006

Estimating Random Errors Due to Shot Noise in Backscatter Lidar Observations

In this paper, we discuss the estimation of random errors due to shot noise in backscatter lidar observations that use either photomultiplier tube (PMT) or avalanche photodiode (APD) detectors. The statistical characteristics of photodetection are reviewed, and photon count distributions of solar background signals and laser backscatter signals are examined using airborne lidar observations at 532 nm using a photon-counting mode APD. Both distributions appear to be Poisson, indicating that the arrival at the photodetector of photons for these signals is a Poisson stochastic process. For Poisson-distributed signals, a proportional, one-to-one relationship is known to exist between the mean of a distribution and its variance. Although the multiplied photocurrent no longer follows a strict Poisson distribution in analog-mode APD and PMT detectors, the proportionality still exists between the mean and the variance of the multiplied photocurrent. We make use of this relationship by introducing the noise scale factor (NSF), which quantifies the constant of proportionality that exists between the root-mean-square of the random noise in a measurement and the square root of the mean signal. Using the NSF to estimate random errors in lidar measurements due to shot noise provides a significant advantage over the conventional error estimation techniques, in that with the NSF uncertainties can be reliably calculated from/for a single data sample. Methods for evaluating the NSF are presented. Algorithms to compute the NSF are developed for the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) lidar and tested using data from the Lidar In-space Technology Experiment (LITE). OCIS Codes:

Liu, Zhaoyan↗
NASA NTRS2004

Simulation of Hyperspectral Images

A software package generates simulated hyperspectral imagery for use in validating algorithms that generate estimates of Earth-surface spectral reflectance from hyperspectral images acquired by airborne and spaceborne instruments. This software is based on a direct simulation Monte Carlo approach for modeling three-dimensional atmospheric radiative transport, as well as reflections from surfaces characterized by spatially inhomogeneous bidirectional reflectance distribution functions. In this approach, "ground truth" is accurately known through input specification of surface and atmospheric properties, and it is practical to consider wide variations of these properties. The software can treat both land and ocean surfaces, as well as the effects of finite clouds with surface shadowing. The spectral/spatial data cubes computed by use of this software can serve both as a substitute for, and a supplement to, field validation data.

Richsmeier, Steven C.↗
NASA NTRS2015

Role of Longwave Cloud-Radiation Feedback in the Simulation of the Madden-Julian Oscillation

The role of the cloud-radiation interaction in the simulation of the Madden-Julian oscillation (MJO) is investigated. A special focus is on the enhancement of column-integrated diabatic heating due to the greenhouse effects of clouds and moisture in the region of anomalous convection. The degree of this enhancement, the greenhouse enhancement factor (GEF), is measured at different precipitation anomaly regimes as the negative ratio of anomalous outgoing longwave radiation to anomalous precipitation. Observations show that the GEF varies significantly with precipitation anomaly and with the MJO cycle. The greenhouse enhancement is greater in weak precipitation anomaly regimes and its effectiveness decreases monotonically with increasing precipitation anomaly. The GEF also amplifies locally when convection is strengthened in association with the MJO, especially in the weak precipitation anomaly regime (less than 5 mm day(exp -1)). A robust statistical relationship is found among CMIP5 climate model simulations between the GEF and the MJO simulation fidelity. Models that simulate a stronger MJO also simulate a greater GEF, especially in the weak precipitation anomaly regime (less than 5 mm day(exp -1)). Models with a greater GEF in the strong precipitation anomaly regime (greater than 30 mm day(-1)) represent a slightly slower MJO propagation speed. Many models that lack the MJO underestimate the GEF in general and in particular in the weak precipitation anomaly regime. The results herein highlight that the cloud-radiation interaction is a crucial process for climate models to correctly represent the MJO.

Clouds↗
NASA NTRS2014

TPSAS-NF1676L-19256-DND

The NASA/GEWEX (Global Energy and Water Exchanges project) Surface Radiation Budget (SRB) project produces longwave and shortwave radiative fluxes for the surface and top-of-atmosphere (TOA) (see, Stackhouse et al., 2011, GEWEX News). The primary inputs of cloud and meteorology data have been undergoing improvements in quality and spatial and temporal resolution. In anticipation of the release of these data, the SRB longwave flux algorithm has been updated both to accommodate these data and to improve the algorithm used in deriving radiative fluxes. Changes in the inputs and algorithm are as follows: - Synchronized algorithm with version used by NASA CERES (Rose et al. 2006). - Atmospheric aerosols were added. - Beta version of ISCCP H cloud properties used. - Beta version of ISCCP nnHIRS temperature and humidity used. - Option of using a newly derived beta Princeton land surface temperature and diurnal Seaflux sea surface temperature as surface skin temperature added - Updated ozone profile with GISS ozone and MEaSUREs GOZCARDS. - Updated maps of surface topography, vegetation type, and snow/ice by ISCCP. The beta GLW v4 IP has enhanced the output fluxes by adding pristine-sky (no clouds or aerosols) fluxes. The new version also computes fluxes at selected atmospheric levels (including the tropopause) rather than just at the surface and TOA. The purpose of this study is to explore the effect of the above changes on the surface and top-of-atmosphere fluxes. These fluxes are compared to the previous version (release 3.1). We show preliminary results for the mid-seasonal months of 2007.

J Colleen Mikovitz↗