Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Cloud computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50
All sourcesNASA NTRSDOE OSTI
NASA NTRS2016

The Matsu Wheel: A Cloud-Based Framework for Efficient Analysis and Reanalysis of Earth Satellite Imagery

Project Matsu is a collaboration between the Open Commons Consortium and NASA focused on developing open source technology for cloud-based processing of Earth satellite imagery with practical applications to aid in natural disaster detection and relief. Project Matsu has developed an open source cloud-based infrastructure to process, analyze, and reanalyze large collections of hyperspectral satellite image data using OpenStack, Hadoop, MapReduce and related technologies. We describe a framework for efficient analysis of large amounts of data called the Matsu "Wheel." The Matsu Wheel is currently used to process incoming hyperspectral satellite data produced daily by NASA's Earth Observing-1 (EO-1) satellite. The framework allows batches of analytics, scanning for new data, to be applied to data as it flows in. In the Matsu Wheel, the data only need to be accessed and preprocessed once, regardless of the number or types of analytics, which can easily be slotted into the existing framework. The Matsu Wheel system provides a significantly more efficient use of computational resources over alternative methods when the data are large, have high-volume throughput, may require heavy preprocessing, and are typically used for many types of analysis. We also describe our preliminary Wheel analytics, including an anomaly detector for rare spectral signatures or thermal anomalies in hyperspectral data and a land cover classifier that can be used for water and flood detection. Each of these analytics can generate visual reports accessible via the web for the public and interested decision makers. The result products of the analytics are also made accessible through an Open Geospatial Compliant (OGC)-compliant Web Map Service (WMS) for further distribution. The Matsu Wheel allows many shared data services to be performed together to efficiently use resources for processing hyperspectral satellite image data and other, e.g., large environmental datasets that may be analyzed for many purposes.

0↗
DOE OSTI2023

Generalized moving least squares vs. radial basis function finite difference methods for approximating surface derivatives

Approximating differential operators defined on two-dimensional surfaces is an important problem that arises in many areas of science and engineering. Over the past ten years, localized meshfree methods based on generalized moving least squares (GMLS) and radial basis function finite differences (RBF-FD) have been shown to be effective for this task as they can give high orders of accuracy at low computational cost, and they can be applied to surfaces defined only by point clouds. However, there have yet to be any studies that perform a direct comparison of these methods for approximating surface differential operators (SDOs). The first purpose of this work is to fill that gap. For this comparison, we focus on an RBF-FD method based on polyharmonic spline kernels and polynomials (PHS+Poly) since they are most closely related to the GMLS method. Additionally, we use a relatively new technique for approximating SDOs with RBF-FD called the tangent plane method since it is simpler than previous techniques and natural to use with PHS+Poly RBF-FD. Further, the second purpose of this work is to relate the tangent plane formulation of SDOs to the local coordinate formulation used in GMLS and to show that they are equivalent when the tangent space to the surface is known exactly. The final purpose is to use ideas from the GMLS SDO formulation to derive a new RBF-FD method for approximating the tangent space for a point cloud surface when it is unknown. For the numerical comparisons of the methods, we examine their convergence rates for approximating the surface gradient, divergence, and Laplacian as the point clouds are refined for various parameter choices. We also compare their efficiency in terms of accuracy per computational cost, both when including and excluding setup costs.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1978

Properties of the clouds of Venus, as inferred from airborne observations of its near-infrared reflectivity spectrum

The shape and absolute value of Venus' reflectivity spectrum is measured in the 1.2- to 4.0 micrometer spectral region with a circular variable filter wheel spectrometer having a spectral resolution of 1.5%. Comparing these spectra with synthetic spectra generated with a multiple-scattering computer code, a number of properties of the Venus clouds are inferred. Evidence is obtained indicating that the clouds are made of a water solution of sulfuric acid in their top unit optical depth, and that the clouds are made of this material down to an optical depth of at least 25. In addition, the acid concentration is 84 plus or minus 2% H2SO4 by weight in the top unit optical depth, the total optical depth of the clouds is 37.5 plus or minus 12.5, and the cross-sectional weighted mean particle radius lies between 0.5 and 1.4 micrometers in the top unit optical depth of the clouds. It is found that the average volume mixing ratio of H2SO4 and H2O contained in the cloud material both equal approximately 2 x 10 to the -6. Employing vapor pressure arguments, the acid concentration is shown to equal 84 plus or minus 6% at the cloud bottom and the water vapor mixing ratio beneath the clouds lies between 6 x 10 to the -4 and 10 to the -2.

Pollack, J. B.↗
NASA NTRS1981

Diurnal variability of regional cloud radiative parameters from geostationary satellite data

In the discussed study, Geostationary Operational Environmental Satellite visible and infrared brightness measurements are used to infer regional cloud cover and several associated radiative parameters on an hourly basis. Several techniques are utilized to derive the parameters of interest. These parameters include the areal cloud fraction, cloud-atmosphere albedo, surface-atmosphere albedo, and equivalent blackbody surface and cloud-top temperatures. Attention is given to clear radiance temperature determinations, surface temperature modeling, the infrared threshold method, narrowband-broadband correlations, and albedo determination. Monthly mean values were computed for each parameter as a function of local time. Cloud amounts and temperatures are considered along with longwave emission and shortwave albedo, and composite results.

Minnis, P.↗
NASA NTRS1999

Accuracy of the Independent Pixel Approximation at Absorbing Wavelengths

In order to correctly interpret shortwave cloud radiation measured by satellites and ground-based radiometers, or by two aircraft flying above and below clouds, we need to better understand interactions between inhomogeneous clouds and solar radiation. The discrepancies between shortwave absorption inferred from measurements and predicted by models, between cloud optical depths estimated from satellites and ground measurements, between single scattering albedo retrieved from in situ radiation measurements and computed from measured droplet size distribution, among others, are strongly affected by cloud horizontal inhomogeneity. Net horizontal photon transport (i. e., horizontal fluxes) are a direct consequence of the inhomoqeneity in cloud structure. Horizontal fluxes and their effect on the accuracy of the pixel-by-pixel one-dimensional (1 D) radiative transfer calculations has recently undergone close scrutiny for conservative scattering. However, the properties and magnitude of horizontal fluxes in absorbing wavelengths are still poorly understood. As far as we are aware, only Ackerman and Cox and Titov discussed correlations between horizontal fluxes at absorbing wavelengths, though these were far from comprehensive. This paper partly fills this gap. We discuss here of whether the accuracy of the Independent Pixel Approximation (IPA), a 1 D radiative transfer approximation for each pixel, is a better model for multiple scattering at conservative or at absorbing wavelengths. Issues addressed here are: (1) dependence of net horizontal fluxes on single scattering albedo; (2) connection between pixel-by-pixel accuracy of the IPA and horizontal fluxes and (3) radiative smoothing and horizontal fluxes at absorbing wavelengths. In contrast to the traditional understanding of IPA, we study IPA accuracies not only for reflectance but also for transmittance and absorptance at both conservative and absorbing wavelengths. In spite of the apparent similarity between the three processes, dependence of IPA accuracies on single-scattering albedo is completely different. As a result, cloud optical properties retrieved from high resolution satellite images and ground-based measurements using IPA at absorbing channels will have different accuracies.

Marchak, Alexander↗
NASA NTRSDate not supplied

Impacts of Aerosol and Cloud Variability on Satellite-Derived All-skies Direct Aerosol Radiative Effects (DARE) over the North and Southeast Atlantic

The Top-of-Atmosphere (TOA) Shortwave (SW) Direct Aerosol Radiative Effect (DARE) in all-sky conditions (i.e., aerosols in clear skies and aerosols above and below all types of clouds) is the global change in upwelling radiative flux due to aerosols. It is one of the strongest indicators of global climate change due to aerosols. SW DARE at TOA depends on the Earth’s surface albedo, cloud fraction, cloud optical properties, and aerosol optical properties, which are all challenging to accurately characterize from space. The overarching goals of our project are to provide state-of-the-art observational all-sky TOA SW DARE, along with guidance on which aerosol and/or cloud properties are the most important to measure, and at which spatio-temporal scales, for accurate DARE observations. We compute all-sky DARE based on state-of-the-art cloud and aerosol retrieval algorithms from CALIOP (Cloud–Aerosol Lidar with Orthogonal Polarization) and MODIS (Moderate Resolution Imaging spectroradiometer) satellite sensors, as well as aerosol intensive properties from MERRA-2 (Modern-Era Retrospective Analysis for Research and Applications, version 2) simulations over three specific regions of the Atlantic Ocean from 2012 to 2016. In this symposium, we present a characterization of the cloud and aerosol optical and physical properties and the observational TOA SW DARE along three individual satellite tracks in the Southeast Atlantic region -- on September 18 and 20, 2016 and August 13, 2017. We then quantify the impact of assuming homogeneous cloud or aerosol fields in space-based TOA SW DARE calculations. And, finally, the resulting space-based all-skies aerosol vertical distribution and DARE calculations are evaluated using remote sensing observations from coincident suborbital flights from the NASA ORACLES (the ObseRvations of Aerosols above CLouds and their intEractionS, ORACLES field campaign) field campaign. The NASA Atmospheric Observing System (AOS) mission addresses the NASA Aerosol, Cloud, Convection and Precipitation (ACCP) designated observables and proposes, as one of its aerosol objectives, to reduce uncertainties in estimates of global mean all-sky SW DARE at TOA. Well characterizing clouds, aerosol vertical distributions, aerosol types and associated all-skies DARE over the Atlantic Ocean will inform the AOS community on where, when, how, and how often the satellite retrievals should be performed to estimate DARE and reduce all-skies DARE uncertainties most accurately. These comprehensive characterizations will also identify the key regions and times when the AOS (or other ACCP-related) suborbital missions should be conducted to evaluate and improve the AOS space-based observations and retrievals.

aerosol↗
NASA NTRS2021

Improving the CERES SYN Cloud and Flux Products by Identifying GOES-17 Scan Anomalies Using a Convolutional Neural Network

The NASA Clouds and the Earth’s Radiant Energy System (CERES) project relies on top-of-atmosphere (TOA) broadband fluxes derived from geostationary (GEO) satellite imagery to account for the diurnal flux variations between the CERES observation intervals, and thereby produce a synoptic gridded (SYN1deg) product based on continuous temporal observations. Consistent broadband flux derivation depends on accurate radiative property measurements and cloud retrievals, which largely determine the radiance-to-flux conversion process. Therefore, it is important to ensure a high quality of cloud property input in order to maintain a reliable broadband flux record. In Edition 4 of the CERES SYN1deg product, a robust automated image anomaly detection algorithm based on inter-line and inter-pixel differences, spatial variance, and 2-D Fourier analysis has been successful in identifying imagery with linear artifacts, but the line-by-line inspection and cleaning process must still be performed by a human. Therefore, further automation of this quality assurance process is warranted, especially considering the excessive amount of additional cleaning necessitated by the GOES-17 Advance Baseline Imager (ABI) cooling system anomaly. As such, this article highlights advancement of the CERES GEO image artifact cleaning approach based on a convolutional neural network (CNN) for classification of bad scanlines. Once trained, the CNN approach is a computationally inexpensive means to ensure greater consistency in cloud retrievals, and therefore broadband flux derivation, based on GOES-17 measurements.

Benjamin Scarino↗
DOE OSTI2023

Incorporation of aerosol into the COSPv2 satellite lidar simulator for climate model evaluation

Abstract. Atmospheric aerosol has substantial impacts on climate, air quality and biogeochemical cycles, and its concentrations are highly variable in space and time. A key variability to evaluate within models that simulate aerosol is the vertical distribution, which influences atmospheric heating profiles and aerosol–cloud interactions, to help constrain aerosol residence time and to better represent the magnitude of simulated impacts. To ensure a consistent comparison between modeled and observed vertical distribution of aerosol, we implemented an aerosol lidar simulator within the Cloud Feedback Model Intercomparison Project (CFMIP) Observation Simulator Package version 2 (COSPv2). We assessed the attenuated total backscattered (ATB) signal and the backscatter ratios (SRs) at 532 nm in the U.S. Department of Energy's Energy Exascale Earth System Model version 1 (E3SMv1). The simulator performs the computations at the same vertical resolution as the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP), making use of aerosol optics from the E3SMv1 model as inputs and assuming that aerosol is uniformly distributed horizontally within each model grid box. The simulator applies a cloud masking and an aerosol detection threshold to obtain the ATB and SR profiles that would be observed above clouds by CALIOP with its aerosol detection capability. Our analysis shows that the aerosol distribution simulated at a seasonal timescale is generally in good agreement with observations. Over the Southern Ocean, however, the model does not produce the SR maximum as observed in the real world. Comparison between clear-sky and all-sky SRs shows little differences, indicating that the cloud screening by potentially incorrect model clouds does not affect the mean aerosol signal averaged over a season. This indicates that the differences between observed and simulated SR values are due not to sampling errors, but to deficiencies in the representation of aerosol in models. Finally, we highlight the need for future applications of lidar observations at multiple wavelengths to provide insights into aerosol properties and distribution and their representation in Earth system models.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2006

Percentage Contributions from Atmospheric and Surface Features to Computed Brightness Temperatures

Over the past few years, there has become an increasing interest in the use of millimeter-wave (mm-wave) and sub-millimeter-wave (submm-wave) radiometer observations to investigate the properties of ice particles in clouds. Passive radiometric channels respond to both the integrated particle mass throughout the volume and field of view, and to the amount, location, and size distribution of the frozen (and liquid) particles with the sensitivity varying for different frequencies and hydrometeor types. One methodology used since the 1960's to discern the relationship between the physical state observed and the brightness temperature (TB) is through the temperature weighting function profile. In this research, the temperature weighting function concept is exploited to analyze the sensitivity of various characteristics of the cloud profile, such as relative humidity, ice water path, liquid water path, and surface emissivity. In our numerical analysis, we compute the contribution (in Kelvin) from each of these cloud and surface characteristics, so that the sum of these various parts equals the computed TB. Furthermore, the percentage contribution from each of these characteristics is assessed. There is some intermingling/contamination of the contributions from various components due to the integrated nature of passive observations and the absorption and scattering between the vertical layers, but all in all the knowledge gained is useful. This investigation probes the sensitivity over several cloud classifications, such as cirrus, blizzards, light snow, anvil clouds, and heavy rain. The focus is on mm-wave and submm-wave frequencies, however discussions of the effects of cloud variations to frequencies as low as 10 GHz and up to 874 GHz will also be presented. The results show that nearly 60% of the TB value at 89 GHz comes from the earth's surface for even the heaviest blizzard snow rates. On the other hand, a significant percentage of the TB value comes from the snow in the cloud for 166, and 183 plus or minus 7 GHz for the heavy and medium snow rates. For submm-wave channels, there is no contribution from the surface because these channels cannot probe through clouds, nor normal water vapor amounts in clear air regions. This work is extremely valuable in physically-based retrieval algorithm development research.

Gail Skofronick-Jackson↗
DOE OSTI2023

Optimizing cloud motion estimation on the edge with phase correlation and optical flow

Abstract. Phase correlation (PC) is a well-known method for estimating cloud motion vectors (CMVs) from infrared and visible spectrum images. Commonly, phase shift is computed in the small blocks of the images using the fast Fourier transform. In this study, we investigate the performance and the stability of the blockwise PC method by changing the block size, the frame interval, and combinations of red, green, and blue (RGB) channels from the total sky imager (TSI) at the United States Atmospheric Radiation Measurement user facility's Southern Great Plains site. We find that shorter frame intervals, followed by larger block sizes, are responsible for stable estimates of the CMV, as suggested by the higher autocorrelations. The choice of RGB channels has a limited effect on the quality of CMVs, and the red and the grayscale images are marginally more reliable than the other combinations during rapidly evolving low-level clouds. The stability of CMVs was tested at different image resolutions with an implementation of the optimized algorithm on the Sage cyberinfrastructure test bed. We find that doubling the frame rate outperforms quadrupling the image resolution in achieving CMV stability. The correlations of CMVs with the wind data are significant in the range of 0.38–0.59 with a 95 % confidence interval, despite the uncertainties and limitations of both datasets. A comparison of the PC method with constructed data and the optical flow method suggests that the post-processing of the vector field has a significant effect on the quality of the CMV. The raindrop-contaminated images can be identified by the rotation of the TSI mirror in the motion field. The results of this study are critical to optimizing algorithms for edge-computing sensor systems.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2012

Rainbow Fourier Transform

We present a novel technique for remote sensing of cloud droplet size distributions. Polarized reflectances in the scattering angle range between 135deg and 165deg exhibit a sharply defined rainbow structure, the shape of which is determined mostly by single scattering properties of cloud particles, and therefore, can be modeled using the Mie theory. Fitting the observed rainbow with such a model (computed for a parameterized family of particle size distributions) has been used for cloud droplet size retrievals. We discovered that the relationship between the rainbow structures and the corresponding particle size distributions is deeper than it had been commonly understood. In fact, the Mie theory-derived polarized reflectance as a function of reduced scattering angle (in the rainbow angular range) and the (monodisperse) particle radius appears to be a proxy to a kernel of an integral transform (similar to the sine Fourier transform on the positive semi-axis). This approach, called the rainbow Fourier transform (RFT), allows us to accurately retrieve the shape of the droplet size distribution by the application of the corresponding inverse transform to the observed polarized rainbow. While the basis functions of the proxy-transform are not exactly orthogonal in the finite angular range, this procedure needs to be complemented by a simple regression technique, which removes the retrieval artifacts. This non-parametric approach does not require any a priori knowledge of the droplet size distribution functional shape and is computationally fast (no look-up tables, no fitting, computations are the same as for the forward modeling).

Alexandrov, Mikhail D.↗
NASA NTRS1984

Microwave radiances from precipitating clouds containing aspherical ice, combined phase, and liquid hydrometeors

A numerical algorithm based on Eddington's second approximation to the equation of radiative transfer has been developed in order to compute the radiances with horizontal and vertical polarization that emerge from precipitating clouds. This algorithm yields a rapid solution to problems pertaining to clouds with vertically inhomogeneous structure. Precipitating clouds containing liquid, mixtures of phases, and ice hydrometeors are modelled. It is shown that the lower-frequency radiances are sensitive to liquid precipitation at low altitudes while the higher-frequency radiances are more sensitive to the ice hydrometeors at the cloud tops. The extinction coefficients of aspherical hydrometeors are presented as a function of rainfall rates. The fact that vertically polarized radiances are warmer than horizontally polarized ones at high rainfall rates, with the difference diminishing at lower frequencies, is due to aspherical ice hydrometeors in the upper regions of precipitating clouds.

Wu, R.↗
NASA NTRS2007

3D Aerosol-Cloud Radiative Interaction Observed in Collocated MODIS and ASTER Images of Cumulus Cloud Fields

3D aerosol-cloud interaction is examined by analyzing two images containing cumulus clouds in biomass burning regions in Brazil. The research consists of two parts. The first part focuses on identifying 3D clo ud impacts on the reflectance of pixel selected for the MODIS aerosol retrieval based purely on observations. The second part of the resea rch combines the observations with radiative transfer computations to identify key parameters in 3D aerosol-cloud interaction. We found that 3D cloud-induced enhancement depends on optical properties of nearb y clouds as well as wavelength. The enhancement is too large to be ig nored. Associated biased error in 1D aerosol optical thickness retrie val ranges from 50% to 140% depending on wavelength and optical prope rties of nearby clouds as well as aerosol optical thickness. We caution the community to be prudent when applying 1D approximations in comp uting solar radiation in dear regions adjacent to clouds or when usin g traditional retrieved aerosol optical thickness in aerosol indirect effect research.

Wen, Guoyong↗
NASA NTRS2024

Correction of Cloud Optical Thickness Retrievals from Nadir Reflectances in the Presence of 3D Radiative Effects. Part I: Concept and Tests on 3D RT Simulations

3D effects cause substantial underestimation of cloud optical thickness (COT) in airborne and satellite retrievals based on 1D radiative transfer computations (such as in the case of widely used bispectral technique). For a single-layer isolated cloud we propose a simple linear correction of the retrieved COT with the renormalization factor dependent on the cloud’s aspect ratio (the ratio between vertical and horizontal dimensions of the cloud). This is an empirical assumption which we successfully test using synthetic 3D RT data. We introduce a heuristic “block model” of 3D radiative effects and show that the functional form of the renormalization factor is consistent with the process of radiation escape from cloud sides in an essentially 3D geometry. We also extend the block model to the case of single-layer broken cloud field with radiative interaction between the neighboring clouds. In this case the renormalization factor depends also on the distance between clouds.

cloud optical thickness↗
NASA NTRS2015

Advanced Computing Support at NASA Advanced Supercomputing (NAS) Division

NAS (NASA Advanced Supercomputing) Division: Advanced Computing: High-End Computing Capability (HECC) Project; Quantum Artificial Intelligence Lab (QuAIL); NASA Earth Exchange (NEX); Data Analytics Infrastructure for NASA; Cloud Services for Science & Engineering Projects.

Advanced Computing↗
NASA NTRS2014

Effects of Nonsphericity on the Behavior of Lorenz-Mie Resonances in Scattering Characteristics of Liquid-Cloud Droplets

By using the results of highly accurate T-matrix computations for randomly oriented oblate and prolate spheroids and Chebyshev particles with varying degrees of asphericity, we analyze the effects of a deviation of water-droplet shapes from that of a perfect sphere on the behavior of Lorenz-Mie morphology-dependent resonances of various widths. We demonstrate that the positions and profiles of the resonances can change significantly with increasing asphericity. The absolute degree of asphericity required to suppress a Lorenz-Mie resonance is approximately proportional to the resonance width. Our results imply that numerical averaging of scattering characteristics of real cloud droplets over sizes may rely on a significantly coarser size-parameter resolution than that required for ideal, perfectly spherical particles.

matrices (mathematics)↗
NASA NTRS1989

Neptune's Triton: A moon rich in dry ice and carbon

The encounter of the spacecraft Voyager 2 with Neptune and its large satellite Triton in August 1989 will provide a crucial test of ideas regarding the origin and chemical composition of the outer solar system. In this pre-encounter publication, the possibility is quantified that Titron is a captured moon which, like Pluto and Charon, originally condensed as a major planetesimal within the gas ring that was shed by the contracting protosolar cloud at Neptune's orbit. Ideas of supersonic convective turbulence are used to compute the gas pressure, temperature and rat of catalytic synthesis of CH4, CO2, and C(s) within the protosolar cloud, assuming that all C is initially present as CO. The calculations lead to a unique composition for Triton, Pluto, Charon: each body consists of, by mass, 18 1/2 percent solid CO2 ice, 4 percent graphite, 1/2 percent CH4 ice, 29 percent methanated water ice and 48 percent of anhydrous rock. This mix has a density consistent with that of the Pluto-Charon system and yields a predicted mean density for Triton of 2.20 + or - 0.5 g/cu cm, for satellite radius equal to 1,750 km.

Prentice, A. J. R.↗
NASA NTRS1972

Tornado occurrences related to overshooting cloud-top heights as determined from ATS pictures

A sequence of ATS 3 pictures including the development history of large anvil clouds near Salina, Kansas was enlarged by NASA into 8X negatives which were used to obtain the best quality prints by mixing scan lines in 8 steps to minimize checker-board patterns. These images resulted in the best possible resolution, permitting use to compute the heights of overshooting tops above environmental anvil levels based on cloud shadow relationships along with the techniques of lunar topographic mapping. Of 39 heights computed, 6 were within 15 miles of reported positions of 3 tornadoes. It was found that the tornado proximity tops were mostly less than 5000 ft, with one exception of 7000 ft, suggesting that tornadoes are most likely to occur when overshooting height decreases. In order to simulate surface vortices induced by cloud-scale rotation and updraft fields, a laboratory model was constructed. The model experiment has shown that the rotation or updraft field induces a surface vortex but their combination does prevent the formation of the surface vortex. This research leads to a conclusion that the determination of the cloud-top topography and its time variation is of extreme importance in predicting severe local storms for a period of 0 to 6 hours.

Fujita, T. T.↗