Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Cloud Implementation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

A Public-Private-Acadmic Partnership to Advance Solar Power Forecasting

The National Center for Atmospheric Research (NCAR) is pleased to have led a partnership to advance the state-of-the-science of solar power forecasting by designing, developing, building, deploying, testing, and assessing the SunCast™ Solar Power Forecasting System. The project has included cutting edge research, testing in several geographically- and climatologically-diverse high penetration solar utilities and Independent System Operators (ISOs), and wide dissemination of the research results to raise the bar on solar power forecasting technology. The partners include three other national laboratories, six universities, and industry partners. This public-private-academic team has worked in concert to perform use-inspired research to advance solar power forecasting through cutting-edge research to advance both the necessary forecasting technologies and the metrics for evaluating them. The project has culminated in a year-long, full-scale demonstration of provide irradiance and power forecasts to utilities and ISOs to use in their operations. The project focused on providing elements of a value chain, beginning with the weather that causes a deviation from clear sky irradiance and progresses through monitoring and observations, modeling, forecasting, dissemination and communication of the forecasts, interpretation of the forecast, and through decision-making, which produces outcomes that have an economic value. The system has been evaluated using metrics developed specifically for this project, which has provided rich information on model and system performance. Research was accomplished on the very short range (0-6 hours) Nowcasting system as well as on the longer term (6-72 hour) forecasting system. The shortest range forecasts are based on observations in the field. The shortest range system, built by Brookhaven National Laboratory (BNL) and based on Total Sky Imagers (TSIs) is TSICast, which operates on the shortest time scale with a latency of only a few minutes and forecasts that currently go out to about 15 min. This project has facilitated research in improving the hardware and software so that the new high definition cameras deployed at multiple nearby locations allow discernment of the clouds at varying levels and advection according to the winds observed at those levels. Improvements over “smart persistence” are about 29% for even these very short forecasts. StatCast is based on pyranometer data measured at the site as well as concurrent meteorological observations and forecasts. StatCast is based on regime-dependent artificial intelligence forecasting techniques and has been shown to improve on “smart persistence” forecasts by 15-50%. A second category of short-range forecasting systems employ satellite imagery and use that information to discern clouds and their motion, allowing them to project the clouds, and the resulting blockage of irradiance, in time. CIRACast (the system produced by the Cooperative Institute for Atmospheric Research [CIRA] at Colorado State University) was already one of the more advanced cloud motion systems, which is the reason that team was brought to this project. During the project timeframe, the CIRA team was able to advance cloud shadowing, parallax removal, and implementation of better advecting winds at different altitudes. CIRACast shows generally a 25-40% improvement over Smart Persistence between sunrise and approximately 1600 UTC (Coordinated Universal Time) . A second satellite-based system, MADCast (Multi-sensor Advective Diffusive foreCast system), assimilates data from multiple satellite imagers and profilers to assimilate a fully three-dimensional picture of the cloud into the dynamic core of WRF. During 2015, MADCast (provided at least 70% improvement over Smart Persistence, with most of that skill being derived during partly cloudy conditions. That allows advection of the clouds via the Weather Research and Forecasting (WRF) model dynamics directly. After WRF-Solar™ showed initial success, it was also deployed in nowcasting mode with coarser runs out to 6 hours made hourly. It provided improvements on the order of 50-60% over Smart Persistence for forecasts up to 1600 UTC. The advantages of WRF-Solar-Nowcasting and MADCast were then blended to develop the new MAD-WRF model that incorporates the most important features of each of those models, both assimilating satellite cloud fields and using WRF-So far physics to develop and dissipate clouds. MAE improvements for MAD-WRF for forecasts from 3-6 hours are improved over WRF-Solar-Now by 20%. While all the Nowcasting system components by themselves provide improvement over Smart Persistence, the largest benefit is derived when they are smartly blended together by the Nowcasting Integrator to produce an integrated forecast. The development of WRF-Solar™ under this project has provided the first numerical weather prediction (NWP) model specifically designed to meet the needs of irradiance forecasting. The first augmentation improved the solar tracking algorithm to account for deviations associated with the eccentricity of the Earth’s orbit and the obliquity of the Earth. Second, WRF-Solar™ added the direct normal irradiance (DNI) and diffuse (DIF) components from the radiation parameterization to the model output. Third, efficient parameterizations were implemented to either interpolate the irradiance in between calls to the expensive radiative transfer parameterization, or to use a fast radiative transfer code that avoids computing three-dimensional heating rates but provides the surface irradiance. Fourth, a new parameterization was developed to improve the representation of absorption and scattering of radiation by aerosols (aerosol direct effect). A fifth advance is that the aerosols now interact with the cloud microphysics, altering the cloud evolution and radiative properties, an effect that has been traditionally only implemented in atmospheric computationally costly chemistry models. A sixth development accounts for the feedbacks that sub-grid scale clouds produce in shortwave irradiance as implemented in a shallow cumulus parameterization Finally, WRF-Solar™ also allows assimilation of infrared irradiances from satellites to determine the three dimensional cloud field, allowing for an improved initialization of the cloud field that increases the performance of short-range forecasts. We find that WRF-Solar™ can improve clear sky irradiance prediction by 15-80% over a standard version of WRF, depending on location and cloud conditions. In a formal comparison to the NAM baseline, WRF-Solar™ showed improvements in the Day-Ahead forecast of 22-42%. The SunCast™ system requires substantial software engineering to blend all of the new model components as well as existing publically available NWP model runs. To do this we use an expert system for the Nowcasting blender and the Dynamic Integrated foreCast (DICast®) system for the NWP models. These two systems are then blended, we use an empirical power conversion method to convert the irradiance predictions to power, then apply an analog ensemble (AnEn) approach to further tune the forecast as well as to estimate its uncertainty. The AnEn module decreased RMSE (root mean squared error) by 17% over the blended SunCast™ power forecasts and provided skill in the probabilistic forecast with a Brier Skill Score of 0.55. In addition, we have also developed a Gridded Atmospheric Forecast System (GRAFS) in parallel, leveraging cost share funds. An economic evaluation based on Production Cost Modeling in the Public Service Company of Colorado showed that the observed 50% improvement in forecast accuracy will save their customers $819,200 with the projected MW deployment for 2024. Using econometrics, NCAR has scaled this savings to a national level and shown that an annual expected savings for this 50% forecast error reduction ranges from $11M in 2015 to $43M expected in 2040 with increased solar deployment. This amounts to a $455M discounted savings over the 26 year period of analysis.

14 SOLAR ENERGY↗

A Fine-grained Asynchronous Bulk Synchronous parallelism model for PGAS applications

The Partitioned Global Address Space (PGAS) model is well suited for executing irregular applications on cluster-based systems, due to its efficient support for short, one-sided messages. Separately, the actor model has been gaining popularity as a productive asynchronous message-passing approach for distributed objects in enterprise and cloud computing platforms, typically implemented in languages such as Erlang, Scala or Rust. To the best of our knowledge, there has been no past work on using the actor model to deliver both productivity and scalability to irregular PGAS applications with large number of small messages. In this paper, we introduce a new programming system for PGAS applications, in which point-to-point remote operations can be expressed as fine-grained asynchronous actor messages. In our approach, the programmer does not need to worry about programming complexities related to message aggregation and termination detection. Our approach can be viewed as extending the classical Bulk Synchronous Parallelism model with fine-grained asynchronous communications within a phase or superstep. Here, we believe that our approach offers a desirable point in the productivity-performance space for PGAS applications, with more scalable performance and higher productivity relative to past approaches. Specifically, for seven irregular mini-applications from the Bale Kernels and three graph kernels executed using 2048 cores in the NERSC Cori system, our approach shows geometric mean performance improvements of ≥ 20X relative to standard PGAS versions (UPC and OpenSHMEM) while maintaining comparable productivity to those versions.

97 MATHEMATICS AND COMPUTING↗

A new framework to map fine resolution cropping intensity across the globe: Algorithm, validation, and implication

We report accurate estimation of cropping intensity (CI), an indicator of food production, is well aligned with the ongoing efforts to achieve sustainable development goals (SDGs) under diminishing natural resources. The advancement in satellite remote sensing provides unprecedented opportunities for capturing CI information in a spatially continuous manner. However, challenges remain due to the lack of generalizable algorithms for accurately and efficiently mapping global CI with a fine spatial resolution. In this study, we developed a 30-m planetary-scale CI mapping framework with the reconstructed time series of Normalized Difference Vegetation Index (NDVI) from multiple satellite images. Using a binary crop phenophase profile indicating growing and non-growing periods, we estimated pixel-by-pixel CI by enumerating the total number of valid cropping cycles during the study years. Based on the Google Earth Engine cloud computing platform, we implemented the framework to estimate CI during 2016–2018 in eight geographic regions across continents that are representative of global cropping system diversity. Comparison with PhenoCam network data in four cropland sites suggests that the proposed framework is capable of capturing the seasonal dynamics of cropping practices. Spatially, overall accuracies based on validation samples range from 80.0% to 98.9% across different regions worldwide. Regarding the CI classes, single cropping systems are associated with more robust and less biased estimations than multiple cropping systems. Finally, our CI estimates reveal high agreement with two widely used land surface phenology products, including Vegetation Index and Phenology V004 (VIP4) and Moderate Resolution Imaging Spectroradiometer Land Cover Dynamics (MCD12Q2), meanwhile providing much more spatial details. Due to its robustness, the developed CI framework can be potentially generalized to produce global fine resolution CI products for food security and other applications.

54 ENVIRONMENTAL SCIENCES↗

Design and implementation of a prototype data system for earth radiation budget, cloud, aerosol, and chemistry data

Activities at the NASA Langley Research Center's distributed active archive centers (DAACs) intended to capitalize on existing centers of scientific expertise and to prevent a single point of failure are described. A Version 0 Langley DAAC, a prototype of an Earth Observing System Data and Information System, started archiving and distributing existing datasets on the earth's radiation budget, clouds, aerosols, and tropospheric chemistry in late 1992. The major goals of the LaRC Version 0 effort include to enhance scientific use of existing data; to develop institutional expertise in maintaining and distributing data; to encourage cooperative interagency and international involvement with datasets and research; and to use institutional capability for processing data from previous missions to prepare for processing the future EOS satellite data.

Baum, Bryan A.↗

Reduction of PMT Signal-Induced Noise in Lidar Receivers

Signal-induced noise is generated when a photomultiplier tube (PMT) is subjected to an intense light pulse. The PMT signal does not return to the dark current level after the signal is removed, but decays slowly (i.e., signal-induced noise). This is of practical significance for DIAL (Differential Absorption lidar) measurements where signal-induced noise decays are superimposed on the on-line (absorption) and off-line signals. Errors in the ozone density calculation result for stratosphere measurements. Other researchers have implemented mechanical choppers that block the intense pulse which may be from near field return scattering or scattering from a cloud. This configuration cannot be implemented for the DIAL system employed for aircraft measurements since the on-line and off-line pulses are 300 microseconds apart. A scheme has been developed in this study to electronically attenuate the signal induced noise. A ring electrode, external to the PMT photocathode, is utilized to perturb the electron trajectories between the photocathode and the first dynode. This effect has been used for position sensitive PMTs and suggested for gating PMTS.

Williamson, Cynthia K.↗

Studies for the Europagenic Plasma Source in Jupiter's Inner Magnetosphere during the Galileo Europa Mission

Progress in research to understand the three-dimensional nature of the Europagenic plasma torus is summarized. Efforts to improve the plasma torus description near Europa's orbit have included a better understanding of Europa's orbit and an improved description of the planetary magnetic field. New plasma torus chemistry for molecular and atomic species has been introduced and implemented in Europa neutral cloud models. Preliminary three-dimensional model calculations for Europa's neutral clouds and their plasma sources are presented.

Smyth, William H.↗

CloudSat system engineering: techniques that point to a future success

Over the past three years the CloutSat Project, a NASA Earth System Science Pathfinder mission to provide from space the first global survey of cloud profiles and cloud physical properties, has implemented a successful project system engineering approach. Techniques learned through heuristic reasoning of past project events and professional experience were applied along with select methods recently touted to increase effectiveness without compromising effiency.

CloudSat system engineering project management↗

Fast Simulators for Satellite Cloud Optical Centroid Pressure Retrievals, 1. Evaluation of OMI Cloud Retrievals

We have developed a relatively simple scheme for simulating retrieved cloud optical centroid pressures (OCP) from satellite solar backscatter observations. We have compared simulator results with those from more detailed retrieval simulators that more fully account for the complex radiative transfer in a cloudy atmosphere. We used this fast simulator to conduct a comprehensive evaluation of cloud OCPs from the two OMI algorithms using collocated data from CloudSat and Aqua MODIS, a unique situation afforded by the A-train formation of satellites. We find that both OMI algorithms perform reasonably well and that the two algorithms agree better with each other than either does with the collocated CloudSat data. This indicates that patchy snow/ice, cloud 3D, and aerosol effects not simulated with the CloudSat data are affecting both algorithms similarly. We note that the collocation with CloudSat occurs mainly on the East side of OMI's swath. Therefore, we are not able to address cross-track biases in OMI cloud OCP retrievals. Our fast simulator may also be used to simulate cloud OCP from output generated by general circulation models (GCM) with appropriate account of cloud overlap. We have implemented such a scheme and plan to compare OMI data with GCM output in the near future.

Joiner, J.↗

Cognitive Communications and Networking Technology Infusion Study Report

As the envisioned next-generation SCaN Network transitions into an end-to-end “system of systems” with new enabling capabilities, it is anticipated that the introduction of machine learning, artificial intelligence, and other cognitive strategies into the network infrastructure will result in increased mission science return, improved resource efficiencies, and increased autonomy and reliability. This enhanced set of cognitive capabilities will be implemented via a “space cloud” concept to achieve a service-oriented architecture with distributed cognition, de-centralized routing, and shared, on-orbit data processing. The enabling cognitive communications and networking capabilities that may facilitate the desired network enhancements are identified in this document, and the associated enablers of these capabilities, such as technologies and standards, are described in detail.

Knoblock, Eric J.↗

A Fast All-Sky Radiation Model for Solar Applications with Narrowband Irradiances on Tilted Surfaces (FARMS-NIT): Part II. The Cloudy-Sky Model

The Fast All-sky Radiation Model for Solar applications with Narrowband Irradiances on Tilted surfaces (FARMSNIT) reported in Part I of this study is enhanced to include the requirements for cloudy-sky conditions. Surface radiances in 2002 narrow-wavelength bands from 0.28 to 4.0 μm are analytically computed by solving the radiative transfer equation for five independent photon paths accounting for clear-sky absorption, Rayleigh scattering, and cloud absorption and scattering. The Simple Model of the Atmospheric Radiative Transfer of Sunshine (SMARTS) is used to provide the optical thickness of the clear-sky atmosphere. Unlike Part I, which approximates the computation of aerosol scattering using the single-scattering phase function, the cloud transmittance and reflectance are efficiently retrieved from a comprehensive look-up table pre-computed by a 32-stream DIScrete Ordinates Radiative Transfer (DISORT) model for possible cloud conditions as well as solar and viewing geometries. A resolution analysis is performed to assess the optimal balance between the computational efficiency and accuracy in the development of the look-up table. Model simulations by DISORT and TMYSPEC are used to evaluate the performance of FARMS-NIT under cloudy-sky conditions. Compared to DISORT, FARMS-NIT yields 2–3% uncertainties on average, but it substantially reduces the computational time because of the independent computation of cloud properties and the implementation of the look-up table. In contrast to TMYSPEC, which uses successive steps to empirically compute plane-of-array (POA) irradiances and spectral irradiances, FARMS-NIT directly solves spectral radiances from the radiative transfer equation, which profoundly increases the accuracy in surface irradiances, especially over inclined photovoltaics (PV) panels.

Xie, Yu↗

The influence of cloud cover on the reliability of satellite-based solar resource data

Satellite-based solar resource data are often developed and validated by using binary cloudiness categories: clear sky or overcast cloudy sky. To investigate the reliability of solar resource data in partially cloudy conditions, we estimate cloud fraction using two distinct algorithms: a physical retrieval model using surface observed global horizontal irradiance (GHI) and direct normal irradiance (DNI) and a temporal average of cloud mask data estimated by the observed DNI. Our analysis reveals a significant presence of scattered clouds, broken clouds, and mismatches between satellite- and surface-based cloud data at 17 surface sites across the contiguous United States, though confidently clear and cloudy conditions collectively account for more than 70 % of the data. Solar radiation is computed using the National Solar Radiation Database (NSRDB) algorithm and validated using surface observations. Here, our findings suggest that, in the presence of scattered clouds, NSRDB data for clear-sky conditions can be subject to significant overestimation. In cloudy-sky conditions classified by satellite data, DNI computed by the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI) can be underestimated when limited clouds are detected by surface observations. The bias observed in several cloudiness categories indicates that the NSRDB is exceptionally accurate in confidently clear conditions. However, clear-sky conditions with scattered clouds and mismatched cloud data contribute significantly to the overall uncertainties in the NSRDB. Therefore, future improvements in solar resource data should involve development and implementation of satellite-derived cloud fraction and should consider a novel radiative transfer model accounting for amplified cloud reflection. The evaluation within cloudiness categories also provides a physical rationale for the superior performance of FARMS-DNI compared to the Direct Insolation Simulation Code (DISC) in both cloudy-sky and all-sky conditions.

14 SOLAR ENERGY↗

Cloud optical depth and liquid effective radius retrievals from SPHOT zenith radiances

A new three-channel (440, 870, and 1640 nm) retrieval algorithm for cloud optical depth has recently been developed by Christine Chiu and her co-workers [Chiu et al., 2012]. This VAP is to implement the three-channel cloud optical depth retrieval algorithm as an ARM operational VAP. First, simultaneously retrieved cloud optical depth and effective radius datasets will be generated by using the pre-calibrated zenith radiance measurements taken from the ARM Sun-Photometer (SPHOT) and the NASA AERONET and Satellite-based surface albedo derived from MODSI. Finally, the algorithm produces uncertainties along with the retrieval products. This VAP outputs a daily NetCDF file.

54 ENVIRONMENTAL SCIENCES↗

Understanding cloud droplet spectral dispersion effect using empirical and semi-analytical parameterizations in NCAR CAM5.3

Five parameterizations of cloud droplet spectral shape are implemented in a global climate model to investigate the dispersion effect and aerosol indirect effect (AIE). We design a series of experiments by modifying the microphysical cloud scheme of NCAR CAM5.3 (Community Atmospheric Model Version 5.3). We employ four empirical (Martin94, RLiu03, PengL03, Liu08) and one semi-analytical (LiuLi15) expressions for cloud droplet spectral shape parameters. Analysis focuses on the instantaneous differences in the simulated cloud microphysical properties and the comparison between model output and satellite data. The results show that RLiu03, PengL03 and LiuLi15 produce wider droplet spectrum and faster autoconversion rate, but Liu08 has a narrower droplet spectrum and slower autoconversion rate than the default parameterization (Martin94) in CAM5.3. Global dispersion effects caused by the five parameterizations modify the aerosol indirect effect by -10% (counteract) to 13% (strengthen). The simulated AIEs and dispersion effects exhibit noticeably spatial inhomogeneity. In the sensitive regions of AIE (Southeast Asia, North Pacific and west coast of South America), we decompose the response of shortwave cloud forcing to the change in droplet number for analysis. The varying dispersion effects can be explained by different responses of cloud properties in different spectral parameterizations.

54 ENVIRONMENTAL SCIENCES↗

A new WRF-Chem treatment for studying regional-scale impacts of cloud processes on aerosol and trace gases in parameterized cumuli

A new treatment of cloud effects on aerosol and trace gases within parameterized shallow and deep convection, and aerosol effects on cloud droplet number, has been implemented in the Weather Research and Forecasting model coupled with Chemistry (WRF-Chem) version 3.2.1 that can be used to better understand the aerosol life cycle over regional to synoptic scales. The modifications to the model include treatment of the cloud droplet number mixing ratio; key cloud microphysical and macrophysical parameters (including the updraft fractional area, updraft and downdraft mass fluxes, and entrainment) averaged over the population of shallow clouds, or a single deep convective cloud; and vertical transport, activation/resuspension, aqueous chemistry, and wet removal of aerosol and trace gases in warm clouds. These changes have been implemented in both the WRF-Chem chemistry packages as well as the Kain–Fritsch (KF) cumulus parameterization that has been modified to better represent shallow convective clouds. Testing of the modified WRF-Chem has been completed using observations from the Cumulus Humilis Aerosol Processing Study (CHAPS). The simulation results are used to investigate the impact of cloud–aerosol interactions on regional-scale transport of black carbon (BC), organic aerosol (OA), and sulfate aerosol. Based on the simulations presented here, changes in the column-integrated BC can be as large as –50% when cloud–aerosol interactions are considered (due largely to wet removal), or as large as +40% for sulfate under non-precipitating conditions due to sulfate production in the parameterized clouds. The modifications to WRF-Chem are found to account for changes in the cloud droplet number concentration (CDNC) and changes in the chemical composition of cloud droplet residuals in a way that is consistent with observations collected during CHAPS. Efforts are currently underway to port the changes described here to the latest version of WRF-Chem, and it is anticipated that they will be included in a future public release of WRF-Chem.

54 ENVIRONMENTAL SCIENCES↗

Container Factories in the Oak Ridge Research Cloud

This technical report describes an implementation of a devops container factory utilizing ORNL ResearchCloud (ORC) birthright resources. Any researcher or project can implement the strategy described here fortheir CI/CD needs. This is a technology demonstration of using rootless podman as a direct replacementfor docker in a GitLab CI/CD context to enhance security. It is also a stepping stone towardsimplementation of the containerized software factory described in the DoD Enterprise DevSecOpsReference Design.

97 MATHEMATICS AND COMPUTING↗

Scaling a Podman Container Factory in the Cloud

This technical report describes an implementation of a scalable continuous integration/continuous deployment infrastructure using Microsoft Azure™ and GitLab™ resources. We utilize GitLab continuous integration podman executors to provide rootless container operations in both privileged and unprivileged modes of operation. We utilize the GitLab Fleeting plugin for Azure to manage the scaling of continuous integration execution resources. This creates a scalable, rootless, and isolate continuous integration/continuous deployment job execution infrastructure.

97 MATHEMATICS AND COMPUTING↗

Seasonal Predictability of Cloud Droplet Number Concentration

Aerosol emissions modify the properties of clouds hence impacting climate. The aerosol indirect effect may have offset part of the global warming caused by anthropogenic greenhouse gas emissions during the industrial era. It however remains unclear whether the same effect is significant over time scales relevant for seasonal and weather climate prediction. Answering such a question has been difficult since most weather prediction systems lack a proper representation of the aerosol evolution and transport and their interaction with clouds. Even in advanced systems it is not clear to what extent cloud microphysical properties are predictable over subseasonal to seasonal time scales. Such an issue is addressed in this study. We use a set of 30 year, four ensemble member, 9 month lead hindcast simulations of the NASA GEOS seasonal prediction system (GEOS-S2S) to study the predictability of cloud droplet number concentration in warm stratocumulus clouds. The latest version GEOS-S2S system implements interactive aerosol as well as a two moment cloud microphysics scheme therefore it is suitable for studying the aerosol indirect effect on climate. Long term retrievals from the MODIS (Moderate Resolution Imaging Spectroradiometer) are used to validate the model predictions and assess its skill in predicting cloud droplet number concentration.

Barahona, Donifan↗