Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “CLOUD DATA”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

The application of satellite data in the determination of ocean temperatures and cloud characteristics and statistics

The author has identified the following significant results. The major shortcoming of the data was the loss of the infrared radiances from the S191 spectrometer. The cloud thermodynamic phase determination procedure was derived and tested with the data collected by the S192 multispectral scanner. Results of the test indicate a large fraction of the data could be classified thermodynamically. An added bonus was the inclusion of snow in the classification approach. The conclusion to be drawn from this portion of the effort is that in most cases considered ice clouds, liquid water droplet clouds, and snow fields can be spectroscopically separated to a high degree of accuracy.

Curran, R. J.↗

NASA/GEWEX SRB Surface Radiation Budget Fluxes Through the Prism of Weather States

The NASA/GEWEX Surface Radiation Budget Version 4 (SRB Rel4) product is now publicly available, covering the period from July 1983 through June 2017. This supersedes the SRB Rel3 (Stackhouse et al., 2011) product which has been used in the community for a wide variety of applications, including climate model validation, agriculture, solar energy, and architecture. SRB Rel4 uses the newly recalibrated and processed ISCCP HXS product as its primary input for cloud and radiance data, replacing ISCCP DX with a ninefold increase in pixel count (10km instead of 30km). This version retains a 1°x1° resolution but benefits from a much larger number of samples per grid box than the SRB Rel3. ISCCP also provides an atmospheric temperature and moisture dataset known as nnHIRS which we use here, along with Seaflux and Landflux surface and near-surface meteorological parameters. Rel4 incorporates several important algorithm improvements. These include recalculated shortwave (SW) atmospheric transmissivities and reflectivities yielding a somewhat less transmissive atmosphere. Both shortwave and longwave (LW) now also include variable aerosol composition and radiative properties, allowing for the use of a detailed aerosol history from the Max Planck Institute Aerosol Climatology (MACv1). LW and SW algorithms now produce pristine sky fluxes, allowing the aerosol flux effects to be quantified. For SW, ocean albedo and snow/ice albedo are improved from Release 3. Total solar irradiance is now variable, and reduced to an average of 1361 Wm-2. The radiative treatment of ice cloud is improved. For the LW, a climatological monthly varying spectral surface emissivity is added. Here we evaluate the SRB Rel4 top of atmosphere (TOA) and surface fluxes in the context of weather states and oceanic regions. Weather states (Tselioudis et al., 2013, Tselioudis et al., 2021) are defined by K-means clustering 2-D histograms of satellite-retrieved cloud optical depths and cloud top pressures. The most recent (Tselioudis et al., 2021) weather states derived from the International Satellite Cloud Climatology Project (ISCCP) H-series data results in eight cloud weather states and one clear sky weather state, for a total of nine weather states. We examine the statistics of SRB Rel4 fluxes for each weather state and a variety of relevant land and ocean regions. We compare to similar analyses performed on CERES EBAF and SYN1Deg flux products, and validate against Baseline Surface Radiometer Network (BSRN) land stations and Pacific Marine Environmental Laboratory (PMEL) ocean buoy data. It is demonstrated that the weather state concept is valuable when examining the comparative strengths and weaknesses of satellite radiative flux algorithms.

Atmospheric Radiation↗

Comparison of lightning location data and polarisation radar observations of clouds

Simultaneous observations of both the precipitation and the lightning associated with thunderstorms show that the lightning is within 3 km of the maximum precipitation echo. The intensity and type of the precipitation is observed with 500 m spatial accuracy using an S-band polarization radar and the position of the lightning is inferred from a low frequency magnetic direction finding location system. Empirical adjustment to the angles using the redundancy of the lightning data reduce this error. Radar echoes above 45dBZ may be caused by soft hail or hailstones, but similarly intense echoes may result from melting snow. The data show that a new polarization radar parameter, the linear depolarization ratio, can distinguish between soft hail and melting snow, and that the intense radar echoes associated with melting snow pose no threat of lightning. A lightning risk only exists when the radar indicates that the clouds contain soft hail or hailstones.

Illingworth, A. J.↗

Vision 20/20: Automation and advanced computing in clinical radiation oncology

This Vision 20/20 paper considers what computational advances are likely to be implemented in clinical radiation oncology in the coming years and how the adoption of these changes might alter the practice of radiotherapy. Four main areas of likely advancement are explored: cloud computing, aggregate data analyses, parallel computation, and automation. As these developments promise both new opportunities and new risks to clinicians and patients alike, the potential benefits are weighed against the hazards associated with each advance, with special considerations regarding patient safety under new computational platforms and methodologies. While the concerns of patient safety are legitimate, the authors contend that progress toward next-generation clinical informatics systems will bring about extremely valuable developments in quality improvement initiatives, clinical efficiency, outcomes analyses, data sharing, and adaptive radiotherapy.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A statistical data analysis and plotting program for cloud microphysics experiments

The analysis software developed for atmospheric cloud microphysics experiments conducted in the laboratory as well as aboard a KC-135 aircraft is described. A group of four programs was developed and implemented on a Hewlett Packard 1000 series F minicomputer running under HP's RTE-IVB operating system. The programs control and read data from a MEMODYNE Model 3765-8BV cassette recorder, format the data on the Hewlett Packard disk subsystem, and generate statistical data (mean, variance, standard deviation) and voltage and engineering unit plots on a user selected plotting device. The programs are written in HP FORTRAN IV and HP ASSEMBLY Language with the graphics software using the HP 1000 Graphics. The supported plotting devices are the HP 2647A graphics terminal, the HP 9872B four color pen plotter, and the HP 2608A matrix line printer.

Jordan, A. J.↗

Methods of editing cloud and atmospheric layer affected pixels from satellite data

Plotted transects made from south Texas daytime HCMM data show the effect of subvisible cirrus (SCI) clouds in the emissive (IR) band but the effect is unnoticable in the reflective (VIS) band. The depression of satellite indicated temperatures ws greatest in the center of SCi streamers and tapered off at the edges. Pixels of uncontaminated land and water features in the HCMM test area shared identical VIS and IR digital count combinations with other pixels representing similar features. A minimum of 0.015 percent repeats of identical VIS-IR combinations are characteristic of land and water features in a scene of 30 percent cloud cover. This increases to 0.021 percent of more when the scene is clear. Pixels having shared VIS-IR combinations less than these amounts are considered to be cloud contaminated in the cluster screening method. About twenty percent of SCi was machine indistinguishable from land features in two dimensional spectral space (VIS vs IR).

Nixon, P. R.↗

Failing in place for low-serviceability storage infrastructure using high-parity GPU-based RAID.

In order to provide large quantities of high-reliability disk-based storage, it has become necessary to aggregate disks into fault-tolerant groups based on the RAID methodology. Most RAID levels do provide some fault tolerance, but there are certain classes of applications that require increased levels of fault tolerance within an array. Some of these applications include embedded systems in harsh environments that have a low level of serviceability, or uninhabited data centers servicing cloud computing. When describing RAID reliability, the Mean Time To Data Loss (MTTDL) calculations will often assume that the time to replace a failed disk is relatively low, or even negligible compared to rebuild time. For platforms that are in remote areas collecting and processing data, it may be impossible to access the system to perform system maintenance for long periods. A disk may fail early in a platform's life, but not be replaceable for much longer than typical for RAID arrays. Service periods may be scheduled at intervals on the order of months, or the platform may not be serviced until the end of a mission in progress. Further, this platform may be subject to extreme conditions that can accelerate wear and tear on a disk, requiring even more protection from failures. We have created a high parity RAID implementation that uses a Graphics Processing Unit (GPU) to compute more than two blocks of parity information per stripe, allowing extra parity to eliminate or reduce the requirement for rebuilding data between service periods. While this type of controller is highly effective for RAID 6 systems, an important benefit is the ability to incorporate more parity into a RAID storage system. Such RAID levels, as yet unnamed, can tolerate the failure of three or more disks (depending on configuration) without data loss. While this RAID system certainly has applications in embedded systems running applications in the field, similar benefits can be obtained for servers that are engineered for storage density, with less regard for serviceability or maintainability. A storage brick can be designed to have a MTTDL that extends well beyond the useful lifetime of the hardware used, allowing the disk subsystem to require less service throughout the lifetime of a compute resource. This approach is similar to the Xiotech ISE. Such a design can be deliberately placed remotely (without frequent support) in order to provide colocation, or meet cost goals. For workloads where reliability is key, but conditions are sub-optimal for routine serviceability, a high-parity RAID can provide extra reliability in extraordinary situations. For example, for installations requiring very high Mean Time To Repair, the extra parity can eliminate certain problems with maintaining hot spares, increasing overall reliability. Furthermore, in situations where disk reliability is reduced because of harsh conditions, extra parity can guard against early data loss due to lowered Mean Time To Failure. If used through an iSCSI interface with a streaming workload, it is possible to gain all of these benefits without impacting performance.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Global four-band spectral classification of Jupiter's clouds - Color/albedo units and trends

Voyager 2 digital images of Jupiter have been used to construct a global data base of cloud reflectance in four spectral bands: three wideband 'colors' with effective wavelengths at 431 nm, 564 nm, and 599 nm, plus the narrowband CH4 filter centered at 621 nm. This data base has been spectrally classified at 0.5 deg resolution to separate the complex scene into cloud color/albedo units on a pixel-by-pixel basis, revealing 20 distinct and five tentative units. These include both large, globally distributed units and very small, localized units. Global color maps and unit membership maps are used to highlight associations and trends.

Thompson, W. Reid↗

Cumulus cloud base height estimation from high spatial resolution Landsat data - A Hough transform approach

A semiautomated methodology is developed for estimating cumulus cloud base heights on the basis of high spatial resolution Landsat MSS data, using various image-processing techniques to match cloud edges with their corresponding shadow edges. The cloud base height is then estimated by computing the separation distance between the corresponding generalized Hough transform reference points. The differences between the cloud base heights computed by these means and a manual verification technique are of the order of 100 m or less; accuracies of 50-70 m may soon be possible via EOS instruments.

Berendes, Todd↗

Point Cloud of Cloud Points PCCP from CACTI Stereo Cameras

The Point Cloud of Cloud Points (PCCP) data set is composed of 3D coordinates describing the position of cloud features and images from which these coordinates are reconstructed. Images are captured in the daytime by two ARM cloud digital cameras (ACDCs) at CACTI S4a and S4b sites, at 20-second intervals. The two cameras are located at 32.1274oS,64.7139oW, and 32.1185oS, 64.7237oW. The 3D positions are detected with respect to the AMF base location at 32.1264oS, 64.7284oW, and 1141 m above sea level. The PCCP data format is the same as explained in PCCP VAP Technical Report.

54 ENVIRONMENTAL SCIENCES↗

ISCCP reduced resolution satellite radiance data

The International Satellite Cloud Climatology Project (ISCCP) is the first active project of the World Climate Research Program. It is a multinational data collection project focused on collecting a data set that will improve the ability to predict and/or simulate the radiative effects of clouds on climate. For specified cloud parameters, the goals are to archieve values for 3-hour periods over the whole globe for 5 years at 30 km resolution. The task of collecting and processing radiance data from both geosynchronous and polar orbiting satellites began in July 1983. A diagram was shown illustrating the flow of data from the transmitting satellites to the various receiving institutions that handle it. The various stages of processing were then explained in detail, emphasizing Level B3-normalized, reformatted, reduced raw satellite data. The reduction of data by sampling is an essential step in the flow. By the time the ISCCP data reaches the Global Processing Center at Goddard Institute for Space Studies (GISS), the volume has been reduced by a factor of 1000. The Pilot Climate Data System (PLDS) will provide access to the ISCCP data set. It should prove to be one of the cleanest satellite data sets because it will have been through three filters--that of the operational agency, the Global Processing Center, and the PCDS. The ISCCP data set also includes other correlative data sets delivered in compatible format.

Rossow, W.↗

Evaluation of Marine Boundary Layer Clouds Over the Northeast Pacific During the CSET Campaign in E3SM Version 2

It is still challenging to reproduce marine boundary layer (MBL) clouds well in large-scale models despite their importance to the Earth's radiation budget and hydrological cycle. This study evaluates representation of the MBL and clouds in the Energy Exascale Earth System Model (E3SM) version 2. This study compares the E3SM simulation results with remote sensing and reanalysis data during the Cloud System Evolution in the Trades (CSET) field campaign to better understand the stratocumulus-to-cumulus cloud transition (SCT) over the northeast Pacific. E3SM results are extracted along the CSET Lagrangian trajectories. The comparison shows that the E3SM simulation applying horizontal wind nudging performs well in reproducing thermodynamic variables of the MBL and evolution trends of cloud variables along the trajectories. However, substantial overestimations of aerosol and cloud drop number (N d ) are observed, which is explained as an issue with version 2 of the model. Cloud fraction (CF) does decrease from the Californian coast to Hawaii in the E3SM simulation, but most CF values indicate either an overcast or almost clear sky, which differs from satellite and reanalysis data. The effect of N d overestimation on CF evolution is assessed via prescribed-N d simulations. Those simulations with N d modifications show negligible CF changes. A comparison of estimated inversion strength (EIS) also shows that the simulated EIS values are similar to those of reanalysis data. Our study suggests that cloud macrophysics and boundary layer processes are more important in improving the simulation to capture the SCT than refining the model's thermodynamics or cloud microphysics.

Choi, Kyoung Ock [Univ. of Washington, Seattle, WA↗

Cloud cover determination in polar regions from satellite imagery

The principal objectives of this project are: (1) to develop suitable validation data sets to evaluate the effectiveness of the International Satellite Cloud Climatology Project (ISCCP) operational algorithm for cloud retrieval in polar regions and to validate model simulations of polar cloud cover; (2) to identify limitations of current procedures for varying atmospheric surface conditions, and to explore potential means to remedy them using textural classifiers; and (3) to compare synoptic cloud data from a control run experiment of the GISS climate model II with typical observed synoptic cloud patterns.

Barry, R. G.↗

Virtual Log-Structured Storage for High-Performance Streaming

Over the past decade, given the higher number of data sources (e.g., Cloud applications, Internet of things) and critical business demands, Big Data transitioned from batch-oriented to real-time analytics. Stream storage systems, such as Apache Kafka, are well known for their increasing role in real-time Big Data analytics. For scalable stream data ingestion and processing, they logically split a data stream topic into multiple partitions. Stream storage systems keep multiple data stream copies to protect against data loss while implementing a stream partition as a replicated log. This architectural choice enables simplified development while trading cluster size with performance and the number of streams optimally managed. This paper introduces a shared virtual log-structured storage approach for improving the cluster throughput when multiple producers and consumers write and consume in parallel data streams. Stream partitions are associated with shared replicated virtual logs transparently to the user, effectively separating the implementation of stream partitioning (and data ordering) from data replication (and durability). We implement the virtual log technique in the KerA stream storage system. When comparing with Apache Kafka, KerA improves the cluster ingestion throughput by up to 4x when multiple producers write over hundreds of data streams.

consistent stream ordering↗

Holistic Interactions of Shallow Clouds, Aerosols, and Land-Ecosystems (HI-SCALE) Science Plan

Cumulus convection is an important component in the atmospheric radiation budget and hydrologic cycle over the Southern Great Plains and over many regions of the world, particularly during the summertime growing season when intense turbulence induced by surface radiation couples the land surface to clouds. Current convective cloud parameterizations contain uncertainties resulting in part from insufficient coincident data that couples cloud macrophysical and microphysical properties to inhomogeneities in boundary layer and aerosol properties. The Holistic Interactions of Shallow Clouds, Aerosols, and Land-Ecosystems (HI-SCALE) campaign is designed to provide a detailed set of measurements that are needed to obtain a more complete understanding of the life cycle of shallow clouds by coupling cloud macrophysical and microphysical properties to land surface properties, ecosystems, and aerosols. HI-SCALE consists of 2, 4-week intensive observational periods, one in the spring and the other in the late summer, to take advantage of different stages and distribution of “greenness” for various types of vegetation in the vicinity of the Atmospheric Radiation and Measurement (ARM) Climate Research Facility’s Southern Great Plains (SGP) site as well as aerosol properties that vary during the growing season. Most of the proposed instrumentation will be deployed on the ARM Aerial Facility (AAF) Gulfstream 1 (G-1) aircraft, including those that measure atmospheric turbulence, cloud water content and drop size distributions, aerosol precursor gases, aerosol chemical composition and size distributions, and cloud condensation nuclei concentrations. Routine ARM aerosol measurements made at the surface will be supplemented with aerosol microphysical properties measurements. The G-1 aircraft will complete transects over the SGP Central Facility at multiple altitudes within the boundary layer, within clouds, and above clouds.

Fast, JD↗

Integrating multi-modal remote sensing, deep learning, and attention mechanisms for yield prediction in plant breeding experiments

In both plant breeding and crop management, interpretability plays a crucial role in instilling trust in AI-driven approaches and enabling the provision of actionable insights. The primary objective of this research is to explore and evaluate the potential contributions of deep learning network architectures that employ stacked LSTM for end-of-season maize grain yield prediction. A secondary aim is to expand the capabilities of these networks by adapting them to better accommodate and leverage the multi-modality properties of remote sensing data. In this study, a multi-modal deep learning architecture that assimilates inputs from heterogeneous data streams, including high-resolution hyperspectral imagery, LiDAR point clouds, and environmental data, is proposed to forecast maize crop yields. The architecture includes attention mechanisms that assign varying levels of importance to different modalities and temporal features that, reflect the dynamics of plant growth and environmental interactions. The interpretability of the attention weights is investigated in multi-modal networks that seek to both improve predictions and attribute crop yield outcomes to genetic and environmental variables. This approach also contributes to increased interpretability of the model's predictions. The temporal attention weight distributions highlighted relevant factors and critical growth stages that contribute to the predictions. The results of this study affirm that the attention weights are consistent with recognized biological growth stages, thereby substantiating the network's capability to learn biologically interpretable features. Accuracies of the model's predictions of yield ranged from 0.82-0.93 R 2 ref in this genetics-focused study, further highlighting the potential of attention-based models. Further, this research facilitates understanding of how multi-modality remote sensing aligns with the physiological stages of maize. The proposed architecture shows promise in improving predictions and offering interpretable insights into the factors affecting maize crop yields, while demonstrating the impact of data collection by different modalities through the growing season. By identifying relevant factors and critical growth stages, the model's attention weights provide valuable information that can be used in both plant breeding and crop management. The consistency of attention weights with biological growth stages reinforces the potential of deep learning networks in agricultural applications, particularly in leveraging remote sensing data for yield prediction. To the best of our knowledge, this is the first study that investigates the use of hyperspectral and LiDAR UAV time series data for explaining/interpreting plant growth stages within deep learning networks and forecasting plot-level maize grain yield using late fusion modalities with attention mechanisms.

59 BASIC BIOLOGICAL SCIENCES↗

Early warning and crop condition assessment research

The Early Warning Crop Condition Assessment Project of AgRISTARS was a multiagency and multidisciplinary effort. Its mission and objectives were centered around development and testing of remote-sensing techniques that enhance operational methodologies for global crop-condition assessments. The project developed crop stress indicators models that provide data filter and alert capabilities for monitoring global agricultural conditions. The project developed a technique for using NOAA-n satellite advanced very-high-resolution radiometer (AVHRR) data for operational crop-condition assessments. This technology was transferred to the Foreign Agricultural Service of the USDA. The project developed a U.S. Great Plains data base that contains various meteorological parameters and vegetative index numbers (VIN) derived from AVHRR satellite data. It developed cloud screening techniques and scan angle correction models for AVHRR data. It also developed technology for using remotely acquired thermal data for crop water stress indicator modeling. The project provided basic technology including spectral characteristics of soils, water, stressed and nonstressed crop and range vegetation, solar zenith angle, and atmospheric and canopy structure effects.

Boatwright, G. O.↗

Molecular clouds without detectable CO

The clouds identified by Desert, Bazell, and Boulanger (DBB clouds) in their search for high-latitude molecular clouds were observed in the CO (J = 1-0) line, but only 13 percent of the sample was detected. The remaining 87 percent are diffuse molecular clouds with CO abundances of about 10 to the -6th, a typical value for diffuse clouds. This hypothesis is shown to be consistent with Copernicus data. The DBB clouds are shown to ben an essentially complete catalog of diffuse molecular clouds in the solar vicinity. The total molecular surface density in the vicinity of the sun is then only about 20 percent greater than the 1.3 solar masses/sq pc determined by Dame et al. (1987). Analysis of the CO detections indicates that there is a sharp threshold in extinction of 0.25 mag before CO is detectable and is derived from the IRAS I(100) micron threshold of 4 MJy/sr. This threshold is presumably where the CO abundance exhibits a sharp increase

Blitz, Leo↗