Skel: Generative Software for Producing Skeletal I/O Applications.
Abstract not provided.
Engineering topics
Publications and source records attributed to Liu, Qing.
Abstract not provided.
As computing power increases exponentially, vast amount of data is created by many scientific re- search activities. However, the bandwidth for storing the data to disks and reading the data from disks has been improving at a much slower pace. These two trends produce an ever-widening data access gap. Our work brings together two distinct technologies to address this data access issue: indexing and in situ processing. From decades of database research literature, we know that indexing is an effective way to address the data access issue, particularly for accessing relatively small fraction of data records. As data sets increase in sizes, more and more analysts need to use selective data access, which makes indexing an even more important for improving data access. The challenge is that most implementations of in- dexing technology are embedded in large database management systems (DBMS), but most scientific datasets are not managed by any DBMS. In this work, we choose to include indexes with the scientific data instead of requiring the data to be loaded into a DBMS. We use compressed bitmap indexes from the FastBit software which are known to be highly effective for query-intensive workloads common to scientific data analysis. To use the indexes, we need to build them first. The index building procedure needs to access the whole data set and may also require a significant amount of compute time. In this work, we adapt the in situ processing technology to generate the indexes, thus removing the need of read- ing data from disks and to build indexes in parallel. The in situ data processing system used is ADIOS, a middleware for high-performance I/O. Our experimental results show that the indexes can improve the data access time up to 200 times depending on the fraction of data selected, and using in situ data processing system can effectively reduce the time needed to create the indexes, up to 10 times with our in situ technique when using identical parallel settings.
Abstract not provided.
The contributions of precipitation and soil moisture observations to the skill of soil moisture estimates from a land data assimilation system are assessed. Relative to baseline estimates from the Modern Era Retrospective-analysis for Research and Applications (MERRA), the study investigates soil moisture skill derived from (i) model forcing corrections based on large-scale, gauge- and satellite-based precipitation observations and (ii) assimilation of surface soil moisture retrievals from the Advanced Microwave Scanning Radiometer for the Earth Observing System (AMSR-E). Soil moisture skill is measured against in situ observations in the continental United States at 44 single-profile sites within the Soil Climate Analysis Network (SCAN) for which skillful AMSR-E retrievals are available and at four CalVal watersheds with high-quality distributed sensor networks that measure soil moisture at the scale of land model and satellite estimates. The average skill (in terms of the anomaly time series correlation coefficient R) of AMSR-E retrievals is R=0.39 versus SCAN and R=0.53 versus CalVal measurements. The skill of MERRA surface and root-zone soil moisture is R=0.42 and R=0.46, respectively, versus SCAN measurements, and MERRA surface moisture skill is R=0.56 versus CalVal measurements. Adding information from either precipitation observations or soil moisture retrievals increases surface soil moisture skill levels by IDDeltaR=0.06-0.08, and root zone soil moisture skill levels by DeltaR=0.05-0.07. Adding information from both sources increases surface soil moisture skill levels by DeltaR=0.13, and root zone soil moisture skill by DeltaR=0.11, demonstrating that precipitation corrections and assimilation of satellite soil moisture retrievals contribute similar and largely independent amounts of information.
Explore the source record for details and available documents.
The Modern-Era Retrospective analysis for Research and Applications (MERRA) is a state-of-the-art reanalysis that provides. in addition to atmospheric fields. global estimates of soil moisture, latent heat flux. snow. and runoff for J 979-present. This study introduces a supplemental and improved set of land surface hydrological fields ('MERRA-Land') generated by replaying a revised version of the land component of the MERRA system. Specifically. the MERRA-Land estimates benefit from corrections to the precipitation forcing with the Global Precipitation Climatology Project pentad product (version 2.1) and from revised parameters in the rainfall interception model, changes that effectively correct for known limitations in the MERRA land surface meteorological forcings. The skill (defined as the correlation coefficient of the anomaly time series) in land surface hydrological fields from MERRA and MERRA-Land is assessed here against observations and compared to the skill of the state-of-the-art ERA-Interim reanalysis. MERRA-Land and ERA-Interim root zone soil moisture skills (against in situ observations at 85 US stations) are comparable and significantly greater than that of MERRA. Throughout the northern hemisphere, MERRA and MERRA-Land agree reasonably well with in situ snow depth measurements (from 583 stations) and with snow water equivalent from an independent analysis. Runoff skill (against naturalized stream flow observations from 15 basins in the western US) of MERRA and MERRA-Land is typically higher than that of ERA-Interim. With a few exceptions. the MERRA-Land data appear more accurate than the original MERRA estimates and are thus recommended for those interested in using '\-tERRA output for land surface hydrological studies.
Abstract not provided.
Significant challenges exist for achieving peak or even consistent levels of performance when using IO systems at scale. They stem from sharing IO system resources across the processes of single large-scale applications and/or multiple simultaneous programs causing internal and external interference, which in turn, causes substantial reductions in IO performance. This paper presents interference effects measurements for two different file systems at multiple supercomputing sites. These measurements motivate developing a 'managed' IO approach using adaptive algorithms varying the IO system workload based on current levels and use areas. An implementation of these methods deployed for the shared, general scratch storage system on Oak Ridge National Laboratory machines achieves higher overall performance and less variability in both a typical usage environment and with artificially introduced levels of 'noise'. The latter serving to clearly delineate and illustrate potential problems arising from shared system usage and the advantages derived from actively managing it.
This paper studies distributed multi-domain, multilayer provisioning (grooming) in IP/MPLS-DWDM networks. Although many multi-domain studies have emerged over the years, these have primarily considered 'homogeneous' network layers. Meanwhile, most grooming studies have assumed idealized settings with 'global' link state across all layers. Hence there is a critical need to develop practical distributed grooming schemes for real-world networks consisting of multiple domains and technology layers. Along these lines, a detailed hierarchical framework is proposed to implement inter-layer routing, distributed grooming, and setup signaling. The performance of this solution is analyzed in detail using simulation studies and future work directions are also high-lighted.
In the cyclone of a circulating fluidized bed (CFB) boiler, a noticeable increment of flue gas temperature, caused by combustion of combustible gas and unburnt carbon content, is often found. Such phenomenon is defined as post combustion, and it could introduce overheating of reheated and superheated steam and extra heat loss of exhaust flue gas. In this paper, mathematical modeling and field measurements on post combustion in 135MWe commercial CFB boilers were conducted. A novel one-dimensional combustion model taking post combustion into account was developed. With this model, the overall combustion performance, including size distribution of various ashes, temperature profile, and carbon content profiles along the furnace height, heat release fraction in the cyclone and furnace were predicted. Field measurements were conducted by sampling gas and solid at different positions in the boiler under different loads. The measured data and corresponding model-calculated results were compared. Both prediction and field measurements showed post combustion introduced a temperature increment of flue gas in the cyclone of the 135MWe CFB boiler in the range of 20-50{sup o}C when a low-volatile bituminous coal was fired. Although it had little influence on ash size distribution, post combustion had a remarkable influence on the carbon content profile and temperature profile in the furnace. Moreover, it introduced about 4-7% heat release in the cyclone over the total heat release in the boiler. This fraction slightly increased with total air flow rate and boiler load. Model calculations were also conducted on other two 135MWe CFB boilers burning lignite and anthracite coal, respectively. The results confirmed that post combustion was sensitive to coal type and became more severe as the volatile content of the coal decreased. 15 refs., 11 figs., 4 tabs.
No abstract prepared.
Advanced climate models require a more realistic description of canopy radiation with reasonable computational efficiency. This paper develops the mathematics of scattering from a spherical object conceptualized to be a spherical bush to provide a building block that helps to address this need of climate models. It is composed of a homogeneous distribution of individual smaller objects that scatter isotropically. In the limit of small optical depth, incident radiation will scatter isotropically as the sum of that scattered by all the individual scatterers, but at large optical depth the radiation leaving the spherical bush in a given direction is reduced by mutual shadowing of the smaller objects. In the single scattering limit, the scattering phase function and so the albedo are obtained by simple but accurate analytic expressions derived from analytic integration and numerical evaluation. Except in the limit of thin canopies, the scattering and hence albedos are qualitatively and quantitatively different than those derived from 1-D modeling.