Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “grid storage”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

167 records · Page 10

Interactive Visualization of Near Real Time and Production Global Precipitation Measurement (GPM) Mission Data Online Using CesiumJS

Advancements in the capabilities of JavaScript frameworks and web browsing technology make online visualization of large geospatial datasets viable. Commonly this is done using static image overlays, prerendered animations, or cumbersome geoservers. These methods can limit interactivity andor place a large burden on server-side post-processing and storage of data. Geospatial data, and satellite data specifically, benefit from being visualized both on and above a three-dimensional surface. The open-source JavaScript framework CesiumJS, developed by Analytical Graphics, Inc., leverages the WebGL protocol to do just that. It has entered the void left by the abandonment of the Google Earth Web API, and it serves as a capable and well-maintained platform upon which data can be displayed. This paper will describe the technology behind the two primary products developed as part of the NASA Precipitation Processing System STORM website: GPM Near Real Time Viewer (GPMNRTView) and STORM Virtual Globe (STORM VG). GPMNRTView reads small post-processed CZML files derived from various Level 1 through 3 near real-time products. For swath-based products, several brightness temperature channels or precipitation-related variables are available for animating in virtual real-time as the satellite-observed them on and above the Earths surface. With grid-based products, only precipitation rates are available, but the grid points are visualized in such a way that they can be interactively examined to explore raw values. STORM VG reads values directly off the HDF5 files, converting the information into JSON on the fly. All data points both on and above the surface can be examined here as well. Both the raw values and, if relevant, elevations are displayed. Surface and above-ground precipitation rates from select Level 2 and 3 products are shown. Examples from both products will be shown, including visuals from high impact events observed by GPM constellation satellites.

satellite precipitation measurement↗

The scale and persistence of soil moisture anomalies as simulated in a global model

Short term variability of climate is intimately connected with soil moisture variability. Soil moisture provides the storage and subsequent return to the atmosphere, through evaporation and transpiration, of precipitation anomalies over land. Global Circulation Model (GCM) simulations enable consistent identification of correlations and dynamical connections between the hydrologic variables, many of which are incompletely observed. One way to facilitate understanding with these increasingly intricate models is to perform sensitivity studies in which a boundary condition or process is prescribed. In this study we will report on a sensitivity study in which a GCM with a sophisticated land surface representation is used to investigate soil moisture variability in the model climate. The simulations to be used in this study were made at R15 resolution (approximately 4.5 deg latitude x 7.5 deg longitude) with prescribed sea surface temperatures (SST) in the GENESIS model (Thompson and Pollard, 1994), which is coupled to a Land Surface Transfer model (LSX) at 2 deg x 2 deg resolution (Pollard and Thompson, 1994). All the results represented here were taken from the monthly averages of the model results. The LSX model accounts for the physical effects of vegetation with two layers specified at each grid point. Vegetation attributes such as leaf area indices, fractional cover, leaf albedos, etc., were taken from the global dataset in Dorman and Sellers (1989). A six-layer soil model extends from the surface to 4.25 m depth. SST's were prescribed in two ten year experiments using monthly SST values with the daily value being interpolated from the nearest two months. In the first experiment monthly climatological values were used, and in the second, the Atmospheric Model Intercomparison Project (AMIP) observed SST's for the years 1979 through 1988 were used (Gates, 1992). Thus, the former experiment gives a measure of the intrinsic model variability, to be compared with that of the latter experiment, which includes month-to-month variability due to ocean forcing.

Fitzjarrald, D.↗

High Resolution Nature Runs and the Big Data Challenge

NASA's Global Modeling and Assimilation Office at Goddard Space Flight Center is undertaking a series of very computationally intensive Nature Runs and a downscaled reanalysis. The nature runs use the GEOS-5 as an Atmospheric General Circulation Model (AGCM) while the reanalysis uses the GEOS-5 in Data Assimilation mode. This paper will present computational challenges from three runs, two of which are AGCM and one is downscaled reanalysis using the full DAS. The nature runs will be completed at two surface grid resolutions, 7 and 3 kilometers and 72 vertical levels. The 7 km run spanned 2 years (2005-2006) and produced 4 PB of data while the 3 km run will span one year and generate 4 BP of data. The downscaled reanalysis (MERRA-II Modern-Era Reanalysis for Research and Applications) will cover 15 years and generate 1 PB of data. Our efforts to address the big data challenges of climate science, we are moving toward a notion of Climate Analytics-as-a-Service (CAaaS), a specialization of the concept of business process-as-a-service that is an evolving extension of IaaS, PaaS, and SaaS enabled by cloud computing. In this presentation, we will describe two projects that demonstrate this shift. MERRA Analytic Services (MERRA/AS) is an example of cloud-enabled CAaaS. MERRA/AS enables MapReduce analytics over MERRA reanalysis data collection by bringing together the high-performance computing, scalable data management, and a domain-specific climate data services API. NASA's High-Performance Science Cloud (HPSC) is an example of the type of compute-storage fabric required to support CAaaS. The HPSC comprises a high speed Infinib and network, high performance file systems and object storage, and a virtual system environments specific for data intensive, science applications. These technologies are providing a new tier in the data and analytic services stack that helps connect earthbound, enterprise-level data and computational resources to new customers and new mobility-driven applications and modes of work. In our experience, CAaaS lowers the barriers and risk to organizational change, fosters innovation and experimentation, and provides the agility required to meet our customers' increasing and changing needs

big data analysis↗

Validation of CFD Model Prediction of Flow Boiling Regime Transitions during LN2 Line Chilldown

Propellant storage and transfer during future long-duration missions will involve fuel depot operations in which a donor depot tank is used to fill a receiver spacecraft tank with a cryogenic propellant. Prior to the on-Orbit filling operation both the receiver tank and the transfer line must be cooled. The line chilldown process involves transition between boiling regimes in microgravity that will be quite different from their 1g ground-based counterparts. Since the cryogenic propellant itself will be used to perform the chilldown process, the time constants to cool the wall and the amount of fuel that will be used become important design considerations. In this light, the focus of the present work is to understand the flow boiling characteristics of a cryogenic fluid, namely, liquid nitrogen, during the chill-down of a transfer line using CFD modelling and simulations. The cryogenic chill-down process involves different flow boiling regimes: film boiling, transition boiling and nucleate boiling. The prediction of transition between these regimes in a CFD framework is new and challenging. The present work addresses this challenge by employing a volume-of-fluid (VOF) based methodology with Lee phase change model to predict the film boiling regime of the chill-down process in ANSYS Fluent®. The transition and nucleate boiling regimes are predicted by incorporating a sub-grid model developed by Craft Tech that accounts for bubble nucleation, growth, shedding frequency, and departure diameter. The sub-grid model is implemented into Fluent via a user-defined function for wall-fluid heat flux calculations. The sub-grid model is similar in formulation to the well-known Rensselaer Polytechnic Institute (RPI) boiling model. The model constants are tested for different operating conditions and designated values are reported. The CFD model is validated against published experimental data for liquid nitrogen chill-down of a heated stainless-steel pipe in 1g. Predicted results showing good agreement of wall temperature, rewetting temperature, and transition between film and nucleate boiling with the experimental measurements are presented and discussed.

Boiling regimes↗

High Performance Access to Archival Data Stored in HDF4 and HDF5 on Cloud Object Stores Without Reformatting the Files

Cloud computing offers numerous advantages for users of extensive Earth science data collections. These benefits encompass direct online access to data files and granules from any location, scalable access supporting parallel computing workflows, and flexible computing tools enabling innovative experimentation with processing techniques. However, older archival file formats designed for distinct computing systems hinder efficient access to decade-long time-series data when compared to data stored in modern cloud-optimized formats like Web Object Stores (WOS), exemplified by Amazon Web Services’ Simple Storage Service (S3). We describe DMR++ (Dataset Metadata Response plus plus), a technology facilitating efficient access to HDF5 (Hierarchical Data Format, version 5) and HDF4 files stored on WOS systems without requiring data reformatting. DMR++ achieves performance comparable to technologies like Zarr while preserving the original file structure, a substantial benefit considering the vast quantity of archival files held by organizations such as NASA. Moreover, DMR++ typically outperforms cloud-optimized versions of HDF5. Essentially an XML (Extensible Markup Language) document usually stored alongside the described data, DMR++ can also be generated on-the-fly but is generally created during data staging to the WOS. Archival files that use HDF4/5 often store large arrays of numerical data. The data in these files is often compressed, typically reducing their size by a factor of four or more. To achieve efficient access to portions of those arrays, they are 'chunked' into smaller sub-arrays, each individually compressed. The chunk size is a compromise, where spinning disks can efficiently access data in smaller chunks while S3 favors larger chunks. A simple optimization of aggregating smaller chunks that are stored adjacently, transferring them in a single access and then individually decompressing them will improve performance. NASA data pose an additional challenge: special Application Programmer Interface (API) libraries are often needed to compute some variables. These libraries are incompatible with WOS environments. Our solution involves storing computed values in the DMR++ document or a companion file, making them accessible like other variables and eliminating the need for specialized APIs. We outline specific optimizations for both satellite grid and swath data stored in HDF4-EOS2 (Earth Observing System).

James Gallagher↗