Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data centers”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Considerations for an earth physics information-management service.

In a preliminary investigation into the feasibility of establishing a data center for earth physics, 12 disciplines were considered for inclusion. Estimation of the size of the data base for each indicated a need for storage of approximately 10 to the 10th power characters. The computer-based system deemed most worthy of further investigation was the interactive concept with remote-terminal access. Users are divided into three classes according to how they would access information: with no terminal, with an interactive terminal, and with a multidevice terminal. All these users can be served by the same center without any particular difficulty, but the real benefactor is the user with an interactive terminal, because he can compile, debug, and run programs in one continuous session. Final points stressed are multiprogramming for dynamic resource sharing, hardware modularity for future expansion, and information protection for such a large community of users. It is concluded that a survey should be conducted to gather more information from the potential users of such a system, and that a pilot project should be developed at some location where both earth-physics research and data-processing capabilities already exist.

Martin, R. W.↗

Protein Data Bank: A Comprehensive Review of 3D Structure Holdings and Worldwide Utilization by Researchers, Educators, and Students

The Research Collaboratory for Structural Bioinformatics Protein Data Bank (RCSB PDB), funded by the United States National Science Foundation, National Institutes of Health, and Department of Energy, supports structural biologists and Protein Data Bank (PDB) data users around the world. The RCSB PDB, a founding member of the Worldwide Protein Data Bank (wwPDB) partnership, serves as the US data center for the global PDB archive housing experimentally-determined three-dimensional (3D) structure data for biological macromolecules. As the wwPDB-designated Archive Keeper, RCSB PDB is also responsible for the security of PDB data and weekly update of the archive. RCSB PDB serves tens of thousands of data depositors (using macromolecular crystallography, nuclear magnetic resonance spectroscopy, electron microscopy, and micro-electron diffraction) annually working on all permanently inhabited continents. RCSB PDB makes PDB data available from its research-focused web portal at no charge and without usage restrictions to many millions of PDB data consumers around the globe. It also provides educators, students, and the general public with an introduction to the PDB and related training materials through its outreach and education-focused web portal. This review article describes growth of the PDB, examines evolution of experimental methods for structure determination viewed through the lens of the PDB archive, and provides a detailed accounting of PDB archival holdings and their utilization by researchers, educators, and students worldwide.

59 BASIC BIOLOGICAL SCIENCES↗

Handbook on thermophysical properties of oxygen

Handbook has been compiled by Cryogenic Data Center of National Bureau of Standards. It covers thermodynamic functions, physical properties, and heat transfer data for oxygen. Handbook addresses primarily low temperature regime, but also includes some data above room temperature.

Roder, H. M.↗

NSSDC Data Listing

Data available from the National Space Science Data Center (NSSDC) are listed. The spacecraft, principal investigator, the experiment, and time span of the data are given. A listing is also included of ground-based data, models, computer routines and composite spacecraft data that are available from NSSDC.

Source record↗

Issues and recommendations associated with distributed computation and data management systems for the space sciences

The primary purpose of the report is to explore management approaches and technology developments for computation and data management systems designed to meet future needs in the space sciences.The report builds on work presented in previous reports on solar-terrestrial and planetary reports, broadening the outlook to all of the space sciences, and considering policy issues aspects related to coordiantion between data centers, missions, and ongoing research activities, because it is perceived that the rapid growth of data and the wide geographic distribution of relevant facilities will present especially troublesome problems for data archiving, distribution, and analysis.

Source record↗

NSSDC: Preserving time with technological advances

The National Space Science Data Center (NSSDC) has always striven to use the best methods and media currently available from data accessibility and archive management. The various advantages and disadvantages of four different media forms that have been used by NSSDC over 12 years of archiving and distributing of International Ultraviolet Explorer (IUE) data are discussed. The four media are nine track magnetic tape, IBM 3850 mass storage, Memorex 3480 18 track tape catridge, and the Sony 6.5 Gbyte Century optical disk. The CD-ROM medium is also discussed.

Perry, Charleen↗

Data archiving

The viewgraphs of a discussion on data archiving presented at the National Space Science Data Center (NSSDC) Mass Storage Workshop is included. The mass storage system at the National Center for Atmospheric Research (NCAR) is described. Topics covered in the presentation include product goals, data library systems (DLS), client system commands, networks, archival devices, DLS features, client application systems, multiple mass storage devices, and system growth.

Pitts, David↗

Analysis of the US Air Force Defense Meteorological Satellite Program Imagery for Global Lightning

The U. S. Air Force operates the Defense Meteorological Satellite Program (DMSP), a system of near-polar orbiting satellites designed for use in operational weather forecasting and other applications. DMSP satellites carry a suite of sensors that provide images of the earth and profiles of the atmosphere. The National Snow and Ice Data Center (NSIDC) at the University of Colorado has been involved with the archival of DMSP data and its use for several research projects since 1979. This report summarizes the portion of this involvement funded by NASA.

Scharfen, Gregory R.↗

Snow and Ice Products from the Moderate Resolution Imaging Spectroradiometer

Snow and sea ice products, derived from the Moderate Resolution Imaging Spectroradiometer (MODIS) instrument, flown on the Terra and Aqua satellites, are or will be available through the National Snow and Ice Data Center Distributed Active Archive Center (DAAC). The algorithms that produce the products are automated, thus providing a consistent global data set that is suitable for climate studies. The suite of MODIS snow products begins with a 500-m resolution, 2330-km swath snow-cover map that is then projected onto a sinusoidal grid to produce daily and 8-day composite tile products. The sequence proceeds to daily and 8-day composite climate-modeling grid (CMG) products at 0.05 resolution. A daily snow albedo product will be available in early 2003 as a beta test product. The sequence of sea ice products begins with a swath product at 1-km resolution that provides sea ice extent and ice-surface temperature (IST). The sea ice swath products are then mapped onto the Lambert azimuthal equal area or EASE-Grid projection to create a daily and 8-day composite sea ice tile product, also at 1 -km resolution. Climate-Modeling Grid (CMG) sea ice products in the EASE-Grid projection at 4-km resolution are planned for early 2003.

Hall, Dorothy K.↗

New Data on the Topside Electron Density Distribution

The existing uncertainties about the electron density profiles in the topside ionosphere, i.e., in the height region from hmF2 to approx. 2000 km, require the search for new data sources. The ISIS and Alouette topside sounder satellites from the sixties to the eighties recorded millions of ionograms and most were not analyzed in terms of electron density profiles. In recent years an effort started to digitize the analog recordings to prepare the ionograms for computerized analysis. As of November 2001 about 350,000 ionograms have been digitized from the original 7-track analog tapes. These data are available in binary and CDF format from the anonymous ftp site of the National Space Science Data Center. A search site and browse capabilities on CDAWeb assist the scientific usage of these data. All information and access links can be found at http://nssdc.gsfc.nasa.gov/space/isis/isis-status.html. This paper describes the ISIS data restoration effort and shows how the digital ionograms are automatically processed into electron density profiles from satellite orbit altitude (1400 km for ISIS-2) down to the F peak. Because of the large volume of data an automated processing algorithm is imperative. The automatic topside ionogram scaler with true height algorithm TOPIST software developed for this task is successfully scaling approx.70 % of the ionograms. An 'editing process' is available to manually scale the more difficult ionograms. The automated processing of the digitized ISIS ionograms is now underway, producing a much-needed database of topside electron density profiles for ionospheric modeling covering more than one solar cycle. The ISIS data restoration efforts are supported through NASA's Applied Systems and Information Research Program.

Huang, Xue-Qin↗

Electron Density Profiles of the Topside Ionosphere

The existing uncertainties about the electron density profiles in the topside ionosphere, i.e., in the height region from h,F2 to - 2000 km, require the search for new data sources. The ISIS and Alouette topside sounder satellites from the sixties to the eighties recorded millions of ionograms but most were not analyzed in terms of electron density profiles. In recent years an effort started to digitize the analog recordings to prepare the ionograms for computerized analysis. As of November 2001 about 350000 ionograms have been digitized from the original 7-track analog tapes. These data are available in binary and CDF format from the anonymous ftp site of the National Space Science Data Center. A search site and browse capabilities on CDAWeb assist the scientific usage of these data. All information and access links can be found at http://nssdc.gsfc.nasa.gov/space/isis/isis- status.htm1. This paper describes the ISIS data restoration effort and shows how the digital ionograms are automatically processed into electron density profiles from satellite orbit altitude (1400 km for ISIS-2) down to the F peak. Because of the large volume of data an automated processing algorithm is imperative. The TOPside Ionogram Scaler with True height algorithm TOPIST software developed for this task is successfully scaling - 70% of the ionograms. An < > is available to manually scale the more difficult ionograms. The automated processing of the digitized ISIS ionograms is now underway, producing a much-needed database of topside electron density profiles for ionospheric modeling covering more than one solar cycle.

Huang, Xue-Qin↗

Policies and Procedures for Accessing Archived NASA Data via the Web

The National Space Science Data Center (NSSDC) was established by NASA to provide for the preservation and dissemination of scientific data from NASA missions. This white paper will address the NSSDC policies that govern data preservation and dissemination and the various methods of accessing NSSDC-archived data via the web.

James, Nathan↗

Policies and Procedures for Accessing Archived NASA Lunar Data via the Web

The National Space Science Data Center (NSSDC) was established by NASA to provide for the preservation and dissemination of scientific data from NASA missions. This paper describes the policies specifically related to lunar science data. NSSDC presently archives 660 lunar data collections. Most of these data (423 units) are stored offline in analog format. The remainder of this collection consists of magnetic tapes and discs containing approximately 1.7 TB of digital lunar data. The active archive for NASA lunar data is the Planetary Data System (PDS). NSSDC has an agreement with the PDS Lunar Data Node to assist in the restoration and preparation of NSSDC-resident lunar data upon request for access and distribution via the PDS archival system. Though much of NSSDC's digital store also resides in PDS, NSSDC has many analog data collections and some digital lunar data sets that are not in PDS. NSSDC stands ready to make these archived lunar data accessible to both the research community and the general public upon request as resources allow. Newly requested offline lunar data are digitized and moved to near-line storage devices called digital linear tape jukeboxes. The data are then packaged and made network-accessible via FTP for the convenience of a growing segment of the user community. This publication will 1) discuss the NSSDC processes and policies that govern how NASA lunar data is preserved, restored, and made accessible via the web and 2) highlight examples of special lunar data requests.

James, Nathan L.↗

Improving the Accuracy of the AFWA-NASA (ANSA) Blended Snow-Cover Product over the Lower Great Lakes Region

The Air Force Weather Agency (AFWA) -- NASA blended snow-cover product, called ANSA, utilizes Earth Observing System standard snow products from the Moderate- Resolution Imaging Spectroradiometer (MODIS) and the Advanced Microwave Scanning Radiometer for EOS (AMSR-E) to map daily snow cover and snow-water equivalent (SWE) globally. We have compared ANSA-derived SWE with SWE values calculated from snow depths reported at ~1500 National Climatic Data Center (NCDC) co-op stations in the Lower Great Lakes Basin. Compared to station data, the ANSA significantly underestimates SWE in densely-forested areas. We use two methods to remove some of the bias observed in forested areas to reduce the root-mean-square error (RMSE) between the ANSA- and station-derived SWE. First, we calculated a 5- year mean ANSA-derived SWE for the winters of 2005-06 through 2009-10, and developed a five-year mean bias-corrected SWE map for each month. For most of the months studied during the five-year period, the 5-year bias correction improved the agreement between the ANSA-derived and station-derived SWE. However, anomalous months such as when there was very little snow on the ground compared to the 5-year mean, or months in which the snow was much greater than the 5-year mean, showed poorer results (as expected). We also used a 7-day running mean (7DRM) bias correction method using days just prior to the day in question to correct the ANSA data. This method was more effective in reducing the RMSE between the ANSA- and co-op-derived SWE values, and in capturing the effects of anomalous snow conditions.

Hall, Dorothy K.↗

Community Involvement in Enhancing the Global Change Master Directory (GCMD) Controlled Vocabularies (Keywords)

NASA's Global Change Master Directory (GCMD) develops and expands a hierarchical set of controlled vocabularies (keywords) covering the Earth sciences and associated information (data centers, projects, platforms, instruments, etc.). The purpose of the keywords is to describe Earth science data and services in a consistent and comprehensive manner, allowing for the precise searching of metadata and subsequent retrieval of data and services. The keywords are accessible in a standardized SKOSRDFOWL representation and are used as an authoritative taxonomy, as a source for developing ontologies, and to search and access Earth Science data within online metadata catalogues. The keyword development approach involves: (1) receiving community suggestions, (2) triaging community suggestions, (3) evaluating the keywords against a set of criteria coordinated by the NASA ESDIS Standards Office, and (4) publication/notification of the keyword changes. This approach emphasizes community input, which helps ensure a high quality, normalized, and relevant keyword structure that will evolve with users changing needs. The Keyword Community Forum, which promotes a responsive, open, and transparent processes, is an area where users can discuss keyword topics and make suggestions for new keywords. The formalized approach could potentially be used as a model for keyword development.

governance↗

Automated Indexing of Structured Scientific Metadata Using Apache Solr

Scientific datasets are continuously growing with the amount of raw data being collected worldwide. This amount of data poses the biggest challenge to web search engines on how to retrieve them efficiently. This paper discusses how major scientific data centers are using popular open-source search platforms such as Solr [1] to retrieve structured data stored in data sources such as relational database management systems using its import handler mechanisms [2]. Additionally, we will also focus on how we can configure Solr to serve advanced full-text, faceted search capabilities, along with its key features, which simplify representing and delivering better performance to the scientific search interfaces.

Guntupally, Kavya↗

Architecture of a Data Portal for Publishing and Delivering Open Data for Atmospheric Measurement

Atmospheric data are collected by researchers every day. Campaigns such as GOAmazon 2014/2015 and the Amazon Tall Tower Observatory collect essential data on aerosols, gases, cloud properties, and meteorological parameters in the Brazilian Amazon basin. These data products provide insights and essential information for analyzing and predicting natural processes. However, in Brazil, it is estimated that more than 80% of the scientific data collected are not published due to the lack of web portals that collect and store these data. This makes it difficult, or even impossible, to access and integrate the data, which can result in the loss of significant amounts of information and significantly affect the understanding of the overall data. To address this problem, we propose a data portal architecture and open data deployment that enable Big Data processing, human interaction, and download-oriented approaches with tools that help users catalog, publish and visualize atmospheric data. Thus, we describe the architecture developed, based on the experience of the Atmospheric Radiation Measurement Data Center, which incorporates the principles of FAIR, the infrastructure and content management system for managing scientific data. The portal partial results were tested with environmental data from contaminated areas at the University of São Paulo. Overall, this data portal creates more shared knowledge about atmospheric processes by providing users with access to open environmental data.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Atmospheric Radiation Measurement (ARM) airborne field campaign data products between 2013 and 2018

Airborne measurements are pivotal for providing detailed, spatiotemporally resolved information about atmospheric parameters and aerosol and cloud properties, thereby enhancing our understanding of dynamic atmospheric processes. For 30 years, the US Department of Energy (DOE) Office of Science supported an instrumented Gulfstream 1 (G-1) aircraft for atmospheric field campaigns. Data from the final decade of G-1 operations were archived by the Atmospheric Radiation Measurement (ARM) Data Center and made publicly available at no cost to all registered users. To ensure a consistent data format and to improve the accessibility of the ARM airborne data, an integrated dataset was recently developed covering the final 6 years of G-1 operations (2013 to 2018, https://doi.org/10.5439/1999133; Mei and Gaustad, 2024). The integrated dataset includes data collected from 236 flights (766.4 h), which covered the Arctic, the US Southern Great Plains (SGP), the US West Coast, the eastern North Atlantic (ENA), the Amazon Basin in Brazil, and the Sierras de Córdoba range in Argentina. These comprehensive data streams provide much-needed insight into spatiotemporal variability in the thermodynamic quantities and aerosol and cloud properties for addressing essential science questions in Earth system process studies. This paper describes the DOE ARM merged G-1 datasets, including information on the acquisition, data collection challenges and future potentials, and quality control processes. It further illustrates the usage of this merged dataset to evaluate the Energy Exascale Earth System Model (E3SM) with the Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package.

54 ENVIRONMENTAL SCIENCES↗