Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “commodity database”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

8 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2005

Lessons Learned From Developing Three Generations of Remote Sensing Science Data Processing Systems

The Biospheric Information Systems Branch at NASA s Goddard Space Flight Center has developed three generations of Science Investigator-led Processing Systems for use with various remote sensing instruments. The first system is used for data from the MODIS instruments flown on NASA s Earth Observing Systems @OS) Terra and Aqua Spacecraft launched in 1999 and 2002 respectively. The second generation is for the Ozone Measuring Instrument flying on the EOS Aura spacecraft launched in 2004. We are now developing a third generation of the system for evaluation science data processing for the Ozone Mapping and Profiler Suite (OMPS) to be flown by the NPOESS Preparatory Project (NPP) in 2006. The initial system was based on large scale proprietary hardware, operating and database systems. The current OMI system and the OMPS system being developed are based on commodity hardware, the LINUX Operating System and on PostgreSQL, an Open Source RDBMS. The new system distributes its data archive across multiple server hosts and processes jobs on multiple processor boxes. We have created several instances of this system, including one for operational processing, one for testing and reprocessing and one for applications development and scientific analysis. Prior to receiving the first data from OMI we applied the system to reprocessing information from the Solar Backscatter Ultraviolet (SBUV) and Total Ozone Mapping Spectrometer (TOMS) instruments flown from 1978 until now. The system was able to process 25 years (108,000 orbits) of data and produce 800,000 files (400 GiB) of level 2 and level 3 products in less than a week. We will describe the lessons we have learned and tradeoffs between system design, hardware, operating systems, operational staffing, user support and operational procedures. During each generational phase, the system has become more generic and reusable. While the system is not currently shrink wrapped we believe it is to the point where it could be readily adopted, with substantial cost savings, for other similar tasks.

Tilmes, Curt↗
NASA NTRS2004

The Development of Two Science Investigator-led Processing Systems (SIPS) for NASA's Earth Observation System (EOS)

In 2001, NASA Goddard Space Flight Center's Laboratory for Terrestrial Physics started the construction of a science Investigator-led Processing System (SIPS) for processing data from the Ozone Monitoring Instrument (OMI) which will launch on the Aura platform in mid 2004. The Ozone Monitoring Instrument (OMI) is a contribution of the Netherlands Agency for Aerospace Programs (NIVR) in collaboration with the Finnish Meteorological Institute (FMI) to the Earth Observing System (EOS) Aura mission. It will continue the Total Ozone Monitoring System (TOMS) record for total ozone and other atmospheric parameters related to ozone chemistry and climate. OMI measurements will be highly synergistic with the other instruments on the EOS Aura platform. The LTP previously developed the Moderate Resolution Imaging Spectrometer (MODIS) Data Processing System (MODAPS), which has been in full operations since the launches of the Terra and Aqua spacecrafts in December, 1999 and May, 2002 respectively. During that time, it has continually evolved to better support the needs of the MODIS team. We now run multiple instances of the system managing faster than real time reprocessings of the data as well as continuing forward processing. The new OMI Data Processing System (OMIDAPS) was adapted from the MODAPS. It will ingest raw data from the satellite ground station and process it to produce calibrated, geolocated higher level data products. These data products will be transmitted to the Goddard Distributed Active Archive Center (GDAAC) instance of the Earth Observing System (EOS) Data and Information System (EOSDIS) for long term archive and distribution to the public. The OMIDAPS will also provide data distribution to the OMI Science Team for quality assessment, algorithm improvement, calibration, etc. We have taken advantage of lessons learned from the MODIS experience and software already developed for MODIS. We made some changes in the hardware system organization, database and software to adapt the system for OMI. We replaced the fundamental database system, Sybase, with an Open Source RDBMS called PostgreSQL, and based the entire OMIDAPS on a cluster of Linux based commodity computers rather than the large SGI servers that MODAPS uses. Rather than relying on a central I/O server host, the new system distributes its data archive among multiple server hosts in the cluster. OMI is also customizing the graphical user interfaces and reporting structure to more closely meet the needs of the OMI Science Team. Prior to 2003, simulated OMI data and the science algorithms were not ready for production testing. We initially constructed a prototype system and tested using a 25 year dataset of Total Ozone Mapping Spectrometer (TOMS) and Solar Backscatter Ultraviolet Instrument (SBUV) data. This prototype system provided a platform to support the adaptation of the algorithms for OMI, and provided reprocessing of the historical data aiding in its analysis. In a recent reanalysis of the TOMS data, the OMIDAPS processed 108,000 full orbits of data through 4 processing steps per orbit, producing about 800,000 files (400 GiB) of level 2 and greater data files. More recently we have installed two instances of the OMIDAPS for integration and testing of OM1 science processes as they get delivered from the Science Team. A Test instance of the OMIDAPS has also supported a series of "Interface Confidence Tests" (ICTs) and End-to-End Ground System tests to ensure the launch readiness of the system. This paper will discuss the high-level hardware, software, and database organization of the OMIDAPS and how it builds on the MODAPS heritage system. It will also provide an overview of the testing and implementation of the production OMIDAPS.

Tilmes, Curt↗
NASA NTRS2004

A Low-Cost Clustered Archive Approach for Storing Remote Sensing Data

As part of NASA's Earth Observing System (EOS) Data and Information System (EOSDIS), the Moderate Resolution Imaging Spectrometer (MODIS) Data Processing System (MODAPS) is now processing data from two instruments on the EOS flag ship spacecraft Terra and Aqua. Between the two, MODAPS is generating over 1 Terrabyte of data per day and has surpassed 3 Petabytes of total data. The bulk of the data is stored near-line in StorageTek Powerhorn tape jukeboxes. Accessing data that has been moved to tape involves submitting an order, scheduling the tape, and waiting for the data to become available. I am developing a low cost clustered archive that could enable storing a very large amount of data such as the MODIS data described above in an organized fashion on a cluster of commodity hardware using low cost SATA hard drives such that the files are directly available online. The system takes full advantage of Open Source software, using the GNULinux operating system, PostgreSQL relational database and the Apache HTTP Server. This poster session will depict my approach, the interface to the archive, a brief discussion of the internals of the system and some performance numbers from my prototyping. I will also describe various costs and benefits of this approach versus the traditional large tape jukebox approach currently in use in the EOSDIS.

Tilmes, Curt↗
NASA NTRS2021

Severity of Drought and Heatwave Crop Losses Tripled Over the Last Five Decades in Europe

Extreme weather disasters (EWDs) can jeopardize domestic food supply and disrupt commodity markets. However, historical impacts on European crop production associated with droughts, heatwaves, floods, and cold waves are not well understood—especially in view of potential adverse trends in the severity of impacts due to climate change. Here, we combine observational agricultural data (FAOSTAT) with an extreme weather disaster database (EM-DAT) between 1961 and 2018 to evaluate European crop production responses to EWD. Using a compositing approach (superposed epoch analysis), we show that historical droughts and heatwaves reduced European cereal yields on average by 9% and 7.3%, respectively, associated with a wide range of responses (inter-quartile range +2% to −23%; +2% to −17%). Non-cereal yields declined by 3.8% and 3.1% during the same set of events. Cold waves led to cereal and non-cereal yield declines by 1.3% and 2.6%, while flood impacts were marginal and not statistically significant. Production losses are largely driven by yield declines, with no significant changes in harvested area. While all four event frequencies significantly increased over time, the severity of heatwave and drought impacts on crop production roughly tripled over the last 50 years, from −2.2% (1964–1990) to −7.3% (1991–2015). Drought-related cereal production losses are shown to intensify by more than 3% yr−1. Both the trend in frequency and severity can possibly be explained by changes in the vulnerability of the exposed system and underlying climate change impacts.

Extreme weather disasters↗
NASA NTRS2003

From Oxygen Generation to Metals Production: In Situ Resource Utilization by Molten Oxide Electrolysis

For the exploration of other bodies in the solar system, electrochemical processing is arguably the most versatile technology for conversion of local resources into usable commodities: by electrolysis one can, in principle, produce (1) breathable oxygen, (2) silicon for the fabrication of solar cells, (3) various reactive metals for use as electrodes in advanced storage batteries, and (4) structural metals such as steel and aluminum. Even so, to date there has been no sustained effort to develop such processes, in part due to the inadequacy of the database. The objective here is to identify chemistries capable of sustaining molten oxide electrolysis in the cited applications and to examine the behavior of laboratory-scale cells designed to generate oxygen and to produce metal. The basic research includes the study of the underlying high-temperature physical chemistry of oxide melts representative of lunar regolith and of Martian soil. To move beyond empirical approaches to process development, the thermodynamic and transport properties of oxide melts are being studied to help set the limits of composition and temperature for the processing trials conducted in laboratory-scale electrolysis cells. The goal of this investigation is to deliver a working prototype cell that can use lunar regolith and Martian soil to produce breathable oxygen along with metal by-product. Additionally, the process can be generalized to permit adaptation to accommodate different feedstock chemistries, such as those that will be encountered on other bodies in the solar system. The expected results of this research include: (1) the identification of appropriate electrolyte chemistries; (2) the selection of candidate anode and cathode materials compatible with electrolytes named above; and (3) performance data from a laboratory-scale cell producing oxygen and metal. On the strength of these results it should be possible to assess the technical viability of molten oxide electrolysis for in situ resource utilization on the Moon and Mars. In parallel, there may be commercial applications here on earth, such as new green technologies for metals extraction and for treatment of hazardous waste, e.g., fixing heavy metals.

Khetpal, Deepak↗
NASA NTRS2004

Transitioning to Intel-based Linux Servers in the Payload Operations Integration Center

The MSFC Payload Operations Integration Center (POIC) is the focal point for International Space Station (ISS) payload operations. The POIC contains the facilities, hardware, software and communication interface necessary to support payload operations. ISS ground system support for processing and display of real-time spacecraft and telemetry and command data has been operational for several years. The hardware components were reaching end of life and vendor costs were increasing while ISS budgets were becoming severely constrained. Therefore it has been necessary to migrate the Unix portions of our ground systems to commodity priced Intel-based Linux servers. hardware architecture including networks, data storage, and highly available resources. This paper will concentrate on the Linux migration implementation for the software portion of our ground system. The migration began with 3.5 million lines of code running on Unix platforms with separate servers for telemetry, command, Payload information management systems, web, system control, remote server interface and databases. The Intel-based system is scheduled to be available for initial operational use by August 2004 The overall migration to Intel-based Linux servers in the control center involves changes to the This paper will address the Linux migration study approach including the proof of concept, criticality of customer buy-in and importance of beginning with POSlX compliant code. It will focus on the development approach explaining the software lifecycle. Other aspects of development will be covered including phased implementation, interim milestones and metrics measurements and reporting mechanisms. This paper will also address the testing approach covering all levels of testing including development, development integration, IV&V, user beta testing and acceptance testing. Test results including performance numbers compared with Unix servers will be included. need for a smooth transition while maintaining real-time support. An important aspect of the paper will involve challenges and lessons learned. product compatibility, implications of phasing decisions and tracking of dependencies, particularly non- software dependencies. The paper will also discuss scheduling challenges providing real-time flight support during the migration and the requirement to incorporate in the migration changes being made simultaneously for flight support. This paper will also address the deployment approach including user involvement in testing and the , This includes COTS product compatibility, implications of phasing decisions and tracking of dependencies, particularly non- software dependencies. The paper will also discuss scheduling challenges providing real-time flight support during the migration and the requirement to incorporate in the migration changes being made simultaneously for flight support.

Guillebeau, P. L.↗
NASA NTRS2015

The Open Data Repositorys Data Publisher

Data management and data publication are becoming increasingly important components of researcher's workflows. The complexity of managing data, publishing data online, and archiving data has not decreased significantly even as computing access and power has greatly increased. The Open Data Repository's Data Publisher software strives to make data archiving, management, and publication a standard part of a researcher's workflow using simple, web-based tools and commodity server hardware. The publication engine allows for uploading, searching, and display of data with graphing capabilities and downloadable files. Access is controlled through a robust permissions system that can control publication at the field level and can be granted to the general public or protected so that only registered users at various permission levels receive access. Data Publisher also allows researchers to subscribe to meta-data standards through a plugin system, embargo data publication at their discretion, and collaborate with other researchers through various levels of data sharing. As the software matures, semantic data standards will be implemented to facilitate machine reading of data and each database will provide a REST application programming interface for programmatic access. Additionally, a citation system will allow snapshots of any data set to be archived and cited for publication while the data itself can remain living and continuously evolve beyond the snapshot date. The software runs on a traditional LAMP (Linux, Apache, MySQL, PHP) server and is available on GitHub (http://github.com/opendatarepository) under a GPLv2 open source license. The goal of the Open Data Repository is to lower the cost and training barrier to entry so that any researcher can easily publish their data and ensure it is archived for posterity.

Astrobiology data↗
NASA NTRS2022

Flow Testing of Corrugated Metal Flexhoses to Evaluate Flow-Induced Vibration and Stiffness

Corrugated metal flexhoses are used to supply fluid routing where straight rigid pipes cannot meet the design requirements due to vibrations, thermal expansion, or motion. These types of hoses are found in a wide range of applications at KSC (Exploration Ground Systems Program in particular) with various fluid commodities such as fuel, oxidizers, coolant, and cryogenics. However, flexibility of design comes at a price: due to increased levels of turbulence generated by the hose geometry, the necessary supply pressure must increase to achieve the same flow rate. Furthermore, the convolutes of the flexhoses interact with the flow field to generate areas of flow separation which leads to a phenomenon known as vortex shedding. When the frequency of vortex shedding couples with the natural frequency of the hose, this can be detrimental and cause premature failure. There are a limited amount of software that can correctly model the coupled fluid structure interactions(FSI) between the solid and fluid physics. This project aims to develop a computer model that can predict Flow-Induced Vibration (FIV) on flexhoses in one of the atypical configurations found in the State-of-the-Art (SOTA) standard for hoses in an angulated state. Our research seeks to extend the literature and expand NASA’s FIV standard. The computational rigor and resources available in the Apollo Era did not allow for flow coupling between fluids and structure interfaces to evaluate FIV of the flexhose. Our team believes that modern techniques and methods of evaluation should be used to reevaluate and extend the database of FIV and stiffness properties of flexhoses to assess the risk of failure. The core performance criteria is a computer model that is able to predict the FIV frequency within 10%.

Jared F. Congiardo↗