Data management at the National Space Science Data Center
Data management functions of National Space Science Data Center /NSSDC/, discussing data processing and information system for secondary usage
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Data management functions of National Space Science Data Center /NSSDC/, discussing data processing and information system for secondary usage
Data management functions of National Space Science Data Center /NSSDC/, discussing data processing and information system for secondary usage
Management Information System, MIS, provides Life Sciences Projects Division at Johnson Space Center with automated system for project managment. MIS utilizes Tektronix 4027 color graphics display terminal and form-fillout capability. User interface with MIS data base is through series of forms.
This white paper focuses on the scientific rationale and motivation for deploying phase change processes-based spacecraft thermal management systems for space missions [1,2]. Phase change processes need to be implemented in the design of various life support systems, sub-critical cryogenic and thermal control systems, taking advantage of the latent heat of phase change so as to significantly increase the heat transfer rate per unit fluid mass. Experimental data are critical to understanding gravitational effects on complex phase change processes using novel materials and working fluids. Experimental data can be acquired by either designing new testing platforms or performing experiments with simulant fluids on existing microgravity platforms. With the acquired data, theoretical flow physics models and numerical simulations can then be validated for use under long-duration microgravity conditions. The acquired data and validated models will enable the deployment of game-changing thermal management systems with remarkably improved efficiency and stability in heat acquisition, transport, and rejection for long-duration space missions.
Greenhouse gas (GHG) emissions continue to grow, while natural carbon reservoirs are becoming increasingly vulnerable to anthropogenic pressures, climate extremes, and disturbance. These changes are impacting humans, ecosystems, and natural resources worldwide. Tracking and mitigating GHG emissions require a pivot to operational monitoring of regional carbon flux and stock changes. The current GHG observing system is addressing needs at two distinct scales: 1) Local scale (< 1 km), related to anthropogenic point source emissions, and 2) global scales (> 1000 km), related to land and ocean carbon sinks. More focus on intermediate (10–1000 km) scales is needed to more effectively monitor progress in reducing carbon emissions, enhancing removals, and maintaining sinks. Representatives from carbon cycle biomass and flux communities across United States government agencies and academic institutions met in September 2024 to discuss the rationale and scientific context for more effectively implementing an operational system for GHG monitoring in support of urban and national carbon management needs. To guide development of this system, we propose a multi-tiered global spaceborne observing framework for carbon flux and stock, prioritizing: 1) frequent GHG partial columns for carbon emissions and removals; 2) continuous time series and data fusion of biomass from Lidar and Synthetic Aperture Radar (SAR) for carbon stocks, and 3) expanded coverage of tropical, high latitude, and oceanic regions to monitor carbon cycle tipping points and feedbacks. This system should be complemented by expanded surface and airborne networks for oceanic and terrestrial/aquatic ecosystems for calibration, ground truthing, and study of under-sampled regions.
Scientific discovery at the exascale will not be possible without significant new research in the management, storage and retrieval over the long lifespan of the extreme amounts of data that will be produced. Our thesis is that adding application level knowledge about data to guide the actions of the storage system provides substantial benefits to the organization, storage, and access to extreme scale data, resulting in improved productivity for computational science. In this project we will demonstrate novel techniques to facilitate efficient mapping of data objects, even partitioning individual variables, from the user space onto multiple storage tiers, and enable application-guided data reductions and transformations to address capacity and bandwidth bottlenecks. Our goal is to address the associated Input/ Output (I/O) and storage challenges in the context of current and emerging storage landscapes, and expedite insights into mission critical scientific processes.
Environmental effects on management economics of public science programs
The Mars Science Laboratory is a NASA/JPL mission to send the next generation of rover to Mars. Originally slated for launch in 2009, development problems led to a delay in the project until the next launch opportunity in 2011. Amidst the delay process, the Launch/Cruise Solar Thermal Vacuum Test was undertaken as risk reduction for the project. With varying maturity and capabilities of the flight and ground systems, undertaking the test in a safe manner presented many challenges. This paper describes the technical and management challenges and the actions undertaken that led to the ultimate safe and successful execution of the test.
The objective of Topic Area V is to evaluate the feasibility and safety of an intermediate-depth borehole for disposal of IAEC nuclear waste. The IAEC nuclear waste is currently stored in above ground and/or in near-surface facilities that provide short-term radiological worker safety but do not provide long-term, full security and safeguards protection for the nuclear material. Disposal of the IAEC nuclear waste several hundred meters below the surface in a sealed borehole would provide long-term security and safeguards due to its depth underground, as well as long-term radiological safety, due to its isolation in a stable geological formation.
Here, the collaborative efforts of large communities in science experiments, often comprising thousands of global members, reflect a monumental commitment to exploration and discovery. Recently, advanced and complex data processing has gained increasing importance in science experiments. Data processing workflows typically consist of multiple intricate steps, and the precise specification of resource requirements is crucial for each step to allocate optimal resources for effective processing. Estimating resource requirements in advance is challenging due to a wide range of analysis scenarios, varying skill levels among community members, and the continuously increasing spectrum of computing options. One practical approach to mitigate these challenges involves initially processing a subset of each step to measure precise resource utilization from actual processing profiles before completing the entire step. While this two-staged approach enables processing on optimal resources for most of the workflow, it has drawbacks such as initial inaccuracies leading to potential failures and suboptimal resource usage, along with overhead from waiting for initial processing completion, which is critical for fast-turnaround analyses. In this context, our study introduces a novel pipeline of machine learning models within a comprehensive workflow management system, the Production and Distributed Analysis (PanDA) system. These models employ advanced machine learning techniques to predict key resource requirements, overcoming challenges posed by limited upfront knowledge of characteristics at each step. Accurate forecasts of resource requirements enable informed and proactive decision-making in workflow management, enhancing the efficiency of handling diverse, complex workflows across heterogeneous resources.
The 7 th workshop of the NNSA-IAEC collaboration was conducted on November 8-10 2022. The workshop was held at the geologic survey of Israel, Jerusalem. The IAEC hosted the workshop. The main topic of the workshop evolved around the results of the characterization borehole drilled in the Yamin plain during 2022 and associated experimental work and modeling results. The new data will be integrated for the applicability analysis of intermediate depth borehole (IDB) disposal for spent fuel in the Yamin plain. The first day of the workshop (November 8 th ) was dedicated to a geological field trip in the Judea desert depicting a similar cross section to that found in the Yamin plain. During the 9 th and 10 th of November the characterization BH results were presented, results of new work on the Miocene Hazeva fm. were presented, and this year’s outcome of the different collaboration groups were given.
At LLNL we contribute to two projects in NNSA-IAEC Science and Technology Working Group Area V: Basic Science of Waste Management & Subsurface Science. The motivation behind Topic Area V is to evaluate the scientific and safety case for an intermediate borehole to house Israel’s nuclear waste. WM1 (SNL lead) is Thermomechanical Damage (initially called Damage Accumulation and Wellbore Stability). This work focuses on evaluating the damage to the host rock induced by excavation and heat released from a possible radioactive waste repository/borehole. WM2 (LLNL lead) is Radionuclide Facilitated Transport in Carbonate Rock (initially called Colloidal Transport of Radionuclides). This work focuses on better understanding the transport of radionuclides and colloids from a nuclear waste repository/borehole in a vadose zone environment through experimentation and modeling. In the second quarter (this report) our work has been delayed in part due to COVID-19. LLNL went into shelter in place (SIP), minimum safe operations mid-March. Operations at LLNL have been slowly ramping up with 50% of the workforce back onsite in limited capacity and telecommuting widely used. The good news is that our labs opened up the last week in June and experiments are expected to start up again for WM2 Radionuclide Facilitated Transport in July. LLNL’s contribution to WM1 Thermochemical Damage modeling efforts also started back up in late June. We expect to be able to catch up on much of our work by the end of next quarter. The three national laboratories communication on a bi-monthly basis to make sure Area V projects remain on track and we have a monthly conference call with our Israeli counterparts to make sure we are communicating priorities and coordinating project details.
At LLNL we contribute to two projects in NNSA-IAEC Science and Technology Working Group Area V: Basic Science of Waste Management & Subsurface Science. The motivation behind Topic Area V is to evaluate the scientific and safety case for an intermediate borehole to house Israel’s nuclear waste. WM1 (SNL lead) is Thermomechanical Damage (initially called Damage Accumulation and Wellbore Stability). This work focuses on evaluating the damage to the host rock induced by excavation and heat released from a possible radioactive waste repository/borehole. WM2 (LLNL lead) is Radionuclide Facilitated Transport in Carbonate Rock (initially called Colloidal Transport of Radionuclides). This work focuses on better understanding the transport of radionuclides and colloids from a nuclear waste repository/borehole in a vadose zone environment through experimentation and modeling. In the second quarter (this report) our work has been delayed in part due to COVID-19. LLNL went into shelter in place (SIP), minimum safe operations mid-March. Operations at LLNL have been slowly ramping up with 50% of the workforce back onsite in limited capacity and telecommuting widely used. The good news is that our labs opened up the last week in June and experiments are expected to start up again for WM2 Radionuclide Facilitated Transport in July. LLNL’s contribution to WM1 Thermochemical Damage modeling efforts also started back up in late June. We expect to be able to catch up on much of our work by the end of next quarter. The three national laboratories communication on a bi-monthly basis to make sure Area V projects remain on track and we have a monthly conference call with our Israeli counterparts to make sure we are communicating priorities and coordinating project details.
The data sets being generated by large applications on very large-scale systems are increasing in both size and complexity. At the same time, there are new ways available to store and access these data sets. The goal in this project is to develop software that applications can use to make use of new and existing storage technologies in more sophisticated ways. One challenge in scientific data management is handling ‘hot’ vs ‘cold’ data. Data that is hot is data that is needed (or will be needed soon) in order for the program to continue progressing, while cold data is either output (and so will not be need further during the life of the program) or will not be needed until significantly later in the program’s run. Hot data should be stored in a way that allows fast access. On most systems, economic factors lead to an inverse relationship between storage performance and storage capacity and so fast access storage is limited. This makes it important to correctly place hot and cold data and avoid cold data unnecessarily consuming precious resources. In this reporting period, we addressed this challenge in various ways and at various levels. Data management frameworks offer only limited control to applications in how data is stored. We have added software capabilities for seamlessly moving data between layers of the storage technology using promote and demote functions to existing software frameworks. This gives direct control to applications in deciding what priority data receives. Additionally, we integrated different storage layer management frameworks in order to allow data to be exchanged and moved between storage layers in a consistent way across the application. Further, applications are not always able to directly decide what storage level makes sense for a given piece of data without an understanding of the underlying storage technologies. Data storage frameworks are often positioned to make these sorts of decisions in service of the application. We have added machine-learning based capabilities to data staging frameworks in order to make intelligent decisions about where data should be stored given learning about patterns in previous usage of similar data.
The objective of Topic Area V is to evaluate the feasibility and safety of an intermediate-depth borehole for disposal of IAEC nuclear waste. The IAEC nuclear waste is currently stored in above ground and/or in near-surface facilities that provide short-term radiological worker safety but do not provide long-term, full security and safeguards protection for the nuclear material. Disposal of the IAEC nuclear waste several hundred meters below the surface in a sealed borehole would provide long-term security and safeguards due to its depth underground, as well as long-term radiological safety, due to its isolation in a stable geological formation.
The High Performance Database Research Center at Florida International University is completing the development of a highly parallel database system based on the semantic/object-oriented approach. This system provides exceptional usability and flexibility. It allows shorter application design and programming cycles and gives the user control via an intuitive information structure. It empowers the end-user to pose complex ad hoc decision support queries. Superior efficiency is provided through a high level of optimization, which is transparent to the user. Manifold reduction in storage size is allowed for many applications. This system allows for operability via internet browsers. The system will be used for the NASA Applications Center program to store remote sensing data, as well as for Earth Science applications.
The FM (Frame Manager) flight software module is responsible for maintaining the frame tree database containing coordinate transforms between frames. The frame tree is a proper tree structure of directed links, consisting of surface and rover subtrees. Actual frame transforms are updated by their owner. FM updates site and saved frames for the surface tree. As the rover drives to a new area, a new site frame with an incremented site index can be created. Several clients including ARM and RSM (Remote Sensing Mast) update their related rover frames that they own. Through the onboard centralized FM frame tree database, client modules can query transforms between any two frames. Important applications include target image pointing for RSM-mounted cameras and frame-referenced arm moves. The use of frame tree eliminates cumbersome, error-prone calculations of coordinate entries for commands and thus simplifies flight operations significantly.
No abstract available