Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “science data system”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

CMIP7 data request: Earth system priorities and opportunities

This paper presents a comprehensive overview of the Coupled Model Intercomparison Project Phase 7 (CMIP7) request for data pertaining to Earth systems science, and provides justification for the resources needed to produce this data. Topics within the CMIP7 Earth System (CMIP7-ES) theme centre around tracking of flows of energy, carbon, water and other fluxes across domains, and constraining feedbacks between these cycles and the climate system. These topics are summarized in this paper as scientific “opportunities” describing specific model intercomparison experiments and use cases for next-generation Earth System Model (ESM) output. These opportunities were submitted by modelling groups and scientific consortia following an extended public consultation process. Contained within each opportunity are requests for groups of Climate & Forecasting (CF) variables, which are bundled into variable groups representing all data required to address the opportunities' needs. Novel opportunities in CMIP7 compared with previous phases will include running `emissions-driven' simulations that integrate carbon emissions and removal scenarios with updated representations of the global carbon cycle, expanded variable groups needed to model marine trophic interactions and biogeochemistry, and data needed to understand the risk of global tipping points, among others. The production of these variables will close key gaps and uncertainties identified during previous rounds of CMIP, and support the 7th Intergovernmental Panel on Climate Change Assessment Report (AR7). We argue that CMIP7-ES data will be broadly used by scientific, policy, governmental, industry, and other communities that rely on climate model projections for research and decision making. As an author group we also reflect on the evolution of the CMIP7-ES data request as a part of a deliberative process in support of the global CMIP program.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2000

Climatological Processing of Radar Data for the TRMM Ground Validation Program

The Tropical Rainfall Measuring Mission (TRMM) satellite was successfully launched in November, 1997. The main purpose of TRMM is to sample tropical rainfall using the first active spaceborne precipitation radar. To validate TRMM satellite observations, a comprehensive Ground Validation (GV) Program has been implemented. The primary goal of TRMM GV is to provide basic validation of satellite-derived precipitation measurements over monthly climatologies for the following primary sites: Melbourne, FL; Houston, TX; Darwin, Australia; and Kwajalein Atoll, RMI. As part of the TRMM GV effort, research analysts at NASA Goddard Space Flight Center (GSFC) generate standardized TRMM GV products using quality-controlled ground-based radar data from the four primary GV sites as input. This presentation will provide an overview of the TRMM GV climatological processing system. A description of the data flow between the primary GV sites, NASA GSFC, and the TRMM Science and Data Information System (TSDIS) will be presented. The radar quality control algorithm, which features eight adjustable height and reflectivity parameters, and its effect on monthly rainfall maps will be described. The methodology used to create monthly, gauge-adjusted rainfall products for each primary site will also be summarized. The standardized monthly rainfall products are developed in discrete, modular steps with distinct intermediate products. These developmental steps include: (1) extracting radar data over the locations of rain gauges, (2) merging rain gauge and radar data in time and space with user-defined options, (3) automated quality control of radar and gauge merged data by tracking accumulations from each instrument, and (4) deriving Z-R relationships from the quality-controlled merged data over monthly time scales. A summary of recently reprocessed official GV rainfall products available for TRMM science users will be presented. Updated basic standardized product results and trends involving monthly accumulation, Z-R relationship, and gauge statistics for each primary GV site will be also displayed.

Kulie, Mark↗
NASA NTRS1991

NASA information systems commonality and convergence

Efforts to identify high payback functions performed by the Office of Space Science Applications (OSSA) data systems package existing operationally proven implementations as system building blocks and foster their use in the OSSA environment. An overview is given of the current state of OSSA data systems and the major challenges facing system developers over the next five years. Current trends in system commonality are discussed, and development is examined in the context of system design. Central system engineering approaches to solving the commonality and interoperability challenges are described. Efforts to package three diverse building blocks and to foster their reuse are documented.

Handley, Thomas H., Jr.↗
NASA NTRS2009

The 2nd Generation Real Time Mission Monitor (RTMM) Development

The NASA Real Time Mission Monitor (RTMM) is a visualization and information system that fuses multiple Earth science data sources, to enable real time decisionmaking for airborne and ground validation experiments. Developed at the National Aeronautics and Space Administration (NASA) Marshall Space Flight Center, RTMM is a situational awareness, decision-support system that integrates satellite imagery and orbit data, radar and other surface observations (e.g., lightning location network data), airborne navigation and instrument data sets, model output parameters, and other applicable Earth science data sets. The integration and delivery of this information is made possible using data acquisition systems, network communication links, network server resources, and visualizations through the Google Earth virtual globe application. In order to improve the usefulness and efficiency of the RTMM system, capabilities are being developed to allow the end-user to easily configure RTMM applications based on their mission-specific requirements and objectives. This second generation RTMM is being redesigned to take advantage of the Google plug-in capabilities to run multiple applications in a web browser rather than the original single application Google Earth approach. Currently RTMM employs a limited Service Oriented Architecture approach to enable discovery of mission specific resources. We are expanding the RTMM architecture such that it will more effectively utilize the Open Geospatial Consortium Sensor Web Enablement services and other new technology software tools and components. These modifications and extensions will result in a robust, versatile RTMM system that will greatly increase flexibility of the user to choose which science data sets and support applications to view and/or use. The improvements brought about by RTMM 2nd generation system will provide mission planners and airborne scientists with enhanced decision-making tools and capabilities to more efficiently plan, prepare and execute missions, as well as to playback and review past mission data. To paraphrase the old television commercial RTMM doesn t make the airborne science, it makes the airborne science easier.

Blakeslee, Richard↗
NASA NTRS2017

GES DISC Data Recipes in Jupyter Notebooks

The Earth Science Data and Information System (ESDIS) Project manages twelve Distributed Active Archive Centers (DAACs) which are geographically dispersed across the United States. The DAACs are responsible for ingesting, processing, archiving, and distributing Earth science data produced from various sources (satellites, aircraft, field measurements, etc.). In response to projections of an exponential increase in data production, there has been a recent effort to prototype various DAAC activities in the cloud computing environment. This, in turn, led to the creation of an initiative, called the Cloud Analysis Toolkit to Enable Earth Science (CATEES), to develop a Python software package in order to transition Earth science data processing to the cloud. This project, in particular, supports CATEES and has two primary goals. One, to transition data recipes created by the Goddard Earth Science Data and Information Service Center (GES DISC) into an interactive and educational environment using JupyterNotebooks. Two, to acclimate Earth scientists to cloud computing. To accomplish these goals, we create JupyterNotebooks to compartmentalize the different steps of data analysis and help users obtain and parse data from the command line. We also develop a Docker container, comprised of Jupyter Notebooks, Python dependencies, and command line tools, and configure it into an easy-to-deploy package. The end result is an end-to-end product that simulates the use case of end users working in the cloud computing environment.

discoverability↗
NASA NTRS1989

Development of an intelligent interface for adding spatial objects to a knowledge-based geographic information system

Earth Scientists lack adequate tools for quantifying complex relationships between existing data layers and studying and modeling the dynamic interactions of these data layers. There is a need for an earth systems tool to manipulate multi-layered, heterogeneous data sets that are spatially indexed, such as sensor imagery and maps, easily and intelligently in a single system. The system can access and manipulate data from multiple sensor sources, maps, and from a learned object hierarchy using an advanced knowledge-based geographical information system. A prototype Knowledge-Based Geographic Information System (KBGIS) was recently constructed. Many of the system internals are well developed, but the system lacks an adequate user interface. A methodology is described for developing an intelligent user interface and extending KBGIS to interconnect with existing NASA systems, such as imagery from the Land Analysis System (LAS), atmospheric data in Common Data Format (CDF), and visualization of complex data with the National Space Science Data Center Graphics System. This would allow NASA to quickly explore the utility of such a system, given the ability to transfer data in and out of KBGIS easily. The use and maintenance of the object hierarchies as polymorphic data types brings, to data management, a while new set of problems and issues, few of which have been explored above the prototype level.

Campbell, William J.↗
NASA NTRS1992

Global views of Venus from Magellan

Magellan data for Venus reveal a planet with a great diversity of volcanic and tectonic landforms, with good evidence of continuing volcanism and tectonism. Weathering, mass wasting and wind erosion and deposition have modified the surface only to the extent of a few meters, thereby preserving an excellent record of tectonic and volcanic processes on a terrestrial-size planet. All cycle 1 mosaics, radiometry, and altimeter data will be made available through the Planetary Data System and the National Space Science Data Center.

Arvidson, R. E.↗
DOE OSTI2020

Flat-histogram extrapolation as a useful tool in the age of big data

In this work, we review recent work by the authors to revisit the concept of extrapolating thermodynamic properties of classical systems using statistical mechanical principles. Specifically, we discuss how the combination of these principles with biased sampling techniques enables the prediction of free energy landscapes and other detailed information, such as structural properties, of the system in question. Remarkably accurate estimates of physical properties across a broad range of conditions have been achieved using this approach, greatly reducing the number of simulations needed to explore a given system's behaviour. While approximate, these extrapolations significantly amplify the amount of reasonably accurate information that can be extracted from simulations enabling a small set of them to feed data-intensive regression algorithms such as neural networks. Thus, this extrapolation methodology represents a useful tool for performing tasks such as high-throughput screening of physical properties, optimising force field parameters, exploring equilibrium phase behaviour, and enabling theory-guided data science for these systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1993

The European HST Science Data Archive

The paper describes the European HST Science Data Archive. Particular attention is given to the flow from the HST spacecraft to the Science Data Archive at the Space Telescope European Coordinating Facility (ST-ECF); the archiving system at the ST-ECF, including the hardware and software system structure; the operations at the ST-ECF and differences with the Data Management Facility; and the current developments. A diagram of the logical structure and data flow of the system managing the European HST Science Data Archive is included.

Pasian, F.↗
NASA NTRS1992

Multi-frequency multi-polarization processing for spaceborne SAR

The Shuttle Imaging Radar-C (SIR-C) is the third in a series of space shuttle based synthetic aperture radars (SAR) sponsored by the National Aeronautics and Space Administration (NASA). The SIR-C ground data processing system is to process the playbacked SAR signal data into a variety of data products for distribution to the science community. An overview of the end-to-end ground data processing system with emphasis on the unique characteristics involved in the system design is presented. Included in the discussion are science requirements, radar system specifications, input data format specifications, system operations design, data products design, processing algorithm design, hardware architecture design, and software design.

Curlander, John C.↗
NASA NTRS1977

DSN radio science system description and requirements

The data system created to collect the functions performed by the Deep Space Network in support of spacecraft radio science experiments is described. Some of the major functional requirements presently being considered for the system are delineated.

Mulhall, B. D. L.↗
NASA NTRSDate not supplied

How NASA Went From App Best Practices to Metaprogramming Better Apps

Relive the adrenaline pumping journey as NASA partners with Splunk to go beyond the app design gravity hold, through to the best practices asteroid belt, and eventually landing on NASA's solution for an on-the-fly conf file and knowledge object management solution. Break out of your black hole of conf stanza management. Discover NASA's concrete examples from apps they've developed to support NASA’s Earth Science Data and Information System’s operations. Rover over to this talk because after all, Splunk's not rocket science.

Sarah Dietrich↗
NASA NTRS2004

Flying the Earth Observing Constellations

Prior to the launch of the Earth Observing System (EOS) Terra and Landsat-7 satellites in 1999, the Project Scientists for the two missions and the Earth Science Data and Information System (ESDIS) Project at the Goddard Space Flight Center signed an inter-project agreement document describing their plan to fly in loose formation, approximately 20 minutes within each other. In November 2000, a technology demonstration satellite, Earth Observer-1 (EO-1), was launched into the same orbit as that of Landsat-7 and Terra, with a goal of flying within a minute from Landsat-7. The SAC-C satellite, developed and operated by the government of Argentina, was launched along with EO-1, with a goal of flying near both Terra and Landsat-7. This formation enables the scientists to make use of the scientific synergy among the instruments on the different spacecraft. This group of satellites constitutes the morning constellation, which is led by the Landsat-7, which has a mean local time (MLT) at 10:00 a.m. In May 2002, the EOS Aqua satellite was launched into an orbit with an altitude of 705 km. and a 1:30 p.m. MLT. Two smaller satellites, CALIPSO (a joint U.S./French mission), and CloudSat (a joint NASA/Colorado State University/Air Force mission), plan to fly in tight formation, within 15 seconds of each other. In addition, CALIPSO and CloudSat also plan to be within 30 to 60 seconds of the Aqua satellite. A third satellite, PARASOL, managed by the French Space Agency, CNES, will be placed within a minute of the CALIPSO satellite. In 2004, the Aura satellite will be launched and phased in relation to the Aqua satellite, such that the instruments on Aura will be able to view the same mass of air no later than 8 minutes after the instruments on Aqua have observed it. Representatives from each mission are currently documenting a plan on how they will coordinate on-orbit operations. Why are all these satellites planning to fly as a constellation? The answer is that as a constellation. the scientists will be able to acquire science data not only from their specific instruments on a single satellite, but science data from the other satellites which will have been taken at approximately the same time, thus resulting in coordinated science observation data. This leads to better quality science. This paper describes how the mission design has been driven by the science requirements. The morning and the afternoon constellations present operational challenges, which had not previously been encountered. Operations planning must address not only how the satellites of each constellation operate safely together, but also, how the two constellations fly on the same orbits without interfering with each other as they downlink data to their respective ground stations. This paper describes the operations experience gained from the morning constellation and the planning for the afternoon constellation.

Kelly, Angelita C.↗
NASA NTRS2020

Continuity of MODIS and VIIRS Snow Cover Extent Data Products for Development of an Earth Science Data Record

An Earth Observing System global snow cover extent data products record at moderate spatial resolution (375–500 m) began in February 2000 with the Moderate-resolution Imaging Spectroradiometer (MODIS) instrument onboard the Terra satellite. The record continued with the Aqua MODIS in July 2002, the Suomi-National Polar Platform (S-NPP) Visible Infrared Imaging Radiometer Suite (VIIRS) in January 2012 and continues with the Joint Polar Satellite System-1 (JPSS-1) VIIRS, launched in November of 2017. The objective of this work is to develop a snow cover extent Earth Science Data Record (ESDR) using different satellites, sensors and algorithms. There are many issues to understand when data from different algorithms and sensors are used over a decade-scale time period to create a continuous dataset. Issues may also arise with sensor degradation and even differences in sensor band locations. In this paper we describe development of an ESDR derived from existing MODIS and VIIRS data products and demonstrate continuity among the products. The MODIS and VIIRS snow cover detection algorithms produce very similar daily snow cover maps, with 90–97% agreement in snow cover extent (SCE) in different landscapes. Differences in SCE between products ranged from 2–15% and are attributable to convolved factors of viewing geometry, pixel spread across a scan and time of observation. Compared at a common grid size of 1 km, there is a mean of 95% agreement in SCE and a difference range of 1–10% between the MODIS and VIIRS SCE maps. Mapping sensor observations to a coarser resolution grid reduces the effect of the factors convolved in the 500 m tile to tile comparisons. We conclude that the MODIS and VIIRS SCE data products are reliable constituents of a moderate-resolution ESDR.

snow cover extent↗
DOE OSTI2016

Integration Of PanDA Workload Management System With Supercomputers for ATLAS and Data Intensive Science

The.LHC, operating at CERN, is leading Big Data driven scientific explorations. Experiments at the LHC explore the fundamental nature of matter and the basic forces that shape our universe. ATLAS, one of the largest collaborations ever assembled in the sciences, is at the forefront of research at the LHC. To address an unprecedented multi-petabyte data processing challenge, the ATLAS experiment is relying on a heterogeneous distributed computational infrastructure. The ATLAS experiment uses PanDA (Production and Data Analysis) Workload Management System for managing the workflow for all data processing on over 150 data centers. Through PanDA, ATLAS physicists see a single computing facility that enables rapid scientific breakthroughs for the experiment, even though the data centers are physically scattered all over the world. While PanDA currently uses more than 250,000 cores with a peak performance of 0.3 petaFLOPS, LHC data taking runs require more resources than grid can possibly provide. To alleviate these challenges, LHC experiments are engaged in an ambitious program to expand the current computing model to include additional resources such as the opportunistic use of supercomputers. We will describe a project aimed at integration of PanDA WMS with supercomputers in United States, in particular with Titan supercomputer at Oak Ridge Leadership Computing Facility. Current approach utilizes modified PanDA pilot framework for job submission to the supercomputers batch queues and local data management, with light-weight MPI wrappers to run single threaded workloads in parallel on LCFs multi-core worker nodes. This implementation was tested with a variety of Monte-Carlo workloads on several supercomputing platforms for ALICE and ATLAS experiments and it is in full pro duction for the ATLAS since September 2015. We will present our current accomplishments with running PanDA at supercomputers and demonstrate our ability to use PanDA as a portal independent of the computing facilities infrastructure for High Energy and Nuclear Physics as well as other data-intensive science applications, such as bioinformatics and astro-particle physics.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2015

Earth Science Informatics - Overview

Over the last 10-15 years, significant advances have been made in information management, there are an increasing number of individuals entering the field of information management as it applies to Geoscience and Remote Sensing data, and the field of informatics has come to its own. Informatics is the science and technology of applying computers and computational methods to the systematic analysis, management, interchange, and representation of science data, information, and knowledge. Informatics also includes the use of computers and computational methods to support decision making and applications. Earth Science Informatics (ESI, a.k.a. geoinformatics) is the application of informatics in the Earth science domain. ESI is a rapidly developing discipline integrating computer science, information science, and Earth science. Major national and international research and infrastructure projects in ESI have been carried out or are on-going. Notable among these are: the Global Earth Observation System of Systems (GEOSS), the European Commissions INSPIRE, the U.S. NSDI and Geospatial One-Stop, the NASA EOSDIS, and the NSF DataONE, EarthCube and Cyberinfrastructure for Geoinformatics. More than 18 departments and agencies in the U.S. federal government have been active in Earth science informatics. All major space agencies in the world, have been involved in ESI research and application activities. In the United States, the Federation of Earth Science Information Partners (ESIP), whose membership includes nearly 150 organizations (government, academic and commercial) dedicated to managing, delivering and applying Earth science data, has been working on many ESI topics since 1998. The Committee on Earth Observation Satellites (CEOS)s Working Group on Information Systems and Services (WGISS) has been actively coordinating the ESI activities among the space agencies. Remote Sensing; Earth Science Informatics, Data Systems; Data Services; Metadata

Remote Sensing; Earth Science Informatics↗
NASA NTRS1991

Observing system simulation experiments for the laser atmospheric wind sounder using global spectral model

Fundamental to improving the understanding of the total Earth system are increased and improved observations. In the coming decade several spaceborne instrumented platforms will be constructed and implemented. These platforms will, in large, be housing the NASA Earth Observing System (EOS) instrument suite. One of the proposed instruments is a wind profiling system which is currently referred to as the Laser Atmospheric Wind Sounder (LAWS). This instrument will use a CO2 Doppler lidar wind profiler to give wind measurements with a vertical and horizontal resolution which has yet to be seen globally. The LAWS instrument is now a candidate for launch on a NASA EOS-B platform and is fundamental to increasing our understanding of Earth system science. The LAWS data sets will form an integral component of the temporally continuous data base needed for research of the coupled climate systems. This instrument's observations will aid in giving an improved description of the atmospheric circulation, including the transports of energy, momentum, moisture, trace gases, and aerosols. Also, the wind data will be assimilated and used as the initial state for many global forecast models at various operational centers. Results of system simulation experiments are discussed, and future experiments are described.

Rohaly, Gregg↗
NASA NTRS1984

Pilot land data system

During the fall of 1983, the Information Systems Office of NASA's Office of Space Science and Applications assembled a Working Group to develop initial plans for a Pilot Land Data System (PLDS). Workshops coordinated planning and concept development activities between land-related and computer science disciplines, and examined land research requirements, information science technology requirements, PLDS architecture, and methodologies for system evaluation. The PLDS will be a limited-scale distributed information system to explore scientific, technical and management approaches to satisfy land science research needs. PLDS will pave the way for a Land Data System to improve data access, processing, transfer and analysis, fostering an environment in which land science information synthesis can occur on a scale not previously possible owing to limits to data assembly and access and efficiency of processing.

Cressy, P. J.↗