Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data needs”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

ncompare: A Python Package for Comparing netCDF Structures

Earth science researchers and data engineers have a common problem: they often need to compare data files to see what is different between them. A lot of time is spent developing code to test differences. When it comes to comparing multidimensional data file formats like netCDFs (Network Common Data Form), this is particularly challenging and time-consuming, since there is frequently a need to evaluate the differences between dimension sizes, variable structures, and variable attributes, especially for regression testing. Since netCDFs are widely used in Earth science — with climate models, oceanographic or atmospheric reanalyses, and observational data — improved means of evaluating netCDF files can help enable a wide range of applications. We have developed a reusable open source approach through `ncompare`, which is a Python package for comparing netCDF structures [[https://github.com/nasa/ncompare]]. The `ncompare` tool compares the structure of two Network Common Data Form (NetCDF) files at the command line. It facilitates rapid comparisons by generating a formatted display of the matching and non-matching groups, variables, and associated metadata between two NetCDF datasets. The user has the option to colorize the terminal output for ease of viewing, and `ncompare` can optionally save comparison reports in text, comma-separated value (CSV), and/or Microsoft Excel formats. Despite the availability of tools (such as ncmpidiff or nccmp) that compare the values of variables, there was not previously a readily available, Python-based tool for rapid visual comparisons of group and variable structures, attributes, and chunking. `ncompare` was developed at NASA’s Atmospheric Science Data Center (ASDC) and is a collaboration with NASA Openscapes [[https://nasa-openscapes.github.io]] mentors across 11 of NASA’s data centers. Openscapes’ overarching vision is to support scientific researchers using NASA Earthdata as they migrate their workflows to the cloud. Relevant links: - https://github.com/nasa/ncompare - https://github.com/pyOpenSci/software-submission/issues/146 - https://nasa-openscapes.github.io

Daniel Kaufman↗
NASA NTRS1987

Scientific and Operational Requirements for TOMS Data

Global total ozone and sulfur dioxide data from the Nimbus 7 Total Ozone Mapping Spectrometer (TOMS) instrument have applications in a broad range of disciplines. The presentations of 29 speakers who are using the data in research or who have operational needs for the data are summarized. Five sessions addressed topics in stratospheric processes, tropospheric dynamics and chemistry, remote sensing, volcanology, and future instrument requirements. Stratospheric and some volcanology requirements can be met by a continuation of polar orbit satellites using a slightly modified TOMS but weather related research, tropospheric sulfur budget studies, and most operational needs require the time resolution of a geostationary instrument.

Krueger, Arlin J.↗
NASA NTRS2018

NASA's Land, Atmosphere Near Real-Time Capability for EOS (LANCE): Delivering Data and Imagery to Meet the Needs of Near Real-Time Applications

NASA's Land, Atmosphere Near real-time Capability for EOS (LANCE) is a virtual system that provides near real-time EOS data and imagery from the AIRS, AMSR2, LIS (ISS), MISR, MLS, MODIS, MOPITT, OMI, OMPS, and VIIRS instruments, to meet the needs of scientists and application users interested in monitoring a wide variety of natural and man-made phenomena. NRT imagery from LANCE are available through NASA's Global Imagery Browse Services (GIBS), Worldview, FIRMS and most recently through Worldview Snapshots – a low band width application that has replaced the Rapid Response Subsets. Over the past year: data and imagery from the Lightning Imaging Sensor (LIS) on board the International Space Station (ISS), OMPS and VIIRS-Land have been added to LANCE. In the coming year LANCE will integrate the MODIS NRT Global Flood product, VIIRS Black Marble nighttime lights and Cloud Mask and Aerosol Dark Target from VIIRS Atmosphere. Here we provide a brief overview of LANCE, focusing on what's new and describing how these new data sets have been used to monitor lightning flashes, hurricanes and fires. For more information on LANCE visit: https://earthdata.nasa.gov/lance.

Davies, Diane↗
NASA NTRS1991

The 1990 annual statistics and highlights report

The National Space Science Data Center (NSSDC) has archived over 6 terabytes of space and Earth science data accumulated over nearly 25 years. It now expects these holdings to nearly double every two years. The science user community needs rapid access to this archival data and information about data. The NSSDC has been set on course to provide just that. Five years ago the NSSDC came on line, becoming easily reachable for thousands of scientists around the world through electronic networks it managed and other international electronic networks to which it connected. Since that time, the data center has developed and implemented over 15 interactive systems, operational nearly 24 hours per day, and is reachable through DECnet, TCP/IP, X25, and BITnet communication protocols. The NSSDC is a clearinghouse for the science user to find data needed through the Master Directory system whether it is at the NSSDC or deposited in over 50 other archives and data management facilities around the world. Over 13,000 users accessed the NSSDC electronic systems, during the past year. Thousands of requests for data have been satisfied, resulting in the NSSDC's sending out a volume of data last year that nearly exceeded a quarter of its holdings. This document reports on some of the highlights and distribution statistics for most of the basic NSSDC operational services for fiscal year 1990. It is intended to be the first of a series of annual reports on how well NSSDC is doing in supporting the space and Earth science user communities.

Green, James L.↗
NASA NTRS1976

Development of specifications for surface and subsurface oceanic environmental data

The existing need for synoptic subsurface observations was demonstrated giving special attention to the requirements of meteorology. The current state of synoptic oceanographic observations was assessed; a preliminary design for the Basic Observational Network needed to fulfill the minimum needs of synoptic meteorology and oceanography was presented. There is an existing critical need for such a network in the support of atmospheric modeling and operational meteorological prediction, and through utilization of the regional water mass concept an adequate observational system can be designed which is realistic in terms of cost and effort.

Wolff, P. M.↗
NASA NTRS2018

Collaborative Data Curation to Support the Multi-Mission Algorithm and Analysis Platform (MAAP)

Upcoming space-borne missions will offer unprecedented data about Earth but will also feature exponentially high data volumes. These high data volumes will change the way the scientific community works with data and will also create a unique need for improved data sharing and collaboration. NASA and ESA are working together to address these issues by collaboratively developing the Multi-Mission Algorithm and Analysis Platform (MAAP) to improve the understanding of global aboveground terrestrial carbon dynamics. The MAAP will support ESA’s BIOMASS mission, NASA’s GEDI mission and NASA/ISRO’s NISAR mission. The MAAP will be developed in two phases: a pilot phase and a full production phase. The pilot phase will demonstrate collaboration and basic capabilities. The pilot phase will focus on biomass relevant airborne and field campaign data. Two NASA teams are supporting the development of the MAAP. The MAAP engineering team is responsible for the development, maintenance and operations of the MAAP system while the MAAP data team ensures the ongoing quality of the data, metadata and other information provided in the MAAP. The MAAP data team also supports the ingest and archive of identified data to the MAAP platform. This poster describes the use case development process for the pilot MAAP and the data curated in support of those use cases. Additionally, this presentation will outline the pilot MAAP data ingest process and metadata curation effort along with efforts to ensure interoperability between ESA and NASA data and metadata.

Bugbee, Kaylin↗
NASA NTRSDate not supplied

Enabling Exchange and Adequate Use of Data for Observation Based Atmospheric Research

Systematic long-term field observations have played a vital role in advancing atmospheric research over the past several decades. The use of these observations has expanded from primarily characterizing atmospheric processes and trends to evaluating satellite measurements, assessing models, and improving air quality forecasts. Consequently, the demand for atmospheric chemistry observational data have dramatically increased in terms of scope and coverage of measurements (i.e., parameters/species, spatiotemporal extent). In addition to high quality measurements, certain data reporting standards need to be agreed to ensure the data can be readily exchanged and are sufficiently documented to enable adequate use in different research activities. To this end, WMO has developed and implemented measurement guidelines and community practices for meteorology, climatology, atmospheric and hydrological sciences. In addition, the WMO Expert Team on Metadata Standards manages and evolves the existing metadata standards for the WMO Information System WIS and WMO Integrated Global Observing System WIGOS to support consistent and interoperable data descriptions, ensure relevance to research, and to apply data science principles. This team draws on a wide range of expertise from the research community, including atmospheric measurements, modeling, data management, and data science. The current activities include development of key performance indicators, vocabularies for metadata and the evolution of metadata standards to lower the barrier of application to weather/climate/water/environment data for all communities and the weather enterprise. This presentation intends to promote awareness of ongoing progress and actively solicit community feedback.

Field Observations↗
NASA NTRSDate not supplied

The NASA Earth Science Applied Sciences Disasters Program: Making EO Data and Expertise Available through the Disasters Mapping Portal to Inform Decision-Makers throughout the Disaster Cycle

The NASA Earth Science Applied Sciences Disasters Program promotes the use of Earth Observations (EO) to inform disaster risk reduction and resilience throughout the disaster cycle, from local to global scales, by harnessing NASA science and technology capabilities, through engagement with end users to demonstrate the value and impact of EO to support decision-making, and by supporting end users in their use of EO in decision-making while developing relationships to grow as a trusted source of relevant science and useful results. Through the NASA Earth Science Applied Sciences Disasters Program Mapping Portal, an Esri-backed hub of geospatially enabled disaster products, event-based and near-real-time products are hosted to provide end users with analysis-ready data and data services, keeping in mind their expressed EO needs. In this presentation, case studies of past events will be highlighted, showcasing how EO data and services were provided by the Program and utilized by end users during the disaster cycle. Additionally, this presentation will highlight some of the Program’s ongoing collaboration activities to assist end users in understanding and preparing for utilization of EO data from the Mapping Portal to inform their decision-making throughout the disaster cycle. Ongoing efforts to advance the science provided by the Program on the Mapping Portal through new developments and capabilities will be highlighted, and common challenges and data needs end users often encounter when using EO data and our Program’s innovative solutions to these challenges will be addressed. Furthermore, this presentation will touch on the challenges faced and the solutions created by the Mapping Portal team in managing and hosting a plethora of EO data for end users across various disciplines.

Ronan Lucey↗
NASA NTRS2001

National Environmental Change Information System Case Study

The Global Hydrology and Climate Center and NASA's Marshall Space Flight Center conducted a fact-finding case study for the Data Management Working Group (DMWG), now referred to as the Data and Information Working Group (DIWG), of the U.S. Global Change Research Program (USGCRP) to determine the feasibility of an interagency National Environmental Change Information System (NECIS). In order to better understand the data and information needs of policy and decision makers at the national, state, and local level, the DIWG asked the case study team to choose a regional water resources issue in the southeastern United States that had an impact on a diverse group of stakeholders. The southeastern United States was also of interest because the region experiences interannual climatic variations and impacts due to El Nino and La Nina. Jointly, with input from the DIWG, a focus on future water resources planning in the Apalachicola-Chattahoochee-Flint (ACF) River basins of Alabama, Georgia, and Florida was selected. A tristate compact and water allocation formula is currently being negotiated between the states and U.S. Army Corps of Engineers (COE) that will affect the availability of water among competing uses within the ACF River basin. All major reservoirs on the ACF are federally owned and operated by the U.S. Army COE. A similar two-state negotiation is ongoing that addresses the water allocations in the adjacent Alabama-Coosa-Tallapoosa (ACT) River basin, which extends from northwest Georgia to Mobile Bay. The ACF and ACT basins are the subject of a comprehensive river basin study involving many stakeholders. The key objectives of this case study were to identify specific data and information needs of key stakeholders in the ACF region, determine what capabilities are needed to provide the most practical response to these user requests, and to identify any limitations in the use of federal data and information. The NECIS case study followed the terms of reference developed by the interagency DIWG. The case study "lessons learned" and "key findings" offer guidelines and considerations to the DMWG for the development and implementation of a NECIS that would support the data and information needs of policy and decision makers at the national, state, and local level.

Goodman, S. J.↗
NASA NTRS1976

Advanced space system concepts and their orbital support needs (1980 - 2000). Volume 3: Detailed data. Part 1: Catalog of initiatives, functional options, and future environments and goals

The following areas were discussed in relation to a study of the commonality of space vehicle applications to future national needs: (1) index of initiatives (civilian observation, communication, support), brief illustrated description of each initiative, time periods (from 1980 to 2000+) for implementation of these initiatives; (2) data bank of functional system options, presented in the form of data sheets, one for each of the major functions, with the system option for near-term, midterm, and far-term space projects applicable to each subcategory of functions to be fulfilled; (3) table relating initiatives and desired goals (public service and humanistic, materialistic, scientific and intellectual); and (4) data on size, weight and cost estimations.

Bekey, I.↗
NASA NTRSDate not supplied

Single Field-of-View Sounding Atmospheric Products

The Single Field-of-view Sounder Atmospheric Products (SiFSAP) answer the need for a novel high spatial resolution atmospheric data product for major hyper-spectral infrared (IR) sounder missions. SiFSAP include a complete set of atmospheric vertical profiles, cloud, and surface properties, which are physically retrieved from top-of-atmosphere (TOA) spectral radiances under all-sky conditions via a rigorously defined radiative transfer relationship. By using a state-of-art fast radiative transfer model and a carefully designed optimal estimation based physical retrieval scheme, the SiFSAP algorithm ensures both an ultra-fast data processing speed needed for operational weather applications and the radiometric consistency desired by long-term climate studies. SiFSAP supplement existing operational products by providing data at the native resolution of the sounder instruments, the direct and accurate retrieval of cloud scattering properties, and the establishment of ‘radiance closure.’

Wan Wu↗
NASA NTRSDate not supplied

Single Field-of-View Sounding Atmospheric Products

The Single Field-of-view Sounder Atmospheric Products (SiFSAP) answer the need for a novel high spatial resolution atmospheric data product for major hyper-spectral infrared (IR) sounder missions. SiFSAP include a complete set of atmospheric vertical profiles, cloud, and surface properties, which are physically retrieved from top-of-atmosphere (TOA) spectral radiances under all-sky conditions via a rigorously defined radiative transfer relationship. By using a state-of-art fast radiative transfer model and a carefully designed optimal estimation based physical retrieval scheme, the SiFSAP algorithm ensures both an ultra-fast data processing speed needed for operational weather applications and the radiometric consistency desired by long-term climate studies. SiFSAP supplement existing operational products by providing data at the native spatial resolution of the sounder instruments, the direct and accurate retrieval of cloud scattering properties, and the establishment of ‘radiance closure.’

single-field-of-view, retrieval, hyperspectral sou↗
NASA NTRS2017

How Long Do Satellites Need to Overlap? Evaluation of Climate Data Stability from Overlapping Satellite Records

Sensors on satellites provide unprecedented understanding of the Earth's climate system by measuring incoming solar radiation, as well as both passive and active observations of the entire Earth with outstanding spatial and temporal coverage. A common challenge with satellite observations is to quantify their ability to provide well-calibrated, long-term, stable records of the parameters they measure. Ground-based intercomparisons offer some insight, while reference observations and internal calibrations give further assistance for understanding long-term stability. A valuable tool for evaluating and developing long-term records from satellites is the examination of data from overlapping satellite missions. This paper addresses how the length of overlap affects the ability to identify an offset or a drift in the overlap of data between two sensors. Ozone and temperature data sets are used as examples showing that overlap data can differ by latitude and can change over time. New results are presented for the general case of sensor overlap by using Solar Radiation and Climate Experiment (SORCE) Spectral Irradiance Monitor (SIM) and Solar Stellar Irradiance Comparison Experiment (SOLSTICE) solar irradiance data as an example. To achieve a 1 % uncertainty in estimating the offset for these two instruments' measurement of the Mg II core (280 nm) requires approximately 5 months of overlap. For relative drift to be identified within 0.1 %/yr uncertainty (0.00008 W/sq m/nm/yr), the overlap for these two satellites would need to be 2.5 years. Additional overlap of satellite measurements is needed if, as is the case for solar monitoring, unexpected jumps occur adding uncertainty to both offsets and drifts; the additional length of time needed to account for a single jump in the overlap data may be as large as 50 % of the original overlap period in order to achieve the same desired confidence in the stability of the merged data set. Results presented here are directly applicable to satellite Earth observations. Approaches for Earth observations offer additional challenges due to the complexity of the observations, but Earth observations may also benefit from ancillary observations taken from ground-based and in situ sources. Difficult choices need to be made when monitoring approaches are considered; we outline some attempts at optimizing networks based on economic principles. The careful evaluation of monitoring overlap is important to the appropriate application of observational resources and to the usefulness of current and future observations.

climate data records↗
NASA NTRS2012

Bringing Together Users and Developers of Forest Biomass Maps

Forests store carbon and thus represent important sinks for atmospheric carbon dioxide. Reducing uncertainty in current estimates of the amount of carbon in standing forests will improve precision of estimates of anthropogenic contributions to carbon dioxide in the atmosphere due to deforestation. Although satellite remote sensing has long been an important tool for mapping land cover, until recently aboveground forest biomass estimates have relied mostly on systematic ground sampling of forests. In alignment with fiscal year 2010 congressional direction, NASA has initiated work toward a carbon monitoring system (CMS) that includes both maps of forest biomass and total carbon flux estimates. A goal of the project is to ensure that the products are useful to a wide community of scientists, managers, and policy makers, as well as to carbon cycle scientists. Understanding the needs and requirements of these data users is helpful not just to the NASA CMS program but also to the entire community working on carbon-related activities. To that end, this meeting brought together a small group of natural resource managers and policy makers who use information on forests in their work with NASA scientists who are working to create aboveground forest biomass maps. These maps, derived from combining remote sensing and ground plots, aim to be more accurate than current inventory approaches when applied at local and regional scales. Meeting participants agreed that users of biomass information will look to the CMS effort not only to provide basic data for carbon or biomass measurements but also to provide data to help serve a broad range of goals, such as forest watershed management for water quality, habitat management for biodiversity and ecosystem services, and potential use for developing payments for ecosystem service projects. Participants also reminded the CMS group that potential users include not only public sector agencies and nongovernmental organizations but also the private sector because much forest acreage in the United States is privately held and needs data for forest management. Additional key outcomes identified by meeting participants include the following: (1) Priority should be given to building into the biomass product ease of use and low costs (including costs of hardware, software, and analysis requirements), (2) CMS products should also be relevant to other biomass measures for forest watershed management, habitat protection for biodiversity, and assessment of markets for ecosystem services, (3) CMS leadership should engage with the Subsidiary Body for Scientific and Technological Advice of the United Nations Framework Convention on Climate Change as they establish measuring, reporting, and verification standards, and (4) CMS leadership should continue to keep sister agencies and other organizations informed as CMS develops, particularly via the agencies active in the U.S. Global Change Research Program Carbon Cycle Interagency Working Group (U.S. Geological Survey, U.S. Department of Agriculture, and National Oceanic and Atmospheric Administration) and nongovernmental organizations.

Forest↗
NASA NTRS1985

Towards a Global MAP Data Base

Scientific and ecological needs call for the generation of a global data base of measured data from the Earth's atmosphere, similar but complementary to the data of the meteorological service. Right now there is a large gap between these needs and the available financial means. If this prevails, it might be prohibitive for the generation of such a data base. There must be a compromise between the needs and the means. Priorities must be set. Thus, discussions should be started on which data can be or should be stored. Newly generated data for storage in such a data base is recommended to be handled by the World Data Centers (WDCs). This brief report should help to stimulate discussions and ubsequent actions.

Hartmann, G. K.↗
NASA NTRS1977

Some aspects of adaptive transform coding of multispectral data

This paper concerns a data compression study pertaining to multi-spectral scanner (MSS) data. The motivation for this undertaking is the need for securing data compression of images obtained in connection with the Landsat Follow-On Mission, where a compression of at least 6:1 is required. The MSS data used in this study consisted of four scenes: Tristate, consisting of 256 pels per row and a total of 512 rows - i.e., (256x512), (2) Sacramento (256x512), (3) Portland (256x512), and (4) Bald Knob (200x256). All these scenes were on digital tape at 6 bits/pel. The corresponding reconstructed scenes of 1 bit/pel (i.e., a 6:1 compression) are included.

Ahmed, N.↗
NASA NTRS1982

A comparison of HCMM surface temperatures with in situ temperature data

Algorithms were updated for a quicker analysis of computer compatible tapes in an effort to establish the absolute and relative accuracy of HCMM infrared data. Data for four case studies were identified and extracted from the tapes. These studies include three dates for the Nantucket Shoals region and one date for the Gulf of Mexico region. Upper air meteorological data, which are needed to make atmospheric correction of the HCMM data, are being reduced and prepared for calculation of the atmospheric effect.

Source record↗
NASA NTRS1983

NASA's AVE/VAS program

A discussion is presented concerning the Atmospheric Variability Experiment (AVE) which was conducted during the spring of 1982 as part of NASA's Visible and Infrared Spin-Scan Radiometer (VISSR) Atmospheric Sounder (VAS) demonstration. The AVE/VAS Ground Truth Field Experiment is examined in detail, which comprised the obtaining of rawinsonde observations during various meteorological conditions on four different days when VAS data were obtained. These experiments were performed over 24 hr periods in a mesoscale network of 24 National Weather Service rawinsonde sites and 13 NASA and NOAA special sites. The VAS, operating as a part of the GOES satellite system, was employed to provide two-dimensional cloud mapping capability during each of the AVE/VAS experiment periods. Among the goals of this AVE/VAS program, in addition to management of the acquisition and processing of the data, were to perform the research and development needed to produce data products from VAS radiances, to validate the data, and to assess the impact of the data on mesoscale meteorological forecasting and research requirements.

Hill, C. K.↗