Why Build A Castle When You Can Create a Community? Advancing Satellite Data Analysis through Professional Open Source
No abstract provided
Huang, Thomas↗
SEARCH · Engineering Papers
Results for “community data”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
GES DISC Collaborations with Open-Source Communities to Migrate Data Collections to Cloud-friendly Zarr Stores
Explore the source record for details and available documents.
Dieu My Nguyen↗
Closing the Gap Together - Connecting Communities with NASA Data through Earthdata Partnership
Explore the source record for details and available documents.
Elizabeth Joyner↗
Evaluation of noise pollution level based upon community exposure and response data
The results and procedures are reported from an evaluation of noise pollution level as a predictor of annoyance, based on aircraft noise exposure and community response data. The measures of noise exposure presented include composite noise rating, noise exposure forecast, noise and number index. A proposed measure as a universal noise exposure measure for noise pollution level (L sub NP) is discussed.
Edmiston, R. D.↗
NASA’s Commercial Smallsat Data Acquisition (CSDA) Program Data System
The National Aeronautic and Space Administration (NASA) Commercial Smallsat Data Acquisition (CSDA) Program was established to identify, evaluate, and acquire data from commercial satellite companies that support and complement NASA’s Earth sciences missions and research goals. Since becoming a sustained program in 2020, CSDA has been developing a data system to provide scalable, efficient, continuous, and repeatable data management processes for all commercial data acquired by NASA. This includes providing access to commercial data to approved science investigators through NASA developed and vendor operated interfaces. As the commercial data user community and volume of data acquired by CSDA has grown, the team managing these data has adapted technologies and services to better address the data and information search, discovery, and access needs of the science user community. This presentation will provide an overview of CSDA Program data system activities including data availability, development of CSDA user interfaces, challenges in managing large-volume diverse datasets, and long-term data preservation activities to retain data for scientific reproducibility.
data management↗
Railroad Valley Radiometric Calibration Test Site (RadCaTS) as Part of a Global Radiometric Calibration Network (RadCalNet)
The Radiometric Calibration Network (RadCalNet) is a coordinated multinational effort to provide in situ data that are suitable for the radiometric calibration and validation of Earth observation sensors that operate in the visible to shortwave infrared solar reflective spectral region (400 nm to 1000 nm). The main goals of RadCalNet are to provide top-of-atmosphere reflectance data to the scientific community, standardize data collection protocols for automated test sites, and to document the SI-traceable uncertainty budgets for each automated test site, of which there are currently four. The data available from RadCalNet are suitable for the calibration and validation of spaceborne imaging spectrometers. The work presented here provides a description of RadCalNet as well as a sample of the current results from the Radiometric Calibration Test Site (RadCaTS), which is located at Railroad Valley, Nevada, USA. Selected sensors for comparison include Terra and Aqua MODIS, SNPP and NOAA-20 VIIRS, and Sentinel-3A and -3B OLCI.
RadCalNet↗
X-59 Air Data Probe Calibration Wind Tunnel Test
NASA's aeronautical innovators are working with Lockheed Martin to design and build a supersonic X-plane, the X-59, under the the Low Boom Flight Demonstrator (LBFD) Project, that produces a gentle thump rather than a loud sonic boom. The plane will be used to collect human response data over select U.S. communities. The data from the X-59 test flights will be provided to U.S. and international regulators to potentially allow supersonic flight over land, drastically reducing travel time within the U.S. and around the world. Two wind tunnel tests were conducted in the NASA Glenn Research Center (GRC) 8- by 6-Foot Supersonic Wind Tunnel to calibrate the nose probe for the X-59. The probe was successfully tested and calibrated at 19 Mach numbers between Mach 0.25 and Mach 1.7. Most data were collected using continuous roll angle sweeps at a set Mach number and pitch angle. About 725 high quality data runs were recorded during testing to be used in the calibration of the probe. A backup nose probe was also run through the same test matrix as the primary probe. The probe will be the primary instrument for the flight test of the X-59 for determining angle of attack, angle of sideslip, airspeed, and pressure altitude of the aircraft in flight. Knowing the aircraft's speed and attitude is critical for flight safety and is also critical data for the Sonic Boom mission. Areas of interest for the test were sea level takeoff and landing at Mach 0.2, subsonic cruise at Mach 0.9, and supersonic cruise at Mach 1.4. During Phase I flight testing, the air data nose probe and air data system as a whole will be further calibrated in flight to account for additional installed effects of the airframe on the air data system.
X-59↗
X-59 Air Data Probe Calibration Wind Tunnel Test
NASA's aeronautical innovators are working with Lockheed Martin to design and build a supersonic X-plane, the X-59, under the the Low Boom Flight Demonstrator (LBFD) Project, that produces a gentle thump rather than a loud sonic boom. The plane will be used to collect human response data over select U.S. communities. The data from the X-59 test flights will be provided to U.S. and international regulators to potentially allow supersonic flight over land, drastically reducing travel time within the U.S. and around the world. Two wind tunnel tests were conducted in the NASA Glenn Research Center (GRC) 8- by 6-Foot Supersonic Wind Tunnel to calibrate the nose probe for the X-59. The probe was successfully tested and calibrated at 19 Mach numbers between Mach 0.25 and Mach 1.7. Most data were collected using continuous roll angle sweeps at a set Mach number and pitch angle. About 725 high quality data runs were recorded during testing to be used in the calibration of the probe. A backup nose probe was also run through the same test matrix as the primary probe. The probe will be the primary instrument for the flight test of the X-59 for determining angle of attack, angle of sideslip, airspeed, and pressure altitude of the aircraft in flight. Knowing the aircraft's speed and attitude is critical for flight safety and is also critical data for the Sonic Boom mission. Areas of interest for the test were sea level takeoff and landing at Mach 0.2, subsonic cruise at Mach 0.9, and supersonic cruise at Mach 1.4. During Phase I flight testing, the air data nose probe and air data system as a whole will be further calibrated in flight to account for additional installed effects of the airframe on the air data system.
X-59↗
The nature of spectral signatures in native arid plant communities
Radiometric data in ERTS bands 5 and 7 of spectral signature components were compared to the overall signatures obtained from an airborne radiometric data collection system flown at low altitude. Results indicate that due to the low density and low vigor of the vegetation, vegetation has little effect on the overall signature, thus making differentiation of desert plant communities on the basis of spectral signature extremely difficult.
Conn, J. S.↗
Open-Source Data Engineering at NASA: CCMC's Approach to Managing Petabyte-Scale Heliophysics Data
The Community Coordinated Modeling Center (CCMC) at NASA Goddard Space Flight Center (GSFC) leads heliophysics research by providing open access to numerous models and their outputs. Our resources are available on-demand and continuously updated with real-time data, covering sun-earth interactions across multiple domains. These domains include coronal, heliosphere, inner and global magnetosphere, ionosphere, thermosphere, and lower atmosphere interactions. Operating in a hybrid environment, CCMC utilizes both self-owned hardware and Amazon Web Services (AWS) cloud infrastructure. Managing petabytes of data across multiple locations necessitates robust data engineering solutions. To address this challenge, CCMC has adopted industry-standard and open-source tools. We use Apache Airflow as our primary data engineering platform, Python for scripting and data processing, and GitLab for version control and CI/CD. Additionally, we employ Kubernetes for containerized services, Grafana and Prometheus for metrics and monitoring, and Terraform and Puppet for reproducible infrastructure as code. This presentation will discuss lessons learned from our data engineering experiences, platforms evaluated but found unsuitable for our scientific data requirements, and specific techniques developed to enhance data transfer speed and reliability. By using these technologies effectively, CCMC continues to advance heliophysics research through efficient data management and open-access modeling.
space weather↗
OpenNEX: An open collaboration platform for the earth science community
Satellite data from the past several decades provide the most consistent record of land-surface processes that form the basis for scientific assessments of the impacts of climate variations and changes on the environment and human social-economical activities. During this time, scientific research on the characterization and assessment of environmental changes had tended to focus on large-scale land-surface changes with significant social-economic impacts. Increasingly, attention is shifting toward changes that occur more locally and that most directly relate to the everyday life of the majority of the population. In addition, there has been needs to develop management and policy decision support systems that are based on local environmental information. Almost at the same time, the advancement in sensor technology has allowed us to collect an unprecedented volume of environmental data. These data must be curated and analyzed to extract useful information for research and decision support purposes. Established in 2013 and funded by NASA, the Open NASA Earth eXchange (OpenNEX; https://opennex.org/ , Jia et al., 2019 ) project partnered with Amazon Web Services (AWS) to make available a large amount of Earth observing data, modeling results, and analysis tools on the AWS. OpenNEX provides researchers, developers, educators, and ordinary users with easy access to an integrated Earth science computational and data platform, enabling citizen scientists and application developers to realize the full value of NASA data assets and software tools. To encourage the public's engagement in this project, NASA ran virtual workshops and prize competitions. The virtual workshops provided online lectures and tutorials about how prominent scientists used the data in their research and the tutorials gave examples how to use the tools to interrogate the data in the Amazon cloud. Finally, the prize competitions allowed much wider participation in the OpenNEX project and enable testing the non-traditional projects and out-of-box ideas. OpenNEX has continued to evolve and mature. Here, we highlight new features and functionalities available to the community.
Jian Zhang↗
NASA GES DISC New Data Service and Data Management for the Air Quality Community
President Obama's Big Data Research and Development Initiative seeks to improve our ability to acquire knowledge and discover insights into large and complex collections of digital data. The Big Earth Data Initiative (BEDI) Invests in standardizing and optimizing the collection, management and delivery of U.S. Government's civil Earth observation data.
air pollution↗
Big Data Challenges at the Community Coordinated Modeling Center (CCMC)
Like other research centers, the Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) at NASA Goddard Space Flight Center (GSFC) is also experiencing the big data challenges. CCMC hosts over 80 space weather models for Runs On Request (ROR), Continuous Runs and Instant Runs simulation services for the research community. In addition, CCMC has started to support simulation output onboarding in response to the Open Science initiative. Overall, we have accumulated over petabytes of simulation output data and are rapidly growing. In this presentation, we will discuss our data and storage challenges. We will present our attempts to address our challenges and any associated lessons learned. CCMC uses Apache Airflow to ensure data transfer is consistent. We will give a brief overview on how we leverage Apache Airflow to enhance our environment.
space weather↗
Wind-tunnel blockage and actuation systems test of a two-dimensional scramjet inlet unstart model at Mach 6
The present study examines the wind-tunnel blockage and actuation systems effectiveness in starting and forcibly unstarting a two-dimensional scramjet inlet in the NASA Langley 20-Inch Mach 6 Tunnel. The intent of the overall test program is to study (both experimentally and computationally) the dynamics of the inlet unstart; however, prior to the design and fabrication of an expensive, instrumented wind-tunnel model, it was deemed necessary first to examine potential wind-tunnel blockage issues related to model sizing and to examine the adequacy of the actuation systems in accomplishing the start and unstart. The model is equipped with both a moveable cowl and aft plug. Windows in the inlet sidewalls allow limited optical access to the internal shock structure; schlieren video was used to identify inlet start and unstart. A chronology of each actuation sequence is provided in tabular form along with still frames from the schlieren video. A pitot probe monitored the freestream conditions throughout the start/unstart process to determine if there was a blockage effect due to the model start or unstart. Because the purpose of this report is to make the phase I (blockage and actuation systems) data rapidly available to the community, the data is presented largely without analysis of the internal shock interactions or the unstart process. This series of tests indicated that the model was appropriately sized for this facility and identified operability limits required first to allow the inlet to start and second to force the unstart.
Holland, Scott D.↗
A Quality Screening Service for Remote Sensing Data
NASA provides a wide variety of Earth-observing satellite data products to a diverse community. These data are annotated with quality information in a variety of ways, with the result that many users struggle to understand how to properly account for quality when dealing with satellite data. To address this issue, a Data Quality Screening Service (DQSS) is being implemented for a number of datasets. The DQSS will enable users to obtain data files in which low-quality pixels have been filtered out, based either on quality criteria recommended by the science team or on the user s particular quality criteria. The objective is to increase proper utilization of this critical quality data in science data analysis of satellite data products.
Lynnes, Christopher↗
Newly Released TRMM Version 7 Products, Other Precipitation Datasets and Data Services at NASA GES DISC
The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is home of global precipitation product archives, in particular, the Tropical Rainfall Measuring Mission (TRMM) products. TRMM is a joint U.S.-Japan satellite mission to monitor tropical and subtropical (40 S - 40 N) precipitation and to estimate its associated latent heating. The TRMM satellite provides the first detailed and comprehensive dataset on the four dimensional distribution of rainfall and latent heating over vastly undersampled tropical and subtropical oceans and continents. The TRMM satellite was launched on November 27, 1997. TRMM data products are archived at and distributed by GES DISC. The newly released TRMM Version 7 consists of several changes including new parameters, new products, meta data, data structures, etc. For example, hydrometeor profiles in 2A12 now have 28 layers (14 in V6). New parameters have been added to several popular Level-3 products, such as, 3B42, 3B43. Version 2.2 of the Global Precipitation Climatology Project (GPCP) dataset has been added to the TRMM Online Visualization and Analysis System (TOVAS; URL: http://disc2.nascom.nasa.gov/Giovanni/tovas/), allowing online analysis and visualization without downloading data and software. The GPCP dataset extends back to 1979. Version 3 of the Global Precipitation Climatology Centre (GPCC) monitoring product has been updated in TOVAS as well. The product provides global gauge-based monthly rainfall along with number of gauges per grid. The dataset begins in January 1986. To facilitate data and information access and support precipitation research and applications, we have developed a Precipitation Data and Information Services Center (PDISC; URL: http://disc.gsfc.nasa.gov/precipitation). In addition to TRMM, PDISC provides current and past observational precipitation data. Users can access precipitation data archives consisting of both remote sensing and in-situ observations. Users can use these data products to conduct a wide variety of activities, including case studies, model evaluation, uncertainty investigation, etc. To support Earth science applications, PDISC provides users near-real-time precipitation products over the Internet. At PDISC, users can access tools and software. Documentation, FAQ and assistance are also available. Other capabilities include: 1) Mirador (http://mirador.gsfc.nasa.gov/), a simplified interface for searching, browsing, and ordering Earth science data at NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). Mirador is designed to be fast and easy to learn; 2)TOVAS; 3) NetCDF data download for the GIS community; 4) Data via OPeNDAP (http://disc.sci.gsfc.nasa.gov/services/opendap/). The OPeNDAP provides remote access to individual variables within datasets in a form usable by many tools, such as IDV, McIDAS-V, Panoply, Ferret and GrADS; 5) The Open Geospatial Consortium (OGC) Web Map Service (WMS) (http://disc.sci.gsfc.nasa.gov/services/wxs_ogc.shtml). The WMS is an interface that allows the use of data and enables clients to build customized maps with data coming from a different network.
Liu, Zhong↗
TPSAS-NF1676L-18315-DND
NASA used towers until 2009 for gathering community noise data. It was thought that the integration of the data into the metrics masked the reflection issues. We now use narrow band data for research and when evaluating community noise. Reflections are visible in narrow band and 1/3 octave tower data.
Charlotte Whitfield↗
Heuristics for Relevancy Ranking of Earth Dataset Search Results
As the Variety of Earth science datasets increases, science researchers find it more challenging to discover and select the datasets that best fit their needs. The most common way of search providers to address this problem is to rank the datasets returned for a query by their likely relevance to the user. Large web page search engines typically use text matching supplemented with reverse link counts, semantic annotations and user intent modeling. However, this produces uneven results when applied to dataset metadata records simply externalized as a web page. Fortunately, data and search provides have decades of experience in serving data user communities, allowing them to form heuristics that leverage the structure in the metadata together with knowledge about the user community. Some of these heuristics include specific ways of matching the user input to the essential measurements in the dataset and determining overlaps of time range and spatial areas. Heuristics based on the novelty of the datasets can prioritize later, better versions of data over similar predecessors. And knowledge of how different user types and communities use data can be brought to bear in cases where characteristics of the user (discipline, expertise) or their intent (applications, research) can be divined. The Earth Observing System Data and Information System has begun implementing some of these heuristics in the relevancy algorithm of its Common Metadata Repository search engine.
science data management↗