Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “geospatial datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

RadLab: A Comprehensive Database and Graphical and Programming Interfaces for Space Radiation Data

RadLab, a component of the NASA Open Science Data Repository (OSDR), is a database of radiation measurements from multiple instruments and spacecraft that provides visual and programmatic interfaces for interrogation and retrieval of these data. The attributes of data available through RadLab include spacecraft, types of radiation sensing instruments, locations within the spacecraft (e.g. ISS modules), associated celestial bodies, trajectories, and spacecraft coordinates; the primary type of data is the absorbed dose rate, as well as flux and dose equivalent rate where available. The application programming interface (API) implements a request syntax for retrieval of timestamped data filtered by various combinations of such attributes; the graphical user interface (GUI) extends this functionality with visualizations (time series plots, comparison plots, geospatial visualizations) which provide easy means to assess data availability, iteratively refine search parameters, interactively inspect the data, and export target data subsets. Datasets are continuously being added to the RadLab database as part of the rolling release process. Investigators from multiple countries, including the US, Canada, Germany, Bulgaria, Hungary, Italy, Japan, Russia and the Czech Republic, have committed to provide data from their instruments in and beyond low Earth orbit. The current release contains datasets provided by US and international collaborators and includes readings from multiple modules of the ISS, the BioSentinel CubeSat, Chang’e 4, the Lunar Reconnaissance Orbiter, the ExoMars Orbiter, and the Curiosity rover. Datasets are associated with respective RadLab knowledgebase articles which include instrument descriptions and provide bibliographical references. RadLab aims to provide a comprehensive, dynamic compendium of space radiation data, enabling the scientific community to perform analyses of data from multiple detectors and to determine the radiation environment of research missions and experiments. Some of its applications include inference of absorbed radiation dose for NASA GeneLab payloads, and training predictive models as part of the 2024 FDL-X challenge. The platform is actively expanding and seeking additional data, with plans to also cover past (e.g. Shuttle, Mir) and future (e.g. Artemis) missions. The RadLab Working Group has been created to aid in this process as well as to foster collaborations among data contributors and users, to develop standards for data harmonization, and to guide the development of the platform, with the goal to establish the use of RadLab in space radiation research and to advance our understanding of the radiation environment in outer space.

Kirill Grigorev↗

Climate Impact and GIS Education Using Realistic Applications of Data.gov Thematic Datasets in a Structured Lesson-Based Workbook

This project created a workbook which teaches Earth Science to undergraduate and graduate students through guided in-class activities and take-home assignments organized around climate topics which use GIS to teach key geospatial analysis techniques and cartography skills. The workbook is structured to the White House's Data.gov climate change themes, which include Coastal Flooding, Ecosystem Vulnerability, Energy Infrastructure, Arctic, Food Resilience, Human Health, Transportation, Tribal Nations, and Water. Each theme provides access to framing questions, associated data, interactive tools, and further reading (e.g. The US Climate Resilience Toolkit and National Climate Assessment). Lessons make use of the respective theme's available resources. The structured thematic approach is designed to encourage independent exploration. The goal is to teach climate concepts and concerns, GIS techniques and approaches, and effective cartographic representation and communication results; and foster a greater awareness of publicly available resources and datasets. To reach more audiences more effectively, a two level approach was used. Level 1 serves as an introductory study and relies on only freely available interactive tools to reach audiences with fewer resources and less familiarity. Level 2 presents a more advanced case study, and focuses on supporting common commercially available tool use and real-world analysis techniques.

Satellite Imagery↗

"Giovanni at 20: Consistency and Persistency in Making Earth Remote Sensing Data Available (and Useful) to the Earth Science Community"

Since its creation in the year 2000, the NASA Geospatial Interactive Online Visualization ANd aNalysis Infrastructure (Giovanni) has been an exemplar of how to provide remotely-sensed satellite data and related Earth science datasets to a broad and globally diverse researcher community. One of the hallmarks of Giovanni system usage is that it is common to see practitioners of many branches of science – particularly those in fields not traditionally associated with remote-sensing data, such as animal behavior and paleooceanography – both accessing and employing datasets which the system provides. This usage pattern is attested to by the diversity of published science citing Giovanni. Giovanni has evolved through several versions, each of which increased analytical and visualization options while also enhancing ease-of-use. Information resources supporting Giovanni from the Goddard Earth Sciences Data and Information Services Center (GES DISC), which hosts the system, start with basic mapping and plotting functions and extend to “How-to” recipes demonstrating interusability with other data analysis systems and software. Giovanni is now being developed for use in a cloud environment, potentially expanding datasets the system can be applied to, and also improving performance for data having high spatial and temporal resolution. This presentation covers the system’s historical success with interesting examples of Giovanni-citing research, and will apply its current capabilities to a multi-dataset examination of derecho events associated with mesoscale convective phenomena in the summer of 2020, indicating how Giovanni is prepared for ongoing support of Earth science in a changing world.

Giovanni Derecho visualization↗

Artificial Intelligence and Machine Learning Applications in Modern Power Systems

Machine learning (ML) and artificial intelligence (AI) algorithms offer valuable tools for the analysis and interpretation of large datasets. These tools have the capability to uncover insights that may not be readily apparent within these datasets. In recent years, the integration of ML and AI has become increasingly prevalent in various applications within the power system domain. One of the earliest instances of machine learning in power systems can be traced back to demand forecasting, where artificial neural networks were employed for short-term load forecasting. In contemporary power systems, an abundance of high-resolution geospatial and temporal data is generated at various time intervals, ranging from sub-seconds (Phasor Measurement Units or PMUs) to seconds (Supervisory Control and Data Acquisition or SCADA), minutes (Process Information or PI), and extending to days, months, and years. These datasets contain valuable information concerning system reliability and performance. This information holds the potential to offer critical insights into system operations, as well as solutions for predicting and mitigating contingencies to prevent cascading outages. Despite the immense power of machine learning tools, system operators, planners, and utilities often exhibit hesitancy in fully embracing AI-enabled system operations and planning. This cautious approach persists, even as numerous diverse applications of machine learning continue to emerge in the realm of power systems. In this chapter, our focus will delve deep into ML and AI applications tailored for power systems. These applications aim to furnish system operators with enhanced situational awareness and augment their decision-making capabilities, especially during challenging operating conditions. Specific areas of interest encompass root cause analyses of electricity market datasets and the strategic selection of representative samples from vast power system databases for training ML/AI models. Finally, the chapter will conclude with a short discussion on the future of ML/AI in power systems and possible directions that the industry is moving towards.

power system applications, machine learning (ML), ↗

Data Democratization: Challenges and Opportunities

Democratizing Earth data is one of the challenges many organizations around the world face in order to maximize the use of their Earth data for research, applications, education, and societal benefits. For example, at the NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC), over 1600 global and regional datasets in several NASA Earth science focus areas, including atmospheric composition, water and energy cycles, and climate variability, are archived and distributed to the public. Giovanni, the Geospatial Interactive Online Visualization and Analysis Infrastructure, was developed by GES DISC to facilitate data access and exploration, especially for novice users of Earth science. With Giovanni, users can analyze and visualize over 2000 Earth science variables (e.g., precipitation, aerosol, surface wind) without downloading data, software, the expert understanding of data formats and structures, and coding skills, lowering the barrier to data analysis/comparison by preprocessing and accessing to the data. Results of data analysis and visualization can be accessed in several popular formats (e.g., NetCDF, CSV). As a result of Giovanni's efforts, more than 3000 referral papers have been published in various fields. In spite of this, Giovanni is still difficult to use for some users. For instance, if one searches for "precipitation," it will return over 150 related variables. The question is, which one to use? Furthermore, variables from different data providers (e.g., satellites and models) are named differently with different units, further confusing users, especially those outside the communities. Data democratization is complex and multifaceted. Challenges include service and data discovery, user experiences, visualization, data quality, trustworthiness, and more. In this presentation, we will examine Giovanni as an example of challenges and opportunities in developing data democratization services.

data democratization↗

Evaluating the sustainability of the 2017 US biofuel industry with an integrated techno-economic analysis and life cycle assessment

The United States produced more than 66.2 billion Liters of biofuel, primarily in the form of corn ethanol (61 billion Liters) and soybean biodiesel (6 billion Liters), for the transportation industry in 2017. No work currently exists that evaluates both the economic and environmental outcomes of this industry with adequate geospatial resolution and national scope. In this study, a model framework is constructed to perform Techno-Economic Analysis and Life Cycle Assessment using high-resolution input datasets to provide a granular estimation of corn ethanol and soybean biodiesel sustainability performance in most counties in the United States in 2017 (the most recent year for which data is available). Results show a total life cycle, greenhouse gas emission volume of 99.5 million Mg CO 2-eq produced in 2017 by these two biofuels (94.8 million Mg from corn ethanol, and 4.7 million Mg from soybean biodiesel), excluding indirect land use change emissions. Further, this volume corresponds to a combined carbon intensity of 65.3 gCO 2-eq /MJ, which is a greenhouse gas improvement compared to petroleum-based gasoline (the carbon intensity of conventional gasoline is 93.0 gCO 2-eq /MJ). However, these biofuels are produced at an additional economic cost ($1.8 billion over the displaced gas/diesel). Additionally, these biofuels generate unfavorable impacts in other environmental categories when compared to petroleum-based fuels, particularly in areas of water, land, and nitrogen intensity. This work enables stakeholders to assess the specific value of biofuels as a means of emission reduction and determine if the attained improvements are worth the associated opportunity costs.

09 BIOMASS FUELS↗

Natural Language Processing for Extracting Rich Disease Data Aligned To Satellite Meteorological Data

Global climate change is redefining our understanding of how diseases spread. In Sri Lanka, vector-borne diseases such as dengue fever, encephalitis, and leptospirosis historically surged during the monsoon seasons when temperatures were high enough for mosquito eggs to hatch. Unfortunately, due to rising temperatures and more erratic rainfall patterns, mosquito eggs can now hatch year-round and are increasingly unpredictable, leading to an alarmingly increasing number of hospitalizations and deaths. More data is needed to adapt our response to these diseases in an increasingly warmer world. In the contemporary landscape, a wealth of disease information is available, yet accessibility remains limited due to unstructured data formats such as PDFs. Therefore, converting unstructured disease reports into structured formats is necessary for effectively leveraging data. This paper introduces a comprehensive framework for collecting unstructured disease reports and transforming them into analyzable formats. By creating separate models tailored to each data format, we can ensure accuracy compared to general models. These straightforward models enhance accessibility and empower other researchers to use our tools. The returned structured data can then be harnessed for analysis, statistical purposes, and informing evidence-based public health interventions, thus facilitating more informed decision-making in healthcare. We deploy this framework to produce geospatial data for Sri Lanka and Brazil for many different conditions and align these data with satellite environmental data, providing for the first time a structured, aligned powerful dataset for disease modeling.

Open Source Open Science↗

Updates to USA Structures (Phase 3 Prototype): 2023-2024 Technical Report

The Oak Ridge National Laboratory (ORNL) team has successfully innovated geospatial data feature mapping and postprocessing workflows to support the USA Structures project supported by FEMA. This technical report highlights significant updates, improvements, and innovations for the USA Structures dataset, focusing on nine priority states.

97 MATHEMATICS AND COMPUTING↗

Tiled WMS/KML Server V2

This software is a higher-performance implementation of tiled WMS, with integral support for KML and time-varying data. This software is compliant with the Open Geospatial WMS standard, and supports KML natively as a WMS return type, including support for the time attribute. Regionated KML wrappers are generated that match the existing tiled WMS dataset. Ping and JPG formats are supported, and the software is implemented as an Apache 2.0 module that supports a threading execution model that is capable of supporting very high request rates. The module intercepts and responds to WMS requests that match certain patterns and returns the existing tiles. If a KML format that matches an existing pyramid and tile dataset is requested, regionated KML is generated and returned to the requesting application. In addition, KML requests that do not match the existing tile datasets generate a KML response that includes the corresponding JPG WMS request, effectively adding KML support to a backing WMS server.

Plesea, Lucian↗

CometQuest: A Rosetta Adventure

This software is a higher-performance implementation of tiled WMS, with integral support for KML and time-varying data. This software is compliant with the Open Geospatial WMS standard, and supports KML natively as a WMS return type, including support for the time attribute. Regionated KML wrappers are generated that match the existing tiled WMS dataset. Ping and JPG formats are supported, and the software is implemented as an Apache 2.0 module that supports a threading execution model that is capable of supporting very high request rates. The module intercepts and responds to WMS requests that match certain patterns and returns the existing tiles. If a KML format that matches an existing pyramid and tile dataset is requested, regionated KML is generated and returned to the requesting application. In addition, KML requests that do not match the existing tile datasets generate a KML response that includes the corresponding JPG WMS request, effectively adding KML support to a backing WMS server.

Leon, Nancy J.↗

RadLab: A Comprehensive Database and Graphical and Programming Interfaces for Biologically Relevant Space Radiation Data

RadLab, a new component of the NASA Open Science Data Repository (OSDR), comprises a database of radiation measurements relevant to space biology, and visual and programmatic interfaces for interrogation and retrieval of these data. The attributes of data available through RadLab include spacecraft, types of radiation sensing instruments, locations within the spacecraft (e.g. modules of the ISS), associated celestial bodies, trajectories, and spacecraft coordinates. The application programming interface (API) implements a request syntax for retrieval of timestamped data filtered by various combinations of such attributes; the graphical user interface (GUI) extends this functionality with visualizations, such as spacecraft schematics, time series plots, geospatial visualizations, and provides easy means to iteratively refine search parameters, inspect the data on the fly, and download target subsets. The release of RadLab currently available to the public contains datasets provided by US and international collaborators and focuses on data recorded on the ISS. Investigators from multiple countries, including the US, Canada, Germany, Bulgaria, Hungary, Italy, Japan, Russia and the Czech Republic, have committed to provide data from their instruments in and beyond low Earth orbit; RadLab will also soon expand to include past (e.g. Shuttle and Mir) and future (e.g. Artemis) data. RadLab will provide a comprehensive, dynamic compendium of space radiation data, enabling the scientific community to perform analyses of data from multiple detectors and to determine the radiation environment of research missions and experiments. The RadLab Working Group has been formed to foster collaborations among data contributors and users, to identify data sources, to put in place standards for data harmonization, and to guide the development of the platform, with the goal to establish the use of RadLab in space radiation research and to advance our understanding of the space radiation environment in human habitats.

database↗

Basin and Range Investigation for Developing Geothermal Energy: Exploration Data

This data package includes exploration material from the Basin & Range Investigation for Developing Geothermal Energy [in Hidden Systems] project (BRIDGE), which is part of a broader initiative to advance the exploration of hidden geothermal resources in the Basin & Range Province of the western U.S. Data modalities include a helicopter-borne time-domain electromagnetic survey, magnetotellurics, 2-meter temperature measurements, ground-based gravity and legacy aeromagnetic surveys, geochemistry, geologic mapping, LiDAR analysis, 3D models, associated geospatial data, and a bibliography of existing data and references utilized in prospect characterization and conceptual modeling. Key files are in CSV, Geosoft, and Geotools formats. Please refer to READMEs for dataset-specific information. Where applicable, acquisition data and inversion models for a particular prospect or area of interest are organized separately. This BRIDGE data package is the product of a collaboration led by Sandia National Laboratories with partners from Geologica Geothermal Group, Inc., the U.S. Navy Geothermal Program Office, and consultants Steven Sewell (Australis Geoscience Ltd) and William Cumming (Cumming Geoscience). The project's areas of interest (AOIs) are based off priority areas of interest in the southwestern portion of the Nevada Play Fairway map, distribution across tectonic provinces, accessibility, and the project team's extensive experience in the region. AOIs cover about a dozen basins that include unexplored prospects, partially explored prospects, and some developed analogue resources that provide validation cases. Many unexplored and partially explored prospects are on U.S. Department of Defense (DoD) land, though adjacent lands are included as well.

15 GEOTHERMAL ENERGY↗

FTICR-MS Data from Multi-continent River Water and Sediment and from Coastal River Fresh and Saline Sediment Associated with: “Dissolved Organic Matter Functional Trait Relationships are Conserved Across Rivers”

This data package is associated with the publication “Dissolved Organic Matter Functional Trait Relationships are Conserved Across Rivers” submitted to PNAS (Stegen et al., 2023). The study aims to understand large-scale spatial structure of the dissolved organic matter (DOM) thermodynamic traits and inter-trait relationships by investigating (1) river water and sediments collected along 97 rivers spanning 3 continents and (2) coastal sediment collected from fresh and saline locations in Pacific and Gulf/Atlantic rivers. Sediment extracts and water samples were analyzed using ultrahigh resolution Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS). This dataset is comprised of three folders (1) Coastal, (2) WHONDR_S19S, and (3) Data_Dictionaries. Coastal contains (1) a subfolder with processed FTICR-MS data as csv files and sample collection metadata, (2) a subfolder with R scripts used to process the data and create associated figures, (3) a subfolder with the raw, unprocessed FTICR-MS data as .xml files, and (4) a readme file with more information about the dataset and instructions for using Formularity (https://omics.pnl.gov/software/formularity). WHONDRS_S19S contains (1) a csv file with processed FTICR data, (2) a csv with sample collection metadata, (3) a csv with sample geospatial data, (4) a csv with simulated lambda model outputs, (5) a subfolder with R scripts used to process the data and create associated figures, and (6) a readme file with more information regarding WHONDRS raw FTICR data and processing scripts. Data_Dictionaries contains data dictionaries for each csv file in the data package. The 97 global river corridors were part of a WHONDRS (https://whondrs.pnnl.gov) study. The raw, unprocessed FTICR-MS data with additional data can be found at doi:10.15485/1729719 for sediments and doi:10.15485/1603775 for water. This data package contains the processed data used in the associated manuscript. The coastal data has not been previously published, and this data package contains both the raw and processed data. Version 3 of this data package published February 2023 includes updates to the title of the manuscript, additional data and data dictionary and updated scripts linked to new analysis.

54 ENVIRONMENTAL SCIENCES↗

Locating Biodiversity Data Through The Global Change Master Directory

The Global Change Master Directory (GCMD) presently holds descriptions for almost 7000 data sets held worldwide. The directory's primary purpose is for data discovery. The information provided through the GCMD's Directory Interchange Format (DIF) is the set of information that a researcher would need to determine if a particular data set could be of value. By offering data set descriptions worldwide in many scientific disciplines - including meteorology, oceanography, ecology, geology, hydrology, geophysics, remote sensing, paleoclimate, solar-terrestrial physics, and human dimensions of climate change - the GCMD simplifies the discovery of data sources. Direct linkages to many of the data sets are also provided. In addition, several data set registration tools are offered for populating the directory. To search the directory, one may choose the Guided Search or Free-Text Search. Two experimental interfaces were also made available with the latest software release - one based on a keyword search and another based on a graphical interface. The graphical interface was designed in collaboration with the Human Computer Interaction Laboratory at the University of Maryland. The latest version of the software, Version 6, was released in April, 1998. It features the implementation of a scheme to handle hierarchical data set collections (parent-child relationships); a hierarchical geospatial location search scheme; a Java-based geographic map for conducting geospatial searches; a Related-URL field for project-related data set collections, metadata extensions (such as more detailed inventory information), etc.; a new implementation of the Isite software; a new dataset language field; hyperlinked email addresses, and more. The key to the continued evolution of the GCMD is in the flexibility of the GCMD database, allowing modifications and additions to made relatively easily to maintain currency, thus providing the ability to capitalize on current technology while importing all existing records. Changes are discussed and approved through an online "interoperability" forum. The next major release of the GCMD is scheduled for early 1999 and will include the incorporation of a new matrix-based interface, a rapid valids-based query system; improvement in the operations facility - important for future distributed options; new streamlined code for greater performance and maintainability; improvements in the handling of seven current fields proposed through the interoperability forum (at no expense to the data providers); and the release of DOCmorph, a more robust version of DIFmorph to translate many 'standards' multi-directionally. Issues and actions will also be addressed.

Olsen, Lola M.↗

NASA Giovanni: Analyze, Compare, and Visualize 2000+ Earth Satellite and Model Variables Without Downloading Data and Software

Over vast oceans and remote continents, observations are often scarce and discontinuous. Satellite and model data play a critical role in research and applications. However, finding and accessing satellite and model data can be a daunting task for many, especially those outside the community. The NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC), one of 12 NASA Science Mission Directorate Data Centers, provides Earth science data, information, and services to everyone such as researchers, application users, educators, and students. GES DISC archives and supports datasets applicable to several NASA Earth Science Focus Areas including Atmospheric Composition, Water & Energy Cycles, Carbon Cycle & Ecosystem, and Climate Variability. To facilitate data discovery, evaluation, and exploration, GES DISC has developed the Geospatial Interactive Online Visualization ANd aNalysis Infrastructure (Giovanni), an online tool to analyze and visualize NASA remote sensing and model data without downloading data and software. As of this writing, over 2000 Earth satellite and model variables are available in Giovanni, including several wellknown NASA satellite missions (e.g., TRMM, GPM) and projects (e.g., MERRA-2, GPCP). Giovanni provides twenty-two plots that can be used to analyze, compare, and explore Earth data across different disciplines. Results can be shared with colleagues and downloaded for further analysis. Over the years, Giovanni has helped publish over 3000 referral papers. In this presentation, we will showcase key variables and plot types in Giovanni with examples. In particular, we will present several popular precipitation products from GPM and CPCP for evaluation and comparison.

data analysis↗

Common Web Mapping and Mobile Device Framework for Display of NASA Real-time Data

Scientists have strategic goals to deliver their unique datasets and research to both collaborative partners and more broadly to the public. These datasets can have a significant impact locally and globally as has been shown by the success of the NASA Short‐term Prediction Research and Transition (SPoRT) Center and SERVIR programs at Marshall Space Flight Center. Each of these respective organizations provides near real‐time data at the best resolution possible to address concerns of the operational weather forecasting community (SPoRT) and to support environmental monitoring and disaster assessment (SERVIR). However, one of the biggest struggles to delivering the data to these and other Earth science community partners is formatting the product to fit into an end user's Decision Support System (DSS). The problem of delivering the data to the end‐user's DSS can be a significant impediment to transitioning research to operational environments especially for disaster response where the deliver time is critical. The decision makers, in addition to the DSS, need seamless access to these same datasets from a web browser or a mobile phone for support when they are away from their DSS or for personnel out in the field. A framework has been developed for MSFC Earth Science program that can be used to easily enable seamless delivery of scientific data to end users in multiple formats. The first format is an open geospatial format, Web Mapping Service (WMS), which is easily integrated into most DSSs. The second format is a web browser display, which can be embedded within any MSFC Science web page with just a few lines of web page coding. The third format is accessible in the form of iOS and Android native mobile applications that could be downloaded from an "app store". The framework developed has reduced the level of effort needed to bring new and existing NASA datasets to each of these end user platforms and help extend the reach of science data.

Burks, Jason E.↗

Common Web Mapping and Mobile Device Framework for Display of NASA Real-time Data

Scientists have strategic goals to deliver their unique datasets and research to both collaborative partners and more broadly to the public. These datasets can have a significant impact locally and globally as has been shown by the success of the NASA Short‐term Prediction Research and Transition (SPoRT) Center and SERVIR programs at Marshall Space Flight Center. Each of these respective organizations provides near real‐time data at the best resolution possible to address concerns of the operational weather forecasting community (SPoRT) and to support environmental monitoring and disaster assessment (SERVIR). However, one of the biggest struggles to delivering the data to these and other Earth science community partners is formatting the product to fit into an end user's Decision Support System (DSS). The problem of delivering the data to the end‐user's DSS can be a significant impediment to transitioning research to operational environments especially for disaster response where the deliver time is critical. The decision makers, in addition to the DSS, need seamless access to these same datasets from a web browser or a mobile phone for support when they are away from their DSS or for personnel out in the field. A framework has been developed for MSFC Earth Science program that can be used to easily enable seamless delivery of scientific data to end users in multiple formats. The first format is an open geospatial format, Web Mapping Service (WMS), which is easily integrated into most DSSs. The second format is a web browser display, which can be embedded within any MSFC Science web page with just a few lines of web page coding. The third format is accessible in the form of iOS and Android native mobile applications that could be downloaded from an "app store". The framework developed has reduced the level of effort needed to bring new and existing NASA datasets to each of these end user platforms and help extend the reach of science data.

Burks, Jason↗

OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagery

While the pretraining of Foundation Models (FMs) for remote sensing (RS) imagery is on the rise, models remain restricted to a few hundred million parameters. Scaling models to billions of parameters has been shown to yield unprecedented benefits including emergent abilities, but requires data scaling and computing resources typically not available outside industry R&D labs. In this work, we pair high-performance computing resources including Frontier supercomputer, America's first exascale system, and high-resolution optical RS data to pretrain billion-scale FMs. Our study assesses performance of different pretrained variants of vision Transformers across image classification, semantic segmentation and object detection benchmarks, which highlight the importance of data scaling for effective model scaling. Moreover, we discuss construction of a novel TIU pretraining dataset, model initialization, with data and pretrained models intended for public release. By discussing technical challenges and details often lacking in the related literature, this work is intended to offer best practices to the geospatial community toward efficient training and benchmarking of larger FMs.

Ambrozio Dias, Philipe↗