Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Management Platform”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Overview of the NASA Earth Action Strategies Wildland Fire Initiative

As part of NASA’s new Earth Action strategy, the Wildland Fire initiative was established, which includes both the NASA Wildland Fire Program (WFP) and the FireSense project. NASA has over 50 years of experience generating data and technology to enhance fire science and operational management. The WFP’s mission is threefold: 1) assemble communities of practice through collaborative efforts with government, academia, and the private sector; 2) co-develop knowledge and applications with relevant partners and stakeholders in the wildfire community; and 3) improve wildland fire management through the transitioning of NASA data, technology, tools, and science to stakeholder organizations. The WFP is focusing on supporting proactive fire management, including situational awareness, preparedness, and risk mitigation. This will be accomplished through selected projects that identify management challenges, relevant to partners and end users, and the NASA data that will be utilized to deliver innovative solutions to enhance the management of wildland fires. Examples include: i) investigation of evaporative stress from OpenET to help predict the risk of wildfire occurrence in watersheds; ii) incorporation of space based LiDAR for the generation of 3-dimensional forest fuel metrics, used to improve wildfire risk and behavior models; iii) integration of global, multi-platform geostationary active-fire data in near-real-time into NASA’s Fire Information for Resource Management System (FIRMS); and iv) identification of post-fire ecohydrological conditions using thermal, multispectral, synthetic aperture radar (SAR), and hyperspectral remotely-sensed data to improve flood hazard forecast models. The FireSense project is a US-focused 5-year project that will focus on delivering NASA’s unique Earth science and technological capabilities to operational agencies, striving towards enhancing fire fighting and air quality management. The project will include airborne campaigns and new technology that will likely have global implications. Initial stakeholder engagement led FireSense to focus on four use-cases focused on the characterization and measurement of: (i) pre-fire fuels conditions, (ii) active fire-dynamics; (iii) post-fire impact and threats; and iv) air quality impacts and forecasting, each-developed with identified stakeholders.

Wildland Fire program↗

A Data Exchange Interface for a Standards Based Data Integration Platform

The modern electrical grid is a complex and a data rich system, requiring several sub-systems to provide the capability and support needed to perform functions such as distributed energy resource management, outage management, and fault location and isolation, to name a few. There is a need to develop software solutions and platforms that provide an integrated infrastructure to allow interoperability between these subsystems, while leveraging the abundant data available from today’s grid. In this paper, we present the development and deployment of an application service to integrate GridAPPS-D which is an open source, standards-based software platform with SurvalentONE, a commonly used DNP3 based ADMS platform that allows operation, monitoring, analysis, restoration, and optimization of network operations. We present details of the integration architecture, including its implementation, and provide results from functional testing of the architecture on a 13 bus IEEE system. The results validate that the integration is successful and is able to provide a two-way exchange of communication and translation between different communication protocols.

Singh, Alka↗

Datum: A Scientific Metadata Catalog

The data catalog market is currently flooded with a myriad of different products, but none serve the scientific community well. There are cloud-native tools like Databricks, Snowflake,to on-premise solutions like Collibra and Datahub. The common failing of all these tools however, is their inability to serve the scientific data community directly. Most catalogs are targeted towards financial, health, or user data - not sensor or scientific domain data. They also prioritize integrations that often don’t exist or are just starting to be used in the scientific realm - all while ignoring common scientific tools and file types. Datum is a catalog which targets the scientific data directly, including the tools and networks in which those tools are used. We work with the producers and consumers of the data where they are, targeting cloud and on-premise with a focus on classified networks. Datum is an Erlang/Elixir application. Technical Features Note: The features listed below are still under development and may change, slightly, upon final delivery of the product. File Formats - Datum has the ability to read additional metadata and provides processing pipelines for the following file formats: Plain Text, PDF, LaTeX, HTML, Open Document Format (.odt), XML, CSV/TSV (and other standard delimiters), OpenDocument Database and Spreadsheets, Geo-Referenced TIFF, Common Data Format, HDF/HDF5, LabView TDMS, Excel, DeltaTables, Parquet, Apache Iceberg, Apache Hudi and many others. Metadata Collection - Scanners for the local and networked file systems and cloud storage providers. Network integration with common databases such as MSSQL and MySQL. User Plugin System - Users are able to provide either file processing, metadata extraction, or sampling plugins in the programming language of their choice. Authentication/Authorization -: OIDC integration, SCIM provisioning and EntraID integration out of the box. Full user and group management system with a “least privilege” operating mode. Governance - Customizable data governance platform; dictate and enforce required metadata, enforce data embargos, and enforce user agreements and NDAs before data access. Ability to create health checks on data, rejecting abandoned or poorly curated data and automatically removing it from the search index. Ability for users to submit corrections. Search - Semantic search is a first class citizen. No licenses to expensive, external software required. Integrated use of vectors and vector-based search allows for AI agent integration at all levels of operation. Metadata Model - Display and control data’s lineage and connections to other data and data directories. Data is modeled after a filesystem - an organization instantly recognizable and navigable by most any user. CLI and SDK - Ships with a Command Line Interface (CLI) tool and with a fully-featured Python SDK. This allows for rapid and programmatic use of Datum by every level of user. Minimal Infrastructure - Datum ships as a single executable file and can be run on any operating system and most CPU architectures. Datum has no reliance on external databases, search indexing tools, or other outside services - and it runs equally well on edge computing devices, cloud services, or in a clustered HPC environment.

darrington, john↗

ECP ST Project 2.3.1.06-STPM08-RAJA (Final Report)

Modern high-performance computing architectures are diverse, with hardware designs that feature multicore CPUs and CPUs plus accelerators, such as GPUs or FPGAs. Achieving good application performance often requires using a programming model and managing application data in ways that are best suited to a particular platform. For large codes that are used daily in production, and are under continual development, architecture-specific ports are untenable. Maintainability requires single-source code that is performance portable across a range of architectures and programming model back-ends. This report describes RAJA, Umpire, and CHAI, three software libraries that provide complementary capabilities to enable application portability for high performance computing (HPC) platforms. In particular, these libraries provide software abstractions that insulate application source code from hardware architecture and programming model-specific implementation details. These development of these libraries was motivated by the needs of multiphysics applications in the Weapons Simulation and Computing Program (WSC) at Lawrence Livermore National Laboratory (LLNL). Funding though the Exascale Computing Project (ECP) Software Technology (ST) project 2.3.1.06 RAJA has fostered outreach and collaboration with the ECP application and software technology development communities. In this report, we describe ECP adoption and integration of these tools to this point. The larger goal of the report is to describe to the ECP community what these projects offer, how they are used, and how to approach adoption and integration of them.

97 MATHEMATICS AND COMPUTING↗

Development of a Prototype Simulation Executive with Zooming in the Numerical Propulsion System Simulation

A major difficulty in designing aeropropulsion systems is that of identifying and understanding the interactions between the separate engine components and disciplines (e.g., fluid mechanics, structural mechanics, heat transfer, material properties, etc.). The traditional analysis approach is to decompose the system into separate components with the interaction between components being evaluated by the application of each of the single disciplines in a sequential manner. Here, one discipline uses information from the calculation of another discipline to determine the effects of component coupling. This approach, however, may not properly identify the consequences of these effects during the design phase, leaving the interactions to be discovered and evaluated during engine testing. This contributes to the time and cost of developing new propulsion systems as, typically, several design-build-test cycles are needed to fully identify multidisciplinary effects and reach the desired system performance. The alternative to sequential isolated component analysis is to use multidisciplinary coupling at a more fundamental level. This approach has been made more plausible due to recent advancements in computation simulation along with application of concurrent engineering concepts. Computer simulation systems designed to provide an environment which is capable of integrating the various disciplines into a single simulation system have been proposed and are currently being developed. One such system is being developed by the Numerical Propulsion System Simulation (NPSS) project. The NPSS project, being developed at the Interdisciplinary Technology Office at the NASA Lewis Research Center is a 'numerical test cell' designed to provide for comprehensive computational design and analysis of aerospace propulsion systems. It will provide multi-disciplinary analyses on a variety of computational platforms, and a user-interface consisting of expert systems, data base management and visualization tools, to allow the designer to investigate the complex interactions inherent in these systems. An interactive programming software system, known as the Application Visualization System (AVS), was utilized for the development of the propulsion system simulation. The modularity of this system provides the ability to couple propulsion system components, as well as disciplines, and provides for the ability to integrate existing, well established analysis codes into the overall system simulation. This feature allows the user to customize the simulation model by inserting desired analysis codes. The prototypical simulation environment for multidisciplinary analysis, called Turbofan Engine System Simulation (TESS), which incorporates many of the characteristics of the simulation environment proposed herein, is detailed.

Reed, John A.↗

Development and Implementation of Real-Time Information Delivery Systems for Emergency Management

The disaster management community has an on-going need for real-time data and information, especially during catastrophic events. Currently, twin engine or jet aircraft with limited altitude and duration capabilities collect much of the data. Flight safety is also an issue. Clearly, much of the needed data could be delivered via over-the-horizon transfer through a uninhabited aerial vehicles (UAV) platform to mission managers at various locations on the ground. In fact, because of the ability to stay aloft for long periods of time, and to fly above dangerous situations, UAV's are ideally suited for disaster missions. There are numerous situations that can be considered disastrous for the human population. Some, such as fire or flood, can continue over a period of days. Disaster management officials rely on data from the site to respond in an optimum way with warnings, evacuations, rescue, relief, and to the extent possible, damage control. Although different types of disasters call for different types of response, most situations can be improved by having visual images and other remotely sensed data available. "Disaster Management" is actually made up of a number of activities, including: - Disaster Prevention and Mitigation - Emergency Response Planning - Disaster Management (real-time deployment of resources, during an event) - Disaster / Risk Modeling All of these activities could benefit from real-time information, but a major focus for UAV-based technology is in real-time deployment of resources (i.e., emergency response teams), based on changing conditions at the location of the event. With all these potential benefits, it is desirable to demonstrate to user agencies the ability to perform disaster management missions as described. The following demonstration project is the first in a program designed to prove the feasibility of supporting disaster missions with UAV technology and suitable communications packages on-board. A several-year program is envisioned, in which a broad range of disaster-related activities are demonstrated to the appropriate user communities.

Wegener, Steve↗

The Globus Galaxies Platform. Delivering Science Gateways as a Service

We use public cloud computers to host sophisticated scientific data; software is then used to transform scientific practice by enabling broad access to capabilities previously available only to the few. The primary obstacle to more widespread use of public clouds to host scientific software (‘cloud-based science gateways’) has thus far been the considerable gap between the specialized needs of science applications and the capabilities provided by cloud infrastructures. We describe here a domain-independent, cloud-based science gateway platform, the Globus Galaxies platform, which overcomes this gap by providing a set of hosted services that directly address the needs of science gateway developers. The design and implementation of this platform leverages our several years of experience with Globus Genomics, a cloud-based science gateway that has served more than 200 genomics researchers across 30 institutions. Building on that foundation, we have also implemented a platform that leverages the popular Galaxy system for application hosting and workflow execution; Globus services for data transfer, user and group management, and authentication; and a cost-aware elastic provisioning model specialized for public cloud resources. We describe here the capabilities and architecture of this platform, present six scientific domains in which we have successfully applied it, report on user experiences, and analyze the economics of our deployments. Published 2015. This article is a U.S. Government work and is in the public domain in the USA.

97 MATHEMATICS AND COMPUTING↗

WinPlot

WinPlot is a powerful desktop graphical analysis tool that allows the user to generate displays of unrestrictive amounts of data. It is designed to operate on a Windows 98/NT/2000 based desktop platform. WinPlot was developed to fulfill the need for fast and easily managed graphical displays of NASA test articles and facilities with extreme amount of test data in a desktop-computer environment.

Moody, John R.↗

GenomeDepot v1.0

GenomeDepot is a web-based platform for annotation, management, and comparative analysis of microbial genomic sequences and associated data including ortholog families, protein domains, operons, regulatory interactions, strain taxonomy, and sample metadata. GenomeDepot supports rapid creation of web-sites for user-defined genome collections that include bioinformatic tools for interactive genome browsing, BLAST search, annotation search, comparative genomic neighborhood visualization, and sequence download. Gene function annotations are generated by a customizable annotation pipeline. The pipeline runs annotation tools in Conda environments and can be easily extended with additional user-specified tools.

Kazakov, Alexey [Lawrence Berkeley National Labora↗

Intelligent Resource Management for Local Area Networks: Approach and Evolution

The Data Management System network is a complex and important part of manned space platforms. Its efficient operation is vital to crew, subsystems and experiments. AI is being considered to aid in the initial design of the network and to augment the management of its operation. The Intelligent Resource Management for Local Area Networks (IRMA-LAN) project is concerned with the application of AI techniques to network configuration and management. A network simulation was constructed employing real time process scheduling for realistic loads, and utilizing the IEEE 802.4 token passing scheme. This simulation is an integral part of the construction of the IRMA-LAN system. From it, a causal model is being constructed for use in prediction and deep reasoning about the system configuration. An AI network design advisor is being added to help in the design of an efficient network. The AI portion of the system is planned to evolve into a dynamic network management aid. The approach, the integrated simulation, project evolution, and some initial results are described.

Meike, Roger↗

Air Traffic Management TestBed Simulation Architect: User's Guide

The Air Traffic Management (ATM) TestBed is a Platform as a Service that is being developed by the National Aeronautics and Space Administration (NASA) to help design, configure, integrate, run, and monitor air traffic simulations. The platform provides cloud services including back-end big-data analytics tools, on-demand computing resource management, data storage, and communication middleware. The ATM TestBed reduces the time to test concepts and technologies, supports interactions among various concepts such as human-in-the-loop and automation-in-the-loop simulations, and enables collaborative simulations by sharing technologies and tools in the ATM community. The Simulation Architect application provides a graphical user interface tool for designing traffic scenarios and simulations using blocks representing components and links representing message channels linking them. This guide describes a high-level user interface design of Simulation Architect and provides information for a new user to compose traffic scenarios and simulations.

Software User Guide↗

Platform for Remote Deployment and Training for Enhanced Building Operation Practices (Building Re-Tuning and On-going Commissioning)

While a building’s energy usage is driven largely by its design and use, building operator behavior has a strong influence on its energy consumption. This project developed and piloted a specific, data-driven coaching methodology to help operators understand how they can adjust operations and/or affect no/low-cost repairs or upgrades to their specific building HVAC systems to reduce energy consumption. Named BuildingCoach, the operational optimization method used is based on the Building Re-tuning approach developed by the Pacific Northwest National Laboratory. A building operations analytics market has matured over the past decade, though its potential to affect energy-saving changes has not been fully realized. Training operators to understand the methods for operational optimization with the explicit approach of using building-system performance data is hypothesized to create a more effective, longer lasting result in building energy efficiency, and this strategy is the fundamental premise of this project. With the support of an Industry Advisory Board, the project succeeded in developing materials and recruiting for and delivering three pilot cohorts. Deliverables included twenty-two self-paced training modules (accessed via a Learning Management System) and a web-based platform that includes access to real-time building system data and a repository for building system documentation. The project set out to have 100 participants from 50 buildings in three pilot cohorts. In the end, there were 28 participants from 17 buildings, i.e., a significant shortfall. The first two pilot cohorts had only two buildings in each, and this was partially due to difficulties in deploying the Building Operator Coaching Solution (“the BOCS”), which is technology that extracts the data from the controls network and presents it as prescribed for coaching. In the third cohort, the project team deployed the BOCS successfully to 13 buildings, the methodology was piloted as intended, and numerous opportunities for optimization were identified. The BuildingCoach business plan charts a path to an economically sustainable effort. However, even with a licensing model captured in the final version of the business plan, the scalability is still limited to keeping less than 1,000 buildings affected by 2033. Even so, there are unexplored paths to greater scalability that are being considered. CUNY BPL is working to perpetuate and grow the use of BuildingCoach. As of this writing, about twenty buildings have either been connected or will be connected with operators coached / to be coached in the NYC municipal portfolio, twelve buildings across four campuses in NY State will use BuildingCoach, a NY upstate county wishes for six or seven buildings to participate with the support of funding from NYSERDA, and others have also expressed interest. In the decades to come, there will be an increasing percentage of large and mid-sized buildings that incorporate automated system optimization (ASO), and the building operators’ role will shift to spend more time on maintenance and monitoring. Meanwhile, programs such as BuildingCoach will play a critical role in optimizing operations. And, regardless of the emergence of ASO, operators will still need to understand how their systems operate so that they can monitor them properly. Within that context, BuildingCoach is an important step towards operators’ understanding of efficient building system operations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Bridging Cloud and Edge Computing at NREL Using CONNECT: Cloud Optimized Networking for Next-Gen Edge Computing Technologies [Slides]

CONNECT is an innovative on-premise hardware and software solution that integrates edge and cloud computing infrastructure at NREL. Built on the AWS Greengrass middleware and leveraging the MQTT protocol, CONNECT enables real-time data streaming from IoT devices and gateways to both cloud and local services, empowering researchers to rapidly capture, analyze, and act upon edge-generated data while leveraging cloud capabilities. The platform addresses research infrastructure challenges by providing a pre-approved platform which is already configured with the correct networking and cybersecurity baselines thus eliminating procurement delays and enabling on-demand availability. CONNECT's hybrid architecture efficiently manages burstable workloads, allowing research teams to dynamically scale computational capacity, handle peak data loads, and reduce operational bottlenecks. Advanced capabilities include built-in GPU support for executing machine learning models which enables low-latency inference at the edge from models trained in the cloud. This architecture supports real-time analytics and filtering, providing a mechanism to allow only transmitting and processing high-value data. Cloud-based configuration management permits engineers to manage on-premise systems remotely, optimizing operational efficiency. By bridging edge and cloud computing, CONNECT provides NREL researchers with a flexible, scalable platform that accelerates scientific discovery while maintaining robust security and performance standards.

97 MATHEMATICS AND COMPUTING↗

Database Management Module Framework for Dynamic Contingency Analysis and Visualization

The Dynamic Contingency Analysis Tool (DCAT) is being developed to mimic the response of generation dynamics, protection, and load components to extreme contingencies in power systems. Currently, DCAT generates a huge data set, with the analysis results stored in multiple subfolders using a great many files in different formats (power flow cases, time series, figures, spreadsheets). To help power system engineers thoroughly understand and analyze system behavior under many scenarios and contingencies, we developed a database management module (DBM) that enables future integration of DCAT with industry-grade Big Data analytical and interactive visualization platforms. In this paper, we demonstrate the DBM framework with interactive analytics and visualization for DCAT on the synthetic South Carolina 500-bus power system model using hurricane contingencies that capture possibilities for an extreme contingency. DCAT’s advanced data management and interactive visualization can help planning engineers to visually explore and analyze system behavior, all in one view.

Cascading, dynamic simulations, database managemen↗

Drone flight visible images, digital elevation maps, and geotiffs, Council, Seward Peninsula, Alaska, USA, July 2017

Remote sensing data collected from Lawrence Berkeley National Laboratory’s (LBNL) unmanned aerial system (UAS) quadcopter platform – Inspire-1 – operated by the Ameriflux Management Project (ameriflux.lbl.gov) Technical Team. The Insprire-1 is a visible imagery UAS platform that simultaneously measures very high spatial resolution optical red/green/blue (RGB) at regular intervals along each flight path. This package includes data from four flight paths over the NGEE Arctic Council Road Site near mile marker 71 in the Seward Peninsula, Alaska in July 2017. Derived image products for each flight include ortho-mosaiced RGB, an RGB-based digital surface model (DSM) using the structure from motion (SfM) technique, and a digital terrain model (DTM). Ancillary aircraft data, flight mission parameters, and general flight conditions are also included. Unprocessed and processed data products are included in this package (processing levels 0-2). This metadata document contains flight campaign, instrument and file metadata, along with a description of data processing levels, data products and file naming scheme.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic) was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy’s Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy’s Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Drone flight visible images, digital elevation maps, and geotiffs, Teller, Seward Peninsula, Alaska, USA, July 2017

Remote sensing data collected from Lawrence Berkeley National Laboratory’s (LBNL) unmanned aerial system (UAS) quadcopter platform – Inspire-1 – operated by the Ameriflux Management Project (ameriflux.lbl.gov) Technical Team. The Insprire-1 is a visible imagery UAS platform that simultaneously measures very high spatial resolution optical red/green/blue (RGB) at regular intervals along the flight path. This package includes data from a flight path over the NGEE Arctic Teller Site, west of mile marker 27 Bob Blodgett Highway in the Seward Peninsula, Alaska in July 2017. Derived image products include ortho-mosaiced RGB, an RGB-based digital surface model (DSM) using the structure from motion (SfM) technique, and a digital terrain model (DTM). Ancillary aircraft data, flight mission parameters, and general flight conditions are also included. Unprocessed and processed data products are included in this package (processing levels 0-2). This metadata document contains flight campaign, instrument and file metadata, along with a description of data processing levels, data products and file naming scheme.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic) was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy’s Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy’s Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Drone flight visible images, digital elevation maps, and geotiffs, Kougarok, Seward Peninsula, Alaska, USA, July 2017

Remote sensing data collected from Lawrence Berkeley National Laboratory’s (LBNL) unmanned aerial system (UAS) quadcopter platform – Inspire-1 – operated by the Ameriflux Management Project (ameriflux.lbl.gov) Technical Team. The Insprire-1 is a visible imagery UAS platform that simultaneously measures very high spatial resolution optical red/green/blue (RGB) at regular intervals along each flight path. This package includes data from four flight paths over the NGEE Arctic Kougarok Site, west of mile marker 64 on Kuzitrin Road in the Seward Peninsula, Alaska in July 2017. Derived image products include ortho-mosaiced RGB, an RGB-based digital surface model (DSM) using the structure from motion (SfM) technique, and a digital terrain model (DTM). Ancillary aircraft data, flight mission parameters, and general flight conditions are also included. Unprocessed and processed data products are included in this package (processing levels 0-2). This metadata document contains flight campaign, instrument and file metadata, along with a description of data processing levels, data products and file naming scheme.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic) was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy’s Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy’s Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

An Integrated Data Analytics Platform

An Integrated Science Data Analytics Platform is an environment that enables the confluence of resources for scientific investigation. It harmonizes data, tools and computational resources which subsequently enable the research community to focus on the investigation rather than spending time on security, data preparation, management, etc. OceanWorks is a NASA technology integration project to establish a cloud-based Integrated Ocean Science Data Analytics Platform at NASA’s Physical Oceanography Distributed Active Archive Center (PO.DAAC) for big ocean science. It focuses on advancement and maturity by bringing together several NASA open-source, big data projects for parallel analytics, anomaly detection, in-situ to satellite data matchup, quality-screened data subsetting, search relevancy, and data discovery. Our communities are relying on data distributed through data centers such as the PO.DAAC, COAPS, NCAR, and many others to conduct their research. In typical investigations, scientists would engage in: search for data, evaluate the relevance of that data, download it, and then apply algorithms to identify trends. Such workflow cannot scale if the research involves a massive amount of data or multi-variate measurements. NASA’s Surface Water and Ocean Topography (SWOT) mission is expected to produce massive amount of observational data during its 3-year nominal mission. Collections like SWOT challenges all existing Earth Science data archival, distribution and analysis paradigms. In this paper, we will discuss how OceanWorks enhances the analysis of physical ocean data where the computation is done on an elastic cloud platform next to the archive to deliver fast, web-accessible services for working with oceanographic measurements.

Yang, Chaowei↗