Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Web visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

A web-based subsetting service for regional scale MODIS land products

The Moderate Resolution Imaging Spectroradiometer (MODIS) sensor has provided valuable information on various aspects of the Earth System since March 2000. The spectral, spatial, and temporal characteristics of MODIS products have made them an important data source for analyzing key science questions relating to Earth System processes at regional, continental, and global scales. The size of the MODIS product and native HDF-EOS format are not optimal for use in field investigations at individual sites (100 - 100 km or smaller). In order to make MODIS data readily accessible for field investigations, the NASA-funded Distributed Active Archive Center (DAAC) for Biogeochemical Dynamics at Oak Ridge National Laboratory (ORNL) has developed an online system that provides MODIS land products in an easy-to-use format and in file sizes more appropriate to field research. This system provides MODIS land products data in a nonproprietary comma delimited ASCII format and in GIS compatible formats (GeoTIFF and ASCII grid). Web-based visualization tools are also available as part of this system and these tools provide a quick snapshot of the data. Quality control tools and a multitude of data delivery options are available to meet the demands of various user communities. This paper describes the important features and design goals for the system, particularly in the context of data archive and distribution for regional scale analysis. The paper also discusses the ways in which data from this system can be used for validation, data intercomparison, and modeling efforts.

54 ENVIRONMENTAL SCIENCES↗

PlanetSense: A Real-time Streaming and Spatio-temporal Analytics Platform for Gathering Geo-spatial Intelligence from Open Source Data

Geospatial intelligence has traditionally relied on the use of archived and unvarying data for planning and exploration purposes. In consequence, the tools and methods that are architected to provide insight and generate projections only rely on such datasets. Albeit, if this approach has proven effective in several cases, such as land use identification and route mapping, it has severely restricted the ability of researchers to inculcate current information in their work. This approach is inadequate in scenarios requiring real-time information to act and to adjust in ever changing dynamic environments, such as evacuation and rescue missions. In this work, we propose PlanetSense, a platform for geospatial intelligence that is built to harness the existing power of archived data and add to that, the dynamics of real-time streams, seamlessly integrated with sophisticated data mining algorithms and analytics tools for generating operational intelligence on the fly. The platform has four main components – i) GeoData Cloud – a data architecture for storing and managing disparate datasets; ii) Mechanism to harvest real-time streaming data; iii) Data analytics framework; iv) Presentation and visualization through web interface and RESTful services. Using two case studies, we underpin the necessity of our platform in modeling ambient population and building occupancy at scale.

big data architecture↗

Potential Demand Reduction from Buildings in a Simulated Utility

The availability of large-area sensing, scalable algorithms, and high-performance computing has enabled the possibility of urban-scale building energy modeling using new methods not limited to the scalability of manual building energy model creation or retrieval of county-by-county tax assessor’s data. Automatic Building detection and Energy Model creation (AutoBEM) has created 178,368 building energy models for the Electric Power Board (EPB) of Chattanooga, TN, and compared simulation performance to 15-minute data from each building. These models leverage several data sources (e.g. imagery, GIS, utility), software tools to extract building properties (e.g. footprint, height, façade type, window-to-wall ratio, occupancy, building type), simulate at scale on two of the world’s #1 fastest supercomputers, and provide web-based visual analytics.Grid-interactive efficient buildings offer the potential to reduce utility and rate-payer energy costs during each calendar month’s hour of critical generation – when the least efficient, most costly, and often dirtiest generation assets must be brought online. In this paper, EnergyPlus is used to simulate over 150,000 buildings to assess the technical potential of utility-controlled smart thermostats. This is analyzed under a couple scenarios leveraging buildings as thermal batteries via pre-conditioning to coast through peak hours. Results are provided in box and whisker plots assessing the distribution of peak demand reduction at the utility-scale along with breakouts of energy and demand savings by building type and vintage.

Bass, Brett↗

Tracking Provenance in ORNL's Flexible Research Platforms

Provenance is dened as information about the origin of objects, a concept that applies to both physical and digital objects and often overlaps both. The use of provenance in systems designed for research is an important but forgotten feature. Provenance allows for proper and exact tracking of information, its use, its lineage, its derivations and other metadata that are important for correctly adhering to the scien- tic method. In our project's prescribed use of provenance, researchers can determine detailed information about the use of sensor data in their experiments on ORNL's Flexible Research Platforms (FRPs). Our project's provenance system, Provenance Data Management System (ProvDMS), tracks information starting with the creation of information by an FRP sensor. The system determines station information, sensor information, and sensor channel information. The system allows researchers to derive generations of experiments from the sensor data and tracks their hierarchical flow. Key points can be seen in the history of the information as part of the information's workflow. The concept of provenance and its usage in science is relatively new and while used in other cases around the world, our project's provenance diers in a key area. To keep track of provenance, most systems must be designed or redesigned around the new provenance system. Our system is designed as a cohesive but sepa- rate entity and allows for researchers to continue using their own methods of analysis without being constrained in their ways in order to track the provenance. We have designed ProvDMS using a lightweight provenance library, Core Provenance Library (CPL) v.6 In addition to keeping track of sensor data experiments and its provenance, ProvDMS also provides a web-enabled visualization of the inheritance.

provenance↗

DragonView: Toward Understanding Network Interference in Dragonfly-based Supercomputers

Acquiring and maintaining high performance computing systems represents a substantial, long term investment. Therefore, it is paramount to optimize their utilization in order to maximize the return on investment and the impact on science and engineering. In this context, network congestion and inter-job interference are a major challenge as they can lead to significant systemwide performance degregation. This is especially pertinent in shared interconnects such as the dragonfly network, in which resources are shared by multiple jobs. Since many large-scale applications are communication-bound, a few communication heavy applications can have a large impact on the performance of all jobs and decrease the overall system throughput. In this paper, we describe a web-based visual analytics environment to study congestion and inter-job interference on dragonfly networks. The system enables network architects, system administrators and application developers to explore the potential impact of machine configuration, job placement policies and routing algorithms by visualizing and comparing ensembles of simulated workloads and real world data. We focus on the design of the system and describe the challenges, design decisions and the final implementation. Finally, we present two detailed case studies of prototypical analysis sessions by our stakeholders aimed at exploring the implications of different workloads and machine configurations using ensembles of network simulations.

97 MATHEMATICS AND COMPUTING↗

PR100 One-Year Progress Summary Report: Preliminary Modeling Results and High-Resolution Solar and Wind Data Sets

The Puerto Rico Grid Resilience and Transitions to 100% Renewable Energy Study (PR100) is a 2-year study by the U.S. Department of Energy's (DOE's) Grid Deployment Office and six national laboratories to comprehensively analyze stakeholder-driven pathways to Puerto Rico's clean energy future. In Year 1 of the study, the PR100 team rigorously modeled and analyzed scenarios that meet Puerto Rico's renewable energy targets and achieve short-term recovery goals and long-term energy resilience. This report, which summarizes PR100 progress in Year 1, provides considerations that can inform potential funding and implementation decisions by key federal and local agencies and stakeholders. The summary report follows the publication in July 2022 of a PR100 Six-Month Progress Update (in English and Spanish), as well as public webinars in February 2022 to kick off the study and in July 2022 to present the 6-month update. A final written report and web-based visuals will be published in late 2023. All publications and public events associated with the study will be available in Spanish and English. This report is also available in Spanish https://www.nrel.gov/docs/fy23osti/85144.pdf.

100%↗

Best practices in software development for robust and reproducible geoscientific models based on insights from the Global Carbon Budget's dynamic vegetation models

Computational models play an increasingly vital role in scientific research by enabling the numerical simulation of complex processes. Such models are also fundamental in geosciences. For instance, they offer critical insights into the impacts of global change on the Earth system today and in the future. Beyond their value as research tools, models are also software products and should therefore adhere to certain established software engineering standards. However, scientists are rarely trained as software developers, which can lead to potential deficiencies in software quality like unreadable, inefficient, or erroneous code. The complexity of models, coupled with their integration into broader workflows, also often makes it challenging to reproduce results, evaluate processes, and build upon them. In this paper, we review the state and current practices of the development processes of the state-of-the-art land surface models used by the Global Carbon Budget. We combine the experience of modelers from the respective research groups with the expertise of software engineers from tech companies to outline key principles and tools for improving software quality in research. We explore four main areas: (1) model testing and validation, (2) scientific, technical, and user documentation, (3) version control, continuous integration, and code review, and (4) the portability and reproducibility of workflows. Our review reveals that while modeling communities are incorporating many best practices, significant room for improvement remains in areas such as automated testing, automated documentation, and reproducibility. Therefore, we here identify and promote essential software engineering practices, including numerous examples of practices from within the community that can serve as guidelines for other models and could help streamline processes across the entire community. We conclude with an open-source example implementation of these principles, demonstrating portable and reproducible data flows, a continuous integration setup, and web-based visualizations. This example may serve as a practical resource for model developers, users, and all scientists engaged in scientific programming.

Gregor, Konstantin [Technical Univ. of Munich (Ger↗

NASA'S SERVIR Gulf of Mexico Project: The Gulf of Mexico Regional Collaborative (GoMRC)

The Gulf of Mexico Regional Collaborative (GoMRC) is a NASA-funded project that has as its goal to develop an integrated, working, prototype IT infrastructure for Earth science data, knowledge and models for the five Gulf U.S. states and Mexico, and to demonstrate its ability to help decision-makers better understand critical Gulf-scale issues. Within this preview, the mission of this project is to provide cross cutting solution network and rapid prototyping capability for the Gulf of Mexico region, in order to demonstrate substantial, collaborative, multi-agency research and transitional capabilities using unique NASA data sets and models to address regional problems. SERVIR Mesoamerica is seen as an excellent existing framework that can be used to integrate observational and GIs data bases, provide a sensor web interface, visualization and interactive analysis tools, archival functions, data dissemination and product generation within a Rapid Prototyping concept to assist decision-makers in better understanding Gulf-scale environmental issues.

Quattrochi, Dale A.↗

Community Coordinated Modeling Center Support of Science Needs for Integrated Data Environment

Space science models are essential component of integrated data environment. Space science models are indispensable tools to facilitate effective use of wide variety of distributed scientific sources and to place multi-point local measurements into global context. The Community Coordinated Modeling Center (CCMC) hosts a set of state-of-the- art space science models ranging from the solar atmosphere to the Earth's upper atmosphere. The majority of models residing at CCMC are comprehensive computationally intensive physics-based models. To allow the models to be driven by data relevant to particular events, the CCMC developed an online data file generation tool that automatically downloads data from data providers and transforms them to required format. CCMC provides a tailored web-based visualization interface for the model output, as well as the capability to download simulations output in portable standard format with comprehensive metadata and user-friendly model output analysis library of routines that can be called from any C supporting language. CCMC is developing data interpolation tools that enable to present model output in the same format as observations. CCMC invite community comments and suggestions to better address science needs for the integrated data environment.

Kuznetsova, M. M.↗

Scientific Benefits of Space Science Models Archiving at Community Coordinated Modeling Center

The Community Coordinated Modeling Center (CCMC) hosts a set of state-of-the-art space science models ranging from the solar atmosphere to the Earth's upper atmosphere. CCMC provides a web-based Run-on-Request system, by which the interested scientist can request simulations for a broad range of space science problems. To allow the models to be driven by data relevant to particular events CCMC developed a tool that automatically downloads data from data archives and transform them to required formats. CCMC also provides a tailored web-based visualization interface for the model output, as well as the capability to download the simulation output in portable format. CCMC offers a variety of visualization and output analysis tools to aid scientists in interpretation of simulation results. During eight years since the Run-on-request system became available the CCMC archived the results of almost 3000 runs that are covering significant space weather events and time intervals of interest identified by the community. The simulation results archived at CCMC also include a library of general purpose runs with modeled conditions that are used for education and research. Archiving results of simulations performed in support of several Modeling Challenges helps to evaluate the progress in space weather modeling over time. We will highlight the scientific benefits of CCMC space science model archive and discuss plans for further development of advanced methods to interact with simulation results.

Kuznetsova, Maria M.↗

Federated Giovanni: A Distributed Web Service for Analysis and Visualization of Remote Sensing Data

The Geospatial Interactive Online Visualization and Analysis Interface (Giovanni) is a popular tool for users of the Goddard Earth Sciences Data and Information Services Center (GES DISC) and has been in use for over a decade. It provides a wide variety of algorithms and visualizations to explore large remote sensing datasets without having to download the data and without having to write readers and visualizers for it. Giovanni is now being extended to enable its capabilities at other data centers within the Earth Observing System Data and Information System (EOSDIS). This Federated Giovanni will allow four other data centers to add and maintain their data within Giovanni on behalf of their user community. Those data centers are the Physical Oceanography Distributed Active Archive Center (PO.DAAC), MODIS Adaptive Processing System (MODAPS), Ocean Biology Processing Group (OBPG), and Land Processes Distributed Active Archive Center (LP DAAC). Three tiers are supported: Tier 1 (GES DISC-hosted) gives the remote data center a data management interface to add and maintain data, which are provided through the Giovanni instance at the GES DISC. Tier 2 packages Giovanni up as a virtual machine for distribution to and deployment by the other data centers. Data variables are shared among data centers by sharing documents from the Solr database that underpins Giovanni's data management capabilities. However, each data center maintains their own instance of Giovanni, exposing the variables of most interest to their user community. Tier 3 is a Shared Source model, in which the data centers cooperate to extend the infrastructure by contributing source code.

Giovanni↗

More Efficient Precipitation Rate Data Acquisition with the STORM Swath-Based Analysis Tool

A multitude of locations exist for acquiring satellite-derived precipitation rate data. Because the volume of data exceeds what can reasonably be analyzed manually, online tools have been developed to help researchers make more informed data acquisition decisions. Some interfaces provide sample images generated from prioritized variables to enable efficient visual inspection, while others include the ability to subset geographically to reduce the volume of the data to the area of interest. Building upon such value-added services is the STORM (the NASA Precipitation Processing System (PPS) data product ordering system) Swath-Based Analysis Tool (https://storm.pps.eosdis.nasa.gov/storm/Analysis.jsp). With it, users can compare overflights of multiple precipitation satellites simultaneously and from this make determinations about which swaths will best serve their research. They can preview these overflights with two distinct visualization tools. Finally, they can then download geographically subset swaths that have precipitation rate characteristics matching their research needs. A user starts by making up to six selections. They then select their date range of interest going back to 1997. Finally, they select a geographical region either by inputting latitude-longitude corners of a rectangle or drawing that rectangle on an interactive map. The system processes each file, determining aggregate statistics about the precipitation rates within the selected region as observed by each instrument. These statistical values are added to a time series graph as a "time remaining" counter is continuously updated. The chart is fully interactive, with detailed values displayed upon mouseover, and numerous options available upon clicking each point. Since the user is likely to need the relevant files for their own research, they can generate an order from their request. All files are geographically subset to the region of interest, and the user can use the statistical values to limit which files are added to the order. This flexibility helps to ensure researchers are only downloading the files they need for their work, making for a more efficient process both from a time-consumption and a storage perspective. This paper will introduce the Swath-Based Analysis Tool and explore its numerous features. It will discuss several use cases for precipitation scientists.

remote sensing↗

RadLab: A Comprehensive Database and Analysis Toolkit for Space Radiation Measurements Relevant to Space Radiation Biology

RadLab, a new addition to the NASA Open Science Data Repository (OSDR), is a public platform for space radiation data relevant to human space exploration. RadLab consists of a database, a submission portal, and user-friendly visualization and data analysis tools, including a graphical user interface (GUI) and an application programming interface (API). Investigators from ISS partners including Germany, Italy, Canada, Hungary, the Czech Republic, Russia, Japan have committed to providing data from their instruments. RadLab will also include data from other spacecraft in LEO: the Space Shuttle, the Mir space station, biosatellites; and beyond LEO: the lunar and the Martian surface, the heliocentric orbit at 1 AU, Mars orbit, and Earth-Mars space. Once fully operational, RadLab will provide open, centralized access to space radiation physics data relevant to human space exploration; a platform for submission of data by agencies and research institutions responsible for radiation detectors deployed in space; analysis tools to facilitate detector and dataset intercomparison to better understand space habitat radiation environments; capabilities for space biology investigators to determine the radiation environment to which samples were exposed. A RadLab Working Group (RLWG) has been formed, modeled on the GeneLab Analysis Working Groups and comprised of data contributors and users. RLWG tasks include identifying data sources, normalizing data from diverse detectors, expanding the analysis toolkit and, perhaps most importantly, sharing ideas for research exploiting capabilities of RadLab. We will provide an overview of RadLab data and capabilities and discuss examples of its potential as a resource for open science.

radiation↗

RadLab: A Comprehensive Database and Graphical and Programming Interfaces for Biologically Relevant Space Radiation Data

RadLab, a new component of the NASA Open Science Data Repository (OSDR), comprises a database of radiation measurements relevant to space biology, and visual and programmatic interfaces for interrogation and retrieval of these data. The attributes of data available through RadLab include spacecraft, types of radiation sensing instruments, locations within the spacecraft (e.g. modules of the ISS), associated celestial bodies, trajectories, and spacecraft coordinates. The application programming interface (API) implements a request syntax for retrieval of timestamped data filtered by various combinations of such attributes; the graphical user interface (GUI) extends this functionality with visualizations, such as spacecraft schematics, time series plots, geospatial visualizations, and provides easy means to iteratively refine search parameters, inspect the data on the fly, and download target subsets of these data. The release of RadLab currently available to the public contains datasets provided by US and international collaborators and focuses on data recorded on the ISS. Investigators from multiple countries, including the US, Canada, Germany, Bulgaria, Hungary, Italy, Japan, Russia and the Czech Republic, have committed to provide data from their instruments in and beyond low Earth orbit; RadLab will also soon expand to include past (e.g. Shuttle and Mir) and future (e.g. Artemis) data. RadLab will provide a comprehensive, dynamic compendium of space radiation data, enabling the scientific community to perform analyses of data from multiple detectors and to determine the radiation environment of research missions and experiments, both via programmatic retrieval of these data and through the graphical analysis toolkit. The RadLab Working Group has been formed to foster collaborations among data contributors and users, to identify data sources, to put in place standards for data harmonization, and to guide the development of the platform, with the goal to establish the use of RadLab in space radiation research and to advance our understanding of the space radiation environment in human habitats.

radiation↗

Situ

Rapidly discovering novel and sophisticated cyber attacks and providing situation aware-ness to analysts are unsolved problems in cyber security. We have developed a platform that scores events in real-time based on probabilistic models to define how typical an event is. This anomaly detection approach is based on unsupervised, probabilistic modeling of data at multiple scales. Scoring events based on multiple scales allows the system to 1) score anomalousness at different levels to detect important events that would otherwise be hidden, and 2) explain to users why an event is anomalous, not just that it is. The system was designed to address several challenges: 1) scaling to very high volume, heterogeneous, streaming data, and 2) minimizing the time from observation to discovery to understanding. The prototype has the real-time framework for pushing scored events to a web-based visualization.

Source record↗

PR100 One-Year Progress Update: Preliminary Modeling Results and High-Resolution Solar and Wind Data Sets

The Puerto Rico Grid Resilience and Transitions to 100% Renewable Energy Study (PR100) is a 2-year study by the U.S. Department of Energy's (DOE's) Grid Deployment Office and six national laboratories to comprehensively analyze stakeholder-driven pathways to Puerto Rico's clean energy future. In Year 1 of the study, the PR100 team rigorously modeled and analyzed scenarios that meet Puerto Rico's renewable energy targets and achieve short-term recovery goals and long-term energy resilience. This presentation will be showcased in the form of a public webinar, which summarizes PR100 progress in Year 1, provides considerations that can inform potential funding and implementation decisions by key federal and local agencies and stakeholders. The presentation follows the publication in July 2022 of a PR100 Six-Month Progress Update (in English and Spanish), as well as public webinars in February 2022 to kick off the study and in July 2022 to present the 6-month update. A final written report and web-based visuals will be published in late 2023. All publications and public events associated with the study will be available in Spanish and English. This report is also available in Spanish: https://www.nrel.gov/docs/fy23osti/85201.pdf.

100%↗