Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data exploration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Influence Network: Network visualization of influence between stories for Earth Science data and information exploration

Using storytelling to present data has been demonstrated as an effective way to help data users gain deeper insight of information. For this purpose, the “Data in Action” story concept has been adopted by NASA Commercial Smallsat Data Acquisition (CSDA) Program to encourage creating and sharing data information in story form. To aid researchers in exploring similar stories and data in their fields of interest, we created an “Influence Network” within the “Data in Action” framework. The Influence Network is a data visualization system component which gathers information of story relationships using a concept called “influence,” which we define based on the number of visits and keyword similarity between stories. The visualization then provides insights into the influence flows between different stories within the system. The visualization of this “Influence Network” focuses on one story at a time, introducing a time series of neighbor stories that have the most influence to the currently focused story. By focusing on views over time and visualizing influence flows between stories, we aim to assist authors in understanding how their readers perceive their stories as well as advancing their methods for delivering more meaningful stories to expand and lower the barrier to use of CSDA datasets.

Dan Pham↗
DOE OSTI2022

CORAL: A framework for rigorous self-validated data modeling and integrative, reproducible data analysis

Abstract Background Many organizations face challenges in managing and analyzing data, especially when relevant datasets arise from multiple sources and methods. Analyzing heterogeneous datasets and additional derived data requires rigorous tracking of their interrelationships and provenance. This task has long been a Grand Challenge of data science and has more recently been formalized in the FAIR principles: that all data objects be Findable, Accessible, Interoperable, and Reusable, both for machines and for people. Adherence to these principles is necessary for proper stewardship of information, for testing regulatory compliance, for measuring the efficiency of processes, and for facilitating reuse of data-analytical frameworks. Findings We present the Contextual Ontology-based Repository Analysis Library (CORAL), a platform that greatly facilitates adherence to all 4 of the FAIR principles, including the especially difficult challenge of making heterogeneous datasets Interoperable and Reusable across all parts of a large, long-lasting organization. To achieve this, CORAL's data model requires that data generators extensively document the context for all data, and our tools maintain that context throughout the entire analysis pipeline. CORAL also features a web interface for data generators to upload and explore data, as well as a Jupyter notebook interface for data analysts, both backed by a common API. Conclusions CORAL enables organizations to build FAIR data types on the fly as they are needed, avoiding the expense of bespoke data modeling. CORAL provides a uniquely powerful platform to enable integrative cross-dataset analyses, generating deeper insights than are possible using traditional analysis tools.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

To Derive or Not to Derive: I/O Libraries Take Charge of Derived Quantities Computation

The ever-increasing volume of data produced by HPC simulations necessitates scalable methods for data exploration and knowledge extraction. Scientific data analysis often involves complex queries across distributed datasets, requiring manipulation of multiple primary variables and generating derived data that needs to be handled efficiently, creating challenges for applications that need to parse many large datasets. Relying on individual applications to handle all intermediate data generally leads to redundant computations across studies and unnecessary data transfers. In this paper, we investigate the performance of different approaches where applications define derived variables as quantities of interest (QoIs) and offload the computation and transfer of these QoIs to the I/O library. This significantly reduces redundancy and optimizes data movement across the distributed storage and processing infrastructure by allowing control over when and where derived variables are computed. We present a detailed analysis of the performance-storage trade-offs associated with different solutions and showcase results for our study on two large-scale datasets created from climate and combustion simulations.

Gainaru, Ana↗
NASA NTRS2007

Online Analysis Enhances Use of NASA Earth Science Data

Giovanni, the Goddard Earth Sciences Data and Information Services Center (GES DISC) Interactive Online Visualization and Analysis Infrastructure, has provided researchers with advanced capabilities to perform data exploration and analysis with observational data from NASA Earth observation satellites. In the past 5-10 years, examining geophysical events and processes with remote-sensing data required a multistep process of data discovery, data acquisition, data management, and ultimately data analysis. Giovanni accelerates this process by enabling basic visualization and analysis directly on the World Wide Web. In the last two years, Giovanni has added new data acquisition functions and expanded analysis options to increase its usefulness to the Earth science research community.

Acker, James G.↗
NASA NTRS2017

The Diverse Data, User Driven Services and the Power of Giovanni at NASA GES DISC

This presentation provides an overview of remote sensing and model data at GES (Goddard Earth Sciences) DISC (Data and Information Services Center); Overview of data services at GES DISC (Registration with NASA data system; Searching and downloading data); Giovanni (Geospatial Interactive Online VisualizationANd aNalysis Infrastructure): online data exploration tool; and NASA Earth Data and Information System.

model↗
NASA NTRS1994

LinkWinds, A System for Interactive Scientific Data Analysis and Visualization

The Linked Windows Interactive Data System is a prototype visual data exploration system resulting from a NASA/JPL program of research into graphical methods for rapidly and interactively accessing, displaying and analyzing large multivariate multidisciplinary data sets.

dynamic interconnection data-linking paradigm easy↗
NASA NTRS2014

Proto-Examples of Data Access and Visualization Components of a Potential Cloud-Based GEOSS-AI System

Once a research or application problem has been identified, one logical next step is to search for available relevant data products. Thus, an early component of a potential GEOSS-AI system, in the continuum between observations and end point research, applications, and decision making, would be one that enables transparent data discovery and access by users. Such a component might be effected via the systems data agents. Presumably, some kind of data cataloging has already been implemented, e.g., in the GEOSS Common Infrastructure (GCI). Both the agents and cataloging could also leverage existing resources external to the system. The system would have some means to accept and integrate user-contributed agents. The need or desirability for some data format internal to the system should be evaluated. Another early component would be one that facilitates browsing visualization of the data, as well as some basic analyses.Three ongoing projects at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) provide possible proto-examples of potential data access and visualization components of a cloud-based GEOSS-AI system. 1. Reorganizing data archived as time-step arrays to point-time series (data rods), as well as leveraging the NASA Simple Subset Wizard (SSW), to significantly increase the number of data products available, at multiple NASA data centers, for production as on-the-fly (virtual) data rods. SSWs data discovery is based on OpenSearch. Both pre-generated and virtual data rods are accessible via Web services. 2. Developing Web Feature Services to publish the metadata, and expose the locations, of pre-generated and virtual data rods in the GEOSS Portal and enable direct access of the data via Web services. SSW is also leveraged to increase the availability of both NASA and non-NASA data.3.Federating NASA Giovanni (Geospatial Interactive Online Visualization and Analysis Interface), for multi-sensor data exploration, that would allow each cooperating data center, currently the NASA Distributed Active Archive Centers (DAACs), to configure its own Giovanni deployment, while also allowing all the deployments to incorporate each others data. A federated Giovanni comprises Giovanni Virtual Machines, which can be run on local servers or in the cloud.

access↗
DOE OSTI2021

Scoreboard

Emerging HPC machines have given rise to enhanced compute power that far outstrips the machine's ability to save large scale results for post-processing. To combat this, in situ data analysis techniques are slowly being adopted. With in situ data management favoring workflows composed of multiple simulations and analyses connected in transit on heterogeneous machines, scientists and engineers need a tool that enables them to create data extracts, visualizations, and interactively monitor and steer their simulations. Scoreboard Phase II is a next generation analysis software that supports composite in transit workflows on heterogeneous architectures and restores interactivity to in situ data analysis through simulation monitoring and computational steering. Scoreboard provides a simulation dashboard with graphs of metrics over time, controls for setting custom simulation steering parameters, controls for managing the set of data extracts being produced in the simulation, as well as the ability to explore data extracts, all from a web browser. Realizing the vision outlined in this project required research into making a system that integrates end to end from simulations all the way to the user. In situ tools generally suffer from complexity and excessive software dependencies. Scoreboard, by contrast, is easy to build and integrate into simulation codes and it provides first class FORTRAN support. The Scoreboard library is capable of in situ and in transit data analysis that can produce data extracts commonly needed for Computational Fluid Dynamics (CFD) analysis. Simulations can transparently stage data in transit to a Scoreboard Endpoint program, which can accept their data and produce the requested data extracts. This lets simulations return to their work while the Endpoint works on the analysis. Efficiently staging the data at scale was a topic of this research. Scoreboard provides the means to let the user manage data extracts and monitor/steer many simulations from a web browser. This area of the research focused on discovery of in transit network components to expose and control their steering parameters within an interactive browser-based user interface that includes: system topology, gathered metrics, notifications, dynamically-generated steering controls, and exploration of visualization data products.

Whitlock, BradJoseph [Intelligent Light] (00000001↗
NASA NTRSDate not supplied

Quasi-Wireless Capacitive Power Transfer with Secure Data Acquisition for Robotic Systems in Space Infrastructure

Space exploration is dependent on robotic systems that utilize end-effectors to collect samples, probe surfaces, and manipulate objects. These systems can rarely be designed to do all three, forcing engineers to make tradeoffs based on the mission parameters - i.e. should the robotic appendage have a claw, drill, or shovel, and which would be best suited for the mission? Additionally, as more industrial and government entities partake in space exploration, data protection is needed in transit and at rest. To address these challenges, we present a first-of-its- kind robotic linkage that has no wiring between the joints. Instead, quasi-wireless capacitive (QWiC) power transfer is used to send energy over the robot’s chassis without a return wire. This enables the system to be completely modular through the use of single-contact permanent magnet connections, allowing rapid alterations in joint kinematics and/or the changing of end-effectors. For collecting sensor data from the robotic arm and to send remote commands to it, we use a Supervisory Control and Data Acquisition (SCADA) system. Data transmission relies on MQTT and OPC UA communication protocols with encryption. The SCADA server logs and archives sensor data and provides the functionality for authorized users to send remote commands from SCADA client(s) to motors. A SCADA client can be any of the web browsers that connects to a server via a secure communication channel using SSL protocol. Furthermore, as an extra data protection mechanism, we inject noise to the sensor data traffic, which obfuscates the timing of sensor data packets and adds confusion about which data packet represents which motor.

wireless sensor networks↗
DOE OSTI2022

Hydropower Capital and O&M Costs: An Exploration of the FERC Form 1 Data

This report explores the potential for using responses from the Federal Energy Regulatory Commission’s (FERC’s) “Electric Utility Annual Report,” also known as FERC Form 1, as a cost database for conventional and pumped storage hydropower (PSH). The report outlines the process used to compile an easy-to-access database from the original FERC Form 1 data and discusses the historical cost/performance data. The steps for developing the database include downloading the annual FoxPro files from the FERC website (FERC, 2020), reading them into an Excel format, and reconciling naming issues across years, repeated entries, and shared assets, among others. The cleaned and compiled Form 1 database is available on Oak Ridge National Laboratory’s (ORNL’s) HydroSource website. For this report, the compiled Form 1 database was linked to two other hydropower databases, the National Inventory of Dams and the ORNL Existing Hydropower Assets, that provide additional information on the characteristics and other features of plants in the Form 1 data. Explorations of the plant characteristics, performance, capital costs, and operation and maintenance (O&M) cost data in the combined database were presented separately for conventional hydropower and PSH projects. Form 1 has several advantages as a hydropower cost database. First, the cost data is reported directly by plant owners. Second, Form 1 provides cost breakdowns of capital and operating costs for large conventional and PSH plants enabling more detailed tracking of hydropower costs compared with typical total cost estimates. Third, although the Form 1 data is not reported by all operational hydropower plants in the United States, the available data represents a wide range of plant characteristics and a sizable proportion of the hydropower fleet (61% of PSH plants and 22% of conventional hydropower plants by capacity). The lower proportion of the conventional hydropower fleet is because Form 1 reporting requirements apply only to private utilities that meet given size thresholds, leaving out federally owned facilities and many smaller hydropower plants. Overall, the Form 1 cost database represents a unique, publicly available database on hydropower asset capital and O&M costs. This report leads to a compiled database for the reporting years 1994 to 2020 that helps resolve issues with accessibility and use of the FERC Form 1 data by hydropower plant owners, project developers, technology developers, and regulators.

13 HYDRO ENERGY↗
NASA NTRS1972

Correlative studies of the solar wind. The interplanetary magnetic field, and their effects on the geomagnetic cavity using Explorer 33 and 35 data

The work completed in the study of the effects of the solar wind and interplanetary magnetic field on the bow shock and geomagnetic cavity is reported along with work underway but not yet completed. The correlative data from Explorer 33 and 35, and the computer programs for processing the data are described. The research discussed includes: polar cusps, substorms, geomagnetic activity, and North-South component of the interplanetary magnetic field. Lists of publications, and papers presented at meetings are included.

Coleman, P. J., Jr.↗
DOE OSTI2023

Enabling Floating Solar Photovoltaic (FPV) Deployment: FPV Technical Potential Assessment for Southeast Asia

Southeast Asia (SE Asia) is a region with growing energy demand and increasing development of floating solar photovoltaic (FPV) systems, which can help meet countries' renewable energy and energy security goals. This study uses a high-level geospatial assessment methodology to estimate the technical potential for monofacial and bifacial FPV on reservoirs and natural waterbodies in the ten countries within the Association of Southeast Asian Nations (ASEAN). Technical potential consists of the suitable waterbody area for FPV development (km2), the capacity of FPV that could be installed on this suitable area (MW), and the annual energy that could be generated from these installations (GWh/year). This first-of-its-kind FPV technical potential assessment for SE Asia can help policymakers and planners better understand the role that FPV could play in meeting regional energy demand and can ultimately guide investment decisions. Although this work focuses on SE Asia, the methodology may also be applicable for countries in other regions, with adaptations. The FPV technical potential results are also integrated into the Renewable Energy (RE) Data Explorer online tool (https://www.re-explorer.org/).

bifacial↗
DOE OSTI2026

Integrating Immersive Visualization in Molten-Salt Reactor Waste Management for Experimental Design and Planning

Molten-salt reactors (MSRs) represent a promising solution for next-generation nuclear energy, offering advantages in safety, fuel efficiency, and waste minimization. However, their liquid-fueled design presents unique challenges for spent fuel management, making post-shutdown waste characterization essential for developing effective strategies. Despite this need, there is a notable absence of visualization platforms specifically tailored to the unique characteristics and analytical requirements of MSR waste management. Existing tools in the nuclear industry are primarily designed for reactor operations or generic data exploration and lack both integration with MSR-specific multiphysics frameworks and the ability to simultaneously visualize time-dependent thermal fields, chemical composition evolution, and radiation distribution patterns. To address these limitations, this paper presents an immersive virtual reality (VR) visualization platform that processes and displays high-fidelity multiphysics simulation output from the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework in real-time, using Unity. The platform visualizes MSR waste characteristics such as nuclide decay, salt cooling, and corrosion by using Exodus II output data and running on a VR headset. It includes a user-friendly interface with features such as visibility toggling, cross-sectional slicing, and time-series animation for exploring simulation data. These capabilities support experimental design, stakeholder engagement, and public communication by making complex reactor behavior more accessible and understandable. By enhancing spatial reasoning and reducing cognitive load, this immersive environment fosters more effective communication and decision-making in MSR waste management.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Data and Tools for Energy Planning and Analysis

The National Renewable Energy Laboratory (NREL) creates widely used data and tools to facilitate energy system planning and analysis. These software tools have been developed for complex research problems and perfected over real-world applications and laboratory validations. Some tools are award winners, others are open-source data explorers, and all are rigorously designed to empower decision-makers with accurate and accessible information. This software selection shows how NREL resources can help stakeholders achieve a clean, just, and resilient energy transformation.

data↗