SEARCH · Engineering Papers

Results for “analysis and visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Mapping Support for Targeted Critical Minerals Exploration and Extraction

The United States’ dependency on imported minerals poses significant risks to economic stability and national security due to potential supply disruptions. Recognizing the strategic importance of critical minerals, the Department of Energy (DOE) emphasizes the need for a secure and resilient supply chain to support emissions reduction, technology development, and capitalization on clean energy opportunities. The DOE’s Office of Manufacturing and Energy Supply Chains (MESC), in collaboration with the Office of Policy (OP), addresses these vulnerabilities by focusing on upstream domestic critical minerals production, balancing extraction with social and environmental goals, including conservation, environmental justice, and respect for Tribal sovereignty. This report showcases a collaborative effort involving Idaho National Laboratory (INL), Argonne National Laboratory (Argonne), National Renewable Energy Laboratory (NREL), and the U.S. Geological Survey (USGS) to map mineral development potential along with key social and environmental datasets. A geographical information system (GIS)-based web map application was developed as a preliminary tool for environmental analysis, integrating 158 geospatial data layers such as critical habitat, land ownership, economic indicators, and environmental concerns. Data were sourced from agencies like the Bureau of Land Management (BLM) and USGS and processed using GIS technology to enhance visualization and analysis. The proposed analysis framework categorizes areas into high, mid, and low concern based on withdrawn lands, special status species, the Economic Development Capacity Index (EDCI) Mining Composite Index, and the Climate and Economic Justice Screening Tool (CEJST). While the application provides broad visualizations, it is not a substitute for detailed environmental reviews required under the National Environmental Policy Act (NEPA). Users must conduct further analyses and engage with tribal entities and other stakeholders for comprehensive planning. A case study of the Idaho Cobalt Belt (ICB) in Lemhi County, Idaho, has been provided in the report to illustrate the tool's practical use. This report introduces a GIS application and framework to support stakeholders in identifying and prioritizing areas for critical mineral exploration, promoting secure supply chains, and advancing the nation's energy independence through responsible resource stewardship.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

ElasTool v3.0: Efficient computational and visualization toolkit for elastic and mechanical properties of materials

Efficient computation and visualization of elastic and mechanical properties are crucial in the selection of materials and the design of new materials. Here, the ElasTool v3.0 toolkit marks a significant advancement in the computational analysis and visualization of elastic and mechanical properties of materials, essential in material selection and design. This enhanced version extends beyond standard calculations like elastic tensor, Young's modulus, bulk modulus, and Poisson's ratio. It introduces capabilities for computing minimum thermal conductivity, linear compressibility, rendering the Christoffel equation, and elastic energy density. Notably, it integrates advanced visualization tools, including compatibility with Plotly and Elate web platforms for interactive web-based property exploration. A key feature of ElasTool v3.0 is the implementation of second-order elastic constants (SOECs) for tubular 2D-based nanostructures and nanotubes. Leveraging high-efficiency strain-matrix sets (OHESS), the toolkit now facilitates efficient computation of elastic constants and mechanical properties at both zero and finite temperatures for 1D, 2D, and 3D dimensions. ElasTool is openly accessible on GitHub: https://github.com/gmp007/elastool.

1D, 2D, 3D, and tubular 2D nanostructure and nanot↗

DOE OSTI2023

A General Framework for Progressive Data Compression and Retrieval

In scientific simulations, observations, and experiments, the transfer of data to and from disk and across networks has become a major bottleneck for data analysis and visualization. Compression techniques have been employed to tackle this challenge, but traditional lossy methods often demand conservative error tolerances to meet the numerical accuracy requirements of both anticipated and unknown data analysis tasks. Progressive data compression and retrieval has emerged as a promising solution, where each analysis task dictates its own accuracy needs. However, few analysis algorithms inherently support progressive data processing, and adapting compression techniques, file formats, client/server frameworks, and APIs to support progressivity can be challenging. Here, this paper presents a framework that enables progressive-precision data queries for any data compressor or numerical representation. Our strategy hinges on a multi-component representation that successively reduces the error between the original and compressed field, allowing each field in the progressive sequence to be expressed as a partial sum of components. We have implemented this approach with four established scientific data compressors and assessed its effectiveness using real-world data sets from the SDRBench collection. The results show that our framework competes in accuracy with the standalone compressors it is based upon. Additionally, (de)compression time is proportional to the number of components requested by the user. Finally, our framework allows for fully lossless compression using lossy compressors when a sufficient number of components are employed.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Use of the Tool to Support Renewable Energy Auctions Processes (RE Data Explorer)

Renewable energy auctions are now a common competitive approach to procure low-cost renewable power around the world. Ensuring a successful auction process increasingly depends on the capabilities of auction designers and participants to identify actionable and defensible insights from large data sets (on renewable energy resources and complementary data) to both attract potential investors and address stakeholder concerns. The Renewable Energy (RE) Data Explorer is a user-friendly geospatial analysis tool for analyzing renewable energy potential and informing decisions. Developed by the National Renewable Energy Laboratory (NREL) and supported by the U.S. Agency for International Development (USAID), RE Data Explorer performs visualization and analysis of renewable energy potential that can be customized for different scenarios. RE Data Explorer can support prospecting, integrated planning, policymaking, and other decision-making activities to accelerate renewable energy deployment. The broader RE Explorer website provides guidance and information to link the RE Data Explorer geospatial analysis tool to key decision areas. This document provides information on how the RE Data Explorer can be used to support renewable energy auction processes.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2020

Use of the Tool to Support Renewable Energy Project Development (RE Data Explorer)

The Renewable Energy (RE) Data Explorer is a user-friendly, geospatial analysis tool for analyzing renewable energy potential and informing decisions. Developed by the National Renewable Energy Laboratory (NREL) and supported by the U.S. Agency for International Development (USAID), RE Data Explorer performs visualization and analysis of renewable energy potential that can be customized for different scenarios. RE Data Explorer can support prospecting, integrated planning, policymaking, and other decision-making activities to accelerate renewable energy deployment. This document provides information on how the RE Data Explorer can support private sector utility-scale renewable energy project development.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2020

The Impact of Behind-the-Meter Heterogeneous Distributed Energy Resources on Distribution Grids: Preprint

The increasing integration of distributed energy resources (DERs) on the electric grid brings new challenges and opportunities for utility grid operations. With the rapid deployment of DERs, there is emerging interest in integrating these controllable devices with utility operations at all levels for monitoring and management. Different types of DERs such as Photovoltaics (PV), energy storage, electric vehicles (EVs), etc. have varying effects on the grid based on how and where they are deployed. Again, the DER deployment and its impact are network-dependent, while the traditional electric grids were not designed to host DERs. To understand the challenges with increasing behind-the-meter (BTM) DERs and to identify the needs in deploying advanced controls, a comprehensive grid impact study is indispensable. This paper investigates the impacts of integrating a mix of DERs in the utility distribution network in Colorado, U.S. Firstly, BTM DERs at the residential scale including distributed PV; battery energy storage systems (BESS); heating, ventilation, and air-conditioning (HVAC) load; electric water heater (EWH) load; and EVs are modeled. The impacts of integrating these resources on the distribution network are evaluated by conducting time-series simulations for different scenarios considering different days to capture the worst-case conditions. Monte Carlo simulations are conducted to generate the realistic EV charging profile. The voltage issues, substation transformer loadings, and critical nodes in the network are identified with the incorporation of uncoordinated EV charging loads and other DER in the network. This analysis helps visualize the DER impact on the grid, identify the challenges, and provides an insight into the new distribution management and control needs to enable reliable and resilient distribution grid operations. Additionally, further analysis is performed to estimate the daily residential electricity cost with the inclusion of DERs under time-of-use tariffs. The result shows the daily residential electricity cost reduced by 20:7% on average with DERs compared to the case without DERs.

27 ARPA - Advanced Research Projects Agency-Energy↗

DOE OSTI2023

A guide to the BRAIN Initiative Cell Census Network data ecosystem

Characterizing cellular diversity at different levels of biological organization and across data modalities is a prerequisite to understanding the function of cell types in the brain. Classification of neurons is also essential to manipulate cell types in controlled ways and to understand their variation and vulnerability in brain disorders. The BRAIN Initiative Cell Census Network (BICCN) is an integrated network of data-generating centers, data archives, and data standards developers, with the goal of systematic multimodal brain cell type profiling and characterization. Emphasis of the BICCN is on the whole mouse brain with demonstration of prototype feasibility for human and nonhuman primate (NHP) brains. Here, we provide a guide to the cellular and spatial approaches employed by the BICCN, and to accessing and using these data and extensive resources, including the BRAIN Cell Data Center (BCDC), which serves to manage and integrate data across the ecosystem. We illustrate the power of the BICCN data ecosystem through vignettes highlighting several BICCN analysis and visualization tools. Finally, we present emerging standards that have been developed or adopted toward Findable, Accessible, Interoperable, and Reusable (FAIR) neuroscience. The combined BICCN ecosystem provides a comprehensive resource for the exploration and analysis of cell types in the brain.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

Conquering Data Chaos: Research Data Management with Kubernetes

Managing massive volumes of data and effectively making it accessible to researchers poses significant challenges and is a barrier to scientific discovery. In many cases, critical data is locked up in unwieldy file formats or one-off databases and is too large to effectively process on a single machine. This talk explores the role of Kubernetes, an open-source container orchestration platform, in addressing research data management challenges. I will discuss how we are using a set of publicly available open-source and home-grown tools in the National Renewable Energy Lab (NREL) Data, Analysis, and Visualization (DAV) group to help researchers overcome data-related bottlenecks. The talk will begin by providing an overview of the data challenges faced in research data management, including data storage, processing, and analysis. I will highlight Kubernetes' ability to handle large-scale data by leveraging containerization and distributed computing, including distributed storage. Kubernetes allows researchers to encapsulate data processing infrastructure and workflows into portable containers, enabling reproducibility and ease of deployment. Kubernetes can then schedule and manage the resource allocation of these containers to enable efficient utilization of limited computing resources, leading to more efficient data processing and analysis. I will discuss some limitations of traditional, siloed approaches to dealing with data and emphasize the need for solutions which foster collaboration. I will highlight how we are using Kubernetes at NREL to facilitate data sharing and cooperation among research teams. Kubernetes' flexible architecture enables the deployment of shared computing environments, such as Apache Superset, where researchers can seamlessly access and analyze shared datasets. Providing the ability to have one research team easily consume data generated by another, utilizing Kubernetes' as a central data platform, is one of the major wins we've encountered by adopting the platform. Finally, I will showcase real-world use cases from NREL where we have used Kubernetes to solve some persistent data challenges involving large volumes of sensor and monitoring data. I will discuss the challenges we encountered when creating our cluster and making it available as a production-ready resource. I will also discuss the specific suite of tools, including Postgres and Apache Druid for columnar and timeseries data, and Redpanda Kafka for streaming data we have deployed in our infrastructure, and the process that went into the selection of these tools.

collaborative environment↗

DOE OSTI2021

The Impact of Behind-the-Meter Heterogeneous Distributed Energy Resources on Distribution Grids

behind-the-meter↗

DOE OSTI2023

Energy-water interdependencies across the three major United States electric grids: A multi-sectoral analysis

As water availability and timing of delivery fluctuates and the US electric grid sees rapid transformation and reconfiguration under decarbonization and resource adequacy strategies, there is a critical need for information and data that supports understanding the water-energy interdependency landscape. The United States currently lacks comprehensive data, informative visualizations, and analysis of energy-water interdependencies at scales necessary to support resource and operational decision-making. This article provides US electricity interconnection-level Sankey diagrams that show the relative reliance of water and energy across various economic sectors. A deeper analysis is additionally provided at the county level to illustrate trends and potential opportunities related to resiliency and efficiency in multi-sectoral water and energy flow distributions and intensities. We find that the electricity interconnections in the US vary dramatically in their water and energy interdependencies across applications and economic sectors.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2025

SCULPT (Supervised Clustering and Uncovering Latent Patterns with Training) v1

SCULPT (Supervised Clustering and Uncovering Latent Patterns with Training) is a comprehensive data visualization and analysis application focused on working with COLTRIMS (COLd Target Recoil Ion Momentum Spectroscopy) data, which is used in atomic and molecular physics experiments. The application offers several powerful features: - Data uploading and processing capabilities for COLTRIMS files - Multiple visualization methods using UMAP (Uniform Manifold Approximation and Projection) for dimensionality reduction - Interactive selection of data points across multiple views - Feature engineering through various methods: - Manual feature selection from calculated physics parameters - Deep autoencoder for dimension reduction - Genetic programming for discovering meaningful features - Mutual information-based feature selection - Multiple clustering approaches (DBSCAN, KMeans, Agglomerative) - Quality metrics for evaluating clustering results - Export capabilities for selections and generated features

Daoud, Hazem [Lawrence Berkeley National Laborator↗

DOE OSTI2022

Methods and system for siting advanced nuclear reactors and evaluating energy policy concerns

There is a growing sociopolitical desire to develop cleaner energy sources in the United States and maintain energy security. Regardless of politics, many coal-fired electric plants have already been shut down and many utilities are vowing to retire their current coal-fired assets within the next two decades. Replacement power assets require consideration of appropriate siting. A geographic information system (GIS)-based multicriteria decision analysis approach is useful to assist utility and energy companies, as well as policymakers, to evaluate potential areas for siting new plants in the contiguous United States. A GIS-based framework is simply a database of location information that allows for mapping, querying, modeling, and analyzing data based on location. The spatial output can be structured to be visual, allowing for easier analysis of location data. The need to site additional power assets, including renewable resources and clean power sources, such as nuclear, led to the development of the Oak Ridge Siting Analysis for power Generation Expansion (OR-SAGE) tool discussed in this paper. The tool takes inputs such as population growth, water availability, environmental indicators, and tectonic and geological hazards to provide an in-depth visual analysis for siting options. Energy companies and other stakeholders can use OR-SAGE to procure feedback quickly and effectively on land suitability based on technology specific inputs. Policymakers can use OR-SAGE to analyze the impacts of future energy technology decisions, while balancing competing resource use. Overall, this paper discusses the recent use of OR-SAGE for these purposes and plans for future development.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2022

Introducing the Bacterial and Viral Bioinformatics Resource Center (BV-BRC): a resource combining PATRIC, IRD and ViPR

The National Institute of Allergy and Infectious Diseases (NIAID) established the Bioinformatics Resource Center (BRC) program to assist researchers with analyzing the growing body of genome sequence and other omics-related data. In this report, we describe the merger of the PAThosystems Resource Integration Center (PATRIC), the Influenza Research Database (IRD) and the Virus Pathogen Database and Analysis Resource (ViPR) BRCs to form the Bacterial and Viral Bioinformatics Resource Center (BV-BRC) https://www.bv-brc.org/. The combined BV-BRC leverages the functionality of the bacterial and viral resources to provide a unified data model, enhanced web-based visualization and analysis tools, bioinformatics services, and a powerful suite of command line tools that benefit the bacterial and viral research communities.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

Another Set of Python Tools for Visualizing and Manipulating Small-Angle Neutron Scattering Data: Descriptions and Examples

The GP-SANS, Bio-SANS and EQ-SANS instruments at ORNL utilize drtsans for data reduction. drtsans is built on Python, and it can be run using python scripts and Jupyter notebooks. The flexibility afforded by Python makes it possible to incorporate additional actions into the scripts used for data reduction, such as analysis and visualization. Here, a new set of tools for visualizing and manipulating SANS data that can be incorporated into the data reduction scripts for the ORNL SANS instruments, or employed during post–processing, is presented that expands the capabilities of the two previously-released tool sets.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

The Influence of Visual Provenance Representations on Strategies in a Collaborative Hand-off Data Analysis Scenario

Conducting data analysis tasks rarely occur in isolation. Especially in intelligence analysis scenarios where different experts contribute knowledge to a shared understanding, members must communicate how insights develop to establish common ground among collaborators. The use of provenance to communicate analytic sensemaking carries promise by describing the interactions and summarizing the steps taken to reach insights. Yet, no universal guidelines exist for communicating provenance in different settings. Our work here focuses on the presentation of provenance information and the resulting conclusions reached and strategies used by new analysts. In an open-ended, 30-minute, textual exploration scenario, we qualitatively compare how adding different types of provenance information (specifically data coverage and interaction history) affects analysts' confidence in conclusions developed, propensity to repeat work, filtering of data, identification of relevant information, and typical investigation strategies. We see that data coverage (i.e., what was interacted with) provides provenance information without limiting individual investigation freedom. On the other hand, while interaction history (i.e., when something was interacted with) does not significantly encourage more mimicry, it does take more time to comfortably understand, as represented by less confident conclusions and less relevant information-gathering behaviors. In conclusion, our results contribute empirical data towards understanding how provenance summarizations can influence analysis behaviors.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Enabling Command-and-Control in Advanced In Situ Workflows

Scientific discovery is progressing towards autonomous science with the combination of scientific instruments, high-performance computing, and artificial intelligence in complex workflows. This evolution introduces new requirements for managing scientific workflows, including feedback loops, near real-time constraints, and the ability to dynamically control workflow execution. In situ workflows that analyze and visualize data as it is generated are well-suited to satisfy stringent time constraints and their iterative nature offers greater opportunities for command-and-control. However, only a few of the many workflow management systems available have been specifically designed to manage in situ workflows and often lack support for automated feedback loops that allow analysis and visualization components to interact with the main scientific data producer. To address this need, we present in this paper how to add command-and-control capabilities to a workflow management system. We identify the functional design requirements of such a command-and-control system, detail its architecture, interface, and core mechanisms, and illustrate how advanced in situ workflows can leverage command-and-control in three use cases: graceful termination with checkpoint, dynamic and adaptive data reduction, and event-triggered analysis.

Mehta, Kshitij [ORNL] (ORCID:0000000297149981)↗

DOE OSTI2025

Advanced Interactive 3D Visualization Tool for Customizable Analyses of Tomography Datasets in Material Science

Current methods for visualizing and analyzing 3D tomography datasets in materials science often lack the interactivity and depth required for detailed structural insights. This limitation restricts a researchers' ability to accurately interpret complex data, which is critical for advancing material innovations and understanding structural properties. To address this issue, we have developed a novel, web-based interactive 3D visualization and analysis tool from the Trame framework that offers customizable features to enhance data interpretability. The tool allows users to adjust parameters such as visible range, slice planes, data rotation, and layering, providing a more detailed and dynamic view of complex structures. Its user-friendly web interface increases the accessibility and ease of use for both novice and experienced researchers, to visualize large volumetric datasets. The tool supports a diverse range of data formats, making it versatile for various research applications. Unique capabilities include real-time data manipulation, automated feature detection, context-sensitive feedback, and real-time volume calculations and distributions per sliced region or layer, alongside the ability to quickly generate high-quality screenshots and videos for presentations and reports. These advancements offer a comprehensive solution for enhanced 3D data exploration, significantly improving the analysis process and communication of results in materials science.

36 - MATERIALS SCIENCE↗

DOE OSTI2025

Uncertainty Visualization of Critical Points of 2D Scalar Fields for Parametric and Nonparametric Probabilistic Models

This paper presents a novel end-to-end framework for closed-form computation and visualization of critical point uncertainty in 2D uncertain scalar fields. Critical points are fundamental topological descriptors used in the visualization and analysis of scalar fields. The uncertainty inherent in data (e.g., observational and experimental data, approximations in simulations, and compression), however, creates uncertainty regarding critical point positions. Uncertainty in critical point positions, therefore, cannot be ignored, given their impact on downstream data analysis tasks. Here, in this work, we study uncertainty in critical points as a function of uncertainty in data modeled with probability distributions. Although Monte Carlo (MC) sampling techniques have been used in prior studies to quantify critical point uncertainty, they are often expensive and are infrequently used in production-quality visualization software. We, therefore, propose a new end-to-end framework to address these challenges that comprises a threefold contribution. First, we derive the critical point uncertainty in closed form, which is more accurate and efficient than the conventional MC sampling methods. Specifically, we provide the closed-form and semianalytical (a mix of closed-form and MC methods) solutions for parametric (e.g., uniform, Epanechnikov) and nonparametric models (e.g., histograms) with finite support. Second, we accelerate critical point probability computations using a parallel implementation with the VTK-m library, which is platform portable. Finally, we demonstrate the integration of our implementation with the ParaView software system to demonstrate near-real-time results for real datasets.

97 MATHEMATICS AND COMPUTING↗