Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “in situ data visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

A terminology for in situ visualization and analysis systems

The term "in situ processing" has evolved over the last decade to mean both a specific strategy for visualizing and analyzing data and an umbrella term for a processing paradigm. The resulting confusion makes it difficult for visualization and analysis scientists to communicate with each other and with their stakeholders. To address this problem, a group of over 50 experts convened with the goal of standardizing terminology. This paper summarizes their findings and proposes a new terminology for describing in situ systems. An important finding from this group was that in situ systems are best described via multiple, distinct axes: integration type, proximity, access, division of execution, operation controls, and output type. This paper discusses these axes, evaluates existing systems within the axes, and explores how currently used terms relate to the axes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Physics-Driven Convolutional Autoencoder Approach for CFD Data Compressions: Preprint

With the growing size and complexity of turbulent flow models, data compression approaches are of the utmost importance to analyze, visualize, or restart the simulations. Recently, in-situ autoencoder-based compression approaches have been proposed and shown to be effective at producing reduced representations of turbulent flow data. However, these approaches focus solely on training the model using point-wise sample reconstruction losses that do not take advantage of the physical properties of turbulent flows. In this paper, we show that training autoencoders with additional physics-informed regularizations, e.g., enforcing incompressibility and preserving enstrophy, improves the compression model in three ways: (i) the compressed data better conform to known physics for homogeneous isotropic turbulence without negatively impacting point-wise reconstruction quality, (ii) inspection of the gradients of the trained model uncovers changes to the learned compression mapping that can facilitate the use of explainability techniques, and (iii) as a performance byproduct, training losses are shown to converge up to 12x faster than the baseline model.

auto-encoders↗
DOE OSTI2022

Sim-Situ: A Framework for the Faithful Simulation of in situ Processing

The amount of data generated by numerical simulations in various scientific domains led to a fundamental redesign of how the analysis and visualization of simulation outputs are performed. The throughput and capacity of storage subsystems have not evolved as fast as the computing power in extreme-scale supercomputers, making the classical post-hoc approach highly inefficient. In situ processing has then emerged as a solution in which simulation and data analysis/visualization are intertwined for better performance and greater interactivity.Determining the best allocation, i.e., how many resources to allocate to simulation and analysis respectively, mapping, i.e., where and at which frequency to run the analysis/visualization, and data transfer mode is a complex task whose performance assessment is crucial to the efficient execution of in situ processing. However, such a performance evaluation of different strategies usually relies either on directly running them on the targeted execution environments, which can rapidly become extremely time- and resource-consuming, or on resorting to simplified models of the components of an in situ application, which can lack of realism. In both cases, the validity of the performance evaluation is limited.In this paper, we present Sim-Situ, a simulation-based framework for the faithful performance evaluation of in situ processing strategies. We designed Sim-Situ to reflect the typical features of in situ processing systems. Thanks to its modular design, Sim-situ has the necessary flexibility to easily and faithfully evaluate the behavior and performance of various allocation, mapping, and data transfer strategies. We illustrate the simulation capabilities of Sim-Situ on a Molecular Dynamics use case. We study the impact of different strategies on performance and show how users can leverage Sim-Situ to determine interesting tradeoffs when adding analysis/visualization components to their application.

Honoré, Valentin↗
DOE OSTI2025

Feature Based Qualification of 17-4PH Stainless Steel to Evaluate Location-Specific Variability in Wire Arc Additive Manufacturing

Qualifying large-scale metal additive manufacturing (M-AM) technologies such as wire arc additive manufacturing (WAAM) can be challenging. This is especially significant in precipitation hardened martensitic stainless steels like SS 17-4PH, where thermal histories induce location-specific microstructural variability and property anisotropy. The Department of Defense (DOD) and the United States Army Combat Capabilities Development Command Ground Vehicle Systems Center (GVSC) Ground Vehicle Materials Engineering (GVME) aim to build robust and qualified large-scale M-AM workflows that could reduce the time and cost through quick and informed evaluation, testing, and development of feedstock, processes, and parts. The report presents the findings from the collaborative efforts between Oak Ridge National Laboratory (ORNL) and the U.S. Army GVSC GVME. The aim of this project was to develop a geometric feature-based qualification framework for WAAM of SS 17-4PH components. This report outlines selection methodology of representative build geometries, optimization of WAAM process parameters, in-situ monitoring, microstructure-property evaluation, thermal simulations, as well as data visualization techniques incorporated in this project. The results from this project demonstrate a clear understanding of thermal history dependent phase evolution and consequent location-specific property variations in WAAM of SS 17-4PH. These results in conjunction with the data-driven methodologies used in this project are expected to reduce qualification timelines, improve predictability, and accelerate the development of reliable feature-based qualification strategies for part production via large-scale M-AM technologies.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Performance analysis and data reduction for exascale scientific workflows

Chimbuko is the first in situ, scalable, workflow-level performance analysis tool for trace-level analysis and visualization of application performance. This tool was developed by the Co-design Center for Online Data Analysis and Reduction and funded by the U.S. Department of Energy’s Exascale Computing Project. We provide a detailed description of Chimbuko’s architecture and illustrate our online and offline visualization with multiple use cases. We also present results for the deployment and scalability of the tool as applied to a high-energy physics workflow running at large scale on the Frontier supercomputer.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Rasterization with Data-Parallel Primitives

Parallel rasterization can suffer from race conditions during fragment generation, which is traditionally addressed by using specialized hardware accessible via vendor graphics APIs. Unfortunately, graphics APIs are increasingly problematic on high-performance computers, either because they are not provided or because of concerns about dependencies with in situ visualization. In response, we present a hardware-agnostic rasterization algorithm that handles race conditions using only data-parallel primitives (DPPs), enabling efficient rendering on HPC systems without graphics API dependencies and aligning with recent efforts to deliver visualization software with DPPs. Our evaluation consists of three phases: (1) evaluating portability across different CPU and GPU architectures, (2) evaluating competitiveness with a community standard, and (3) evaluating performance across varying workloads and available parallelism. The supporting experiments run on both AMD and NVIDIA GPUs, considering data sets as large as 460 million triangles and 160 million pixels. While performance generally falls short of graphics API baselines, it achieves interactive frame rates on most workloads. As a result, we conclude our approach is a viable solution for rasterization on high-performance computers since our approach is portably performant across different architectures without the need for specialized vendor support.

Buckley, Makani [University of Oregon] (ORCID:0009↗
DOE OSTI2023

Thermally driven phase transition of halide perovskites revealed by big data-powered in situ electron microscopy

Halide perovskites are promising light-absorbing materials for high-efficiency solar cells, while the crystalline phase of halide perovskites may influence the device’s efficiency and stability. In this work, we investigated the thermally driven phase transition of perovskite (CsPbIxBr3—x), which was confirmed by electron diffraction and high-resolution transmission electron microscopy results. CsPbIxBr3—x transitioned from δ phase to α phase when heated, and the γ phase was obtained when the sample was cooled down. The γ phase was stable as long as it was isolated from humidity and air. A template matching-based data analysis method enabled visualization of the thermally driven phase evolution of perovskite during heating. Here, we also proposed a possible atomic movement in the process of phase transition based on our in situ heating experimental data. The results presented here may improve our understanding of the thermally driven phase transition of perovskite as well as provide a protocol for big-data analysis of in situ experiments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Demonstrating the viability of Lagrangian in situ reduction on supercomputers

Performing exploratory analysis and visualization of large-scale time-varying computational science applications is challenging due to inaccuracies that arise from under-resolved data. In recent years, Lagrangian representations of the vector field computed using in situ processing are being increasingly researched and have emerged as a potential solution to enable exploration. However, prior works have offered limited estimates of the encumbrance on the simulation code as they consider “theoretical” in situ environments. Further, the effectiveness of this approach varies based on the nature of the vector field, benefitting from an in-depth investigation for each application area. With this study, an extended version of Sane et al. (2021), we contribute an evaluation of Lagrangian analysis viability and efficacy for simulation codes executing at scale on a supercomputer. We investigated previously unexplored cosmology and seismology applications as well as conducted a performance benchmarking study by using a hydrodynamics mini-application targeting exascale computing. Here, to inform encumbrance, we integrated in situ infrastructure with simulation codes, and evaluated Lagrangian in situ reduction in representative homogeneous and heterogeneous HPC environments. To inform post hoc accuracy, we conducted a statistical analysis across a range of spatiotemporal configurations as well as a qualitative evaluation. Additionally, our study contributes cost estimates for distributed-memory post hoc reconstruction. In all, we demonstrate viability for each application — data reduction to less than 1% of the total data via Lagrangian representations, while maintaining accurate reconstruction and requiring under 10% of total execution time in over 90% of our experiments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Simultaneous neutron and X-ray tomography for visualization of graphite electrode degradation in fast-charged lithium-ion batteries

Advanced battery characterization using neutron and X-ray-based imaging modalities is crucial to reveal fundamental degradation modes of lithium-ion batteries (LIBs). Taking advantage of the sensitivity of neutrons to some low-Z (Li) and X-rays to high-Z materials (Cu), here we demonstrate the viability of simultaneous neutron and X-ray tomography (NeXT) as a non-destructive imaging platform for ex-situ 3D visualization of graphite electrode degradation following extreme fast charging (XFC). In addition, we underscore the benefits of the simultaneous of NeXT by combining the neutron and X-ray tomography data from the same sample location for material identification and segmentation of one pristine and two XFC-cycled graphite electrodes (9C charge for 450 cycles). Our ex-situ results and methodology development pave the way for the design of NeXT-friendly LIB geometries that will allow operando and/or in-situ 3D visualization of electrode degradation during XFC.

25 ENERGY STORAGE↗
DOE OSTI2025

MultiTaskDeltaNet: change detection-based image segmentation for operando ETEM with application to carbon gasification kinetics

Transforming in situ transmission electron microscopy (TEM) imaging into a tool for spatially-resolved operando characterization of solid-state reactions requires automated, high-precision semantic segmentation of dynamically evolving features. However, traditional deep learning methods for semantic segmentation often face limitations due to the scarcity of labeled data, visually ambiguous features of interest, and scenarios involving small objects. To tackle these challenges, we introduce MultiTaskDeltaNet (MTDN), a novel deep learning architecture that creatively reconceptualizes the segmentation task as a change detection problem. By implementing a unique Siamese network with a U-Net backbone and using paired images to capture feature changes, MTDN effectively leverages minimal data to produce high-quality segmentations. Furthermore, MTDN utilizes a multi-task learning strategy to exploit correlations between physical features of interest. In an evaluation using data from in situ environmental TEM (ETEM) videos of filamentous carbon gasification, MTDN demonstrated a significant advantage over conventional segmentation models, particularly in accurately delineating fine structural features. Notably, MTDN achieved a 10.22% performance improvement over conventional segmentation models in predicting small and visually ambiguous physical features. This work bridges key gaps between deep learning and practical TEM image analysis, advancing automated characterization of nanomaterials in complex experimental settings.

08 HYDROGEN↗
DOE OSTI2025

A Performance Model of In-Situ Techniques

The computational capacity of High-Performance Computing (HPC) systems increases continuously with the rapid development of central processing units (CPUs) and graphic processing units (GPUs), while the in-/output (IO) subsystem develops relatively slowly and storage capacity is also limited. Data-intensive applications, which are designed to leverage the high computational capacity of HPC resources, typically generate a considerable amount of data for post-processing visualizations and data analytics. The limited IO speed and storage space could lead to constraints in the actual performance of these applications and, therefore, scientific discovery. In-situ techniques, where data is visualized/analysed while still in memory rather than through disk, can contribute to alleviating these problems as they can reduce or even fully avoid data writing/reading through the IO subsystem to/from storage. However, the overall efficiency of insitu techniques crucially depends on the characteristics of both the in-situ tasks and the applications, and the resource distribution among them. Therefore, choosing the right in-situ approach (synchronous, asynchronous, or hybrid) and resource allocation is essential to minimize overhead and maximize the benefits of concurrent execution. In this paper, we present a performance model of in-situ techniques to find the most beneficial in-situ approach and the preferred resource configuration. We verify the high accuracy of our approach with over 6800 measurements and provide use cases with different applications.

Ju, Yi [Max Planck Computing and Data Facility, Ga↗
DOE OSTI2021

Close Observation of Hydraulic Fracturing at EGS Collab Experiment 1: Fracture Trajectory, Microseismic Interpretations, and the Role of Natural Fractures

Abstract Despite the wide application of hydraulic fracturing in enhanced geothermal system (EGS) development and unconventional hydrocarbon production, our understanding of the many factors affecting the propagation of hydraulic fractures has relied on circumstantial evidence. This is partly due to the scarcity of direct observations in the subsurface. The EGS Collab project attempts to address these issues in the context of EGS research by performing intermediate‐scale (∼10 m) hydraulic stimulation experiments in a thoroughly characterized and heavily instrumented underground testbed. This paper analyzes the data collected from the first suite of hydraulic fracturing tests in this testbed, consisting of seven stimulation episodes. High‐quality microseismic data delineate five planar features very clearly. Combining fracture‐wellbore intersection observations from distributed temperature sensing (DTS) and visual observations from an open‐hole well, as well as prior in‐situ stress measurements, we conclude with high certainty that the four larger planes were hydraulic fractures. The growth of the hydraulic fractures was temporarily halted by a prominent, open natural fracture in the testbed but they eventually crossed and slightly reoriented under continued stimulation. Mineral‐filled (i.e., healed) natural fractures, though prevalent in the testbed, did not have perceivable effects on hydraulic fracture propagation. The high‐quality, mutually corroborating data sets allowed conclusions to be drawn with high confidence and attests to the advantage of intermediate‐scale experiments in subsurface research.

58 GEOSCIENCES↗
DOE OSTI2025

Collaborative: in situ visual analytics technologies for extreme scale combustion simulations

This project aims to drastically enhance the usability of in situ analysis and visualization for extreme-scale scientific simulations. Current exascale computing capabilities promise to offer greater predictive ability of simulations and to further push the frontiers of science and technology. However, to validate the simulation output at extreme scale, examine the modeled phenomena, and discover previously unknowns from the output data, the output must be reduced or transformed in situ as it is being generated during the simulation such that the amount of data to examine and store is kept to a minimum. Such in situ approaches allow us to process and analyze the data and any embedded geometry to an extent that would be prohibitively expensive, if not impossible, to perform as a post hoc task. While in situ processing has been demonstrated to be a feasible and promising approach, its full potential has not yet been leveraged. In this project, we have developed comprehensive enhancements to in situ technology based on probability distributions in data. Our research focuses on jointly developing new ways of interacting with massive statistical samples while creatively utilizing new state-of-the-art computational resources to push the boundaries of in situ exploration. Moreover, we have developed new time-dependent techniques to enable previously unattainable capabilities in areas such as intelligent simulation steering and precise feature identification. We have experimentally studied our design and implementation at NERSC and OLCF, and are able to leverage existing in situ infrastructures whenever possible. While the exemplar in this project is combustion, many other fields for which turbulent transport is important, e.g., fusion, climate, astrophysics among others, encounter similar issues as simulations scale up to the exascale. This project shows its potential to generate high impact on DOE missions since the resulting technology promises to improve scientists’ ability to rapidly and correctly interpret and tune extreme-scale simulations, leading to new scientific understanding and advancements.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Enhancing synchrotron radiation micro-CT images using deep learning: an application of Noise2Inverse on bone imaging

In bone-imaging research, in situ synchrotron radiation micro-computed tomography (SRµCT) mechanical tests are used to investigate the mechanical properties of bone in relation to its microstructure. Low-dose computed tomography (CT) is used to preserve bone's mechanical properties from radiation damage, though it increases noise. To reduce this noise, the self-supervised deep learning method Noise2Inverse was used on low-dose SRµCT images where segmentation using traditional thresholding techniques was not possible. Simulated-dose datasets were created by sampling projection data at full, one-half, one-third, one-fourth and one-sixth frequencies of an in situ SRµCT mechanical test. After convolutional neural networks were trained, Noise2Inverse performance on all dose simulations was assessed visually and by analyzing bone microstructural features. Visually, high image quality was recovered for each simulated dose. Lacunae volume, lacunae aspect ratio and mineralization distributions shifted slightly in full, one-half and one-third dose network results, but were distorted in one-fourth and one-sixth dose network results. Following this, new models were trained using a larger dataset to determine differences between full dose and one-third dose simulations. Significant changes were found for all parameters of bone microstructure, indicating that a separate validation scan may be necessary to apply this technique for microstructure quantification. Noise present during data acquisition from the testing setup was determined to be the primary source of concern for Noise2Inverse viability. While these limitations exist, incorporating dose calculations and optimal imaging parameters enables self-supervised deep learning methods such as Noise2Inverse to be integrated into existing experiments to decrease radiation dose.

Obata, Yoshihiro (ORCID:0000000303659129)↗
DOE OSTI2026

Deep-learning methods for contrast enhancement and artifact reduction in cryo-electron tomography: a systematic analysis of the state of the art and proposed improvements

Cryo-electron tomography (cryo-ET) has emerged as the preferred technique for visualizing the organization of macromolecular complexes in situ and resolving their structures at subnanometre resolution [Tegunov et al. (2021)View full citation, Nat. Methods, 18, 186–193]. Despite improvements in data quality as a result of advances in detector technology, microscope stability and stage precision, the analysis and interpretation of tomograms remains challenging due to a low signal-to-noise ratio and reconstruction artifacts stemming from experimental constraints in specimen tilt during data collection resulting in a missing wedge in the Fourier space. Recently, self-supervised deep-learning methods have been proposed for contrast enhancement and reduction of resolution anisotropy in reconstructed tomograms. Here, we evaluate several state-of-the-art deep-learning methods which aim to improve the interpretability of cryo-ET reconstructions, with a focus on their performance on downstream tasks of template matching, sub­tomogram averaging and segmentation. We propose new training architectures and a loss function based on Fourier shell correlation that show improved performance over the standard U-Net with L1/L2 losses. We demonstrate our analysis on four diverse experimental datasets: purified 80S ribosomes, in situ Chlamydomonas reinhardtii, immature HIV-1 virus-like particles and INS-1E cells.

contrast enhancement↗
DOE OSTI2024

Evaluating the Effectiveness of a Detection and Deterrent System in Reducing Golden Eagle Fatalities at Operational Wind Facilities

The Renewable Energy Wildlife Institute (REWI) was appointed as the prime awardee of DOE award number DE-EE0007883 to lead a team of scientists, wind developers, and technology manufacturers toward the overarching goal of evaluating the effectiveness of the current DTBird system in minimizing the risk of golden eagles (Aquila chrysaetos) and other large soaring raptors from approaching the rotor-swept zone (RSZ) of operating wind turbines. As part of this goal, the team set out to 1) quantify the expected reduction in collision risk for golden eagles from operation of the detection and deterrence modules in a manner that supports the approach used by the U.S. Fish and Wildlife Service (USFWS) to assess and credit facility operators for their efforts to minimize predicted collision fatalities and 2) provide information to help improve the technology to maximize its effectiveness. DTBird is an automated detection and audio deterrent system created by the Spanish company Liquen, designed to discourage birds from entering the RSZ of spinning wind turbines. The system uses cameras to automatically detect airborne targets of interest, records each such event in an online database, and triggers a warning signal (loud sound) if the tracked object has moved close to the turbine. If the object moves even closer to the RSZ, a more aggressive dissuasion signal is broadcast. To meet our objectives, the team conducted a two-year experiment at the Goodnoe Hills wind facility in Washington state, in which 14 turbines were outfitted with DTBird units. Daily, each DTBird-equipped turbine was randomly assigned to a control or treatment group. Treatment turbines operated with DTBird running as intended—broadcasting warning or deterrent signals when DTBird detected a target within range. On control turbines, no sound signals were broadcast if a moving target triggered the DTBird system. The team also flew unmanned aerial vehicles (UAVs) designed to coarsely mimic the general size, weight, and coloration of golden eagles in programmed flight transects across DTBird detection ranges to quantify DTBird’s ability to detect intended targets and to evaluate factors that influence the probability of detection and DTBird’s response distances. Additionally, the team evaluated the behavioral responses of in situ eagles exposed to spinning turbines alone (visual and sound influences) versus spinning turbines plus broadcasted DTBird audio deterrents, to estimate the effectiveness of deterrence by the DTBird system. The data and results from these investigations were combined with those from a pilot study conducted at the Manzana Wind Power Project in California to better evaluate DTBird’s effectiveness across different landscapes.

17 WIND ENERGY↗
DOE OSTI2020

In situ multimodal imaging for nanoscale visualization of tribofilm formation

A third of the energy from fuel combustion in passenger car gasoline engines is lost due to friction. Carefully designed engine lubricants can recover some of these losses by reducing friction and wear by forming a nanometer-scale chemico-physico tribofilm between surfaces. Accordingly, attention has focused on developing oil formulations that form low-friction tribofilms. However, analyses of resultant tribofilms are typically conducted after tribo-tests with conventional characterization tools and do not offer insights into tribofilm formation and evolution, precluding information critical to tuning tribofilm properties. In this work, we developed a unique multimodal methodology based on Atomic Force Microscopy (AFM) with local probe heating for in situ tribological studies that activates friction modifiers and simultaneously captures the evolution of friction and surface roughness, with nanometer resolution. As a platform to demonstrate the ability of this methodology to visualize dynamics of tribofilm formation in situ, we apply it to molybdenum-based friction modifiers to distinguish key factors in their functionality and correlate nanoscale AFM and Friction Force Microscopy data to bench tribo-tests used in the industry. To decode the formation mechanisms observed in situ and underlying chemistry of tribofilms, we performed ab initio Molecular Dynamics (AIMD) simulations at comparable conditions. AIMD simulations confirmed both nanoscale and bench tribo-test results and showed deviations in molecular organization in tribofilms that are formed from different molybdenum-based friction modifiers that corroborates with surface functionality. With this innovative methodology, we demonstrate proof-of-principle in situ formation of molybdenum-based tribofilms directly on steel surfaces that could be applied generally to studying tribofilm formation.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Evaluating the pressure dependence of PZT structures using a virtual reality environment

Pb–Zr–Ti–O (PZT) perovskites span a large solid-solution range and have found widespread use due to their piezoelectric and ferroelectric properties that also span a large range. Crystal structure analysis via Rietveld refinement facilitates materials analysis via the extraction of the structural parameters. These parameters, often obtained as a function of an additional dimension (e.g., pressure), can help to diagnose materials response within a use environment. Often referred to as “ in-situ ” studies, these experiments provide an abundance of data. Viewing structural changes due to applied pressure conditions can give much-needed insight into materials performance. However, challenges exist for viewing/presenting results when the details are inherently three-dimensional (3D) in nature. For PZT perovskites, the use of polyhedra (e.g., Zr/Ti–O 6 octahedra) to view bonding/connectivity is beneficial; however, the visualization of the octahedra behavior with pressure dependence is less easily demonstrated due to the complexity of the added pressure dimension. We present a more intuitive visualization by projecting structural data into virtual reality (VR). We employ previously published structural data for Pb 0.99 (Zr 0.95 Ti 0.05 ) 0.98 Nb 0.02 O 3 as an exemplar for VR visualization of the PZT R3c crystal structure between ambient and 0.62 GPa pressure. This is accomplished via our in-house CAD2VR™ software platform and the new CrystalVR plugin. The use of the VR environment enables a more intuitive viewing experience, while enabling on-the-fly evaluation of crystal data, to form a detailed and comprehensive understanding of in-situ datasets. Discussion of methodology and tools for viewing are given, along with how recording results in video form can enable the viewing experience.

Rodriguez, Mark A. (ORCID:0000000269405044)↗