Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis, visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Measurement and analysis of GPU-accelerated applications with HPCToolkit

To address the challenge of performance analysis on the US DOE’s forthcoming exascale supercomputers, Rice University has been extending its HPCToolkit performance tools to support measurement and analysis of GPU-accelerated applications. To help developers understand the performance of accelerated applications as a whole, HPCToolkit’s measurement and analysis tools attribute metrics to calling contexts that span both CPUs and GPUs. To measure GPU-accelerated applications efficiently, HPCToolkit employs a novel wait-free data structure to coordinate monitoring and attribution of GPU performance. To help developers understand the performance of complex GPU code generated from high-level programming models, HPCToolkit constructs sophisticated approximations of call path profiles for GPU computations. To support fine-grained analysis and tuning, HPCToolkit uses PC sampling and instrumentation to measure and attribute GPU performance metrics to source lines, loops, and inlined code. To supplement fine-grained measurements, HPCToolkit can measure GPU kernel executions using hardware performance counters. To provide a view of how an execution evolves over time, HPCToolkit can collect, analyze, and visualize call path traces within and across nodes. Finally, on NVIDIA GPUs, HPCToolkit can derive and attribute a collection of useful performance metrics based on measurements using GPU PC samples. Here, we illustrate HPCToolkit’s new capabilities for analyzing GPU-accelerated applications with several codes developed as part of the Exascale Computing Project.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

TracKlinic: Diagnosis of Challenge Factors in Visual Tracking

Generic visual object tracking is difficult due to many challenge factors (e.g., occlusion, blur, etc.). Each of these factors may cause serious problems for a tracker, and when they work together can make things even more complicated. Despite a great amount of efforts devoted to understanding the behavior of trackers, reliable and quantifiable ways for studying the per factor tracking behavior remain barely available. Addressing this issue, in this paper we contribute to the community a tracking diagnosis toolkit, TracKlinic, for diagnosis of challenge factors of tracking algorithms. TracKlinic consists of two novel components focusing on the data and analysis aspects, respectively. For the data component, we carefully prepare a set of 2,390 annotated videos, each involving one and only one major challenge factor. When analyzing an algorithm for a specific challenge factor, such one-factor-per-sequence rule greatly inhibits the disturbance from other factors and consequently leads to more faithful analysis. For the analysis component, given the tracking results on all sequences, it investigates the behavior of the tracker under each individual factor and generates the report automatically. With TracKlinic, a thorough study is conducted on ten state-of-the-art trackers on nine challenge factors (including two compound ones). The results suggest that, heavy shape variation and occlusion are the two most challenging factors faced by most trackers. Besides, out-of-view, though does not happen frequently, is often fatal. By sharing TracKlinic1, we expect to make it much easier for diagnosing tracking algorithms, and to thus facilitate developing better ones.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

A Dynamic Hierarchical Attention Framework for Multimodal Malware Detection

The increasing use of Android in the worldwide mobile ecosystem has come along with a significant increase in advanced malware, highlighting the critical necessity for efficient, scalable, and adaptable detection systems. Despite recent advancements in machine learning improving malware detection, the majority of current solutions are limited to one, two, or three data modalities, hence neglecting the comprehensive behavioral spectrum of contemporary multi-vector threats. This thesis presents the first comprehensive multimodal framework for Android malware detection, which combines textual, time-series (temporal), graph-based (structural), and visual information using an innovative hierarchical attention mechanism and Dynamic Fusion Controller (DFC). Our methodology consistently classifies and processes modalities as either sequential or structural, facilitating content-adaptive weighting and resilient cross-modal representation learning. We advance the implementation of cutting-edge time series techniques, such as MiniRocket, for malware detection, hence creating new opportunities for temporal analysis in cybersecurity. Comprehensive experimental assessment shows that our framework performs exceptionally well, with 99.46% classification accuracy and 97.15% detection accuracy, significantly outperforming existing approaches through effective multimodal integration and hierarchical attention mechanisms.

Nazmin, Tamanna↗
DOE OSTI2023

Evaluating the pressure dependence of PZT structures using a virtual reality environment

Pb–Zr–Ti–O (PZT) perovskites span a large solid-solution range and have found widespread use due to their piezoelectric and ferroelectric properties that also span a large range. Crystal structure analysis via Rietveld refinement facilitates materials analysis via the extraction of the structural parameters. These parameters, often obtained as a function of an additional dimension (e.g., pressure), can help to diagnose materials response within a use environment. Often referred to as “ in-situ ” studies, these experiments provide an abundance of data. Viewing structural changes due to applied pressure conditions can give much-needed insight into materials performance. However, challenges exist for viewing/presenting results when the details are inherently three-dimensional (3D) in nature. For PZT perovskites, the use of polyhedra (e.g., Zr/Ti–O 6 octahedra) to view bonding/connectivity is beneficial; however, the visualization of the octahedra behavior with pressure dependence is less easily demonstrated due to the complexity of the added pressure dimension. We present a more intuitive visualization by projecting structural data into virtual reality (VR). We employ previously published structural data for Pb 0.99 (Zr 0.95 Ti 0.05 ) 0.98 Nb 0.02 O 3 as an exemplar for VR visualization of the PZT R3c crystal structure between ambient and 0.62 GPa pressure. This is accomplished via our in-house CAD2VR™ software platform and the new CrystalVR plugin. The use of the VR environment enables a more intuitive viewing experience, while enabling on-the-fly evaluation of crystal data, to form a detailed and comprehensive understanding of in-situ datasets. Discussion of methodology and tools for viewing are given, along with how recording results in video form can enable the viewing experience.

Rodriguez, Mark A. (ORCID:0000000269405044)↗
DOE OSTI2020

The weakly nonlinear response and nonaffine interpretation of the Johnson–Segalman/Gordon–Schowalter model

We derive new analytical solutions for the non-affine Johnson-Segalman/Gordon-Schowalter (JS/GS) constitutive equation with a general relaxation kernel in medium-amplitude oscillatory shear (MAOS) deformation. The results show time-strain separable (TSS) nonlinearity, therefore providing new physically-meaningful interpretation to the heuristic TSS nonlinear parameter in MAOS. The upper-convected, lower-convected, and corotational Maxwell models are all subsets of the results presented here. The model assumes that the microscale elements causing stress in the material slip compared to the continuum deformation. We introduce a visualization of the non-affine deformation field that acts on stress-generating elements to reinforce the hysical interpretation of the JS/GS class of models. Lastly, a case study is presented where previously published results, from fitting TSS models to MAOS data, can be re-interpreted based on the concept of non-affine motion of the JS/GS framework.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Tetrahedral Trees: A Family of Hierarchical Spatial Indexes for Tetrahedral Meshes

In this work, we address the problem of performing efficient spatial and topological queries on large tetrahedral meshes with arbitrary topology and complex boundaries. Such meshes arise in several application domains, such as 3D Geographic Information Systems (GISs), scientific visualization, and finite element analysis. To this aim, we propose Tetrahedral trees, a family of spatial indexes based on a nested space subdivision (an octree or a kD-tree) and defined by several different subdivision criteria. We provide efficient algorithms for spatial and topological queries on Tetrahedral trees and compare to state-of-the-art approaches. Our results indicate that Tetrahedral trees are an improvement over R*-trees for querying tetrahedral meshes; they are more compact, faster in many queries, and stable at variations of construction thresholds. They also support spatial queries on more general domains than topological data structures, which explicitly encode adjacency information for efficient navigation but have difficulties with domains with a non-trivial geometric or topological shape.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Precoder Design for Physical-Layer Security and Authentication in Massive MIMO UAV Communications

Supporting reliable and seamless wireless connectivity for unmanned aerial vehicles (UAVs) has recently become a critical requirement to enable various different use cases of UAVs. Due to their widespread deployment footprint, cellular networks can support beyond visual line of sight (BVLOS) communications for UAVs. In this paper, we consider cellular connected UAVs (C-UAVs) that are served by massive multiple input-multiple-output (MIMO) links to extend coverage range, while also improving physical layer security and authentication. Here, we consider Rician channel and propose a novel linear precoder design for transmitting data and artificial noise (AN). We derive the closed-form expression of the ergodic secrecy rate of CUAVs for both conventional and proposed precoder designs. In addition, we obtain the optimal power splitting factor that divides the power between data and AN by asymptotic analysis. Then, we apply the proposed precoder design in the fingerprint embedding authentication framework, where the goal is to minimize the probability of detection of the authentication tag at an eavesdropper. In simulation results, we show the superiority of the proposed precoder in both secrecy rate and the authentication probability considering moderate and large number of antenna massive MIMO scenarios.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

Computed Tomography Scanning and Geophysical Measurements of UW Enterprises LP 1-250512-129 Well in Southwestern Indiana

The computed tomography (CT) facilities and the Multi-Sensor Core Logger (MSCL) at the National Energy Technology Laboratory (NETL) in Morgantown, West Virginia, were used to characterize Illinois Basin core of the Upper Devonian-Early Mississippian New Albany Shale Formation from Posey County, Indiana. The primary impetus of this work is a collaboration between Indiana Geological and Water Survey at Indiana University Bloomington, NETL, and Woolsey Operating Company LLC to characterize and make publicly available core information from the New Albany Shale of the Illinois Basin. Core characterization of this unconventional oil/gas well will aid in understanding the lithology changes and the fracture complexity of the New Albany Shale. There is a potential for this formation to be developed in the future for critical mineral and rare earth element (CM/REE) extraction. The resultant datasets are presented in this report and can be accessed from NETL's Energy Data eXchange (EDX) online system using the following link: https://edx.netl.doe.gov/dataset/uw-enterprises. All equipment and techniques used were non-destructive, enabling future examinations and analyses to be performed on this core. None of the equipment used was suitable for direct visualization of the pore space in the fine-grained structures studied; however, fractures, discontinuities, and millimeter-scale features were readily detectable with the methods tested. Imaging with the NETL medical CT scanner was performed on the entire core. Targeted higher resolution CT scanning of select sections was performed with NETL’s industrial and micro-CT scanner. Qualitative analysis of the medical CT images, coupled with X-ray fluorescence (XRF), P-wave, and magnetic susceptibility measurements from the MSCL were useful in identifying zones of interest for more detailed analysis. The ability to quickly identify key areas for more detailed study with higher resolution will save time and resources in future studies. The combination of methods used provides a multi-scale analysis of the core; the resulting macro and micro descriptions are relevant to many subsurface energy related examinations traditionally performed at NETL.

58 GEOSCIENCES↗
DOE OSTI2022

Accurate and Rapid Forecasts for Geologic Carbon Storage via Learning-Based Inversion-Free Prediction

Carbon capture and storage (CCS) is one approach being studied by the U.S. Department of Energy to help mitigate global warming. The process involves capturing CO 2 emissions from industrial sources and permanently storing them in deep geologic formations (storage reservoirs). However, CCS projects generally target “green field sites,” where there is often little characterization data and therefore large uncertainty about the petrophysical properties and other geologic attributes of the storage reservoir. Consequently, ensemble-based approaches are often used to forecast multiple realizations prior to CO 2 injection to visualize a range of potential outcomes. In addition, monitoring data during injection operations are used to update the pre-injection forecasts and thereby improve agreement between forecasted and observed behavior. Thus, a system for generating accurate, timely forecasts of pressure buildup and CO 2 movement and distribution within the storage reservoir and for updating those forecasts via monitoring measurements becomes crucial. This study proposes a learning-based prediction method that can accurately and rapidly forecast spatial distribution of CO 2 concentration and pressure with uncertainty quantification without relying on traditional inverse modeling. The machine learning techniques include dimension reduction, multivariate data analysis, and Bayesian learning. The outcome is expected to provide CO 2 storage site operators with an effective tool for timely and informative decision making based on limited simulation and monitoring data.

58 GEOSCIENCES↗
DOE OSTI2022

Comparison of Machine Learning and Deep Learning for View Identification from Cardiac Magnetic Resonance Images

Background: Artificial intelligence is increasingly utilized to aid in the interpretation of cardiac magnetic resonance (CMR) studies. One of the first steps is the identification of the imaging plane depicted, which can be achieved by both deep learning (DL) and classical machine learning (ML) techniques without user input. We aimed to compare the accuracy of ML and DL for CMR view classification and to identify potential pitfalls during training and testing of the algorithms. Methods: To train our DL and ML algorithms, we first established datasets by retrospectively selecting 200 CMR cases. The models were trained using two different cohorts (passively and actively curated) and applied data augmentation to enhance training. Once trained, the models were validated on an external dataset, consisting of 20 cases acquired at another center. We then compared accuracy metrics and applied class activation mapping (CAM) to visualize DL model performance. Results: The DL and ML models trained with the passively-curated CMR cohort were 99.1% and 99.3% accurate on the validation set, respectively. However, when tested on the CMR cases with complex anatomy, both models performed poorly. After training and testing our models again on all 200 cases (active cohort), validation on the external dataset resulted in 95% and 90% accuracy, respectively. The CAM analysis depicted heat maps that demonstrated the importance of carefully curating the datasets to be used for training. Conclusions: Both DL and ML models can accurately classify CMR images, but DL outperformed ML when classifying images with complex heart anatomy.

artificial intelligence↗
DOE OSTI2025

A product data network to enable faster, easier, and better planning of building envelopes

The building envelopes contributes significantly to the energy-efficiency of the building. Building performance simulation has made it possible to compare façade technologies regarding energy demand, daylighting, thermal and visual comfort in detail. Planners, such as architects and engineers, need experience to find product data with the right quality and level of detail, and to process the data to fit the calculation and the application. In the available time, planners can compare only a limited number of products, which means that better solutions could go unnoticed. This paper presents a new concept for making product data easily accessible for building façade planning. The concept consists of a network of databases for the efficient exchange and use of optical and calorimetric data of glazing units, shading devices, and combinations of both. The paper presents the research questions, an analysis of the current challenges, six design goals for the product data network and its implementation together with a discussion. Many product data sources can be connected to many planning software applications via the specified application programming interface. When planning software connects to the product data network, the planning of building envelopes can be much faster because planners do not need to spend so much time to search and process product data manually. The planning of building envelopes can also become much easier, especially for planners with limited experience. They do not need to understand all the details about which data fits which calculation if the software company implements this. The planning of building envelopes can become much more reliable when software companies validate their use of the product data network, because the current manual process is prone to errors. The planning of building envelopes can also improve because more products can be compared in the available time, allowing better solutions to be found.

Maurer, Christoph↗
DOE OSTI2023

DFTT report for Signal Analysis (2023)

The Detection Framework Testbed and Toolkit (DFTT) is a database and associated java programs intended to facilitate the development and testing of algorithms for operating suites of correlation and subspace detectors. This framework is a generalization of the system described in Harris and Dodge (2011) and Dodge and Harris (2016). DFTT allows retrospective processing of sequences of data using various system configurations. Results are saved in a database, so it is easy to compare the results obtained using different configurations of the system. The principal software components of DFTT are the ConfigCreator, the framework_runner and the Builder program. ConfigCreator assembles the files necessary to define a particular configuration used for processing. The framework_runner operates suites of detectors and saves the results in an Oracle™ database. Builder allows visual examination of templates and detected signals and allows editing and creation of detectors. In addition, there are tools for importing continuous data into the database. DFTT is licensed under the MIT license and has LLNL release number LLNL-CODE-801881. In the current fiscal year DFTT has been used in two different projects. The first (NTL-funded) project investigates the feasibility of screening nuisance detections using correlation detectors. The second (GNEM-funded) project seeks to extend the results of Harris and Dodge (2021) to 3- D sources and multiple stations. Each of these efforts required that additional functionality be added to DFTT. In this report I will summarize the enhancements to DFTT in the context of the relevant research effort.

58 GEOSCIENCES↗
DOE OSTI2020

An Updated Visual Orbit of the Directly Imaged Exoplanet 51 Eridani b and Prospects for a Dynamical Mass Measurement with Gaia

We present a revision to the visual orbit of the young, directly imaged exoplanet 51 Eridani b using four years of observations with the Gemini Planet Imager. The relative astrometry is consistent with an eccentric (e=0.53{sub -0.13}{sup +0.09}) orbit at an intermediate inclination (i=136{sub -11}{sup +10} °), although circular orbits cannot be excluded due to the complex shape of the multidimensional posterior distribution. We find a semimajor axis of 11.1{sub -1.3}{sup +4.2} au and a period of 28.1{sub -4.9}{sup +17.2} yr, assuming a mass of 1.75 M{sub ⊙} for the host star. We find consistent values with a recent analysis of VLT/SPHERE data covering a similar baseline. We investigate the potential of using the absolute astrometry of the host star to obtain a dynamical mass constraint for the planet. The astrometric acceleration of 51 Eri derived from a comparison of the Hipparcos and Gaia catalogs was found to be inconsistent at the 2σ–3σ level with the predicted reflex motion induced by the orbiting planet. Potential sources of this inconsistency include a combination of random and systematic errors between the two astrometric catalogs and the signature of an additional companion within the system interior to current detection limits. We also explored the potential of using Gaia astrometry alone for a dynamical mass measurement of the planet by simulating Gaia measurements of the motion of the photocenter of the system over the course of the extended 8 yr mission. We find that such a measurement is only possible (>98% probability) given the most optimistic predictions for the Gaia scan astrometric uncertainties for bright stars and a high mass for the planet (≳3.6 M {sub Jup}).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Chimbuko: A Workflow-Level Scalable Performance Trace Analysis Tool

ABSTRACT Due to the sheer volume of data it is typically impractical to analyze the detailed performance of an HPC application running at-scale. While conventional small-scale benchmarking and scaling studies are often sufficient for simple applications, many modern workflow-based applications couple multiple elements with competing resource demands and complex inter-communication patterns for which performance cannot easily be studied in isolation and at small scale. This work discusses Chimbuko, a performance analysis framework that provides real-time, in situ anomaly detection. By focusing specifically on performance anomalies and their origin (aka provenance), data volumes are dramatically reduced without losing necessary details. To the best of our knowledge, Chimbuko is the first online, distributed, and scalable workflow-level performance trace analysis framework. We demonstrate the tool's usefulness on Oak Ridge National Laboratory's Summit system.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Comparative Analysis of Report-Back of Research Results Strategies for Personal Chemical Exposure Data

Background. Report-back of research results (RBRR) is ethically supported and highly requested by participants yet lacks broadly transferable guidelines for RBRR. Effective RBRR must be responsive to target audience needs and may not be addressed by a ‘one-size-fits-all’ approach. Objective. Within a subset of our 19 studies on RBRR, we had the unique opportunity to carry out a comparative analysis of RBRR strategies across cohorts with similar development and evaluation methods, yet distinct in life stage, geography, number and type of chemicals assessed, and community contexts. Methods. We highlight key outcomes from three environmental health studies: an ongoing New York, NY cohort (Fair Start; n=486) and a Detroit, MI cohort (CLEAR; n=34) assessing exposure to ambient urban pollution during pregnancy, and a longitudinal cohort in Houston, TX (Houston-3H) following Hurricane Harvey (n=312). Focus group and survey data were analyzed to identify lessons learned and explore how RBRR supports understanding of environmental health. Results. Commonalities emerged in RBRR development, design, organization, and data visualization, as well as in how RBRR can contribute to an understanding of health-environment connections. Differences included preferences for individual versus community level findings, as well as distinguishable contextual considerations. For pregnancy cohorts, messaging was framed with cultural sensitivity, and to avoid unintended consequences of parental guilt due to prenatal exposures. In the post-disaster Houston-3H study, participants requested additional transparency regarding sampling design and study rationale. Significance. All RBRR case studies reported chemicals without known regulatory or health guidelines, so results were contextualized within the study population. Participants across cohorts requested multi-study comparisons to better understand their results beyond their communities. While foundational RBRR elements (e.g. plain language, graphic organizers) may supersede cohort-specific differences, RBRR should be personalized to encompass perceptions of health across different life-stage, cultural, and environmental contexts.

Vogel, Taylor J.↗
DOE OSTI2022

Exploring MDSplus data-acquisition software and custom devices

MDSplus is a software tool designed for data acquisition, storage, and analysis of complex scientific experiments. Over the years, MDSplus has primarily been used for data management for fusion experiments. This paper demonstrates that MDSplus can be used for a much wider variety of systems and experiments. We present a step-by-step tutorial describing how to create a simple experiment, manage the data, and analyze it using MDSplus and Python. To this end, a custom example device was developed to be used as the data source. This device was built on an opensource electronic hardware platform, and it consists of a microcontroller and two sensors. We read data from these sensors, store it in MDSplus, and use JupyterLab to visualize and process it. This project and code demo are available on the GitHub site at this URL: https://github.com/santorofer/MDSplusAndCustomeDevices

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

YOLO2U-Net: Detection-guided 3D instance segmentation for microscopy

Microscopy imaging techniques are instrumental for characterization and analysis of biological structures. As these techniques typically render 3D visualization of cells by stacking 2D projections, issues such as out-of-plane excitation and low resolution in the z-axis may pose challenges (even for human experts) to detect individual cells in 3D volumes as these non-overlapping cells may appear as overlapping. In this paper a comprehensive method for accurate 3D instance segmentation of cells in the brain tissue is introduced. The proposed method combines the 2D YOLO detection method with a multi-view fusion algorithm to construct a 3D localization of the cells. Next, the 3D bounding boxes along with the data volume are input to a 3D U-Net network that is designed to segment the primary cell in each 3D bounding box, and in turn, to carry out instance segmentation of cells in the entire volume. The promising performance of the proposed method is shown in comparison with current deep learning-based 3D instance segmentation methods.

3D instance segmentation↗
DOE OSTI2023

Computed Tomography Scanning and Petrophysical Measurements of the Lively Grove #1 Well Core

The computed tomography (CT) facilities and the Multi-Sensor Core Logger (MSCL) at the National Energy Technology Laboratory (NETL) in Morgantown, West Virginia were used to characterize core from the Lively Grove #1 Well (API 121892494700), drilled near Marissa, Washington County, Illinois. Core from the well was obtained as part of the Illinois Storage Corridor’s Carbon Storage Assurance Facility Enterprise (CarbonSAFE) project (DE FE0031892). The primary impetus of this work was to capture a detailed digital representation of the core from the Lively Grove #1 Well. The collaboration between the U.S. Department of Energy’s (DOE) NETL and the Illinois State Geological Survey (ISGS) enables other research entities to access information about this potential carbon storage location and Cambro-Ordovician Storage Complex formations of the Illinois Basin. The resultant datasets are presented in this report and can be accessed from NETL’s Energy Data eXchange (EDX) online system. All equipment and techniques used were non-destructive, enabling future examinations and analyses to be performed on these cores. Fractures, discontinuities, and millimeter-scale features were readily detectable with the medical CT scanner-acquired images. Imaging with the NETL medical CT scanner was performed on entire cores. Qualitative analysis of the medical CT images, coupled with X-ray fluorescence (XRF), gamma density, and magnetic susceptibility measurements from the MSCL were useful in identifying zones of interest for potential future analysis. Higher-resolution industrial and micro-CT images were acquired from selected zones along the depth of the core to visualize the structure in higher detail. The ability to quickly identify key areas for more detailed study with higher resolution will save time and resources in future studies. The combination of methods used provides a multi-scale analysis of the core; with the resulting macro- and micro-descriptions relevant to many subsurface energy related examinations traditionally performed at NETL.

54 ENVIRONMENTAL SCIENCES↗