Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “statistical visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Molecular-gas-dynamics simulations of turbulent Couette flow over a mean-free-path-scale permeable substrate

Here we report flow statistics and visualizations from molecular-gas-dynamics simulations using the direct simulation Monte Carlo (DSMC) method for turbulent Couette flow in a minimal domain where the lower wall is replaced by an idealized permeable fibrous substrate representative of thermal-protection-system materials for which the Knudsen number is O(10 -1 ). Comparisons are made with smooth-wall DSMC simulations and smooth-wall direct numerical simulations (DNS) of the Navier-Stokes equations for the same conditions. Roughness, permeability, and noncontinuum effects are assessed. In the range of Reynolds numbers considered herein, the scalings of the skin friction on the permeable substrate and of the mean flow within the substrate suggest that they are dominated by viscous effects. While the regenerative cycle characteristic of smooth-wall turbulence remains intact for all cases considered, we observe that the near-wall velocity fluctuations are modulated by the permeable substrate with a wavelength equal to the pore spacing. Additionally, the flow within the substrate shows significant rarefaction effects, resulting in an apparent permeability that is 13% larger than the intrinsic permeability. In contrast, the smooth-wall DSMC and DNS simulations exhibit remarkably good agreement for the statistics examined, despite the Knudsen number based on the viscous length scale being as large as O(10 -1 ). This latter result is at variance with classical estimates for the breakdown of the continuum assumption and calls for further investigations into the interaction of noncontinuum effects and turbulence.

42 ENGINEERING↗
DOE OSTI2018

Large Ensemble Analytic Framework for Consequence-Driven Discovery of Climate Change Scenarios

An analytic scenario generation framework is developed based on the idea that the same climate outcome can result from very different socioeconomic and policy drivers. The framework builds on the Scenario Matrix Framework’s abstraction of “challenges to mitigation” and “challenges to adaptation” to facilitate the flexible discovery of diverse and consequential scenarios. We combine visual and statistical techniques for interrogating a large factorial data set of 33,750 scenarios generated using the Global Change Assessment Model. We demonstrate how the analytic framework can aid in identifying which scenario assumptions are most tied to user-specified measures for policy relevant outcomes of interest, specifically for our example high or low mitigation costs. We show that the current approach for selecting reference scenarios can miss policy relevant scenario narratives that often emerge as hybrids of optimistic and pessimistic scenario assumptions. We also show that the same scenario assumption can be associated with both high and low mitigation costs depending on the climate outcome of interest and the mitigation policy context. In the illustrative example, we show how agricultural productivity, population growth, and economic growth are most predictive of the level of mitigation costs. Formulating policy relevant scenarios of deeply and broadly uncertain futures benefits from large ensemble-based exploration of quantitative measures of consequences. To this end, we have contributed a large database of climate change futures that can support “bottom-up” scenario generation techniques that capture a broader array of consequences than those that emerge from limited sampling of a few reference scenarios.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2014

IOPro: a parallel I/O profiling and visualization framework for high-performance storage systems

Efficient execution of large-scale scientific applications requires high-performance computing systems designed to meet the I/O requirements. To achieve high-performance, such data-intensive parallel applications use a multi-layer layer I/O software stack, which consists of high-level I/O libraries such as PnetCDF and HDF5, the MPI library, and parallel file systems. To design efficient parallel scientific applications, understanding the complicated flow of I/O operations and the involved interactions among the libraries is quintessential. Such comprehension helps identify I/O bottlenecks and thus exploits the potential performance in different layers of the storage hierarchy. To profile the performance of individual components in the I/O stack and to understand complex interactions among them, we have implemented a GUI-based integrated profiling and analysis framework, IOPro. IOPro automatically generates an instrumented I/O stack, runs applications on it, and visualizes detailed statistics based on the user-specified metrics of interest. We present experimental results from two different real-life applications and show how our framework can be used in practice. By generating an end-to-end trace of the whole I/O stack and pinpointing I/O interference, IOPro aids in understanding I/O behavior and improving the I/O performance significantly.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

The optimization of high resolution topographic data for 1D hydrodynamic models

The main focus of our research presented in this paper is to optimize and use high resolution topographical data (HRTD) for hydrological modelling. Optimization of HRTD is done by generating adaptive mesh by measuring distance of coarse mesh and the surface of the dataset and adapting the mesh from the perspective of keeping the geometry as close to initial resolution as possible. Technique described in this paper enables computation of very accurate 1-D hydrodynamic models. In the paper, we use HEC-RAS software as a solver. For comparison, we have chosen the amount of generated cells/grid elements (in whole discretization domain and selected cross sections) with respect to preservation of the accuracy of the computational domain. Generation of the mesh for hydrodynamic modelling is strongly reliant on domain size and domain resolution. Topographical dataset used in this paper was created using LiDAR method and it captures 5.9km long section of a catchment of the river Olše. We studied crucial changes in topography for generated mesh. Assessment was done by commonly used statistical and visualization methods.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2017

MWASTools: an R/bioconductor package for metabolome-wide association studies

Abstract Summary MWASTools is an R package designed to provide an integrated pipeline to analyse metabonomic data in large-scale epidemiological studies. Key functionalities of our package include: quality control analysis; metabolome-wide association analysis using various models (partial correlations, generalized linear models); visualization of statistical outcomes; metabolite assignment using statistical total correlation spectroscopy (STOCSY); and biological interpretation of metabolome-wide association studies results. Availability and implementation The MWASTools R package is implemented in R (version > =3.4) and is available from Bioconductor: https://bioconductor.org/packages/MWASTools/. Supplementary information Supplementary data are available at Bioinformatics online.

Rodriguez-Martinez, Andrea↗
DOE OSTI2018

DataXray

Lab experiments involving digital signal processing tend to capture heterogeneous data that is binned into individual files. The structure of the whole experiment tends to get lost in this process, generating a "mess" of data that is difficult to summarize, and even more difficult to analyze in a consistent way. DataXray is a set of python routines that wraps publicly available open-source codes to create a consistent workflow for data and experiments, involving imaging, spectral and hyperspectral data. Routines are provided for data translation, slicing, visualization, multivariate statistics, integral transforms, feature extraction and reporting in the form of publication-grade figures.

Maksymovych, Petro↗
DOE OSTI2021

FY21 Progress Report: SRNL Analysis of ICCWR LCM and WAMS data for Corrosion and Cracking

The development of algorithms for machine learning and data analysis for the 3013 Surveillance Program is a collaborative effort by the Savannah River National Laboratory (SRNL) and the University of South Carolina (USC). For corrosion detection, Laser Confocal Microscope (LCM) or Wide Area 3D Measurement System (WAMS) data is extracted from large binary files, with software written to convert the data to physical attributes (e.g., height, color and grayscale values; all as functions of a location in a plane projection). A user-friendly Matlab Graphical User Interface (GUI) that reads data from either LCM or WAMS files was developed to integrate input data with software developed for processing and evaluation. The GUI can selectively download binary data, interrogate data attributes, label data, flag significant features, execute Machine Learning (ML) algorithms, output parameters for trained ML algorithms, report ML model accuracy with respect to labeled data, and generate graphical representations for various analyses. Features can be called out by user-specified thresholds, manual labeling or machine learning algorithms when they have been completed. The ability to rapidly label data is important because of the volume of data required for training machine learning algorithms. The GUI has the flexibility to allow addition of improved ML algorithms, methods for data visualization, and statistical computations. Statistical analyses via the GUI include areas of pits within a defined range of pit depths, correlations between Red-Green-Blue (RGB) or grayscale intensity and relative surface height, covariances between values associated with features, and feature histograms. The development of supervised machine learning algorithms, however, has been hindered by a lack of training data. The machine learning algorithms for crack identification are being refined but require improvements to the true positive rate for crack detection. This shortcoming is an artifact of the limited training data currently available, perhaps more so than the structure of the neural networks. At present, the best results are had from a consensus over an ensemble of randomly generated Deep Neural Network (DNN) or Convolutional Neural Network (CNN) algorithms. Although the consensus accuracy method has yielded optimum true positive and true negative rates in excess of 80%, additional validation testing is necessary. In addition to the suite of LCM data that was initially used, and which represents the majority of the work presented in this report, WAMS image data was also reviewed at a preliminary level. The review included a comparison between image resolution and dynamic range for each method. WAMS (ZON file) image data was found to have a pixel pitch of 3.69μm compared to 1 μm for the LCM (vk4 file) data, which implies a lower resolution for the WAMS images. Conversely, the ratio of dynamic range of the WAMS data to the LCM data was approximately 41:20 for height data, suggesting that information from WAMS should more accurately determine the depth of pits. At present, the significance of the greater dynamic range of the WAMS data relative to the LCM data has not yet been evaluated.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2019

Conditional Generative Adversarial Networks (cGANs) for Near Real-Time Precipitation Estimation from Multispectral GOES-16 Satellite Imageries—PERSIANN-cGAN

In this paper, we present a state-of-the-art precipitation estimation framework which leverages advances in satellite remote sensing as well as Deep Learning (DL). The framework takes advantage of the improvements in spatial, spectral and temporal resolutions of the Advanced Baseline Imager (ABI) onboard the GOES-16 platform along with elevation information to improve the precipitation estimates. The procedure begins by first deriving a Rain/No Rain (R/NR) binary mask through classification of the pixels and then applying regression to estimate the amount of rainfall for rainy pixels. A Fully Convolutional Network is used as a regressor to predict precipitation estimates. The network is trained using the non-saturating conditional Generative Adversarial Network (cGAN) and Mean Squared Error (MSE) loss terms to generate results that better learn the complex distribution of precipitation in the observed data. Common verification metrics such as Probability Of Detection (POD), False Alarm Ratio (FAR), Critical Success Index (CSI), Bias, Correlation and MSE are used to evaluate the accuracy of both R/NR classification and real-valued precipitation estimates. Statistics and visualizations of the evaluation measures show improvements in the precipitation retrieval accuracy in the proposed framework compared to the baseline models trained using conventional MSE loss terms. This framework is proposed as an augmentation for PERSIANN-CCS (Precipitation Estimation from Remotely Sensed Information using Artificial Neural Network- Cloud Classification System) algorithm for estimating global precipitation.

42 ENGINEERING↗
DOE OSTI2020

The Catalogue for Astrophysical Turbulence Simulations (CATS)

Turbulence is a key process in many fields of astrophysics. Advances in numerical simulations of fluids over the last several decades have revolutionized our understanding of turbulence and related processes such as star formation and cosmic ray propagation. However, data from numerical simulations of astrophysical turbulence are often not made public. We introduce a new simulation-oriented database for the astronomical community: the Catalogue for Astrophysical Turbulence Simulations (CATS), located at www.mhdturbulence.com. CATS includes magnetohydrodynamic (MHD) turbulent box simulation data products generated by the public codes athena++, arepo, enzo, and flash. CATS also includes several synthetic observational data sets, such as turbulent HI data cubes. We also include measured power spectra and three-point correlation functions from some of these data. We discuss the importance of open-source statistical and visualization tools for the analysis of turbulence simulations such as those found in CATS.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

Method and apparatus for offloading compute resources to a flash co-processing appliance

Solid-State Drive (SSD) burst buffer nodes are interposed into a parallel supercomputing cluster to enable fast burst checkpoint of cluster memory to or from nearby interconnected solid-state storage with asynchronous migration between the burst buffer nodes and slower more distant disk storage. The SSD nodes also perform tasks offloaded from the compute nodes or associated with the checkpoint data. For example, the data for the next job is preloaded in the SSD node and very fast uploaded to the respective compute node just before the next job starts. During a job, the SSD nodes perform fast visualization and statistical analysis upon the checkpoint data. The SSD nodes can also perform data reduction and encryption of the checkpoint data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

The Use of Unmanned Aerial Vehicles for Rapid and Repeatable 3D Radiological Site Characterization - 18352

As unmanned aerial vehicles (UAVs) are beginning to become heavily featured within a number of industries globally, the technology remains underutilized within the nuclear industry, particularly in routine monitoring investigations. Using a temporary Japanese waste storage facility (used to house topsoil contaminated with fallout from the Fukushima nuclear incident) as an analogy for a typical low-level waste repository (LLWR) site, the suitability of UAV-hosted radiation mapping systems for routine site investigations is evaluated. The criteria used to assess the performance of the custom UAV and commercial radiation mapping system focusses on the repeatability of both the flight and the produced radiation maps from two identical surveys at the chosen site. Additionally, the speed of deployment is assessed against the time taken to complete a walking survey of the site. The results indicate that the radiation maps derived from the two repeat surveys are directly comparable both visually and statistically, despite minor differences in the flight of the UAV between both surveys. Furthermore, the terrain independent nature of the airborne radiation mapping system meant that the time taken to complete the survey was reduced when compared with the similar resolution ground-based survey. The use of UAV-hosted radiation mapping systems therefore presents a powerful tool with which to rapidly complete routine radiological monitoring procedures within active nuclear environments. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2017

Statistical projections for multi-dimensional visual data exploration

When working with large, multidimensional and multivariate data, science users are frequently interested in understanding variation in data, as opposed to the actual data values. Our work focuses on exploring how a simple statistical metric, the Coefficient of Variation (or Cv), can be used in several different ways to facilitate understanding variation in large data. As a statistical measure, it offers a key advantage over more widely accepted measures like standard deviation, namely to its ability to capture local variation properties. As a multidimensional projection operator, Cv is an effective way of reducing data size while preserving the key variational signal. Visualizations produced from Cv that target conveying variation in data are highly informative, especially compared to those produced with more widely known methods. We demonstrate these ideas within the context of a two-part application case study focusing on understanding long-Term trends in the the changes in precipitation and winds in large-scale climate model ensemble output.

Nguyen, H↗
DOE OSTI2013

Trelliscope: A System for Detailed Visualization in Analysis of Large Complex Data

Visualization plays a critical role in the statistical model building and data analysis process. Data analysts, well-versed in statistical and machine learning methods, visualize data to hypothesize and validate models. These analysts need flexible, scalable visualization tools that are not decoupled from their analysis environment. In this paper we introduce Trelliscope, a visualization framework for statistical analysis of large complex data. Trelliscope extends Trellis, an effective visualization framework that divides data into subsets and applies a plotting method to each subset, arranging the results in rows and columns of panels. Trelliscope provides a way to create, arrange and interactively view panels for very large datasets, enabling flexible detailed visualization for data of any size. Scalability is achieved using distributed computing technologies coupled with . We discuss the underlying principles, design, and scalable architecture of Trelliscope, and illustrate its use on three analysis projects in the domains of proteomics, high energy physics, and power systems engineering.

Hafen, Ryan P.↗
DOE OSTI2017

Performance Analysis of Large Scale HPC Workflows for Earth System Models

Climate assessment reports, such as the Intergovernmental Panel on Climate Change’s 5th assesment report [IPCC AR5; IPCC et al., 2014] or the United States National Climate Assessment [U.S. Global Change Research Program, 2014], increasingly rely on many-ensemble climate projections from fully-coupled Earth system models (ESM) to asses possible future climate states. ESM participate in a large set of Coupled Model Intercomparson Projects (CMIP) to better understand their models and the climate system, so that they may provide credible climate projections. However, fully participating in these intercomparison exercises represents an extremely large computational personnel burden for modeling centers [Eyring et al., 2016, Williams et al., 2016a]. However, there has been little attention within the climate modeling community paid to the in situ performance of ESMs up until now. Recently a computational performance model intercomparison project (CPMIP) for CMIP6 has begun [Balaji et al., 2017], but there has not yet been an effort to gather, process, and analyze the historical performance data that has been saved within archived log files from previous modeling efforts, nor the development of performance analysis system capable of providing detailed statistical analyses or visualizations of this performance data. Therefore, we’ve begun a joint effort to analyze the historical and current performance data on both GFDL and OLCF modeling systems. Here, we have developed a preliminary performance analysis system to captue, analyize, and visualize end-to-end in situ performance data and applied it to NOAA/GFDL’s post-processing system. Through the course of the project a number of performance improvements have been made, with the steps necessary to handle the expected volume of data (Big Data) likely to come out of the CMIP6 exercises (TB to PB) provided. We have also begun developing a statistical workload model that will allow modeling centers to determined their expected scientific throughput in the context of expected resource (computational and personnel) availability and accounting for typical workflow disruptions. This will allow them to develop a CMIP participation strategy and maximize their level of participation in the exercises. We expect this infrastructure, and the data it produces, to ultimately allow us to identify performance issues and workflow errors that exist across Earth system modeling centers, and possibly HPC modeling centers in general. Center-independent solutions to workflow or performance issues would help alleviate the computational burden for CMIP6+ modeling projects and should realize both labor and cost savings benefits throughout the CMIP community.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

TU-CD-207-08: Intrinsic Image Quality Comparison of Synthesized 2-D and FFDM Images

Purpose: With the combined interest of managing patient dose, maintaining or improving image quality, and maintaining or improving the diagnostic utility of mammographic data, this study aims to compare the intrinsic image quality of Hologic’s synthesized 2-D (C-View) and 2-D FFDM images in terms of resolution, contrast, and noise. Methods: This study utilized a novel 3-D printed anthropomorphic breast phantom in addition to the American College of Radiology (ACR) mammography accreditation phantom. Analysis of the 3-D anthropomorphic phantom included visual assessment of resolution and analysis of the normalized noise power spectrum. Analysis of the ACR phantom included both visual inspection and objective automated analysis using in-house software. The software incorporates image- and object-specific CNR visibility thresholds which account for image characteristics such as noise texture which affect object visualization. T- test statistical analysis was also performed on ACR phantom scores. Results: The spatial resolution of C-View images is markedly lower (at least 50% worse) than that of FFDM. And while this is generally associated with the benefit of reduced relative noise magnitude, the noise in C-View images tends to have a more mottled (predominantly low-frequency) texture. In general, for high contrast objects, C-View provides superior visualization over FFDM; however this benefit diminishes for low contrast objects and is applicable only to objects that are sufficiently larger than the spatial resolution threshold. Based on both observer and automated ACR phantom analysis, between 50–70% of C-View images failed to meet ACR minimum accreditation requirements – primarily due to insufficient (unbroken) fiber visibility. Conclusion: Compared to FFDM, C-View offers better depiction of objects of certain size and contrast, but provides poorer overall resolution and noise properties. Based on these findings, the utilization of C-View images in the clinical setting requires careful consideration, especially if considering the discontinuation of FFDM imaging.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Entropy-driven melting point depression in fcc HEAs

High Entropy Alloys (HEAs) are an increasingly dominant alloy design paradigm. The premise of entropic stabilization of single-phase alloys has motivated much of the research on HEAs. Chemical complexity may indeed help stabilize single alloy phases relative to other lower-entropy competing solid phases. Paradoxically, this complexity may de-stabilize these alloys against the liquid phase, potentially limiting the application space of HEAs at elevated temperatures. In this work, we carry out a comprehensive investigation of the phase stability in the fcc CoCrFeMnNiV-Al HEA space using a state of the art CALPHAD database. By using modern visualization techniques and statistical analysis we examine the trade-off between chemical complexity and stability against the liquid state and identify a potentially difficult to overcome barrier for development of high temperature alloys, at least within the conventional fcc HEA space. Here, limited experimental data seem to be consistent with this analysis.

36 MATERIALS SCIENCE↗