Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “statistical visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2015

Formulas for Fast Computation of Divergence Statistics Applied to Quantitative Performance Analysis

In an earlier work, we reported on the extension to the statistical analysis capability of the Visualization Tool Kit (VTK), which we developed for the calculation of divergence statistics, with the particular aim of providing quantitative means for High Performance Computing (HPC) performance analysis, of which we provided an example as well as user's manual. However, we did not provide the mathematical foundations for this work. In the current report, we fill this void with the complete derivation of the formulas which we used in the divergence statistics engine. This provides the foundations for future work which will aim at generalizing these formulas for more detailed HPC performance analysis.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2006

Automated objective characterization of visual field defects in 3D

A method and apparatus for electronically performing a visual field test for a patient. A visual field test pattern is displayed to the patient on an electronic display device and the patient's responses to the visual field test pattern are recorded. A visual field representation is generated from the patient's responses. The visual field representation is then used as an input into a variety of automated diagnostic processes. In one process, the visual field representation is used to generate a statistical description of the rapidity of change of a patient's visual field at the boundary of a visual field defect. In another process, the area of a visual field defect is calculated using the visual field representation. In another process, the visual field representation is used to generate a statistical description of the volume of a patient's visual field defect.

Fink, Wolfgang↗
DOE OSTI2014

Bayesian Analysis of Congruence of Core Genes in Prochlorococcus and Synechococcus and Implications on Horizontal Gene Transfer

It is often suggested that horizontal gene transfer is so ubiquitous in microbes that the concept of a phylogenetic tree representing the pattern of vertical inheritance is oversimplified or even positively misleading. “Universal proteins” have been used to infer the organismal phylogeny, but have been criticized as being only the “tree of one percent.” Currently, few options exist for those wishing to rigorously assess how well a universal protein phylogeny, based on a relative handful of well-conserved genes, represents the phylogenetic histories of hundreds of genes. Here, we address this problem by proposing a visualization method and a statistical test within a Bayesian framework. We use the genomes of marine cyanobacteria, a group thought to exhibit substantial amounts of HGT, as a test case. We take 379 orthologous gene families from 28 cyanobacteria genomes and estimate the Bayesian posterior distributions of trees – a “treecloud” – for each, as well as for a concatenated dataset based on putative “universal proteins.” We then calculate the average distance between trees within and between all treeclouds on various metrics and visualize this high-dimensional space with non-metric multidimensional scaling (NMMDS). We show that the tree space is strongly clustered and that the universal protein treecloud is statistically significantly closer to the center of this tree space than any individual gene treecloud. We apply several commonly-used tests for incongruence/HGT and show that they agree HGT is rare in this dataset, but make different choices about which genes were subject to HGT. Our results show that the question of the representativeness of the “tree of one percent” is a quantitative empirical question, and that the phylogenetic central tendency is a meaningful observation even if many individual genes disagree due to the various sources of incongruence.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Quality Assurance and Quality Control (QA/QC) of Meteorological Time Series Data for Billy Barr, East River, Colorado USA

A comprehensive Quality Assurance (QA) and Quality Control (QC) statistical framework consists of three major phases: Phase 1—Preliminary raw data sets exploration, including time formatting and combining datasets of different lengths and different time intervals; Phase 2—QA of the datasets, including detecting and flagging of duplicates, outliers, and extreme values; and Phase 3—the development of time series of a desired frequency, imputation of missing values, visualization and a final statistical summary. The time series data collected at the Billy Barr meteorological station (East River Watershed, Colorado) were analyzed. The developed statistical framework is suitable for both real-time and post-data-collection QA/QC analysis of meteorological datasets.The files that are in this data package include one excel file, converted to CSV format (Billy_Barr_raw_qaqc.csv) that contains the raw meteorological data, i.e., input data used for the QA/QC analysis. The second CSV file (Billy_Barr_1hr.csv) is the QA/QC and flagged meteorological data, i.e., output data from the QA/QC analysis. The last file (QAQC_Billy_Barr_2021-03-22.R) is a script written in R that implements the QA/QC and flagging process. The purpose of the CSV data files included in this package is to provide input and output files implemented in the R script.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Challenging problems of quality assurance and quality control (QA/QC) of meteorological time series data

Abstract Representativeness and quality of collected meteorological data impact accuracy and precision of climate, hydrological, and biogeochemical analyses and predictions. We developed a comprehensive Quality Assurance (QA) and Quality Control (QC) statistical framework, consisting of three major phases: Phase I—Preliminary data exploration, i.e., processing of raw datasets, with the challenging problems of time formatting and combining datasets of different lengths and different time intervals; Phase II—QA of the datasets, including detecting and flagging of duplicates, outliers, and extreme data; and Phase III—the development of time series of a desired frequency, imputation of missing values, visualization and a final statistical summary. The paper includes two use cases based on the time series data collected at the Billy Barr meteorological station (East River Watershed, Colorado), and the Barro Colorado Island (BCI, Panama) meteorological station. The developed statistical framework is suitable for both real-time and post-data-collection QA/QC analysis of meteorological datasets.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1993

Analyzing High-Dimensional Multispectral Data

In this paper, through a series of specific examples, we illustrate some characteristics encountered in analyzing high- dimensional multispectral data. The increased importance of the second-order statistics in analyzing high-dimensional data is illustrated, as is the shortcoming of classifiers such as the minimum distance classifier which rely on first-order variations alone. We also illustrate how inaccurate estimation or first- and second-order statistics, e.g., from use of training sets which are too small, affects the performance of a classifier. Recognizing the importance of second-order statistics on the one hand, but the increased difficulty in perceiving and comprehending information present in statistics derived from high-dimensional data on the other, we propose a method to aid visualization of high-dimensional statistics using a color coding scheme.

Lee, Chulhee↗
NASA NTRS2014

A Cloud-Based Global Flood Disaster Community Cyber-Infrastructure: Development and Demonstration

Flood disasters have significant impacts on the development of communities globally. This study describes a public cloud-based flood cyber-infrastructure (CyberFlood) that collects, organizes, visualizes, and manages several global flood databases for authorities and the public in real-time, providing location-based eventful visualization as well as statistical analysis and graphing capabilities. In order to expand and update the existing flood inventory, a crowdsourcing data collection methodology is employed for the public with smartphones or Internet to report new flood events, which is also intended to engage citizen-scientists so that they may become motivated and educated about the latest developments in satellite remote sensing and hydrologic modeling technologies. Our shared vision is to better serve the global water community with comprehensive flood information, aided by the state-of-the- art cloud computing and crowdsourcing technology. The CyberFlood presents an opportunity to eventually modernize the existing paradigm used to collect, manage, analyze, and visualize water-related disasters.

CyberFlood↗
DOE OSTI2024

Consistent and reproducible computation of the glass transition temperature from molecular dynamics simulations

In many fields, from semiconductors for opto-electronic applications to ionic liquids (ILs) for separations, the glass transition temperature (Tg) of a material is a useful gauge for its potential use in practical settings. As a result, there is a great deal of interest in predicting Tg using molecular simulations. However, the uncertainty and variation in the trend shift method, a common approach in simulations to predict Tg, can be high. This is due to the need for human intervention in defining a fitting range for linear fits of density with temperature assumed for the liquid and glass phases across the simulated cooling. The definition of such fitting ranges then defines the estimate for the Tg as the intersection of linear fits. We eliminate this need for human intervention by leveraging the Shapiro–Wilk normality test and proposing an algorithm to define the fitting ranges and, consequently, Tg. Through this integration, we incorporate into our automated methodology that residuals must be normally distributed around zero for any fit, a requirement that must be met for any regression problem. Consequently, fitting ranges for realizing linear fits for each phase are statistically defined rather than visually inferred, obtaining an estimate for Tg without any human intervention. The method is also capable of finding multiple linear regimes across density vs temperature curves. We compare the predictions of our proposed method across multiple IL and semiconductor molecular dynamics simulation results from the literature and compare other proposed methods for automatically detecting Tg from density–temperature data. We believe that our proposed method would allow for more consistent predictions of Tg. We make this methodology available and open source through GitHub.

Chemistry↗
DOE OSTI2024

Atom Probe Tomography Investigation of Clustering in Model P 2 O 5 -Doped Borosilicate Glasses for Nuclear Waste Vitrification

Atom probe tomography (APT) has been utilized to investigate the microstructure of two model borosilicate glasses designed to understand the solubility limits of phosphorous pentoxide (P 2 O 5 ). This component is found in certain high-level radioactive defence wastes destined for vitrification, where phase separation can potentially lead to a number of issues relating to the processing of the glass and its long-term chemical and structural stability. The development of suitable focused ion beam (FIB)-preparation routes and APT analysis conditions were initially determined for the model glasses, before examining their detailed microstructures. In a 3.0 mol% P 2 O 5 -doped glass, both visual inspection and sensitive statistical analysis of the APT data show homogeneous microstructures, while raising the content to 4.0 mol% initiates the formation of phosphorus-enriched nanoscale precipitates. This study confirms the expected inhomogeneities and phase separation of these glasses and offers routes to characterizing these at near-atomic scale resolution using APT.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

In-Situ Characterization Tools for Evaluating Radiation Tolerance and Elemental Migration in Perovskites

This paper discusses the in-situ characterization tools designed to assess radiation tolerance and elemental migration in perovskite materials. With the increasing use of perovskites in various technological applications, understanding their response to radiation exposure is paramount. Ion Beam Induced Charge (IBIC) emerges as a powerful tool for investigating the radiation tolerance of perovskites at the microscale. By employing focused ion beams, IBIC allows for the spatial mapping of charge carriers, offering insights into the material's electronic response to radiation-induced defects. This technique enables researchers to pinpoint areas of enhanced or suppressed charge collection, providing valuable information on the perovskite's intrinsic properties under irradiation. Rutherford Backscattering Spectrometry (RBS) complements the study by offering a quantitative analysis of elemental migration in perovskite materials. Through the precise measurement of backscattered ions, RBS provides a detailed understanding of the elemental composition and distribution within the perovskite lattice after radiation exposure. The integration of IBIC and RBS techniques in in-situ experiments enhances the comprehensive characterization of radiation effects on perovskites.

ion beams↗
DOE OSTI2018

WebGIobe - A cloud-based geospatial analysis framework for interacting with climate data

While climate models have evolved over time to produce high fidelity and high resolution climate forecasts, visualization and analysis of the output of the model simulations has been limited, typically constrained to single dimensional charts for visualization and basic aggregate statistics for analytics. Same is true for the large troves of observational data available from meteorological stations all over the world. For richer understanding of climate and the impact of climate change, one needs computational tools that allow researchers, policymakers, and general public, to interact with the climate data. In this paper, we describe, webGlobe, a browser based GIS framework for interacting with climate data, and other datasets available in similar format. webGlobe is a unique resource that allows unprecedented access to climate data through a browser. The framework also allows for deploying machine learning based analytical applications on the climate data without putting computational burden on the client. Instead, webGlobe uses a client-server framework, where the server, deployed on a cloud infrastructure, allows for dynamic allocation of resources for running compute-intensive applications. The capabilities of the framework will be discussed in context of a use case: identifying extreme events from real and simulated climate data using a Gaussian process based change detection algorithm.

Sharma, Arun↗
DOE OSTI2018

jansson_snijders_collaborative_cross

This is supplemental material for a scientific paper. This project 'bernstein-2017-founders-species', explores community succession using a lake biofilm as a model. The code here was used to process and analyze environmental metadata and genetic sequencing data. Statistical tests and data visualization are included. This code makes use of commodity software that is freely available and commonly used in this field. No new methods or techniques are introduced in this code.

Brislawn, Colin↗
DOE OSTI2023

Machine-learning-assisted analysis of transition metal dichalcogenide thin-film growth

In situ reflective high-energy electron diffraction (RHEED) is widely used to monitor the surface crystalline state during thin-film growth by molecular beam epitaxy (MBE) and pulsed laser deposition. With the recent development of machine learning (ML), ML-assisted analysis of RHEED videos aids in interpreting the complete RHEED data of oxide thin films. The quantitative analysis of RHEED data allows us to characterize and categorize the growth modes step by step, and extract hidden knowledge of the epitaxial film growth process. In this study, we employed the ML-assisted RHEED analysis method to investigate the growth of 2D thin films of transition metal dichalcogenides (ReSe2) on graphene substrates by MBE. Principal component analysis (PCA) and K-means clustering were used to separate statistically important patterns and visualize the trend of pattern evolution without any notable loss of information. Using the modified PCA, we could monitor the diffraction intensity of solely the ReSe2 layers by filtering out the substrate contribution. These findings demonstrate that ML analysis can be successfully employed to examine and understand the film-growth dynamics of 2D materials. Further, the ML-based method can pave the way for the development of advanced real-time monitoring and autonomous material synthesis techniques.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Integrated photonic Galton board and its application for photon counting

The Galton board is a desktop probability machine traditionally used to visualize the principles of statistical physics from classical particles. Here, we demonstrate a photonic Galton board that enables on-chip observation of statistics from single-photon interference. The photonic Galton board consists of a directional coupler matrix terminated by an array of superconducting nanowire detectors to provide spatiotemporal resolution. This design also allows for photon-number-resolving capability, making it suitable for high-speed photon counting. Our results demonstrate the compatibility between single-photon detector array and photonic integrated circuits, paving the way for implementing on-chip large-scale quantum optics experiments and photonic quantum computing.

Qin, Hezheng (ORCID:0009000139348800)↗
DOE OSTI2019

Full Integration of Lipidomics Data into Multi-OMIC Functional Enrichment

Lipids have numerous roles critical to living systems. Many of these vital functions are tightly linked or regulated by proteins. Even though the function of many lipid-related enzymes is known, direct links between most individual lipid species and the enzymes that metabolize them are severely lacking. This missing connection impedes biological progress. A resource that allows users to quickly identify protein-lipid relationships will advance our understanding of lipid homeostasis and metabolic perturbed systems. Databases are readily available for mapping small molecule metabolites (i.e., polar metabolites) and specific oxidized fatty acid lipids (e.g., arachidonic acid derivatives) to proteins/enzymes known to be directly involved in metabolism of these molecules (e.g. SMPDB, Reactome, HMDB, BioCyc). This enables the integration of metabolite and protein (as well as transcript) data when performing functional enrichment and metabolic modeling allowing researchers to rapidly examine metabolic pathways from multiple omics sources. Currently, linking lipidomics data with proteomics data is conducted using a time-intensive, user defined, manual process. Here we propose creating a tool that will link lipidomics and proteomics data and also conduct functional enrichment analysis and visualization allowing for full statistical integration. Using text-mining approaches, we will extract lipid references from uniprot and create a database linking lipid species to enzymes directly related to their metabolism. We will also extract directional annotation, which will allow even greater specificity when linking data types and will help eliminate false positives from functional associations.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2015

Kelvin Probe Force Microscopy in liquid using Electrochemical Force Microscopy

Conventional closed loop-Kelvin probe force microscopy (KPFM) has emerged as a powerful technique for probing electric and transport phenomena at the solid-gas interface. The extension of KPFM capabilities to probe electrostatic and electrochemical phenomena at the solid–liquid interface is of interest for a broad range of applications from energy storage to biological systems. However, the operation of KPFM implicitly relies on the presence of a linear lossless dielectric in the probe-sample gap, a condition which is violated for ionically-active liquids (e.g., when diffuse charge dynamics are present). Here, electrostatic and electrochemical measurements are demonstrated in ionically-active (polar isopropanol, milli-Q water and aqueous NaCl) and ionically-inactive (non-polar decane) liquids by electrochemical force microscopy (EcFM), a multidimensional (i.e., bias- and time-resolved) spectroscopy method. In the absence of mobile charges (ambient and non-polar liquids), KPFM and EcFM are both feasible, yielding comparable contact potential difference (CPD) values. In ionically-active liquids, KPFM is not possible and EcFM can be used to measure the dynamic CPD and a rich spectrum of information pertaining to charge screening, ion diffusion, and electrochemical processes (e.g., Faradaic reactions). EcFM measurements conducted in isopropanol and milli-Q water over Au and highly ordered pyrolytic graphite electrodes demonstrate both sample- and solvent-dependent features. Finally, the feasibility of using EcFM as a local force-based mapping technique of material-dependent electrostatic and electrochemical response is investigated. The resultant high dimensional dataset is visualized using a purely statistical approach that does not require a priori physical models, allowing for qualitative mapping of electrostatic and electrochemical material properties at the solid–liquid interface.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2014

ORBiT - The Oak Ridge Biosurveillance Toolkit

We describe ORBiT, the Oak Ridge Biosurveillance Toolkit, the objective of which is to provide 1) forecasting and early warning, and 2) an extensible data analytics platform for biosurveillance by enabling the use of traditional and non-traditional datasets, consisting of heterogeneous data types and modalities. ORBiT includes a data collection interface, analytic components, higher-order statistical tools, and a visual front-end with visual analytics. ORBiT is implemented as a distributed analytic platform consisting of a software stack atop of Hadoop and uses Titan, a distributed graph database as a backend for data storage.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1973

Multispectral combination and display of ERTS-1 data

A significant problem in the use of ERTS-1 data is the extraction of information pertinent to each application and the presentation of that information in a form most suitable to users. When the information is to be displayed for visual study by an observer, the problem can be reduced to two steps: (1) Dimensionality reduction, an objective procedure which attempts to preserve most of the ERTS-1 information in a smaller number of components. (2) Display of the reduced number of components for optimum visibility by an observer. A specific dimensionality reduction technique has been applied to ERTS-1 data for several geographical areas in California and distinct types of earth resources. In the display of the reduced number of components, consideration has to be given to properties of the human visual system and the statistics of the data to be displayed. Previous work on digital image enhancement was applied to this problem to generate color composites which contain and display most of the information provided by the ERTS-1 sensors. Results of this approach were interesting, both in terms of the small mean-square caused by the dimensionality reduction, as well as for the examples of enhanced images that have been obtained.

Algazi, V. R.↗