Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Visual Analytics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2014

Web-Based Geographic Information System Tool for Accessing Hanford Site Environmental Data

Data volume, complexity, and access issues pose severe challenges for analysts, regulators and stakeholders attempting to efficiently use legacy data to support decision making at the U.S. Department of Energy’s (DOE) Hanford Site. DOE has partnered with the Pacific Northwest National Laboratory (PNNL) on the PHOENIX (PNNL-Hanford Online Environmental Information System) project, which seeks to address data access, transparency, and integration challenges at Hanford to provide effective decision support. PHOENIX is a family of spatially-enabled web applications providing quick access to decades of valuable scientific data and insight through intuitive query, visualization, and analysis tools. PHOENIX realizes broad, public accessibility by relying only on ubiquitous web-browsers, eliminating the need for specialized software. It accommodates a wide range of users with intuitive user interfaces that require little or no training to quickly obtain and visualize data. Currently, PHOENIX is actively hosting three applications focused on groundwater monitoring, groundwater clean-up performance reporting, and in-tank monitoring. PHOENIX-based applications are being used to streamline investigative and analytical processes at Hanford, saving time and money. But more importantly, by integrating previously isolated datasets and developing relevant visualization and analysis tools, PHOENIX applications are enabling DOE to discover new correlations hidden in legacy data, allowing them to more effectively address complex issues at Hanford.

decision support↗
DOE OSTI2024

Quantifying Uncertainty in HPC Job Queue Time Predictions

High Performance Computing (HPC) has developed at an unprecedented pace in recent decades. This growth has demanded corresponding development in the area of HPC Operational Data Analytics (ODA), which encompasses a wide range of data analysis techniques, ML/AI efforts, tools, and visualizations. Published studies in ODA offer a variety of practical ways to inform HPC users, administrators, procurement managers, and other stakeholders. Uncertainty analysis, however, is rare in the related published literature. For instance, we identify only 1 out of 14 existing studies focused on job queue time prediction that investigates the uncertainty aspect of their proposed predictions. We recognize the utmost importance uncertainty quantification can have in such predictive analytics solutions, with consequences in how users interpret information they receive, and attempt to bridge this gap. With the goal of improving access to such insights, we develop a process for determining upper and lower bounds of the predicted queue times of a regression model at a specified confidence level. Our current research is focused on the uncertainty in predicting job queue times, yet our approach may be employed in predicting other metrics.

HPC↗
DOE OSTI2022

Approach to using 3D laser-induced breakdown spectroscopy (LIBS) data to explore the interaction of FLiNaK and FLiBe molten salts with nuclear-grade graphite

Nuclear graphite has historically been a key component of many nuclear reactor designs and has emerged as key to numerous advanced nuclear reactor design concepts. Molten salt reactors (MSRs) are one broad group of advanced reactor designs currently being pursued by industry for commercialization. Several MSR designs under consideration use graphitic materials that directly interface with a molten salt, whether it is a fuel salt, coolant salt, or both. Therefore, the interaction of graphite materials with molten salts must be understood. To gain this required understanding, a range of data is needed including porosity, strength, and composition as a function of different salt exposure parameters. In this study, a laser-induced breakdown spectroscopy (LIBS) measurement and data analysis methodology was developed to obtain spatially resolved elemental composition information for graphite samples exposed to a molten fluoride salt. Traditional univariate emission line analysis of atomic, ionic, and molecular optical emission signals was coupled via correlation analysis with spectral decomposition of the data using principal component analysis. Elemental depth profiling and elemental mapping were also performed to visualize salt–graphite interactions. LIBS was demonstrated to be useful for measuring key analytes such as fluorine and hydrogen, which are troublesome for other analysis techniques. Evidence for complex behavior was found, thereby demonstrating the usefulness of the developed approach for future systematic studies.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Basics of the scanning electrochemical microscope and its application in the characterization of lithium-ion batteries: a brief review

A scanning electrochemical microscope (SECM) can directly monitor electrochemical processes at interfaces of electrodes and electrolytes and has been used as an analytical tool for lithium-ion battery (LIB) studies. Through SECM, we can visualize the electrochemical reactivities of active species in LIBs in-situ during cycling. This review begins with introducing SECM-based LIB research and then summarizes the working mechanism and operating modes of the technique as well as combinations of SECM with other techniques for LIB studies. We review the results with a focus on the interfacial properties, surface reactions and electrochemical activity of different electrode materials for LIBs. The investigations of battery degradation, kinetic parameters and electrolyte swelling by SECM are also discussed. Finally, the current limitations and perspectives are also described regarding future developments.

25 ENERGY STORAGE↗
DOE OSTI2017

Build and Execute Environment

At exascale, the challenge becomes to develop applications that run at scale and use exascale platforms reliably, efficiently, and flexibly. Workflows become much more complex because they must seamlessly integrate simulation and data analytics. They must include down-sampling, post-processing, feature extraction, and visualization. Power and data transfer limitations require these analysis tasks to be run in-situ or in-transit. We expect successful workflows will comprise multiple linked simulations along with tens of analysis routines. Users will have limited development time at scale and, therefore, must have rich tools to develop, debug, test, and deploy applications. At this scale, successful workflows will compose linked computations from an assortment of reliable, well-defined computation elements, ones that can come and go as required, based on the needs of the workflow over time. We propose a novel framework that utilizes both virtual machines (VMs) and software containers to create a workflow system that establishes a uniform build and execution environment (BEE) beyond the capabilities of current systems. In this environment, applications will run reliably and repeatably across heterogeneous hardware and software. Containers, both commercial (Docker and Rocket) and open-source (LXC and LXD), define a runtime that isolates all software dependencies from the machine operating system. Workflows may contain multiple containers that run different operating systems, different software, and even different versions of the same software. We will run containers in open-source virtual machines (KVM) and emulators (QEMU) so that workflows run on any machine entirely in user-space. On this platform of containers and virtual machines, we will deliver workflow software that provides services, including repeatable execution, provenance, checkpointing, and future proofing. We will capture provenance about how containers were launched and how they interact to annotate workflows for repeatable and partial re-execution. We will coordinate the physical snapshots of virtual machines with parallel programming constructs, such as barriers, to automate checkpoint and restart. We will also integrate with HPC-specific container runtimes to gain access to accelerators and other specialized hardware to preserve native performance. Containers will link development to continuous integration. When application developers check code in, it will automatically be tested on a suite of different software and hardware architectures.

Guan, Qiang↗
DOE OSTI2022

MPC4CLR (Model-Predictive-Control-for-Critical-Load-Restoration-in-Power-Distribution-Systems) [SWR-22-24]

Model predictive control (MPC) is a system or process control technique for making decisions under uncertainty via rolling look-ahead optimizations at each control step where only the current step decisions are applied, and the rest are discarded. In this work, we developed an MPC for a critical load restoration (CLR) in power distribution systems to recover system service (electricity delivery) following an extreme event-triggered substation outage. The method considers the problem of controlling distributed energy resources (DERs) of the distribution system with the objective of achieving maximum load pick up while satisfying distribution network flow and voltage constraints. A linearized optimal power flow (OPF) model is employed to represent the physics of the network. The problem formulation is augmented with a ramping (up) reserve product for the DERs to ensure improved and upward monotonic load restoration as time evolves. Simulation analysis and performance tests are performed using a modified IEEE 13-bus test feeder integrated with wind, solar, microturbine, and energy storage battery. The software is developed using various software packages in Julia and Python. The MPC model is implemented using the JuMP optimization language in Julia while the data analytics including renewable generation and load demand forecasts, running the MPC simulation and visualizations is performed in Python.

Eseye, Abinet Tesfaye↗
DOE OSTI2017

Build and Execute Environment

At exascale, the challenge becomes to develop applications that run at scale and use exascale platforms reliably, efficiently, and flexibly. Workflows become much more complex because they must seamlessly integrate simulation and data analytics. They must include down-sampling, post-processing, feature extraction, and visualization. Power and data transfer limitations require these analysis tasks to be run in-situ or in-transit. We expect successful workflows will comprise multiple linked simulations along with tens of analysis routines. Users will have limited development time at scale and, therefore, must have rich tools to develop, debug, test, and deploy applications. At this scale, successful workflows will compose linked computations from an assortment of reliable, well-defined computation elements, ones that can come and go as required, based on the needs of the workflow over time. We propose a novel framework that utilizes both virtual machines (VMs) and software containers to create a workflow system that establishes a uniform build and execution environment (BEE) beyond the capabilities of current systems. In this environment, applications will run reliably and repeatably across heterogeneous hardware and software. Containers, both commercial (Docker and Rocket) and open-source (LXC and LXD), define a runtime that isolates all software dependencies from the machine operating system. Workflows may contain multiple containers that run different operating systems, different software, and even different versions of the same software. We will run containers in open-source virtual machines (KVM) and emulators (QEMU) so that workflows run on any machine entirely in user-space. On this platform of containers and virtual machines, we will deliver workflow software that provides services, including repeatable execution, provenance, checkpointing, and future proofing. We will capture provenance about how containers were launched and how they interact to annotate workflows for repeatable and partial re-execution. We will coordinate the physical snapshots of virtual machines with parallel programming constructs, such as barriers, to automate checkpoint and restart. We will also integrate with HPC-specific container runtimes to gain access to accelerators and other specialized hardware to preserve native performance. Containers will link development to continuous integration. When application developers check code in, it will automatically be tested on a suite of different software and hardware architectures.

Guan, Qiang↗
DOE OSTI2015

Radiological data consolidation and 3D modeling of a building - 15473

A portion of a building at an industrial facility that conducted monazite sands-processing operations in the 1950's under contract to the Atomic Energy Commission (AEC) became contaminated. Subsequently the U.S. Department of Energy designated the facility for remedial action under the Formerly Used Sites Remedial Action Program (FUSRAP). Remedial investigation, remedial actions and post-remediation surveys have been conducted in portions of the building. Radiological data for the interior of the building were compiled, evaluated and presented in a three dimensional (3-D) model (the model) created by AMEC Foster Wheeler in order to identify areas that meet the Record of Decision (ROD) cleanup criteria, and identity areas that may require remedial action or may require additional investigation due to data gaps. The data from different phases of investigation and remediation cover different portions of the building and in some cases overlap. In addition, the data were collected over a period of more than ten years, for different objectives, and thus the instruments and methods for establishing efficiency were not necessarily consistent. The data consolidation process included determining the relative quality of data points to include in the model and the development of rationale associated with assigning a quality level (i.e. ranking) to each data point. The rationale for ranking data quality included, as the primary determining factors, chronological order of the data (most recent was ranked as more reliable), certainty of the sample locations within the building, and analytical data quality. A 3-D model of the building was created using a laser point cloud scan which was then converted into a 3-D design model. Sample locations were then entered into the model and linked with the analytical database to allow display of the radiological results in the model. The visual model allows both strategic and tactical decisions to be made, depending on the level of detail examined. The evaluation process allowed maximum use of the historical data set, rather than requiring older data to be disregarded, and provided at a minimum a qualitative sense of data quality/confidence in the data. The (authors)process also highlights the importance of collecting high quality data from the very beginning with a consistent locational coordinate system, and the need for a good visualization model in order to assess contaminant locations during remedial action or post-remediation surveys.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2014

Electrodynamics of a ring-shaped spiral resonator

We present analytical, numerical, and experimental investigations of electromagnetic resonant modes of a compact monofilar Archimedean spiral resonator shaped in a ring, with no central part. Planar spiral resonators are interesting as components of metamaterials for their compact deep-subwavelength size. Such resonators couple primarily to the magnetic field component of the incident electromagnetic wave, offering properties suitable for magnetic meta-atoms. Surprisingly, the relative frequencies of the resonant modes follow the sequence of the odd numbers as f{sub 1}:f{sub 2}:f{sub 3}:f{sub 4}… = 1:3:5:7…, despite the nearly identical boundary conditions for electromagnetic fields at the extremities of the resonator. In order to explain the observed spectrum of resonant modes, we show that the current distribution inside the spiral satisfies a particular Carleman type singular integral equation. By solving this equation, we obtain a set of resonant frequencies. The analytically calculated resonance frequencies and the current distributions are in good agreement with experimental data and the results of numerical simulations. By using low-temperature laser scanning microscopy of a superconducting spiral resonator, we compare the experimentally visualized ac current distributions over the spiral with the calculated ones. Theory and experiment agree well with each other. Our analytical model allows for calculation of a detailed three-dimensional magnetic field structure of the resonators.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2015

Knowledge management information tool analytics with distributed database engine - 15737

The D and D KM-IT is a web-based knowledge management information tool custom built for the deactivation and decommissioning (D and D) user community. The system allows interested users to post information which goes through a custom work flow. To better improve the performance and user experience, the analysis of server logs is being conducted using MongoDB. MongoDB is a document database that provides high performance, high availability, and easy scalability. Objectives: - Feasibility study of Distributed Database Engine, MongoDB for web analytics; - Analyze server logs to evaluate D and D KM-IT module usage; - Generate useful information from the analysis. Method: - The server logs were loaded and stored in MongoDB for analysis; - Analysis and visualization was performed using NodeJS and Java Script library. Results: - It was possible to store log files in MongoDB; - Log files with different time stamps and groups from different servers can be aggregated; - Queries can be written to extract meaningful information from aggregated log files (e.g. users from different countries/organizations). Conclusions: - MongoDB is useful for server log analytics as the analyst can immediately access, analyze, and visualize MongoDB data based on the requirements; - The information can be extracted to develop custom reports; - Optimized queries can be run for fast data access. Path forward: - Custom queries need to be developed to extract information leading to improved user information.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2019

Cumulative Spatial Impact Layers™

Cumulative Spatial Impact Layers™ (CSIL) is a GIS-based tool that summarizes spatio-temporal datasets based on overlapping features and attributes. Applying a recursive quadtree method and multiple additive frameworks, the CSIL tool allows users to analyze raster and vector datasets simultaneously by calculating data, record, or attribute density. The CSIL tool was designed based on the original approach (Bauer et al. 2015) and more information on the tool overall along with applications can be found in Romeo et al. 2019). Providing an efficient summary of disparate geospatial data, CSIL bridges the gap between understanding data and analysis. Bauer, J. R., Nelson, J., Romeo, L., Eynard, J., Sim, L., Halama, J., Rose, K., & Graham, J. (2015). A spatio-temporal approach to analyze broad risks and potential impacts associated with uncontrolled hydrocarbon release events in the offshore Gulf of Mexico (NETL-TRS-2-2015 EPAct Technical Report Series). U.S. Department of Energy, National Energy Technology Laboratory: Morgantown, WV; p 60. Romeo, L., Nelson, J., Wingo, P., Bauer, J., Justman, D., & Rose, K. (2019). Cumulative spatial impact layers: A novel multivariate spatio-temporal analytical summarization tool. Transactions in GIS.

Multivariate Visualization↗
DOE OSTI2020

Open Chemistry, JupyterLab, REST, and quantum chemistry

Quantum chemistry must evolve if it wants to fully leverage the benefits of the internet age, where the worldwide web offers a vast tapestry of tools that enable users to communicate and interact with complex data at the speed and convenience of a button press. The Open Chemistry project has developed an open-source framework that offers an end-to-end solution for producing, sharing, and visualizing quantum chemical data interactively on the web using an array of modern tools and approaches. These tools build on some of the best open-source community projects such as Jupyter for interactive online notebooks, coupled with 3D accelerated visualization, state-of-the-art computational chemistry codes including NWChem and Psi4, and emerging machine learning and data mining tools such as ChemML and ANI. They offer flexible formats to import and export data, along with approaches to compare computational and experimental data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Introducing Molecular Hypernetworks for Discovery in Multidimensional Metabolomics Data

Orthogonal separations of data from high-resolution mass spectrometry can provide insight into sample composition and address challenges of complete annotation of molecules in untargeted metabolomics. “Molecular networks” (MNs), as used in the Global Natural Products Social Molecular Networking platform, are a prominent strategy for exploring and visualizing molecular relationships and improving annotation. MNs are mathematical graphs showing the relationships between measured multidimensional data features. MNs also show promise for using network science algorithms to automatically identify targets for annotation candidates and to dereplicate features associated with a single molecular identity. Here, this paper introduces “molecular hypernetworks” (MHNs) as more complex MN models able to natively represent multiway relationships among observations. Compared to MNs, MHNs can more parsimoniously represent the inherent complexity present among groups of observations, initially supporting improved exploratory data analysis and visualization. MHNs also promise to increase confidence in annotation propagation, for both human and analytical processing. We first illustrate MHNs with simple examples, and build them from liquid chromatography- and ion mobility spectrometry-separated MS data. We then describe a method to construct MHNs directly from existing MNs as their “clique reconstructions”, demonstrating their utility by comparing examples of previously published graph-based MNs to their respective MHNs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Comparing Mapper Graphs of Artificial Neuron Activations

The mapper graph is a popular tool from topological data analysis that provides a graphical summary of point cloud data. It has been used to study data from cancer research, sports analytics, neurosciences, and machine learning. In particular, mapper graphs have been used recently to visualize the topology of high-dimensional artificial neural activations from convolutional neural networks and large language models. However, a key question that arises from using mapper graphs across applications is how to compare mapper graphs to study their structural differences. In this paper, we introduce a distance between mapper graphs using tools from optimal transport. We demonstrate the utility of such a distance by studying the topological changes of neural activations across convolutional layers in deep learning, as well as by capturing the loss of structural information for multiscale mapper.

mapper graphs, computational topology, machine lea↗
DOE OSTI2024

WELLBASE - An Interactive Platform for Wellbore Material Assessment

This project seeks to build an open-source wellbore material data repository with adequate material performance and contextual data to support Geological Carbon Storage (GCS). By appropriately evaluating the data types as mentioned earlier made available by the WELLBASE tool, stakeholders can make more informed decisions regarding well selections, risk assessment, and economic analysis for geologic carbon storage projects. Advanced Natural Language Processing models and other custom python scripts will be deployed in an automated process to extract unstructured data from documents, reports, and web applications and subsequently parse to more usable formats. The processed data will then be integrated into a robust and comprehensive database architecture, optimizing data accessibility, and usability for analytical purposes. The final data products will be accessible through a user-friendly visualization platform that will allow users to query and visualize the data, as well as download data in usable formats.

Tetteh, Daniel A.↗
DOE OSTI2025

Leveraging AI and Spatial Data to Unlock Pipeline Integrity Insights: NETL’s Advanced Infrastructure Integrity Model (AIIM)

Maintaining the integrity of natural gas infrastructure plays a critical role in ensuring energy security. Robust, data-driven foundational AI models for pipeline integrity can help address risk management and mitigation issues. Trusted foundational models can help with industry adoption and accelerate innovation by enhancing integrity predictions, reduce costs, and informing infrastructure build-out. The AIIM dashboard was released in 2022 and utilizes multi-ML models for ensemble-type insights. It was expanded to include analytics on reported incidents. It was developed as an ESRI Dashboard to support data visualization & interrogation and contains pipeline data and model results.

Advanced Infrastructure Integrity Model (AIIM)↗
DOE OSTI2026

UCB-GLOBES: An open-access mass spectral database of identified and unidentified atmospheric organic compounds

Chemical characterization of atmospheric organic aerosols using gas chromatography with 70 eV electron ionization mass spectrometry (GC/EI-MS) has been used for decades in advancing molecular marker detection and identification, though primarily through suspect screening and/or targeted analyses. To advance non-targeted analyses of environmental samples, we have catalogued approximately 27 000 mass spectra (MS) of the trimethylsilyl derivatives of semi-volatile organic aerosol (OA) analytes in the open-access University of California Berkeley Goldstein Library of Organic Biogenic Environmental Spectra (UCB-GLOBES). Analytes were observed in ambient samples from the U.S. and the Central Amazon and/or laboratory simulations of secondary OA (SOA) formation. These samples are representative of OA under urban and biomass burning influences as well as SOA derived from biogenic precursors (e.g., isoprene, monoterpenes, sesquiterpenes) and biomass burning intermediates. MS are documented in UCB-GLOBES without regard to known chemical identity, annotated with extensive metadata such as sample source/experimental conditions, any structural information gained from MS analyses, and predicted chemical properties such as average carbon oxidation state and carbon number. UCB-GLOBES MS are compatible for importing into the NIST MS Search program, and we have also provided a Jupyter Notebook for MS visualization and comparisons. We demonstrate the utility of UCB-GLOBES through MS reanalyses of prior analytes observed in ambient data, finding a 20 % reduction in the number of analytes assigned to OA source categories reliant solely on time series correlation and an overall 11 % increase in new MS-based OA source categorization for the Southeast U.S. For 1513 analytes observed previously in the Central Amazon, we found 375 MS matches using UCB-GLOBES vs. 136 MS matches during prior analyses, representing a 14 % gain in newly confirmed or newly categorized OA species. While OA from laboratory oxidation experiments in UCB-GLOBES are highly diverse chemically, on average only 29 % of UCB-GLOBES MS have a mass spectral match to another MS entry in UCB-GLOBES and/or in databases of known compounds (i.e. NIST MS Database, Adams Essential Oil, MANE Flavor and Fragrance Company). This indicates that roughly 70 % of UCB-GLOBES MS are unique thus far, not observed more than once among the laboratory oxidation samples and ambient data in UCB-GLOBES MS. Further, only 18 % can be positively identified using these databases or known authentic standards. This points to a large gap between these laboratory simulations and ambient OA. Overall, the UCB-GLOBES database can be utilized for improving confidence in OA source categorization and/or identification, novel chemical marker discovery, tracking chemical diversity, de novo structure and properties prediction, and improving MS search and matching algorithms. This can ultimately inform future research priorities for the chemical characterization of atmospheric organic samples.

Mass spectrometry↗
DOE OSTI2017

Helium Ion Microscopy for Imaging and Quantifying Porosity at the Nanoscale

Nanoporous materials are essential components in a vast number of applications from energy to drug delivery and to agriculture. Yet, the number of ways to analytically quantify the salient features of these materials, for example: surface structure, pore shape, and size, remain limited. The most common approach is gas absorption, where volumetric gas absorption and desorption are measured. This technique has some fundamental drawbacks such as low sample throughput and a lack of direct surface visualization. In this work, we demonstrate Helium Ion Microscopy (HIM) as a tool for imaging and quantification of pores in industrially relevant SiO 2 catalyst supports. We start with the fundamental principles of ion-sample interaction, and build on this knowledge to experimentally observe and quantify surface pores by using the HIM and image data analytics. We contrast our experimental results to gas absorption and demonstrate full statistical agreement between two techniques. The principles surrounding the theoretical, experimental, and analytical framework presented herein offer an automated framework for visualization and quantification of pore structures in a wide variety of materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗