Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Visualization & Storage”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

System and method of managing large data files

Disclosed are systems and software that provide a high-performance, extensible file format and web API for remote data access and a visual interface for data viewing, query, and analysis. The described system can support storage of raw spectroscopic data such as neural recording data, MSI data, metadata, and derived analyses in a single, self-describing format that may be compatible by a large range of analysis software.

Bowen, Benjamin P.↗

ADIOS Visualization Schema: A First Step Towards Improving Interdisciplinary Collaboration in High Performance Computing

Scientific communities have benefitted from a significant increase of available computing and storage resources in the last few decades. For science projects that have access to leadership scale computing resources, the capacity to produce data has been growing exponentially. Teams working on such projects must now include, in addition to the traditional application scientists, experts in various disciplines including applied mathematicians for development of algorithms, visualization specialists for large data, and I/O specialists. Sharing of knowledge and data is becoming a requirement for scientific discovery, providing useful mechanisms to facilitate this sharing is a key challenge for e-Science. Our hypothesis is that in order to decrease the time to solution for application scientists we need to lower the barrier of entry into related computing fields. We aim at improving users' experience when interacting with a vast software ecosystem and/or huge amount of data, while maintaining focus on their primary research field. In this context we present our approach to bridge the gap between the application scientists and the visualization experts through a visualization schema as a first step and proof of concept for a new way to look at interdisciplinary collaboration among scientists dealing with big data. The key to our approach is recognizing that our users are scientists who mostly work as islands. They tend to work in very specialized environment but occasionally have to collaborate with other researchers in order to take full advantage of computing innovations and get insight from big data. We present an example of identifying the connecting elements between one of such relationships and offer a liaison schema to facilitate their collaboration.

Computer Science↗

Computer-aided discovery of a metal–organic framework with superior oxygen uptake

Current advances in materials science have resulted in the rapid emergence of thousands of functional adsorbent materials in recent years. This clearly creates multiple opportunities for their potential application, but it also creates the following challenge: how does one identify the most promising structures, among the thousands of possibilities, for a particular application? Here, we present a case of computer-aided material discovery, in which we complete the full cycle from computational screening of metal–organic framework materials for oxygen storage, to identification, synthesis and measurement of oxygen adsorption in the top-ranked structure. We introduce an interactive visualization concept to analyze over 1000 unique structure–property plots in five dimensions and delimit the relationships between structural properties and oxygen adsorption performance at different pressures for 2932 already-synthesized structures. We also report a world-record holding material for oxygen storage, UMCM-152, which delivers 22.5% more oxygen than the best known material to date, to the best of our knowledge.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

In Operando Visualization of the Electrochemical Formation of Liquid Polybromide Microdroplets

Abstract Zinc–bromine flow batteries are promising for stationary energy storage, and bromine‐complexing agents have been used to form phase‐separated liquid polybromide products. However, an understanding of the dynamics of polybromide nucleation is limited due to the beam sensitivity and complexity of polybromides. Here we report an in operando platform composed of dark‐field light microscopy and a transparent electrochemical cell to reveal the dynamics of polybromide formation in their native environment. Using our platform, we confirm and reveal the liquid nature, chemical composition, pinning effect (strong interaction with Pt), residual effect (residual charge products on the surface), self‐discharging, and over‐oxidation of the polybromide products. The results provide insights into the role of complexing agents and guide the future design of zinc–bromine flow batteries. Furthermore, our in operando platform can potentially be used to study sensitive species and phases in other electrochemical reactions.

Wu, Yutong↗

Laboratory flow experiments for visualizing carbon dioxide-induced, density-driven brine convection

Injection of carbon dioxide (CO{sub 2}) into saline aquifers confined by low-permeability cap rock will result in a layer of CO{sub 2} overlying the brine. Dissolution of CO{sub 2} into the brine increases the brine density, resulting in an unstable situation in which more-dense brine overlies less-dense brine. This gravitational instability could give rise to density-driven convection of the fluid, which is a favorable process of practical interest for CO{sub 2} storage security because it accelerates the transfer of buoyant CO{sub 2} into the aqueous phase, where it is no longer subject to an upward buoyant drive. Laboratory flow visualization tests in transparent Hele-Shaw cells have been performed to elucidate the processes and rates of this CO{sub 2} solute-driven convection (CSC). Upon introduction of CO{sub 2} into the system, a layer of CO{sub 2}-laden brine forms at the CO{sub 2}-water interface. Subsequently, small convective fingers form, which coalesce, broaden, and penetrate into the test cell. Images and time-series data of finger lengths and wavelengths are presented. Observed CO{sub 2} uptake of the convection system indicates that the CO{sub 2} dissolution rate is approximately constant for each test and is far greater than expected for a diffusion-only scenario. Numerical simulations of our system show good agreement with the experiments for onset time of convection and advancement of convective fingers. There are differences as well, the most prominent being the absence of cell-scale convection in the numerical simulations. This cell-scale convection observed in the experiments is probably initiated by a small temperature gradient induced by the cell illumination.

54 ENVIRONMENTAL SCIENCES↗

Ordovician-Cambrian Units: Hierarchical Evaluation of Geologic Carbon Storage Resource Estimates

The Indiana Geological and Water Survey (IGWS) led subtask 1.1 to assess the regional distribution and estimate the storage capacity of Ordovician-Cambrian stratigraphic units located within the partnership region. A comprehensive data set of wireline logs and petrophysical information was used to generate these interpretations. These data include core analysis for porosity and permeability, mercury injection capillary pressure (MICP), and existing well data including location and stratigraphic information. This report includes storage resource estimates (SREs) for three potential storage reservoirs(limestone and dolostone from the Upper Ordovician Trenton Limestone/Black River Group and equivalent units, the Middle Ordovician St. Peter Sandstone, and primary target reservoir rocks of the Lower Ordovician and Upper Cambrian Knox Supergroup and equivalent units) calculated using six methodologies: (1) a fixed value of porosity of 10 percent in all units evaluated; (2) a unique average porosity (per well) from wireline-derived porosity (neutron, sonic, and/or density porosity for each unit); (3) porosity values from core analysis; (4) a depth-dependent porosity model (Knox Supergroup only); (5) porosity based on a model based on petrophysical facies; and (6) SREs using National Energy Technology Laboratory’s CO2 Storage prospeCtive Resource Estimation Excel aNalysis (CO2-SCREEN beta V2). All methods used the same values for thickness for each unit. However, the areal extent of each assessment was limited by the data available for each method. Estimated volumes were calculated in 1-by-1 kilometer grid cells and summarized as county and total stratigraphic unit volumes. The resultant SREs mass are displayed using boxplots, which allow for comparing data statistics (mean values and variability) between methods. Differences observed in SRE results from the six methods are mainly attributable to differences in the data and conceptual models used to interpret or estimate porosity in each method. Based on this systematic variability between methods, it is inferred that methods 1, 4, and 6 are best used for regional-scale reconnaissance estimates of storage capacity while methods 2, 3, and 5 are more appropriate for local scales where more data is required. All estimates are data-density dependent and different methods require different amounts of data for reasonable assessments. ArcMap 10.5.1 software was used to portray SREs to help visualize spatial variance of estimates for each methodology, and more importantly, to highlight those areas having the greatest total storage potential estimates.

01 COAL, LIGNITE, AND PEAT↗

Atypical Behavior Identification in Large Scale Network Traffic

Cyber analysts are faced with the daunting challenge of identifying exploits and threats within potentially billions of daily records of network traffic. Enterprise-wide cyber traffic involves hundreds of millions of distinct IP addresses and results in data sets ranging from terabytes to petabytes of raw data. Creating behavioral models and identifying trends based on those models requires data intensive architectures and techniques that can scale as data volume increases. Analysts need scalable visualization methods that foster interactive exploration of data and enable identification of behavioral anomalies. Developers must carefully consider application design, storage, processing, and display to provide usability and interactivity with large-scale data. We present an application that highlights atypical behavior in enterprise network flow records. This is accomplished by utilizing data intensive architectures to store the data, aggregation techniques to optimize data access, statistical techniques to characterize behavior, and a visual analytic environment to render the behavioral trends, highlight atypical activity, and allow for exploration.

99 GENERAL AND MISCELLANEOUS↗

ORBiT - The Oak Ridge Biosurveillance Toolkit

We describe ORBiT, the Oak Ridge Biosurveillance Toolkit, the objective of which is to provide 1) forecasting and early warning, and 2) an extensible data analytics platform for biosurveillance by enabling the use of traditional and non-traditional datasets, consisting of heterogeneous data types and modalities. ORBiT includes a data collection interface, analytic components, higher-order statistical tools, and a visual front-end with visual analytics. ORBiT is implemented as a distributed analytic platform consisting of a software stack atop of Hadoop and uses Titan, a distributed graph database as a backend for data storage.

59 BASIC BIOLOGICAL SCIENCES↗

Variable Grid Method

NETL’s Variable Grid Method (VGM) is a novel approach that leverages GIS capabilities to simultaneously visualize and quantify spatial data trends and underlying data uncertainty. The flexible VGM approach utilizes a range of spatial datasets and uncertainty quantifications, which can be calculated using data related to sample density, sample variance, interpolation error, multiple simulations, etc., to create an integrated visualization of data and uncertainty. The intuitive manner of the VGM helps communicate the relationship between uncertainty and spatial data to effectively guide research, support advanced computation analyses, and helps inform research, management and policy decisions. The VGM approach is being developed into a standalone tool designed to integrate into a variety of research workflows, providing users the capabilities to utilize the VGM for their datasets, analysis, and models in support of their decision making needs. The VGM approach was developed as part of NETL’s Offshore portfolio. It was further matured and utilized in projects associated with both NETL’s Unconventional Resources and Carbon Storage portfolios, and is now being further developed by Varigrid, LLC.

Carbon Storage↗

Visualization and Data Analysis at the Exascale

The scope of our working group is scientific visualization and data analysis. Scientific visualization refers to the process of transforming scientific simulation and experimental data into images to facilitate visual understanding. Data analysis refers to the process of transforming data into an information-rich form via mathematical or computational algorithms to promote better understanding. We share scope on data management with the Storage group. Data management refers to the process of tracking, organizing and enhancing the use of scientific data. The purpose of our work is to enable scientific discovery and understanding. Visualization and data analysis has a broad scope as an integral part of scientific simulations and experiments, it is also a distinct separate service for scientific discovery and documentation purposes. Our scope includes an exascale software and hardware infrastructure that effectively supports visualization and data analysis.

ALGORITHMS↗

Scalable Contour Tree Computation by Data Parallel Peak Pruning

As data sets grow to exascale, automated data analysis and visualization are increasingly important, to intermediate human understanding and to reduce demands on disk storage via in situ analysis. Trends in architecture of high performance computing systems necessitate analysis algorithms to make effective use of combinations of massively multicore and distributed systems. One of the principal analytic tools is the contour tree, which analyses relationships between contours to identify features of more than local importance. Unfortunately, the predominant algorithms for computing the contour tree are explicitly serial, and founded on serial metaphors, which has limited the scalability of this form of analysis. While there is some work on distributed contour tree computation, and separately on hybrid GPU-CPU computation, there is no efficient algorithm with strong formal guarantees on performance allied with fast practical performance. Furthermore, we report the first shared SMP algorithm for fully parallel contour tree computation, with formal guarantees of O(lg V lg t) parallel steps and O(V lg V) work for data with V samples and t contour tree supernodes, and implementations with more than 30× parallel speed up on both CPU using TBB and GPU using Thrust and up 70× speed up compared to the serial sweep and merge algorithm.

97 MATHEMATICS AND COMPUTING↗

US Department of Energy, Office of Science High Performance Computing Facility Operational Assessment 2021: Oak Ridge Leadership Computing Facility

Oak Ridge National Laboratory’s (ORNL’s) Leadership Computing Facility (OLCF) continues to surpass its operational target goals of supporting users; delivering fast, reliable computational ecosystems; creating innovative solutions for high-performance computing (HPC) needs; contributing to the community to build the next generation HPC workforce, and managing risks, safety, and security associated with operating some of the most powerful computers in the world. The results can be seen in the cutting-edge science conducted by users and the praise from the research community. Calendar year (CY) 2021 saw continued excellence in research supported by the OLCF’s leadership-class computing resources, including Summit (the nation’s most powerful supercomputer), the global scratch file system Alpine, the Scalable Protected Infrastructure (SPI), the Exploratory Visualization Environment for Research in Science and Technology (EVEREST), and the archival mass-storage resource High-Performance Storage System (HPSS). While maintaining access and exceptional user support for Summit, the OLCF continued to make progress on the installation and deployment of Frontier, which will be the nation’s first exascale system when it comes online at the start of CY 2023. Users have already begun running and optimizing scientific codes on Crusher, the OLCF test and development system equipped with Frontier’s architecture. Throughout the year, the OLCF maintained a strong culture of operational excellence, including risk management, workplace safety, and cybersecurity. The OLCF’s rigorous risk management strategy anticipated and mitigated risks, and at this time there are no high-priority operational risks. Similarly, ORNL and the OLCF were committed to operating under the US Department of Energy’s (DOE’s) safety regulations that ensure a safe workplace. Technical staff tracked and monitored existing threats and vulnerabilities within the OLCF while continually developing tools and practices to enhance operations without increasing the facility’s risk. CY 2021 was filled with outstanding results and accomplishments, including a very high rating from users on overall satisfaction for the eighth consecutive year; a tremendous number of node hours delivered to 1,671 researchers on Summit; and the successful delivery of the allocation split of roughly 60%, 20%, and 20% of core-hours offered for the Innovative and Novel Computational Impact on Theory and Experiment (INCITE), Advanced Scientific Computing Research Leadership Computing Challenge (ALCC), and Director’s Discretionary (DD) programs, respectively (Section 2). COVID-19 research remained a focus in 2021, and the ALCC and DD programs allocated over 1 million Summit hours to the COVID-19 High Performance Computing Consortium. These accomplishments, coupled with the high utilization rates (i.e., overall and capability usage), represent the fulfillment of the promise of leadership class machines: efficient facilitation of leadership-class computational applications.

97 MATHEMATICS AND COMPUTING↗

NREL and SDG&E Collaboration to Support SDG&E Grid and Storage Efforts: Cooperative Research and Development Final Report, CRADA Number CRD-14-562

This project will enable effective utilization of high penetration of photovoltaics (PV) in islanded microgrids, increasing overall system efficiency, decreased fuel costs and resiliency of the overall system to help meet the SunShot goals of enhancing system integration methods to increase penetration of PV. National Renewable Energy Laboratory (NREL) will collaborate with San Diego Gas & Electric (SDG&E) to provide research and testing support to address their needs in energy storage sizing and placement, Integrated Test Facility (ITF) development, Real Time Digital Simulator (RTDS) Modeling and simulation support at ITF, Visualization and Virtual connection to Energy Systems Integration Facility (ESIF), and microgrid simulation and testing areas. Specifically in this project a real microgrid scenario with high penetration of PV (existing in SDG&E territory) is tested in the ESIF laboratory. Multiple control cases for firming PV using storage in a microgrid scenario will be investigated and tested in the laboratory setup.

14 SOLAR ENERGY↗

Augmented Monitoring and Condition Assessment Program (AMCAP) Material Test Reactor (MTR) (Fuel Inspection Program Report)

The AMCAP MTR Fuel Inspection Program, a special inspection program comprised of four inspection campaigns, examined a total of ten (10) pre-selected aluminum-clad, aluminum-based fuel core spent nuclear fuel assemblies (ASNF) stored in the L Area Disassembly Basin (L Basin) at the Savannah River Site. A full description of the inspections and the results are reported. The fuel had been stored in bundled-tube storage (Vertical Tube Storage) for periods of 18 to 21 years. The prior service experience of the individual 10 assemblies varies, but all included irradiation followed by wet storage at international research reactor sites prior to shipment to the US and storage in L Basin. The 10 assemblies were expected to be among the “worst"’ in terms of prior corrosion damage of the entire inventory of the direct-bundle-stored ASNF in L Basin. The inventory of MTR ASNF in L Basin will continue to be stored in the bundled-tube configuration or in slug-storage buckets with inserts pending retrieval for ultimate disposition. The MTR fuel inspections focused on collecting information for characterization of the material condition of the ASNF considering various types of aluminum fuel corrosion degradation of its assembled materials in water storage. A custom-designed Fuel Inspection Table was used to stage the fuel for remote, enhanced visual examination (close-up video imaging & recording) with controlled lighting and positioning that enables reproducibility of imaging conditions. The inspections were conducted by fuel subject matter expert staff from Spent Fuel Project Engineering (SFPE) and the Savannah River National Laboratory (SRNL). Stills captured from the video records were used to compare the corrosion evolution from previous records, as available. This evaluation of the inspection results including the comparison to the previous inspection results demonstrate that the water quality and the storage configuration of ASNF in L Basin do not cause aggressive corrosion degradation of the fuel; mitigation of the prior corrosion degradation of the fuel also appears to have been achieved with the good water quality conditions of L Basin. Recommendations are made for future inspection of the fuel to trend corrosion degradation and demonstrate continued safe wet storage of the ASNF in L Basin. The next fuel examination is recommended to be performed in 5 years.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Investigating Mountain Watershed Headwater‐To‐Groundwater Connections, Water Sources, and Storage Selection Behavior With Dynamic‐Flux Particle Tracking

Abstract Climate change will impact mountain watershed streamflow both directly—with changing precipitation amounts and variability—and indirectly—through temperature shifts altering snowpack, melt, and evapotranspiration. To understand how these complex processes will affect ecosystem functioning and water resources, we need tools to distinguish connections between water sources (rain/snowmelt), groundwater storage, and exit fluxes (streamflow/evapotranspiration), and to determine how these connections change seasonally and as climate shifts. Here, we develop novel watershed‐scale approaches to understand water source, storage, and exit flux connections using a dynamic‐flux particle tracking model (EcoSLIM) applied in California's Cosumnes Watershed, which connects the Sierra Nevada and Central Valley. This work develops new visualizations and applications to provide mechanistic understanding that underpins the interpretation of isotopic field data at watershed scales to distinguish sources, flow paths, residence times, and storage selection. In our simulations, streamflow comes primarily from snow‐derived water while evapotranspiration generally comes from rain. Most streamflow starts above 1,000 m while evapotranspiration is sourced relatively evenly across the watershed and is generally younger than streamflow. Modeled streamflow consists primarily of water sourced from precipitation in the previous 5 years but before the current water year, while ET consists primarily of water from precipitation in the current water year. ET, and to a lesser extent streamflow, are both younger than water in groundwater storage. However, snowmelt‐derived streamflow preferentially discharges older water from snow‐derived storage. Dynamic‐flux particle tracking and new approaches presented here enable novel model‐tracer comparisons in large‐scale watersheds to better understand watershed behavior in a changing climate.

54 ENVIRONMENTAL SCIENCES↗

I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey

Growing interest in Artificial Intelligence (AI) has resulted in a surge in demand for faster methods of Machine Learning (ML) model training and inference. This demand for speed has prompted the use of high performance computing (HPC) systems that excel in managing distributed workloads. Because data is the main fuel for AI applications, the performance of the storage and I/O subsystem of HPC systems is critical. In the past, HPC applications accessed large portions of data written by simulations or experiments or ingested data for visualizations or analysis tasks. ML workloads perform small reads spread across a large number of random files. This shift of I/O access patterns poses several challenges to modern parallel storage systems. In this paper, we survey I/O in ML applications on HPC systems, and target literature within a 6-year time window from 2019 to 2024. We define the scope of the survey, provide an overview of the common phases of ML, review available profilers and benchmarks, examine the I/O patterns encountered during offline data preparation, training, and inference, and explore I/O optimizations utilized in modern ML frameworks and proposed in recent literature. Lastly, we seek to expose research gaps that could spawn further R&D.

97 MATHEMATICS AND COMPUTING↗