Kokkos Performance Portable Thread-Parallel Execution and Data Structures On Next Generation Platforms.
Abstract not provided.
Edwards, Harold C.↗
SEARCH · Engineering Papers
Results for “data platform”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Weathering the Storm: Developing a Spatial Data Infrastructure and Online Research Platform for Oil Spill Preparedness
Presented by NETL at AGU Fall Conference, 12/16
Bauer, Jennifer R.↗
Topical Report on Water Balance Model Development and Initial Application
This topical report summarizes results from developing a generic dynamic water balance tool which can be used by coal-fired power plant operators to evaluate FGD water management strategies. EPRI is using a statistical software model created on the GoldSim platform and data from coal-fired energy plants to determine the fraction of power plant water needs that can be satisfied by electrodialysis reversal treatment and, correspondingly, the discharge volume and/or byproducts that still need to be managed. The generic model is designed to accept a number of easily obtainable process variables and generate probabilities of resultant water characteristics. The model is also constructed as a universal process flow; one that can be adjusted to accommodate most major components of an FGD blowdown handling system. The generic model is dynamic and utilizes user-inputted operational variation in water quality and quantity to best provide a probabilistic representation of potential performance outcomes. In order to account for complexities of water composition and treatment, a separate chemical modeling software is used to evaluate water chemistry and unit operation performance. The thermodynamic modeling software, OLI Studio, is employed to convert ion data from laboratory analyses into balanced molecular concentrations that are classified as dissolved and suspended solids. The dynamic water model is designed to import a total of 11 species commonly found in FGD blowdown water as molecular concentrations.Water management unit operations are used in the model and categorized by either physical unit operation blocks or chemical unit operations blocks. As the name implies, the physical water treatment blocks are unit operations that are exclusively physical changes to the system (e.g., separations and volume changes). The chemical water treatment blocks are unit operations where chemical changes occur and require the use of OLI Studio to characterize subsequent streams. Water and material balances from three unique coal-fired power plants were obtained and preliminary modeling on the dynamic water balance tool was performed using the extracted data from these power plants. These three power plants were chosen due to their unique configurations and water profiles that represented a variety of operational changes. Results from using the dynamic tool with the three plant configurations are presented and discussed in the context of the existing tool and planned future capabilities.
01 COAL, LIGNITE, AND PEAT↗
Topical Report on Water Balance Model Development and Initial Application
This topical report summarizes results from developing a generic dynamic water balance tool which can be used by coal-fired power plant operators to evaluate FGD water management strategies. EPRI is using a statistical software model created on the GoldSim platform and data from coal-fired energy plants to determine the fraction of power plant water needs that can be satisfied by advanced treatment technologies and, correspondingly, the discharge volume and/or byproducts that still need to be managed. The initial evaluations presented in this report represent generic scenarios, while the final evaluations will incorporate results from advanced treatment and encapsulation studies conducted during later stages of the project.
01 COAL, LIGNITE, AND PEAT↗
Experimental Validation of a Spectral-Based Structural Analysis Model Implemented in the Design of the VolturnUS 6MW Floating Offshore Wind Turbine
The following work presents a spectral-based structural analysis method implemented in the design of the VolturnUS 6MW Floating Offshore Wind Turbine hull developed to increase system optimization. To begin, a description of the methodology is provided which details how transfer functions relate the hull's structural response to first order wave kinematics and wind turbine aerodynamics. Following the model definition, focus is placed on model validation using results from an experimental 1:52 scale model test of the VolturnUS system (shown in Fig. 1) conducted at the University of Maine's Alfond W2 Ocean Engineering Laboratory. Using data acquired from load cells installed at various locations in the hull the accuracy of the model is assessed through the use of power spectra and statistics. The performance of the structural model is considered over a range of environmental conditions representing design load cases prescribed by the American Bureau of Shipping for class certification of floating offshore wind turbines.
artificial intelligence, offshore projects plannin↗
1.4.2.402 - Water Risk for the Bulk Power System: Asset to Grid Impacts
Utilities and stakeholders need a standardized mechanism for evaluating how future climate and hydrologic conditions translate to water-related risks for power grid assets and systems to support planning decisions. Yet, no such mechanism exists. To address this need, our goals are to: (1) Develop and execute a state-of-the-art multi-model framework to assess future climate-water impacts and risks to the grid, including sensitivities to varying hydrologic drivers and infrastructure scenarios. (2) Create a standardized interactive visualization platform, using data from the climate-water risk assessments, that enables stakeholders to evaluate climate-water impacts, risks, and adaptation measures for power systems.
bulk power system↗
Lidar Mapping and Surveillance of Nuclear Infrastructure
Wear is unavoidable, whether it occurs in a nuclear facility or abridge on the highway its detection is crucial to preventing the failure of a system. While tools capable of detecting localized damage exist, industry lacks methods to evaluate the health of larger infrastructure. Routine inspection of nuclear facilities must be undertaken to ensure the safety of personnel and proper containment of nuclear materials. Most systems in a nuclear facility are designated as radioactive and confined spaces. To constantly monitor such systems in person would be hazardous but with a remote inspection tool it can be done in a safer and easier way. Lidar: Operates by emitting a laser pulse and looking for the reflected light. Allows user to gain 3D information of the environment. Project Objective: To develop an inspection tool for evaluating the health of large scale infrastructure using Lidar and machine learning. Autonomous Platform + Lidar + Data Fusion + Big Data. Use SLAM to build a 2D map of the environment. Point cloud created by transforming the points between reference frames. Point cloud to Surface: Inherent representation of surface geometry; Difficult to process with conventional techniques. Point cloud to Image: Easily processed by conventional machine learning algorithms. The quantity of data generated will necessitate a big data framework to manage the data for processing. Additional Sensors: Detecting the temperature (a) chemical makeup (b) and radiation emission (c) of a surface could assist in detecting problems. Human inspection can detect irregularities in both physical objects and their point-cloud representations. This is a good indication that mapping nuclear sites using Lidar will provide qualitative insight into the health of the facility. If deep learning can be used to automatically identify problem areas then the completed tool could become an invaluable asset.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
New U.S. Data Tools are Playing a Crucial Role in Decarbonizing Buildings at Speed, Scale, and Low Cost
Preparing buildings for retrofits traditionally requires expensive on-site audits or time- intensive simulation models. As a result, the majority of buildings fail to pursue cost-saving retrofits. To address these barriers, the U.S. Department of Energy (DOE) has introduced the Building Efficiency Targeting Tool for Energy Retrofits (BETTER)—a new, free, on-line tool that utilizes a data-driven analytical engine and user-friendly web interface to automatically analyze a building’s monthly energy usage in response to weather conditions. The tool benchmarks a building’s electric and fossil energy usage against peers; estimates energy, cost, and emissions reductions at the building and portfolio levels; recommends energy efficiency measures; and prioritizes buildings for net-zero energy retrofits. Thanks to interoperability with the DOE’s Standard Energy Efficiency Data (SEED) platform, BETTER is supporting U.S. jurisdictions to prepare buildings for retrofit at speed, scale, and low cost to comply with energy policies. This paper discusses the use of BETTER and SEED by one of the branches of the California state government to streamline a retrofit program across 455 public non-residential buildings to align with state goals to reduce greenhouse gas emissions. It describes the organization’s challenge to reduce energy consumption across a geographically diverse, aging portfolio; explores how BETTER and SEED improved workflow efficiency; presents preliminary results, including avoiding audit costs of $3.28 million and developing the groundwork for retrofit projects estimated to prevent emission of 2,271 t CO2e annually; and provides guidance for other jurisdictions seeking similar results.
Li, han↗
A Hybrid System for High-Accuracy Timekeeping Using Millisecond Pulsars
Millisecond pulsars exhibit extremely stable rotational periods with negligible long-term variation, comparable to atomic clocks. Leveraging pulsar signal stability, this paper presents a hybrid Pulse Per Second (PPS) generation system for high-accuracy and GPS-independent timing. The system combines pulsar and GPS signals through a high-speed data acquisition platform featuring FPGA-driven processing and techniques. This design provides a reliable and precise timekeeping solution for energy systems, ensuring functionality when GPS signals are unavailable.
Wu, Ori [ORNL] (ORCID:0000000326723410)↗
In Situ Data Infrastructure for Scientific Unit Testing Platform
Testing is a significant software development process for the management of software systems and scientific code. However, as the complexity of scientific codes increases, extra checks are needed to monitor impacts to dependent models and to verify system constraints. The software complexity also impedes the efforts of module developers and software engineers to rapidly develop and extend their code. Recently, we have developed an automatic methodology and prototype platform to facilitate scientific verification of individual functions within complex scientific codes. With this system, the scientific module builders are able to track variables conveniently in one module or track variables’ changes among different modules. In this paper, we present a procedure for automatic unit testing generation. For the interest of a general audience of this conference, we are emphasizing the technical details of integrating the In Situ data infrastructure into our platform. At the end of this paper, we have included an implementation of unit testing for the ACME Land Model (ALM) to demonstrate the usefulness and correctness of the platform. We have also used single- and multipoint checks to demonstrate the efficient variable tracking capability of this platform.
97 MATHEMATICS AND COMPUTING↗
TransPlatformer
We propose TransPlatformer for translating toxicogenomics from one platform to another. Transcriptomic profiling has evolved through multiple generations of technology, from microarrays (e.g., Affymetrix, CodeLink) to more recent high-throughput sequencing and targeted panels such as S1500+. Microarrays, which dominated gene expression studies in the early 2000s, provided affordable and high-throughput transcript quantification but suffered from cross-hybridization issues and limited dynamic range . RNA-Seq, introduced in the late 2000s, revolutionized transcriptomics by enabling unbiased and comprehensive gene expression analysis, albeit at higher costs and computational demands . Despite advances, many studies rely on historical microarray data, necessitating the translation of legacy data into modern platforms to ensure continuity and comparability. This translation is complicated by factors such as platform-specific probe design, differences in transcript coverage, and batch effects . Existing methods for cross-platform mapping include statistical normalization, machine learning models, and biological anchoring approaches. The ability to translate transcriptomic data between platforms has broad implications, including enhanced meta-analyses, improved toxicological modeling, and better integration of historical datasets with contemporary research. TransPlatformer seeks to contribute to this effort by evaluating translation methodologies and proposing novel strategies to improve cross-platform gene expression harmonization. In this repository there are code examples for TransPlatformer implementation
Cong, Guojing↗
Matminer: An open source toolkit for materials data mining
As materials data sets grow in size and scope, the role of data mining and statistical learning methods to analyze these materials data sets and build predictive models is becoming more important. This manuscript introduces matminer, an open-source, Python-based software platform to facilitate data-driven methods of analyzing and predicting materials properties. Matminer provides modules for retrieving large data sets from external databases such as the Materials Project, Citrination, Materials Data Facility, and Materials Platform for Data Science. It also provides implementations for an extensive library of feature extraction routines developed by the materials community, with 47 featurization classes that can generate thousands of individual descriptors and combine them into mathematical functions. Finally, matminer provides a visualization module for producing interactive, shareable plots. These functions are designed in a way that integrates closely with machine learning and data analysis packages already developed and in use by the Python data science community. We explain the structure and logic of matminer, provide a description of its various modules, and showcase several examples of how matminer can be used to collect data, reproduce data mining studies reported in the literature, and test new methodologies.
97 MATHEMATICS AND COMPUTING↗
Could Blobs Fuel Storage-Based Convergence between HPC and Big Data?
The increasingly growing data sets processed on HPC platforms raise major challenges for the underlying storage layer. A promising alternative to POSIX-IO- compliant file systems are simpler blobs (binary large objects), or object storage systems. Such systems offer lower overhead and better performance at the cost of largely unused features such as file hierarchies or permissions. Similarly, blobs are increasingly considered for replacing distributed file systems for big data analytics or as a base for storage abstractions such as key-value stores or time-series databases. This growing interest in such object storage on HPC and big data platforms raises the question: Are blobs the right level of abstraction to enable storage-based convergence between HPC and Big Data? In this paper we study the impact of blob-based storage for real-world applications on HPC and cloud environments. The results show that blobbased storage convergence is possible, leading to a significant performance improvement on both platforms
Matri, Pierre↗
A National Infrastructure for Artificial Intelligence on the Grid (NI4AI) (Final Scientific/Technical Report)
Electric utilities have traditionally taken a very pragmatic yet myopic approach with grid sensors and the resulting collected data. Sensors are purchased and deployed to solve a specific, known problem that has risen to sufficient awareness as to justify the effort of deploying sensors and the needed capital investment. This sensor data flows into proprietary software packages with limited functionality intended only to address the initial problem. This approach aligns with the financial incentives of the utility to deploy capital into fixed hardware assets for which the corporations earn a rate of return. This mentality stands in stark contrast to the big data revolution that started nearly 25 years ago with the rise of Google. In this worldview, data is a fundamental business asset; successful organizations collect, store, explore, merge, and exploit as much data as possible to not only solve problems well understood today but also to tackle new problems that will inevitably rise tomorrow. The ARPA-E Open Innovation 2018 project entitled A National Infrastructure for Artificial Intelligence on the Grid or NI4AI for short was designed to demonstrate this alternative paradigm for using data. To do this, the project was composed of three key thrust areas. The first major component deployed a variety of high-frequency grid sensors and captured terabytes of both wide-scale and localized grid measurements, generating high-value datasets for grid research and algorithm development. The second aspect made available PingThings’ PredictiveGridTM, a horizontally scalable, cloud-based data management and AI platform built for time series data to explore and exploit the collected data. Finally, the project fostered a diverse and open research community composed of experts from numerous fields through focused educational content, code sharing, and data science competitions. Shifting away from “single use” sensors and closed data silos within electric utilities is a major benefit to the public at large. This legacy approach to data is incredibly (1) capital intensive (new sensors must be deployed for each new problem and problems tend to arise continuously) and (2) painfully slow (new problems must be identified first and then new sensors must be deployed to collect data to begin to address the issue). The transition to a carbon neutral grid requires a massive transformation of the existing grid infrastructure and will continue to challenge the legacy grid in unforeseen ways. The only way to make the energy transition cost effective is for utilities to abandon this dated data paradigm and adopt more contemporary approaches. NI4AI has shown that it is technically possible and economically feasible to ingest, explore, and exploit grid data collected from even very high frequency sensing, such as continuous point on wave sensors collecting measurements 10,000 times a second. In fact, the PredictiveGrid platform used is commercially available and deployed at several utilities in the United States. Project accomplishments were numerous and included (1) making available a state of the art time series platform to the community, (2) collecting over 520 streams of time series data from grid sensors totaling over 1 trillion grid measurements, and (3) developing and nurturing a community within the industry focused on the use of data to create value for utilities and, ultimately, end consumers.
97 MATHEMATICS AND COMPUTING↗
MultiProBE Software Platform
MultiProBE Software Platform is cloud based multi-omic data repository and data processing compute platform.
Wright, Devin↗
Dataset from ORNL Flexible Research Platform (FRP)
The data comes from a two-story light commercial building which can be used to physically simulate light commercial buildings common in the nation's existing building stock. Based on a data collection plan, these measurements were performed for five different building operations. In the data set for each period, 98 data variables were selected and collected, in which 7 variables are weather data and the rest are all building and system operation data.
Cui, Borui↗
The Galaxy platform for accessible, reproducible, and collaborative data analyses: 2024 update
Galaxy (https://galaxyproject.org) is deployed globally, predominantly through free-to-use services, supporting user-driven research that broadens in scope each year. Users are attracted to public Galaxy services by platform stability, tool and reference dataset diversity, training, support and integration, which enables complex, reproducible, shareable data analysis. Applying the principles of user experience design (UXD), has driven improvements in accessibility, tool discoverability through Galaxy Labs/subdomains, and a redesigned Galaxy ToolShed. Galaxy tool capabilities are progressing in two strategic directions: integrating general purpose graphical processing units (GPGPU) access for cutting-edge methods, and licensed tool support. Engagement with global research consortia is being increased by developing more workflows in Galaxy and by resourcing the public Galaxy services to run them. The Galaxy Training Network (GTN) portfolio has grown in both size, and accessibility, through learning paths and direct integration with Galaxy tools that feature in training courses. Code development continues in line with the Galaxy Project roadmap, with improvements to job scheduling and the user interface. Environmental impact assessment is also helping engage users and developers, reminding them of their role in sustainability, by displaying estimated CO 2 emissions generated by each Galaxy job.
97 MATHEMATICS AND COMPUTING↗