Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data storage data management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

An overview of data tools for representing and managing building information and performance data

Building information modeling (BIM) has been widely adopted for representing and exchanging building data across disciplines during building design and construction. However, BIM's use in the building operation phase is limited. With the increasing deployment of low-cost sensors and meters, as well as affordable digital storage and computing technologies, growing volumes of data have been collected from buildings, their energy services systems, and occupants. Such data are crucial to help decision makers understand what, how, and when energy is consumed in buildings—a critical step to improving building performance for energy efficiency, demand flexibility, and resilience. However, practical analyses and use of the collected data are very limited due to various reasons, including poor data quality, ad-hoc representation of data, and lack of data science skills. To unlock value from building data, there is a strong need for a toolchain to curate and represent building information and performance data in common standardized terminologies and schemas, to enable interoperability between tools and applications. This study selected and reviewed 24 data tools based on common use cases of data across the building life cycle, from design to construction, commissioning, operation, and retrofits. The selected data tools are grouped into three categories: (1) data dictionary or terminology, (2) data ontology and schemas, and (3) data platforms. The data are grouped into ten typologies covering most types of data collected in buildings. This study resulted in five main findings: (1) most data representation tools can represent their intended data typologies well, such as Green Button for smart meter data and Brick schema for metadata of sensors in buildings and HVAC systems, but none of the tools cover all ten types of data; (2) there is a need for data schemas to represent the basis of design data and metadata of occupant data; (3) standard terminologies such as those defined in BEDES are only adopted in a few data tools; (4) integrating data across various stages in the building life cycle remains a challenge; and (5) most data tools were developed and maintained by different parties for different purposes, their flexibility and interoperability can be improved to support broader use cases. Finally, recommendations for future research on building data tools are provided for the data and buildings community based on the FAIR principles to make data Findable, Accessible, Interoperable, and Reusable.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A terminology for scientific workflow systems

The term “scientific workflow” has evolved over the last two decades to encompass a broad range of compositions of interdependent compute tasks and data movements. It has also become an umbrella term for processing in modern scientific applications. Today, many scientific applications can be considered as workflows made of multiple dependent steps, and hundreds of workflow systems have been developed to manage and run these scientific workflows. However, no turnkey solution has emerged from the field to address the diversity of scientific processes and the infrastructure on which they are supposed to be implemented. Instead, new research problems requiring the execution of scientific workflows with some novel feature often lead to the development of an entirely new workflow system. A direct consequence of this situation is that many existing workflow management systems (WMSs) share some salient features, offer similar functionalities, and can manage the same categories of workflows but at the same time also have some distinct capabilities that can be important for specific applications. This situation makes researchers who develop workflows face the complex question of selecting a WMS. This selection can be driven by technical considerations, to find the system that is the most appropriate for their application and for the computing and storage resources available to them, or other factors such as reputation, adoption, strong community support, or long-term sustainability. To address this problem, a group of WMS developers and practitioners joined their efforts to produce a community-based terminology of WMSs. This paper summarizes their findings and introduces this new terminology to characterize WMSs. Furthermore, this terminology is composed of fives axes: workflow structure and characteristics, composition, orchestration, data management, and metadata capture. Each axis comprises several concepts that capture the prominent features of WMSs. Based on this terminology, this paper also presents a classification of 23 existing WMSs according to the proposed axes and terms.

Community-based terminology↗

Remote Geophysical Logging at the Hanford Single-Shell Tank Farms: Maintaining Efficiency and Reducing Personnel Hazards - 16190

Vadose zone characterization around groups of underground waste storage tanks (known as tank farms) at the US DOE Hanford Site in Washington State is conducted to assess the presence and extent of manmade gamma-ray emitting radionuclides. Boreholes around the tanks are characterized using a high-resolution spectral gamma logging system (SGLS). In the past, logging operations required workers to remain inside the tank farm boundary during data acquisition. This approach was effective; however, personnel were at risk of exposure to potential radiological hazards, chemical hazards, and/or vapor releases that can be associated with the tank farm environment. Limitations associated with this work environment necessitated a new approach in order to decrease the amount of time personnel spent in the farm without affecting work productivity and efficiency. In order to accomplish this, a new remote logging cable support (RLCS) was developed and implemented which effectively removed workers from the hazards associated with the tank farm environment. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

COMPILATION OF LABORATORY SCALE ALUMINUM WASH AND LEACH REPORT RESULTS

This report compiles and analyzes all known wash and caustic leach laboratory studies. As further data is produced, this report will be updated. Included are aluminum mineralogical analysis results as well as a summation of the wash and leach procedures and results. Of the 177 underground storage tanks at Hanford, information was only available for five individual double-shell tanks, forty-one individual single-shell tanks (e.g. thirty-nine 100 series and two 200 series tanks), and twelve grouped tank wastes. Seven of the individual single-shell tank studies provided data for the percent of aluminum removal as a function of time for various caustic concentrations and leaching temperatures. It was determined that in most cases increased leaching temperature, caustic concentration, and leaching time leads to increased dissolution of leachable aluminum solids.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

CRiSPPy: An advanced hydropower scheduling tool for the Colorado River Storage Project

The Western Area Power Administration (WAPA) plays a vital role in delivering reliable and cost-effective hydroelectric power to millions of customers across the western United States. The Colorado River Storage Project (CRSP) carries out WAPA’s mission in Arizona, Utah, Colorado, New Mexico, Nevada, Wyoming and Texas. Achieving this mission requires effective management of the Colorado River system, and depends on the use of advanced analytical tools and modeling methodologies. For many years, CRSP has relied on the Generation and Transmission Maximization Superlite (GTMax SL) model for its mid-term and long-term hydroscheduling needs. However, the evolving energy market, power system operations, environmental rules, and hydrology conditions, coupled with advancements in computational capabilities, have necessitated the development of a more modern and robust solution. This report introduces the Colorado River Storage Project Python-based (CRiSPPy) model, a new, advanced hydropower scheduling tool developed to address CRSP ever-evolving challenges. CRiSPPy represents a significant leap forward in our ability to model and optimize the operation of the Colorado River system. It incorporates state-of-the-art optimization algorithms, enhanced data management capabilities, and an advanced graphical user interface, providing WAPA CRSP personnel with unprecedented insights and decision-making support. This document details the development, capabilities, and implementation of CRiSPPy. It is intended to serve as a comprehensive resource for WAPA staff, stakeholders, and anyone interested in the future of hydropower scheduling in the Colorado River Basin. We are confident that CRiSPPy will enhance WAPA's mission while adapting to the challenges of a dynamic and increasingly complex environment. The version of CRiSPPy described in this report is the version 2.3. New versions of CRiSPPy will be developed as the tool keeps evolving to address CRSP challenges.

13 HYDRO ENERGY↗

Building Simulation Modelers are we big-data ready?

Recent advances in computing and sensor technologies have pushed the amount of data we collect or generate to limits previously unheard of. Sub-minute resolution data from dozens of channels is becoming increasingly common and is expected to increase with the prevalence of non-intrusive load monitoring. Experts are running larger building simulation experiments and are faced with an increasingly complex data set to analyze and derive meaningful insight. This paper focuses on the data management challenges that building modeling experts may face in data collected from a large array of sensors, or generated from running a large number of building energy/performance simulations. The paper highlights the technical difficulties that were encountered and overcome in order to run 3.5 million EnergyPlus simulations on supercomputers and generating over 200 TBs of simulation output. This extreme case involved development of technologies and insights that will be beneficial to modelers in the immediate future. The paper discusses different database technologies (including relational databases, columnar storage, and schema-less Hadoop) in order to contrast the advantages and disadvantages of employing each for storage of EnergyPlus output. Scalability, analysis requirements, and the adaptability of these database technologies are discussed. Additionally, unique attributes of EnergyPlus output are highlighted which make data-entry non-trivial for multiple simulations. Practical experience regarding cost-effective strategies for big-data storage is provided. The paper also discusses network performance issues when transferring large amounts of data across a network to different computing devices. Practical issues involving lag, bandwidth, and methods for synchronizing or transferring logical portions of the data are presented. A cornerstone of big-data is its use for analytics; data is useless unless information can be meaningfully derived from it. In addition to technical aspects of managing big data, the paper details design of experiments in anticipation of large volumes of data. The cost of re-reading output into an analysis program is elaborated and analysis techniques that perform analysis in-situ with the simulations as they are run are discussed. The paper concludes with an example and elaboration of the tipping point where it becomes more expensive to store the output than re-running a set of simulations.

Sanyal, Jibonananda↗

Characterization of Settler Tank and KW Container Sludge Simulants

The Sludge Treatment Project (STP), managed by CH2M Hill Plateau Remediation Company (CHPRC) has specified base formulations for non-radioactive sludge simulants for use in the development and testing of equipment for sludge sampling, retrieval, transport, and processing. In general, the simulant formulations are based on the average or design-basis physical and chemical properties obtained by characterizing sludge samples. The simulants include surrogates for uranium metal, uranium oxides (agglomerates and fine particulate), and the predominant chemical phases (iron and aluminum hydroxides, sand). Specific surrogate components were selected to match the nominal particle-size distribution and particle-density data obtained from sludge sample analysis. Under contract to CHPRC, Pacific Northwest National Laboratory (PNNL) has performed physical and rheological characterization of simulants, and the results are reported here. Two base simulant types (dry) were prepared by STP staff at the Maintenance and Storage Facility and received by PNNL on February 12, 2009: Settler Tank Simulant and KW Container Sludge Simulant. The objectives of this simulant characterization effort were to provide baseline characterization data on simulants being used by STP for process development and equipment testing and provide a high-level comparison of the simulant characteristics to the targets used to formulate the simulants.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

HPDR: High-Performance Portable Scientific Data Reduction Framework

The rapid growth in scientific data generation is outpacing advancements in computing systems necessary for efficient storage, transfer, and analysis, particularly in the context of exascale computing. With the deployment of first-generation exascale computing systems and next-generation experimental facilities, this gap is widening and necessitates effective data reduction techniques to manage enormous data volumes. Over the past decade, various data reduction methods, including lossless compression, error-controlled lossy compression, and data refactoring, have been developed to accelerate I/O in scientific workflows. Despite significant reductions in data volume, these methods introduce considerable computational overhead, which can become the new bottleneck in data processing. To mitigate this, GPU-accelerated data reduction algorithms have been introduced. However, challenges remain in their integration into exascale workflows, including limited portability across different GPU architectures, substantial memory transfer overhead, and reduced scalability on dense multi-GPU systems. To address these challenges, we propose HPDR, a high-performance and portable data reduction framework. HPDR is designed to enable the execution of state-of-the-art reduction algorithms across diverse processor architectures while reducing memory transfer overhead to 2.3 % of the original, resulting in up to 3.5× faster throughput compared to existing solutions. It also achieves up to 96% of the theoretical speedup in multi-GPU settings. In addition, evaluations on accelerating I/O operations at scale up to 1,024 nodes of the Frontier supercomputer demonstrate that HPDR can achieve up to 103 TB/s reduction throughput, providing up to 4× acceleration in parallel I/O performance compared to existing data reduction routines. This work highlights the potential of HPDR to significantly enhance data reduction efficiency in exascale computing environments.

Chen, Jieyang [University of Oregon]↗

Analysis Report for Exascale Storage Requirements for Scientific Data.

Over the next 10 years, the Department of Energy will be transitioning from Petascale to Exascale Computing resulting in data storage, networking, and infrastructure requirements to increase by three orders of magnitude. The technologies and best practices used today are the result of a relatively slow evolution of ancestral technologies developed in the 1950s and 1960s. These include magnetic tape, magnetic disk, networking, databases, file systems, and operating systems. These technologies will continue to evolve over the next 10 to 15 years on a reasonably predictable path. Experience with the challenges involved in transitioning these fundamental technologies from Terascale to Petascale computing systems has raised questions about how these will scale another 3 or 4 orders of magnitude to meet the requirements imposed by Exascale computing systems. This report is focused on the most concerning scaling issues with data storage systems as they relate to High Performance Computing- and presents options for a path forward. Given the ability to store exponentially increasing amounts of data, far more advanced concepts and use of metadata will be critical to managing data in Exascale computing systems.

97 MATHEMATICS AND COMPUTING↗

The Oklahoma Geographic Information Retrieval System

The Oklahoma Geographic Information Retrieval System (OGIRS) is a highly interactive data entry, storage, manipulation, and display software system for use with geographically referenced data. Although originally developed for a project concerned with coal strip mine reclamation, OGIRS is capable of handling any geographically referenced data for a variety of natural resource management applications. A special effort has been made to integrate remotely sensed data into the information system. The timeliness and synoptic coverage of satellite data are particularly useful attributes for inclusion into the geographic information system.

Blanchard, W. A.↗

Advanced program development management software system. Software description and user's manual

The objectives of this project were to apply emerging techniques and tools from the computer science discipline of paperless management to the activities of the Space Transportation and Exploration Office (PT01) in Marshall Space Flight Center (MSFC) Program Development, thereby enhancing the productivity of the workforce, the quality of the data products, and the collection, dissemination, and storage of information. The approach used to accomplish the objectives emphasized the utilization of finished form (off-the-shelf) software products to the greatest extent possible without impacting the performance of the end product, to pursue developments when necessary in the rapid prototyping environment to provide a mechanism for frequent feedback from the users, and to provide a full range of user support functions during the development process to promote testing of the software.

Source record↗

ScienceOrganizer System and Interface Summary

ScienceOrganizer is a specialized knowledge management tool designed to enhance the information storage, organization, and access capabilities of distributed NASA science teams. Users access ScienceOrganizer through an intuitive Web-based interface that enables them to upload, download, and organize project information - including data, documents, images, and scientific records associated with laboratory and field experiments. Information in ScienceOrganizer is "threaded", or interlinked, to enable users to locate, track, and organize interrelated pieces of scientific data. Linkages capture important semantic relationships among information resources in the repository, and these assist users in navigating through the information related to their projects.

Keller, Richard M.↗

PHASE II VAULT TESTING OF THE ARGONNE RFID SYSTEM

The U.S. Department of Energy (DOE) (Environmental Management [EM], Office of Packaging and Transportation [EM-45]) Packaging and Certification Program (DOE PCP) has developed a Radio Frequency Identification (RFID) tracking and monitoring system, called ARG-US, for the management of nuclear materials packages during transportation and storage. The performance of the ARG-US RFID equipment and system has been fully tested in two demonstration projects in April 2008 and August 2009. With the strong support of DOE-SR and DOE PCP, a field testing program was completed in Savannah River Site's K-Area Material Storage (KAMS) Facility, an active Category I Plutonium Storage Facility, in 2010. As the next step (Phase II) of continued vault testing for the ARG-US system, the Savannah River Site K Area Material Storage facility has placed the ARG-US RFIDs into the 910B storage vault for operational testing. This latest version (Mark III) of the Argonne RFID system now has the capability to measure radiation dose and dose rate. This paper will report field testing progress of the ARG-US RFID equipment in KAMS, the operability and reliability trend results associated with the applications of the system, and discuss the potential benefits in enhancing safety, security and materials accountability. The purpose of this Phase II K Area test is to verify the accuracy of the radiation monitoring and proper functionality of the ARG-US RFID equipment and system under a realistic environment in the KAMS facility. Deploying the ARG-US RFID system leads to a reduced need for manned surveillance and increased inventory periods by providing real-time access to status and event history traceability, including environmental condition monitoring and radiation monitoring. The successful completion of the testing program will provide field data to support a future development and testing. This will increase Operation efficiency and cost effectiveness for vault operation. As the next step (Phase II) of continued vault testing for the ARG-US system, the Savannah River Site K Area Material Storage facility has placed the ARG-US RFIDs into the 910B storage vault. Deploying the ARG-US RFID system lends to a reduced need for manned surveillance and increased inventory periods by providing real-time access to status and event history traceability, including radiation and environmental monitoring. The successful completion of the testing program will provide field data to support future development and testing.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Accelerating Scientific Workflows on HPC Platforms with In Situ Processing

Scientific workflows drive most modern large-scale science breakthroughs by allowing scientists to define their computations as a set of jobs executed in a given order based on their data dependencies. Workflow management systems (WMSs) have become key to automating scientific workflows-executing computational jobs and orchestrating data transfers between those jobs running on complex high-performance computing (HPC) platforms. Traditionally, WMSs use files to communicate between jobs: a job writes out files that are read by other jobs. However, HPC machines face a growing gap between their storage and compute capabilities. To address that concern, the scientific community has adopted a new approach called in situ, which bypasses costly parallel filesystem I/O operations with faster in-memory or in-network communications. When using in situ approaches, communication and computations can be interleaved. In this work, we leverage the Decaf in situ dataflow framework to accelerate task-based scientific workflows managed by the Pegasus WMS, by replacing file communications with faster MPI messaging. We propose a new execution engine that uses Decaf to manage communications within a sub-workflow (i.e., set of jobs) to optimize inter-job communications. We consider two workflows in this study: (i) a synthetic workflow that benchmarks and compares file- and MPI-based communication; and (ii) a realistic bioinformatics workflow that computes mu-tational overlaps in the human genome. Experiments show that in situ communication can improve the bioinformatics workflow execution time by 22% to 30% compared with file communication. Our results motivate further opportunities and challenges for bridging traditional WMSs with in situ frameworks.

Decaf↗

Analyzing the Effects of Climate and Thermal Configuration on Community Energy Storage Systems (Presentation)

Community energy storage (CES) has been proposed to mitigate the high variation in output from renewable sources and reduce peak load on the electrical grid. Thousands of these systems may be distributed around the grid to provide benefits to local distribution circuits and to the grid as a whole when aggregated. CES must be low cost to purchase and install and also largely maintenance free through more than 10 years of service life to be acceptable to most utilities.Achieving the required system life time is a major uncertainty for lithium-ion batteries. The lifetime and immediate system performance of batteries can change drastically with battery temperature, which is a strong function of system packaging, local climate, electrical duty cycle, and other factors. In other Li-ion applications, this problem is solved via air or liquid heating and cooling systems that may need occasional maintenance throughout their service life. CES requires a maintenance-free thermal management system providing protection from environmental conditions while rejecting heat from a moderate electrical duty cycle. Thus, the development of an effective, low-cost, zero-maintenance thermal management system poses a challenge critical to the success of CES. NREL and Southern California Edison have collaborated to evaluate the long-term effectiveness of various CES thermal configurations in multiple climates by building a model of CES based on collected test data, integrating it with an NREL-developed Li-ion degradation model, and applying CES electrical duty cycles and historic location-specific meteorological data to forecast battery thermal response and degradation through a 10-year service life.

25 ENERGY STORAGE↗

Hybrid Power Purchase Agreements for Flexible 24/7 Energy Delivery – A Comprehensive Review of Current Practices and Research Pathways

Power Purchase Agreements (PPAs) are becoming increasingly preferred among large energy consumers, such as data centers, to secure cost-effective energy and meet accelerating demand growth. Traditionally, variable renewable energy (VRE)-based PPAs operate on a pay-as-produced basis, balancing supply and demand for a relatively longer duration (e.g., annually). However, the focus is shifting toward matching supply and demand on an hourly basis to fully meet energy needs. This shift requires the integration of flexible energy resources, such as hydropower, thermal generation, and energy storage, to complement VRE sources like wind and solar, forming the foundation for 24/7 PPA. This work contributes by: (i) reviewing emerging market trends and current practices in PPA procurement, supported by data on PPA prices and technology portfolios; (ii) synthesizing the existing literature on modeling approaches for contract pricing, quantities, hybrid resource procurement, and risk management in 24/7 PPA design, while identifying key research gaps; and (iii) proposing an integrated 24/7 PPA design framework along with two contracting mechanisms from the perspectives of both PPA providers and consumers. The proposed framework highlights critical modeling challenges, risk-allocation issues, and future research opportunities for 24/7 PPA design.

24/7↗

Establishing and Maintaining the Digital Thread of Additively Manufactured Materials and Applications

Additive Manufacturing (AM) and Integrated Computational Materials Engineering (ICME) are complementary enabling technologies for design and manufacturing of “fit-for-purpose” materials. Both technologies will impact rapid material design, reduction in cost- and time-to-market for new applications, and discovery and implementation of new materials. An ICME approach to design, however, requires experimentally validated material models at multiple length and time scales, an integrated framework that can connect analysis tools with one another to ensure the digital thread of an application is maintained, and the manufacturing (e.g., AM) capability to leverage processing-structure-property-performance (PSPP) relationships to achieve spatially varying material properties where desired. AM enables the implementation of the design of an optimized, spatially varying microstructure through careful selection of the processing parameters used during an additively manufactured build. In order to establish these PSPP relations, a large amount of data is necessary, and that data must be properly captured, analyzed and maintained in an information management system that can establish the required traceability between various aspects of the design process to ensure an application’s digital thread is maintained (from design to end of life). Such an information management system must be able to capture feedstock material pedigree, resulting microstructure from various build parameters, subsequent mechanical properties derived from testing, developed material models, and enable spatial variations in material assignment in an engineering application. Furthermore, the information management system should be easily integrated with traditionally engineered materials in a single, centralized platform to enable an ICME optimization tool to explore both types of manufacturing processes. At NASA GRC, a robust, 21st century materials information management system has been previously developed with a focus towards enabling ICME. In this work, GRC’s ICME schema is extended to accommodate additively manufactured materials, enabling storage of both traditionally and additively manufactured materials in the same construct. The methodology for properly capturing additively manufactured materials across the entire material lifecycle is presented, following the previously established database best practices, as a potential framework for establishing PSPP relationships for additively manufactured materials and applying them to engineering applications.

Data management↗

FY2018 Long-Term PCT of ILAW Glasses (Final Report, Rev. 0)

About 50 million gallons of high-level mixed waste is currently stored in underground tanks at The United States Department of Energy’s (DOE’s) Hanford site in the State of Washington. The Hanford Tank Waste Treatment and Immobilization Plant (WTP) will provide DOE’s Office of River Protection (ORP) with a means of treating this waste by vitrification for subsequent disposal. The tank waste will be separated into low- and high-activity waste fractions, which will then be vitrified respectively into Immobilized Low Activity Waste (ILAW) and Immobilized High Level Waste (IHLW) products. The objective of the work described in this report is to perform testing, data collection, and analyses for the ILAW glass product to assess potential environmental risks associated with long-term storage.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗