SEARCH · Engineering Papers

Results for “DATA STORAGE SYSTEMS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Streaming Large-Scale Microscopy Data to a Supercomputing Facility

Data management is a critical component of modern experimental workflows. As data generation rates increase, transferring data from acquisition servers to processing servers via conventional file-based methods is becoming increasingly impractical. The 4D Camera at the National Center for Electron Microscopy generates data at a nominal rate of 480 Gbit s -1 (87,000 frames s -1 ⁠), producing a 700 GB dataset in 15 s. To address the challenges associated with storing and processing such quantities of data, we developed a streaming workflow that utilizes a high-speed network to connect the 4D Camera’s data acquisition system to supercomputing nodes at the National Energy Research Scientific Computing Center, bypassing intermediate file storage entirely. In this work, we demonstrate the effectiveness of our streaming pipeline in a production setting through an hour-long experiment that generated over 10 TB of raw data, yielding high-quality datasets suitable for advanced analyses. Additionally, we compare the efficacy of this streaming workflow against the conventional file-transfer workflow by conducting a postmortem analysis on historical data from experiments performed by real users. Our findings show that the streaming workflow significantly improves data turnaround time, enables real-time decision-making, and minimizes the potential for human error by eliminating manual user interactions.

4D-STEM↗

DOE OSTI2024

Curating Carbon Storage Data for Reuse: Enabling Research and Modeling from Earth’s Surface to Subsurface

The volume of public geologic carbon storage (GCS) data resources has continued to increase in recent years as the result of an increase in funding from government, industry, and academia towards national, basin, regional and field scale studies to ensure carbon capture and storage becomes a commercially viable operation. Despite the increasing volume of data, GCS data applied towards analyses such as geologic, cost, and risk modeling continues to be multi-sourced and often disparate in nature, published across government agencies, websites, data repositories and buried in derivative reports and documents. Much of the time preparing for an analysis and derivative product development is spent collecting, aggregating, transforming and preparing input data. There have been significant efforts within the DOE National Energy Technology Laboratory’s Carbon Storage Program to optimize multi-source, multi-scale subsurface geologic data curation and aggregation to support data discovery, interoperability, and reuse. Methods include the use of artificial intelligence, machine learning, and data science techniques. This talk will discuss the workflows, best practices, and processes developed to support the aggregation and curation of data through the whole system – surface to subsurface data - that support multi-scale, multi-purpose analysis for carbon storage research.

Morkner, Paige↗

DOE OSTI2025

Field Test Report Neutron Scintillator Array Dry Storage Cask Scanner FY2024

During two weeks of Field Testing at the Idaho National Laboratory INTEC Cask Farm in July and August 2024, the LLNL Dry Storage Cask Scanner Array was lifted on top of an MC-10 dry storage fuel cask and operated to acquire neutron and gamma-ray data from the 24 fuel bundle positions. Neutron and gamma-ray data acquisition scans across the top of the cask of varying dwell times were performed July 15-18, 2024 and August 19-22, 2024 to evaluate the ability of the scanner data to reveal asymmetries in the fuel positions that reflect asymmetries in the MC-10 cask fuel bundle loading. The MC-10 cask 24 position fuel bundle loading at the INTEC Cask Farm is well documented, including the locations of six empty fuel bundle positions. This loading presents an opportunity to test the ability of the scanner system to detect diversion of spent fuel bundles as well as to validate the MC-10 cask MCNP modeling. The cask scanner array consists of six Stilbene crystal scintillator detectors and a linear actuator frame that moves the six detectors across the MC-10 dry storage cask to obtain data above each of the 24 fuel bundle positions. The detectors are connected to a pulse-shape discrimination data acquisition system capable of generating separate neutron and gamma-ray spectra for each detector and for each scan position. From the prior single detector Field Test in 2021 and iteration with MCNP modeling, the neutron and gamma-ray data were analyzed in multiple energy regions to identify an analysis method that would provide the strongest and most consistent signature of the asymmetric MC-10 cask fuel loading1 . From both the 2021 Field Test and the current Field Test results, the neutron capture gamma-ray count rate around 2.2 MeV provides the strongest signature of the asymmetric MC-10 cask fuel loading and has qualitative agreement with MCNP calculations. Counting all gamma-rays produces a similar signature. Neutrons emerging from the cask top are moderated and captured by the hydrogen in the polyethylene moderator and scintillator detector, producing a 2.2 MeV gamma ray which is seen in the scintillator gamma-ray spectrum. The count rate in the 2.2 MeV gamma-ray region is ~50 c/s, which is ~1000x higher than the ~0.05 n/s rate in the > 4MeV neutron region, and ~50x greater than the ~1 n/s rate in the neutrons > 500 keV region. Analysis of the 2.2 MeV neutron-capture Compton-scattered gamma-rays produces a statistically significant signature of the INTEC Cask Farm MC-10 asymmetric fuel loading. MCNP simulations indicate that the average neutron energy spectrum offers the potential to detect a large asymmetry from several missing bundles as well as individual missing fuel bundles. Testing this feature will require measurements on a cask with single missing elements.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2024

An Efficient Checkpointing System for Large Machine Learning Model Training

As machine learning models increase in size and complexity rapidly, the cost of checkpointing in ML training became a bottleneck in storage and performance (time). For example, the latest GPT-4 model has massive parameters at the scale of 1.76 trillion. It is highly time and storage consuming to frequently writes the model to checkpoints with more than 1 trillion floating point values to storage. This work aims to understand and attempt to mitigate this problem. First, we characterize the checkpointing interface in a collection of representative large machine learning/language models with respect to storage consumption and performance overhead. Second, we propose the two optimizations: i) A periodic cleaning strategy that periodically cleans up outdated checkpoints to reduce the storage burden; ii) A data staging optimization that coordinates checkpoints between local and shared file systems for performance improvement.

machine learning, artificial intelligence↗

DOE OSTI2025

Properties of Electronic Materials

This final technical report summarizes the research conducted under DOE Grant DE-SC0002623, "Properties of Electronic Materials," led by Principal Investigator Shengbai Zhang at Rensselaer Polytechnic Institute. Over the 16-year period, the project employed first-principles computational methods to investigate the structural, electronic, and dynamic properties of a wide range of electronic materials, with applications in energy technologies, optoelectronics, and data storage. Key areas included topological insulators, phase-change materials, graphene and two-dimensional systems, perovskites for photovoltaics, defect engineering in semiconductors, kagome lattices, and ultrafast carrier dynamics. The research resulted in 115 peer-reviewed publications, advancing fundamental understanding of material behaviors at the atomic scale and contributing to innovations in renewable energy, memory devices, and quantum materials. Findings have implications for improving energy efficiency, developing lead-free solar cells, and enabling high-speed data processing. The work has trained numerous graduate students and postdocs, fostering the next generation of computational materials scientists. The original goals were to develop theoretical models and computational tools to predict and optimize electronic properties of materials for energy applications. All objectives were accomplished, with no major departures from planned methodologies. Challenges in computational scaling were addressed through access to high-performance computing resources.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Advanced defrosting techniques in air source heat pumps: A review of vapor injection, thermal energy storage, and experimental frost accumulation data

Electrification is a critical step for reducing greenhouse gas emissions from heating. Air source heat pumps (ASHPs) are a promising alternative to fossil fuel-based systems due to their high coefficients of performance (COP), dual heating and cooling capability, and lower carbon footprint. However, for ASHPs to achieve widespread adoption, they must operate reliably across all climates, including cold regions. Additionally, defrosting techniques should be energy efficient and minimally disruptive to indoor comfort. Vapor injection (VI) technology can address the high-pressure and high-temperature lift challenges encountered in low ambient conditions. More recently, in addition to enhancing heating performance, VI has also been shown to improve the speed and efficiency of reverse cycle defrosting. Likewise, thermal energy storage (TES) has steadily gained attention for its ability to serve as an auxiliary heat source during both normal operation and defrosting. This review analyzes the benefits and limitations of VI- and TES-assisted defrosting approaches. While both technologies show strong potential individually, no studies to date have explored their combined use in ASHP systems. Additionally, to support continued development of defrosting strategies, both in modeling and experimental work, it is critical to establish frost accumulation data under a range of operating conditions. By compiling the available data from the literature, this paper also highlights the limited availability of such experimental data and the wide variation in frosting and defrosting durations and termination criteria, which are often influenced by system design and test setups.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2025

Validation of Photovoltaic Modeling Tool Solargraf Against Measured Data

Solargraf is a cloud-based 3D design tool by Enphase Energy that allows users to design solar and storage systems with a variety of elements. Through a Cooperative Research and Development Agreement (CRADA), Enphase Energy collaborated with the National Renewable Energy Laboratory (NREL) to validate Solargraf's 3D design simulation against measured PV system performance. This study follows the same methodology of similar validation studies completed at NREL. The predicted performance results from simulations in both Solargraf and NREL's System Advisor Model (SAM) tool were compared with measured data to evaluate performance predictions.

14 SOLAR ENERGY↗

DOE OSTI2025

Pushing the limits of NAND technology scaling with ferroelectrics

Artificial intelligence (AI) continues to drive transformative advancements across various industries. The data-intensive nature of AI training (and inferencing) has resulted in the generation of unprecedented volumes of data with machine-generated content surpassing human-generated data by more than 100-fold in 2025. Efficiently managing this data influx necessitates advanced digital storage technologies. However, traditional NAND flash memory, which is critical for supporting data flows in AI systems—alongside high-bandwidth memory, for AI training—faces fundamental scaling limitations as it approaches the 1000-layer milestone, encompassing more than 40 trillion transistors. This article delves into the potential of hafnia-based ferroelectric materials as a breakthrough solution to these challenges. Recent advancements indicate that the intrinsic limitations of ferroelectric field-effect transistors (FEFETs) can be mitigated through material and device-level engineering. These advancements enable FEFETs to meet the stringent density, reliability, and scalability requirements of future three-dimensional NAND technology. The role of ferroelectrics in addressing NAND scaling challenges and expanding storage capabilities presents a promising avenue for meeting the storage demands of the AI-driven era.

3D NAND↗

DOE OSTI2025

Assessing the Performance and Impact of PV Technologies on Storage in Hybrid Renewable Systems

Traditional monofacial photovoltaic (mPV) systems are commonly adopted and well-documented because of their lower upfront costs in comparison to bifacial photovoltaic (bPV) systems. This study investigates how PV technologies impact energy storage in grid-scale hybrid renewable systems, focusing on optimizing and assessing the performance of mPV and bPV technologies integrated with pumped storage hydropower. Using Ludington City, Michigan as a case study and analyzing real-world data such as solar irradiance, ambient temperature, and utility-scale load profiles, the research highlights the operational and economic benefits of bPV systems. The results reveal that bPV systems can pump approximately 10.38% more water annually to the upper reservoir while achieving a lower levelized cost of energy ($0.0578/kWh for bPV vs. $0.0672/kWh for mPV). This study underscores the outstanding potential of bPV systems in enhancing energy storage and management strategies, contributing to a more sustainable and resilient renewable energy future.

13 HYDRO ENERGY↗

DOE OSTI2025

DEDUPKV: A Space-Efficient and High-Performance Key-Value Store via Fine-Grained Deduplication

Log-Structured Merge Tree (LSM-tree) based key-value stores excel in write-intensive environments but suffer from data duplication, consuming up to 49% of storage space in LSM-tree-based key-value store deployments. Traditional solutions like compression and coarse-grained file system-level deduplication introduce overhead or have limited effectiveness. In this study, we propose DedupKV, a fine-grained deduplication framework tailored for LSM-tree, maximizing data reduction efficiency while minimizing write stalls and read overheads. DedupKV features three key innovations: (1) FLUSH-integrated inline deduplication, which removes duplicates during memory-to-storage writes; (2) WAL file-based offline deduplication, repurposing write-ahead logs to avoid double writes; and (3) elastic execution, dynamically balancing inline and offline deduplication based on memory pressure and workload intensity. Additionally, dynamic granularity management reduces deduplication metadata overhead. We implemented these four ideas in RocksDB for the first time and conducted experiments in a Linux environment. Our evaluation shows that WAL file-based offline deduplication and DedupKV outperform BlobDB by 33% and 23%, respectively, in write-heavy workloads, while reducing write amplification by 1.2 ×, 2 ×, and 1.6 × for real KV datasets.

Jamil, Safdar [Sogang University]↗

DOE OSTI2026

Identifying Barriers to Solar and Storage Hybrids: Modeled vs. empirical wholesale market value and net-value for co-located solar + storage projects [Slides]

Large-scale (1MW+) co-located solar and battery storage projects are expanding rapidly in the United States, but their realized contribution to the bulk power system remains poorly understood because public project-level operating data are limited. The Lawrence Berkeley National Laboratory estimates the wholesale market value of 280 operational photovoltaic-plus-storage (PV+S) projects across the seven ISOs/RTOs and 19 additional balancing authorities, representing roughly 95% of the U.S. PV+S fleet in 2024. We model optimized hourly dispatch under energy, capacity, and ancillary-service market opportunities and compare the resulting value with standalone PV value, project-specific levelized cost estimates, and empirical operating or revenue data where available.

14 SOLAR ENERGY↗

DOE OSTI2025

Electrifying Airport GSE: Monte Carlo Grid Impacts

Airports globally are shifting from ICE-powered to electric Ground Support Equipment (eGSE) to enhance efficiency, reduce operational costs, and improve operator health. Leveraging predictable routes, flat terrain, and low operational speeds, airports provide ideal conditions for electrification. This study evaluates freight GSE electrification at Dallas-Fort Worth International Airport (DFW), USA, using the Agile@ platform, which integrates three analytical methods: Freight Facility Model (FFM), Activity-Structure-Intensity-Fuel (ASIF), and Monte Carlo simulations. Results from 10,000 simulations indicate modest but critical increases in electricity demand and significant variability in GSE energy consumption. These insights emphasize the importance of data-driven scheduling, targeted maintenance, and strategic infrastructure planning. For high-uncertainty scenarios, airports are advised to deploy buffer energy storage systems (battery banks), implement demand-response charging strategies, schedule flexible workforce shifts, and prioritize proactive maintenance-particularly for equipment with higher operational uncertainty, such as tug tractors with trailers. Agile@ thus offers a robust, scalable, and data-driven framework to optimize long-term GSE planning and enhance reliability across diverse airport environments.

Bose, Ranjan [ORNL] (ORCID:0009000791026327)↗

DOE OSTI2025

Cataloging Legacy Data from the Tritium Systems Test Assembly Program

The Tritium Systems Test Assembly (TSTA) at Los Alamos National Laboratory, operational from 1984 to 2001, was critical in advancing fusion fuel cycle technologies, including tritium storage, gas separation, and pumping. TSTA’s contributions, particularly in safe tritium operations, have influenced subsequent fusion projects. This paper discusses the ongoing effort to digitize and catalog TSTA’s historical data to create a searchable resource for the fusion research community. While the long-term objective is to develop a relational database for structured data management, the project remains in the early phase, with current efforts focused on scanning and indexing physical documents. Initial plans for database implementations are also presented, outlining key considerations for structure, query indexing, and standardization. As digitization progresses, future discussions will refine these implantation details to ensure an efficient and comprehensive system. This initiative aims to preserve critical legacy data, enhance the design of tritium system facilities, and support the next generation of fusion energy research.

42 ENGINEERING↗

DOE OSTI2025

The Persistent Challenge of Data Locality in the Post-Exascale Era

The era of exascale computing, exemplified by systems like Frontier achieving exaflop-level performance, marks a milestone. However, the quest for sheer compute power leads to strong imbalance in system design. Hence, scaling advancements in memory, network bandwidth, and storage are also necessary and pose challenges, with a crucial need to address data locality issues. This article underscores the fundamental importance of data locality as a key abstraction for optimizing application performance. Despite notable software solutions, the growing complexity of parallelism and memory hierarchy demands performance-portable data locality solutions across diverse computing platforms. Additionally, the article revisits data locality aspects, covering hardware considerations, application perspectives, software stack abstractions, and tool support. It concludes with insights into data locality challenges and opportunities, emphasizing the ongoing significance of collaborative research for progress in this critical issue.

Unat, Didem [Koc University, Istanbul (Turkey)] (O↗

DOE OSTI2026

Cybersecurity Standards for Distributed Energy Resources: Gaps and Harmonization Strategy

This report examines cybersecurity standards for Distributed Energy Resources (DERs) in light of their rapid growth and increasing integration into energy systems. It identifies critical gaps in existing frameworks, including inadequate coverage of DER-specific challenges, complexities in implementing comprehensive standards, integration issues with legacy systems, adoption hurdles for newer standards, and a lack of harmonization across regulatory landscapes. The analysis highlights vulnerabilities such as data integrity risks, unauthorized device control, and denial-of-service attacks across various DER technologies like solar PV, wind turbines, energy storage systems, and hydrogen fuel cells. The report proposes a harmonization strategy to address these deficiencies by developing unified cybersecurity requirements, certification programs, and training resources while fostering collaboration among stakeholders such as government agencies, industry groups, DER operators, manufacturers, and research institutions. A phased roadmap is outlined to refine and implement these measures through pilot testing and widespread adoption. Ultimately, the report underscores the urgent need for coordinated efforts to enhance DER cybersecurity and ensure the reliable operation of future energy systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2026

Advanced flip-coil system for magnetic field integral measurements of insertion devices

A novel flip-coil measurement system has been developed for the National Synchrotron Light Source II (NSLS-II) at Brookhaven National Laboratory. This paper describes the design, implementation, and commissioning of the new measurement bench, highlighting its key features, including improved mechanical stability, advanced data acquisition, and enhanced reproducibility. The system enables precise characterization of field integrals and multipole components, ensuring the optimal performance of Insertion Devices (IDs) before installation in the NSLS-II storage ring. The flip-coil system incorporates an innovative approach to minimize mechanical and electrical errors, which significantly improves the reproducibility of measurements. In addition, the system features a state-of-the-art data acquisition system that enables real-time monitoring and analysis, further enhancing the efficiency and accuracy of the measurement process. Furthermore, preliminary tests have demonstrated that the new system meets the stringent requirements for magnetic field characterization of advanced insertion devices, making it an essential tool for future ID commissioning and quality assurance at NSLS-II.

36 MATERIALS SCIENCE↗

DOE OSTI2025

E3SM‐GCAM: A Synchronously Coupled Human Component in the E3SM Earth System Model Enables Novel Human‐Earth Feedback Research

Abstract Modeling human‐environment feedbacks is critical for assessing the effectiveness of climate change mitigation and adaptation strategies under a changing climate. The Energy Exascale Earth System Model (E3SM) now includes a human component, with the Global Change Analysis Model (GCAM) at its core, that is synchronously coupled with the land and atmosphere components through the E3SM coupling software. Terrestrial productivity is passed from E3SM to GCAM to make climate‐responsive land use and CO 2 emission projections for the next 5‐year period, which are interpolated and passed to E3SM annually. Key variables affected by the incorporation of these feedbacks include land use/cover change, crop prices, terrestrial carbon, local surface temperature, and climate extremes. Regional differences are more pronounced than global differences because the effects are driven primarily by differences in land use. This novel system enables a new type of scenario development and provides a powerful modeling framework that facilitates the addition of other feedbacks between these models. This system has the potential to explore how human responses to climate change impacts in a variety of sectors, including heating/cooling energy demand, water management, and energy production, may alter emissions trajectories and Earth system changes. Plain Language Summary Earth system models help us understand how humans are changing the climate. Currently, these models do not include human systems, so predetermined greenhouse gas, aerosol, and land use change data are input to these models. These data do not reflect human responses to changes projected by Earth system models. We have added a human component to an Earth system model to represent human responses to environmental change and calculate corresponding greenhouse gas and land use change data instead of using predetermined data. Including this human component changes projections of land use, land carbon storage, and regional climate. Key Points We have incorporated a novel, advanceable human component in an Earth system model to simulate human‐Earth feedbacks Including terrestrial productivity feedbacks from the Earth to the human systems affects land change, crop prices, carbon, and climate Regional effects of including terrestrial productivity feedbacks are greater than global effects because land change is the main driver

E3SM↗

DOE OSTI2024

Large-Scale Hydrogen Storage Cyber Risk Assessment

Hydrogen storage systems may become more widely deployed throughout the country, and so it is possible that individual and interconnected systems will be exposed to cyber-attacks. These events can cause physical and financial harm to employees, people in the vicinity of the facility, and the company that owns the facility. The two main ways bad actors may access information or control from a hydrogen storage facility are through information technology and operations technology devices, the former of which refers to data and information from networked devices and the latter of which refers to onsite controls for the physical system. Both types of entryways into the system should be considered when companies conduct cyber risk assessments and when regulators develop or revise relevant codes and standards. This report analyzes cybersecurity risks associated with a generic hydrogen storage system by outlining the system's purpose and the importance of its cybersecurity. The hydrogen storage system architecture and communication protocols are provided to understand potential cyber vulnerabilities. Later, an event tree analysis is performed on hydrogen operation to identify system weaknesses by outlining potential attack scenarios. This report also identifies critical cyber assets related to different hydrogen operations followed by an examination of potential threats, and the impact of cyber assets on those operational assets.

08 HYDROGEN↗