Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “storage throughput”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Deploying and Operating CephFS for Scientific Applications at Fermilab

Fermilab has been running a Ceph cluster in production for several years to support high-throughput scientific computing. Our primary use case is CephFS, which serves interactive data analysis workloads, with growing interest in using RGW for scalable object storage of scientific datasets. In this talk, we'll share lessons learned from successfully deploying and maintaining our Ceph cluster with cephadm, including challenges faced, performance tuning, and operational practices. We'll also present custom tools we've developed to streamline monitoring and management and discuss how Ceph fits into our broader storage architecture for large-scale scientific research.

Peisker, Alison [Fermilab]↗
NASA NTRS1980

Packet communications in satellites with multiple-beam antennas and signal processing

A communication satellite with a multiple-beam antenna and onboard signal processing is considered for use in a 'message-switched' data relay system. The signal processor may incorporate demodulation, routing, storage, and remodulation of the data. A system user model is established and key functional elements for the signal processing are identified. With the throughput and delay requirements as the controlled variables, the hardware complexity, operational discipline, occupied bandwidth, and overall user end-to-end cost are estimated for (1) random-access packet switching; and (2) reservation-access packet switching. Other aspects of this network (eg, the adaptability to channel switched traffic requirements) are examined. For the given requirements and constraints, the reservation system appears to be the most attractive protocol.

Davies, R.↗
DOE OSTI2025

VA EDH Advanced Software Pipeline Framework Report: Enhancing Automation and Scalability

The VA Environmental Determinants of Health (EDH) Advanced Software Pipeline Framework is designed to enhance the efficiency, scalability, and security of geospatial data processing workflows. This framework integrates modern data orchestration and containerization technologies, including Prefect for workflow automation, Docker for containerization, and PostgreSQL/PostGIS for geospatial data storage and analysis. It ensures standardized, reproducible, and automated data processing, supporting VA objectives related to substance use risk assessment and recovery research. The pipeline addresses key scalability and performance challenges through horizontal and vertical scaling, high-performance computing (HPC) integration, parallel processing, task caching, and dynamic resource allocation. These optimizations improve throughput and reduce latency, allowing the system to efficiently manage large and complex datasets. Additionally, security and compliance measures—such as data encryption (SSL), Role-Based Access Control (RBAC), and adherence to GDPR and HIPAA standards—safeguard sensitive information throughout data transmission and storage. A key implementation of this framework includes the automation of shelter list geolocation workflows, ensuring that up-to-date data is readily available for VA decision-making. Lessons learned from this project include the transition from in-memory processing to incremental storage writes, improving resource management and reliability. Future enhancements aim to expand automation, integrate AI-driven anomaly detection, and incorporate high-performance computing resources. This framework provides a scalable, secure, and adaptable solution for managing geospatial datasets, reinforcing the VA’s ability to support clinical and strategic initiatives through data-driven decision-making.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Machine learning for the redox potential prediction of molecules in organic redox flow battery

Here, organic redox flow batteries (ORFB) are recognized as an innovative technology for the large-scale storage of renewable energy. The redox potential of organic redox-active molecules plays a vital role in their performance. Advanced screening techniques like high-throughput experiment and machine learning (ML) have significantly enhanced organic material performance and transformed the field of ORFB. However, the scarcity of experimental data poses a considerable challenge for ML model development in this domain. In our study, we developed lightweight graph-based Gaussian process regression (GPR) models with GPU-accelerated marginalized graph kernel and hybrid kernel to predict the redox potentials of organic redox-active molecules for ORFBs, specifically focusing on small datasets. To evaluate model accuracy, we created a new experimental database of organic redox-active molecules by the data from hundreds of published papers and assembled previous computational datasets. We also considered some key parameters, such as pH conditions and solvent type, to assess their impact on redox potential prediction. Our GPR model predicted redox potentials with high accuracy across all datasets using minimal training data. The study provides powerful tools for molecule screening and design and delivers valuable guidance on designing training datasets for costly experiments.

25 ENERGY STORAGE↗
DOE OSTI2020

Density Functionals for Hydrogen Storage: Defining the H2Bind275 Test Set with Ab Initio Benchmarks and Assessment of 55 Functionals

Efficient and high-capacity storage materials are indispensable for a hydrogen-based economy. In silico tools can accelerate the process of discovery of new adsorbent materials with optimal hydrogen adsorption enthalpies. Density functional theory is well-poised to become a very useful tool for enabling high-throughput screening of potential materials. In this work, we have identified density functional approximations that provide good performance for hydrogen binding applications following a two-pronged approach. First, we have compiled a data set (H2Bind275) that comprehensively represents the hydrogen binding problem capturing the chemical and mechanistic diversity in the binding sites encountered in hydrogen storage materials. We have also computed reference interaction energies for this data set using coupled-cluster theory. Second, we have assessed the performance of 55 density functional approximations for predicting H 2 interaction energies and have identified two hybrid density functionals (ωB97X-V and ωB97M-V), two double hybrid density functionals (DSD-PBEPBE-D3(BJ) and PBE0-DH), and one semilocal density functional (B97M-V) as the best performing ones. We have recommended the addition of empirical dispersion corrections to systematically underbinding density functionals such as revPBE, BLYP, and B3LYP for improvements in performance at negligible additional cost. We have also recommended the usage of the def2-TZVPP basis set as it represents a good compromise between accuracy and cost, limiting the finite basis set errors to less than 1 kJ/mol.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Towards a self-driving trigger at the LHC: adaptive response in real time

Real-time data filtering and selection—or trigger—systems at high-throughput scientific facilities such as the experiments at the Large Hadron Collider must process extremely high-rate data streams under stringent bandwidth, latency, and storage constraints. Yet these systems are typically designed as static, hand-tuned menus of selection criteria grounded in prior knowledge and simulation. In this work, we further explore the concept of a self-driving trigger, an autonomous data-filtering framework that reallocates resources and adjusts thresholds dynamically in real-time to optimize signal efficiency, rate stability, and computational cost as instrumentation and environmental conditions evolve. We introduce a benchmark ecosystem to emulate realistic collider scenarios and demonstrate real-time optimization of a menu including canonical energy sum triggers as well as modern anomaly-detection algorithms that target non-standard event topologies using machine learning. Using simulated data streams and publicly available collision data from the Compact Muon Solenoid experiment, we demonstrate the capability to dynamically and automatically optimize trigger performance under specific cost objectives without manual retuning. Our adaptive strategy shifts trigger design from static menus with heuristic tuning to intelligent, automated, data-driven control, unlocking greater flexibility and discovery potential in future high-energy physics analyses.

Emami, Shaghayegh [Michigan U.] (ORCID:00090007589↗
NASA NTRS2007

A Disk-Based System for Producing and Distributing Science Products from MODIS

Since beginning operations in 1999, the MODIS Adaptive Processing System (MODAPS) has evolved to take advantage of trends in information technology, such as the falling cost of computing cycles and disk storage and the availability of high quality open-source software (Linux, Apache and Perl), to achieve substantial gains in processing and distribution capacity and throughput while driving down the cost of system operations.

Masuoka, Edward↗
DOE OSTI2026

Learning to Trigger: Reinforcement Learning at the Large Hadron Collider

High-throughput scientific facilities such as the Large Hadron Collider depend on real-time event filtering (\textit{triggering}) under tight constraints on bandwidth, latency, and storage. In practice, trigger menus are largely static and hand-tuned and can become suboptimal as detector conditions, pileup, and background composition drift over time. We cast online threshold tuning as a sequential decision-making problem: a reinforcement learning agent ingests streaming summaries of recent rates and signal-sensitive features and updates trigger thresholds to maximize signal efficiency while tracking a target background rate within a tolerance band. We adapt Group-Filtered Policy Optimization (GFPO) to streaming control and introduce two variants (GFPO-F, GFPO-FR) that enforce background rate feasibility during training. On a benchmark that emulates realistic collider operation, we study two representative triggers: a total transverse energy ($H_{T}$) trigger sensitive to pileup variation, and an anomaly-detection (AD) trigger based on reconstruction loss for rare or non-standard signatures. On Monte Carlo streams, our agent increases the fraction of in-tolerance time intervals by 48% ($H_T$) and 28% (AD), with a cumulative gain of up to 2% in signal efficiency on those in-tolerance intervals. Transferring from simulation to \emph{real} collision data (CMS Run 283408), the same agent, without fine-tuning, achieves a 56% ($H_T$) and 28% (AD) in-tolerance improvement over baselines, with further signal-efficiency gain on both triggers. To our knowledge, this is the \emph{first} demonstration of RL-based trigger control on real Large Hadron Collider collision data. Code is available at https://github.com/Zixind/GFPO_LHC (see repo for details).

Ding, Zixin [Chicago U.]↗
DOE OSTI2023

High-throughput screening of hypothetical metal-organic frameworks for thermal conductivity

Thermal energy management in metal-organic frameworks (MOFs) is an important, yet often neglected, challenge for many adsorption-based applications such as gas storage and separations. Despite its importance, there is insufficient understanding of the structure-property relationships governing thermal transport in MOFs. To provide a data-driven perspective into these relationships, here we perform large-scale computational screening of thermal conductivity k in MOFs, leveraging classical molecular dynamics simulations and 10,194 hypothetical MOFs created using the ToBaCCo 3.0 code. We found that high thermal conductivity in MOFs is favored by high densities (> 1.0 g cm -3 ), small pores (< 10 Å), and four-connected metal nodes. We also found that 36 MOFs exhibit ultra-low thermal conductivity (< 0.02 W m -1 K -1 ), which is primarily due to having extremely large pores (~65 Å). Furthermore, we discovered six hypothetical MOFs with very high thermal conductivity (>10 Wm -1 K -1 ), the structures of which we describe in additional detail.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Disinfection system with high throughput and low power requirements

Devices, methods and techniques are disclosed to perform high confidence sterilization of indoor air with low power requirements. In one example aspect, a sterilization device includes a power source, an energy storage coupled to the power source and configured to store electric charges, a set of electrodes arranged in a specified geometry to have a fixed characteristic impedance, and a switch positioned between the energy storage and the set of electrodes. The switch is configured to operate to establish a pulsed electric field on the set of electrodes.

Sampayan, Stephen↗
DOE OSTI2022

Moving small files in a networked environment

Globally distributed computing infrastructures, such as clouds and supercomputers, are currently used to manage data that is generated with an unprecedented speed from a variety of resources. Coping with this trend, the volume of data exchanged across distant sites increases substantially. To accelerate data transfer, high-speed networks are provided to connect remote sites. Most existing data movement solutions are optimized for moving large files. However, it is still challenging to transfer a large number of small files across networks. This disadvantage not only lowers data transfer performance, but also decreases overall system utilization. Here, we identify that moving small files is mainly constrained by degraded file system throughput, not just network performance as might be suspected. We have built a data transfer pipeline model to analyze the impact of small network I/O and storage I/O on data movement. Extending one of the widely used open source data movement solutions, GridFTP, we demonstrate several appropriate engineering approaches that mitigate the bottleneck and increase data transfer efficiency. We show optimizations that improve data transfer performance more than 5 times. In comparison to existing solutions, our approaches can save a significant amount of system resources for moving lots of small files.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2020

NASA Exploration Systems & Habitation (X-Hab)Academic Innovation Challenge 2020: Microgravity Gas/Liquid Separator for the CO2 Revitalization System Final Report

This report outlines the efforts of UNT X-Hab Team on a project titled, Microgravity Gas/Liquid Separator for the CO2 Revitalization System. The project is executed as a senior design project during academic year 2019-2020. The X-Hab 2020 Academic Innovation Challenge has selected eleven senior design teams from colleges across the US to demonstrate working prototypes for exploration systems and habitation. UNT has been tasked with the creation of a gas-liquid separator for an air revitalization system. Air revitalization technology has been used to support spaceflight by removing CO2 from enclosed systems in order to maintain breathable air. Solid sorbents such as zeolites or lithium hydroxide have been used in the past for these systems but are difficult to handle in microgravity environments and require a large amount of energy. This challenge aims to demonstrate vortex phase separator (VPS) technology for removing H2O from a CO2 stream. However, VPS technology also has the capability of using liquid sorbents for removing CO2 from an air stream. Further research could be done on liquid sorbents, such as liquid amine, in use with VPS systems. This would potentially be an alternative technology in replacing use of solid sorbents in CO2 removal systems. In 2019, NASA proposed a design that uses a gas/liquid contactor to allow for efficient contact between the two fluid phase. This was integrated into an overall CO2 removal system. The subsystems for gas-liquid separation and storage in NASA’s previous models for CO2 removal system could be replaced with a VPS. Innovative vortex separator technology is expected to allow for high throughput flow and highly efficient CO2 removal compared to other gas-liquid separation technologies. VPS relies on centripetal driven buoyancy forces to form a gas-liquid vortex within a fixed, right circular cylinder. The gas stream enters the separator through a tangential nozzle and breaks into very small bubbles (<<1 mm) resulting in a very large contact surface area for interaction with the liquid stream via energy and mass exchange. VPS technology can handle mismatches in inlet and outlet flow rates and system volume changes through the range of liquid thickness held in the separator (i.e., buffering and accumulating capability), and requires low pressure differences (<5-10 in H2O in most cases) for operation. The X-Hab 2020 team leverages these characteristics to investigate VPS technology as an alternative CO2 removal technology.

Alyssa Sarvadi↗
NASA NTRS2011

High-Throughput, Adaptive FFT Architecture for FPGA-Based Spaceborne Data Processors

Exponential growth in microelectronics technology such as field-programmable gate arrays (FPGAs) has enabled high-performance spaceborne instruments with increasing onboard data processing capabilities. As a commonly used digital signal processing (DSP) building block, fast Fourier transform (FFT) has been of great interest in onboard data processing applications, which needs to strike a reasonable balance between high-performance (throughput, block size, etc.) and low resource usage (power, silicon footprint, etc.). It is also desirable to be designed so that a single design can be reused and adapted into instruments with different requirements. The Multi-Pass Wide Kernel FFT (MPWK-FFT) architecture was developed, in which the high-throughput benefits of the parallel FFT structure and the low resource usage of Singleton s single butterfly method is exploited. The result is a wide-kernel, multipass, adaptive FFT architecture. The 32K-point MPWK-FFT architecture includes 32 radix-2 butterflies, 64 FIFOs to store the real inputs, 64 FIFOs to store the imaginary inputs, complex twiddle factor storage, and FIFO logic to route the outputs to the correct FIFO. The inputs are stored in sequential fashion into the FIFOs, and the outputs of each butterfly are sequentially written first into the even FIFO, then the odd FIFO. Because of the order of the outputs written into the FIFOs, the depth of the even FIFOs, which are 768 each, are 1.5 times larger than the odd FIFOs, which are 512 each. The total memory needed for data storage, assuming that each sample is 36 bits, is 2.95 Mbits. The twiddle factors are stored in internal ROM inside the FPGA for fast access time. The total memory size to store the twiddle factors is 589.9Kbits. This FFT structure combines the benefits of high throughput from the parallel FFT kernels and low resource usage from the multi-pass FFT kernels with desired adaptability. Space instrument missions that need onboard FFT capabilities such as the proposed DESDynl, SWOT (Surface Water Ocean Topography), and Europa sounding radar missions would greatly benefit from this technology with significant reductions in non-recurring cost and risk.

NguyenKobayashi, Kayla↗
DOE OSTI2025

ASEAN Technical Exchange Workshop for System Operators, Regulators, and Policymakers

This presentation provides an in-depth exploration of power system planning, cross-border electricity trading, and battery energy storage systems (BESS), offering actionable insights for system operators, regulators, and policymakers. The first section delves into power system planning and analysis, focusing on capacity expansion models and resource adequacy studies, including their role in optimizing system efficiency, managing emissions, and addressing system reliability risks. Key considerations, such as integration of transmission into generation planning and the forecasting versus optimization of customer distributed energy resources (DER) technologies, are explored. The session highlights critical trade-offs in spatial granularity and model runtimes, as well as the feasibility of aligning distribution investments with capacity expansion efforts. The second section examines cross-border electricity trading, with an emphasis on resource adequacy concepts such as reliability targets, loss of load expectation (LOLE), and planning reserve margins (PRM). Case studies on reserve market design and coordination across US regions provide insights into improving reserve deliverability and managing interregional power balance and congestion. This section also addresses market-to-market congestion management, including advanced strategies for high-voltage direct current (HVDC) optimization and ancillary service delivery. Finally, the presentation covers the rapid evolution of Battery Energy Storage Systems (BESS), highlighting their operational growth, regulatory frameworks, and use cases in grid flexibility, energy storage, and reliability. The discussion focuses on the benefits of BESS for system stability, resilience, and integration of renewable energy, offering insights into its role as a vital component in the transition toward a more sustainable and flexible grid. Key performance parameters, such as throughput, round-trip efficiency, and state of charge, are also examined.

25 ENERGY STORAGE↗
NASA NTRS1991

The Mees CCD imaging spectrograph

The Mees CCD (MCCD0 instrument is an imaging spectroscopy device which uses the 25-cm coronagraph telescope and the 3.0-m Coude spectrograph at Mees Solar Observatory on Haleakala, Maui. The instrument works with resolving power up to about 200,000 with significant throughput from 3934 A (Ca II K) to about 10,000 A. A fast guiding active mirror stabilizes the image during observations. A rapidly writing magnetic tape storage system allows observations to be recorded at 256 kbytes/s. Currently, the MCCD is used for imaging spectroscopy of solar flares at 6563 A (H-alpha), and velocity measurements of umbral oscillations; future plans include emission line studies of active region coronae, and photospheric studies of solar oscillations.

Penn, Matthew J.↗
DOE OSTI2021

Computation-guided discovery of coating materials to stabilize the interface between lithium garnet solid electrolyte and high-energy cathodes for all-solid-state lithium batteries

All-solid-state batteries with a lithium metal anode, enabled by lithium garnet solid electrolytes such as Li 7 La 3 Zr 2 O 12 (LLZO), are a promising next-generation energy-storage technology. The further development of all-solid-state battery requires the integration of high-energy cathodes such as LiNi 1-x-y Mn x Co y O 2 (NMC) with the garnet solid electrolyte with stable and low-resistance interfaces, which requires a coating layer to stabilize the interface during high-temperature sintering and electrochemical cycling. In order to guide the future development of interfacial coatings, we perform high-throughput thermodynamic analyses based on first-principles computation to investigate the stability of LLZO garnet and high-energy NMC cathodes with a wide range of materials chemistries. Here our study reveals the factors governing the materials stability with LLZO garnet and NMC cathodes, and identifies the mechanisms of good coating layers stable with LLZO and NMC. In addition to classifying known coating layers, our study provides detailed guiding charts and multiple new materials systems as promising coatings for stabilizing LLZO—NMC interfaces to enable high-energy-density garnet-based all-solid-state batteries. Our demonstrated computation scheme and high-throughput analyses are generally applicable to investigate and screen coating materials for stabilizing interfaces in energy-related applications.

25 ENERGY STORAGE↗
NASA NTRS2008

Delay-Throughput Performance the Deep-Space Ka-Band Link

In this paper, performance of a first-in, first-out (FIFO), selective retransmission scheme for the deep-space Ka-band link is presented and compared to the performance of a comparable X-band link. In this analysis, 16 months of water vapor radiometer (WVR) and advanced water vapor radiometer (AWVR) data from the three Deep Space Network (DSN) Communication Complexes (DSCC) were used to emulate weather effects on X-band and Ka-band links from Mars. Mars Reconnaissance Orbiter (MRO) X-band and Ka-band telecommunications parameters were used for spacecraft telecommunications capabilities. One pass per week per complex was selected from MRO's Deep Space Network (DSN) schedule from April 1, 2006 to August 31, 2007 for a total of 207 passes (69 passes per complex) for this analysis. For each pass both X-band and Ka-band links were designed using at most two data rates so that the expected pass capacity would be maximized subject to a minimum availability requirement (MAR). In conjunction with the WVR/AWVR data, elevation profiles of the selected passes and models for the performance of the antennas in the DSN were used to emulate the performance of both links. It was assumed that the retransmission of the data takes place not on the same pass as the original transmission but during subsequent passes. The data collected before a pass was assumed to be a fraction of the expected capacity of the pass as calculated through the link design process. Infinite spacecraft storage was assumed to obtain an upper bound on the spacecraft storage requirement. The independent parameters of this analysis were MAR and the ratio of data collected before a pass to the expected pass capacity. Since the selected passes did not occur at regular intervals, the delay in this analysis was measured in terms of number of passes. The throughput was measured in terms of number of bits received successfully on the ground. The results indicate that reasonable delay performance could be achieved with very high throughput for relatively low MAR values for data collection to expected pass capacity ratio of around 97% for Ka-band. The results indicate that, except for very low average delay requirements, the Ka-band link provides more than twice the throughput of the X-band link for the same amount of power consumed by the spacecraft. In addition, the results indicate that the required storage onboard the spacecraft is not prohibitive and good performance could be achieved by using a buffer size less than three times the maximum amount of data collected before a pass.

Shambayati, Shervin↗