Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance bound”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Finely tuning the microporosity in phosphoric acid doped triptycene-containing polybenzimidazole membranes for highly permselective helium and hydrogen recovery

High-performance polymer membranes with well-defined microporosity and size-sieving ability are especially attractive for helium and hydrogen recovery. Here, in this study, we report novel macromolecular engineering of polybenzimidazole (PBI) membranes that integrate hierarchical triptycene units for high permeability and polyprotic acid doping for size sieving via controllable manipulation of microporous architecture. The triptycene moieties disrupt chain packing and introduce additional configurational free volume, leading to significantly boosted He and H 2 permeabilities compared to previously reported PBI membranes. The acid doping resulted in crosslinked PBI membranes via hydrogen bonding and proton transfer with dramatically enhanced gas selectivities. Via adjusting the H 3 PO 4 -doping level, triptycene-based polybenzimidazole (TPBI) composite membranes (TPBI-(H 3 PO 4 ) x ) exhibit the highest gas selectivities for He enrichment (i.e., α(He/CH 4 ) = 7052 ± 156) and H 2 purification (i.e., α(H 2 /CH 4 ) = 5128 ± 110) among existing polymeric gas separation membranes. Additionally, under mixed-gas conditions at 150 °C, the TPBI-(H 3 PO 4 ) 0.98 membrane displays a H 2 permeability of 46.7 Barrer and a H 2 /CO 2 selectivity of 16, far beyond the Robeson's 2008 upper bound for H 2 /CO 2 separation. The facile and diverse tunability and excellent gas separation performance make TPBI-(H 3 PO 4 ) x membranes highly attractive for helium and hydrogen separation.

42 ENGINEERING↗

Dynamic consensus and extended high gain observers as a tool to achieve practical frequency synchronization in power systems under unknown time-varying power demand

In this paper, we consider the frequency synchronization problem in a network of lossless, connected, and network-reduced power system. Frequency synchronization is an important problem in power systems as frequency deviation can lead to degraded power quality, tripping of generators, etc. We present a load-estimator-based consensus algorithm in a network of fourth-order generator models that achieves practical frequency synchronization in the presence of unknown time-varying power demand. We do not assume that the demand is generated by a known model. We follow a multiple time-scale approach for the stability analysis. It is shown that synchronization is achieved for the case of constant power demand, by showing that the system is exponentially stable. Furthermore, for the case of time-varying power demand, we show the error trajectories are ultimately bounded, and the synchronization error is proportional to an upper bound on the derivative of the time-varying power demand. We simulate the controller performance on a four area network which is equivalent to the IEEE New England 39-Bus system.

42 ENGINEERING↗

A deep dilated convolutional residual network for predicting interchain contacts of protein homodimers

Abstract Motivation Deep learning has revolutionized protein tertiary structure prediction recently. The cutting-edge deep learning methods such as AlphaFold can predict high-accuracy tertiary structures for most individual protein chains. However, the accuracy of predicting quaternary structures of protein complexes consisting of multiple chains is still relatively low due to lack of advanced deep learning methods in the field. Because interchain residue–residue contacts can be used as distance restraints to guide quaternary structure modeling, here we develop a deep dilated convolutional residual network method (DRCon) to predict interchain residue–residue contacts in homodimers from residue–residue co-evolutionary signals derived from multiple sequence alignments of monomers, intrachain residue–residue contacts of monomers extracted from true/predicted tertiary structures or predicted by deep learning, and other sequence and structural features. Results Tested on three homodimer test datasets (Homo_std dataset, DeepHomo dataset and CASP-CAPRI dataset), the precision of DRCon for top L/5 interchain contact predictions (L: length of monomer in a homodimer) is 43.46%, 47.10% and 33.50% respectively at 6 Å contact threshold, which is substantially better than DeepHomo and DNCON2_inter and similar to Glinter. Moreover, our experiments demonstrate that using predicted tertiary structure or intrachain contacts of monomers in the unbound state as input, DRCon still performs well, even though its accuracy is lower than using true tertiary structures in the bound state are used as input. Finally, our case study shows that good interchain contact predictions can be used to build high-accuracy quaternary structure models of homodimers. Availability and implementation The source code of DRCon is available at https://github.com/jianlin-cheng/DRCon. The datasets are available at https://zenodo.org/record/5998532#.YgF70vXMKsB. Supplementary information Supplementary data are available at Bioinformatics online.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Constraining neutrinophilic mediators at FASER ν , FLArE, and FASER ν 2

High energy collider neutrinos have been observed for the first time by the FASER ν experiment. The detected spectrum of collider neutrinos scattering off nucleons can be used to probe neutrinophilic mediators with GeV-scale masses. We find that constraints on the pseudoscalar (axial vector) neutrinophilic mediator are close to the scalar (vector) case since they have similar cross section in the neutrino massless limit. We perform an analysis on the measured muon spectra at FASER ν , and find that the bounds on the vector mediator from the current FASER ν data are comparable to the existing bounds at m Z ′ ≈ 0.2 GeV . We also study the sensitivities to a neutrinophilic mediator at future Forward Physics Facilities including FLArE and FASER ν 2 by using both the missing transverse momentum and the charge identification information. We find that FLArE and FASER ν 2 can impose stronger bounds on both the scalar and vector neutrinophilic mediators than the existing bounds. The constraints on the scalar mediator can reach 0.08 (0.1) for m ϕ ≲ 1 GeV with (without) muon charge identification at FASER ν 2 . Published by the American Physical Society 2024

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Blackstart and Fault Ride-Through Capability of DFIG-Based Wind Turbines

Grid-forming wind turbines must be able to re-energize transmission branches, motor loads, unbalanced loads, and power electronics loads following a blackout. Further, they must ride through faults that can arise during restoration. To tackle these challenges, this paper sets forth a grid-forming control strategy for wind turbines using doubly-fed induction generators (DFIGs). In particular, a special set of feedforward control loops are engineered to mitigate the impacts of restoration transients as well as symmetrical and asymmetrical faults on the regulation of DFIG rotor currents and stator voltages. This paper also leverages two-axis anti-windup regulators to bound two-axis voltage and current commands within ratings. As a result, the controller performance is demonstrated via a high-fidelity simulation model of a notional wind-dominant grid.

17 WIND ENERGY↗

Leveraging Free Volume Manipulation to Improve the Membrane Separation Performance of Amine‐Functionalized PIM‐1

Abstract Gas‐separation polymer membranes display a characteristic permeability–selectivity trade‐off that has limited their industrial use. The most comprehensive approach to improving performance is to devise strategies that simultaneously increase fractional free volume, narrow free volume distribution, and enhance sorption selectivity, but generalizable methods for such approaches are exceedingly rare. Here, we present an in situ crosslinking and solid‐state deprotection method to access previously inaccessible sorption and diffusion characteristics in amine‐functionalized polymers of intrinsic microporosity. Free volume element (FVE) size can be increased while preserving a narrow FVE distribution, enabling below‐upper bound polymers to surpass the H 2 /N 2 , H 2 /CH 4 , and O 2 /N 2 upper bounds and improving CO 2 ‐based selectivities by 200 %. This approach can transform polymers into chemical analogues with improved performance, thereby overcoming traditional permeability–selectivity trade‐offs.

Mizrahi Rodriguez, Katherine↗

T-FSM: A Scalable Distributed Task-Based System for Frequent Subgraph Pattern Mining from a Big Graph

Finding frequent subgraph patterns in a big graph is an important problem with many applications such as classifying chemical compounds and building indexes to speed up graph queries. Since this problem is NP-hard, some recent parallel and distributed systems have been developed to accelerate the mining. However, they often have a huge memory cost, very long running time, suboptimal load balancing, poor scale-out capability, and possibly inaccurate results. In this article, we propose an efficient system called T-FSM for parallel mining of frequent subgraph patterns in a big graph. T-FSM supports a new anti-monotonic frequentness measure called Fraction-Score, which is more accurate than the widely used MNI measure. The execution engine of T-FSM supports both intra-machine parallelism and inter-machine parallelism. For intra-machine parallelism, T-FSM adopts a novel task-based execution model to ensure high multithreading concurrency, bounded memory consumption, and effective load balancing. For inter-machine parallelism, T-FSM ensures good scale-out performance with a lightweight pattern rebalancing approach that reduces workload skewness of pattern evaluations among machines. To avoid recomputing the contexts for migrated patterns, we design a novel context cache table to support concurrent and asynchronous requesting and caching of remote context data, which can timely evict and garbage collect used pattern contexts that are no longer needed to keep memory consumption bounded. Extensive experiments show that T-FSM is orders of magnitude faster than existing state-of-the-art parallel systems (more than 10×, 51×, 131×, 55× speedup over ScaleMine, DistGraph, Pangolin and Peregrine, respectively) and distributed systems (more than 42× and 88× over ScaleMine and DistGraph, respectively) for frequent subgraph pattern mining, and it scales out satisfactorily to 512 CPU cores on the Polaris supercomputer at Argonne National Laboratory.

97 MATHEMATICS AND COMPUTING↗

Implementation Plan for Combined Heat and Power Systems VOLTTRON Controller: Performance Monitoring and Real-Time Commissioning Algorithm Verification

Building-integrated cooling, heating, and power (CHP) systems are more efficient than conventional systems at providing local power and thermal energy, and favorable fuel prices are bound to spur their increased adoption. However, to realize the full benefit of the CHP systems, we must ensure persistence of energy efficient operations. Much of the inefficiency in the current building operations can be eliminated by use of automated performance monitoring (PM), real-time commissioning verification (CxV) and automated fault detection and diagnostic (AFDD) tools. Automation can help system operators make intelligent decisions. Remote and continuous monitoring of system conditions and performance will enable better management and integration of CHP with existing building systems. Continuous PM, real-time CxV, and AFDD could alleviate burdens for operations staff, enhance operations and maintenance (O&M), and improve reliability of building and CHP systems. To address the O&M challenges and to provide a means to maximize the rate-of-return of building-integrated CHP systems, the Building Technologies Office (BTO) within the U.S. Department of Energy’s (DOE’s) Office of Energy Efficiency and Renewable Energy (EERE) initiated a project to design, develop, and field test a VOLTTRON™-based supervisory controller and associated open-source algorithms. These algorithms will ensure real-time optimal operation of a building-integrated CHP system, support electric grid reliability, and lead to achieving the goal of clean, efficient, reliable, and affordable next-generation integrated energy system. Previous report listed the components for which PM, real-time CxV, and AFDD algorithms will be developed, how the algorithms will be tested, and the metrics that will be used to validate the algorithms and their ease of deployment. Deployment of these algorithms in the field will result in a reduction in energy consumption of between 10% and 20% (for both CHP and conventional building systems). This report builds upon the previous report by detailing the process by which PNNL will implement performance monitoring and real-time commissioning algorithms for CHP systems in conjunction with the use of the VOLTTRON CHP economic dispatch agent in host facilities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Removal of Non-Specifically Bound Proteins Using Rayleigh Waves Generated on ST-Quartz Substrates

Label-free biosensors are plagued by the issue of non-specific protein binding which negatively affects sensing parameters such as sensitivity, selectivity, and limit-of-detection. In the current work, we explore the possibility of using the Rayleigh waves in ST-Quartz devices to efficiently remove non-specifically bound proteins via acoustic streaming. A coupled-field finite element (FE) fluid structure interaction (FSI) model of a surface acoustic wave (SAW) device based on ST-Quartz substrate in contact with a liquid loading was first used to predict trends in forces related to SAW-induced acoustic streaming. Based on model predictions, it is found that the computed SAW body force is sufficient to overcome adhesive forces between particles and a surface while lift and drag forces prevent reattachment for a range of SAW frequencies. We further performed experiments to validate the model predictions and observe that the excitation of Rayleigh SAWs removed non-specifically bound (NSB) antigens and antibodies from sensing and non-sensing regions, while rinsing and blocking agents were ineffective. An amplified RF signal applied to the device input disrupted the specific interactions between antigens and their capture antibody as well. ST-quartz allows propagation of Rayleigh and leaky SH-SAW waves in orthogonal directions. Thus, the results reported here could allow integration of three important biosensor functions on a single chip, i.e., removal of non-specific binding, mixing, and sensing in the liquid phase.

59 BASIC BIOLOGICAL SCIENCES↗

Assessing high fidelity multi-component models to facilitate safeguards at Gas Centrifuge Enrichment Plants

We report that the International Atomic Energy Agency (IAEA) inspectors routinely carry out environmental sampling (ES) as a verification method. Collection of environmental swipe samples at various locations in Gas Centrifuge Enrichment Facilities (GCEPs) is an important process in detecting misuse of a declared facility and possibly the existence of undeclared nuclear material. These samples are measured for isotopic composition in uranium containing particles by Thermal Ionization Mass Spectrometry (TIMS) or Inductively Coupled Plasma Mass Spectrometry (ICP-MS). Even though ES is highly effective in detecting the absolute value of enrichments and their deviations from the declared values, it cannot explain the cause of those changes. Several potential explanations can serve as possibilities for particles detected above or other than the declared enrichment. These include normal and non-malicious events such as the design of the enrichment cascades, unintentional failures of the machines, or overshoot during startup of a cascade. It can also be the result of deliberate misuse by the facility operators. The primary objective of this work is to understand how these factors affect the enrichments produced by a cascade and quantify anticipated multi-isotopic concentrations for each case. The following methodology is employed to determine signatures at a particular facility. 1) Utilize a new two-dimensional multi-component diffusion code to obtain centrifuge performance data and use that information to design and perform cascade analysis. Compare and contrast the results with previous 1-D radially averaged solutions from the Pancake code. 2) Design a GCEP cascade with the production goal of 19.75% 235 U for each set of machine data above. Investigate two cascade scenarios that include enrichment of natural uranium (NU) feed to 19.75% 235U in a single cascade compared to a two-step process of NU to 5% and then 5% to 19.75%. 3) Simulate the intentional vs. unintentional off-normal scenarios in the cascades to assess the differences in isotopic concentrations. A non-ideal squared-off cascade model developed at the University of Virginia is used to calculate flow rates and isotopic concentrations of the process gas. The analysis is performed using the Rome machine model operated at 600 m/s rotor speed. The upper and lower bounds of normal and abnormal enrichments in a typical facility are used in conjunction with ES results to understand the root causes of such observations.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Signatures of Non-universal Quantum Dynamics of Ultracold Chemical Reactions of Polar Alkali Dimer Molecules with Alkali Metal Atoms: Li( 2 S) + NaLi( a 3 Σ + ) → Na( 2 S) + Li 2 ( a 3 Σ u + )

Ultracold chemical reactions of weakly bound triplet-state alkali metal dimer molecules have recently attracted much experimental interest. Here we perform rigorous quantum scattering calculations with a new ab initio potential energy surface to explore the chemical reaction of spin-polarized NaLi(a 3 Σ + ) and Li( 2 S) to form Li 2 (a 3 Σ u + ) and Na( 2 S). The reaction is exothermic and proceeds readily at ultralow temperatures. Significantly, we observe strong sensitivity of the total reaction rate to small variations of the three-body part of the Li 2 Na interaction at short range, which we attribute to a relatively small number of open Li 2 (a 3 Σ u + ) product channels populated in the reaction. This provides the first signature of highly non-universal dynamics seen in rigorous quantum reactive scattering calculations of an ultracold exothermic insertion reaction involving a polar alkali dimer molecule, opening up the possibility of probing microscopic interactions in atom+molecule collision complexes via ultracold reactive scattering experiments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NENCI-2021. I. A large benchmark database of non-equilibrium non-covalent interactions emphasizing close intermolecular contacts

In this work, we present NENCI-2021, a benchmark database of ~8000 Non-Equilibirum Non-Covalent Interaction energies for a large and diverse selection of intermolecular complexes of biological and chemical relevance. To meet the growing demand for large and high-quality quantum mechanical data in the chemical sciences, NENCI-2021 starts with the 101 molecular dimers in the widely used S66 and S101 databases and extends the scope of these works by (i) including 40 cation–π and anion–π complexes, a fundamentally important class of non-covalent interactions that are found throughout nature and pose a substantial challenge to theory, and (ii) systematically sampling all 141 intermolecular potential energy surfaces (PESs) by simultaneously varying the intermolecular distance and intermolecular angle in each dimer. Designed with an emphasis on close contacts, the complexes in NENCI-2021 were generated by sampling seven intermolecular distances along each PES (ranging from 0.7× to 1.1× the equilibrium separation) and nine intermolecular angles per distance (five for each ion–π complex), yielding an extensive database of 7763 benchmark intermolecular interaction energies (E int ) obtained at the coupled-cluster with singles, doubles, and perturbative triples/complete basis set [CCSD(T)/CBS] level of theory. The E int values in NENCI-2021 span a total of 225.3 kcal/mol, ranging from -38.5 to +186.8 kcal/mol, with a mean (median) E int value of -1.06 kcal/mol (-2.39 kcal/mol). In addition, a wide range of intermolecular atom-pair distances are also present in NENCI-2021, where close intermolecular contacts involving atoms that are located within the so-called van der Waals envelope are prevalent—these interactions, in particular, pose an enormous challenge for molecular modeling and are observed in many important chemical and biological systems. A detailed symmetry-adapted perturbation theory (SAPT)- based energy decomposition analysis also confirms the diverse and comprehensive nature of the intermolecular binding motifs present in NENCI-2021, which now includes a significant number of primarily induction-bound dimers (e.g., cation–π complexes). NENCI-2021 thus spans all regions of the SAPT ternary diagram, thereby warranting a new four-category classification scheme that includes complexes primarily bound by electrostatics (3499), induction (700), dispersion (1372), or mixtures thereof (2192). A critical error analysis performed on a representative set of intermolecular complexes in NENCI-2021 demonstrates that the E int values provided herein have an average error of ±0.1 kcal/mol, even for complexes with strongly repulsive E int values, and maximum errors of ±0.2–0.3 kcal/mol (i.e., ~±1.0 kJ/mol) for the most challenging cases. For these reasons, we expect that NENCI-2021 will play an important role in the testing, training, and development of next-generation classical and polarizable force fields, density functional theory approximations, wavefunction theory methods, and machine learning based intra- and inter-molecular potentials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Influence of hydrostatic pressure on hidden order, the Kondo lattice, and magnetism in URu 2 Si 2-x P x

Within the chemical substitution series URu 2 Si 2-x P x , there is an evolution in the ground-state behavior from hidden ordered (HO) for x ≲ 0.03, to Kondo lattice behavior with no ordering (NO) for 0.03 ≲ x ≲ 0.26, to antiferromagnetism (AFM-2) for 0.26 ≲ x ≲ 0.5 [A. Gallagher et al., Nat. Commun. 7, 10712 (2016); A. Gallagher et al., J. Phys.: Condens. Matter 29, 024004 (2016)]. To better understand what factors control this behavior, temperature-dependent electrical resistivity measurements are performed for this series under applied pressures P up to 20.5 kbar. Specimens in the HO x region show similarities to the parent compound, where HO transforms into antiferromagnetism (AFM-1) at a critical pressure (P c ). P c decreases with increasing x and collapses towards P = 0 near x ≈ 0.03, suggesting that AFM-1 occurs at ambient pressure for this concentration. No pressure-induced phase transitions are observed in the NO x region and the AFM-2 state is only weakly suppressed by P. Measurements further reveal that AFM-1 and AFM-2 are distinct from each other. Calculations of the wave functions using the tight-binding Hartree-Fock approximation are performed and show (i) that the radial probability distributions for the phosphorus ions are more tightly bound than those for the silicon and (ii) that the energy difference between the orbitals decreases with increasing x. The cumulative effect of these two factors is that Si → P substitution decreases the hybridization strength, which correlates with the weakening of HO. At large x, additional effects such as electrical charge tuning also play an important role in determining the ground-state

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Update of Erosion Conditions and Assessment of Mitigation Options for the L-Bar Site

The L-Bar former uranium milling site was remediated and closed per regulations and is now under the long-term stewardship of the U.S. Department of Energy, Office of Legacy Management (DOE/LM). Since assuming stewardship in 2004, DOE/LM has observed erosion and sedimentation processes at the L-Bar Site that will challenge meeting the design closure criteria in the long term, and therefore erosion control structures were installed in several areas. Portions of these structures were subsequently damaged by summer convective storm events and they are being redesigned. At the request of DOE/LM, Desert Research Institute (DRI) reviewed the proposed redesign plans of the erosion control structures. The purpose of this review is to support DOE/LM decisions regarding mitigation of ongoing erosion processes, including assessing possible repair of the existing erosion control structures, as well as plan for effective long-term site management. This design review is performed in reference to the Uranium Mill Tailings Radiation Control Act (UMTRCA) standards contained in 40 CFR 192.02 that require containment of residual radioactive material be effective for up to 1,000 years (if achievable, but certainly for 200 years), limit radon release, protect groundwater, and minimize future maintenance. The erosion control structures under review are not subject to the UMTRCA standard directly, but they contribute to the performance of the overall containment system by virtue of their relationship with the large diversion channels bounding the disposal cell. The 11 design drawings included in “Erosion Control Alternatives Analysis, L-Bar, New Mexico, Disposal Site, LTS-111-0043-08-002,” dated January 11, 2019, and listed in Appendix A, and supporting calculations in Weston (2019) are the focus of the review. Additionally, DOE/LM provided supporting data such as a 2018 photogrammetry-based digital elevation model of the site, precipitation records collected from an on-site weather station, and sedimentation records collected at an on-site basin. This assessment includes review of the proposed design to mitigate current site conditions but also addresses site changes between the initial erosion assessment report (Miller et al., 2012) and current conditions. The analysis is at a predesign engineering level and does not include development of hydraulic or sediment transport models. Site precipitation data are included in Miller et al. (2012). The natural conditions of the site, the design of site diversion systems, observed erosion at the site, and predesign engineering analysis are used to develop a holistic view of the challenges to L-Bar Site stability and possible responsive actions.

54 ENVIRONMENTAL SCIENCES↗

GPS Spoofing Mitigation and Timing Risk Analysis in Networked Phasor Measurement Units via Stochastic Reachability

To address phasor measurement unit (PMU) vulnerability to spoofing, we propose the use of a set-valued state estimation technique known as stochastic reachability (SR)-based distributed Kalman filter (DKF) that computes secure global positioning system (GPS) timing across a network of receivers. Utilizing SR, we estimate not only GPS time but also its stochastic reachable set, which is parameterized by probabilistic zonotope (p-Zonotope). While requiring known measurement error bounds in only non-spoofed conditions, we designed a two-tiered approach. We first performed measurement-level spoofing mitigation via deviation of a measurement innovation from its expected p-Zonotope. We then performed state-level timing risk analysis via a determination of the intersection probability of the estimated p-Zonotope with an unsafe set that violates IEEE C37.118.1a-2014 standards. Finally, we validated our SR-DKF algorithm by subjecting it to a simulated receiver network to coordinate signal-level spoofing. We demonstrate improved timing accuracy and successful spoofing mitigation via the use of our SR-DKF algorithm. We also validated the robustness of the estimated timing risk as the number of receivers were varied.

47 OTHER INSTRUMENTATION↗

Complete set of bound negative-parity states in the neutron-rich nucleus 18 N

High-resolution γ -ray spectroscopy of N 18 is performed with the Advanced GAmma Tracking Array, following deep-inelastic processes induced by an O 18 beam on a Ta 181 target. Six states are newly identified, which together with the three known excitations exhaust all negative-parity excited states expected in N 18 below the neutron threshold. Spin and parities are proposed for all located states on the basis of decay branchings and comparison with large-scale shell-model calculations performed in the p-sd space, with the YSOX interaction. Of particular interest is the location of the 0 1 - and 1 2 - excitations, which provide strong constrains for cross-shell p-sd matrix elements based on realistic interactions and help to simultaneously reproduce the ground and first-excited states in N 16 and N 18 , for the first time. Overall, understanding the N 18 structure may also have significant impact on neutron-capture cross-section calculations in r-process modeling including light neutron-rich nuclei.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

HPC Campaign Management: Remote data access with user-defined error bound using ADIOS and ZFP

Remote access to large-scale scientific datasets, like those generated by combustion simulations or other high-performance computing (HPC) applications, presents a significant challenge. Downloading entire datasets is often impractical due to their size and the bandwidth limitations of typical networks. To address this challenge, we propose a novel approach that enables efficient remote access to large datasets distributed across multiple facilities. Our method enables technologies to download only the data values of a select variable, in a select region of interest, to a user-defined accuracy. For this purpose, we extended the ADIOS IO library to provide read functions with user-defined accuracy, a remote data server that understands multidimensional selections of specific variables, steps and accuracy from an ADIOS dataset, and which uses lossy compression on the remote site to reduce the data to be transferred back to the client. In addition, our extension of the ADIOS library collects metadata from multiple datasets in small files called Campaign Archives, which can be shared among project participants on any HPC, cloud or laptop, and which can easily facilitate the discovery of content and pointers to the data location as well as remote access to the data by local tools as if data was local. This feature called Campaign Management, enables a group of scientists to manage related datasets stored in multiple files, across multiple facilities as if it was in a single file/database. We demonstrate the effectiveness of our approach using a 1.5 TB dataset from the S3D combustion simulation on Frontier at the Oak Ridge Leadership Facility. Even a single variable from this dataset, at 64 GB, is too large to be processed on a standard laptop. We show two different reading patterns for 2D plots and 3D visualization, with careful settings that a scientist studying combustion data would do and show that running the same Python scripts on Frontier directly takes comparable time than running them on the local laptop with remote access to the data on Frontier.

Podhorszki, Norbert [ORNL] (ORCID:000000019647542X↗