Results for “Performance Tuning” — Page 3

DOE OSTI2024

TunIO: An AI-powered Framework for Optimizing HPC I/O

I/O operations are a known performance bottleneck of HPC applications. To achieve good performance, users often employ an iterative multistage tuning process to find an optimal I/O stack configuration. However, an I/O stack contains multiple layers, such as high-level I/O libraries, I/O middleware, and parallel file systems, and each layer has many parameters. These parameters and layers are entangled and influenced by each other. The tuning process is time-consuming and complex. In this work, we present TunIO, an AI-powered I/O tuning framework that implements several techniques to balance the tuning cost and performance gain, including tuning the high-impact parameters first. Furthermore, TunIO analyzes the application source code to extract its I/O kernel while retaining all statements necessary to perform I/O. It utilizes a smart selection of high-impact configuration parameters of the given tuning objective. Finally, it uses a novel Reinforcement Learning (RL)-driven early stopping mechanism to balance the cost and performance gain. Experimental results show that TunIO leads to a reduction of up to ≈73% in tuning time while achieving the same performance gain when compared to H5Tuner. It achieves a significant performance gain/cost of 208.4 MBps/min (I/O bandwidth for each minute spent in tuning) over existing approaches under our testing.

Rajesh, Neeraj↗

DOE OSTI2021

Performance Profile of Transformer Fine-Tuning in Multi-GPU Cloud Environments

The study presented here focuses on performance characteristics and trade-offs associated with running machine-learning tasks in multi-GPU environments on both on-site cloud computing resources and commercial cloud services (Azure). Specifically, this study examines these tradeoffs by examining the performance of training and fine-tuning of transformer-based deep-learning (DL) networks on clinical notes and data, a task of critical importance in the medical domain. To this end, we perform DL-related experiments on the widely deployed NVIDIA V100 GPUs and on the newer A100 GPUs connected via NVLink or PCIe. This study analyzes the execution time of major operations to train DL models and investigate popular options to optimize each of them. We examine and present the findings on the impacts that various operations (e.g. data loading into GPUs, training, fine-tuning), optimizations, and system configurations (single vs. multi-GPU, NVLink vs. PCIe) have on the overall training performance.

Begoli, Edmon↗

DOE OSTI2022

Improvement of Oxygen Reduction Performance in Alkaline Media by Tuning Phase Structure of Pd–Bi Nanocatalysts

Tuning the crystal phase of bimetallic nanocrystals offers an alternative avenue to improving their electrocatalytic performance. Herein, we present a facile and one-pot synthesis approach that is used to enhance the catalytic activity and stability toward oxygen reduction reaction (ORR) in alkaline media via control of the crystal structure of Pd-Bi nanocrystals. By merely altering the types of Pd precursors under the same conditions, the monoclinic structured Pd 5 Bi 2 and conventional face-centered cubic (fcc) structured Pd 3 Bi nanocrystals with comparable size and morphology can be precisely synthesized, respectively. Interestingly, the carbon-supported monoclinic Pd 5 Bi 2 nanocrystals exhibit superior ORR activity in alkaline media, delivering a mass activity (MA) as high as 2.05 A/mg Pd . After 10,000 cycles of ORR durability test, the monoclinic structured Pd 5 Bi 2 /C nanocatalysts still remain a MA of 1.52 A/mg Pd , which is 3.6 times, 16.9 times, and 21.7 times as high as those of the fcc Pd 3 Bi/C counterpart, commercial Pd/C, and Pt/C electrocatalysts, respectively. Moreover, structural characterizations of the monoclinic Pd 5 Bi 2 /C nanocrystals after the durability test demonstrate the excellent retention of the original size, morphology, composition, and crystal phase, greatly alleviating the leaching of the Bi component. Overall, this work provides new insight for the synthesis of multimetallic catalysts with a metastable phase and demonstrates phase-dependent catalytic performance.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Simulation-Based Inference for Neutrino Interaction Model Parameter Tuning

High-energy physics experiments studying neutrinos rely heavily on simulations of their interactions with atomic nuclei. Limitations in the theoretical understanding of these interactions typically necessitate ad hoc tuning of simulation model parameters to data. Traditional tuning methods for neutrino experiments have largely relied on simple algorithms for numerical optimization. While adequate for the modest goals of initial efforts, the complexity of future neutrino tuning campaigns is expected to increase substantially, and new approaches will be needed to make progress. In this paper, we examine the application of simulation-based inference (SBI) to the neutrino interaction model tuning for the first time. Using a previous tuning study performed by the MicroBooNE experiment as a test case, we find that our SBI algorithm can correctly infer the tuned parameter values when confronted with a mock data set generated according to the MicroBooNE procedure. This initial proof-of-principle illustrates a promising new technique for next-generation simulation tuning campaigns for the neutrino experimental community.

Tame-Narvaez, Karla Maria [Fermilab]↗

DOE OSTI2025

Simulation-based inference for neutrino interaction model parameter tuning

High-energy physics experiments studying neutrinos rely heavily on simulations of their interactions with atomic nuclei. Limitations in the theoretical understanding of these interactions typically necessitate ad hoc tuning of simulation model parameters to data. Traditional tuning methods for neutrino experiments have largely relied on simple algorithms for numerical optimization. While adequate for the modest goals of initial efforts, the complexity of future neutrino tuning campaigns is expected to increase substantially, and new approaches will be needed to make progress. In this paper, we examine the application of simulation-based inference (SBI) to the neutrino interaction model tuning for the first time. Using a previous tuning study performed by the MicroBooNE experiment as a test case, we find that our SBI algorithm can correctly infer the tuned parameter values when confronted with a mock data set generated according to the MicroBooNE procedure. This initial proof-of-principle illustrates a promising new technique for next-generation simulation tuning campaigns for the neutrino experimental community.

Tame-Narvaez, Karla [Fermilab] (ORCID:000000022249↗

DOE OSTI2024

Improved Subseasonal Forecasting of Extreme Polar Vortices Using Machine Learning

Our research was focused on forecasting the position and shape of the winter stratospheric polar vortex at a subseasonal timescale of 15 days in advance. To achieve this, we employed both statistical and neural network machine learning techniques. The analysis was performed on 42 winter seasons of reanalysis data provided by NASA giving us a total of 6,342 days of data. The state of the polar vortex for determined by using geometric moments to calculate the centroid latitude and the aspect ratio of an ellipse fit onto the vortex. Timeseries for thirty additional precursors were calculated to help improve the predictive capabilities of the algorithm. Feature importance of these precursors was performed using random forest to measure the predictive importance and the ideal number of precursors. Then, using the precursors identified as important, various statistical methods were tested for predictive accuracy with random forest and nearest neighbor performing the best. An echo state network, a type of recurrent neural network that features sparsely connected hidden layer and a reduced number of trainable parameters that allows for rapid training and testing, was also implemented for the forecasting problem. Hyperparameter tuning was performed for each methods using a subset of the training data. The algorithms were trained and tuned on the first 41 years of data, then tested for accuracy on the final year. In general, the centroid latitude of the polar vortex proved easier to predict than the aspect ratio across all algorithms. Random forest outperformed other statistical forecasting algorithms overall but struggled to predict extreme values. Forecasting from echo state network suggested a strong predictive capability past 15 days, but further work is required to fully realize the potential of recurrent neural network approaches.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Spray: Sparse Reductions of Arrays in OPEN MP

We present SPRAY, an open-source header-only C++ library for sparse reductions of arrays. SPRAY is meant for applications in which a large array is collaboratively updated by multiple threads using an associative and commutative operation such as +=. Especially when each thread accesses only parts of the array, SPRAY can perform significantly better than OPENMP's built-in reduction clause or atomic updates, while also using less memory than the former. SPRAY provides both an easy-to-use interface that can serve as a drop-in replacement for OPENMP reductions and a selection of reducer objects that accumulate the final result in different thread-safe ways. We demonstrate SPRAY through multiple test cases including the LULESH shock hydrodynamics code and a transpose-matrix-vector multiplication for sparse matrices stored in CSR format. SPRAY reductions outperform built-in OPENMP reductions consistently, in some cases improving run time and memory overhead by 20X, and even beating domain-specific approaches such as Intel MKI, by over 2X in some cases. Furthermore, SPRAY reductions have a minimal impact on the code base, requiring only a few lines of source code changes. Once in place, SPRAY reduction schemes can be switched easily, allowing performance portability and tuning opportunities by separating performance-critical implementation details from application code.

OpenMP↗

DOE OSTI2021

Correlation of the Structure with Performance in MEH-PPV/dPS Thin Films Illuminated during Processing

Thin films containing conjugated polymers have been used in a wide array of optoelectronic devices, and much research has focused on the conformation of the conjugated polymer as a key aspect to tuning the performance of the resulting devices. White light exposure has been studied as a post-processing method to alter the film’s morphology and photoluminescence (PL) in systems composed of poly[2-methoxy-5-(2-ethylhexyloxy)-1,4-phenylenevinylene] (MEH-PPV) and polystyrene (PS). To date, there have been few studies that correlate the changes in the depth profile with the PL performance of MEH-PPV/PS films. This study is designed to address this gap in knowledge. Thin films of MEH-PPV/dPS annealed above the glass transition temperatures (T g ) in an illuminated environment led to lower PL than that found in annealed samples that are not illuminated. However, at higher MEH-PPV loading in the blend film, the extent of variation of PL with illumination diminished. Additionally, time-of-flight secondary ion mass spectrometry and small-angle neutron scattering document the three-dimensional morphology of the films under illumination conditions, which are correlated with the changes in PL. Illumination during annealing compressed MEH-PPV-rich layers in the thin film blends at low loadings of MEH-PPV (below 10 wt %) but resulted in significant in-plane phase separation at higher loadings (above 15 wt %). Both changes increase interchain interactions and lower the PL of the illuminated samples. The changes in the depth profile significantly alter the PL of the films, while the in-plane phase separation affected the optoelectronic properties to a lesser degree. This work, therefore, provides insights into how illumination and film composition can be utilized to predictably alter the structure and optoelectronic performance of conjugated polymer blend films.

36 MATERIALS SCIENCE↗

DOE OSTI2024

$\overline{TKE}$ Parameterization and $\bar{v}$ Uncertainty Analysis for CGMF

Previous work was performed on tuning CGMF parameters for 235 U, 238 U, and Plutonium isotopes. Now work is being done to tune minor uranium isotopes. However, uranium isotopes like 232 U and 236 U have almost no experimental data. We are applying cross-isotope models to extrapolate and tune CGMF on isotopes that lack experimental data. There exist several internal CGMF physics quantities that affect the output of CGMF—multi-chance fission probability, excitation energy sharing, spin-cutoff factor, spin scaling, and fragment total kinetic energy to name a few. The mean fragment total kinetic energy, $\overline{TKE}$, is particularly interesting because of its strong anti-correlation with $\bar{v}$. We are most interested in the mean fragment total kinetic energy before neutron emissions. $\overline{TKE}$ is assumed to be pre-neutron emission unless otherwise stated. Currently in CGMF, the $\overline{TKE}$ model for 233,234,235,238 U are tuned independently to reproduce ν for the associated isotopes. In this report, we will tune a cross-isotope $\overline{TKE}$ model to experimental $\overline{TKE}$ data for 232,233,234,235,236,238 U. Because of the unreliable and sparse nature of $\overline{TKE}$ experimental data, future work will use more reliable experimental $\bar{v}$ data to infer the $\overline{TKE}$ model (and likely other internal CGMF parameters) for uranium isotopes. Such work has been performed previously using a sensitivity analysis and Kalman filter methods.

07 ISOTOPE AND RADIATION SOURCES↗

DOE OSTI2021

Influence of the Anionic Zinc-Adeninate Metal–Organic Framework Structure on the Luminescent Detection of Rare Earth Ions in Aqueous Streams

Rare earth elements (REEs) are critical to numerous technologies; however, a combination of increasing demand, environmental concerns, and monopolistic marketplace conditions has spurred interest in boosting the domestic REE production from sources such as coal utilization byproducts. The economic viability of this approach requires rapid, inexpensive, and sensitive analytical techniques capable of characterizing the REE content during resource exploration and downstream REE processing (e.g., analyzing REE separation, concentration, and purification production steps). Luminescence-based sensors are attractive because many REEs may be sensitized to produce element-specific emission. Hence, a single material may simultaneously detect and distinguish multiple REEs. Metal–organic frameworks (MOFs) can sensitize multiple REEs, but their viability has been hindered by sensitivity and selectivity challenges. Understanding how the MOF structure impacts the REE sensing efficacy is critical to the rational design of new sensors. Here, we evaluate the sensing performance of seven different anionic zinc-adeninate MOFs with different organic linkers and/or structures for the visible-emitting REEs Tb, Dy, Sm, and Eu. The choice of a linker determines which REEs are sensitized and significantly influences their sensitivity and selectivity against competing species (here, Fe(II) and HCl). For a given linker, structural changes to the MOF can further fine-tune the performance. The MOFs produce some of the lowest detection limits (sub-10 ppb for Tb) reported for the aqueous sensitization-based REE detection. Importantly, the most selective MOFs demonstrated the ability to sensitize the REE signal at sub-ppm levels in a REE-spiked acid mine drainage matrix, highlighting their potential for use in real-world sensing applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

FY23 Progress on Computational Modeling of the Water-Based NSTF

This report summarizes the system-level modeling effort by Argonne National Laboratory (Argonne) of the Natural convection Shutdown heat removal Test Facility (NSTF) in FY23. As a continuation of the modeling effort from FY22, this year’s work focuses on improving the RELAP5-3D model developed previously for two-phase flow simulations. The RELAP5-3D model is updated to more accurately capture the heat loss experienced by the facility. The updated model is compared against experimental data for benchmarking purposes of the RELAP5-3D input model. By correctly accounting for heat loss, the updated RELAP5-3D model can now predict the two-phase baseline case more accurately. The onset and the duration of instability are captured well by the model. Furthermore, analyses are performed to better understand the instability mechanism experienced by the flow where the expansion of the boiling boundary in the chimney is studied in details and the fundamental frequencies of the oscillations are obtained. The updated RELAP5-3D model is further compared against four fault conditions, namely the reduction of riser header inlet flow area, depletion of system inventory, blocked riser channels, and static boiling scenario. For each fault condition, minor modifications and tuning are performed to improve the predictions of the model. The purpose of the analyses is to investigate the capability of RELAP5-3D in predicting complex two-phase flows in possible accident scenarios in actual Reactor Cavity Cooling System (RCCS). Overall, the model is able to capture the behaviors and trends of these fault conditions relatively well. Some discrepancies remain between the experimental data and the predictions, many of which are likely due to the differences in the predicted and experimental vapor generation rate. Future work will focus on the continued development of the current RELAP5-3D input model of the NSTF to both improve the accuracy of the model’s predictive capability and continue supporting the experimental program needs. The mutually beneficial relationship between analysis and experimental efforts has become integral to the parent NSTF program, and the greater objective to fully understand and accurately predict the heat removal performance of a full scale RCCS concept.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2024

MatCal Users Guide: Release 1.3.0

Any continuum mechanics model will require three components: (1) a discretized geometry of the boundary value problem being studied, (2) the partial differential equations to be solved, and (3) the initial conditions and boundary conditions for the problem. To describe material behavior in these computational models, material models contribute to (2) the underlying equations and, occasionally, to (3) the initial conditions for the simulation. These material models can exhibit a mathematical form that is empirically based, based on first principles, or developed from both empirical observations and known physics. In general, these models are meant to represent a class of materials with well understood behavior. As a result, material models have parameters that must be tuned or calibrated so that the model response matches characterization data available for the specific material it is intended to represent when used to simulate a specific system. For simple models, such as isotropic, linear elastic materials in solid mechanics, this calibration process can be a simple analytical calculation directly extracting the parameters from experimental measurements. For complex models that have many inputs and require many characterization datasets to adequately identify the material behavior, the model calibration process can require an inverse problem approach where an optimization is performed to tune the model parameters to the available data.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Improved Time-Stepping Methods in Global to Regional Ocean Modeling (Annual Status Report 2020)

Time stepping algorithms are an important part of ocean models, and strongly influence both the accuracy of solution and performance. There have been a number of projects investigating various improvements for ocean time-stepping schemes in the Model for Prediction Across Scales-Ocean (MPAS-Ocean), a component of the DOE Energy Exascale Earth System Model. Ocean dynamics include fast surface gravity waves, which are two-dimensional, and slower internal waves, which are three-dimensional, so ocean models use a split time-stepping scheme that separates these barotropic and baroclinic modes for efficiency. MPAS-Ocean runs on variable-resolution horizontal meshes, and must scale to tens of thousands of cores and millions of horizontal gridcells. Ocean models require time stepping algorithms that are customized to these needs, and which are tuned for performance on various resolutions and architectures.

58 GEOSCIENCES↗

DOE OSTI2022

Improved Time-Stepping Methods in Global to Regional Ocean Modeling (Annual Status Report)

Time stepping algorithms are an important part of ocean models, and strongly influence both the accuracy of solution and performance. There have been a number of projects investigating various improvements for ocean time-stepping schemes in the Model for Prediction Across Scales-Ocean (MPAS-Ocean), a component of the DOE Energy Exascale Earth System Model. Ocean dynamics include fast surface gravity waves, which are two-dimensional, and slower internal waves, which are three-dimensional, so ocean models use a split time-stepping scheme that separates these barotropic and baroclinic modes for efficiency. MPAS-Ocean runs on variable-resolution horizontal meshes, and must scale to tens of thousands of cores and millions of horizontal gridcells. Ocean models require time stepping algorithms that are customized to these needs, and which are tuned for performance on various resolutions and architectures.

58 GEOSCIENCES↗

DOE OSTI2024

Hyperconjugation-controlled molecular conformation weakens lithium-ion solvation and stabilizes lithium metal anodes

Tuning the solvation structure of lithium ions via electrolyte engineering has proven effective for lithium metal (Li) anodes. Further advancement that bypasses the trial-and-error practice relies on the establishment of molecular design principles. Expanding the scope of our previous work on solvent fluorination, we report here an alternative design principle for non-fluorinated solvents, which potentially have reduced cost, environmental impact, and toxicity. By studying non-fluorinated ethers systematically, we found that the short-chain acetals favor the [gauche, gauche] molecular conformation due to hyperconjugation, which leads to weakened monodentate coordination with Li + . The dimethoxymethane electrolyte showed fast activation to >99% coulombic efficiency (CE) and high ionic conductivity of 8.03 mS cm -1 . The electrolyte performance was demonstrated in anode-free Cu$∥$LFP pouch cells at current densities up to 4 mA cm -2 (70 to 100 cycles) and thin-Li$∥$high-loading-LFP coin cells (200–300 cycles). Overall, we demonstrated and rationalized the improvement in Li metal cyclability by the acetal structure compared to ethylene glycol ethers. We expect further improvement in performance by tuning the acetal structure.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Detecting Unclassified Electromagnetic Signals for Secure Wireless Communication Using Open Set Recognition

We developed multiple machine learning methods for the detection and classification of new wireless communication waveforms, which is critical for targeted attacks in wireless networks and electronic warfare. Our machine learning models are capable of dynamically detecting security threats in near real time through our advanced open set recognition (OSR) approach. This model has demonstrated significant improvements in the detection of unknown waveforms, thereby enhancing the security and reliability of mission critical communications. Our approach to detecting uncertain security threats is novel; we advanced OSR techniques by incorporating domain knowledge of wireless signals. Specifically, we combined time and frequency domain model features to enhance the model’s performance. Utilizing an OSR approach eliminates the need for training data to be distributed similarly to the deployment environment and removes the requirement for the training set to contains all possible threat classes. This is crucial because it is often infeasible to determine and characterize all potential security threats in advance. Our model were trained on simulated data, generated in partnership with the University at Albany, State of New York. The data set contained a diverse array of wireless signals, including those with additive white Gaussian noise and multipath signals, with and without line of sight. This comprehensive training set allowed us to optimize our models to detect unknown waveforms under various challenging scenarios, such as low signal-to-noise ratios. By training on various waveforms, varying signal-to-noise ratio, and different sample sizes under normal conditions, our models were fine tuned to perform effectively in challenging environments.

99 - GENERAL AND MISCELLANEOUS↗

DOE OSTI2023

Toughening Brittle Bio‐P3HB with Synthetic P3HB of Engineered Stereomicrostructures

Abstract Poly(3‐hydroxybutyrate) (P3HB), a biologically produced, biodegradable natural polyester, exhibits excellent thermal and barrier properties but suffers from mechanical brittleness, largely limiting its applications. Here we report a mono‐material product design strategy to toughen stereoperfect, brittle bio or synthetic P3HB by blending it with stereomicrostructurally engineered P3HB. Through tacticity ([ mm ] from 0 to 100 %) and molecular weight ( M n to 788 kDa) tuning, high‐performance synthetic P3HB materials with tensile strength to ≈30 MPa, fracture strain to ≈800 %, and toughness to 126 MJ m −3 (>110× tougher than bio‐P3HB) have been produced. Physical blending of the brittle P3HB with such P3HB in 10 to 90 wt % dramatically enhances its ductility from ≈5 % to 95–450 % and optical clarity from 19 % to 85 % visible light transmittance while maintaining desirably high elastic modulus (>1 GPa), tensile strength (>35 MPa), and melting temperature (160–170 °C). This P3HB‐toughening‐P3HB methodology departs from the traditional approach of incorporating chemically distinct components to toughen P3HB, which hinders chemical or mechanical recycling, highlighting the potential of the mono‐material product design solely based on biodegradable P3HB to deliver P3HB materials with diverse performance properties.

Zhang, Zhen↗

DOE OSTI2023

Toughening Brittle Bio‐P3HB with Synthetic P3HB of Engineered Stereomicrostructures

Abstract Poly(3‐hydroxybutyrate) (P3HB), a biologically produced, biodegradable natural polyester, exhibits excellent thermal and barrier properties but suffers from mechanical brittleness, largely limiting its applications. Here we report a mono‐material product design strategy to toughen stereoperfect, brittle bio or synthetic P3HB by blending it with stereomicrostructurally engineered P3HB. Through tacticity ([ mm ] from 0 to 100 %) and molecular weight ( M n to 788 kDa) tuning, high‐performance synthetic P3HB materials with tensile strength to ≈30 MPa, fracture strain to ≈800 %, and toughness to 126 MJ m −3 (>110× tougher than bio‐P3HB) have been produced. Physical blending of the brittle P3HB with such P3HB in 10 to 90 wt % dramatically enhances its ductility from ≈5 % to 95–450 % and optical clarity from 19 % to 85 % visible light transmittance while maintaining desirably high elastic modulus (>1 GPa), tensile strength (>35 MPa), and melting temperature (160–170 °C). This P3HB‐toughening‐P3HB methodology departs from the traditional approach of incorporating chemically distinct components to toughen P3HB, which hinders chemical or mechanical recycling, highlighting the potential of the mono‐material product design solely based on biodegradable P3HB to deliver P3HB materials with diverse performance properties.

Chemistry↗