Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Packaging HEP Heterogeneous Mini-apps for Portable Benchmarking and Facility Evaluation on Modern HPCs

High Energy Physics (HEP) experiments are making increasing use of GPUs and GPU dominated High Performance Computer facilities. Both the software and hardware of these systems are rapidly evolving, creating challenges for experiments to make informed decisions as to where they wish to devote resources. In its first phase, the High Energy Physics Center for Computational Excellence (HEP-CCE) produced portable versions of a number of heterogeneous HEP mini-apps, such as \ptor, FastCaloSim, Patatrack and the WireCell Toolkit, that exercise a broad range of GPU characteristics, enabling cross platform and facility benchmarking and evaluation. However, these mini-apps still require a significant amount of manual intervention to deploy on a new facility. We present our work in developing turn-key deployments of these mini-apps, where by means of containerization and automated configuration and build techniques such as Spack, we are able to quickly test new hardware, software, environments and entire facilities with minimal user intervention, and then track performance metrics over time.

Atif, Mohammad [Brookhaven] (ORCID:000000026889770↗

Comparing Classical and Machine Learning Force Fields for Modeling Deformation of Metal–Organic Frameworks Relevant for Direct Air Capture

Deformation of metal–organic frameworks (MOFs) induced by adsorbate molecules can affect adsorption properties such as capacity and selectivity, but most computational studies of MOFs assume framework rigidity to simplify calculations. Although flexible force fields (FFs) for MOFs have been parametrized for specific materials, the generality of FFs for reliably modeling adsorbate-induced deformation to accuracy nearing that of density functional theory (DFT) has not been established. This work confirms using DFT calculations that adsorbate-induced deformation can affect CO 2 and H 2 O adsorption energies in a considerable fraction of MOFs promising for direct air capture (DAC). We then benchmark the efficacy of several general-purpose FFs in describing adsorbate-induced deformation for DAC against DFT. Our results show that current classical FFs are insufficient for describing MOF deformation, especially in cases of interest for DAC where strong interactions exist between adsorbed molecules and MOF frameworks. Some emerging machine learning force fields (MLFFs) we tested, particularly CHGNet, MACE-MP-0, and Equiformer V2, appear to be more promising than the classical FF for emulating the deformation behavior described by DFT. The best performing FF (CHGNet), however, fails to achieve the accuracy required for practical predictions with a mean absolute adsorption energy error of 0.124 eV.

adsorption↗

A polysulfide/ferricyanide redox flow battery with extended cycling

The inexpensive sulfur raw material is promising to enable cost-effective redox flow batteries for long duration energy storage. But the catastrophic through-membrane crossover of polysulfides remains a severe challenge resulting in irreversible performance degradation and short cycle life. In this work, we demonstrate that use of a permselective cation exchange membrane yields a two orders of magnitude enhancement in polysulfide retention compared to the benchmark Nafion membrane. Combined physico-chemical, spectroscopic, and microscopic analyses suggest more disordered sidechain structures, which lead to the more hydrophobic nature and smaller hydrophilic domains in the membrane. The microstructural features contribute to the effective mitigation of polysulfide crossover. As a result, the cycle life of polysulfide/ferricyanide flow cells is boosted over a substantially extended test time. This finding sheds light on the fundamental membrane factors that cause polysulfide permeation and can provide feasible directions in the development of permselective membranes for polysulfide flow batteries.

36 MATERIALS SCIENCE↗

Coupled cluster benchmarks of large noncovalent complexes: The L7 dataset as well as DNA–ellipticine and buckycatcher–fullerene

In this work, benchmark binding energies for dispersion-bound complexes in the L7 dataset, the DNA–ellipticine intercalation complex, and the buckycatcher–C60 complex with 120 heavy atoms using a focal-point method based on the canonical form of second-order Møller−Plesset theory (MP2) and the domain based local pair natural orbital scheme for the coupled cluster with single, double, and perturbative triple excitations [CCSD(T)] extrapolated to the complete basis set (CBS) limit are reported. This work allows for increased confidence given the agreement with respect to values recently obtained using the local natural orbital CCSD(T) for L7 and the canonical CCSD(T)/CBS result for the coronene dimer (C2C2PD). Therefore, these results can be considered pushing the CCSD(T)/CBS binding benchmark to the hundred-atom scale. The disagreements between the two state-of-the-art methods, CCSD(T) and fixed-node diffusion Monte Carlo, are substantial with at least 2.0 (∼10%), 1.9 (∼5%), and 10.3 kcal/mol (∼25%) differences for C2C2PD in L7, DNA–ellipticine, and buckycatcher–C60, respectively. Such sizable discrepancy above “chemical accuracy” for large noncovalent complexes indicates how challenging it is to obtain benchmark binding interactions for systems beyond small molecules, although the three up-to-date density functionals, PBE0+D4, ωB97M-V, and B97M-V, agree better with CCSD(T) for these large systems. In addition to reporting these values, different basis sets and various CBS extrapolation parameters for Hartree–Fock and MP2 correlation energies were tested for the first time in large noncovalent complexes with the goal of providing some indications toward optimal cost effective routes to approach the CBS limit without substantial loss in quality.

Ballesteros, Francisco (ORCID:0000000325732307)↗

High Strength Aluminum Additive Manufacturing

High-strength aluminum alloys for elevated temperature applications are desirable to replace heavier and more expensive titanium alloys. However, most aluminum alloys lose a large fraction of their strength at temperatures above approximately 200°C. ORNL has designed DuAlumin-3D, an alloy with nominal composition Al-9Ce-4Ni-0.5Mn-1Zr (wt.%), which utilizes the high cooling rates in additive manufacturing (AM) to achieve a refined microstructure, and thermally stable mechanical properties. DuAlumin-3D was fabricated by laser powder bed fusion and tested for its tensile mechanical properties across a range of temperature, and for its room temperature high-cycle fatigue resistance. The alloy was tested in both the as-printed and heat treated conditions, and both parallel and perpendicular to the AM build direction. The alloy was found to have anisotropic mechanical behavior in the as-printed state, but the anisotropy significantly decreased (both for tensile and fatigue properties) following heat treatment. The tensile properties significantly out-performed benchmark wrought 2219-T61 across a wide temperature range. The room temperature fatigue performance was approximately similar to 2219-T61.

36 MATERIALS SCIENCE↗

SC Wall-to-RC Basemat Over-Strength Connection: Behavior and Design

This paper presents results from experimental and analytical investigations conducted to evaluate the lateral load behavior and capacity of steel-plate composite (SC) wall-to-reinforced concrete (RC) basemat connections. Two SC wall-to-reinforced concrete basemat connection specimens were tested. These SC wall specimens had a height-to-length ratio of 0.6 and did not include boundary elements. The experimental results include the lateral force-displacement (V-Δ) responses of the specimens and observations of local damage such as steel plate local buckling and concrete crushing. 3D finite element models were developed and benchmarked using the experimental results. The benchmarked models were used to conduct analytical parametric studies, expand the database, and gain additional insights into the behavior of SC wall-to-RC basemat connections. The parameters included in analytical investigations were the wall aspect ratio (h/lw), reinforcement ratio (ρ), and wall thickness (T).

Kurt, Efe G.↗

Getting Warmer: IceCube Nears Freeze Out

IceCube has recently detected a diffuse population of high-energy neutrinos arising from the Milky Way. We use this high-significance detection to place new limits on dark matter (DM) annihilation to neutrinos with two complementary approaches. The first method uses the background-subtracted Galactic longitude distribution of shower events to place a conservative bound on the DM annihilation cross section that does not rely on any assumed Galactic cosmic ray emission model; the resulting limits on the velocity-averaged annihilation cross section improve upon existing bounds by factors of a few. The second method uses the template-dependent neutrino energy spectra from the Inner Galaxy, inferred under different Galactic cosmic ray emission models. This complementary approach shows that the inferred Galactic neutrino intensities are already sensitive to DM contributions near the thermal-relic benchmark for a range of TeV-scale DM masses, though this comparison is more model-dependent. Our results demonstrate that measurements of diffuse Galactic neutrino emission can be used as a powerful probe of DM annihilation into neutrinos. Future observations with IceCube-Gen2 and KM3NeT will substantially extend this sensitivity, potentially allowing a decisive test of the thermal freeze-out mechanism with Galactic neutrino observations.

Mukhopadhyay, Mainak [Fermilab; Chicago U., KICP; ↗

Tidal Turbine Benchmarking Project: Stage I - Steady Flow Blind Predictions: Preprint

This paper presents the first blind prediction stage of the Tidal Turbine Benchmarking Project being conducted and funded by the UK's EPSRC and Supergen ORE Hub. In this first stage, only steady flow conditions, at low and elevated turbulence (3.1%) levels, were considered. Prior to the blind prediction stage, a large laboratory scale experiment was conducted in which a highly instrumented 1.6m diameter tidal rotor was towed through a large towing tank in well-defined flow conditions with and without an upstream turbulence grid. Details of the test campaign and rotor design were released as part of this community blind prediction exercise. Participants were invited to use a range of engineering modelling approaches to simulate the performance and loads of the turbine. 26 submissions were received from 12 groups from across academia and industry using solution techniques ranging from blade resolved computational fluid dynamics through actuator line, boundary integral element methods, vortex methods to engineering Blade Element Momentum methods. The comparisons between experiments and blind predictions were extremely positive helping to provide validation and uncertainty estimates for the models, but also validating the experimental tests themselves. The exercise demonstrated that the experimental turbine data provides a robust data set against which researchers and design engineers can test their models and implementations to ensure robustness in their processes, helping to reduce uncertainty and provide increased confidence in engineering processes. Furthermore, the data set provides the basis by which modellers can evaluate and refine approaches.

benchmarking↗

A Practical Probabilistic Benchmark for AI Weather Models

Since the weather is chaotic, it is necessary to forecast an ensemble of future states. Recently, multiple AI weather models have emerged claiming breakthroughs in deterministic skill. Unfortunately, it is hard to fairly compare ensembles of AI forecasts because variations in ensembling methodology become confounding and the baseline data volume is immense. We address this by scoring lagged initial condition ensembles—whereby an ensemble can be constructed from a library of deterministic hindcasts. This allows the first parameter‐free intercomparison of leading AI weather models' probabilistic skill against an operational baseline. Lagged ensembles of the two leading AI weather models, GraphCast and Pangu, perform similarly even though the former outperforms the latter in deterministic scoring. These results are elaborated upon by sensitivity tests showing that commonly used multiple time‐step loss functions damage ensemble calibration.

54 ENVIRONMENTAL SCIENCES↗

Tracking blobs in the turbulent edge plasma of a tokamak fusion device

Abstract The analysis of turbulence in plasmas is fundamental in fusion research. Despite extensive progress in theoretical modeling in the past 15 years, we still lack a complete and consistent understanding of turbulence in magnetic confinement devices, such as tokamaks. Experimental studies are challenging due to the diverse processes that drive the high-speed dynamics of turbulent phenomena. This work presents a novel application of motion tracking to identify and track turbulent filaments in fusion plasmas, called blobs, in a high-frequency video obtained from Gas Puff Imaging diagnostics. We compare four baseline methods (RAFT, Mask R-CNN, GMA, and Flow Walk) trained on synthetic data and then test on synthetic and real-world data obtained from plasmas in the Tokamak à Configuration Variable (TCV). The blob regime identified from an analysis of blob trajectories agrees with state-of-the-art conditional averaging methods for each of the baseline methods employed, giving confidence in the accuracy of these techniques. By making a dataset and benchmark publicly available, we aim to lower the entry barrier to tokamak plasma research, thereby greatly broadening the community of scientists and engineers who might apply their talents to this endeavor.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Toward shell model interactions with credible uncertainties

Background: The nuclear shell model is a powerful framework for predicting nuclear structure observables, but relies on interaction matrix elements fit to experimental data as its inputs. Extending the shell model's applicability, particularly toward dripline nuclei, requires efficient fitting methods and credible uncertainty quantification. Traditional approaches face computational challenges and may underestimate uncertainties. Purpose: We develop and test a framework combining eigenvector continuation and Markov chain Monte Carlo to efficiently fit shell model interaction matrix elements and quantify their uncertainties. Methods: Eigenvector continuation is used to emulate shell model calculations, reducing computational costs. The emulator enables Markov chain Monte Carlo sampling to optimize interaction matrix elements and rigorously assess parametric uncertainties. Here, the framework is benchmarked using the USDB interaction in the 𝑠⁢𝑑 shell. Results: The emulator reproduces the USDB interaction with negligible error, validating its use in shell model fitting applications. However, we find that to obtain credible predictive intervals, the model defect of the shell model itself, rather than experimental or emulator error, must be taken into account in order to obtain credible uncertainties. Conclusions: The proposed framework provides an efficient and rigorous approach for fitting shell model interactions and quantifying uncertainties. Further, the normality assumption used in the past appears sufficient to describe the distribution of interaction matrix elements. However, it is crucial to account for model correlations to avoid underestimating uncertainties.

Nuclear forces↗

Metal-Insulation REBCO Pancake Coil With Solder Surface Shunt: Testing and Modeling

Rare-earth barium copper oxide (REBCO) high-temperature superconducting (HTS) magnets can generate very high magnetic fields with superior engineering current density and robust mechanical integrity. The no-insulation (NI) winding technique, including its metal-insulation (MI) variant, enables “self-protection” against localized overheating through inter-turn current sharing, improving defect tolerance and allowing temporary current overloads. In REBCO pancake coils, the current-sharing path is predominantly confined to the edges of the REBCO tapes due to insulating buffer layers. Applying a surface shunt using solder can effectively enhance current sharing in NI/MI coils via the REBCO tape edges. Here, in this paper, we present both experimental and numerical research on the current distribution in surface-shunt metal-insulation (SSMI) REBCO pancake coils. We tested a stainless steel co-wound MI REBCO double-pancake coil, before and after applying a soldered surface shunt, in a saturated liquid nitrogen bath. The SSMI coil was modeled using the H-formulation and rotated anisotropic resistivity to study its dynamic behavior, including inter-turn current sharing and intra-turn screening currents. Benchmarked by experimental data, the numerical model is able to study the defect tolerance of the SSMI coil during energization.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

A Scalable and Distributed Algorithm for Managing Residential Demand Response Programs using Alternating Direction Method of Multipliers (ADMM)

For effective engagement of residential demand-side resources and to ensure efficient operation of distribution networks, we must overcome the challenges of controlling and coordinating residential components and devices at scale. To overcome this challenge, we present a distributed and scalable algorithm with a three-level hierarchical information exchange architecture for managing the residential demand response programs. First, a centralized optimization model is formulated to maximize community social welfare. Then, this centralized model is solved in a distributed manner with alternating direction method of multipliers (ADMM) by decomposing the original problem to utility-level and house-level problems. The information exchange between the different layers is limited to the primary residual (i.e., supply-demand mismatch), Lagrangian multipliers, and the total load of each house to protect each customer’s privacy. Simulation studies are performed on the IEEE 33 bus test system with 605 residential customers. The results demonstrate that the proposed approach can save customers’ electricity bills and reduce the peak load at the utility level without much affecting customers’ comfort and privacy. Finally, a quantitative comparison of the distributed and centralized algorithms shows the scalability advantage of the proposed ADMM-based approach, and it gives benchmarking results with achievable value for future research works.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Electric Drive Technologies Consortium (EDTC)/ Cost competitive, high-Performance, highly Reliable (CPR) Power Devices on 4H-SiC (Final Report)

4H-Silicon carbide (4H-SiC) is a wide bandgap semiconductor that offers superior material properties over silicon, including higher critical electric field, thermal conductivity, and electron saturation velocity. These advantages make 4H-SiC highly attractive for high-voltage, high-efficiency power electronics. However, realizing the full potential of SiC requires device technologies that are not only high-performing but also manufacturable and reliable under real-world operating conditions. This report summarizes the outcomes of a five-year R&D effort funded by the U.S. Department of Energy (DOE) under the Electric Drive Technologies Consortium (EDTC), focused on developing cost-competitive, high-performance, and highly reliable (CPR) power devices on 4H-SiC substrates. The program targeted scalable and manufacturable 1.2 kV-class SiC MOSFETs optimized for next-generation electric vehicles, renewable energy systems, and industrial power conversion. The project delivered transformative advancements in SiC power device performance and ruggedness. Particularly, Specific on-resistance (R on,sp ) was reduced by up to 37%, from ~4.0 m$\Omega \cdot$cm 2 in earlier designs to an industry-leading 2.40 m$\Omega \cdot$cm 2 , driven by optimized doping, refined JFET widths, and layout engineering. Breakdown voltages (BV) exceeded 1600 V, marking improvement over legacy baselines, and demonstrating the robustness of newly implemented junction profiles and edge terminations. Short-circuit withstand time (SCWT) saw a remarkable 4$\times$ increase, from ~2 $\mu$s to over 8 $\mu$s, achieved through the successful deployment of deep P-well structures (~1.8–2.0 $\mu$m) via channeling implantation. This innovative process breakthrough enabled precise junction formation without MeV-class implantation tools, reduced leakage under high field stress, and allowed even the shortest-channel devices (down to 0.3 $\mu$m) to achieve both high BV and excellent ruggedness—breaking the traditional trade-off between conduction efficiency and blocking capability. Several novel architectures pushed the performance envelope further. JBSFETs—featuring embedded Schottky portions—eliminated bipolar degradation and drastically reduced third-quadrant leakage, while Ladder MOSFETs introduced a clever orthogonal conduction path that achieved a 15.4% reduction in R on,sp over standard linear designs. Switching performance reached new benchmarks: short-channel devices showed a 31% reduction in total switching energy compared to 0.5 $\mu$m counterparts, while maintaining manageable gate drive requirements. Layout-optimized structures not only improved transconductance but also accelerated switching transitions, pointing to real-world benefits in converter-level efficiency. The devices also passed rigorous reliability validation. Stress-tested across TDDB, HTGB, HTRB, HVP, and burn-in, the devices screened under 30 V/10 hr and 43 V/1 s protocols consistently exhibited tighter lifetime distributions and long-term oxide robustness. These screening techniques proved effective in identifying latent defects and ensuring deployment-grade reliability. Meanwhile, advanced 3D TCAD simulations revealed and resolved electric field hotspots—particularly in HEXFET corners—where fields exceeding 4.8 MV/cm were mitigated through geometry-aware layout corrections. Overall, the results of this project demonstrate a manufacturable and scalable SiC power device platform that addresses key DOE performance targets for efficient, robust, and reliable 1.2kV 4H-SiC Power Devices. The developed technologies represent a meaningful step forward in the commercial readiness of high-voltage SiC solutions and provide a strong foundation for continued advancement in wide bandgap power electronics.

42 ENGINEERING↗

Measurement of Close-in Ground Motion from an Underground Chemical Explosion

Understanding the geophysical response near an underground explosion is crucial for generating insights into the source and emplacement conditions that produce distinct observations in monitoring scenarios occurring at greater distances. Recently, Shot A of the Low Yield Nuclear Monitoring (LYNM) Physics Experiment 1 (PE1) series was conducted at the Nevada National Security Site to provide ground truth for subsurface explosion signal models. This experiment resulted in measuring near-source ground motion at distances ranging from 70 to 1000 m/kt with a 99% success rate, yielding high-fidelity knowledge of the near-field response that can serve as benchmarks for future numerical modeling and experiment planning. However, technical challenges exist in observing near-source phenomena while safeguarding sensitive data acquisition components from the detrimental effects of ground motion in the subsurface. This report outlines tools and techniques to address challenges associated with observing near-source accelerations and within the tunnel drift of the PE1 test bed. Additionally, we describe key systems designed with both modern advancements and legacy guidance to maximize the collection of high-quality ground motion data, which may be applied to constitutive and computational models, leading to new or improved understanding of the near- and far-field signals produced by underground explosions.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Performance Improvements of the Griffin Solvers in FY24

The Griffin code is a MOOSE-based reactor physics application jointly developed by Idaho National Laboratory and Argonne National Laboratory under the Department of Energy Office of Nuclear Energy Nuclear Energy Advanced Modeling and Simulation Program. This fiscal year, we have made significant efforts to improve the performance of transport solver options and cross-section generation for the efficient use of Griffin in advanced reactor applications. For the HFEM-PN solver, the residual evaluations of HFEM kernels were optimized by utilizing the pre- computed averaged cross sections for individual elements. Numerical integration involving the evaluation of basis functions at quadrature points was bypassed by facilitating precomputed element mass matrices for response matrices. Red-black iterations were improved by introducing a new generalized minimum residual based solver. The memory usage of response matrix storage was significantly reduced by applying basis function rotations on interfaces and calculating volumetric odd-parity moments on the fly. Additionally, the adjoint flux and transient calculation capabilities of the HFEM-PN solver were successfully implemented and verified using the TWIGL benchmark problem. For the DFEM-SN solver, memory footprint and computation time were significantly reduced by not treating angular flux vectors as the MOOSE nonlinear system vectors. Specifically for IQS, scalar adjoint weighting was introduced to further eliminate angular adjoint flux storage in the MOOSE auxiliary system. It was demonstrated through the three-dimensional Advanced Burner Test Reactor core problem that the memory usage for transient calculations with the IQS method was reduced by over 7.5× compared to before the optimizations. For the self-shielding application programming interface, a new double-heterogeneity treatment method, named the Bell Function-Based Analytic Two-Region Slowing Down Method, was developed to efficiently flux-volume homogenize TRISO particles with the matrix. Additionally, optimizations were made to hyper- fine group (HFG) slowing down calculations by pretabulating collision probability coefficients and grouping isotopes, significantly reducing the computational time for calculating scattering sources per HFG. Lastly, the pin power reconstruction module was extended to account for temporal behavior in a microreactor analysis problem, specifically for a control drum transient. Verification tests for each of these improvements demonstrated significant performance enhancements and memory reduction.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Ion irradiation testing of 14YWT ODS and HT-9

Ion irradiations were performed to compare a new generation of 14YWT, NFA-2, to the prior generation NFA-1. Irradiations were performed at 450 °C and to a peak dose of 500 dpa. The irradiation condition was chosen as a relevant temperature for scoping for an upcoming JOYO neutron irradiation, and the high dose was chosen to evaluate the exceptional microstructural stability to irradiation induced changes of 14YWT. For comparison, HT-9 was irradiated as the benchmark. Irradiation induced changes to the microstructures were limited for the 14YWT samples and extensive for the HT-9 benchmark.

36 MATERIALS SCIENCE↗

Variationally consistent Maxwell stress in flexoelectric structures under finite deformation and immersed in free space

Maxwell stress refers to the mechanical stress exerted on a dielectric material due to the presence of electric fields. It plays a significant role in the interaction between a dielectric material and the surrounding free space under finite deformation. Previous research on finite deformation of flexoelectricity mainly adopted a modified form of Maxwell stress, potentially not able to correctly capture some physical phenomena, such as the compression of a dielectric droplet in an electric field. In this work, we propose a consistent and complete variational principle for flexoelectricity, in which the Maxwell stress emerges naturally from the derivation, without introducing additional assumptions. An Isogeometric analysis-based numerical framework is developed accordingly and verified by both linear and nonlinear benchmark cases compared with experimental results. The present framework successfully captures and quantifies the behaviors of conductive liquids and soft dielectric solids subjected to an external electric field. Finally, a novel scenario is investigated in which a flexoelectric beam immersed in free space is analyzed, showing the interesting distribution of Maxwell stress-induced tractions at opposing boundaries. The test demonstrates that a higher dielectric constant can effectively enhance the material's stiffness in response to the external electric loading.

36 MATERIALS SCIENCE↗