Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Jet tagging in the Lund plane with graph networks

The identification of boosted heavy particles such as top quarks or vector bosons is one of the key problems arising in experimental studies at the Large Hadron Collider. In this article, we introduce LundNet, a novel jet tagging method which relies on graph neural networks and an efficient description of the radiation patterns within a jet to optimally disentangle signatures of boosted objects from background events. We apply this framework to a number of different benchmarks, showing significantly improved performance for top tagging compared to existing state-of-the-art algorithms. We study the robustness of the LundNet taggers to non-perturbative and detector effects, and show how kinematic cuts in the Lund plane can mitigate overfitting of the neural network to model-dependent contributions. Finally, we consider the computational complexity of this method and its scaling as a function of kinematic Lund plane cuts, showing an order of magnitude improvement in speed over previous graph-based taggers.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Stereo-DIC Challenge 1.0 – Rigid Body Motion of a Complex Shape

Background Stereo-DIC is a widely used optical measurement technique that provides a dense full-field 3D measurement of the shape, displacement, and strain of a solid sample. When compared with 2D-DIC, Stereo-DIC provides greater flexibility and expands its use beyond flat, planar specimens. Furthermore, the widespread availability of commercial systems has led to the adoption of the technique throughout industry, academia, and government research labs. Objective Even though some research has been done to understand the effects of different experimental and stereo-DIC parameters, no reference is available to benchmark and compare the performance of current stereo-DIC algorithms to each other. Methods This paper provides the description and analysis of a carefully controlled 3D experiment and associated images used to compare the results from five subset based DIC software packages. Both the images and analysis codes used in this paper to compare the results are described here and are available for download and use for continued research. Results We show that over a very large range of motion, the 3D errors are very small, less than 80μm over a travel of ±20 mm out-of-plane and ±20 mm in-plane. While all codes performed similarly, there are important differences noted in the paper. Conclusion The image sets and results comparison software are hosted by the International DIC Society (www.iDICs.org) and are freely available for download and analysis for comparison with results in this paper. Furthermore, it is hoped that this set of images can be used for future research in improving stereo-DIC by future authors.

Algorithms comparison↗
DOE OSTI2024

First-principles and cluster expansion study of the effect of magnetism on short-range order in Fe–Ni–Cr austenitic stainless steels

Short-range order (SRO), the regular and predictable arrangement of atoms over short distances, alters the mechanical properties of technologically relevant structural materials such as medium/high entropy alloys and austenitic stainless steels. In this study, we present a generalized spin cluster expansion (CE) model and show that magnetism is a primary factor influencing the level of SRO present in austenitic Fe-Ni-Cr alloys. The spin CE consists of a chemical cluster expansion combined with an Ising model for Fe-Ni-Cr austenitic alloys. It explicitly accounts for local magnetic exchange interactions, thereby capturing the effects of finite temperature magnetism on SRO. Model parameters are obtained by fitting to a first-principles data set comprising both chemically and magnetically diverse FCC configurations. The magnitude of the magnetic exchange interactions are found to be comparable to the chemical interactions. Compared to a conventional implicit magnetism CE built from only magnetic ground state configurations, the spin CE shows improved performance on several experimental benchmarks over a broad spectrum of compositions, particularly at higher temperatures due to the explicit treatment of magnetic disorder. We find that SRO is strongly influenced by alloy Cr content, since Cr atoms prefer to align antiferromagnetically with nearest neighbors but become magnetically frustrated with increasing Cr concentration. Using the spin CE, we predict that increasing the Cr concentration in typical austenitic stainless steels promotes the formation of SRO and increases order-disorder transition temperatures. Furthermore, this study underscores the significance of considering magnetic interactions explicitly when exploring the thermodynamic properties of complex transition metal alloys. It also highlights guidelines for customizing SRO through adjustments of alloy composition.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Adaptive Interface-PINNs (AdaI-PINNs) for inverse problems: Determining material properties for heterogeneous systems

Here, we determine spatially varying discontinuous material properties using a domain-decomposition based physics-informed neural networks (PINNs) framework named the Adaptive Interface-PINNs or AdaI-PINNs (Roy et al., 2024). We propose the use of distinct neural networks for the field variables and material properties within each material, utilizing adaptive activation functions. While the neural networks across different materials share the same weights and biases, their activation functions are uniquely tailored using a hyperparameter that influences the slope of the activation function. The proposed framework is tested on several one-dimensional and two-dimensional benchmark examples, and its performance is compared with conventional PINNs and existing domain-decomposition PINNs frameworks, namely, the Multi-domain physics-informed neural network (M-PINN), and the eXtended physics-informed neural networks (XPINNs). The results demonstrate that the proposed approach can determine randomly distributed discontinuous material properties with an L 2 error of $\mathscr{O}$ (10 -3 ) for the material property and the root-mean-square error of $\mathscr{O}$ (10 -3 ) for the primary variable while the other approaches yield errors that are approximately two orders of magnitude larger (that is, $\mathscr{O}$ (10 -1 )). Moreover, the spatial distribution of material properties obtained using the proposed framework is in close agreement with the true distribution, whereas the other approaches fare much worse. Additionally, the proposed approach is approximately 40% faster than its competitors, indicating its potential as a robust alternative for solving inverse problems in heterogeneous materials.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Quantification of silicon carbide grain structure in TRISO fuel by BSE image analysis

The grain structure of the silicon carbide (SiC) layer in tristructural-isotropic (TRISO) fuels has commonly been qualified in fuel specifications based on a qualitative comparison to visual standards to ensure undesirable microstructure are not produced. This approach is inherently dependent on subjective judgement and provides limited data for analysis or comparison. An alternative method to rapidly quantify (i.e., provide a numeric measure of) the grain structure of the SiC layer in TRISO fuels has been developed. This method relies on the identification of silicon carbide grain boundaries based on brightness variation in backscattered electron (BSE) images through the application of automated image processing algorithms. The speed with which the requisite BSE imaging and analysis may be completed enables the practical use of this method on an industrial scale as a part of qualifying TRISO fuel to meet a given specification on silicon carbide grain structure, which is an important parameter for TRISO fuel performance. The method is benchmarked by comparison to prior Electron-Backscattered Diffraction (EBSD) results for TRISO particles from the Advanced Gas Reactor (AGR) program.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Benchmarking Coordination Number Prediction Algorithms on Inorganic Crystal Structures

Coordination numbers and geometries form a theoretical framework for understanding and predicting materials properties. Algorithms to determine coordination numbers automatically are increasingly used for machine learning and automatic structural analysis. In this work, we introduce MaterialsCoord, a benchmark suite containing 56 experimentally-derived crystal structures (spanning elements, binaries, and ternary compounds) and their corresponding coordination environments as described in the research literature. We also describe CrystalNN, a novel algorithm for determining near neighbors. We compare CrystalNN against 7 existing near-neighbor algorithms on the MaterialsCoord benchmark, finding CrystalNN to perform similarly to several well-established algorithms. For each algorithm, we also assess computational demand and sensitivity towards small perturbations that mimic thermal motion. Finally, we investigate the similarity between bonding algorithms when applied to the Materials Project database. Finally, we expect that this work will aid the development of coordination prediction algorithms as well as improve structural descriptors for machine learning and other applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Comparative Density Functional Theory Study of Magnetic Exchange Couplings in Dinuclear Transition-Metal Complexes

Multicenter transition-metal complexes (MCTMs) with magnetically interacting ions have been proposed as components for information-processing devices and storage units. For any practical application of MCTMs as magnetic units, it is crucial to characterize their magnetic behavior, and in particular, the isotropic magnetic exchange coupling, J, between its magnetic centers. Due to the large size of typical MCTMs, density functional theory is the only practical electronic structure method for evaluating the J coupling. Here, we assess the accuracy of different density functional approximations for predicting the magnetic couplings of eight dinuclear transition-metal complexes, including five dimanganese, two dicopper, and one divanadium with known reliable experimental J couplings spanning from ferromagnetic to strong antiferromagnetic. The density functionals considered include global hybrid functionals which mix semilocal density functional approximations and exact exchange with a fixed admixing parameter, six local hybrid functionals where the admixing parameters are extended to be spatially dependent, the SCAN and r 2 SCAN meta-generalized gradient approximations (GGAs), and two widely used GGAs. We found that global hybrids tested in this work have a tendency to over-correct the error in magnetic coupling parameters from the Perdew–Burke–Ernzerhof (PBE) GGA as seen for manganese complexes. The performance of local hybrid density functionals shows no improvement in terms of bias and is scattered without a clear trend, suggesting that more efforts are needed for the extension from global to local hybrid density functionals for this particular property. The SCAN and r 2 SCAN meta-GGAs are found to perform as well as benchmark global hybrids on most tested complexes. We further analyze the charge density redistribution of meta-GGAs as well as global and local hybrid density functionals with respect to that of PBE, in connection to the self-interaction error or delocalization error.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Completely Multipolar Model for Many-Body Water–Ion and Ion–Ion Interactions

This work constructs an advanced force field, the Completely Multipolar Model (CMM), to quantitatively reproduce each term of an energy decomposition analysis (EDA) for aqueous solvated alkali metal cations and halide anions and their ion pairings. We find that all individual EDA terms remain well-approximated in the CMM for ion-water and ion-ion interactions, except for polarization, which shows errors due to the partial covalency of ion interactions near their equilibrium. We quantify the onset of the dative bonding regime by examining the change in molecular polarizability and Mayer bond indices as a function of distance, showing that partial covalency manifests by breaking the symmetry of atomic polarizabilities while strongly damping them at short-range. This motivates an environment-dependent atomic polarizability parameter that depends on the strength of the local electric field experienced by the ions to account for strong damping, with anisotropy introduced by atomic multipoles. The resulting CMM model for ions provides accurate dimer surfaces and three-body polarization and charge transfer compared to EDA, and shows excellent performance on various ion benchmarks including vibrational frequencies and cluster geometries.

Heindel, Joseph P↗
DOE OSTI2026

Thermally Stable Co@C3N4 Single-Atom Catalysts for CO Oxidation: Atomic-Level Insights into Structure and Activity

Single Co atoms supported on C3N4 (Co@C3N4) have demonstrated high activity and selectivity in photocatalysis. However, the investigation of structure–function relationships and reaction mechanisms under photocatalytic conditions is very challenging due to the complex conditions of light absorption, charge transfer, and catalysis. In this study, we employed thermal CO oxidation as a prototypical probe reaction to benchmark the intrinsic catalytic performance and track the active-site evolution of Co@C3N4. Single Co atoms were identified and shown to be the catalytically active sites for CO oxidation based on control experiments and isotope-labeling experiments. The Co sites remained atomically dispersed before, during, and after the reaction with temperatures up to 400 °C, as established by in situ X-ray absorption fine structure (XAFS) combined with density functional theory (DFT), FDMNES simulations, and dynamic-time-warping (DTW)-assisted X-ray absorption near edge structure (XANES) matching. Together with theoretical calculations, the integrated analysis reveals a stable coordination environment under reaction conditions, which correlates with sustained activity, establishing Co@C3N4 single-atom catalysts as thermally stable CO oxidation catalysts. Beyond these findings, the current study provides a workflow for unambiguously assigning active sites in Co@C3N4 for thermal CO oxidation. This workflow will aid the understanding of their behavior in photocatalysis in the future, where light-driven dynamics obscure direct structure–function links. Notably, this study provides fundamental insights for the rational design of robust single-atom catalysts and a foundation for the broader application of Co@C3N4 catalysts in oxidation reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

A Lens into the Cu Nanograin by In Situ Vibrational Spectroscopy

Cu-based catalysts are uniquely capable of C-C coupling during electrochemical CO 2 reduction (CO 2 R), yet further mechanistic understanding remains hampered by the lack of spectroscopically resolved descriptors that demonstrate how surface adsorbates emerge and evolve within their catalytic environment. Here, in this study, we correlate in situ surface-enhanced Raman spectroscopy (SERS) and surface-enhanced infrared absorption spectroscopy (SEIRAS) to resolve the potential-dependent dynamics during CO 2 R on Cu nanograin catalysts. By building on previous benchmarking of low overpotential performance and nanograin structural evolution, we offer a diagnostic framework linking vibrational signatures to catalytic function, unveiling which species appear, persist, and turnover as the electrified surface and interfacial environment evolve under bias. The onset of linear CO is marked below -0.45 V, coincident with persistent adsorbed *OH/*O domains beyond the CO 2 R onset. In this context, Cu nanograins serve as a platform to dissect contributions of adsorbate coverage. By carefully dissecting the potential dependence of emergent twin-defect/step CO stretch bands (P1-P2), alongside the prototypical terrace-site CO stretch band (P3), we provide important context for interpreting coupled spectroscopic trends driven by coverage effects and resolve this for the evidently complex nanograin morphology. Together, these observations highlight the intertwined roles of surface stabilization and interfacial flux in steering multicarbon product formation. By directly linking vibrational signatures to catalytic behavior, this work aims to bridge the gap between observation and control and help guide toward a predictive framework of fine-tuned selectivity for CO 2 R.

Fonseca Guzman, Maria V. [University of California↗
DOE OSTI2025

Data from a multi-year targeted proteomics study of a longitudinal birth cohort of type 1 diabetes

The deployment of liquid chromatography-mass spectrometry-based plasma proteomics experiments in a large cohort is sparse, leading to a lack of data available for benchmarking, method development or validation. Comprised of 6,426 plasma analyses, The Environmental Determinants of Diabetes in the Young (TEDDY) proteomics validation study constitutes one of the largest targeted proteomics experiments in the literature to date. The proteomics data from this study were generated over the course of 2.5 years from over 900 study subjects, each providing up to 29 longitudinal samples. The data also includes 916 quality control samples. The targeted mass spectrometry assay was comprised of 694 peptides mapping to 167 proteins and the panel was measured in each subject and QC sample. The targeted proteomic dataset presented here can be used as a resource for new computational method development, such as for batch correction, as well as for benchmarking and comparing the performance of different methods/tools.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Extension of frozen natural orbital approximation to open-shell references: Theory, implementation, and application to single-molecule magnets

Natural orbitals are often used to achieve a more compact representation of correlated wave-functions. Using natural orbitals computed as eigenstates of the virtual–virtual block of the state density matrix instead of the canonical Hartree–Fock orbitals results in smaller errors when the same fraction of virtual space is frozen. This strategy, termed frozen natural orbital (FNO) approach, is effective in reducing the cost of regular coupled-cluster (CC) calculations and some multistate methods, such as EOM-IP-CC (equation-of-motion CC for ionization potentials). This contribution extends the FNO approach to the EOM-SF-CC ansatz (EOM-CC with spin-flip). In contrast to EOM-IP-CCSD, EOM-SF-CCSD relies on high-spin open-shell references. Using FNOs computed for an open-shell reference leads to an erratic behavior of the EOM-SF-CC energies and properties due to an inconsistent truncation of the α and β orbital spaces. A general solution to problems arising in the EOM-CC calculations utilizing open-shell references, termed OSFNO (open-shell FNO), is proposed. Furthermore, by means of singular value decomposition (SVD) of the overlap matrix of the α and β orbitals, the OSFNO algorithm identifies the corresponding orbitals and determines virtual orbitals corresponding to the singly occupied space. This is followed by SVD of the singlet part of the state density matrix in the remaining virtual orbital subspace. The so-computed FNOs preserve the spin purity of the open-shell orbital subspace to the extent allowed by the original reference, thus facilitating a safe truncation of the virtual space. The performance of OSFNO is benchmarked for selected diradicals and triradicals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Hybrid-gyrokinetic simulations of low- n toroidal Alfvén eigenmodes using gKPSP

Here, we report a benchmark study of toroidal Alfvén eigenmode (TAE) simulation using the hybrid-gyrokinetic code GyroKinetic Plasma Simulation Program (gKPSP). A simulation capability for energetic particles based on the gyrokinetic δf method has been newly implemented in the gKPSP code. Benchmark simulations have been performed in both circular and realistic tokamak geometries. Good agreement has been found with previously reported results, demonstrating the new capability of the gKPSP code. We have investigated the effects of the distribution function on TAE stability by examining both isotropic and anisotropic slowing-down distributions of energetic particles. The slowing-down distribution produces a higher linear growth rate than a Maxwellian distribution, while a growth rate scan with the anisotropy shows an opposite trend. This can be attributed to competition between Landau damping and the linear drive, which are correlated with the fraction of resonant passing particles and their distribution in phase space.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Bayesian experimental design and parameter estimation for ultrafast spin dynamics

Abstract Advanced experimental measurements are crucial for driving theoretical developments and unveiling novel phenomena in condensed matter and materials physics, which often suffer from the scarcity of large-scale facility resources, such as x-ray or neutron scattering centers. To address these limitations, we introduce a methodology that leverages the Bayesian optimal experimental design paradigm to efficiently uncover key quantum spin fluctuation parameters from x-ray photon fluctuation spectroscopy (XPFS) data. Our method is compatible with existing theoretical simulation pipelines and can also be used in combination with fast machine learning surrogate models in the event that real-time simulations are unfeasible. Our numerical benchmarks demonstrate the superior performance in predicting model parameters and in delivering more informative measurements within limited experimental time. Our method can be adapted to many different types of experiments beyond XPFS and spin fluctuation studies, facilitating more efficient data collection and accelerating scientific discoveries.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

The ballad of LLM agents: philosophical reasoning for chemistry

Large language models (LLMs) show remarkable potential for scientific reasoning but often produce unreliable or scientifically unactionable outputs when faced with multi-step logic, domain grounding, and interpretability challenges, especially in complex fields like chemistry and materials science. Here, we introduce a framework of philosophical reasoning agents, inspired by canonical thinkers such as Socrates, Descartes, Kant, and Hume, to guide LLM behavior via structured prompt engineering. These agents embody distinct reasoning paradigms (dialectical inquiry, deductive logic, rule-based judgment, and empirical validation) and are evaluated across multiple chemistry subdomains, physical, analytical, general, inorganic, and organic chemistry, using the ChemBench benchmark. Our agentic prompting approach yields substantial accuracy gains on open-ended numerical chemistry questions, with gains of +11.5 percentage points for GPT-4o with Hume, +4.5 percentage points for GPT-5 with Kant, and +21.8 percentage points for GPT-5.1 with Socrates at the strict 1% error threshold, relative to the corresponding base models. Beyond accuracy, we observe benchmark-level model–agent performance patterns, suggesting that different prompting styles interact differently with each base model. These findings demonstrate that embedding philosophy-of-science principles into multi-agent frameworks can improve and produce interpretable, adaptive, and domain-aligned scientific LLMs.

Harb, Hassan [Argonne National Laboratory (ANL), A↗
DOE OSTI2025

Desmearing small-angle scattering data by central moment expansions of instrument resolution

This study introduces an enhanced numerical technique tailored specifically for refining 1D small-angle scattering (SAS) intensity profiles affected by smearing. Our primary objective is to address the resolution blurring commonly encountered in SAS data, particularly in systems with clearly defined correlation peaks whose spread aligns with the width of the resolution function at corresponding Q positions. Unlike previous approaches that expanded the SAS intensity using central moment expansion, the new method focuses on expanding the resolution function itself, thus eliminating artificial oscillations observed in smeared spectra due to limitations inherent in our earlier algorithm. This method is straightforward to implement, computationally efficient and consistently performs well in numerical benchmarking. To illustrate its effectiveness, we present a case study of a lamellar phase characterized by distinct peaks in its small-angle neutron scattering intensities.

central moment expansions↗
DOE OSTI2024

Coarse Mesh Finite Difference Acceleration for Pebble Tracking Transport in Griffin

We implemented a coarse mesh finite difference (CMFD) for accelerating transport calculations with PTT (pebble tracking transport) in the Griffin code. More specifically, extensions for transport update with the consideration of scattering operator and CMFD projection were implemented for PTT. The implementation was verified with a simplified PBR (pebble bed reactor) benchmark problem and significant performance improvements in CPU time was observed.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

ECP Report: Update on Proxy Applications and Vendor Interactions

The ExaLearn miniGAN team (Ellis and Rajamanickam) have released miniGAN, a generative adversarial network(GAN) proxy application, through the ECP proxy application suite. miniGAN is the first machine learning proxy application in the suite (note: the ECP CANDLE project did previously release some benchmarks) and models the performance for training generator and discriminator networks. The GAN's generator and discriminator generate plausible 2D/3D maps and identify fake maps, respectively. miniGAN aims to be a proxy application for related applications in cosmology (CosmoFlow, ExaGAN) and wind energy (ExaWind). miniGAN has been developed so that optimized mathematical kernels (e.g., kernels provided by Kokkos Kernels) can be plugged into to the proxy application to explore potential performance improvements. miniGAN has been released as open source software and is available through the ECP proxy application website (https://proxyapps.exascaleproject.ordecp-proxy-appssuite/) and on GitHub (https://github.com/SandiaMLMiniApps/miniGAN). As part of this release, a generator is provided to generate a data set (series of images) that are inputs to the proxy application.

97 MATHEMATICS AND COMPUTING↗