Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Density Functionals for Hydrogen Storage: Defining the H2Bind275 Test Set with Ab Initio Benchmarks and Assessment of 55 Functionals

Efficient and high-capacity storage materials are indispensable for a hydrogen-based economy. In silico tools can accelerate the process of discovery of new adsorbent materials with optimal hydrogen adsorption enthalpies. Density functional theory is well-poised to become a very useful tool for enabling high-throughput screening of potential materials. In this work, we have identified density functional approximations that provide good performance for hydrogen binding applications following a two-pronged approach. First, we have compiled a data set (H2Bind275) that comprehensively represents the hydrogen binding problem capturing the chemical and mechanistic diversity in the binding sites encountered in hydrogen storage materials. We have also computed reference interaction energies for this data set using coupled-cluster theory. Second, we have assessed the performance of 55 density functional approximations for predicting H 2 interaction energies and have identified two hybrid density functionals (ωB97X-V and ωB97M-V), two double hybrid density functionals (DSD-PBEPBE-D3(BJ) and PBE0-DH), and one semilocal density functional (B97M-V) as the best performing ones. We have recommended the addition of empirical dispersion corrections to systematically underbinding density functionals such as revPBE, BLYP, and B3LYP for improvements in performance at negligible additional cost. We have also recommended the usage of the def2-TZVPP basis set as it represents a good compromise between accuracy and cost, limiting the finite basis set errors to less than 1 kJ/mol.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Solar Thermochemical Redox Cycling Using Ga- and Al-Doped LSM Perovskites for Renewable Hydrogen Production

Solar thermochemical hydrogen production using redox-active metal oxides is a promising pathway for the production of green hydrogen and synthetic fuel precursors. Herein, the perovskite material (La 0.6 Sr 0.4 ) 0.95 Mn 0.8 Ga 0.2 O 3–δ (LSMG6482) is identified as a promising metal oxide for thermochemical water splitting. LSMG6482, along with more-established water splitters ceria and (La 0.6 Sr 0.4 ) 0.95 Mn x Al 1–x O 3–δ (LSMA) perovskites, is experimentally characterized via thermogravimetric (TGA) analysis and high-temperature water splitting in a reactor simulating solar concentrating conditions. TGA analysis demonstrated that LSMG6482 has high and stable oxygen exchange capacity under controlled pO 2 redox cycling, demonstrated by large changes in oxygen nonstoichiometry (δ) relative to ceria. Water splitting experiments using laser heating (T red = 1400 °C, T ox = 1200 °C) resulted in H 2 yields of 165.1 μmol g –1 for the candidate LSMG6482 composition, exceeding that of all benchmark materials tested. Under high conversion oxidation conditions, where H 2 is cointroduced with H 2 O (150 ≤ nH 2 O/nH 2 ≤ 500), H 2 yields were greatest for LSMG6482 and LSMA6482, up to four times that of ceria at the highest nH 2 O/nH 2 conditions. Crystallographic analysis showed that over the course of experimentation, there is some secondary phase growth for all perovskite compositions, except for LSMA6482, but there was no observable degradation in H 2 yields.

08 HYDROGEN↗

Barrier Heights for Diels–Alder Transition States Leading to Pentacyclic Adducts: A Benchmark Study of Crowded, Strained Transition States of Large Molecules

Theoretical characterization of reactions of complex molecules depends on providing consistent accuracy for the relative energies of intermediates and transition states. Here we employ the DLPNO-CCSD(T) method with core–valence correlation, large basis sets, and extrapolation to the CBS limit to provide benchmark values for Diels–Alder transition states leading to competitive strained pentacyclic adducts. We then used those benchmarks to test a diverse set of wave function and density functional methods for the absolute and relative barrier heights of these transition states. Our results show that only a few of the tested density functionals can predict the absolute barrier heights satisfactorily, although relative barrier heights are more accurate. The most accurate functionals tested are ωB97M-V, M11plus, ωB97X-V, PBE-D3(0), M11, and MN15 with MUDs from best estimates less than 3.0 kcal. Furthermore, these findings can guide selection of density functionals for future studies of crowded, strained transition states of large molecules.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Resolution of Selectivity Steps of CO Reduction Reaction on Copper by Quantum Monte Carlo

Electrochemical reduction of carbon monoxide to valuable fuels and chemicals on copper surfaces remains a challenging area in catalysis due to a limited understanding of adsorption mechanisms and reaction pathways. Although density functional theory (DFT)-based studies have investigated these processes, their accuracy varies across different functionals. Here, in this study, we present the application of fixed-node diffusion Monte Carlo (FNDMC) to benchmark the adsorption energies of CO*, H*, and key CO reduction reaction (CORR) intermediates, COH* and CHO* on the Cu(111) surface. Our results for CO* and H* adsorption energies closely align with experimentally measured chemisorption reactions, highlighting the limitations of DFT and providing site-specific energy comparisons that are often not available experimentally. Additionally, we explore the effect of explicit solvation, demonstrating how water stabilizes the COH* over CHO*, thus suggesting a critical role of COH* in CORR. Finally, we release our high-accuracy FNDMC benchmarks for testing and developing new DFT functionals for electrocatalysis. Overall, this study underscores the potential of FNDMC for detailed surface chemistry studies and offers new insights into catalytic processes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Design Principles for the Synthesis of Self-Pillared ZSM-5 Zeolite Nanosheets

The design of next-generation materials for emerging energy and environmental applications heavily relies on empirical approaches to direct nonclassical nucleation and crystal growth pathways, polymorphism, intercrystalline transformations, and seed-assisted growth processes. A long-standing obstacle to nanoporous materials design is the complexity of their crystallization, which hinders the development of predictive models and/or physical descriptors that can guide their synthesis. In this study, we use a combination of state-of-the-art synthesis, characterization, and computational design to prepare hierarchical MFI-type zeolites, which we couple with benchmark catalytic testing to assess structure-property-performance relationships. These hierarchical materials are intergrowths of two commercially relevant zeolite frameworks, MFI and MEL, prepared as self-pillared pentasil (SPP) zeolites through seed-assisted, organic-free syntheses for which little theoretical guidance existed. Here, by comparing a large library of zeolite seeds with different pore sizes, dimensions, and structural composite building units, we determined the relative impact of seed and silica source selection, among other synthesis variables. Combined experimental and computational studies are used to test several hypotheses in literature to rationalize the choice of seed structure and establish a more robust selection criteria for seed-assisted synthesis of zeolites. Specifically, we show that a data-driven approach to develop structural descriptors correlates to new, facile routes to rationally design SPP zeolites, addressing knowledge gaps in the fundamental understanding of (non)classical crystal growth mechanisms that are characteristic of nanoporous aluminosilicates.

36 MATERIALS SCIENCE↗

Comparing Liquid Vortex Capture & the Rapid Droplet Sampling Interface for Single Cell Mass Spectrometry

High-throughput single-cell mass spectrometry is a rapidly evolving field that requires innovative sampling and ionization techniques to balance speed, sensitivity, and reliability for metabolomic and lipidomic analyses. This study provides a comparative analysis of two cutting-edge ionization platforms for single-cell analysis: Liquid Vortex Capture (LVC) and Rapid Droplet Sampling Interface (RDSI). The performance was benchmarked by testing pharmaceuticals, EquiSPLASH, and single-cell experiments. RDSI demonstrated up to 100-fold improvements in sensitivity for drugs and lipids such as propranolol, amiodarone, atorvastatin, and phosphocholines in water and phosphate-buffered solutions. This was attributed to its low-flow rate operation (3 μL/min) and reduced dilution. Conversely, LVC excelled in handling higher liquid volumes with greater reproducibility due to its higher solvent flow rate (200 μL/min), enabling increased dilution, solubility, and cleaning. Single-cell uptake of atorvastatin incubated for 10 min, or amiodarone incubated for 24 h in HepG2 cells, similarly revealed up to 85-fold enhancement in sensitivity by RDSI for drugs and lipids. These findings highlight the potential of RDSI for enhancing sensitivity in single-cell drug monitoring and lipidomics.

Cahill, John [ORNL] (ORCID:0000000298664010)↗

Overview of the Nephele Perturbed Parameter Ensemble for Aerosol‐Cloud Interactions in E3SMv3

Aerosol-cloud interactions (aci) are the leading source of uncertainty in inferring climate sensitivity from the historical record. Earth system models (ESMs) struggle to represent aci because the processes responsible for these phenomena occur at much finer time and space scales than can be resolved by any ESM. Observational constraints provide key benchmarks to test ESMs, but cannot be used alone to fully understand aci processes except in very specific cases where causality is controlled; some degree of modeling is required to infer aci and estimate radiative forcing. Here, we generate and characterize a perturbed parameter ensemble (PPE) in version 3 of the Energy Exascale ESM (E3SMv3). We perturb 25 parameters that govern aci processes over 250 members and integrate the model over present-day and preindustrial aerosol emissions. We find that the process representation in E3SMv3 is flexible and can generate global-mean effective radiative forcings due to aci (ERFaci) ranging from −3.0 to +0.9 W m −2 . The positive ERFaci values simulated by a portion of the PPE are implausible and result from parameter combinations that produce unrealistic top-of-atmosphere energy fluxes. While global-mean cloud droplet number concentration always increases in response to anthropogenic aerosol, cloud liquid water path can both increase and decrease, suggesting that precipitation suppression is not the only aerosol-cloud adjustment represented by E3SMv3. Analysis of which processes control liquid cloud adjustment in the PPE points toward stratiform precipitation processes and aerosol activation, which is consistent with many previous ESMs, as well as the new two-moment convective cloud microphysics in E3SMv3.

Nugent, Jacqueline M. [Univ. of Wyoming, Laramie, ↗

Ensemble transfer learning for the prediction of anti-cancer drug response

Abstract Transfer learning, which transfers patterns learned on a source dataset to a related target dataset for constructing prediction models, has been shown effective in many applications. In this paper, we investigate whether transfer learning can be used to improve the performance of anti-cancer drug response prediction models. Previous transfer learning studies for drug response prediction focused on building models to predict the response of tumor cells to a specific drug treatment. We target the more challenging task of building general prediction models that can make predictions for both new tumor cells and new drugs. Uniquely, we investigate the power of transfer learning for three drug response prediction applications including drug repurposing, precision oncology, and new drug development, through different data partition schemes in cross-validation. We extend the classic transfer learning framework through ensemble and demonstrate its general utility with three representative prediction algorithms including a gradient boosting model and two deep neural networks. The ensemble transfer learning framework is tested on benchmark in vitro drug screening datasets. The results demonstrate that our framework broadly improves the prediction performance in all three drug response prediction applications with all three prediction algorithms.

60 APPLIED LIFE SCIENCES↗

Application of research reactor environments for validation of the IRDFF-II dosimetry cross section library

Activation data from seven different reactor-based reference neutron fields are examined to provide enhanced validation evidence for the newly released IRDFF-II library. A least-squares based spectrum adjustment methodology is used and rigorous statistical metrics demonstrate the consistency of the set of IRDFF-II dosimetry cross sections. The use of these reactor-based neutron fields provides validation evidence for nine more reactions than have been addressed in the 252 Cf(sf) and 235 U(th) benchmark validation testing. The use of covers to shift their energy response increases the power of the response validation but makes it challenging to properly capture response correlations.

Griffin, Patrick↗

Bond length alternation of π -conjugated polymers predicted by the Fermi–Löwdin orbital self-interaction correction method

π-conjugated polymers have been used in a wide range of practical applications, partly due to their unique properties that originate in the delocalization of electrons through the polymer backbone. The level of delocalization can be characterized by the induced bond length alternation (BLA), with shorter BLA connected with strong delocalization and vice versa. The accurate description of this structural parameter can be considered a benchmark for testing the capability of different electronic structure methods for self-interaction error (SIE) removal and electron correlation inclusion. Density functional theory (DFT), in its local or semi-local flavors, suffers from SIE and, thus, underestimates the BLA compared to self-interaction-free methods. In this work, we utilize the Fermi–Löwdin orbital self-interaction correction (FLOSIC) method for one-electron self-interaction removal to characterize the BLA of five oligomers with increasing length extrapolated to the polymeric limit. We compare the self-interaction-free BLA to several DFT approximations, Møller–Plesset second-order perturbation theory (MP2), and the BLA obtained with the domain based local pair natural orbital CCSD(T) [DLPNO-CCSD(T)] approximation. Our findings show that FLOSIC corrects for the small BLA given by (semi-)local DFT approximations, but it tends to overcorrect with respect to CAM-B3LYP, MP2, and DLPNO-CCSD(T).

Chemistry↗

Demonstration of TOFFEE: A Response Uncertainty Quantification Tool

A key characteristic in neutron transport is nuclear data. Cross-section uncertainty is not used in MCNP6.3 to propagate response uncertainty without external analysis. Here, the TOol For Fast Error Estimation (TOFFEE) is a Python-based code developed to automate the propagation of cross-section uncertainty for MCNP evaluations. TOFFEE implements the sandwich rule to calculate the uncertainty from cross sections with sensitivity coefficients from MCNP6.3 and ENDF/B covariance data. In this paper, TOFFEE has been tested with benchmark experiments, and it has been compared to the uncertainty quantification capabilities of Sampler and TSUNAMI, within SCALE, to verify the application’s capabilities.

97 MATHEMATICS AND COMPUTING↗

Progress in modelling fast-ion D-alpha spectra and neutral particle analyzer fluxes using FIDASIM

FIDASIM is a code that models signals produced by charge-exchange reactions between neutrals and ions (both fast and thermal) in magnetically confined plasmas. With the ion distribution function as input, the code predicts the efflux to a neutral particle analyzer diagnostic and the photon radiance of Balmer-alpha light to a fast-ion D α diagnostic, in addition to many other related quantities. A new, parallelized version of the Monte Carlo code FIDASIM has been developed in Fortran90 that is substantially faster than the original interactive data language version. Modified algorithms include more accurate treatments of the time dependent collisional-radiative equations that describe neutral energy levels, of the cloud of ‘halo’ neutrals that surround the injected neutral beam, and of finite Larmor radius effects. Enhanced physics capabilities include modelling ‘passive’ signals from cold edge neutrals, the ability to treat general three-dimensional magnetic confinement configurations, and calculations of diagnostic-specific weight functions that enable tomographic reconstructions of the fast-ion distribution function. Neutral beam attenuation, beam emission, and fast-ion birth profiles are also modelled. Finally, the new algorithms have been successfully validated against experimental data and new features have been tested through benchmarks between two independently developed versions of the code.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Coordinate parameterisation and spectral method optimisation for Beltrami field solver in stellarator geometry

The numerical solution of the stepped pressure equilibrium (Hudson et al 2012 Phys. Plasmas 19 112502) requires a fast and robust solver to obtain the Beltrami field in three-dimensional geometry such as stellarators. The spectral method implemented in the stepped pressure equilibrium code (SPEC) is efficient when the domain is a hollow torus, but ill-conditioning of the discretised linear equations occurs in the (solid) toroid due to the artificially singular coordinate parameterisation near the axis. Here, we propose an improved choice for the reference axis to prevent coordinates surfaces from overlapping. Then, we examine the parity and asymptotics of the magnetic vector potential near the axis and suggest the use of recombined and rescaled Zernike radial basis functions. The maximum relative error in the magnetic field of the Wendelstein 7-X geometry is shown to reach 10 –9 at high resolution in a series of convergence tests and benchmarks against the boundary integral equation solver for Taylor states. The new method is also reported to significantly improve the accuracy of multi-volume SPEC calculations. A comparison between free-boundary SPEC and the analytical Dommaschk potential is presented with higher-than-usual Fourier resolution. It is illustrated that we are able to resolve low amplitude current sheets when an interface is placed where there is no flux surface in the analytic solution. This was previously concealed because of insufficient numerical resolution.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

PICSAR-QED: a Monte Carlo module to simulate strong-field quantum electrodynamics in particle-in-cell codes for exascale architectures

Abstract Physical scenarios where the electromagnetic fields are so strong that quantum electrodynamics (QED) plays a substantial role are one of the frontiers of contemporary plasma physics research. Investigating those scenarios requires state-of-the-art particle-in-cell (PIC) codes able to run on top high-performance computing (HPC) machines and, at the same time, able to simulate strong-field QED processes. This work presents the PICSAR-QED library, an open-source, portable implementation of a Monte Carlo module designed to provide modern PIC codes with the capability to simulate such processes, and optimized for HPC. Detailed tests and benchmarks are carried out to validate the physical models in PICSAR-QED, to study how numerical parameters affect such models, and to demonstrate its capability to run on different architectures (CPUs and GPUs). Its integration with WarpX, a state-of-the-art PIC code designed to deliver scalable performance on upcoming exascale supercomputers, is also discussed and validated against results from the existing literature.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Global linear and nonlinear gyrokinetic simulations of tearing modes

Abstract To better understand multi-scale interactions between global tearing modes and microturbulence in the Madison Symmetric Torus (MST) reversed-field pinch (RFP), the global gyrokinetic code Gene is modified to describe global tearing mode instability via a shifted Maxwellian (SM) distribution consistent with experimental equilibria. The implementation of the SM is tested and benchmarked by comparisons with different codes and models. Good agreement is obtained in code-code and code-theory comparisons. Linear stability of tearing modes of a non-reversed MST discharge is studied. A collisionality scan is performed to the lowest order unstable modes ( n = 5, n = 6) and shown to behave consistently with theoretical scaling. The nonlinear evolution is simulated, and saturation is found to arise from mode coupling and transfer of energy from the most unstable tearing mode to small-scale stable modes mediated by the m = 2 tearing mode. The work described herein lays the foundation for nonlinear simulation and analysis of the interaction of tearing modes and gyroradius-scale instabilities in RFP plasmas.

Physics↗

PYK-SubstitutionOME: an integrated database containing allosteric coupling, ligand affinity and mutational, structural, pathological, bioinformatic and computational information about pyruvate kinase isozymes

Interpreting changes in patient genomes, understanding how viruses evolve and engineering novel protein function all depend on accurately predicting the functional outcomes that arise from amino acid substitutions. To that end, the development of first-generation prediction algorithms was guided by historic experimental datasets. However, these datasets were heavily biased toward substitutions at positions that have not changed much throughout evolution (i.e. conserved). Although newer datasets include substitutions at positions that span a range of evolutionary conservation scores, these data are largely derived from assays that agglomerate multiple aspects of function. To facilitate predictions from the foundational chemical properties of proteins, large substitution databases with biochemical characterizations of function are needed. We report here a database derived from mutational, biochemical, bioinformatic, structural, pathological and computational studies of a highly studied protein family—pyruvate kinase (PYK). A centerpiece of this database is the biochemical characterization—including quantitative evaluation of allosteric regulation—of the changes that accompany substitutions at positions that sample the full conservation range observed in the PYK family. We have used these data to facilitate critical advances in the foundational studies of allosteric regulation and protein evolution and as rigorous benchmarks for testing protein predictions. We trust that the collected dataset will be useful for the broader scientific community in the further development of prediction algorithms.

59 BASIC BIOLOGICAL SCIENCES↗

Contribution of nuclear excitation electromagnetic form factors in C 12 and O 16 to the Coulomb sum rule

We report on empirical parametrizations of longitudinal and transverse nuclear excitation electromagnetic form factors in 12 C and 16 O. We extract the contribution of nuclear excitations to the normalized inelastic Coulomb sum rule [S L (q)] as a function of momentum transfer q and find that it is significant (0.29 ± 0.030 at q = 0.22 GeV). The total contributions of nuclear excitations to S L (q) in 12 C and 16 O are found to be equal within uncertainties. Since the cross sections for nuclear excitations are significant, the radiative tails from nuclear excitations should be included in precise calculations of radiative corrections to quasielastic electron scattering at low q and deep-inelastic electron scattering at large energy transfers ν. The parametrizations also serve as a benchmark in testing theoretical modeling of cross sections for excitation of nuclear states in electron and neutrino interactions on nuclear targets at low energies.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Signal Processing Based Method for Real-Time Anomaly Detection in High-Performance Computing

Performance anomalies can manifest as irregular execution times or abnormal execution events for many reasons, including network congestion and resource contention. Detecting such anomalies in real-time by analyzing the details of performance traces at scale is impractical due to the sheer volume of data High-Performance Computing (HPC) applications produce. In this paper, we propose formulating HPC performance anomaly detection as a signal-processing problem where anomalies can be treated as noise. We evaluate our proposed method in comparison with two other commonly used anomaly detection techniques of varying complexity based on their detection accuracy and scalability. Since real-time in-situ anomaly detection at a large scale requires lightweight methods that can handle a large volume of streaming data, we find that our proposed method provides the best trade-off. We then implement the proposed method in Chimbuko, the first online, distributed, and scalable workflow-level performance trace analysis framework. We compare our proposed signal-based anomaly detection algorithm with two other methods using a function of their accuracy, F1 score, and detection overhead. Our experiments demonstrate that our proposed approach achieves a 99% improvement for the benchmark datasets and a 93% improvement with Chimbuko traces.

99 GENERAL AND MISCELLANEOUS↗