Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Three-dimensional Skyrme Hartree-Fock-Bogoliubov solver in coordinate-space representation

The coordinate-space representation of the Hartree-Fock-Bogoliubov theory is the method of choice to study weakly bound nuclei whose properties are affected by the quasiparticle continuum space. To describe such systems, we developed a three-dimensional Skyrme-Hartree-Fock-Bogoliubov solver HFBFFT based on the existing, highly optimized and parallelized Skyrme-Hartree-Fock code Sky3D. The code does not impose any self-consistent spatial symmetries such as mirror inversions or parity. The underlying equations are solved in HFBFFT directly in the canonical basis using the fast Fourier transform. To remedy the problems with pairing collapse, we implemented the soft energy cutoff and pairing annealing. The convergence of HFB solutions was improved by a sub-iteration method. The Hermiticity violation of differential operators brought by Fourier-transform-based differentiation has also been solved. Furthermore, the accuracy and performance of HFBFFT were tested by benchmarking it against other HFB codes, both spherical and deformed, for a set of nuclei, both well-bound and weakly-bound.

3D coordinate-space representation↗

A performance evaluation framework for building fault detection and diagnosis algorithms

Fault detection and diagnosis (FDD) algorithms for building systems and equipment represent one of the most active areas of research and commercial product development in the buildings industry. However, far more effort has gone into developing these algorithms than into assessing their performance. As a result, considerable uncertainties remain regarding the accuracy and effectiveness of both research-grade FDD algorithms and commercial products - a state of affairs that has hindered the broad adoption of FDD tools. This article presents a general, systematic framework for evaluating the performance of FDD algorithms. The article focuses on understanding the possible answers to two key questions: in the context of FDD algorithm evaluation, what defines a fault and what defines an evaluation input sample? The answers to these questions, together with appropriate performance metrics, may be used to fully specify evaluation procedures for FDD algorithms.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

An investigation on machine learning predictive accuracy improvement and uncertainty reduction using VAE-based data augmentation

The confluence of ultrafast computers with large memory, rapid progress in Machine Learning (ML) algorithms, and the availability of large datasets place multiple engineering fields at the threshold of dramatic progress. However, a unique challenge in nuclear engineering is data scarcity because experimentation on nuclear systems is usually more expensive and time-consuming than most other disciplines. One potential way to resolve the data scarcity issue is deep generative learning, which uses certain ML models to learn the underlying distribution of existing data and generate synthetic samples that resemble the real data. In this way, one can significantly expand the dataset to train more accurate predictive ML models. In this study, our objective is to evaluate the effectiveness of data augmentation using variational autoencoder (VAE)-based deep generative models. We investigated whether the data augmentation leads to improved accuracy in the predictions of a deep neural network (DNN) model trained using the augmented data. Additionally, the DNN prediction uncertainties are quantified using Bayesian Neural Networks (BNN) and conformal prediction (CP) to assess the impact on predictive uncertainty reduction. To test the proposed methodology, we used TRACE simulations of steady-state void fraction data based on the NUPEC Boiling Water Reactor Full-size Fine-mesh Bundle Test (BFBT) benchmark. Here, we found that augmenting the training dataset using VAEs has improved the DNN model’s predictive accuracy, improved the prediction confidence intervals, and reduced the prediction uncertainties.

Bayesian neural network↗

Density Functionals for Hydrogen Storage: Defining the H2Bind275 Test Set with Ab Initio Benchmarks and Assessment of 55 Functionals

Efficient and high-capacity storage materials are indispensable for a hydrogen-based economy. In silico tools can accelerate the process of discovery of new adsorbent materials with optimal hydrogen adsorption enthalpies. Density functional theory is well-poised to become a very useful tool for enabling high-throughput screening of potential materials. In this work, we have identified density functional approximations that provide good performance for hydrogen binding applications following a two-pronged approach. First, we have compiled a data set (H2Bind275) that comprehensively represents the hydrogen binding problem capturing the chemical and mechanistic diversity in the binding sites encountered in hydrogen storage materials. We have also computed reference interaction energies for this data set using coupled-cluster theory. Second, we have assessed the performance of 55 density functional approximations for predicting H 2 interaction energies and have identified two hybrid density functionals (ωB97X-V and ωB97M-V), two double hybrid density functionals (DSD-PBEPBE-D3(BJ) and PBE0-DH), and one semilocal density functional (B97M-V) as the best performing ones. We have recommended the addition of empirical dispersion corrections to systematically underbinding density functionals such as revPBE, BLYP, and B3LYP for improvements in performance at negligible additional cost. We have also recommended the usage of the def2-TZVPP basis set as it represents a good compromise between accuracy and cost, limiting the finite basis set errors to less than 1 kJ/mol.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Charge-Transfer Versus Charge-Transfer-Like Excitations Revisited

Criteria to assess charge-transfer (CT) and `CT-like' character of electronic excitations are examined. Time-dependent density functional theory (TDDFT) with non-hybrid, hybrid, and tuned long-range corrected (LC) functionals is compared with with coupled-cluster (CC) benchmarks. The test set includes an organic CT complex, two `push-pull' donor-acceptor chromophores, a cyanine dye, and several polycyclic aromatic hydrocarbons. Proper CT is easily identified. Excitations with significant density changes upon excitation within regions of close spatial proximity can also be diagnosed. For such excitations, the use of LC functionals in TDDFT sometimes leads to dramatic improvements of the singlet energies, similar to proper CT, which has led to the concept of `CT-like' excitations. However, `CT-like' excitations are not like charge transfer, and the improvements are not obtained for the right reasons. The triplet excitation energies are underestimated for all systems, often severely. For the `CT-like' candidates, when going from a non-hybrid to an LC functional the error in the singlet-triplet (S/T) separation changes from negative to positive, providing error compensation. For the cyanine, the S/T separation is too large with all functionals, leading to the best error compensation for non-hybrid functionals.

Charge-transfer↗

Solar Thermochemical Redox Cycling Using Ga- and Al-Doped LSM Perovskites for Renewable Hydrogen Production

Solar thermochemical hydrogen production using redox-active metal oxides is a promising pathway for the production of green hydrogen and synthetic fuel precursors. Herein, the perovskite material (La 0.6 Sr 0.4 ) 0.95 Mn 0.8 Ga 0.2 O 3–δ (LSMG6482) is identified as a promising metal oxide for thermochemical water splitting. LSMG6482, along with more-established water splitters ceria and (La 0.6 Sr 0.4 ) 0.95 Mn x Al 1–x O 3–δ (LSMA) perovskites, is experimentally characterized via thermogravimetric (TGA) analysis and high-temperature water splitting in a reactor simulating solar concentrating conditions. TGA analysis demonstrated that LSMG6482 has high and stable oxygen exchange capacity under controlled pO 2 redox cycling, demonstrated by large changes in oxygen nonstoichiometry (δ) relative to ceria. Water splitting experiments using laser heating (T red = 1400 °C, T ox = 1200 °C) resulted in H 2 yields of 165.1 μmol g –1 for the candidate LSMG6482 composition, exceeding that of all benchmark materials tested. Under high conversion oxidation conditions, where H 2 is cointroduced with H 2 O (150 ≤ nH 2 O/nH 2 ≤ 500), H 2 yields were greatest for LSMG6482 and LSMA6482, up to four times that of ceria at the highest nH 2 O/nH 2 conditions. Crystallographic analysis showed that over the course of experimentation, there is some secondary phase growth for all perovskite compositions, except for LSMA6482, but there was no observable degradation in H 2 yields.

08 HYDROGEN↗

Barrier Heights for Diels–Alder Transition States Leading to Pentacyclic Adducts: A Benchmark Study of Crowded, Strained Transition States of Large Molecules

Theoretical characterization of reactions of complex molecules depends on providing consistent accuracy for the relative energies of intermediates and transition states. Here we employ the DLPNO-CCSD(T) method with core–valence correlation, large basis sets, and extrapolation to the CBS limit to provide benchmark values for Diels–Alder transition states leading to competitive strained pentacyclic adducts. We then used those benchmarks to test a diverse set of wave function and density functional methods for the absolute and relative barrier heights of these transition states. Our results show that only a few of the tested density functionals can predict the absolute barrier heights satisfactorily, although relative barrier heights are more accurate. The most accurate functionals tested are ωB97M-V, M11plus, ωB97X-V, PBE-D3(0), M11, and MN15 with MUDs from best estimates less than 3.0 kcal. Furthermore, these findings can guide selection of density functionals for future studies of crowded, strained transition states of large molecules.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Resolution of Selectivity Steps of CO Reduction Reaction on Copper by Quantum Monte Carlo

Electrochemical reduction of carbon monoxide to valuable fuels and chemicals on copper surfaces remains a challenging area in catalysis due to a limited understanding of adsorption mechanisms and reaction pathways. Although density functional theory (DFT)-based studies have investigated these processes, their accuracy varies across different functionals. Here, in this study, we present the application of fixed-node diffusion Monte Carlo (FNDMC) to benchmark the adsorption energies of CO*, H*, and key CO reduction reaction (CORR) intermediates, COH* and CHO* on the Cu(111) surface. Our results for CO* and H* adsorption energies closely align with experimentally measured chemisorption reactions, highlighting the limitations of DFT and providing site-specific energy comparisons that are often not available experimentally. Additionally, we explore the effect of explicit solvation, demonstrating how water stabilizes the COH* over CHO*, thus suggesting a critical role of COH* in CORR. Finally, we release our high-accuracy FNDMC benchmarks for testing and developing new DFT functionals for electrocatalysis. Overall, this study underscores the potential of FNDMC for detailed surface chemistry studies and offers new insights into catalytic processes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Design Principles for the Synthesis of Self-Pillared ZSM-5 Zeolite Nanosheets

The design of next-generation materials for emerging energy and environmental applications heavily relies on empirical approaches to direct nonclassical nucleation and crystal growth pathways, polymorphism, intercrystalline transformations, and seed-assisted growth processes. A long-standing obstacle to nanoporous materials design is the complexity of their crystallization, which hinders the development of predictive models and/or physical descriptors that can guide their synthesis. In this study, we use a combination of state-of-the-art synthesis, characterization, and computational design to prepare hierarchical MFI-type zeolites, which we couple with benchmark catalytic testing to assess structure-property-performance relationships. These hierarchical materials are intergrowths of two commercially relevant zeolite frameworks, MFI and MEL, prepared as self-pillared pentasil (SPP) zeolites through seed-assisted, organic-free syntheses for which little theoretical guidance existed. Here, by comparing a large library of zeolite seeds with different pore sizes, dimensions, and structural composite building units, we determined the relative impact of seed and silica source selection, among other synthesis variables. Combined experimental and computational studies are used to test several hypotheses in literature to rationalize the choice of seed structure and establish a more robust selection criteria for seed-assisted synthesis of zeolites. Specifically, we show that a data-driven approach to develop structural descriptors correlates to new, facile routes to rationally design SPP zeolites, addressing knowledge gaps in the fundamental understanding of (non)classical crystal growth mechanisms that are characteristic of nanoporous aluminosilicates.

36 MATERIALS SCIENCE↗

Comparing Liquid Vortex Capture & the Rapid Droplet Sampling Interface for Single Cell Mass Spectrometry

High-throughput single-cell mass spectrometry is a rapidly evolving field that requires innovative sampling and ionization techniques to balance speed, sensitivity, and reliability for metabolomic and lipidomic analyses. This study provides a comparative analysis of two cutting-edge ionization platforms for single-cell analysis: Liquid Vortex Capture (LVC) and Rapid Droplet Sampling Interface (RDSI). The performance was benchmarked by testing pharmaceuticals, EquiSPLASH, and single-cell experiments. RDSI demonstrated up to 100-fold improvements in sensitivity for drugs and lipids such as propranolol, amiodarone, atorvastatin, and phosphocholines in water and phosphate-buffered solutions. This was attributed to its low-flow rate operation (3 μL/min) and reduced dilution. Conversely, LVC excelled in handling higher liquid volumes with greater reproducibility due to its higher solvent flow rate (200 μL/min), enabling increased dilution, solubility, and cleaning. Single-cell uptake of atorvastatin incubated for 10 min, or amiodarone incubated for 24 h in HepG2 cells, similarly revealed up to 85-fold enhancement in sensitivity by RDSI for drugs and lipids. These findings highlight the potential of RDSI for enhancing sensitivity in single-cell drug monitoring and lipidomics.

Cahill, John [ORNL] (ORCID:0000000298664010)↗

Overview of the Nephele Perturbed Parameter Ensemble for Aerosol‐Cloud Interactions in E3SMv3

Aerosol-cloud interactions (aci) are the leading source of uncertainty in inferring climate sensitivity from the historical record. Earth system models (ESMs) struggle to represent aci because the processes responsible for these phenomena occur at much finer time and space scales than can be resolved by any ESM. Observational constraints provide key benchmarks to test ESMs, but cannot be used alone to fully understand aci processes except in very specific cases where causality is controlled; some degree of modeling is required to infer aci and estimate radiative forcing. Here, we generate and characterize a perturbed parameter ensemble (PPE) in version 3 of the Energy Exascale ESM (E3SMv3). We perturb 25 parameters that govern aci processes over 250 members and integrate the model over present-day and preindustrial aerosol emissions. We find that the process representation in E3SMv3 is flexible and can generate global-mean effective radiative forcings due to aci (ERFaci) ranging from −3.0 to +0.9 W m −2 . The positive ERFaci values simulated by a portion of the PPE are implausible and result from parameter combinations that produce unrealistic top-of-atmosphere energy fluxes. While global-mean cloud droplet number concentration always increases in response to anthropogenic aerosol, cloud liquid water path can both increase and decrease, suggesting that precipitation suppression is not the only aerosol-cloud adjustment represented by E3SMv3. Analysis of which processes control liquid cloud adjustment in the PPE points toward stratiform precipitation processes and aerosol activation, which is consistent with many previous ESMs, as well as the new two-moment convective cloud microphysics in E3SMv3.

Nugent, Jacqueline M. [Univ. of Wyoming, Laramie, ↗

Ensemble transfer learning for the prediction of anti-cancer drug response

Abstract Transfer learning, which transfers patterns learned on a source dataset to a related target dataset for constructing prediction models, has been shown effective in many applications. In this paper, we investigate whether transfer learning can be used to improve the performance of anti-cancer drug response prediction models. Previous transfer learning studies for drug response prediction focused on building models to predict the response of tumor cells to a specific drug treatment. We target the more challenging task of building general prediction models that can make predictions for both new tumor cells and new drugs. Uniquely, we investigate the power of transfer learning for three drug response prediction applications including drug repurposing, precision oncology, and new drug development, through different data partition schemes in cross-validation. We extend the classic transfer learning framework through ensemble and demonstrate its general utility with three representative prediction algorithms including a gradient boosting model and two deep neural networks. The ensemble transfer learning framework is tested on benchmark in vitro drug screening datasets. The results demonstrate that our framework broadly improves the prediction performance in all three drug response prediction applications with all three prediction algorithms.

60 APPLIED LIFE SCIENCES↗

Application of research reactor environments for validation of the IRDFF-II dosimetry cross section library

Activation data from seven different reactor-based reference neutron fields are examined to provide enhanced validation evidence for the newly released IRDFF-II library. A least-squares based spectrum adjustment methodology is used and rigorous statistical metrics demonstrate the consistency of the set of IRDFF-II dosimetry cross sections. The use of these reactor-based neutron fields provides validation evidence for nine more reactions than have been addressed in the 252 Cf(sf) and 235 U(th) benchmark validation testing. The use of covers to shift their energy response increases the power of the response validation but makes it challenging to properly capture response correlations.

Griffin, Patrick↗

A nonlinear eigenvalue problem for self-similar spherical force-free magnetic fields

An axisymmetric force-free magnetic field B(r, θ) in spherical coordinates is defined by a function r sin θB{sub φ}=Q(A) relating its azimuthal component to its poloidal flux-function A. The power law r sin θB{sub φ}=aA|A|{sup 1/n}, n a positive constant, admits separable fields with A=(A{sub n}(θ))/(r{sup n}) , posing a nonlinear boundary-value problem for the constant parameter a as an eigenvalue and A{sub n}(θ) as its eigenfunction [B. C. Low and Y. Q Lou, Astrophys. J. 352, 343 (1990)]. A complete analysis is presented of the eigenvalue spectrum for a given n, providing a unified understanding of the eigenfunctions and the physical relationship between the field's degree of multi-polarity and rate of radial decay via the parameter n. These force-free fields, self-similar on spheres of constant r, have basic astrophysical applications. As explicit solutions they have, over the years, served as standard benchmarks for testing 3D numerical codes developed to compute general force-free fields in the solar corona. The study presented includes a set of illustrative multipolar field solutions to address the magnetohydrodynamics (MHD) issues underlying the observation that the solar corona has a statistical preference for negative and positive magnetic helicities in its northern and southern hemispheres, respectively; a hemispherical effect, unchanging as the Sun's global field reverses polarity in successive eleven-year cycles. Generalizing these force-free fields to the separable form B=(H(θ,φ))/(r{sup n+2}) promises field solutions of even richer topological varieties but allowing for φ-dependence greatly complicates the governing equations that have remained intractable. The axisymmetric results obtained are discussed in relation to this generalization and the Parker Magnetostatic Theorem. The axisymmetric solutions are mathematically related to a family of 3D time-dependent ideal MHD solutions for a polytropic fluid of index γ = 4/3 as discussed in the Appendix.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A DEMO relevant fast wave current drive high harmonic antenna exploiting the high impedance technique

Ion Cyclotron (IC) antennas are routinely adopted in most of the existing nuclear fusion experiments, even though their main goal, i.e. to couple high power to the plasma (MW), is often limited by rather severe drawbacks due to high fields on the antenna itself and on the unmatched part of the feeding lines. In addition to the well exploited auxiliary ion heating during the start-up phase, some non-ohmic current drive (CD) at the IC range of frequencies may be explored in view of the DEMO reactor. In this work, we suggest and describe a compact high frequency DEMO relevant antenna, based on the high impedance surfaces concept. High-impedance surfaces are periodic metallic structures (patches) usually displaced on top of a dielectric substrate and grounded by means of vertical posts embedded inside the dielectric, in a mushroom-like shape. These structures present a high impedance, within a given frequency band, such that the image currents are in-phase with the currents of the antenna itself, thus determining a significant efficiency increase. After a general introduction on the properties of high impedance surfaces, we analyze, by means of numerical codes, a dielectric based and a full metal solution optimized to be tested and benchmarked on the FTU experiment fed with generators at 433MHz.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

On the applicability of one- and many-electron quantum chemistry models for hydrated electron clusters

We evaluate the applicability of a hierarchy of quantum models in characterizing the binding energy of excess electrons to water clusters. In particular, we calculate the vertical detachment energy of an excess electron from water cluster anions with methods that include one-electron pseudopotential calculations, density functional theory (DFT) based calculations, and ab initio quantum chemistry using MP2 and eom-EA-CCSD levels of theory. The examined clusters range from the smallest cluster size (n = 2) up to nearly nanosize clusters with n = 1000 molecules. The examined cluster configurations are extracted from mixed quantum-classical molecular dynamics trajectories of cluster anions with n = 1000 water molecules using two different one-electron pseudopotenial models. We find that while MP2 calculations with large diffuse basis set provide a reasonable description for the hydrated electron system, DFT methods should be used with precaution and only after careful benchmarking. Strictly tested one-electron psudopotentials can still be considered as reasonable alternatives to DFT methods, especially in large systems. The results of quantum chemistry calculations performed on configurations, that represent possible excess electron binding motifs in the clusters, appear to be consistent with the results using a cavity structure preferring one-electron pseudopotential for the hydrated electron, while they are in sharp disagreement with the structural predictions of a non-cavity model.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Bond length alternation of π -conjugated polymers predicted by the Fermi–Löwdin orbital self-interaction correction method

π-conjugated polymers have been used in a wide range of practical applications, partly due to their unique properties that originate in the delocalization of electrons through the polymer backbone. The level of delocalization can be characterized by the induced bond length alternation (BLA), with shorter BLA connected with strong delocalization and vice versa. The accurate description of this structural parameter can be considered a benchmark for testing the capability of different electronic structure methods for self-interaction error (SIE) removal and electron correlation inclusion. Density functional theory (DFT), in its local or semi-local flavors, suffers from SIE and, thus, underestimates the BLA compared to self-interaction-free methods. In this work, we utilize the Fermi–Löwdin orbital self-interaction correction (FLOSIC) method for one-electron self-interaction removal to characterize the BLA of five oligomers with increasing length extrapolated to the polymeric limit. We compare the self-interaction-free BLA to several DFT approximations, Møller–Plesset second-order perturbation theory (MP2), and the BLA obtained with the domain based local pair natural orbital CCSD(T) [DLPNO-CCSD(T)] approximation. Our findings show that FLOSIC corrects for the small BLA given by (semi-)local DFT approximations, but it tends to overcorrect with respect to CAM-B3LYP, MP2, and DLPNO-CCSD(T).

Chemistry↗

Demonstration of TOFFEE: A Response Uncertainty Quantification Tool

A key characteristic in neutron transport is nuclear data. Cross-section uncertainty is not used in MCNP6.3 to propagate response uncertainty without external analysis. Here, the TOol For Fast Error Estimation (TOFFEE) is a Python-based code developed to automate the propagation of cross-section uncertainty for MCNP evaluations. TOFFEE implements the sandwich rule to calculate the uncertainty from cross sections with sensitivity coefficients from MCNP6.3 and ENDF/B covariance data. In this paper, TOFFEE has been tested with benchmark experiments, and it has been compared to the uncertainty quantification capabilities of Sampler and TSUNAMI, within SCALE, to verify the application’s capabilities.

97 MATHEMATICS AND COMPUTING↗