Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,603 records · Page 89
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

DeepPatent2: A Large-Scale Benchmarking Corpus for Technical Drawing Understanding

Abstract Recent advances in computer vision (CV) and natural language processing have been driven by exploiting big data on practical applications. However, these research fields are still limited by the sheer volume, versatility, and diversity of the available datasets. CV tasks, such as image captioning, which has primarily been carried out on natural images, still struggle to produce accurate and meaningful captions on sketched images often included in scientific and technical documents. The advancement of other tasks such as 3D reconstruction from 2D images requires larger datasets with multiple viewpoints. We introduce DeepPatent2, a large-scale dataset, providing more than 2.7 million technical drawings with 132,890 object names and 22,394 viewpoints extracted from 14 years of US design patent documents. We demonstrate the usefulness of DeepPatent2 with conceptual captioning. We further provide the potential usefulness of our dataset to facilitate other research areas such as 3D image reconstruction and image retrieval.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Complexity-calibrated benchmarks for machine learning reveal when prediction algorithms succeed and mislead

Abstract Recurrent neural networks are used to forecast time series in finance, climate, language, and from many other domains. Reservoir computers are a particularly easily trainable form of recurrent neural network. Recently, a “next-generation” reservoir computer was introduced in which the memory trace involves only a finite number of previous symbols. We explore the inherent limitations of finite-past memory traces in this intriguing proposal. A lower bound from Fano’s inequality shows that, on highly non-Markovian processes generated by large probabilistic state machines, next-generation reservoir computers with reasonably long memory traces have an error probability that is at least $$\sim 60\%$$ ∼ 60 % higher than the minimal attainable error probability in predicting the next observation. More generally, it appears that popular recurrent neural networks fall far short of optimally predicting such complex processes. These results highlight the need for a new generation of optimized recurrent neural network architectures. Alongside this finding, we present concentration-of-measure results for randomly-generated but complex processes. One conclusion is that large probabilistic state machines—specifically, large $$\epsilon$$ ϵ -machines—are key to generating challenging and structurally-unbiased stimuli for ground-truthing recurrent neural network architectures.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Benchmarking greenhouse gas emissions from US wastewater treatment for targeted reduction

Here, in this study, to assess the national climate impact of wastewater treatment and inform decarbonization, we assembled a comprehensive greenhouse gas inventory of 15,863 facilities in the contiguous USA. Considering location and treatment configurations, we modelled on-site CH 4 , N 2 O and CO 2 production and emissions associated with energy, chemical inputs and solids disposal. Using Monte Carlo simulations, we estimated median national emissions at 47 million tonnes of CO 2 equivalent per year, with on-site process CH 4 and N 2 O emissions exceeding current government estimates by 41%. Treatment configurations with anaerobic digesters are responsible for 16 million tonnes of CO 2 equivalent per year of fugitive methane, outweighing benefits achieved through on-site electricity generation. Systems designed for nutrient removal have the highest greenhouse gas emissions intensity, attributable to energy requirements and N 2 O production, demonstrating current trade-offs between meeting water quality and climate objectives. We analysed key sensitivities and included a geospatial analysis to highlight the scale and distribution of opportunities for reducing life cycle greenhouse gas emissions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

Benchmarking nanoparticulate metal oxide electrocatalysts for the alkaline water oxidation reaction

Nanoparticulate metal-oxide catalysts are among the most prevalent systems for alkaline water oxidation. However, comparisons of the electrochemical performance of these materials have been challenging due to the different methods of attachment, catalyst loadings, and electrochemical test conditions reported in the literature. Here in this paper, we have leveraged a conventional drop-casting method that allows for the successful adhesion of a wide range of nanoparticulate catalysts to glassy-carbon electrode surfaces. We have applied this adhesion method to prepare catalyst films from 16 crystalline metal-oxide nanoparticles with a constant loading of 0.8 mg cm -2 , and evaluated the resulting nanoparticulate films for the oxygen evolution reaction under conditions relevant to an integrated solar fuels device. In general, the activities of the adhered nanoparticulate films are similar to those of thin-film catalysts prepared by electrodeposition or sputtering, achieving 10 mA cm -2 current densities per geometric area at overpotentials of ~0.35–0.5 V.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Benchmarking nitrous oxide adsorption and activation in metal–organic frameworks bearing coordinatively unsaturated metal centers

Anthropogenic emissions of N 2 O, the third most abundant greenhouse gas after CO 2 and CH 4 , are contributing to global climate change. Although metal–organic frameworks (MOFs) have been widely studied as adsorbents for CO 2 and CH 4 , less effort has focused on the use of MOFs to remove N 2 O from emission streams or from air. Further, N 2 O activation would enable its use as an inexpensive oxidant for fine chemical synthesis. Here, in this paper, we identify features that contribute to strong binding and high uptake of N 2 O at coordinatively unsaturated metal sites in the M 2 Cl 2 (btdd) (M = Mn, Co, Ni, Cu; btdd 2– = bis(1,2,3-triazolo[4,5-b],[4',5'-i])dibenzo[1,4]dioxin) and M 2 (dobdc) (M = Mg, Mn, Fe, Co, Ni, Cu, Zn; dobdc 4– = 2,5-dioxido-1,4-benzenedicarboxylate) series of MOFs. Combined experimental and computational studies suggest that N 2 O adsorption at open-metal-sites is primarily based on electrostatic interactions, rather than π-backbonding, causing MOFs with more Lewis acidic metal centers to be superior N 2 O adsorbents. As a result, Mg 2 (dobdc) demonstrates strong binding and record-setting N 2 O uptake (8.75 mmol g –1 at 1 bar and 298 K). Using density functional theory (DFT) to characterize reactive intermediates and transition states, we demonstrate that N 2 O activation to form a M(IV)–oxo species and N 2 is thermodynamically favorable in Mn 2 (dobdc) and Fe 2 (dobdc) but appears to be kinetically limited in Mn 2 (dobdc). Our work lays a foundation for understanding N 2 O adsorption and activation in MOFs, paving the way for the design of promising next-generation materials for N 2 O capture and utilization.

36 MATERIALS SCIENCE↗
DOE OSTI2013

The Jastrow antisymmetric geminal power in Hilbert space: Theory, benchmarking, and application to a novel transition state

The Jastrow-modified antisymmetric geminal power (JAGP) ansatz in Hilbert space successfully overcomes two key failings of other pairing theories, namely, a lack of inter-pair correlations and a lack of multiple resonance structures, while maintaining a polynomially scaling cost, variational energies, and size consistency. Here, we present efficient quantum Monte Carlo algorithms that evaluate and optimize the JAGP energy for a cost that scales as the fifth power of the system size. We demonstrate the JAGP’s ability to describe both static and dynamic correlation by applying it to bond stretching in H{sub 2}O, C{sub 2}, and N{sub 2} as well as to a novel, multi-reference transition state of ethene. JAGP’s accuracy in these systems outperforms even the most sophisticated single-reference methods and approaches that of exponentially scaling active space methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2014

Electronic couplings for molecular charge transfer: Benchmarking CDFT, FODFT, and FODFTB against high-level ab initio calculations

We introduce a database (HAB11) of electronic coupling matrix elements (H{sub ab}) for electron transfer in 11 π-conjugated organic homo-dimer cations. High-level ab inito calculations at the multireference configuration interaction MRCI+Q level of theory, n-electron valence state perturbation theory NEVPT2, and (spin-component scaled) approximate coupled cluster model (SCS)-CC2 are reported for this database to assess the performance of three DFT methods of decreasing computational cost, including constrained density functional theory (CDFT), fragment-orbital DFT (FODFT), and self-consistent charge density functional tight-binding (FODFTB). We find that the CDFT approach in combination with a modified PBE functional containing 50% Hartree-Fock exchange gives best results for absolute H{sub ab} values (mean relative unsigned error = 5.3%) and exponential distance decay constants β (4.3%). CDFT in combination with pure PBE overestimates couplings by 38.7% due to a too diffuse excess charge distribution, whereas the economic FODFT and highly cost-effective FODFTB methods underestimate couplings by 37.6% and 42.4%, respectively, due to neglect of interaction between donor and acceptor. The errors are systematic, however, and can be significantly reduced by applying a uniform scaling factor for each method. Applications to dimers outside the database, specifically rotated thiophene dimers and larger acenes up to pentacene, suggests that the same scaling procedure significantly improves the FODFT and FODFTB results for larger π-conjugated systems relevant to organic semiconductors and DNA.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2014

Communication: Resolving the three-body contribution to the lattice energy of crystalline benzene: Benchmark results from coupled-cluster theory

Coupled-cluster theory including single, double, and perturbative triple excitations [CCSD(T)] has been applied to trimers that appear in crystalline benzene in order to resolve discrepancies in the literature about the magnitude of non-additive three-body contributions to the lattice energy. In this paper, the present results indicate a non-additive three-body contribution of 0.89 kcal mol -1 , or 7.2% of the revised lattice energy of -12.3 kcal mol -1 . For the trimers for which we were able to compute CCSD(T) energies, we obtain a sizeable difference of 0.63 kcal mol -1 between the CCSD(T) and MP2 three-body contributions to the lattice energy, confirming that three-body dispersion dominates over three-body induction. Taking this difference as an estimate of three-body dispersion for the closer trimers, and adding an Axilrod-Teller-Muto estimate of 0.13 kcal mol -1 for long-range contributions yields an overall value of 0.76 kcal mol -1 for three-body dispersion, a significantly smaller value than in several recent studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2014

Excitations and benchmark ensemble density functional theory for two electrons

A new method for extracting ensemble Kohn-Sham potentials from accurate excited state densities is applied to a variety of two-electron systems, exploring the behavior of exact ensemble density functional theory. The issue of separating the Hartree energy and the choice of degenerate eigenstates is explored. A new approximation, spin eigenstate Hartree-exchange, is derived. Exact conditions that are proven include the signs of the correlation energy components and the asymptotic behavior of the potential for small weights of the excited states. Many energy components are given as a function of the weights for two electrons in a one-dimensional flat box, in a box with a large barrier to create charge transfer excitations, in a three-dimensional harmonic well (Hooke's atom), and for the He atom singlet-triplet ensemble, singlet-triplet-singlet ensemble, and triplet bi-ensemble.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2014

The vibrational spectrum of FeO{sub 2}{sup +} isomers—Theoretical benchmark and experiment

Infrared photodissociation is used to record the vibrational spectrum of FeO{sub 2}{sup +}(He){sub 2–4} which shows three bands at 1035, 980, and 506 cm{sup −1}. Quantum chemical multi-reference configuration interaction calculations (MRCISD) of structures and harmonic frequencies show that these bands are due to two different isomers, an inserted dioxo complex with Fe in the +V oxidation state and a side-on superoxo complex with Fe in the +II oxidation state. These two are separated by a substantial barrier, 53 kJ/mol, whereas the third isomer, an end-on complex between Fe{sup +} and an O{sub 2} molecule, is easily converted into the side-on complex. For all three isomers, states of different spin multiplicity have been considered. Our best energies are computed at the MRCISD+Q level, including corrections for complete active space and basis set extension, core-valence correlation, relativistic effects, and zero-point vibrational energy. The average coupled pair functional (ACPF) yields very similar energies. Density functional theory (DFT) differs significantly from our best estimates for this system, with the TPSS functional yielding the best results. The other functionals tested are BP86, PBE, B3LYP, TPSSh, and B2PLYP. Complete active space second order perturbation theory (CASPT2) performs better than DFT, but less good than ACPF.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2014

Complex absorbing potentials within EOM-CC family of methods: Theory, implementation, and benchmarks

A production-level implementation of equation-of-motion coupled-cluster singles and doubles (EOM-CCSD) for electron attachment and excitation energies augmented by a complex absorbing potential (CAP) is presented. The new method enables the treatment of metastable states within the EOM-CC formalism in a similar manner as bound states. The numeric performance of the method and the sensitivity of resonance positions and lifetimes to the CAP parameters and the choice of one-electron basis set are investigated. A protocol for studying molecular shape resonances based on the use of standard basis sets and a universal criterion for choosing the CAP parameters are presented. Our results for a variety of π{sup *} shape resonances of small to medium-size molecules demonstrate that CAP-augmented EOM-CCSD is competitive relative to other theoretical approaches for the treatment of resonances and is often able to reproduce experimental results.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2014

Ab initio molecular dynamics with noisy forces: Validating the quantum Monte Carlo approach with benchmark calculations of molecular vibrational properties

We present a systematic study of a recently developed ab initio simulation scheme based on molecular dynamics and quantum Monte Carlo. In this approach, a damped Langevin molecular dynamics is employed by using a statistical evaluation of the forces acting on each atom by means of quantum Monte Carlo. This allows the use of an highly correlated wave function parametrized by several variational parameters and describing quite accurately the Born-Oppenheimer energy surface, as long as these parameters are determined at the minimum energy condition. However, in a statistical method both the minimization method and the evaluation of the atomic forces are affected by the statistical noise. In this work, we study systematically the accuracy and reliability of this scheme by targeting the vibrational frequencies of simple molecules such as the water monomer, hydrogen sulfide, sulfur dioxide, ammonia, and phosphine. We show that all sources of systematic errors can be controlled and reliable frequencies can be obtained with a reasonable computational effort. This work provides convincing evidence that this molecular dynamics scheme can be safely applied also to realistic systems containing several atoms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2014

A benchmark study of electronic excitation energies, transition moments, and excited-state energy gradients on the nicotine molecule

In this work, we report a comparative study of computed excitation energies, oscillator strengths, and excited-state energy gradients of (S)-nicotine, chosen as a test case, using multireference methods, coupled cluster singles and doubles, and methods based on time-dependent density functional theory. This system was chosen because its apparent simplicity hides a complex electronic structure, as several different types of valence excitations are possible, including n-π{sup *}, π-π{sup *}, and charge-transfer states, and in order to simulate its spectrum it is necessary to describe all of them consistently well by the chosen method.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗