Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error rate calculations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Q-Cluster: Quantum Error Mitigation Through Noise-Aware Unsupervised Learning

Quantum error mitigation (QEM) is critical in reducing the impact of noise in the pre-fault-tolerant era, and is expected to complement error correction in fault-tolerant quantum computing (FTQC). In this work, we propose a novel QEM approach, Q-Cluster, that uses unsupervised learning (clustering) to reshape the measured bit-string distribution. Our approach starts with a simplified bit-flip noise model. It first performs clustering on noisy measurement results, i.e., bit-strings, based on the Hamming distance. The centroid of each cluster is calculated using a qubit-wise majority vote. Next, the noisy distribution is adjusted with the clustering outcomes and the bitflip error rates using Bayesian inference. Our simulation results show that Q-Cluster can mitigate high noise rates (up to 40% per qubit) with the simple bit-flip noise model. However, real quantum computers do not fit such a simple noise model. To address the problem, we (a) apply Pauli twirling to tailor the complex noise channels to Pauli errors, and (b) employ a machine learning model, ExtraTrees regressor, to estimate an effective bit-flip error rate using a feature vector consisting of machine calibration data (gate & measurement error rates), circuit features (number of qubits, numbers of different types of gates, etc.) and the shape of the noisy distribution (entropy). Our experimental results show that our proposed Q-Cluster scheme improves the fidelity by a factor of 1.46x, on average, compared to the unmitigated output distribution, for a set of low-entropy benchmarks on five different IBM quantum machines. Our approach outperforms the state-of-art QEM approaches RZNE [28], M3 [24], Hammer [35], and QBEEP [33] by 1.26x,1.29x,1.47x, and 2.65 x, respectively.

42 ENGINEERING↗
DOE OSTI2021

Impact of Flux Wire Selection on Neutron Spectrum Adjustment

In reactor dosimetry, spectrum unfolding methods are used to assess the energy-dependent neutron flux following the irradiation of flux wires or foils. For some spectrum unfolding methods, an a priori, or initial guess, spectrum is necessary. However, if the a priori spectrum is not representative of the irradiation spectrum experienced by the flux wires, the spectrum unfolding method may fail or create a nonphysical adjusted spectrum. The unfolded spectrum is dependent on flux wire reaction rates, and therefore cross section. As a result, each selection or combination of flux wires will have a different sensitivity to the group-wise fluence difference between the a priori spectrum and the irradiation spectrum. Therefore, a selection of flux wires that are insensitive to errors in the a priori spectrum would be considered robust choices for reactor dosimetry. In this work, flux wire reaction rates are calculated using a simulated neutron spectrum from the High Flux Isotope Reactor (HFIR) and spectrum unfolding methods are used in each flux wire combinations. The flux wire combinations are compared against a traditional flux wire set of Ti, Fe, and Co, with a summary table of the deemed “good” wire combinations that are insensitive to number of a priori neutron energy groups, group-wise difference between the a priori and irradiation, and magnitude of difference.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Rigorous constraints on three-nucleon forces in chiral effective field theory from fast and accurate calculations of few-body observables

We explore the constraints on the three-nucleon force (3NF) of chiral effective field theory (χ EFT) that are provided by bound-state observables in the A = 3 and A = 4 sectors. Our statistically rigorous analysis incorporates experimental error, computational method uncertainty, and the uncertainty due to truncation of the χ EFT expansion at next-to-next-to-leading order. A consistent solution for the 3 H binding energy, the 4 He binding energy and radius, and the 3 H β-decay rate can only be obtained if χ EFT truncation errors are included in the analysis. Here, the β-decay rate is the only one of these that yields a nondegenerate constraint on the 3NF low-energy constants, which makes it crucial for the parameter estimation. We use eigenvector continuation for fast and accurate emulation of no-core shell model calculations of the few-nucleon observables. This facilitates sampling of the posterior probability distribution, allowing us to also determine the distributions of the parameters that quantify the truncation error. We find a χ EFT expansion parameter of Q = 0.33 ± 0.06 for these observables.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Signal-Compensation-Based Adaptive PID Control for Fused Magnesia Smelting Processes

For fused magnesia smelting processes, the proportional-integral-derivative (PID) controller is difficult to regulate the smelting currents within desired ranges due to unexpected variations of the dynamics caused by material feeding operations. To solve this problem, we first proposed its dynamic model composed of a linear model and an uncertain nonlinear dynamic system that describes the unknown time-varying dynamics of nonlinearity and strong couplings among controlled variables. Then, using the accurately calculated value of the uncertain part at the previous sampling time instant and the tracking error that reflects the influence of its change rate, we developed a feedforward and a one-step optimal control to obtain two signal compensators to eliminate the impact of frequent variations of the uncertainties. For the compensators, we proposed a weight selection method to minimize the sum of the squared tracking error with ensured closed-loop stability. Based on the abovementioned modeling and control structure, we finally developed a novel adaptive PID controller augmented with signal compensators to control the whole process. Industrial applications have shown that the proposed method can always keep the tracking error and the control input within their targeted ranges, leading to a significantly reduced energy consumption per ton and increased fused magnesia production.

Wang, Weizhou↗
DOE OSTI2021

Search for CPT and Lorentz invariance violation in the muon $g -2$ experiment at Fermilab

The Muon g-2 experiment at Fermilab (E989) aims to measure the anomalous magnetic moment of the muon, $a_{\mu}= (g-2)/2$, to a groundbreaking precision of $140$ ppb, obtaining a near four-fold increase in precision over the previous experiment, E821, at the Brookhaven National Laboratory (BNL). The value of $a_{\mu}$ from BNL currently differs from the Standard Model prediction by $\sim 3.7$ standard deviations, suggesting the potential for new physics and therefore, motivating a new experiment.Because the theory predicts this number with high precision, testing the g-factor through experiment provides a stringent test of the SM and can suggest physics beyond the Standard Model. The goal of the Fermilab Muon $g-2$ experiment is to increase the statistical precision by more than a factor of 20 and reduce systematic errors by a factor of 3. By measuring muon precession rate ($\omega_a$) in an external magnetic field, the anomalous magnetic moment will be calculated. This is an incredibly challenging experiment with a unique opportunity to provide new insight into nature. \\ The $g-2$ data also provides a great opportunity for setting the most stringent limits on some of the Standard Model Extension CPT Lorentz violating (LV) parameters in the muon sector. One of the CPT and Lorentz violating signatures that we can look for using $g-2$ data is a sidereal variation of $\omega_a(t)$. Extensive simulation studies confirm that the sensitivity regarding the sidereal varation roughly scales with $\omega_a$ uncertainty. Hence, the $g-2$ experiment at FNAL should be able to reach limits of $\sim 5\times10^{-25}$ GeV. Because the CPT and LV analyses are essentially studies of variations in $\omega_a$ as a function of time and charge, performing an $\omega_a$ analysis sets the stage for the CPT and LV measurement. This dissertation focuses on the methodology of a fully functioning framework and analyzing the Fermilab Muon $g - 2$ Run 2 data containing $\sim 11$ billion events above an energy threshold of $1.7$~GeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Spherically expanding flame in silane–hydrogen–nitrous oxide–argon mixtures

The effect of silane addition on the laminar flame speed ($S^0_u$) of flames propagating in hydrogen–nitrous oxide–argon mixtures has been investigated experimentally for the first time using the spherically expanding flame technique in a constant volume combustion chamber. Replacing hydrogen by silane and maintaining the equivalence ratio constant, much higher flame speeds, explosion peak pressures, and pressure rise coefficients were measured. A previously developed detailed reaction model has been updated based on ab initio thermodynamic properties calculations and collision limit violation analysis. The improved reaction model demonstrates encouraging performance in predicting the flame speed, with a mean absolute error below 11%. To explain the effect of silane addition on the flame dynamics, a number of parameters have been calculated including OH and H rate of production, heat release rate per reaction, and sensitivity coefficient on . The dynamics of freely propagating flames in SiH 4 –H 2 –N 2 O–Ar mixtures is essentially controlled by reactions of the H–O–N chemical system: N 2 O+H=N 2 +OH, OH+H 2 =H 2 O+H, and N 2 O(+M)=N 2 +O(+M). Whereas silane addition does not influence much the rate of production of OH, it significantly modifies that of H with a number of pyrolytic chemical pathways of silicon hydrides, such as SiH+H 2 =SiH 2 +H and Si+H 2 =SiH+H, which act as sink of H atom as they proceed in the backward direction. The reactions forming SiO(s) and SiO 2 (s), such as SiO+OH=SiO 2 (s)+H and 2SiO=2SiO(s), are exothermic and significantly contribute to the temperature increase. The adiabatic, constant pressure flame temperature for mixture containing silane is significantly higher, up to several 100’s K. The increase of induced by silane addition seems to be mostly related to the large increase of the flame temperature which leads to higher energy release rate.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Novel application of neutrinos to evaluate U.S. nuclear weapons performance

There is a growing realization that neutrinos can be used as a diagnostic tool to better understand the inner workings of a nuclear weapon. Robust estimates demonstrate that an Inverse Beta Decay (IBD) neutrino scintillation detector built at the Nevada Test Site with a 1000-ton active target mass at a standoff distance of 500 m would detect thousands of antineutrino events per nuclear test. This would provide less than 4% statistical error on the measured antineutrino rate and 5% error on antineutrino energy. Extrapolating this to an error on the test device explosive yield requires knowledge from evaluated nuclear databases, non-equilibrium fission rates, and assumptions on internal neutron fluxes. Initial calculations demonstrate that the total number of neutrinos emitted per fission in the first 10 3 s after a short pulse of 239 Pu fission is about a factor of two less than that from Pu fissioning under steady state conditions. Furthermore, there are significant energy spectral differences as a function of time after the pulse that must be considered. These and other model dependencies will be discussed in the paper. In the absence of nuclear weapons testing, many of the technical and theoretical challenges of a full nuclear test could be mitigated with a low cost smaller scale 20 ton fiducial mass IBD demonstration detector placed near a pulsed reactor. Potential reactors include the Texas A&M University TRIGA 1 GW–10 ms pulsed facility or the Sandia Annular Core Research Reactor. The short duty cycle and repeatability of pulses would provide critical real environment testing and measurements, which would be valuable for planning a possible real test shot in the future. Furthermore, the antineutrino rate as a function of time data would provide unique constraints on fission databases and model assumptions. Finally, there are impactful science drivers such as sensitive searches for ∼1 eV 2 sterile neutrinos and ∼MeV scale axions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Updating PV and Battery Bill Savings Calculations for Net Billing: New Best Practices for Input Data and Uncertainty

Jurisdictions are increasingly adopting compensation structures for distributed PV and PV-battery systems that price exported energy lower than energy consumed onsite (net billing rates). Standard methods for calculating the bill savings from PV and PV-battery systems were developed for net metering structures, and applying these same methods to net billing structures (such as using Typical Meteorological Year weather with actual year load) introduces bias errors that underestimate PV-battery system bill savings by between 1.5\% and 9\%, depending on the utility rate. We assess the magnitude of these errors and compare them to other sources of uncertainty when estimating the bill savings from PV and PV-battery systems under more complex utility rates.

14 SOLAR ENERGY↗
DOE OSTI2025

2025 Review and Revision of Federal Guidance Report 15

Federal Guidance Report No. 15 (FGR 15), External Exposure to Radionuclides in Air, Water and Soil, published in 2019 and referred to below as FGR 2019, provides age-specific effective dose rate coefficients for reference persons externally exposed to each of 1252 radionuclides homogenously distributed in environmental media. Soon after completion of FGR 2019, the International Commission on Radiological Protection (ICRP) published a similar report (ICRP Publication 144, 2020) addressing the same radionuclides and many of the external exposure scenarios addressed in FGR 2019. In 2023 Argonne National Laboratory (ANL) published a review of dose coefficients in FGR 2019, concluding that “The external effective dose from beta radiation is not appropriately accounted for in FGR 15 for both low- and high-energy beta emitters in air, in soil, and on soil surfaces.” That conclusion was based largely on comparisons of dose coefficients in FGR 2019 with values in ICRP Publication 144 but also on consideration of some unexpected patterns of equivalent dose rate coefficients across tissues and of effective dose rate coefficients across different soil depths, for a selected set of low-energy beta emitters. In response to the ANL report, the Center for Radiation Protection Knowledge (CRPK) at Oak Ridge National Laboratory (ORNL) performed an extensive reexamination of the methods and published values of FGR 2019. CRPK found that coding errors had resulted in inaccurate estimates, primarily overestimates, in many of the dose coefficients tabulated in FGR 2019 but that many of the differences between results in FGR 2019 and ICRP Publication 144 could be traced to differences in methodology. CRPK has corrected all errors in FGR 2019 associated with the coding errors and has taken the opportunity to improve a major portion of the remaining dose coefficients in FGR 2019, primarily through additional Monte Carlo calculations resulting in improved statistics for tissue equivalent dose rate coefficients for exposure to monoenergetic sources. This has eliminated the need for extrapolation of results from high and medium energies to low energies, as was done in FGR 2019. In addition, inconsistencies in the methodology identified in the review, such as computational representation of the adult female, were eliminated. The revised effective dose rate coefficients are consistent with values in ICRP Publication 144 except for differences in values clearly arising from differences in methodology; and differences in values for a relatively small set of very low-energy radionuclides with highly uncertain dose coefficients regardless of methodology.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Direct, simple and efficient computation of all components of the virtual-casing magnetic field in axisymmetric geometries with Kapur–Rokhlin quadrature

In a recent publication (Toler et al., J. Plasma Phys., vol. 89, issue 2, 2023, p. 905890210), we demonstrated that for axisymmetric geometries, the Kapur–Rokhlin quadrature rule provided an efficient and high-order accurate method for computing the normal component, on the plasma surface, of the magnetic field due to the toroidal current flowing in the plasma, via the virtual-casing principle. The calculation was indirect, as it required the prior computation of the magnetic vector potential from the virtual-casing principle, followed by the computation of its tangential derivative by Fourier differentiation, to obtain the normal component of the magnetic field. Our approach did not provide the other components of the virtual-casing magnetic field. In this letter, we show that a more direct and more general approach is available for the computation of the virtual-casing magnetic field. The Kapur–Rokhlin quadrature rule accurately calculates the principal value integrals in the expression for all the components of the magnetic field on the plasma boundary, and the numerical error converges at a rate nearly as high as the indirect method we presented previously.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Feasibility of using thermal response methods for nonintrusive compressed air flow measurement

Robust, low-cost nonintrusive flow meters are of interest in many industries. Particularly, a reliable nonintrusive flow measurement for the diagnosis of air leaks in compressed air systems is desirable. Measurement of the air flow due to leaks in the system ensures an accurate estimation of potential cost and energy savings. This study evaluates a novel method of using thermal responses to nonintrusively measure leakage rates in compressed air lines. The method uses heat and the resulting thermal response to calculate the flow rate inside the compressed air line. Compared to the current methods for flow measurement, this method can simplify flow measurement while decreasing the sensitivity to errors when measuring flow rates. In this study, the methodology of the proposed method is explained along with the potential advantages to the design. Two approaches are evaluated: a dynamic step response and sinusoidal frequency response. Simulated tests evaluate the feasibility of the proposed methods, followed by experiments that validate the simulation results. A clear correlation between the thermal step response and the flow rate indicate viability of the proposed method in simulation. Experimental results yielded similar results, confirming the validity of the proposed method. The results of a field test in an industrial environment demonstrate the capability of the approach to other flow rate measurement techniques.

42 ENGINEERING↗
DOE OSTI2020

Microkinetic Modeling: A Tool for Rational Catalyst Design

The design of heterogeneous catalysts relies on understanding the fundamental surface kinetics that controls catalyst performance, and microkinetic modeling is a tool that can help the researcher in streamlining the process of catalyst design. Microkinetic modeling is used to identify critical reaction intermediates and rate-determining elementary reactions, thereby providing vital information for designing an improved catalyst. In this review, we summarize general procedures for developing microkinetic models using reaction kinetics parameters obtained from experimental data, theoretical correlations, and quantum chemical calculations. We examine the methods required to ensure the thermodynamic consistency of the microkinetic model. We describe procedures required for parameter adjustments to account for the heterogeneity of the catalyst and the inherent errors in parameter estimation. We discuss the analysis of microkinetic models to determine the rate determining reactions using the degree of rate control and reversibility of each elementary reaction. We introduce incorporation of Brønsted–Evans–Polanyi relations and scaling relations in microkinetic models and the effects of these relations on catalytic performance and formation of volcano curves. We review the analysis of reaction schemes in terms of the maximum rate of elementary reactions, and we outline a procedure to identify kinetically significant transition states and adsorbed intermediates. Here, we explore the application of generalized rate expressions for the prediction of optimal binding energies of important surface intermediates and to estimate the extent of potential rate improvement. We also explore the application of microkinetic modeling in homogeneous catalysis, electro-catalysis, and transient reaction kinetics. We conclude by highlighting the challenges and opportunities in the application of microkinetic modeling for catalyst design.

42 ENGINEERING↗
DOE OSTI2022

Observability of fidelity decay at the Lyapunov rate in few-qubit quantum simulations

In certain regimes, the fidelity of quantum states will decay at a rate set by the classical Lyapunov exponent. This serves both as one of the most important examples of the quantum-classical correspondence principle and as an accurate test for the presence of chaos. While detecting this phenomenon is one of the first useful calculations that noisy quantum computers without error correction can perform, a thorough study of the quantum sawtooth map reveals that observing the Lyapunov regime is just beyond the reach of present-day devices. We prove that there are three bounds on the ability of any device to observe the Lyapunov regime and give the first quantitatively accurate description of these bounds: (1) the Fermi golden rule decay rate must be larger than the Lyapunov rate, (2) the quantum dynamics must be diffusive rather than localized, and (3) the initial decay rate must be slow enough for Lyapunov decay to be observable. This last bound, which has not been recognized previously, places a limit on the maximum amount of noise that can be tolerated. The theory implies that an absolute minimum of 6 qubits is required. Recent experiments on IBM-Q and IonQ imply that some combination of a noise reduction by up to 100x per gate and large increases in connectivity and gate parallelization are also necessary. Finally, scaling arguments are given that quantify the ability of future devices to observe the Lyapunov regime based on trade-offs between hardware architecture and performance.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Radially resolved active charge exchange measurements of the hydrogenic isotope fraction on DIII-D

Radially resolved hydrogenic isotope fraction measurement capabilities have been developed for DIII-D using the main-ion charge exchange recombination (MICER) spectroscopy system in preparation for mixed hydrogen and deuterium experiments. Constraints on the hydrogenic ion temperatures and velocities based on measurements of the impurity ion properties are required to accurately fit the spectrum. Corrections for cross sectional distortions, spatial smearing due to the halo, and a neoclassical offset between the impurity and hydrogenic toroidal rotation are applied to the constraints prior to fitting the MICER spectrum. Extensive atomic physics calculations have been performed using the FIDASIM code, which has recently been improved to allow simulations using mixtures of hydrogenic species. Overall, these results demonstrate that for the same plasma parameters, the Dα emission is 20%–30% brighter than Hα due to differences in rate coefficients associated with the different ion thermal velocities for the same temperature and therefore must be taken into consideration when calculating absolute densities. However, despite these differences, the absolute error when estimating the hydrogen isotope fraction [n H /(n H + n D )] by using the Hα radiance fraction [L Hα /(L Hα + L Dα )] is typically less than 5% due to the way the fraction is formed, making the radiance fraction a reasonably accurate estimate of the isotope fraction for most cases.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Product Consistency Test and Vapor Hydration Test Comparisons of a Radioactive Hanford Waste Glass with its Non-Radioactive Simulant Glass

Product Consistency Tests (PCT) and Vapor Hydration Tests (VHT) were performed on a radioactive glass made from Hanford tank AP-107 waste (i.e., R-AP-107) and its non-radioactive equivalent glass made from simulated tank waste (i.e., S-AP-107). The radioactive and non-radioactive experiments were conducted in parallel with identical equipment, protocols, and staff to remove additional experimental uncertainties. PCT and VHT results are reported for all samples and are shown in Table S.1. Average normalized mass loss of B ( NL B ) and Na ( NL Na ) calculated from the three replicate test results for each glass with their respective standard deviations (SD) are presented for PCT results while individual VHT rates ( r VHT ) with their propagated errors ( σ r prop ) from individual thickness measurements on each sample are presented for the VHT results. Some VHT samples experienced more than 50% evaporation loss during the experiments. However, no visible alteration was detected on any VHT samples regardless on the amount of evaporation loss detected as shown in Table S.1.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

High temperature oxidation of corrosion resistant alloys from machine learning

Parabolic rate constants, k p , were collected from published reports and calculated from corrosion product data (sample mass gain or corrosion product thickness) and tabulated for 75 alloys exposed to temperatures between ~800 and 2000 K (~500–1700 °C; 900–3000°F). Data were collected for environments including lab air, ambient and supercritical carbon dioxide, supercritical water, and steam. Materials studied include low- and high-Cr ferritic and austenitic steels, nickel superalloys, and aluminide materials. A combination of Arrhenius analysis, simple linear regression, supervised and unsupervised machine learning methods were used to investigate the relations between composition and oxidation kinetics. The supervised machine learning techniques produced the lowest mean standard errors. The most significant elements controlling oxidation kinetics were Ni, Cr, Al, and Fe, with Mo and Co composition also found to be significant features. The activation energies produced from the machine learning analysis were in the correct distributions for the diffusion constants for the oxide scales expected to dominate in each class.

Materials Science↗
DOE OSTI2020

An Eulerian multimaterial framework for simulating high-explosive aquarium tests

Aquarium tests of cylindrical high-explosive charges provide optical data of the detonation front velocity and shape, propagation of the shock wave in the surrounding water, and expansion rates of the detonation products behind the front. Data from aquarium experiments is often used for calibration of reactive burn models based on phenomenological equations of state (EOS) and reaction rate laws. This paper presents a multimaterial numerical modeling framework to solve the 2D axisymmetric reactive Euler equations for high-explosive aquarium tests, in particular for ammonium nitrate - fuel oil (ANFO) explosives. An extension of the Ghost Fluid Method (GFM) is used to handle the dynamic material interfaces for the ANFO explosion products, the charge-confining material (polymethyl methacrylate PMMA), and the surrounding water. This study analyzes the sensitivity of calculations (both computational efficiency and numerical accuracy) to different algorithms for the material interface models including the original GFM versus Riemann solver-based strategies. A novel method for defining the left and right states in the interfacial Riemann problem eliminates the need for sorting or nodal interpolation during the projection along the material interface. Numerical tests indicate that populating the interface node values using the Riemann solution mitigate the overheating error observed in steady-state calculations. Solution convergence and computational efficiency are explored as a function of the spatial and temporal order of the schemes. Results from the computational model with analytical equations of state and fitted reaction rate parameters show very good quantitative agreement with experimentally observed detonation front velocity, reaction products expansion, and shock wave propagation in the surrounding water for a cylindrical ANFO charge encased in PMMA. Finally, the proposed modeling framework, in conjunction with experimental tests, provides a reliable tool to assess equations of state and reaction rate expressions for reactive burn models of confined high explosives.

42 ENGINEERING↗
DOE OSTI2023

Unified analysis of finite-size error for periodic Hartree-Fock and second order Møller-Plesset perturbation theory

Despite decades of practice, finite-size errors in many widely used electronic structure theories for periodic systems remain poorly understood. For periodic systems using a general Monkhorst-Pack grid, there has been no comprehensive and rigorous analysis of the finite-size error in the Hartree-Fock theory (HF) and the second order Møller-Plesset perturbation theory (MP2), which are the simplest wavefunction based method, and the simplest post-Hartree-Fock method, respectively. Such calculations can be viewed as a multi-dimensional integral discretized with certain trapezoidal rules. Due to the Coulomb singularity, the integrand has many points of discontinuity in general, and standard error analysis based on the Euler-Maclaurin formula gives overly pessimistic results. The lack of analytic understanding of finite-size errors also impedes the development of effective finite-size correction schemes. We propose a unified analysis to obtain sharp convergence rates of finite-size errors for the periodic HF and MP2 theories. Our main technical advancement is a generalization of the result of Lyness [Math. Comp. 30 (1976), pp. 1–23] for obtaining sharp convergence rates of the trapezoidal rule for a class of non-smooth integrands. Our result is applicable to three-dimensional bulk systems as well as low dimensional systems (such as nanowires and 2D materials). Our unified analysis also allows us to prove the effectiveness of the Madelung-constant correction to the Fock exchange energy, and the effectiveness of a recently proposed staggered mesh method for periodic MP2 calculations (see X. Xing, X. Li, and L. Lin [J. Chem. Theory Comput. 17 (2021), pp. 4733–4745]). In conclusion, our analysis connects the effectiveness of the staggered mesh method with integrands with removable singularities, and suggests a new staggered mesh method for reducing finite-size errors of periodic HF calculations.

97 MATHEMATICS AND COMPUTING↗