Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Beam dynamics corrections in the measurement of the anomalous precession frequency at the Muon $g-2$ experiment at Fermilab

The Muon $g-2$ experiment at Fermilab (E989) aims to measure the anomalous magnetic moment of the muon with an accuracy of 140 ppb (parts per billions). This accuracy, obtained by adding in quadrature a statistical and a systematic contribution of comparable value (100 ppb), will allow to reduce the experimental uncertainty (from the previous E821 experiment at BNL \cite{bnl}) of a factor of 4, and represents one of the most precise tests of the Standard Model (SM) theory of elementary particles. The first result on the Run-1 dataset \cite{prl} was released on April 7, 2021, showing a very good agreement with the previous result from BNL experiment, with a slightly better uncertainty. The corresponding experimental average increases the significance of the discrepancy between the measured and Standard Model prediction of 4.2$\sigma$ \cite{white_paper}.\\ \noindent The measured quantity is the muon magnetic anomaly a$_\mu$=$\frac{g_\mu-2}{2}$ where g$_\mu$ is the gyromagnetic factor of the muon. Dirac's equation predicts g$_\mu$ = 2, while radiative corrections, dominated by the QED contribution due to an exchange of a virtual photon, causes a per-mille correction on this quantity. By including all the SM contributions, a$_\mu$ is known at 370 ppb. The E989 experiment measures $a_\mu$ injecting positive muons with momentum of 3.1 GeV/$c$ polarized longitudinally in bunches (called $fills$) with an average rate of 12 Hz, in a storage ring of 14 meters diameter. Due to the parity violation in the weak muon decay, high energy positrons produced are emitted preferably in the muon's spin direction. By counting the number of positrons with energy greater then 1.7 GeV in function of the time, the frequency precession of the muon spin is measured, that together with the measurement of the magnetic field, allows to extract $a_\mu$. The positrons are detected with 24 electromagnetic calorimeters, that measure the energy and the arrival time of the positrons, each made of 54 crystals of lead fluoride (PbF$_2$) read by silicon photomultipliers (SiPM). Together with calorimeters, two tracking detectors are used to make non-destructive measurements of the muon beam characteristic by reconstructing the muon decay position extrapolating backward the decay positrons. The knowledge of the beam motion inside the ring plays a fundamental role in the analysis of $a_{\mu}$, where the measured anomalous precession frequency $\omega_a$ must be corrected for four main beam dynamics effects. A first correction is associated with the presence of an electric field responsible of the vertical focusing on the storage ring, where vertical direction is orthogonal to the orbit and horizontal direction is along the storage ring radius. Due to the oscillations in the vertical direction, the so called vertical betatron oscillations, a second correction is necessary to account for an average angle associated with the muon motion off the ideal orbit. A third correction is caused by lost muons in the ring which have a different spin phase at the injection respect to the decay ones. Finally, due to the correlation between the vertical and horizontal beam motion of the muons and the acceptance of the calorimeter, a correction (called ``phase-acceptance") arises. In Run1, due to the presence of two damaged resistors in one electrostatic quadrupole, this correction had a prominent role. The replacement of the damaged resistors before Run2 decreased this effect by one order of magnitude, and a further reduction in Run-3 was provided by an improved orbit.\\ \noindent The work of this Thesis focuses on the beam dynamics corrections on $\omega_a$. Due to the prominent role in Run-1 a special attention has been put to the phase-acceptance correction\footnote{The effect of this correction on the E821 BNL measurement of the $g-2$ has been evaluated to be within the quoted systematic error.}. Chapter \ref{ch:anomalous_magnetic_moment} introduces the anomalous magnetic moment of the muon. Chapter \ref{ch:early_experiment} describes the history of the Muon $g-2$ experiments. Chapter \ref{ch:theory} discusses the Standard Model prediction and possible new physics scenario. Chapter \ref{ch:muon_g2_experiment} describes the E989 experiment, whose experimental technique and the apparatus are discussed focusing on the improvements needed to reach the final goal on $a_\mu$ measurement. The original work of the Thesis is discussed in the last 5 chapters. Chapter \ref{ch:experiment_technique} presents the analysis technique to extract $\omega_a$, Chapter \ref{ch:beam_dynamics} describes the beam dynamics in the E989 experiment, Chapter \ref{ch:beam_dynamics_correction} discusses the beam dynamics correction to $\omega_a$, and Chapter \ref{sec:pa_corr} focuses on the phase acceptance correction. Finally Chapter \ref{ch:run23_analysis_improvements} contains the Run-2/3 improvements which are expected to allow for an increased precision ons the beam dynamics co...

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Modeling neutrino-induced scale-dependent galaxy clustering for photometric galaxy surveys

Abstract The increasing statistical precision of photometric redshift surveys requires improved accuracy of theoretical predictions for large-scale structure observables to obtain unbiased cosmological constraints. In ΛCDM cosmologies, massive neutrinos stream freely at small cosmological scales, suppressing the small-scale power spectrum. In massive neutrino cosmologies, galaxy bias modeling needs to accurately relate the scale-dependent growth of the underlying matter field to observed galaxy clustering statistics. In this work, we implement a computationally efficient approximation of the neutrino-induced scale-dependent bias (NISDB). Through simulated likelihood analyses of Dark Energy Survey Year 3 (DESY3) and Legacy Survey of Space and Time Year 1 (LSSTY1) synthetic data that contain an appreciable NISDB, we examine the impact of linear galaxy bias and neutrino mass modeling choices on cosmological parameter inference. We find model misspecification of the NISDB approximation and neutrino mass models to decrease the constraining power of photometric galaxy surveys and cause parameter biases in the cosmological interpretation of future surveys. We quantify these biases and devise mitigation strategies.

Astronomy & Astrophysics↗
DOE OSTI2022

Efficient Loads Surrogates for Waked Turbines in an Array

Accurately and efficiently predicting wind turbine structural loading is a crucial step in wind farm design. Without considering structural loading, wind farm optimization could negatively impact turbine fatigue and ultimate loads, especially for waked and partially waked turbines, which could result in higher maintenance costs and reduced turbine lifetime. However, predicting turbine loads throughout an array is a costly step, as these quantities require time-accurate results across long time histories, which is often intractable for large array optimization. Therefore, surrogate models that link array spacing to load outputs are often used, but the surrogates are then unique to the inflow conditions and array configurations in the training library. This work develops surrogate models for many wind turbine load outputs based solely on rotor plane velocity measurements, with no required input about array configuration or freestream inflow parameters. Surrogate models were constructed for many turbine quantities of interest (QoI), considering mean, standard deviation, ultimate, and fatigue loads. In general, most QoI statistics were accurately captured, as measured by predicted vs. actual correlation coefficient, confirming the suitability of the approach. Temporal mean values of the QoI required only temporal mean measurements of the rotor plane inflow velocity. However, accurate prediction of temporal standard deviation, ultimate, and fatigue values of QoI also required temporal standard deviations of the rotor plane velocity field. Poor surrogate performance was observed when too many correlated inputs were used, such as multiple velocity components. If the fewest inflow parameters are used to construct the surrogates, the average correlation coefficient value for all output QoI statistics is 0.89. Surrogates for standard deviations and damage equivalent loads (DELs) of turbine QoIs generally had lower accuracy and tower-base and shaft load channels posed the most difficult to capture accurately. The results suggest that these surrogates could be easily paired with analytic wake models, which are frequently used for pre-construction wind farm array optimization, to account for turbine loading in addition to power production. By including the optimal inflow conditions, the surrogate accuracy can improve to an average correlation coefficient value for all output QoI statistics of 0.92. This work has established the ability to build accurate surrogates for mean, standard deviation, ultimate load, and DEL turbine QoI values based on the rotor plane inflow velocity, and identified which inflow conditions lead to greater surrogate accuracy.

17 WIND ENERGY↗
DOE OSTI2026

Surrogate model evaluation and building energy benchmarking for commercial buildings

Building energy consumption benchmarking involves challenges associated with various energy patterns for different building types; heating, ventilating, and air-conditioning (HVAC) system types; and climates. Given significant variation in energy use patterns, accurate prediction of long-term energy use using surrogate models remains challenging. Multiple linear regression (MLR) is commonly used for building energy benchmarking because of its simple structure; however, it lacks accuracy compared to other black-box models. Although many studies have compared surrogate models and offer guidance on model selection based on metrics, they do not provide detailed analysis on improving the surrogate model accuracy. In this paper, we implement a surrogate model using polynomial ridge regression (i.e., MLR with interaction terms combined with ridge regularization) for small office and retail strip mall buildings across six HVAC system types and all climate zones, for electricity and natural gas in baseline and proposed scenarios. A simulation workflow is developed using OpenStudio TM /EnergyPlus TM to generate simulation data using measures over a wide range of efficiency inputs. Enhancements based on statistical insights are used for improving the model accuracy using filters, input transformations, and change points. Surrogate models achieved average coefficient of variation of the root mean squared error (CVRMSE) values of 2.17, 1.06, 2.05, and 3.26 for proposed electricity, proposed natural gas, baseline electricity, and baseline natural gas, respectively, with enhancements reducing CVRMSE by an average of 14.9% across all combinations. We provide model interpretation via Shapley additive explanations to determine which input variables most influence energy consumption and provide supportive arguments for enhancements.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Deep-field analytical calibration

The next generation of imaging surveys, including the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), Euclid, and the Nancy Grace Roman Space Telescope, will provide unprecedented constraints on cosmology using weak gravitational lensing. To fully exploit this statistical power, shear measurement methods must achieve sub- per cent accuracy while mitigating systematic biases from noise, the point-spread function (PSF), blending, and shear-dependent detection. The analytical calibration framework (AnaCal) has demonstrated such accuracy but requires adding noise to images, reducing effective depth. We introduce Deep-Field Analytical Calibration (DEEP-FIELD AnaCal), an extension of AnaCal that uses deep-field images to compute shear responses while preserving the statistical power of wide-field data. We validate DEEP-FIELD AnaCal on isolated and blended galaxy image simulations with LSST-like conditions, finding it meets the stringent requirement of multiplicative bias $|m| < 3\times 10^{-3}$ at 99.7 per cent confidence. Compared to standard AnaCal applied to wide-field images, DEEP-FIELD AnaCal increases the effective galaxy number density from 17 to 30 arcmin$^{-2}$ for simulated 10-yr LSST data. With deep fields $10\times$ longer than the wide field, we find pixel noise variance in shear estimation is reduced by 30 per cent and overall uncertainty by $\sim 25~{{\ \rm per\ cent}}$. Finally, using the LSST Deep Drilling Fields strategy, we assess sample variance and find an equivalent calibration uncertainty of $\lesssim 0.3~{{\ \rm per\ cent}}$. These results demonstrate that DEEP-FIELD AnaCal offers a promising path to achieve the required shear calibration for upcoming weak lensing surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Segmentation and Classification of Fission as Pores in Reactor Irradiated Annular U–10Zr Metallic Fuel Using Machine Learning Models

Metallic fuels, particularly U—10Zr, are promising candidates for next-generation sodium-cooled fast reactors. Irradiation of nuclear fuels in reactors can lead to the formation of solid and gas fission product which subsequently forms microstructural pores, deteriorating fuel performance. Due to the massive amount of pores and complex phases formed, a quantitative description of fission gas pores is not yet available, preventing the development of microstructure-informed fuel performance modeling for fuel qualification. This paper applied a pre-trained deep learning model to ~10,260 high magnification scanning electron microscopy images. This method increased the accuracy of fission gas pore segmentation and allows statistical features to be extracted which cannot be achieved manually. A pre-trained decision tree model worked on the segemenation results and further classified the pores into different categories to produce a correlation between the pores, movement of lanthanides, and temperature gradient during irradiation. Finally, this paper emphasizes the potentials of machine learning models to accelerate fuel research, development, and qualification for advanced reactors.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Reconstructions from randomly generated longitudinal electron bunch profiles with Gaussian envelopes using the Gerchberg–Saxton algorithm

Knowledge of longitudinal electron bunch profiles is vital to optimize the performance of plasma wakefield accelerators and x-ray free electron laser linacs. Because of their importance to these novel applications, noninvasive frequency domain techniques are often employed to reconstruct longitudinal bunch profiles from coherent synchrotron, transition, or undulator radiation measurements. In this paper, we detail several common reconstruction techniques involving the Kramers–Kronig phase relationship and Gerchberg–Saxton algorithm. Additionally, through statistical analysis, we draw general conclusions about the accuracy of these reconstruction techniques and the most suitable candidate for reconstructing well-isolated longitudinal bunch profiles from spectroscopic data.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Fast, High-fidelity Lyα Forests with Convolutional Neural Networks

Full-physics cosmological simulations are powerful tools for studying the formation and evolution of structure in the universe but require extreme computational resources. Here, we train a convolutional neural network to use a cheaper N-body-only simulation to reconstruct the baryon hydrodynamic variables (density, temperature, and velocity) on scales relevant to the Lyα forest, using data from Nyx simulations. We show that our method enables rapid estimation of these fields at a resolution of ~20 kpc, and captures the statistics of the Lyα forest with much greater accuracy than existing approximations. Because our model is fully convolutional, we can train on smaller simulation boxes and deploy on much larger ones, enabling substantial computational savings. Furthermore, as our method produces an approximation for the hydrodynamic fields instead of Lyα flux directly, it is not limited to a particular choice of ionizing background or mean transmitted flux.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Quantitative Insight to Fission Gas Pores Distribution in Irradiated Annular U-10Zr Metallic Fuel Using Machine Learning

Metallic fuels, particularly U-10Zr and its performance in reactor irradiation conditions, have been thoroughly investigated and are a promising candidate for next-generation sodium-cooled fast spectrum nuclear reactors. Irradiation in reactors can lead to the formation of fission gas and increased pore formation which can significantly impact fuel performance. Due to the large number of pores and various phases formed in metallic fuel during irradiation, a quantitative description of fission gas pores as a function of irradiation conditions is not yet available, undermining the fidelity of fuel performance modeling to support fuel qualification. It has been difficult to clearly detect pore boundaries and distinguish matrix phases from fission gas pores using optical microscopy by using simple threshold methods working with low magnification images. The pre-trained deep learning model for fission gas pore detection was applied to ~10,260 high magnification scanning electron microscopy images. The model increased the accuracy of fission gas pore segmentation to obtain statistical features, which cannot be processed manually. A pre-trained decision tree model was used to classify pores as isolated or connected pores, providing new insight into the correlation between the movement of lanthanides, solid fission products, and the radial temperature gradient developed in fuel irradiation conditions. This paper emphasizes the potential that artificial intelligence-based machine learning models have to accelerate qualification and support nuclear fuel development.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Tree-Based Ensemble Learning Models for Wall Temperature Predictions in Post-Critical Heat Flux Flow Regimes at Subcooled and Low-Quality Conditions

Accurately predicting post-critical heat flux (CHF) heat transfer is an important but challenging task in water-cooled reactor design and safety analysis. Although numerous heat transfer correlations have been developed to predict post-CHF heat transfer, these correlations are only applicable to relatively narrow ranges of flow conditions due to the complex physical nature of the post-CHF heat transfer regimes. In this paper, a large quantity of experimental data is collected and summarized from the literature for steady-state subcooled and low-quality film boiling regimes with water as the working fluid in vertical tubular test sections. In addition, a low-quality water film boiling (LWFB) database is consolidated with a total of 22,813 experimental data points, which cover a wide flow range of the system pressure from 0.1 to 9.0 MPa, mass flux from 25 to 2750 kg/m 2 s, and inlet subcooling from 1 to 70 °C. Two machine learning (ML) models, based on random forest (RF) and gradient boosted decision tree (GBDT), are trained and validated to predict wall temperatures in post-CHF flow regimes. The trained ML models demonstrate significantly improved accuracies compared to conventional empirical correlations. To further evaluate the performance of these two ML models from a statistical perspective, three criteria are investigated and three metrics are calculated to quantitatively assess the accuracy of these two ML models. For the full LWFB database, the root-mean-square errors between the measured and predicted wall temperatures by the GBDT and RF models are 5.7% and 6.2%, respectively, confirming the accuracy of the two ML models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

Full-stack Quantification of Variability in Predicting Ion Transport Properties using Machine-learned Interatomic Potentials

Machine-learned interatomic potentials (MLIPs) have become the state-of-the-art for performing accurate, scalable molecular dynamics (MD) simulations. It is therefore crucial to understand and quantify the reliability of MLIPs for downstream property predictions. Uncertainty in predicted properties can arise from limitations in first-principles training data, intrinsic MLIP model errors in representing the data, and the statistical noise introduced during subsequent MD simulations. Using ion transport in Li7P3S11 as a case study, we systematically assess the impact of training set size and selection, neural network stochasticity, and MD sampling statistics on predicted diffusivity and activation energy. We find that when using equivariant MLIP architectures with standard MD protocols, uncertainty arising from MD sampling dominates over model-induced errors. In contrast, MLIP errors relative to the underlying first-principles data are consistently minor. Given this, there are two main routes to improving the accuracy of predictions based on MLIP potentials: adopting higher accuracy reference data generation methods, and improving the MD sampling statistics.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Evaluation of artificial neural network performance for classification of potato plants infected with potato virus Y using spectral data on multiple varieties and genotypes

Potato virus Y (Potyviridae, PVY) is a plant virus that poses a significant threat to potato producers on a global basis. The pathogen has disrupted seed potato supplies and negatively impacted yield and quality of commercial potato crops. The potato industry currently manages PVY infection levels via insecticide applications, regional seed certification programs that rely on field scouting to visually assess individual plants for infection status, and destructive and costly tissue sampling coupled with laboratory assays. Despite these efforts, PVY continues to confound potato industry stakeholders resulting in economic harm. Remote sensing and machine learning provide for the development of new tools to more accurately detect and spatially quantify PVY-infected plants versus the current state of the art. However, there is a need to understand how the occurrence of many different potato varieties impact the dynamics of developing models to detect potato plants impacted with PVY and their potential effectiveness. This study evaluates classification modelling outcomes using spectral datasets collected in different temporal and spatial environments (greenhouse and a production field) on multiple potato varieties consisting of labelled instances of plants infected with PVY and those not infected with the virus. A modelling framework was developed to support iterative modelling runs using artificial neural network (ANN) architectures configured as binary classifiers to develop sample populations to support statistical analysis on model performance using specific spectral subsets. When using spectral data to detect PVY-infected plants, ANN models achieved the highest mean accuracy of 0.894 on a single variety. Conversely, the same ANN model architecture only achieved a mean accuracy of 0.575 on a spectral data set representing 29 potato breeding lines. Additionally, statistical analysis indicates spectral regions including the red edge, near infrared and shortwave infrared contain more important spectral features for the ANN classifier introduced in this research.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Modeling the Behavior of Complex Aqueous Electrolytes Using Machine Learning Interatomic Potentials: The Case of Sodium Sulfate

Understanding the structure and thermodynamics of solvated ions is essential for advancing applications in electrochemistry, water treatment, and energy storage. While ab initio molecular dynamics methods are highly accurate, they are limited by short accessible time and length scales whereas classical force fields struggle with accuracy. Herein, we explore the structure and thermodynamics of complex monovalent-divalent ion pairs using Na 2 SO 4 (aq) as a case study by applying a machine learning interatomic potential (MLIP) trained on density functional theory (DFT) data. Our MLIP-based approach reproduces key bulk properties such as density and radial distribution functions of water. We provide the hydration structure of the sodium and sulfate ions in the 0.1–2 M concentration range and the one-dimensional and two-dimensional potentials of mean force for the sodium–sulfate ion pairing at the low concentration limit (0.1 M), which are inaccessible to DFT. At low concentrations, the sulfate ion is strongly solvated, leading to the stabilization of solvent-separated ion pairs over contact ion pairs. Minimum energy pathway analysis revealed that coordinating two sodium ions with a sulfate ion is a multistep process whereby the sodium ions coordinate to the sulfate ion sequentially. Finally, we demonstrate that MLIPs allow the study of solvated ions beyond simple monovalent pairs with DFT-level accuracy in their low concentration limit (0.1 M) via statistically converged properties from ns-long simulations.

anions↗
DOE OSTI2022

Extracting forces from noisy dynamics in dusty plasmas

Extracting environmental forces from noisy data is a common yet challenging task in complex physical systems. Machine learning (ML) represents a robust approach to this problem, yet is mostly tested on simulated data with known parameters. Here we use supervised ML to extract the electrostatic, dissipative, and stochastic forces acting on micron-sized charged particles levitated in an argon plasma (dusty plasma). By tracking the sub-pixel motion of particles in subsequent images, we successfully estimated these forces from their random motion. The experiments contained important sources of non-Gaussian noise, such as drift and pixel-locking, representing a data mismatch from methods used to analyze simulated data with purely Gaussian noise. Our model was trained on simulated particle trajectories that included all of these artifacts, and used more than 100 dynamical and statistical features, resulting in a prediction with 50\% better accuracy than conventional methods. Lastly, in systems with two interacting particles, the model provided non-contact measurements of the particle charge and Debye length in the plasma environment.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

A Hybrid Anomaly Detection Approach for Obfuscated Malware

With the rapid evolution of malicious software, cyber threats have become increasingly sophisticated, employing advanced obfuscation techniques to evade traditional detection methods. This study presents a hybrid anomaly detection approach applied to obfuscated malware. Even though there is a large body of research in this field, existing malware detection techniques have some drawbacks, such as requiring large amounts of data, trustworthiness (imprecise results) of algorithms, and advanced obfuscation. To overcome these challenges, there is a need to employ solid and efficient techniques for malware detection. This paper proposes a hybrid approach, combining an autoencoder with traditional machine-learning methods to create an efficient malware detection framework. We used the malware memory dataset (MalMemAnalysis-2022) to evaluate this framework. The results indicate that our proposed approach can detect obfuscated malware when a deep autoencoder used for feature learning is combined with logistic regression, and it is extremely fast with an Accuracy, Detection Rate (DR), Matthew Correlation Coefficient(MCC), and Statistical Parity Difference

malware detection, Hybrid Anomly Detection, Obfusc↗
DOE OSTI2024

Topological Interpretability for Deep Learning

With the growing adoption of AI-based systems across everyday life, the need to understand their decision-making mechanisms is correspondingly increasing. The level at which we can trust the statistical inferences made from AI-based decision systems is an increasing concern, especially in high-risk systems such as criminal justice or medical diagnosis, where incorrect inferences may have tragic consequences. Despite their successes in providing solutions to problems involving real-world data, deep learning (DL) models cannot quantify the certainty of their predictions. These models are frequently quite confident, even when their solutions are incorrect. This work presents a method to infer prominent features in two DL classification models trained on clinical and non-clinical text by employing techniques from topological and geometric data analysis. We create a graph of a model's feature space and cluster the inputs into the graph's vertices by the similarity of features and prediction statistics. We then extract subgraphs demonstrating high-predictive accuracy for a given label. These subgraphs contain a wealth of information about features that the DL model has recognized as relevant to its decisions. We infer these features for a given label using a distance metric between probability measures, and demonstrate the stability of our method compared to the LIME and SHAP interpretability methods. This work establishes that we may gain insights into the decision mechanism of a DL model. This method allows us to ascertain if the model is making its decisions based on information germane to the problem or identifies extraneous patterns within the data.

Spannaus, Adam↗
DOE OSTI2022

Large Scale Study of Ligand–Protein Relative Binding Free Energy Calculations: Actionable Predictions from Statistically Robust Protocols

The accurate and reliable prediction of protein–ligand binding affinities can play a central role in the drug discovery process as well as in personalized medicine. Of considerable importance during lead optimization are the alchemical free energy methods that furnish an estimation of relative binding free energies (RBFE) of similar molecules. Recent advances in these methods have increased their speed, accuracy, and precision. This is evident from the increasing number of retrospective as well as prospective studies employing them. However, such methods still have limited applicability in real-world scenarios due to a number of important yet unresolved issues. Here, we report the findings from a large data set comprising over 500 ligand transformations spanning over 300 ligands binding to a diverse set of 14 different protein targets which furnish statistically robust results on the accuracy, precision, and reproducibility of RBFE calculations. We use ensemble-based methods which are the only way to provide reliable uncertainty quantification given that the underlying molecular dynamics is chaotic. These are implemented using TIES (Thermodynamic Integration with Enhanced Sampling). Results achieve chemical accuracy in all cases. Ensemble simulations also furnish information on the statistical distributions of the free energy calculations which exhibit non-normal behavior. We find that the “enhanced sampling” method known as replica exchange with solute tempering degrades RBFE predictions. We also report definitively on numerous associated alchemical factors including the choice of ligand charge method, flexibility in ligand structure, and the size of the alchemical region including the number of atoms involved in transforming one ligand into another. Our findings provide a key set of recommendations that should be adopted for the reliable application of RBFE methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Stochastic modeling and statistical calibration with model error and scarce data

This paper introduces a procedure to assess the predictive accuracy of stochastic models subject to model error and sparse data. Model error is introduced as uncertainty on the coefficients of appropriate polynomial chaos expansions (PCE). The error associated with finite sample size allows us to conceive of these coefficients as statistics of the data that we describe as random variables whose influence on output quantities of interest is evaluated through the extended polynomial chaos expansion (EPCE). A Bayesian data assimilation scheme is introduced to update these expansions by considering the resulting nested chaos expansion as a hierarchical probabilistic model. Stochastic models of quantities of interest (QoI) are thus constructed and efficiently evaluated. Here, the Metropolis–Hastings Markov chain Monte Carlo procedure is used to sample the posterior. Two illustrative analytical and numerical problems are used to demonstrate the proposed approach.

Bayesian inference↗