Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Analyses of GWAS signal using GRIN identify additional genes contributing to suicidal behavior

Genome-wide association studies (GWAS) identify genetic variants underlying complex traits but are limited by stringent genome-wide significance thresholds. We present GRIN (Gene set Refinement through Interacting Networks), which increases confidence in the expanded gene set by retaining genes strongly connected by biological networks when GWAS thresholds are relaxed. GRIN was validated on both simulated interrelated gene sets as well as multiple GWAS traits. From multiple GWAS summary statistics of suicide attempt, a complex phenotype, GRIN identified additional genes that replicated across independent cohorts and retained biologically interrelated genes despite a relaxed significance threshold. We present a conceptual model of how these retained genes interact through neurobiological pathways that may influence suicidal behavior, and identify existing drugs associated with these pathways that would not have been identified under traditional GWAS thresholds. We demonstrate GRIN’s utility in boosting GWAS results by increasing the number of true positive genes identified from GWAS results.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Redshifting galaxies from DESI to JWST CEERS: Correction of biases and uncertainties in quantifying morphology

Observations of high-redshift galaxies with unprecedented detail have now been rendered possible with the James Webb Space Telescope (JWST). However, accurately quantifying their morphology remains uncertain due to potential biases and uncertainties. To address this issue, we used a sample of 1816 nearby DESI galaxies, with a stellar mass range of 10 9.75 - 11.25 M ⊙ , to compute artificial images of galaxies of the same mass located at 0.75 ≤ z ≤ 3 and observed at rest-frame optical wavelength in the Cosmic Evolution Early Release Science (CEERS) survey. We analyzed the effects of cosmological redshift on the measurements of Petrosian radius (R p ), half-light radius (R 50 ), asymmetry (A), concentration (C), axis ratio (q), and Sérsic index (n). Our results show that R p and R 50 , calculated using non-parametric methods, are slightly overestimated due to PSF smoothing, while R 50 , q, and n obtained through fitting a Sérsic model does not exhibit significant biases. By incorporating a more accurate noise effect removal procedure, we improve the computation of A over existing methods, which often overestimate, underestimate, or lead to significant scatter of noise contributions. Due to PSF asymmetry, there is a minor overestimation of A for intrinsically symmetric galaxies. However, for intrinsically asymmetric galaxies, PSF smoothing dominates and results in an underestimation of A, an effect that becomes more significant with higher intrinsic A or at lower resolutions. Moreover, PSF smoothing also leads to an underestimation of C, which is notably more pronounced in galaxies with higher intrinsic C or at lower resolutions. We developed functions based on resolution level, defined as R p /FWHM, for correcting these biases and the associated statistical uncertainties. Applying these corrections, we measured the bias-corrected morphology for the simulated CEERS images and we find that the derived quantities are in good agreement with their intrinsic values – except for A, which is robust only for angularly large galaxies where R p /FWHM ≥ 5. Our correction functions can be applied to other surveys, offering valuable tools for future studies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

X-ray continuum spectroscopy of inertial confinement fusion implosions at the National Ignition Facility

A methodology for measuring x-ray continuum spectra of inertial confinement fusion (ICF) implosions is described. The method relies on the use of ConSpec, a high-throughput spectrometer using a highly annealed pyrolytic graphite crystal , which measures the spectra in the ≃20–30 keV range. Due to its conical shape, the crystal is sagittally focusing a Bragg-reflected x-ray spectrum into a line, which enhances the recorded x-ray emission signal above the high neutron-induced background accompanying ICF implosions at the National Ignition Facility. To improve the overall measurement accuracy, the sensitivity of the spectrometer measured in an off-line x-ray laboratory setting was revised. The error analysis was expanded to include the accuracy of the off-line measurements, the effect of the neutron-induced background, as well as the influence of possible errors in alignment of the instrument to the ICF target. Here we demonstrate how the improved methodology is applied in the analysis of ConSpec data with examples of a relatively low-neutron-yield implosion using a tritium–hydrogen–deuterium mix as a fuel and a high-yield deuterium–tritium (DT) implosion producing high level of the background. In both cases, the shape of the measured spectrum agrees with the exponentially decaying spectral shape of bremsstrahlung emission to within ±10%. In the case of the high-yield DT experiment, non-monotonic deviations slightly exceeding the measurement uncertainties are observed and discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Noise from undetected sources in Dark Energy Survey images

ABSTRACT For ground-based optical imaging with current CCD technology, the Poisson fluctuations in source and sky background photon arrivals dominate the noise budget and are readily estimated. Another component of noise, however, is the signal from the undetected population of stars and galaxies. Using injection of artifical galaxies into images, we demonstrate that the measured variance of galaxy moments (used for weak gravitational lensing measurements) in Dark Energy Survey (DES) images is significantly in excess of the Poisson predictions, by up to 30 per cent, and that the background sky levels are overestimated by current software. By cross-correlating distinct images of ‘empty’ sky regions, we establish that there is a significant image noise contribution from undetected static sources (US), which, on average, are mildly resolved at DES resolution. Treating these US as a stationary noise source, we compute a correction to the moment covariance matrix expected from Poisson noise. The corrected covariance matrix matches the moment variances measured on the injected DES images to within 5 per cent. Thus, we have an empirical method to statistically account for US in weak lensing measurements, rather than requiring extremely deep sky simulations. We also find that local sky determinations can remove most of the bias in flux measurements, at a small penalty in additional, but quantifiable, noise.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Dark Energy Survey Year 3 results: $w$CDM cosmology from simulation-based inference with persistent homology on the sphere

We present cosmological constraints from Dark Energy Survey Year 3 (DES Y3) weak lensing data using persistent homology, a topological data analysis technique that tracks how features like clusters and voids evolve across density thresholds. For the first time, we apply spherical persistent homology to galaxy survey data through the algorithm TopoS2, which is optimized for curved-sky analyses and HEALPix compatibility. Employing a simulation-based inference framework with the Gower Street simulation suite, specifically designed to mimic DES Y3 data properties, we extract topological summary statistics from convergence maps across multiple smoothing scales and redshift bins. After neural network compression of these statistics, we estimate the likelihood function and validate our analysis against baryonic feedback effects, finding minimal biases (under $0.3σ$) in the $Ω_\mathrm{m}-S_8$ plane. Assuming the $w$CDM model, our combined Betti numbers and second moments analysis yields $S_8 = 0.821 \pm 0.018$ and $Ω_\mathrm{m} = 0.304\pm0.037$-constraints 70% tighter than those from cosmic shear two-point statistics in the same parameter plane. Our results demonstrate that topological methods provide a powerful and robust framework for extracting cosmological information, with our spherical methodology readily applicable to upcoming Stage IV wide-field galaxy surveys.

Prat, J. [Nordita; Royal Inst. Tech., Sodertalje; ↗
DOE OSTI2022

Improved $^{95}\mathrm{Mo}$ neutron resonance parameters and astrophysical reaction rates

We report improved 95 Mo neutron resonance parameters and reaction rates are important for nuclear astrophysics, testing nuclear models, and nuclear criticality safety. However, despite many previous neutron-capture and total cross-section measurements on this nuclide, there still is much room for improvement as well as several discrepancies. For example, there are very few firm resonance spin and parity assignments; average resonance parameters are available only for each parity, the currently recommended astrophysical reaction rate results in disagreements between stellar models and meteoric isotopic anomalies, and there are substantial disagreements in the neutron-capture cross section at low energies important for nuclear criticality safety. To obtain an improved set of neutron resonance parameters and astrophysical reaction rates for 95 Mo. High-resolution neutron-capture and transmission data were measured at the Oak Ridge Electron Linear Accelerator (ORELA) using highly isotopically enriched 95 Mo samples. The neutron-capture apparatus, data reduction, and analysis were improved so that information contained in the γ-ray cascade following neutron capture were used to assign resonance J π values. Following this, simultaneous analysis of the new neutron-capture and transmission data was used to obtain resonance energies, gamma widths, and neutron widths and their uncertainties to a maximum energy of 10 keV. Accurate neutron-capture cross sections also were obtained for the unresolved resonance region to a maximum energy of 500 keV and, together with the new resonance parameters, used to calculate the astrophysical reaction rates in the temperature range from 5 to 30 keV. A vastly improved set of 95Mo neutron resonance parameters and an astrophysical reaction rate accurate to about 3% were obtained. Firm J π assignments were determined for 261 of the 314 observed resonances. This is a very large improvement over the previously published 32 firm J π assignments for 108 resonances. Also, the number of resonances having both firm J π assignments and Γ γ values was increased by almost a factor of 24—from 11 to 261. Neutron- and total-radiation-width distributions and average resonance spacings, average total radiation widths, and neutron strength functions were obtained for the six different s- and p-wave possibilities. Parameters for the lowest s-wave resonance, which is most important for criticality benchmarks, were obtained with high accuracy. Simple modification of the neutron-capture apparatus and expansion and improvement of data analysis techniques led to a large increase in firm J π assignments for 95 Mo neutron resonances. The resulting astrophysical reaction rate is 20%–30% larger than the currently recommended rate at s-process temperatures, which should lead to better agreement between stellar models and meteoric isotopic anomalies. The neutron-capture cross section at low energies is substantially larger than recommended in the latest evaluation, which is problematical for criticality benchmarks. The average resonance spacing as a function of spin and parity is significantly different from current models. The total-radiation-width distributions are significantly broader than predicted by theory and show significant departures from the expected Gaussian shapes.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Online Detection of Inter-Turn Winding Faults in Single-Phase Distribution Transformers Using Smart Meter Data

Turn-to-turn faults between primary windings due to insulation degradation are a major cause of distribution transformer failure, and occur due to high levels of stress such as overloading and overheating. An additional consequence of these faults is an increased voltage on the transformer secondary due to effective change in turns ratio. This paper develops a novel method for early detection of insulation degradation and subsequent inter-turn winding failure by monitoring the transformer secondary voltage. The algorithm is based on a cumulative sum (CUSUM) statistic and compares voltages on neighbouring transformers to flag degrading assets. Results obtained from simulation as well as experimental data show that smart meter measurements can be utilized to achieve very high detection accuracy while keeping costs low. Here, the paper also demonstrates the validity of the algorithm in the presence of measurement noise, residential solar power injection etc.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Efficient Probabilistic Prediction and Uncertainty Quantification of Tropical Cyclone–Driven Storm Tides and Inundation

Abstract This study proposes and assesses a methodology to obtain high-quality probabilistic predictions and uncertainty information of near-landfall tropical cyclone–driven (TC-driven) storm tide and inundation with limited time and resources. Forecasts of TC track, intensity, and size are perturbed according to quasi-random Korobov sequences of historical forecast errors with assumed Gaussian and uniform statistical distributions. These perturbations are run in an ensemble of hydrodynamic storm tide model simulations. The resulting set of maximum water surface elevations are dimensionality reduced using Karhunen–Loève expansions and then used as a training set to develop a polynomial chaos (PC) surrogate model from which global sensitivities and probabilistic predictions can be extracted. The maximum water surface elevation is extrapolated over dry points incorporating energy head loss with distance to properly train the surrogate for predicting inundation. We find that the surrogate constructed with third-order PCs using elastic net penalized regression with leave-one-out cross validation provides the most robust fit across training and test sets. Probabilistic predictions of maximum water surface elevation and inundation area by the surrogate model at 48-h lead time for three past U.S. landfalling hurricanes (Irma in 2017, Florence in 2018, and Laura in 2020) are found to be reliable when compared to best track hindcast simulation results, even when trained with as few as 19 samples. The maximum water surface elevation is most sensitive to perpendicular track-offset errors for all three storms. Laura is also highly sensitive to storm size and has the least reliable prediction. Significance Statement The purpose of this study is to develop and evaluate a methodology that can be used to provide high-quality probabilistic predictions of hurricane-induced storm tide and inundation with limited time and resources. This is important for emergency management purposes during or after the landfall of hurricanes. Our results show that sampling forecast errors using quasi-random sequences combined with machine learning techniques that fit polynomial functions to the data are well suited to this task. The polynomial functions also have the benefit of producing exact sensitivity indices of storm tide and inundation to the forecasted hurricane properties such as path, intensity, and size, which can be used for uncertainty estimation. The code implementing the presented methodology is publicly available on GitHub.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Robust Anthropogenic Signal Identified in the Seasonal Cycle of Tropospheric Temperature

Previous work identified an anthropogenic fingerprint pattern in T AC (x, t), the amplitude of the seasonal cycle of mid- to upper-tropospheric temperature (TMT), but did not explicitly consider whether fingerprint identification in satellite T AC (x, t) data could have been influenced by real-world multidecadal internal variability (MIV). Here we address this question here using large ensembles (LEs) performed with five climate models. LEs provide many different sequences of internal variability noise superimposed on an underlying forced signal. Despite differences in historical external forcings, climate sensitivity, and MIV properties of the five models, their T AC (x, t) fingerprints are similar and statistically identifiable in 239 of the 240 LE realizations of historical climate change. Comparing simulated and observed variability spectra reveals that consistent fingerprint identification is unlikely to be biased by model underestimates of observed MIV. Even in the presence of large (factor of 3–4) intermodel and inter-realization differences in the amplitude of MIV, the anthropogenic fingerprints of seasonal cycle changes are robustly identifiable in models and satellite data. This is primarily due to the fact that the distinctive, global-scale fingerprint patterns are spatially dissimilar to the smaller-scale patterns of internal T AC (x, t) variability associated with the Atlantic multidecadal oscillation and El Niño–Southern Oscillation. The robustness of the seasonal cycle detection and attribution results shown here, taken together with the evidence from idealized aquaplanet simulations, suggest that basic physical processes are dictating a common pattern of forced T AC (x, t) changes in observations and in the five LEs. The key processes involved include GHG-induced expansion of the tropics, lapse-rate changes, land surface drying, and sea ice decrease.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

mystic : software for autonomous discovery and design under uncertainty

Throughout the diverse range of science and engineering applications, there is a growing desire to develop computational methods that can reliably predict the behavior of complex systems. Specifically, there is a strategic need for tools that can robustly forecast the behavior of complex physical systems, where data may be high-dimensional, noisy, or sparse, and models of the system may be time-dependent or include uncertainty. We use mystic to build tools that leverage statistical learning, physics-informed learning, and active learning in the efficient generation of reliably predictive surrogates for complex physical systems. mystic is a robust, proven, open-source optimization and uncertainty quantification toolkit with over a decade of use in the design and optimization of neutron instrumentation, solar-powered drones, and gasguns, and in iterative tuning of models for Raman spectroscopy and elastoplastic materials strength. Recent developments have focused on automated learning of statistically robust surrogates under uncertainty, with applications in materials in extreme environments, nanostructures, materials simulations and strength models, and the failure of shielding under particle radiation. In 2020, McKerns demonstrated active learning of optimally robust surrogates with respect to new simulated data for molecular dynamics simulations of materials mixing in warm dense matter, and is currently applying active learning to the automated steering of particle accelerator beams and the optimal design and control of quantum optical sensor instrumentation.

42 ENGINEERING↗
DOE OSTI2023

Turbulence Modeling with Nek5000/RS, SOD2D and Alya

We present Validation and Verification (V & V) study of two high-order spectral element method (SEM) based Computational Fluid Dyanimcs (CFD) codes that we will utilize for work on turbulence modeling: Nek5000 and SOD2D. While the former solves the incompressible form of Navier-Stokes equation, the latter works with compressible set of equations and uses an entropy-viscosity formulation to account for the discontinuities for high Mach number flows. We demonstrate the accuracy of these codes for two benchmark sub-sonic turbulent flows: periodic channel and pipe flow, by carrying out first and second order statistical analysis, grid convergence and turbulent structure analysis using wall-resolved large eddy simulations (WRLES). Later, we report on the implementation and testing of various wall-modeling strategies for large eddy simulation of turbulent flows in Nek5000. These include both classical log-law based and decision-tree based machine-learning models. Accuracy of these closure strategies are analyzed and necessary future work is outlined.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Field Test Report Neutron Scintillator Array Dry Storage Cask Scanner FY2024

During two weeks of Field Testing at the Idaho National Laboratory INTEC Cask Farm in July and August 2024, the LLNL Dry Storage Cask Scanner Array was lifted on top of an MC-10 dry storage fuel cask and operated to acquire neutron and gamma-ray data from the 24 fuel bundle positions. Neutron and gamma-ray data acquisition scans across the top of the cask of varying dwell times were performed July 15-18, 2024 and August 19-22, 2024 to evaluate the ability of the scanner data to reveal asymmetries in the fuel positions that reflect asymmetries in the MC-10 cask fuel bundle loading. The MC-10 cask 24 position fuel bundle loading at the INTEC Cask Farm is well documented, including the locations of six empty fuel bundle positions. This loading presents an opportunity to test the ability of the scanner system to detect diversion of spent fuel bundles as well as to validate the MC-10 cask MCNP modeling. The cask scanner array consists of six Stilbene crystal scintillator detectors and a linear actuator frame that moves the six detectors across the MC-10 dry storage cask to obtain data above each of the 24 fuel bundle positions. The detectors are connected to a pulse-shape discrimination data acquisition system capable of generating separate neutron and gamma-ray spectra for each detector and for each scan position. From the prior single detector Field Test in 2021 and iteration with MCNP modeling, the neutron and gamma-ray data were analyzed in multiple energy regions to identify an analysis method that would provide the strongest and most consistent signature of the asymmetric MC-10 cask fuel loading1 . From both the 2021 Field Test and the current Field Test results, the neutron capture gamma-ray count rate around 2.2 MeV provides the strongest signature of the asymmetric MC-10 cask fuel loading and has qualitative agreement with MCNP calculations. Counting all gamma-rays produces a similar signature. Neutrons emerging from the cask top are moderated and captured by the hydrogen in the polyethylene moderator and scintillator detector, producing a 2.2 MeV gamma ray which is seen in the scintillator gamma-ray spectrum. The count rate in the 2.2 MeV gamma-ray region is ~50 c/s, which is ~1000x higher than the ~0.05 n/s rate in the > 4MeV neutron region, and ~50x greater than the ~1 n/s rate in the neutrons > 500 keV region. Analysis of the 2.2 MeV neutron-capture Compton-scattered gamma-rays produces a statistically significant signature of the INTEC Cask Farm MC-10 asymmetric fuel loading. MCNP simulations indicate that the average neutron energy spectrum offers the potential to detect a large asymmetry from several missing bundles as well as individual missing fuel bundles. Testing this feature will require measurements on a cask with single missing elements.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Transient Unfolding and Long-Range Interactions in Viral BCL2 M11 Enable Binding to the BECN1 BH3 Domain

Viral BCL2 proteins (vBCL2s) help to sustain chronic infection of host proteins to inhibit apoptosis and autophagy. However, details of conformational changes in vBCL2s that enable binding to BH3Ds remain unknown. Using all-atom, multiple microsecond-long molecular dynamic simulations (totaling 17 μs) of the murine γ-herpesvirus 68 vBCL2 (M11), and statistical inference techniques, we show that regions of M11 transiently unfold and refold upon binding of the BH3D. Further, we show that this partial unfolding/refolding within M11 is mediated by a network of hydrophobic interactions, which includes residues that are 10 Å away from the BH3D binding cleft. We experimentally validate the role of these hydrophobic interactions by quantifying the impact of mutating these residues on binding to the Beclin1/BECN1 BH3D, demonstrating that these mutations adversely affect both protein stability and binding. To our knowledge, this is the first study detailing the binding-associated conformational changes and presence of long-range interactions within vBCL2s.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

PSF–NET: A Nonparametric Point-spread Function Model for Ground-based Optical Telescopes

Ground-based optical telescopes are seriously affected by atmospheric turbulence induced aberrations. Understanding properties of these aberrations is important both for instrument design and image restoration method development. Because the point-spread function can reflect performance of the whole optic system, it is appropriate to use the point-spread function to describe atmospheric turbulence induced aberrations. Assuming point-spread functions induced by the atmospheric turbulence with the same profile belong to the same manifold space, we propose a nonparametric point-spread function—PSF–NET. The PSF–NET has a cycle convolutional neural network structure and is a statistical representation of the manifold space of PSFs induced by the atmospheric turbulence with the same profile. Testing the PSF–NET with simulated and real observation data, we find that a well trained PSF–NET can restore any short exposure images blurred by atmospheric turbulence with the same profile. Besides, we further use the impulse response of the PSF–NET, which can be viewed as the statistical mean PSF, to analyze interpretation properties of the PSF–NET. We find that variations of statistical mean PSFs are caused by variations of the atmospheric turbulence profile: as the difference of the atmospheric turbulence profile increases, the difference between statistical mean PSFs also increases. The PSF–NET proposed in this paper provides a new way to analyze atmospheric turbulence induced aberrations, which would benefit the development of new observation methods for ground-based optical telescopes.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Time Distribution Analysis for Task Primitives to Support Dynamic Human Reliability Analysis

To support data collection for dynamic human reliability analysis (HRA), this study investigates time distributions for task primitives defined in the Goals, Operators, Methods, and Selection rules (GOMS)–Human Reliability Analysis (HRA) method and Human Reliability data EXtraction (HuREX). GOMS-HRA was developed to provide cognition-based time and human error probability (HEP) information for dynamic HRA calculations within the Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) framework, while HuREX is a comprehensive HRA data collection method developed by the Korea Atomic Energy Research Institute (KAERI). In this paper, we examine time distributions by using experimental data collected from the Simplified Human Error Experimental Program (SHEEP) study, which proposes an HRA data collection framework to complement full-scope simulator research and gather input data for dynamic HRA by using simplified simulators such as the Rancor Microworld simulator. This paper investigates whether the time required for GOMS-HRA and HuREX task primitives fits 13 statistical distributions. Additionally, we compare and discuss the time distributions obtained from both student operators and professional operators. The result was that this study identified several time distributions for five GOMS-HRA and four HuREX task primitives. In the future, the results of this study are expected to provide objective reference data on the elapsed time for task primitives and aid in realistically simulating scenarios within dynamic HRA.

Dynamic Human Reliability Analysis↗
DOE OSTI2020

Reconstruction of effective potential from statistical analysis of dynamic trajectories

The broad incorporation of microscopic methods is yielding a wealth of information on the atomic and mesoscale dynamics of individual atoms, molecules, and particles on surfaces and in open volumes. Analysis of such data necessitates statistical frameworks to convert observed dynamic behaviors to effective properties of materials. Here, we develop a method for the stochastic reconstruction of effective local potentials solely from observed structural data collected from molecular dynamics simulations (i.e., data analogous to those obtained via atomically resolved microscopies). Using the silicon vacancy defect in graphene as a model, we apply the statistical framework presented herein to reconstruct the free energy landscape from the calculated atomic displacements. Evidence of consistency between the reconstructed local potential and the trajectory data from which it was produced is presented, along with a quantitative assessment of the uncertainty in the inferred parameters.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2025

Exploring HOD-dependent systematics for the DESI 2024 Full-Shape galaxy clustering analysis

We analyze the robustness of the DESI 2024 cosmological inference from the full shape of the galaxy power spectrum to uncertainties in the Halo Occupation Distribution (HOD) model of the galaxy-halo connection and the choice of priors on nuisance parameters. We assess variations in the recovered cosmological parameters across a range of mocks populated with different HOD models and find that shifts are often greater than 20% of the expected statistical uncertainties from the DESI data. We encapsulate the effect of such shifts in terms of a systematic covariance term, C HOD , and an additional diagonal contribution quantifying the impact of our choice of nuisance parameter priors on the ability of the effective field theory (EFT) model to correctly recover the cosmological parameters of the simulations. These two covariance contributions are designed to be added to the usual covariance term, C stat , describing the statistical uncertainty in the power spectrum measurement, in order to fairly represent these sources of systematic uncertainty. This novel approach should be more general and robust to the choice of model or additional external datasets used in cosmological fits than the alternative approach of adding systematic uncertainties to the recovered marginalised parameter posteriors. We compare the approaches within the context of a fixed ΛCDM model and demonstrate that our method gives conservative estimates of the systematic uncertainty that nevertheless have little impact on the final posteriors obtained from DESI data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

VALIDATION, VERIFICATION, AND CALIBRATION THROUGH A CAUSAL LENS

This paper presents an alternative method based on causal inference to perform validation, verification, and calibration of simulation models. While classical validation and verification approaches focus on the identification of the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on the identification of causal relationships between data elements. Statistical and machine learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between datasets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, then the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles it is known as a directed acyclic graph (DAG). A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and from experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts have a means to identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗