Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Covariance Matrix”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Data compression and covariance matrix inspection: Cosmic shear

Covariance matrices are among the most difficult pieces of end-to-end cosmological analyses. In principle, for two-point functions, each component involves a four-point function, and the resulting covariance often has hundreds of thousands of elements. We investigate various compression mechanisms capable of vastly reducing the size of the covariance matrix in the context of cosmic shear statistics. This helps identify which of its parts are most crucial to parameter estimation. We start with simple compression methods, by isolating and “removing” 200 modes associated with the lowest eigenvalues, then those with the lowest signal-to-noise ratio, before moving on to more sophisticated schemes like compression at the tomographic level and, finally, with the massively optimized parameter estimation and data compression (MOPED). We find that, while most of these approaches prove useful for a few parameters of interest, like Ω m , the simplest yield a loss of constraining power on the intrinsic alignment (IA) parameters as well as S 8 . For the case considered—cosmic shear from the first year of data from the Dark Energy Survey—only MOPED was able to replicate the original constraints in the 16-parameter space. Finally, we apply a tolerance test to the elements of the compressed covariance matrix obtained with MOPED and confirm that the IA parameter A IA is the most susceptible to inaccuracies in the covariance matrix.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

The parameter-level performance of covariance matrix conditioning in cosmic microwave background data analyses

Empirical estimates of the band power covariance matrix are commonly used in cosmic microwave background (CMB) power spectrum analyses. While this approach easily captures correlations in the data, noise in the resulting covariance estimate can systematically bias the parameter fitting. Conditioning the estimated covariance matrix, by applying prior information on the shape of the eigenvectors, can reduce these biases and ensure the recovery of robust parameter constraints. In this work, we use simulations to benchmark the performance of four different conditioning schemes, motivated by contemporary CMB analyses. The simulated surveys measure the TT, TE, and EE power spectra over the angular multipole range 300 ≤ ℓ ≤ 3500 in Δℓ = 50 wide bins, for temperature map-noise levels of 10, 6.4, and $2\, \mu$K arcmin. We divide the survey data into N real = 30, 50, or 100 uniform subsets. We show the results of different conditioning schemes on the errors in the covariance estimate, and how these uncertainties on the covariance matrix propagate to the best-fitting parameters and parameter uncertainties. The most significant effect we find is an additional scatter in the best-fitting point, beyond what is expected from the data likelihood. For a minimal conditioning strategy, N real = 30, and a temperature map-noise level of 10$\, \mu$K arcmin, we find the uncertainty on the recovered best-fitting parameter to be ×1.3 larger than the apparent posterior width from the likelihood (×1.2 larger than the uncertainty when the true covariance is used). Stronger priors on the covariance matrix reduce the misestimation of parameter uncertainties to $\lt 1{{\ \rm per\ cent}}$. As expected, empirical estimates perform better with higher N real , ameliorating the adverse effects on parameter constraints.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Posterior Covariance Matrix Approximations

Here, the Davis equation of state (EOS) is commonly used to model thermodynamic relationships for high explosive (HE) reactants. Typically, the parameters in the EOS are calibrated, with uncertainty, using a Bayesian framework and Markov Chain Monte Carlo (MCMC) methods. However, MCMC methods are computationally expensive, especially for complex models with many parameters. This paper provides a comparison between MCMC and less computationally expensive Variational methods (Variational Bayesian and Hessian Variational Bayesian) for computing the posterior distribution and approximating the posterior covariance matrix based on heterogeneous experimental data. All three methods recover similar posterior distributions and posterior covariance matrices. This study demonstrates that for this EOS parameter calibration application, the assumptions made in the two Variational methods significantly reduce the computational cost but do not substantially change the results compared to MCMC.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

PISCES two-detector covariance matrix fit for the NOvA Experiment

NOvA is a long-baseline neutrino oscillation experiment with two functionally identical detectors: a Near Detector (ND) at Fermilab, placed 1 km from the neutrino source, and a Far Detector (FD) located 810 km away from the ND in Minnesota. NOvA's primary physics goals are the precise measurements of neutrino oscillation parameters $\theta_{23}$ and $\Delta m^2_{32}$ , determine the neutrino mass ordering, and constrain the value of $\delta_{CP}$, via the study of muon neutrino to electron neutrino oscillation. In the standard NOvA three-flavor analysis, oscillation parameters are extracted using an extrapolation technique in which the ND data constrain the FD prediction through a ratio method. While this allows for systematic uncertainties sharing the same effects in both detectors to cancel, it remains an FD-only fit and does not fully leverage the constraining power of the high-statistics ND. This analysis proposes a simultaneous ND+FD fit using the PISCES method. PISCES (Parameter Inference with Systematic Covariance and Exact Statistics) is a framework designed to support complex configurations such as a joint ND+FD fit. This allows PISCES to take full advantage of the ND data to directly constrain systematic uncertainties across all samples. In PISCES, systematic uncertainties are encoded in a fractional covariance matrix, and statistical uncertainties are handled with a Poisson likelihood, making the approach well suited for low-statistics samples. For interpretability, we further use a Newton–Raphson + PCA method to recover per-systematic pulls from the covariance formulation. This poster presents the full PISCES joint ND+FD fit for the NOvA three-flavor analysis, describes its implementation and evaluates its performance through extensive robustness tests and fake data studies. It also provides a comparison between the PISCES joint ND+FD results and the standard NOvA extrapolation method.

Rajaoalisoa, Miriama [Cincinnati U.] (ORCID:000000↗
DOE OSTI2024

Physics-informed Estimation of the Covariance Matrix for Various Neutron Spectra

A method for estimating covariance matrices which capture the uncertainties in calculated reactor spectra has been developed. This method is based on perturbing the parameters of a physics-based analytic model fitted to a calculated spectrum. The covariance of the perturbed analytic spectra imposes energy-dependent correlations due to the physics of the neutron processes in the reactor, i.e., a fission component, a 1/E down-scatting component, and a thermal Maxwellian component. An analytic model is developed which is shown to produce good fits to several reactor environments. The covariance matrices produced via this method are then used as the prior spectrum in STAYSL least squares spectrum adjustment where it is combined with integral metrics, such as activation measurements, to produce a high-fidelity neutron spectrum characterization. It was concluded that the methodology showed agreeable results for the ACRR free-field spectrum adjustment in STAYSL resulting in a 𝜒 2 value of 2.21 (per degree of freedom), but further work is needed to describe scattering and interface regions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Variance-Reduced Accelerated First-Order Methods: Central Limit Theorems and Confidence Statements

In this paper, we consider a strongly convex stochastic optimization problem and propose three classes of variable sample-size stochastic first-order methods: (i) the standard stochastic gradient descent method, (ii) its accelerated variant, and (iii) the stochastic heavy-ball method. In each scheme, the exact gradients are approximated by averaging across an increasing batch size of sampled gradients. We prove that when the sample size increases at a geometric rate, the generated estimates converge in mean to the optimal solution at an analogous geometric rate for schemes (i)–(iii). Based on this result, we provide central limit statements, whereby it is shown that the rescaled estimation errors converge in distribution to a normal distribution with the associated covariance matrix dependent on the Hessian matrix, the covariance of the gradient noise, and the step length. If the sample size increases at a polynomial rate, we show that the estimation errors decay at a corresponding polynomial rate and establish the associated central limit theorems (CLTs). Under certain conditions, we discuss how both the algorithms and the associated limit theorems may be extended to constrained and nonsmooth regimes. As a result, we provide an avenue to construct confidence regions for the optimal solution based on the established CLTs and test the theoretical findings on a stochastic parameter estimation problem.

Lei, Jinlong↗
DOE OSTI2022

Comparison of the Baseline USL Calculation Methods for Loosely-Coupled and Novel Neutronic Systems [Slides]

Current work includes reconstructing 187-group ENDF B/VII.1 covariance matrix for comparison study to 44-group ENDF B/VII.1 matrix to determine how covariance matrix structures affect the USL calculations and investigating the exact domination mechanism of region-wise sensitivities in a loosely-coupled system. Future work will involve seeking to understand how bias distributions change with reactivity and how to calculate propagate distribution error into USL calculations, as well as how cross section perturbation studies can be extended to other types of calculations, such as shielding calculations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Fast matrix algebra for Bayesian model calibration

In Bayesian model calibration, evaluation of the likelihood function usually involves finding the inverse and determinant of a covariance matrix. When Markov Chain Monte Carlo (MCMC) methods are used to sample from the posterior, hundreds of thousands of likelihood evaluations may be required. In this paper, we demonstrate that the structure of the covariance matrix can be exploited, leading to substantial time savings in practice. Here, we also derive two simple equations for approximating the inverse of the covariance matrix in this setting, which can be computed in near-quadratic time. The practical implications of these strategies are demonstrated using a simple numerical case study and the "quack" R package. For a covariance matrix with 1000 rows, application of these strategies for a million likelihood evaluations leads to a speedup of roughly 4000 compared to the naive implementation

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Noise and error analysis and optimization in particle-based kinetic plasma simulations

In this paper we analyze the noise in macro-particle methods used in plasma physics and fluid dynamics, leading to approaches for minimizing the total error, focusing on electrostatic models in one dimension. We begin by describing kernel density estimation for continuous values of the spatial variable x, expressing the kernel in a form in which its shape and width are represented separately. The covariance matrix of the noise in the density is computed, first for uniform true density. The bandwidth of the covariance matrix C(x,y) is related to the width of the kernel. A feature that stands out is the presence of constant negative terms in the elements of the covariance matrix both on and off-diagonal. These negative correlations are related to the fact that the total number of particles is fixed at each time step; they also lead to the property ∫C(x,y)dy = 0. We investigate the effect of these negative correlations on the electric field computed by Gauss's law, finding that the noise in the electric field is related to a process called the Ornstein-Uhlenbeck bridge, leading to a covariance matrix of the electric field with variance significantly reduced relative to that of a Brownian process. For non-constant density, p(x), still with continuous x, we analyze the total error in the density estimation and discuss it in terms of bias-variance optimization (BVO). For some characteristic length l, determined by the density and its second derivative, and kernel width h, having too few particles within h leads to too much variance; for h that is large relative to l, there is too much smoothing of the density. The optimum between these two limits is found by BVO. For kernels of the same width, it is shown that this optimum (minimum) is weakly sensitive to the kernel shape. Next, we repeat the analysis for x discretized on a grid. In this case the charge deposition rule is determined by a particle shape. An important property to be respected in the discrete system is the exact preservation of total charge on the grid; this property is necessary to ensure that the electric field is equal at both ends, consistent with periodic boundary conditions. We find that if the particle shapes satisfy a partition of unity property, the particle charge deposited on the grid is conserved exactly. Further, if the particle shape is expressed as the convolution of a kernel with another kernel that satisfies the partition of unity, then the particle shape obeys the partition of unity. This property holds for kernels of arbitrary width, including widths that are not integer multiples of the grid spacing. Furthermore, we show results relaxing the approximations used to do BVO optimization analytically, by doing numerical computations of the total error as a function of the kernel width, on a grid in x. The comparison between numerical and analytical results shows good agreement over a range of particle shapes. We discuss the practical implications of our results, including the criteria for design and implementation of computationally efficient particle shapes that take advantage of the developed theory.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Mitigating baryonic effects with a theoretical error covariance

ABSTRACT One of the primary sources of uncertainties in modelling the cosmic-shear power spectrum on small scales is the effect of baryonic physics. Accurate cosmology for stage-IV surveys requires knowledge of the matter power spectrum deep in the non-linear regime at the per cent level. Therefore, it is important to develop reliable mitigation techniques to take into account baryonic uncertainties if information from small scales is to be considered in the cosmological analysis. In this work, we develop a new mitigation method for dealing with baryonic physics for the case of the shear angular power spectrum. The method is based on an augmented covariance matrix that incorporates baryonic uncertainties informed by hydrodynamical simulations. We use the results from 13 hydrodynamical simulations and the residual errors arising from a fit to a ΛCDM model using the extended halo model code HMCode to account for baryonic physics. These residual errors are used to model a so-called theoretical error covariance matrix that is added to the original covariance matrix. In order to assess the performance of the method, we use the 2D tomographic shear from four hydrodynamical simulations that have different extremes of baryonic parameters as mock data and run a likelihood analysis comparing the residual bias on Ωm and σ8 of our method and the HMCode for an LSST-like survey. We use different modelling of the theoretical error covariance matrix to test the robustness of the method. We show that it is possible to reduce the bias in the determination of the tested cosmological parameters at the price of a modest decrease in the precision.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

$\bar{\nu}_\mu$ charged-current $\pi^0$ data release

Data release for the NOvA muon antineutrino charged-current (CC) pi^0 cross section presented in arXiv:2511.05807. The signal for this analysis is defined as muon antineutrino CC interactions in the fiducial volume of the NOvA near detector (a 2.7 m × 2.7 m × 9.0 m region) that produce at least one pi^0 in the final state emerging from the nucleus, within the phase space of muon momentum [0.5, 2.5) GeV/c and muon angle [0, 60) degree, as described in arXiv:2511.05807. The released zip file contains two files: NOvA_NumubarCCPi0_DataRelease.root README.txt The ROOT file includes the cross-section results as well as the statistical and systematic covariance matrices for each variable used in this analysis. The README provides a detailed description of the contents of the data release. Official Flux: The flux used in this analysis is available from the NOvA Public Docs: https://publicdocs.fnal.gov/cgi-bin/ShowDocument?docid=8. File structure --- The ROOT file contains the following TDirectories: pi0p - pi^0 momentum distributions pi0dir - pi^0 angular distributions muonp - muon momentum distributions muondir - muon angular distributions Q2 - reconstructed Q^2 distributions Wmass - reconstructed W_mass distributions Each directory contains three histograms: xsec (TH1D): Cross section result cov_stat (TH2D): Statistical covariance matrix cov_syst (TH2D): Systematic covariance matrix Usage notes: - xsec gives the measured differential cross section w.r.t. the corresponding variable. - cov_stat and cov_syst provide the full covariance matrices. - The bin definitions and kinematic phase spaces follow those used in arXiv:2511.05807. Citation --- If you use these data, please cite: NOvA Collaboration, arXiv:2511.05807.

Wu, Wanwei [Pittsburgh U.] (ORCID:0000000326327215↗
DOE OSTI2026

Parity-odd four-point correlation function from the DESI data release 1 luminous red galaxy sample

The parity-odd four-point function provides a unique probe of fundamental symmetries and potential new physics in the large-scale structure of the Universe. We present measurements of the parity-odd four-point function using the Dark Energy Spectroscopic Instrument (DESI) DR1 luminous red galaxy (LRG) sample and assess its detection significance. Our analysis considers both auto- and cross-correlations, using two complementary approaches to the covariance: (i) the full analytic covariance matrix applied to the uncompressed data vector, and (ii) a compressed data vector combined with a hybrid covariance matrix constructed from simulations and analytic estimates. When using the full analytic covariance matrix without corrections, we observe apparent auto-correlation signals with significance up to 4⁢𝜎. However, this excess is also consistent with a mismatch between the statistical fluctuations estimated from the simulations and those present in the real data. Our findings therefore suggest that the parity-odd signal in the current DESI DR1 LRG sample is consistent with zero. We note, however, that the low completeness of this sample may have a non-negligible impact on the detection sensitivity. Future data releases with improved completeness will be crucial for further investigation.

Hou, Jiamin [Ludwig-Maximilians-Universität; Unive↗
DOE OSTI2024

Searching for parity violation in SDSS DR16 Lyman-α forest data

The four-point correlation function is the lowest order correlation function for scalar fields that can be used to probe statistical parity invariance in an isotropic universe. There are intriguing claims of detection of parity violation in the 4-point function of BOSS galaxy clustering data. We apply the same estimator to the public SDSS Data Release 16 Lyman-α forest data. Lyman-α forest data probes a different redshift range and is sensitive to a different density regime using a completely different technique. A detection would therefore be a strong indication of new physics. We identify an accurate covariance matrix as a crucial impediment to performing this measurement accurately, consistent with existing literature on galaxy 4-point function. Here, we discuss several approaches to estimating the covariance matrix, several of which produce spurious detection. Using a robust, but very suboptimal, covariance matrix derived from subsample bootstrapping, we find no evidence for parity violation.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Methodology for Generating Covariance Data of Thermal Neutron Scattering Cross Sections

This paper details and implements a framework for evaluating thermal neutron scattering cross sections that provide S(α,β) data and covariance data for hydrogen in light water. This methodology involves perturbing model parameters of molecular dynamics potentials and fitting the simulation results to experimental data. The framework is general and can be applied to any material or simulation method. The fit is made using the Unified Monte Carlo method to experimentally measure double-differential scattering cross sections of light water at the Spallation Neutron Source at Oak Ridge National Laboratory. Mean values and covariance data were generated for model parameters, phonon density of states, double-differential cross sections, and total scattering cross sections. These posterior parameter values were very similar to their prior values with a maximum relative error of 0.54%. This falls within in the Unified Monte Carlo–calculated uncertainties on the order of 2.7%. Additionally, posterior double-differential cross sections agree favorably with ENDF/B-VIII.0 cross sections. The new thermal scattering law was tested by comparing it against benchmarks from the International Criticality Safety Benchmark Evaluation Project Handbook, which showed a slight improvement over the ENDF/B-VIII.0 library. Additionally, the covariance matrix of the phonon density of states was validated to confirm that the spread of k eff from the density of states used to generate the covariance matrix was similar to the spread of k eff from the density of states of the sampled covariance matrix.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Noise from undetected sources in Dark Energy Survey images

ABSTRACT For ground-based optical imaging with current CCD technology, the Poisson fluctuations in source and sky background photon arrivals dominate the noise budget and are readily estimated. Another component of noise, however, is the signal from the undetected population of stars and galaxies. Using injection of artifical galaxies into images, we demonstrate that the measured variance of galaxy moments (used for weak gravitational lensing measurements) in Dark Energy Survey (DES) images is significantly in excess of the Poisson predictions, by up to 30 per cent, and that the background sky levels are overestimated by current software. By cross-correlating distinct images of ‘empty’ sky regions, we establish that there is a significant image noise contribution from undetected static sources (US), which, on average, are mildly resolved at DES resolution. Treating these US as a stationary noise source, we compute a correction to the moment covariance matrix expected from Poisson noise. The corrected covariance matrix matches the moment variances measured on the injected DES images to within 5 per cent. Thus, we have an empirical method to statistically account for US in weak lensing measurements, rather than requiring extremely deep sky simulations. We also find that local sky determinations can remove most of the bias in flux measurements, at a small penalty in additional, but quantifiable, noise.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗