Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Covariance and correlation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Semi-analytical covariance matrices for two-point correlation function for DESI 2024 data

We present an optimized way of producing the fast semi-analytical covariance matrices for the Legendre moments of the two-point correlation function, taking into account survey geometry and mimicking the non-Gaussian effects. We validate the approach on simulated (mock) catalogs for different galaxy types, representative of the Dark Energy Spectroscopic Instrument (DESI) Data Release 1, used in 2024 analyses. We find only a few percent differences between the mock sample covariance matrix and our results, which can be expected given the approximate nature of the mocks, although we do identify discrepancies between the shot-noise properties of the DESI fiber assignment algorithm and the faster approximation (emulator) used in the mocks. Importantly, we find a close agreement (≤ 8% relative differences) in the projected errorbars for distance scale parameters for the baryon acoustic oscillation measurements. This confirms our method as an attractive alternative to simulation-based covariance matrices, especially for non-standard models or galaxy sample selections, making it particularly relevant to the broad current and future analyses of DESI data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Proof-of-concept chemometric approach for environmental forensic sourcing of crude oil samples using SPME-GC-MS

Environmental exposure to crude oil through seepage and spillage poses risks to the immediate environment and the broader ecosystem as areas along the oil distribution path are affected by the influx of crude petroleum as well as the environmental, economic, and civil unrest that accompanies it. There is a large financial burden associated with the lost resources, including the cost of rehabilitation, and the affected sources of revenue for communities affected by oil spills. As such, it is crucial to determine the responsible parties. This work outlines an environmental forensics approach to determining the source of an un-weathered crude oil sample. The researchers employed solid phase microextraction coupled with gas chromatography mass spectrometry (SPME-GC-MS) to capture and analyze the gaseous components emitted by crude oil samples sourced from five locations. Samples were analyzed using Spearman's rank correlation and 3D covariance analysis. Both chemometric approaches yielded optimal performance results with no misclassifications, true positive rate (TPR) = 100 % and false positive rate (FPR) = 0 %. The similarity metrics calculated by each test noted clear delineations between the values of same-source and differently sourced samples. The Spearman's rank correlation test and 3D covariance calculations both demonstrated the ability to correctly identify sample source origin in this dataset. Finally, the authors outline an approach to the future application of these tests and suggest their joint use in future crude oil sourcing endeavors.

3D covariance mapping↗
DOE OSTI2026

An analytic approximation to the covariance between pre- and post-reconstruction galaxy two-point statistics

We present a simple analytic approximation for the covariance between pre-reconstruction galaxy power spectrum measurements and post-reconstruction two-point correlation functions. This cross-covariance is essential for joint analyses that combine full-shape clustering information with baryon acoustic oscillation (BAO) measurements, as commonly performed in modern spectroscopic surveys. Our model builds on the disconnected contribution to the covariance and accounts for the damping of correlations due to the BAO reconstruction process. We validate our analytic prescription against numerical simulations from the Dark Energy Spectroscopic Instrument (DESI), testing both idealized cubic geometries and realistic survey configurations including complex footprints and fiber assignment effects. Despite neglecting survey window functions in the analytic calculation, we find excellent agreement with simulation-based covariances and demonstrate that cosmological parameter constraints are virtually unchanged when using our approximation. Our results show that the pre-post cross-covariance is sufficiently small that even approximate treatments are adequate for cosmological inference, opening a pathway toward fully analytic covariance matrices for next-generation galaxy surveys.

baryon acoustic oscillations↗
DOE OSTI2025

DESI-DR1 $3 \times 2$-pt analysis: consistent cosmology across weak lensing surveys

We present a joint cosmological analysis of projected galaxy clustering observations from the Dark Energy Spectroscopic Instrument Data Release 1 (DESI-DR1), and overlapping weak gravitational lensing observations from three datasets: the Kilo-Degree Survey (KiDS-1000), the Dark Energy Survey (DES-Y3), and the Hyper-Suprime-Cam Survey (HSC-Y3). This combination of large-scale structure probes allows us to measure a set of $3 \times 2$-pt correlation functions, breaking the degeneracies between parameters in cosmological fits to individual observables. We obtain mutually-consistent constraints on the parameter $S_8 = σ_8 \sqrt{Ω_{\rm m}/0.3} = 0.786^{+0.022}_{-0.019}$ from the combination of DESI-DR1 and DES-Y3, $S_8 = 0.760^{+0.020}_{-0.018}$ from KiDS-1000, and $S_8 = 0.771^{+0.026}_{-0.027}$ from HSC-Y3. These parameter determinations are consistent with fits to the Planck Cosmic Microwave Background dataset, albeit with $1.5-2σ$ lower values in the $S_8-Ω_{\rm m}$ plane. We perform our analysis with a unified pipeline tailored to the requirements of each cosmic shear survey, which self-consistently determines cosmological and astrophysical parameters. We generate an analytical covariance matrix for the correlation data including all cross-covariances between probes, and we design a new blinding procedure to safeguard our analysis against confirmation bias, whilst leaving goodness-of-fit statistics unchanged. Our study is part of a suite of papers that present joint cosmological analyses of DESI-DR1 and weak gravitational lensing datasets.

Porredon, A. [Madrid, CIEMAT; Edinburgh U., Inst. ↗
DOE OSTI2025

Covariance operator estimation via adaptive thresholding

This paper studies sparse covariance operator estimation for nonstationary processes with sharply varying marginal variance and small correlation lengthscale. We introduce a covariance operator estimator that adaptively thresholds the sample covariance function using an estimate of the variance component. Building on recent results from empirical process theory, we derive an operator norm bound on the estimation error in terms of the sparsity level of the covariance and the expected supremum of a normalized process. Furthermore, our theory and numerical simulations demonstrate the advantage of adaptive threshold estimators over universal threshold and sample covariance estimators in nonstationary settings.

Al-Ghattas, Omar [University of Chicago, IL (Unite↗
DOE OSTI2026

Eddy Correlation Flux Measurement System (ECOR) Instrument Handbook

The eddy correlation (ECOR) flux measurement system provides in situ, half-hour measurements of surface turbulent fluxes of momentum, sensible heat, latent heat, and carbon dioxide (CO 2 ) at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) User Facility sites. ARM’s ECORs also historically measured methane fluxes at Utqiaġvik and Oliktok Point, Alaska. The fluxes are obtained with the eddy covariance technique, which involves correlation of the vertical wind component with the horizontal wind component, the air temperature, the water vapor density, and the CO 2 concentration.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Eddy Correlation Flux Measurement System (ECOR) Instrument Handbook

The eddy correlation (ECOR) flux measurement system provides in situ, half-hour measurements of the surface turbulent fluxes of momentum, sensible heat, latent heat, and carbon dioxide (CO 2 ) (and methane at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility’s North Slope of Alaska central facility [NSA Barrow], and at the ARM Mobile Facility (AMF) deployment at Oliktok Point). The fluxes are obtained with the eddy covariance technique, which involves correlation of the vertical wind component with the horizontal wind component, the air temperature, the water vapor density, and the CO 2 concentration. The instruments used are: a fast-response, three-dimensional (3D) wind sensor (sonic anemometer) to obtain the orthogonal wind components and the speed of sound (SOS) (used to derive the air temperature), an open-path infrared gas analyzer (IRGA) to obtain the water vapor density and the CO 2 concentration, and an open-path infrared gas analyzer (IRGA) to obtain methane density and methane flux at NSA Barrow and at the AMF deployment at Oliktok Point. The ECOR systems are deployed at the locations where other methods for surface flux measurements (e.g., energy balance Bowen ratio [EBBR] systems) are difficult to employ, primarily at the north edge of a field of crops. A surface energy balance system (SEBS) has been installed collocated with each deployed ECOR system in SGP, NSA, Tropical Western Pacific (TWP), and each of three ARM Mobile Facilities. The surface energy balance system consists of upwelling and downwelling solar and infrared radiometers within one net radiometer, a wetness sensor, and soil measurements. Finally, the SEBS measurements allow the comparison of ECOR sensible and latent heat fluxes with the energy balance determined from the SEBS and provide information on wetting of the sensors for data quality purposes.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Dynamical correlation between ions in liquid seen in real space and time

Controlling ionic transport in liquids is anticipated to provide new scientific and technological opportunities, but it requires accurate knowledge of atomic-scale dynamics of ions beyond the hydrodynamic description. Atomic dynamics in liquids is characterized by strong and dynamical correlations among atoms, which render a conventional approach to describing the dynamics in reciprocal space challenging. We propose an alternative approach to describe liquid dynamics in real space and time using the time-delayed two-body correlation function, Van Hove correlation function, and discuss recent results on the local dynamics in water and electrolytes.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2026

Parity-odd four-point correlation function from the DESI data release 1 luminous red galaxy sample

The parity-odd four-point function provides a unique probe of fundamental symmetries and potential new physics in the large-scale structure of the Universe. We present measurements of the parity-odd four-point function using the Dark Energy Spectroscopic Instrument (DESI) DR1 luminous red galaxy (LRG) sample and assess its detection significance. Our analysis considers both auto- and cross-correlations, using two complementary approaches to the covariance: (i) the full analytic covariance matrix applied to the uncompressed data vector, and (ii) a compressed data vector combined with a hybrid covariance matrix constructed from simulations and analytic estimates. When using the full analytic covariance matrix without corrections, we observe apparent auto-correlation signals with significance up to 4⁢𝜎. However, this excess is also consistent with a mismatch between the statistical fluctuations estimated from the simulations and those present in the real data. Our findings therefore suggest that the parity-odd signal in the current DESI DR1 LRG sample is consistent with zero. We note, however, that the low completeness of this sample may have a non-negligible impact on the detection sensitivity. Future data releases with improved completeness will be crucial for further investigation.

Hou, Jiamin [Ludwig-Maximilians-Universität; Unive↗
DOE OSTI2024

Fermionic mean-field theory as a tool for studying spin Hamiltonians

The Jordan–Wigner transformation permits one to convert spin 1/2 operators into spinless fermion ones, or vice versa. In some cases, it transforms an interacting spin Hamiltonian into a noninteracting fermionic one, which is exactly solved at the mean-field level. Even when the resulting fermionic Hamiltonian is interacting, its mean-field solution can provide surprisingly accurate energies and correlation functions. Furthermore, Jordan–Wigner is, however, only one possible means of interconverting spin and fermionic degrees of freedom. Here, we apply several such techniques to the XXZ and J 1 –J 2 Heisenberg models, as well as to the pairing or reduced Bardeen–Cooper–Schrieffer Hamiltonian, with the aim of discovering which of these mappings is most useful in applying fermionic mean-field theory to the study of spin Hamiltonians.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Evolution of intermittent filaments in the scrape-off layer of NSTX

Filamentary structures naturally arise from background turbulence in the scrape-off layer (SOL) of plasmas, leading to significant particle and heat transport that can degrade overall plasma confinement. This enhanced transport can contribute to unacceptably high heat loads on plasma-facing components. As such, understanding the physics of SOL plasma filaments is critical for predicting and mitigating their effects in future fusion devices. On the National Spherical Torus Experiment (NSTX), plasma filaments—commonly referred to as “blobs”—were investigated using the gas-puff imaging (GPI) diagnostic in the edge and SOL regions. The analysis involved identifying, segmenting, and tracking the characteristic contours of the blobs in each frame of the GPI video sequences. Their evolution was characterized through shape descriptors, velocity, and angular velocity derived from their contour coordinates. The results indicate that as the blob area increases, their shapes become more concave and less circular, suggesting reduced structural stability in larger blobs. This result aligns with previous theoretical results where it was shown that larger blobs are more susceptible to instabilities [Krasheninnikov et al., J. Plasma Phys. 74, 679–717 (2008) and D'Ippolito et al., Phys. Plasmas 18, 060501 (2011)]. A positive correlation was observed between radial velocity and radial position, suggesting radially outward acceleration of the filaments, potentially driven by decreasing viscous drag toward the far SOL. Interestingly, blobs in background SOL turbulence exhibited minimal spinning in contrast to filaments originating from edge localized modes, which show substantial rotation during their paths [Lampert et al., Phys. Plasmas 29, 102502 (2022)]. Statistical analysis of the solidity and total curvature shape descriptors, along with their temporal evolution, revealed relatively broad, near-Gaussian distributions. This suggests that blob morphology is strongly influenced by stochastic turbulent processes in the surrounding plasma environment. Blob parameters were also compared with bulk plasma and radial profile measurements. Notable trends were found between blob rotation and poloidal velocity with collisionality and line-integrated density. These findings contribute to a deeper understanding of blob dynamics and provide valuable insights for refining SOL turbulence models.

Covariance and correlation↗
DOE OSTI2026

Correlation function metrology for warm dense matter: Recent developments and practical guidelines

X-ray Thomson scattering (XRTS) has emerged as a valuable diagnostic for matter under extreme conditions, as it captures the intricate many-body physics of the probed sample. Recent advances, such as the model-free temperature diagnostic of Dornheim et al. [Nat. Commun. 13 , 7911 (2022)], have demonstrated how much information can be extracted directly within the imaginary-time formalism. However, since the imaginary-time formalism is a concept often difficult to grasp, we provide here a systematic overview of its theoretical foundations and explicitly demonstrate its practical applications to temperature inference, including relevant subtleties. Furthermore, we present recent developments that enable the determination of the absolute normalization, Rayleigh weight, and density from XRTS measurements without reliance on uncontrolled model assumptions. Finally, we outline a unified workflow that guides the extraction of these key observables, offering a practical framework for applying the method to interpret experimental measurements.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Allosteric prediction via convolutional neural networks and protein structural and dynamical features

Allostery is the phenomenon whereby a binding event or covalent modification at one site in a protein modulates function at a distal site, thus changing a protein’s functional state. As such, it is a ubiquitous aspect of protein functional regulation. Computationally predicting allosteric states is important as part of the broader challenge of functional annotation, but it also has practical implications for drug development, as targeting an allosteric site often affords greater specificity compared with targeting an orthosteric site. This study introduces a machine learning approach to predict the allosteric functional state using the small G-protein KRas as the model system, due to its implication in many types of cancer and being well studied as a result with many x-ray crystallographic structures of KRas available with different mutations and ligands bound. Using structural and dynamical features that can be cast as images, namely interatomic distances, contact maps, covariance, and mutual information, supervised learning was performed using convolutional neural networks. Two pretrained convolutional neural network architectures, GoogLeNet and ResNet18, were fine-tuned to classify KRas into active or inactive states based on these features. Across training regimes, atomic contact maps emerged as the most effective structural feature, whereas linearized mutual information outperformed covariance in capturing dynamical correlations relevant to allostery. Models achieved significant validation accuracy, with atomic contact maps yielding up to 90% accuracy. In conclusion, the findings suggest that integrating global structural rearrangements and correlated motion patterns with deep learning can reliably predict protein allosteric states, offering a promising framework for understanding allosteric regulation and developing targeted therapeutics.

Rajeshwar T., Rajitha [Oak Ridge National Laborato↗
DOE OSTI2025

Active deep kernel learning of molecular properties from structural embeddings

As vast databases of chemical identities become increasingly available, the challenge shifts to how we effectively explore and leverage these resources to study molecular properties. This paper presents an active learning approach for molecular discovery using deep kernel learning (DKL), demonstrated on the QM9 dataset. DKL links structural embeddings directly to properties, creating organized latent spaces that prioritize relevant property information. By iteratively recalculating embedding vectors in alignment with target properties, DKL uncovers concentrated maxima representing key molecular properties and reveals unexplored regions with potential for innovation. This approach underscores DKL’s potential in advancing molecular research and discovery.

Artificial neural networks↗