Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “covariance and correlation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
NASA NTRS2010

Interactions of Ku70/80 with Double-Strand DNA: Energetic, Dynamics, and Functional Implications

Space radiation is a proficient inducer of DNA damage leading to mutation, aberrant cell signaling, and cancer formation. Ku is among the first responding proteins in nucleus to recognize and bind the DNA double strand breaks (DSBs) whenever they are introduced. Once loaded Ku works as a scaffold to recruit other repair factors of non-homologous end joining and facilitates the following repair processes. The crystallographic study of the Ku70/80 heterodimer indicate the core structure of this protein shows virtually no conformational change after binding with DNA. To investigate the dynamical features as well as the energetic characteristics of Ku-DNA binding, we conduct multi-nanosecond molecular dynamics simulations of a modeled Ku70/80 structure and several complexes with two 24-bp DNA duplexes. Free energy calculations show significant energy differences between the complexes with Ku bound at DSBs and those with Ku associated at an internal site of a chromosome. The results also reveal detailed interactions between different nucleotides and the amino acids along the DNA-binding cradle of Ku, indicating subtle binding preference of Ku at specific DNA sequences. The covariance matrix analyses along the trajectories demonstrate the protein is stimulated to undergo correlated motions of different domains once bound to DNA ends. Additionally, principle component analyses identify these low frequency collective motions suitable for binding with and translocation along duplex DNA. It is proposed that the modification of dynamical properties of Ku upon binding with DSBs may provide a signal for the further recruitment of other repair factors such as DNA-PKcs, XLF, and XRCC4.

Hu, Shaowen↗
NASA NTRS1994

Suboptimal schemes for atmospheric data assimilation based on the Kalman filter

This work is directed toward approximating the evolution of forecast error covariances for data assimilation. The performance of different algorithms based on simplification of the standard Kalman filter (KF) is studied. These are suboptimal schemes (SOSs) when compared to the KF, which is optimal for linear problems with known statistics. The SOSs considered here are several versions of optimal interpolation (OI), a scheme for height error variance advection, and a simplified KF in which the full height error covariance is advected. To employ a methodology for exact comparison among these schemes, a linear environment is maintained, in which a beta-plane shallow-water model linearized about a constant zonal flow is chosen for the test-bed dynamics. The results show that constructing dynamically balanced forecast error covariances rather than using conventional geostrophically balanced ones is essential for successful performance of any SOS. A posteriori initialization of SOSs to compensate for model - data imbalance sometimes results in poor performance. Instead, properly constructed dynamically balanced forecast error covariances eliminate the need for initialization. When the SOSs studied here make use of dynamically balanced forecast error covariances, the difference among their performances progresses naturally from conventional OI to the KF. In fact, the results suggest that even modest enhancements of OI, such as including an approximate dynamical equation for height error variances while leaving height error correlation structure homogeneous, go a long way toward achieving the performance of the KF, provided that dynamically balanced cross-covariances are constructed and that model errors are accounted for properly. The results indicate that such enhancements are necessary if unconventional data are to have a positive impact.

Todling, Ricardo↗
DOE OSTI2026

Correlation-aware binning for small-angle neutron scattering via Gaussian-process inference

Binning in small-angle neutron scattering (SANS) is typically performed empirically, with fixed parameters chosen for convenience rather than statistical optimality. Such practices often fail to balance statistical precision and spatial resolution, leading to inconsistencies across instruments and datasets. Here we establish a correlation-aware framework that determines the optimal bin width from first principles by extending the classical Freedman–Diaconis (FD) rule to account for inter-bin correlations with a Gaussian process. In this formulation, the scattering intensity is treated as a smooth stochastic field whose statistical coherence is described by a covariance matrix. Analytical expressions of errors derived from this model yield closed-form criteria that separate the total deviation into contributions from counting noise, aliasing distortion and curvature-dependent correlation effects. Expressed in reduced variables, the resulting dimensionless error surface reveals a continuous transition from the uncorrelated FD regime to the correlation-dominated limit, providing a unified description of noise suppression and resolution control. Because the formulation depends only on the profile characteristics of scattering intensity I(Q), specifically its average intensity and first- and second-order derivatives, it applies generally to any SANS measurement regardless of sample, instrument or geometry. Experimental validation using small- and ultra-small-angle neutron scattering data confirms the predicted scaling behavior, demonstrating that correlation-aware inference systematically reduces mean-squared error and enables information-efficient reproducible data reduction across materials and instruments.

Tung, Chi-Huan [ORNL] (ORCID:0000000221972074)↗
DOE OSTI2026

Haze–cloud correlations mediated by supersaturation fluctuations

Atmospheric aerosol particles that contain water-soluble components can absorb water vapor in humid environments and form either haze particles or cloud droplets, depending on supersaturation conditions. Laboratory and in situ measurements have shown that haze particles and cloud droplets often coexist and compete for available water vapor in shallow clouds and fogs, especially under polluted conditions. It is expected that more aerosol particles can form more haze particles and cloud droplets, so that the haze and cloud number concentrations are positively correlated. However, recent large-eddy simulations show that haze and cloud number concentration can be negatively correlated under extremely polluted conditions. Haze–cloud interactions across different environmental settings remain poorly understood. In this study, experiments in a convection cloud chamber with the same aerosol injection rate show that, as supersaturation forcing increases (i.e., changing from polluted to clean conditions), the covariance between haze and cloud droplet number concentration changes from negative to positive and finally to zero. Large-eddy simulations (LES) of the cloud chamber with a fixed supersaturation forcing but varying aerosol injection rates show a similar result for the haze–cloud correlation: near zero in clean, mean-supersaturation-dominated activation conditions; positive in moderate, supersaturation-fluctuation-influenced activation conditions; and negative in polluted, supersaturation-fluctuation-dominated activation conditions. A theoretical covariance framework was developed to interpret this behavior based on the relative magnitude and signs of the correlations between supersaturation and the populations of haze and cloud droplets. Significantly, experiments, LES, and theory all yield the same three-regime behavior for the sign of the haze–cloud covariance. Furthermore, our results show that the haze–cloud covariance remains robust and easily measurable, thereby providing a useful metric for regime identification in the atmosphere, improving regime-aware parameterizations, and informing aerosol interventions such as fog dispersion, rainfall enhancement, and albedo modification.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Vertical dependence of horizontal variation of cloud microphysics: observations from the ACE-ENA field campaign and implications for warm-rain simulation in climate models

Abstract. In the current global climate models (GCMs), the nonlinearity effect of subgrid cloud variations on the parameterization of warm-rain process, e.g., the autoconversion rate, is often treated by multiplying the resolved-scale warm-rain process rates by a so-called enhancement factor (EF). In this study, we investigate the subgrid-scale horizontal variations and covariation of cloud water content (qc) and cloud droplet number concentration (Nc) in marine boundary layer (MBL) clouds based on the in situ measurements from a recent field campaign and study the implications for the autoconversion rate EF in GCMs. Based on a few carefully selected cases from the field campaign, we found that in contrast to the enhancing effect of qc and Nc variations that tends to make EF > 1, the strong positive correlation between qc and Nc results in a suppressing effect that tends to make EF < 1. This effect is especially strong at cloud top, where the qc and Nc correlation can be as high as 0.95. We also found that the physically complete EF that accounts for the covariation of qc and Nc is significantly smaller than its counterpart that accounts only for the subgrid variation of qc, especially at cloud top. Although this study is based on limited cases, it suggests that the subgrid variations of Nc and its correlation with qc both need to be considered for an accurate simulation of the autoconversion process in GCMs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Using heterogeneous data to identify signatures of dengue outbreaks at fine spatio-temporal scales across Brazil

Dengue virus remains a significant public health challenge in Brazil, and seasonal preparation efforts are hindered by variable intra- and interseasonal dynamics. Here, we present a framework for characterizing weekly dengue activity at the Brazilian mesoregion level from 2010–2016 as time series properties that are relevant to forecasting efforts, focusing on outbreak shape, seasonal timing, and pairwise correlations in magnitude and onset. In addition, we use a combination of 18 satellite remote sensing imagery, weather, clinical, mobility, and census data streams and regression methods to identify a parsimonious set of covariates that explain each time series property. The models explained 54% of the variation in outbreak shape, 38% of seasonal onset, 34% of pairwise correlation in outbreak timing, and 11% of pairwise correlation in outbreak magnitude. Regions that have experienced longer periods of drought sensitivity, as captured by the “normalized burn ratio,” experienced less intense outbreaks, while regions with regular fluctuations in relative humidity had less regular seasonal outbreaks. Both the pairwise correlations in outbreak timing and outbreak trend between mesoresgions were best predicted by distance. Our analysis also revealed the presence of distinct geographic clusters where dengue properties tend to be spatially correlated. Forecasting models aimed at predicting the dynamics of dengue activity need to identify the most salient variables capable of contributing to accurate predictions. Our findings show that successful models may need to leverage distinct variables in different locations and be catered to a specific task, such as predicting outbreak magnitude or timing characteristics, to be useful. This advocates in favor of “adaptive models” rather than “one-size-fits-all” models. The results of this study can be applied to improving spatial hierarchical or target-focused forecasting models of dengue activity across Brazil.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Physics-informed Karhunen-Loeve and Neural Network Approximations for Solving Inverse Differential Equation Problems

Here we present the PI-CKL-NN method for parameter estimation in differential equation (DE) models given sparse measurements of the parameters and states. In the proposed approach, the space- or time-dependent parameters are approximated by Karhunen-Loeve (KL) expansions that are conditioned on the parameters’ measurements, and the states are approximated by deep neural networks (DNNs). The unknown weights in the KL expansions and DNNs are found my minimizing the cost function that enforces the measurements of the states the DE constraint. Regularization is achieved by adding the l2 norm of the conditional KL coefficients into the loss function. Our approach assumes that the parameter fields are correlated in space or time and enforces the statistical knowledge (the mean and the covariance function) in addition to the DE constraints and measurements as opposed to the physics-informed neural network (PINN) and other similar physics-informed machine learning methods where only DE constraints and data are used for parameter estimation. We use the PI-CKL-NN method for parameter estimation in an ordinary differential equation with an unknown time-dependent parameter and the one- and two-dimensional partial differential diffusion equations with unknown space-dependent diffusion coefficients. We also demonstrate that PI-CKL-NN is more accurate than the PINN method, especially when the observations of the parameters are very sparse

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

FY21 Progress Report: SRNL Analysis of ICCWR LCM and WAMS data for Corrosion and Cracking

The development of algorithms for machine learning and data analysis for the 3013 Surveillance Program is a collaborative effort by the Savannah River National Laboratory (SRNL) and the University of South Carolina (USC). For corrosion detection, Laser Confocal Microscope (LCM) or Wide Area 3D Measurement System (WAMS) data is extracted from large binary files, with software written to convert the data to physical attributes (e.g., height, color and grayscale values; all as functions of a location in a plane projection). A user-friendly Matlab Graphical User Interface (GUI) that reads data from either LCM or WAMS files was developed to integrate input data with software developed for processing and evaluation. The GUI can selectively download binary data, interrogate data attributes, label data, flag significant features, execute Machine Learning (ML) algorithms, output parameters for trained ML algorithms, report ML model accuracy with respect to labeled data, and generate graphical representations for various analyses. Features can be called out by user-specified thresholds, manual labeling or machine learning algorithms when they have been completed. The ability to rapidly label data is important because of the volume of data required for training machine learning algorithms. The GUI has the flexibility to allow addition of improved ML algorithms, methods for data visualization, and statistical computations. Statistical analyses via the GUI include areas of pits within a defined range of pit depths, correlations between Red-Green-Blue (RGB) or grayscale intensity and relative surface height, covariances between values associated with features, and feature histograms. The development of supervised machine learning algorithms, however, has been hindered by a lack of training data. The machine learning algorithms for crack identification are being refined but require improvements to the true positive rate for crack detection. This shortcoming is an artifact of the limited training data currently available, perhaps more so than the structure of the neural networks. At present, the best results are had from a consensus over an ensemble of randomly generated Deep Neural Network (DNN) or Convolutional Neural Network (CNN) algorithms. Although the consensus accuracy method has yielded optimum true positive and true negative rates in excess of 80%, additional validation testing is necessary. In addition to the suite of LCM data that was initially used, and which represents the majority of the work presented in this report, WAMS image data was also reviewed at a preliminary level. The review included a comparison between image resolution and dynamic range for each method. WAMS (ZON file) image data was found to have a pixel pitch of 3.69μm compared to 1 μm for the LCM (vk4 file) data, which implies a lower resolution for the WAMS images. Conversely, the ratio of dynamic range of the WAMS data to the LCM data was approximately 41:20 for height data, suggesting that information from WAMS should more accurately determine the depth of pits. At present, the significance of the greater dynamic range of the WAMS data relative to the LCM data has not yet been evaluated.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS1972

Corrections to star catalogues from satellite observations.

Theoretical investigation of the possibility of obtaining systematic corrections to star catalogs from observations of artificial satellites. A model is established to represent the system of equations formed when such corrections are determined simultaneously with corrections to the geocentric position of the observer. An analytical expression for the covariance matrix is set up for the two-dimensional (planar) case. The resulting correlations and weights are discussed. Since this method presents an independent way of obtaining the systematic errors in star catalogs, apart from the orientation to the equatorial system, it is related to the measurement of all quantities which depend on star positions. This institutes a completely new principle of obtaining systematic corrections to star catalogs. It is based not on rotation, but on comparing the angle subtended at the satellite by two stars to the angle subtended at the satellite by two points on the surface of the earth.

Williams, C. A.↗
NASA NTRS2024

Spectral Correlation in MODIS Water-Leaving Reflectance Retrieval Uncertainty

Spectral remote sensing reflectance, Rrs(λ) (sr−1), is the fundamental quantity used to derive a host of bio-optical and biogeochemical properties of the water column from satellite ocean color measurements. Estimation of uncertainty in those derived geophysical products is therefore dependent on knowledge of the uncertainty in satellite-retrieved R rs . Furthermore, since the associated algorithms require R rs at multiple spectral bands, the spectral (i.e., band-to-band)error covariance in R rs is needed to accurately estimate the uncertainty in those derived properties. This study establishes a derivative-based approach for propagating instrument random noise, instrument systematic uncertainty, and forward model uncertainty into R rs as retrieved using NASA’s multiple-scattering epsilon (MSEPS) atmospheric correction algorithm, to generate pixel-level error covariance in R rs . The approach is applied to measurements from Moderate Resolution Imaging Spectroradiometer (MODIS) on the Aqua satellite and verified using Monte Carlo (MC) analysis. We also make use of this full spectral error covariance in R rs to calculate uncertainty in phytoplankton pigment chlorophyll-a concentration (chl a , mg/m 3 ) and diffuse attenuation coefficient of downwelling irradiance at 490 nm (K d (490), m -1 ). Accounting for the error covariance in R rs generally reduces the estimated relative uncertainty in chl a by ∼1-2% (absolute value) in waters with chl a < 0.25 mg/m 3 where the color index (CI) algorithm is used. The reduction is ∼5-10% in waters with chl a > 0.35 mg/m 3 where the blue-green ratio (OCX) algorithm is used. Such reduction can be higher than 30% in some regions. For K d (490), the reduction by error covariance is generally ∼2%, but can be higher than 20% in some regions. The error covariance in R rs is further verified through forward-calculating chl a from MODIS-retrieved and in situ R rs and comparing estimated uncertainty with observed differences. An 8-day global composite of propagated uncertainty shows that the goal of 35% uncertainty in chl a can be achieved over deep ocean waters (chl a ≤ 0.1 mg/m3). While the derivative-based approach generates reasonable error covariance in R rs some assumptions should be updated as our knowledge improves. These include the inter-band error correlation in top-of-atmosphere reflectance, and uncertainties in the calibration of MODIS 869 nm band, in ancillary data, and in the in situ data used for system vicarious calibration.

Ocean color↗
NASA NTRS2020

Simultaneous Retrieval of Surface Roughness Parameters for Bare Soils From Combined Active–Passive Microwave SMAP Observations

An active–passive microwave retrieval algorithm for simultaneous determination of soil surface roughness parameters [vertical root-mean-square (RMS) height ( s ) and horizontal correlation length ( l )] is presented for bare soils. The algorithm is based on active–passive microwave covariation, including the improved Integral Equation Method (I(exp 2) EM), and is tested with global soil moisture active passive (SMAP) observations. The estimated retrieval results for s and l are overall consistent with values in the literature, indicating the validity of the proposed algorithm. Sensitivity analyses showed that the developed roughness retrieval algorithm is independent of permittivity for E(sub s) > 10 [-]. Furthermore, the physical model basis of this approach (I(exp 2) EM) allows the application of different autocorrelation functions (ACF), such as Gaussian and exponential ACFs. Global roughness retrieval results confirm bare areas in deserts such as Sahara or Gobi. However, the type of ACF used within roughness parameter estimation is important. Retrieval results for the Gaussian ACF describe a rougher surface than retrieval results for the exponential ACF. No correlations were found between roughness results and the amount of precipitation or the soil texture, which could be due to the coarse spatial resolution of the SMAP data. The extension of this approach to vegetated soils is planned as an add-on study.

Correlation length↗
DOE OSTI2020

Big-Data-Driven Geo-Spatiotemporal Correlation Analysis between Precursor Pollen and Influenza and its Implication to Novel Coronavirus Outbreak

Although studies of many respiratory viruses and pollens are often framed by both seasonal and health related perspectives, pollen has yet to be extensively examined as an important covariate to seasonal respiratory viruses (SRVs) in any context, including a causal one. This study contributes to those goals through an investigation of SRVs and pollen counts at selected regions across the Western Hemisphere. Two complementary decadal-scaled geospatial profiles were developed. One laterally spanned the US and was anchored by detailed pollen information for Albuquerque, New Mexico. The other straddled the equator to include Fortaleza, Brazil. We found that the geospatial and climatological patterns of pollen advancement and decline across the US every year presented a statistically significant correlation to the subsequent emergence and decline of SRVs. Other significant covariates included winds, temperatures, and atmospheric moisture. Our study indicates that areas of the US with lower geostrophic wind baselines are typically areas of persistently higher and earlier influenza like illness (ILI) cases. In addition to that continental- scaled contrast, many sites indicated seasonal highs of geostrophic winds and ILI which were closely aligned. These observations suggest extensive scale-dependent connectivity of viruses to geostrophic circulation. Pollen emergence and its own scale-dependent circulation may contribute to the geospatial and seasonal patterns of ILI. We explore some uncertainties associated with this investigation, and consider the possibility that in a temperate climate, following a Spring pollen emergence, a resulting increase in pollen triggered human Immunoglobulin E (IgE) antibodies may suppress ILIs for several months.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2020

Simultaneous Retrieval of Surface Roughness Parameters for Bare Soils from Combined Active-Passive Microwave SMAP Observations

An active-passive microwave retrieval algorithm for simultaneous determination of soil surface roughness parameters [vertical root-mean-square (RMS) height (s) and horizontal correlation length (l)] is presented for bare soils. The algorithm is based on active-passive microwave covariation, including the improved Integral Equation Method (I²EM), and is tested with global soil moisture active passive (SMAP) observations. The estimated retrieval results for s and l are overall consistent with values in the literature, indicating the validity of the proposed algorithm. Sensitivity analyses showed that the developed roughness retrieval algorithm is independent of permittivity for εₛ > 10 [-]. Furthermore, the physical model basis of this approach (I²EM) allows the application of different autocorrelation functions (ACF), such as Gaussian and exponential ACFs. Global roughness retrieval results confirm bare areas in deserts such as Sahara or Gobi. However, the type of ACF used within roughness parameter estimation is important. Retrieval results for the Gaussian ACF describe a rougher surface than retrieval results for the exponential ACF. No correlations were found between roughness results and the amount of precipitation or the soil texture, which could be due to the coarse spatial resolution of the SMAP data. The extension of this approach to vegetated soils is planned as an add-on study.

correlation length↗
DOE OSTI2024

SmoQyDEAC.jl: A differential evolution package for the analytic continuation of imaginary time correlation functions

We introduce the SmoQyDEAC.jl package, a Julia implementation of the Differential Evolution Analytic Continuation (DEAC) algorithm [N. S. Nichols et al., Phys. Rev. E 106, 025312 (2022)] for analytically continuing noisy imaginary time correlation functions to the real frequency axis. Our implementation supports fermionic and bosonic correlation functions on either the imaginary time or Matsubara frequency axes, and treatment of the covariance error in the input data. This paper presents an overview of the DEAC algorithm and the features implemented in the SmoQyDEAC.jl package. It also provides detailed benchmarks of the package's output against the popular maximum entropy and stochastic analytic continuation methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Codebase release r1.1 for SmoQyDEAC.jl

We introduce the SmoQyDEAC.jl package, a Julia implementation of the Differential Evolution Analytic Continuation (DEAC) algorithm [N. S. Nichols et al., Phys. Rev. E 106, 025312 (2022)] for analytically continuing noisy imaginary time correlation functions to the real frequency axis. Our implementation supports fermionic and bosonic correlation functions on either the imaginary time or Matsubara frequency axes, and treatment of the covariance error in the input data. This paper presents an overview of the DEAC algorithm and the features implemented in the SmoQyDEAC.jl package. It also provides detailed benchmarks of the package’s output against the popular maximum entropy and stochastic analytic continuation methods. The code for this package can be downloaded from our GitHub repository at https://github.com/SmoQySuite/SmoQyDEAC.jl or installed using the Julia package manager. The online documentation, including examples, can be accessed at https://smoqysuite.github.io/SmoQyDEAC.jl/stable/.

Neuhaus, James (ORCID:0000000169048510)↗
NASA NTRS1975

Users manual for flight control design programs

Computer programs for the design of analog and digital flight control systems are documented. The program DIGADAPT uses linear-quadratic-gaussian synthesis algorithms in the design of command response controllers and state estimators, and it applies covariance propagation analysis to the selection of sampling intervals for digital systems. Program SCHED executes correlation and regression analyses for the development of gain and trim schedules to be used in open-loop explicit-adaptive control laws. A linear-time-varying simulation of aircraft motions is provided by the program TVHIS, which includes guidance and control logic, as well as models for control actuator dynamics. The programs are coded in FORTRAN and are compiled and executed on both IBM and CDC computers.

Nalbandian, J. Y.↗
NASA NTRS1978

GPS-aided Space Shuttle navigation

In the present paper, specific GPS (Global Positioning System) aided Shuttle navigation are presented as examples of the navigation performance prediction process. The process described is a statistical covariance error analysis. To facilitate detailing, the process is broken down into four portions with sharply limited interfaces. Considerations of mission scenarios form one distinct package of computer routines. Simulation of the onboard navigation filter is another facet of the process, as are the larger system covariance program and the GPS segment covariance simulation. The combination of these computer tools permits proper evaluation of the multitude of correlated error sources affecting GPS-aided Shuttle navigation.

Matchett, G.↗