SEARCH · Engineering Papers

Results for “Covariance Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Covariate Dependent Sparse Functional Data Analysis

This study proposes a method to incorporate covariate information into sparse functional data analysis. The method aims at cases where each subject has a limited number of longitudinal measurements and is associated with static covariates. This research is motivated by several use cases in practice. One representative example is void swelling, a nuclear-specific material degradation mechanism. Void swelling is affected by many covariates, including alloy composition and irradiation type. How to accurately model the complicated joint effects of such covariates on the swelling process is the key to mitigating the effect of swelling and ensuring safe operation. Unlike most of the existing methods, the proposed method can handle high-dimensional covariates with the informative covariate identification procedure and sparse and irregularly spaced measurements, that is, does not require complete or dense observations. The main innovation of the proposed method is that we model the variation coming from covariates and the variation left conditioned on covariates, such that the functional principal component analysis and Gaussian process can be conducted in a unified manner. Further, we also propose a systematic approach to identify important covariates in the hypothesis testing context. The methodology is demonstrated on applications in nuclear engineering and healthcare and simulation studies.

42 ENGINEERING↗

DOE OSTI2024

Eddy Covariance Flux / Processed Data

This dataset consists of estimates of mean and turbulent quantities from a vertical array of instruments installed on the barge met mast, including: sonic anemometers, relative humidity and temperature, pressure, and rain. One of the levels consists of a paired sonic anemometer and infrared gas analyzer for direct covariance sensible and latent heat fluxes. Mean and turbulent quantities are determined over 20-minute averaging periods.

17 WIND ENERGY↗

DOE OSTI2024

Eddy Covariance Flux / Processed Data

17 WIND ENERGY↗

DOE OSTI2024

Eddy Covariance Flux / Processed Data

This dataset consists of estimates of mean and turbulent quantities from a vertical array of over a dozen instruments, which include sonic anemometers, relative humidity and temperature, pressure, rain, ocean temperature and salinity, ocean skin temperature, and surface wave spectra and bulk wave parameters. One of the levels consists of a paired sonic anemometer and infrared gas analyzer for direct covariance sensible and latent heat fluxes. Mean and turbulent quantities are determined over 20-minute averaging periods.

17 WIND ENERGY↗

DOE OSTI2021

Data compression and covariance matrix inspection: Cosmic shear

Covariance matrices are among the most difficult pieces of end-to-end cosmological analyses. In principle, for two-point functions, each component involves a four-point function, and the resulting covariance often has hundreds of thousands of elements. We investigate various compression mechanisms capable of vastly reducing the size of the covariance matrix in the context of cosmic shear statistics. This helps identify which of its parts are most crucial to parameter estimation. We start with simple compression methods, by isolating and “removing” 200 modes associated with the lowest eigenvalues, then those with the lowest signal-to-noise ratio, before moving on to more sophisticated schemes like compression at the tomographic level and, finally, with the massively optimized parameter estimation and data compression (MOPED). We find that, while most of these approaches prove useful for a few parameters of interest, like Ω m , the simplest yield a loss of constraining power on the intrinsic alignment (IA) parameters as well as S 8 . For the case considered—cosmic shear from the first year of data from the Dark Energy Survey—only MOPED was able to replicate the original constraints in the 16-parameter space. Finally, we apply a tolerance test to the elements of the compressed covariance matrix obtained with MOPED and confirm that the IA parameter A IA is the most susceptible to inaccuracies in the covariance matrix.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2017

New Data-Driven Estimation of Terrestrial CO2 Fluxes in Asia Using a Standardized Database of Eddy Covariance Measurements, Remote Sensing Data, and Support Vector Regression

The lack of a standardized database of eddy covariance observations has been an obstacle for data-driven estimation of terrestrial carbon dioxide fluxes in Asia. In this study, we developed such a standardized database using 54 sites from various databases by applying consistent postprocessing for data-driven estimation of gross primary productivity (GPP) and net ecosystem carbon dioxide exchange (NEE). Data-driven estimation was conducted by using a machine learning algorithm: support vector regression (SVR), with remote sensing data for 2000 to 2015 period. Site-level evaluation of the estimated carbon dioxide fluxes shows that although performance varies in different vegetation and climate classifications, GPP and NEE at 8 days are reproduced (e.g., r (exp 2) =0.73 and 0.42 for 8 day GPP and NEE). Evaluation of spatially estimated GPP with Global Ozone Monitoring Experiment 2 sensor-based Sun-induced chlorophyll fluorescence shows that monthly GPP variations at subcontinental scale were reproduced by SVR (r (exp 2)=1.00, 0.94, 0.91, and 0.89 for Siberia, East Asia, South Asia, and Southeast Asia, respectively). Evaluation of spatially estimated NEE with net atmosphere-land carbon dioxide fluxes of Greenhouse Gases Observing Satellite (GOSAT) Level 4A product shows that monthly variations of these data were consistent in Siberia and East Asia; meanwhile, inconsistency was found in South Asia and Southeast Asia. Furthermore, differences in the land carbon dioxide fluxes from SVR-NEE and GOSAT Level 4A were partially explained by accounting for the differences in the definition of land carbon dioxide fluxes. These data-driven estimates can provide a new opportunity to assess carbon dioxide fluxes in Asia and evaluate and constrain terrestrial ecosystem models.

chlorophyll fluorescence↗

DOE OSTI2022

Theoretical and calculable dependent variables and their covariance in nuclear data libraries [Slides]

This presentation begins by defining observables, including theoretical observable, calculable observable, and measured observable. It also provides definitions and examples of experimental effects. Additionally, uncertainty in evaluated libraries and a metric to probe evaluated uncertainty is presented. In conclusion, being related to theoretical quantities such as resonance parameters, the uncertainty in ENDF libraries (e.g., ENDF/B-VIII.0) can be overestimated because it is usually evaluated under the guidance of experimental uncertainty: lim Δσexp.corr.→0 Δσ = Δσ theoretical model . The presentation states that a clear distinction of the uncertainty between nuclear theoretical models and experimental corrections should be revisited and this is important since (e.g., transport) simulations need theoretical quantities convoluted with specific operational parameters and material configurations. It also states that strong coupling between uncertainty quantification methodologies and optimization procedures exists, and it is necessary to develop methodologies to obtain uncertainty on theoretical models from physical and mathematical constraints.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

NASA NTRS1992

Covariance of biophysical data with digital topograpic and land use maps over the FIFE site

This paper discusses the biophysical stratification of the FIFE site, implementation of the stratification utilizing geographic information system methods, and validation of the stratification with respect to field measurements of biomass, Bowen ratio, soil moisture, and the greenness vegetation index (GVI) derived from TM satellite data. Maps of burning and topographic position were significantly associated with variation in GVI, biomass, and Bowen ratio. The stratified design did not significantly alter the estimated site-wide means for surface climate parameters but accounted for between 25 and 45 percent of the sample variance depending on the variable.

Davis, F. W.↗

NASA NTRSDate not supplied

Covariance Propagation in Data Assimilation: A Continuum Analysis of Advective Systems

Explore the source record for details and available documents.

Shay Gilpin↗

NASA NTRS1995

On-line estimation of error covariance parameters for atmospheric data assimilation

A simple scheme is presented for on-line estimation of covariance parameters in statistical data assimilation systems. The scheme is based on a maximum-likelihood approach in which estimates are produced on the basis of a single batch of simultaneous observations. Simple-sample covariance estimation is reasonable as long as the number of available observations exceeds the number of tunable parameters by two or three orders of magnitude. Not much is known at present about model error associated with actual forecast systems. Our scheme can be used to estimate some important statistical model error parameters such as regionally averaged variances or characteristic correlation length scales. The advantage of the single-sample approach is that it does not rely on any assumptions about the temporal behavior of the covariance parameters: time-dependent parameter estimates can be continuously adjusted on the basis of current observations. This is of practical importance since it is likely to be the case that both model error and observation error strongly depend on the actual state of the atmosphere. The single-sample estimation scheme can be incorporated into any four-dimensional statistical data assimilation system that involves explicit calculation of forecast error covariances, including optimal interpolation (OI) and the simplified Kalman filter (SKF). The computational cost of the scheme is high but not prohibitive; on-line estimation of one or two covariance parameters in each analysis box of an operational bozed-OI system is currently feasible. A number of numerical experiments performed with an adaptive SKF and an adaptive version of OI, using a linear two-dimensional shallow-water model and artificially generated model error are described. The performance of the nonadaptive versions of these methods turns out to depend rather strongly on correct specification of model error parameters. These parameters are estimated under a variety of conditions, including uniformly distributed model error and time-dependent model error statistics.

Dee, Dick P.↗

DOE OSTI2024

Water loss through evapotranspiration after precipitation events in bioenergy crops grown in similar climatic conditions

The relationship between precipitation and evapotranspiration (ET) is critical to understanding water cycle related dynamics in ecosystems, including crops. Existing studies of bioenergy crops have primarily focused on annual or seasonal ET rates, with less attention given to the immediate ET response following precipitation events. This study examines the variation in ET rates in the days subsequent to precipitation events across various bioenergy crops—corn, switchgrass, and prairies—utilizing 13 years (2010–2022) of growing season data. Meteorological and eddy covariance flux data were collected from seven eddy covariance flux towers as part of the GLBRC scale-up experiment at the Kellogg Biological Station Long Term Ecological Research sites. The analysis revealed that average ET peaked the day after precipitation and declined linearly over the following days, with a statistically significant relationship (p-value = 0.00027, R2 = 0.96). Neither the type of biofuel vegetation nor the historical land use significantly influenced ET post-precipitation events (p-values = 0.53 and 0.153, respectively). Key predictors of ET following precipitation events include shortwave radiation, season, day of the year, ambient temperature, vapor pressure deficit (VPD), long-wave radiation, precipitation amount, soil moisture, and annual variability. These findings enhance our comprehension of ET responses in bioenergy crop systems, with implications for water management in sustainable agriculture.

09 BIOMASS FUELS↗

DOE OSTI2022

Kronecker-structured covariance models for multiway data

Many applications produce multiway data of exceedingly high dimension. Modeling such multi-way data is important in multichannel signal and video processing where sensors produce multi-indexed data, e.g. over spatial, frequency, and temporal dimensions. We will address the challenges of covariance representation of multiway data and review some of the progress in statistical modeling of multiway covariance over the past two decades, focusing on tensor-valued covariance models and their inference. We will illustrate through a space weather application: predicting the evolution of solar active regions over time.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Applying a Template of Expected Uncertainties to Updating 239 Pu(n,f) Cross-section Covariances in the Neutron Data Standards Database

Templates of uncertainties expected in specific measurement types were recently developed. One aim of these templates is to help evaluators in identifying (1) missing or suspiciously low uncertainties and (2) missing correlations between uncertainties of the same and different experiments, when estimating covariances for experimental data employed in their evaluations. These templates also provide realistic estimates of standard deviations and correlations for a particular uncertainty source and measurement type that can be used by evaluators in situations where they are not supplied by the experimenters. This information allows for a more comprehensive uncertainty analysis across all measurements considered in an evaluation and, thus, more realistic evaluated covariances. Here, in this work, we extend a template that is applicable to uncertainties expected in neutron-induced fission, (n,f), cross-section measurements. It is applied to improving covariances of 239 Pu(n,f) cross-section measurements in the database underlying the Neutron Data Standards evaluations. This particular example was chosen since this evaluation is primarily based on experimental information. Also, some uncertainties of individual 239 Pu(n,f) cross-section experiments in this database were suspected to be underestimated. The evaluated uncertainties obtained after updating the covariances in the database by means of the template indeed do increase compared to their original values. Even more importantly, the evaluated mean values change noticeably. These modified cross sections impact application calculations significantly, as is demonstrated by employing them in simulations of the effective neutron multiplication factor for a few selected critical assemblies. However, this updated evaluated 239 Pu(n,f) cross section should not be interpreted as the final one that should replace values of the current Neutron Data Standards project. Evaluations for the Neutron Data Standards of the 239 Pu(n,f) cross section must be linked to many other observables included in the associated database, most notably to cross sections for 235 U(n,f), but also to those for 10 B(n, α ), 6 Li(n,t), 238 U(n,f), and 238 U(n, γ ), because of included measurements of the 239 Pu(n,f) cross section that appear as ratios to these reactions. Some of these other reactions are correlated to further observables in the database. Hence, updating uncertainties of data sets of any of these observables can potentially impact the 239 Pu(n,f) cross section. Uncertainties for all measurements of these linked physical observables have to be updated before a comprehensive evaluation of the 239 Pu(n,f) cross section and its corresponding uncertainties can be provided.

239Pu Neutron-induced fission cross-section↗

NASA NTRS1988

Error dynamics and relative orbital uncertainty of the Magellan spacecraft

Relative error is discussed in light of a proposed orbiter mission to Venus. It is hypothesized that the relative (position) error of the orbiting spacecraft between disjoint data sets will be large because of residual uncertainties of the absolute estimates and their decorrelation caused by succeeding estimates. A method is proposed to limit relative error by inducing correlations between the estimates on successive data arcs. These correlations are induced by overlapping the data arcs. Covariance analyses of the data sets are undertaken at two distinct mapping times, yielding the relative error between those mapping times. The technique is applied to a mosaicking problem on a specific day in the mission.

Haw, R. J.↗

NASA NTRS1990

Gravity field improvement using GPS data from Topex/Poseidon - A covariance analysis

A covariance analysis is performed using a realistic scenario for processing 10 days of GPS data, to obtain the expected improvement to the GEM-T2 gravity field. The gravity bin technique has been refined to compute the covariance matrix associated with the spherical harmonic gravity field. It is shown that the GPS data from one ten-day arc of Topex/Poseidon with no a priori can improve medium degree and order (3-26) sigmas for the parameters in the GEM-T2 gravity field by more than an order of magnitude.

Bertiger, Willy I.↗

DOE OSTI2024

A Data-Driven Methodology for Contextual Unit Commitment Using Regression Residuals

Day after day, system operators are faced with the challenge of taking unit commitment (UC) decisions under uncertain net load conditions. The standard operating procedure for taking UC decisions begins by leveraging auxiliary data on covariates (such as the day of the week or latest weather information) to generate a point prediction for net load, which is used in solving a deterministic UC problem. Such an approach, however, is known to deliver a notoriously poor out-of-sample (OOS) performance, as it completely disregards the stochastic nature of net load. While stochastic programming models explicitly represent uncertainty, they mostly do so using a generic set of scenarios that neglect covariate observations, squandering useful auxiliary data that could be harnessed to glean insights into uncertainty. In this article, we discuss a contextual stochastic optimization approach to UC, which effectively exploits covariate observations while explicitly assessing uncertainty so as to boost the OOS performance of UC decisions. The key thrust of our approach is to leverage regression models, along with their empirical residuals, to set up and solve sample average approximation problems. Not only do we prove that our approach satisfies the requisite conditions for asymptotic optimality and consistency laid out in (Kannan et al., 2022), but we also assess its performance on several case studies conducted using real-world data collected in California ISO and New York ISO grids. In conclusion, results show that the proposed approach can significantly improve OOS performance compared to alternative methods proposed in the literature under varying dataset sizes.

Yurdakul, Ogun↗

NASA NTRS1985

Systematic estimation of forecast and observation error covariances in four-dimensional data assimilation

A two-part algorithm is presented for reliably computing weather forecast model and observational error covariances during data assimilation. Data errors arise from instrumental inaccuracies and sub-grid scale variability, whereas forecast errors occur because of modeling errors and the propagation of previous analysis errors. A Kalman filter is defined as the primary algorithm for estimating the forecast and analysis error convariance matrices. A second algorithm is described for quantifying the noise covariance matrices of any degree to obtain accurate values for the observational error covariances. Numerical results are provided from a linearized one-dimensional shallow-water model. The results cover observational noise covariances, initial instrumental errors and erroneous model values.

Dee, D. P.↗

NASA NTRS2017

Role of Forcing Uncertainty and Background Model Error Characterization in Snow Data Assimilation

Accurate specification of the model error covariances in data assimilation systems is a challenging issue. Ensemble land data assimilation methods rely on stochastic perturbations of input forcing and model prognostic fields for developing representations of input model error covariances. This article examines the limitations of using a single forcing dataset for specifying forcing uncertainty inputs for assimilating snow depth retrievals. Using an idealized data assimilation experiment, the article demonstrates that the use of hybrid forcing input strategies (either through the use of an ensemble of forcing products or through the added use of the forcing climatology) provide a better characterization of the background model error, which leads to improved data assimilation results, especially during the snow accumulation and melt-time periods. The use of hybrid forcing ensembles is then employed for assimilating snow depth retrievals from the AMSR2 (Advanced Microwave Scanning Radiometer 2) instrument over two domains in the continental USA with different snow evolution characteristics. Over a region near the Great Lakes, where the snow evolution tends to be ephemeral, the use of hybrid forcing ensembles provides significant improvements relative to the use of a single forcing dataset. Over the Colorado headwaters characterized by large snow accumulation, the impact of using the forcing ensemble is less prominent and is largely limited to the snow transition time periods. The results of the article demonstrate that improving the background model error through the use of a forcing ensemble enables the assimilation system to better incorporate the observational information.

assimilation↗