Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2013

Ensemble Data Assimilation Without Ensembles: Methodology and Application to Ocean Data Assimilation

Two methods to estimate background error covariances for data assimilation are introduced. While both share properties with the ensemble Kalman filter (EnKF), they differ from it in that they do not require the integration of multiple model trajectories. Instead, all the necessary covariance information is obtained from a single model integration. The first method is referred-to as SAFE (Space Adaptive Forecast error Estimation) because it estimates error covariances from the spatial distribution of model variables within a single state vector. It can thus be thought of as sampling an ensemble in space. The second method, named FAST (Flow Adaptive error Statistics from a Time series), constructs an ensemble sampled from a moving window along a model trajectory. The underlying assumption in these methods is that forecast errors in data assimilation are primarily phase errors in space and/or time.

Data Assimilation↗
NASA NTRS2004

Ensemble Data Mining Methods

Ensemble Data Mining Methods, also known as Committee Methods or Model Combiners, are machine learning methods that leverage the power of multiple models to achieve better prediction accuracy than any of the individual models could on their own. The basic goal when designing an ensemble is the same as when establishing a committee of people: each member of the committee should be as competent as possible, but the members should be complementary to one another. If the members are not complementary, Le., if they always agree, then the committee is unnecessary---any one member is sufficient. If the members are complementary, then when one or a few members make an error, the probability is high that the remaining members can correct this error. Research in ensemble methods has largely revolved around designing ensembles consisting of competent yet complementary models.

Oza, Nikunj C.↗
NASA NTRS2014

Device and Method for Gathering Ensemble Data Sets

An ensemble detector uses calibrated noise references to produce ensemble sets of data from which properties of non-stationary processes may be extracted. The ensemble detector comprising: a receiver; a switching device coupled to the receiver, the switching device configured to selectively connect each of a plurality of reference noise signals to the receiver; and a gain modulation circuit coupled to the receiver and configured to vary a gain of the receiver based on a forcing signal; whereby the switching device selectively connects each of the plurality of reference noise signals to the receiver to produce an output signal derived from the plurality of reference noise signals and the forcing signal.

Racette, Paul E.↗
NASA NTRS2013

Assessing the Impact of Pre-gpm Microwave Precipitation Observations in the Goddard WRF Ensemble Data Assimilation System

The forthcoming Global Precipitation Measurement (GPM) Mission will provide next generation precipitation observations from a constellation of satellites. Since precipitation by nature has large variability and low predictability at cloud-resolving scales, the impact of precipitation data on the skills of mesoscale numerical weather prediction (NWP) is largely affected by the characterization of background and observation errors and the representation of nonlinear cloud/precipitation physics in an NWP data assimilation system. We present a data impact study on the assimilation of precipitation-affected microwave (MW) radiances from a pre-GPM satellite constellation using the Goddard WRF Ensemble Data Assimilation System (Goddard WRF-EDAS). A series of assimilation experiments are carried out in a Weather Research Forecast (WRF) model domain of 9 km resolution in western Europe. Sensitivities to observation error specifications, background error covariance estimated from ensemble forecasts with different ensemble sizes, and MW channel selections are examined through single-observation assimilation experiments. An empirical bias correction for precipitation-affected MW radiances is developed based on the statistics of radiance innovations in rainy areas. The data impact is assessed by full data assimilation cycling experiments for a storm event that occurred in France in September 2010. Results show that the assimilation of MW precipitation observations from a satellite constellation mimicking GPM has a positive impact on the accumulated rain forecasts verified with surface radar rain estimates. The case-study on a convective storm also reveals that the accuracy of ensemble-based background error covariance is limited by sampling errors and model errors such as precipitation displacement and unresolved convective scale instability.

microwave observations↗
NASA NTRS2017

Assimilation of AERONET and MODIS AOT Observations Using Variational and Ensemble Data Assimilation Methods and Its Impact on Aerosol Forecasting Skill

Data assimilation of Aerosol Robotic Network (AERONET) and Moderate Resolution Imaging Spectroradiometer (MODIS) aerosol optical thickness (AOT) for aerosol forecasting was tested within the Navy Aerosol Analysis Prediction System (NAAPS) framework, using variational and ensemble data assimilation methods. Navy aerosol forecasting currently makes use of a deterministic NAAPS simulation coupled to Navy Variational Data Assimilation System for aerosol optical depth, a two-dimensional variational data assimilation system, for MODIS AOT assimilation. An ensemble version of NAAPS (ENAAPS) coupled to an ensemble adjustment Kalman filter (EAKF) from the Data Assimilation Research Testbed was recently developed, allowing for a range of data assimilation and forecasting experiments to be run with deterministic NAAPS and ENAAPS. The main findings are that the EAKF, with its flow-dependent error covariances, makes better use of sparse observations such as AERONET AOT. Assimilating individual AERONET observations in the two-dimensional variational system can increase the analysis errors when observations are located in high AOT gradient regions. By including AERONET with MODIS AOT assimilation, the magnitudes of peak aerosol events (AOT> 1) were better captured with improved temporal variability, especially in India and Asia where aerosol prediction is a challenge. Assimilating AERONET AOT with MODIS had little impact on the 24 h forecast skill compared to MODIS assimilation only, but differences were found downwind of AERONET sites. The 24 h forecast skill was approximately the same for forecasts initialized with analyses from AERONET AOT assimilation alone compared to MODIS assimilation, particularly in regions where the AERONET network is dense; including the United States and Europe, indicating that AERONET could serve as a backup observation network for over-land synoptic-scale aerosol events.

Rubin, Juli I.↗
NASA NTRS2011

Receiver Gain Modulation Circuit

A receiver gain modulation circuit (RGMC) was developed that modulates the power gain of the output of a radiometer receiver with a test signal. As the radiometer receiver switches between calibration noise references, the test signal is mixed with the calibrated noise and thus produces an ensemble set of measurements from which ensemble statistical analysis can be used to extract statistical information about the test signal. The RGMC is an enabling technology of the ensemble detector. As a key component for achieving ensemble detection and analysis, the RGMC has broad aeronautical and space applications. The RGMC can be used to test and develop new calibration algorithms, for example, to detect gain anomalies, and/or correct for slow drifts that affect climate-quality measurements over an accelerated time scale. A generalized approach to analyzing radiometer system designs yields a mathematical treatment of noise reference measurements in calibration algorithms. By treating the measurements from the different noise references as ensemble samples of the receiver state, i.e. receiver gain, a quantitative description of the non-stationary properties of the underlying receiver fluctuations can be derived. Excellent agreement has been obtained between model calculations and radiometric measurements. The mathematical formulation is equivalent to modulating the gain of a stable receiver with an externally generated signal and is the basis for ensemble detection and analysis (EDA). The concept of generating ensemble data sets using an ensemble detector is similar to the ensemble data sets generated as part of ensemble empirical mode decomposition (EEMD) with exception of a key distinguishing factor. EEMD adds noise to the signal under study whereas EDA mixes the signal with calibrated noise. It is mixing with calibrated noise that permits the measurement of temporal-functional variability of uncertainty in the underlying process. The RGMC permits the evaluation of EDA by modulating the receiver gain using an external signal. Without the RGMC, samples of calibrated references from radiometers form an ensemble data set of the natural occurring fluctuations within a receiver. By driving the gain of an otherwise stable receiver with an external signal, the conceptual framework and generalization of the mathematics of EDA can be tested. A series of measurements was conducted to evaluate and characterize the performance of the RGMC. Test signals stepped the RGMC across its dynamic range of performance using a radiometer that sampled four noise references; analysis indicates that the RGMC successfully modulated the receiver gain with an external signal. Calibration algorithms applied to four noise references demonstrate the RGMC produced ensemble data sets of the external signal.

Jones, Hollis↗
NASA NTRS2014

Background Error Covariance Estimation Using Information from a Single Model Trajectory with Application to Ocean Data Assimilation

An attractive property of ensemble data assimilation methods is that they provide flow dependent background error covariance estimates which can be used to update fields of observed variables as well as fields of unobserved model variables. Two methods to estimate background error covariances are introduced which share the above property with ensemble data assimilation methods but do not involve the integration of multiple model trajectories. Instead, all the necessary covariance information is obtained from a single model integration. The Space Adaptive Forecast error Estimation (SAFE) algorithm estimates error covariances from the spatial distribution of model variables within a single state vector. The Flow Adaptive error Statistics from a Time series (FAST) method constructs an ensemble sampled from a moving window along a model trajectory.SAFE and FAST are applied to the assimilation of Argo temperature profiles into version 4.1 of the Modular Ocean Model (MOM4.1) coupled to the GEOS-5 atmospheric model and to the CICE sea ice model. The results are validated against unassimilated Argo salinity data. They show that SAFE and FAST are competitive with the ensemble optimal interpolation (EnOI) used by the Global Modeling and Assimilation Office (GMAO) to produce its ocean analysis. Because of their reduced cost, SAFE and FAST hold promise for high-resolution data assimilation applications.

Error Covariance↗
NASA NTRS1989

Laser transit anemometer software development program

Algorithms were developed for the extraction of two components of mean velocity, standard deviation, and the associated correlation coefficient from laser transit anemometry (LTA) data ensembles. The solution method is based on an assumed two-dimensional Gaussian probability density function (PDF) model of the flow field under investigation. The procedure consists of transforming the data ensembles from the data acquisition domain (consisting of time and angle information) to the velocity space domain (consisting of velocity component information). The mean velocity results are obtained from the data ensemble centroid. Through a least squares fitting of the transformed data to an ellipse representing the intersection of a plane with the PDF, the standard deviations and correlation coefficient are obtained. A data set simulation method is presented to test the data reduction process. Results of using the simulation system with a limited test matrix of input values is also given.

Abbiss, John B.↗
NASA NTRS2000

Influence of the Biosphere on Precipitation: July 1995 Studies with the ARM-CART Data

Ensemble sets of simulation experiments were conducted with a single column model (SCM) using the Goddard GEOS II GCM physics containing a recent version of the Cumulus Scheme (McRAS) and a biosphere based land-fluxes scheme (SSiB). The study used the 18 July to 5 August 1995 ARM-CART (Atmospheric Radiation Measurement-Cloud Atmospheric Radiation Test-bed) data, which was collected at the ARM-CART site in the mid-western United States and analyzed for single column modeling (SCM) studies. The new findings affirm the earlier findings that the vegetation, which increases the solar energy absorption at the surface together with soil and soil-moisture dependent processes, which modulate the surface, fluxes (particularly evapotranspiration) together help to increase the local rainfall. In addition, the results also show that for the particular study period roughly 50% of the increased evaporation over the ARM-CART site would be converted into rainfall with the Column, while the remainder would be advected out to the large-scale. Notwithstanding the limitations of only one-way interaction (i.e., the large-scale influencing the regional physics and not vice versa), the current SCM simulations show a very robust relationship. The evaporation-precipitation relationship turns out to be independent of the soil types, and soil moisture; however, it is weakly dependent on the vegetation cover because of its surface-albedo effect. Clearly, these inferences are prone to weaknesses of the SCM physics, the assumptions of the large-scale being unaffected by gridscale (SCM-scale) changes in moist processes, and other limitations of the evaluation procedures.

Sud, Y. C.↗
NASA NTRS2014

Background Error Covariance Estimation using Information from a Single Model Trajectory with Application to Ocean Data Assimilation into the GEOS-5 Coupled Model

An attractive property of ensemble data assimilation methods is that they provide flow dependent background error covariance estimates which can be used to update fields of observed variables as well as fields of unobserved model variables. Two methods to estimate background error covariances are introduced which share the above property with ensemble data assimilation methods but do not involve the integration of multiple model trajectories. Instead, all the necessary covariance information is obtained from a single model integration. The Space Adaptive Forecast error Estimation (SAFE) algorithm estimates error covariances from the spatial distribution of model variables within a single state vector. The Flow Adaptive error Statistics from a Time series (FAST) method constructs an ensemble sampled from a moving window along a model trajectory. SAFE and FAST are applied to the assimilation of Argo temperature profiles into version 4.1 of the Modular Ocean Model (MOM4.1) coupled to the GEOS-5 atmospheric model and to the CICE sea ice model. The results are validated against unassimilated Argo salinity data. They show that SAFE and FAST are competitive with the ensemble optimal interpolation (EnOI) used by the Global Modeling and Assimilation Office (GMAO) to produce its ocean analysis. Because of their reduced cost, SAFE and FAST hold promise for high-resolution data assimilation applications.

Data Assimilation↗
NASA NTRS2017

Considerations for Using Hybrid Ensemble-Variational Data Assimilation in NASA-GMAO's Next Reanalysis System

The Modern-Era Retrospective Analysis for Research and Applications, version 2 (MERRA-2) is the latest reanalysis produced by GMAO, and provides global data spanning the period 1980-present. The atmospheric data assimilation component of MERRA-2 used a 3D-Var scheme, which was operational at the time of its design. Since then, a Hybrid 3D-Var, then a Hybrid 4D-EnVar were implemented, adding an ensemble component to the data assimilation scheme. In this work, we will be examining the benefits of using hybrid ensemble flow-dependent covariances to represent errors and uncertainties in historic periods. Specifically, periods of pre- and post-satellites, as well as periods of active tropical cyclone seasons. Finally, we will also be exploring the use of adaptive localization scales.

MERRA-↗
NASA NTRS2018

The GMAO Hybrid Ensemble-Variational Atmospheric Data Assimilation System: Version 2.0

This document describes the implementation and usage of the Goddard Earth Observing System (GEOS) Hybrid Ensemble-Variational Atmospheric Data Assimilation System (Hybrid EVADAS). Its aim is to provide comprehensive guidance to users of GEOS ADAS interested in experimenting with its hybrid functionalities. The document is also aimed at providing a short summary of the state-of-science in this release of the hybrid system. As explained here, the ensemble data assimilation system (EnADAS) mechanism added to GEOS ADAS to enable hybrid data assimilation applications has been introduced to the pre-existing machinery of GEOS in the most non-intrusive possible way. Only very minor changes have been made to the original scripts controlling GEOS ADAS with the objective of facilitating its usage by both researchers and the GMAO's near-real-time Forward Processing applications. In a hybrid scenario two data assimilation systems run concurrently in a two-way feedback mode such that: the ensemble provides background ensemble perturbations required by the ADAS deterministic (typically high resolution) hybrid analysis; and the deterministic ADAS provides analysis information for recentering of the EnADAS analyses and information necessary to ensure that observation bias correction procedures are consistent between both the deterministic ADAS and the EnADAS. The nonintrusive approach to introducing hybrid capability to GEOS ADAS means, in particular, that previously existing features continue to be available. Thus, not only is this upgraded version of GEOS ADAS capable of supporting new applications such as Hybrid 3D-Var, 3D-EnVar, 4D-EnVar and Hybrid 4D-EnVar, it remains possible to use GEOS ADAS in its traditional 3D-Var mode which has been used in both MERRA and MERRA-2. Furthermore, as described in this document, GEOS ADAS also supports a configuration for exercising a purely ensemble-based assimilation strategy which can be fully decoupled from its variational component. We should point out that Release 1.0 of this document was made available to GMAO in mid-2013, when we introduced Hybrid 3D-Var capability to GEOS ADAS. This initial version of the documentation included a considerably different state-of-science introductory section but many of the same detailed description of the mechanisms of GEOS EnADAS. We are glad to report that a few of the desirable Future Works listed in Release 1.0 have now been added to the present version of GEOS EnADAS. These include the ability to exercise an Ensemble Prediction System that uses the ensemble analyses of GEOS EnADAS and (a very early, but functional version of) a tool to support Ensemble Forecast Sensitivity and Observation Impact applications.

Todling, Ricardo↗
NASA NTRS1991

Biasing errors and corrections

The dependence of laser velocimeter measurement rate on flow velocity is discussed. Investigations outlining that any dependence is purely statistical, and is nonstationary both spatially and temporally, are described. Main conclusions drawn are that the times between successive particle arrivals should be routinely measured and the calculation of the velocity data rate correlation coefficient should be performed to determine if a dependency exists. If none is found, accept the data ensemble as an independent sample of the flow. If a dependency is found, the data should be modified to obtain an independent sample. Universal correcting procedures should never be applied because their underlying assumptions are not valid.

Meyers, James F.↗
NASA NTRS2021

Assimilation of DAWN Doppler Wind Lidar Data During the 2017 Convective Processes Experiment (CPEX): Impact on Precipitation and Flow Structure

An improved representation of 3-D air motion and precipitation structure through forecast models and assimilation of observations is vital for improvements in weather forecasting capabilities. However, there are few independent data to properly validate a model forecast of precipitation structure when the underlying dynamics are evolving on short convective timescales. Using data from the JPL Ku/Ka-band Airborne Precipitation Radar (APR-2) and the 2 μmDoppler Aerosol Wind (DAWN) lidar collected during the2017 Convective Processes Experiment (CPEX), the NASA Unified Weather Research and Forecasting (WRF) Ensemble Data Assimilation System (EDAS) modeling system was used to quantify the impact of high-resolution sparsely sampled DAWN measurements on the analyzed variables and on the forecast when the DAWN winds were assimilated. Over-all, the assimilation of the DAWN wind profiles had a discernible impact on the wind field as well as the evolution and timing of the 3-D precipitation structure. Analysis of individual variables revealed that the assimilation of the DAWN winds resulted in important and coherent modifications of the environment. It led to an increase in the near-surface convergence, temperature, and water vapor, creating more favorable conditions for the development of convection exactly where it was observed (but not present in the control run). Comparison to APR-2 and observations by the Global Precipitation Measurement (GPM) satellite shows a much-improved forecast after the assimilation of the DAWN winds – development of precipitation where there was none, more organized precipitation where there was some, and a much more intense and organized cold pool, similar to the analysis of the dropsonde data. The onset of the vertical evolution of the precipitation showed similar radar-derived cloud-top heights, but delayed in time. While this investigation was limited to a single CPEX flight date, the investigation design is appropriate for further investigation of the impact of airborne Doppler wind lidar observations upon short-term convective precipitation forecasts

DAWN↗
NASA NTRSDate not supplied

Applied Uses of MERRA Reanalyses: Current and Future Prospects

During the initial planning of the Modern Era Retrospective-analysis for Research and Applications (MERRA), the project was envisioned to become a tool for applied sciences and decision makers, as well as weather and climate research. MERRA was the first reanalysis to provide data at 1 hourly frequencies. After discussions with wind energy users, 50m above the surface winds were included in the data collection to begin to represent the environment at the turbine height. MERRA-2 was the first reanalysis to include interactive and assimilated aerosols. From these, PM 1, 2.5 and 10 records have been computed and contribute to the climate and health sector. The US Center for Disease Control is accessing MERRA-2 data for comparison along with their health data. MERRA-2 Extreme Indices have been computed from the high frequency data (e.g. precipitation maxima, heat waves and fire weather). These have been used to characterize the changing extremes in the United States and around the globe as well as the weather associated with the extremes. The next-generation, MERRA-21C, includes increased resolution (25km) and continues to provide innovative Earth system data. For example, a boundary layer collection will provide constant height level data starting at 100m, continuing up to 4000m. This will provide detailed information about the boundary layer processes that greatly affect the biosphere. Chemical tracers for constituents are included in the system. The ensemble data assimilation is run with 32 members, and the variance for critical variables are stored. We will explore the use of this variance as one measure of uncertainty relevant for applied uses, which has not been included in any MERRA reanalysis. We will discuss use case scenarios developed to engage with the energy and financial sectors, to better understand their needs for climate data. Prospects for further downscaling of reanalyses will also be explored.

Michael Bosilovich↗
NASA NTRS2023

Statistical Approach on Utilizing Ground-Based Experiments to Model Break-Up Events

Two laboratory-based impact tests have been conducted to develop and extend the capability of NASA satellite breakup models. The first experiment, the Satellite Orbital Debris Characterization Impact Test (SOCIT), was conducted by the U.S. Department of Defense and NASA in 1992. It employed a fully functional U.S. Navy Transit spacecraft, fabricated from materials commonly used in the 1960s. SOCIT fragmentation data formed the basis of the current NASA Standard Satellite Breakup Model (SSBM). A second experiment, DebriSat, was conducted in 2014 by the DebriSat consortium: the NASA Orbital Debris Program Office, the United States Space Force Space Systems Command, formerly the Air Force Space and Missile Systems Center, the Air Force Arnold Engineering Development Complex, and the University of Florida. This impact test was performed on a high-fidelity mock-up satellite assembled from modern components. Data from both experiments are expected to contribute to the next-generation models for on-orbit breakup analyses, long-term environment predictions, and debris risk assessment. This paper uses the direct statistical sampling of the SOCIT and DebriSat data ensembles to model an on-orbit breakup event, rather than the analytic expressions estimated from the samples in the SSBM and its predecessor. This direct method involves drawing fragments (i.e., sampling with replacement) from each fragmentation data-subset containing mass, shape category, material density, characteristic length, mass, and cross-sectional area. As part of the sampling process, the properties of sampled fragment data (e.g., area-to-mass ratios) are numerically checked to ensure they do not contain unrealistic quantities. The process to simulate a breakup cloud composed of fragments from SOCIT and DebriSat datasets is discussed. The methodology for ensuring that conservation of overall mass of the sampled fragment cloud under this sampling approach is highlighted. Finally, the results are compared with simulated clouds generated from SSBM for specific historical breakup events.

Andrew Vavrin↗