Novel intraday photovoltaic production forecasting algorithm using deep learning ensemble models.
Abstract not provided.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Abstract not provided.
Explore the source record for details and available documents.
This work reports on the current status of the global modeling of iron (Fe) deposition fluxes and atmospheric concentrations and the analyses of the differences between models, as well as between models and observations. A total of four global 3-D chemistry transport (CTMs) and general circulation (GCMs) models participated in this intercomparison, in the framework of the United Nations Joint Group of Experts on the Scientific Aspects of Marine Environmental Protection (GESAMP) Working Group 38, “The Atmospheric Input of Chemicals to the Ocean”. The global total Fe (TFe) emission strength in the models is equal to ~72 Tg Fe yr -1 (38–134 TgFeyr -1 ) from mineral dust sources and around 2.1 Tg Fe yr -1 (1.8–2.7 Tg Fe yr -1 ) from combustion processes (the sum of anthropogenic combustion/biomass burning and wildfires). The mean global labile Fe (LFe) source strength in the models, considering both the primary emissions and the atmospheric processing, is calculated to be 0.7 ( ±0.3 ) Tg Fe yr -1 , accounting for both mineral dust and combustion aerosols. The mean global deposition fluxes into the global ocean are estimated to be in the range of 10–30 and 0.2–0.4 Tg Fe yr -1 for TFe and LFe, respectively, which roughly corresponds to a respective 15 and 0.3 Tg Fe yr -1 for the multi-model ensemble model mean. The model intercomparison analysis indicates that the representation of the atmospheric Fe cycle varies among models, in terms of both the magnitude of natural and combustion Fe emissions as well as the complexity of atmospheric processing parameterizations of Fe-containing aerosols. The model comparison with aerosol Fe observations over oceanic regions indicates that most models overestimate surface level TFe mass concentrations near dust source regions and tend to underestimate the low concentrations observed in remote ocean regions. All models are able to simulate the tendency of higher Fe concentrations near and downwind from the dust source regions, with the mean normalized bias for the Northern Hemisphere ( ~14 ), larger than that of the Southern Hemisphere ( ~2.4 ) for the ensemble model mean. This model intercomparison and model–observation comparison study reveals two critical issues in LFe simulations that require further exploration: (1) the Fe-containing aerosol size distribution and (2) the relative contribution of dust and combustion sources of Fe to labile Fe in atmospheric aerosols over the remote oceanic regions.
Abstract We thank the authors for this interesting paper that highlights important ideas and concepts for the future of climate model ensembles and their storage, as well as future uses of stochastic emulators. Stochastic emulators are particularly relevant because of the statistical nature of climate model ensembles, as discussed in previous work of the authors (Castruccio et al. in J Clim 32:8511–8522, 2019; Hu and Castruccio in J Clim 34:8409–8418, 2021). We thank the authors for sharing of some of their data with us in order to illustrate this discussion. In the following, in Sect. 1 we discuss alternative techniques currently used and studied, namely lossy compression and ideas emerging from the climate modeling community, that could feed the discussion on ensemble and storage. In that section, we also present numerical results of compression performed on the data shared by the authors. In Sect. 2, we discuss the current statistical model proposed by the authors and its context. We discuss other potential uses of stochastic emulators in climate and Earth modeling.
The Atmospheric Carbon and Transport (ACT)-America NASA Earth Venture Suborbital Mission set out to improve regional atmospheric greenhouse gas (GHG) inversions by exploring the intersection of the strong GHG fluxes and vigorous atmospheric transport that occurs within the midlatitudes. In this study, two research aircraft instrumented with remote and in situ sensors to measure GHG mole fractions, associated trace gases, and atmospheric state variables collected 1,140.7 flight hours of research data, distributed across 305 individual aircraft sorties, coordinated within 121 research flight days, and spanning five 6-week seasonal flight campaigns in the central and eastern United States. Flights sampled 31 synoptic sequences, including fair-weather and frontal conditions, at altitudes ranging from the atmospheric boundary layer to the upper free troposphere. The observations were complemented with global and regional GHG flux and transport model ensembles. We found that midlatitude weather systems contain large spatial gradients in GHG mole fractions, in patterns that were consistent as a function of season and altitude. We attribute these patterns to a combination of regional terrestrial fluxes and inflow from the continental boundaries. These observations, when segregated according to altitude and air mass, provide a variety of quantitative insights into the realism of regional CO 2 and CH 4 fluxes and atmospheric GHG transport realizations. The ACT-America dataset and ensemble modeling methods provide benchmarks for the development of atmospheric inversion systems. As global and regional atmospheric inversions incorporate ACT-America’s findings and methods, we anticipate these systems will produce increasingly accurate and precise subcontinental GHG flux estimates.
This letter proposes a novel Gaussian mixture model-based ensemble Kalman filter (GMM-EnKF) approach to the accurate calibration of the parameters of machine dynamic models. This approach aims to overcome some practical challenges of machine parameter calibration. Results show the proposed approach can provide high-accuracy calibrated parameters even when the machine operates under unbalanced network conditions and the measurement noises are non-Gaussian.
Abstract. Here, computer models are ubiquitous tools used to represent systems across many scientific and engineering domains. For any given system, many computer models exist, each built on different assumptions and demonstrating variability in the ways in which these systems can be represented. This variability is known as epistemic uncertainty, i.e. uncertainty in our knowledge of how these systems operate. Two primary sources of epistemic uncertainty are (1) uncertain parameter values and (2) uncertain mathematical representations of the processes that comprise the system. Many formal methods exist to analyse parameter-based epistemic uncertainty, while process-representation-based epistemic uncertainty is often analysed post hoc, incompletely, informally, or is ignored. In this model description paper we present the multi-assumption architecture and testbed (MAAT v1.0) designed to formally and completely analyse process-representation-based epistemic uncertainty. MAAT is a modular modelling code that can simply and efficiently vary model structure (process representation), allowing for the generation and running of large model ensembles that vary in process representation, parameters, parameter values, and environmental conditions during a single execution of the code. MAAT v1.0 approaches epistemic uncertainty through sensitivity analysis, assigning variability in model output to processes (process representation and parameters) or to individual parameters. In this model description paper we describe MAAT and, by using a simple groundwater model example, verify that the sensitivity analysis algorithms have been correctly implemented. The main system model currently coded in MAAT is a unified, leaf-scale enzyme kinetic model of C 3 photosynthesis. In the Appendix we describe the photosynthesis model and the unification of multiple representations of photosynthetic processes. The numerical solution to leaf-scale photosynthesis is verified and examples of process variability in temperature response functions are provided. For rapid application to new systems, the MAAT algorithms for efficient variation of model structure and sensitivity analysis are agnostic of the specific system model employed. Therefore MAAT provides a tool for the development of novel or toy models in many domains, i.e. not only photosynthesis, facilitating rapid informal and formal comparison of alternative modelling approaches.
Ensemble density functional theory (EDFT) is a generalization of ground-state DFT, which is based on an exact formal theory of finite collections of a system's ground and excited states. EDFT in various forms has been shown to improve the accuracy of calculated energy level differences in isolated model systems, atoms, and molecules, but it is not yet clear how EDFT could be used to calculate band gaps for periodic systems. We extend the application of EDFT toward periodic systems by estimating the thermodynamic limit with increasingly large finite one-dimensional 'particle in a box' systems, which approach the uniform electron gas (UEG). Using ensemble-generalized Hartree and local spin density approximation exchange-correlation functionals, we find that corrections go to zero in the infinite limit, as expected for a metallic system. However, there is a correction to the effective mass, with results comparable to other calculations on 1D, 2D, and 3D UEGs, which indicates promise for non-trivial results from EDFT on periodic systems.
The rationale for using multi-model ensembles in climate change projections and impacts research is often based on the expectation that different models constitute independent estimates; therefore, a range of models allows a better characterisation of the uncertainties in the representation of the climate system than a single model. However, it is known that research groups share literature, ideas for representations of processes, parameterisations, evaluation data sets and even sections of model code. Thus, nominally different models might have similar biases because of similarities in the way they represent a subset of processes, or even be near-duplicates of others, weakening the assumption that they constitute independent estimates. If there are near-replicates of some models, then treating all models equally is likely to bias the inferences made using these ensembles. The challenge is to establish the degree to which this might be true for any given application. While this issue is recognised by many in the community, quantifying and accounting for model dependence in anything other than an ad-hoc way is challenging. Here we present a synthesis of the range of disparate attempts to define, quantify and address model dependence in multi-model climate ensembles in a common conceptual framework, and provide guidance on how users can test the efficacy of approaches that move beyond the equally weighted ensemble. In the upcoming Coupled Model Intercomparison Project phase 6 (CMIP6), several new models that are closely related to existing models are anticipated, as well as large ensembles from some models. We argue that quantitatively accounting for dependence in addition to model performance, and thoroughly testing the effectiveness of the approach used will be key to a sound interpretation of the CMIP ensembles in future scientific studies.
A system, method, device and computer-readable medium for creating an ensemble model of water quality. The ensemble model is generated by determining a set of optimal component models for spectral regions of a body of water, and combining the optimal models. The optimal models can be based on remote sensing data, including satellite imagery. A K-fold partition approach or a global approach can be used to determine the optimal component models, and the optimal component models can be combined through spectral space partition rules to generate an ensemble model of water quality. The ensemble model not only has improved water quality prediction ability, but also has strong spatial and temporal extensibility. The spatial and temporal extensibility of the ensemble model is fundamentally important and desirable for long-term and large-scale remote sensing monitoring and assessment of water quality.
Two massively parallel data assimilation systems in which the model forecast-error covariances are estimated from the distribution of an ensemble of model integrations are applied to the assimilation of 97-98 TOPEX/POSEIDON altimetry and TOGA/TAO temperature data into a Pacific basin version the NASA Seasonal to Interannual Prediction Project (NSIPP)ls quasi-isopycnal ocean general circulation model. in the first system, ensemble of model runs forced by an ensemble of atmospheric model simulations is used to calculate asymptotic error statistics. The data assimilation then occurs in the reduced phase space spanned by the corresponding leading empirical orthogonal functions. The second system is an ensemble Kalman filter in which new error statistics are computed during each assimilation cycle from the time-dependent ensemble distribution. The data assimilation experiments are conducted on NSIPP's 512-processor CRAY T3E. The two data assimilation systems are validated by withholding part of the data and quantifying the extent to which the withheld information can be inferred from the assimilation of the remaining data. The pros and cons of each system are discussed.
Ensemble learning approach based decision treeboost (DTB) and decision tree forest (DTF) models are introduced in order to establish quantitative structure–toxicity relationship (QSTR) for the prediction of toxicity of 1450 diverse chemicals. Eight non-quantum mechanical molecular descriptors were derived. Structural diversity of the chemicals was evaluated using Tanimoto similarity index. Stochastic gradient boosting and bagging algorithms supplemented DTB and DTF models were constructed for classification and function optimization problems using the toxicity end-point in T. pyriformis. Special attention was drawn to prediction ability and robustness of the models, investigated both in external and 10-fold cross validation processes. In complete data, optimal DTB and DTF models rendered accuracies of 98.90%, 98.83% in two-category and 98.14%, 98.14% in four-category toxicity classifications. Both the models further yielded classification accuracies of 100% in external toxicity data of T. pyriformis. The constructed regression models (DTB and DTF) using five descriptors yielded correlation coefficients (R{sup 2}) of 0.945, 0.944 between the measured and predicted toxicities with mean squared errors (MSEs) of 0.059, and 0.064 in complete T. pyriformis data. The T. pyriformis regression models (DTB and DTF) applied to the external toxicity data sets yielded R{sup 2} and MSE values of 0.637, 0.655; 0.534, 0.507 (marine bacteria) and 0.741, 0.691; 0.155, 0.173 (algae). The results suggest for wide applicability of the inter-species models in predicting toxicity of new chemicals for regulatory purposes. These approaches provide useful strategy and robust tools in the screening of ecotoxicological risk or environmental hazard potential of chemicals. - Graphical abstract: Importance of input variables in DTB and DTF classification models for (a) two-category, and (b) four-category toxicity intervals in T. pyriformis data. Generalization and predictive abilities of the constructed (c) DTB and (d) DTF regression models to predict the T. pyriformis toxicity of diverse chemicals. - Highlights: • Ensemble learning (EL) based models constructed for toxicity prediction of chemicals • Predictive models used a few simple non-quantum mechanical molecular descriptors. • EL-based DTB/DTF models successfully discriminated toxic and non-toxic chemicals. • DTB/DTF regression models precisely predicted toxicity of chemicals in multi-species. • Proposed EL based models can be used as tool to predict toxicity of new chemicals.
We develop a theoretical approach that uses physiochemical kinetics modelling to describe cell population dynamics upon progression of viral infection in cell culture, which results in cell apoptosis (programmed cell death) and necrosis (direct cell death). Several model parameters necessary for computer simulation were determined by reviewing and analyzing available published experimental data. By comparing experimental data to computer modelling results, we identify the parameters that are the most sensitive to the measured system properties and allow for the best data fitting. Our model allows extraction of parameters from experimental data and also has predictive power. Using the model we describe interesting time-dependent quantities that were not directly measured in the experiment and identify correlations among the fitted parameter values. Numerical simulation of viral infection progression is done by a rate-equation approach resulting in a system of “stiff” equations, which are solved by using a novel variant of the stochastic ensemble modelling approach. The latter was originally developed for coupled chemical reactions.
We developed a dataset of local-scale daily climate change scenarios for Japan (called ELPIS-JP) using the stochastic weather generators (WGs) LARS-WG and, in part, WXGEN. The ELPIS-JP dataset is based on the observed (or estimated) daily weather data for seven climatic variables (daily mean, maximum and minimum temperatures; precipitation; solar radiation; relative humidity; and wind speed) at 938 sites in Japan and climate projections from the multi-model ensemble of global climate models (GCMs) used in the coupled model intercomparison project (CMIP3) and multi-model ensemble of regional climate models form the Japanese downscaling project (called S-5-3). The capability of the WGs to reproduce the statistical features of the observed data for the period 1981–2000 is assessed using several statistical tests and quantile–quantile plots. Overall performance of the WGs was good. The ELPIS-JP dataset consists of two types of daily data: (i) the transient scenarios throughout the twenty-first century using projections from 10 CMIP3 GCMs under three emission scenarios (A1B, A2 and B1) and (ii) the time-slice scenarios for the period 2081–2100 using projections from three S-5- 3 regional climate models. The ELPIS-JP dataset is designed to be used in conjunction with process-based impact models (e.g. crop models) for assessment, not only the impacts of mean climate change but also the impacts of changes in climate variability, wet/dry spells and extreme events, as well as the uncertainty of future impacts associated with climate models and emission scenarios. The ELPIS-JP offers an excellent platform for probabilistic assessment of climate change impacts and potential adaptation at a local scale in Japan.
In order to execute Uncertainty Quantification (UQ) studies, the number of reads placed on the filesystem will increase. This document works through the file I/O for a climatology UQ study. The utilization of the filesystem for the above discussed will be similar for ICF and Stockpile Stewardship applications. The current state of the art for the quantification of uncertainty of a multi-physics simulation code is the utilization of an ensemble of models approach. As an overview of the ensemble of models approach, a set of uncertain input parameters is identified along with an identified set of observational and output parameters. The model is computed n number of times with each ensemble simulation using a unique set of parametric combinations of input parameters thereby creating an ensemble of simulations. Response surface models (also known as statistical emulator models, surrogate models, or meta models) are trained using the ensemble results. The response models are then convolved with observational data to further constrain input parameters and to create uncertainty bounds on the model outputs. Using the Community Climate System Model (CCSM) specifically the atmospheric component of CCSM, the Community Atmospheric Model (CAM), as the model of interest, this document provides a rough model of the demands on a filesystem that is needed to execute a UQ study on CAM. Each ensemble simulation consists of 12 simulation years and uses 384 processors on the Atlas machine. The LLNL UQ Pipeline is LLNL's standard tool to execute UQ studies. The UQ Pipeline possesses the capability to execute the ensemble simulations on LLNL's diverse set of HPC environments, produce response models, generate uncertainty bounds, and analyze the results. The process executing the LLNL UQ Pipeline is run on a different compute node from the set of concurrent, executing ensemble simulations.
Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.
Modeling physical phenomena through computational simulation increasingly relies on generating a collection of related runs, known as an ensemble. In this paper, we explore the challenges we face in developing analysis and visualization systems for large and complex ensemble data sets, which we seek to understand without having to view the results of every simulation run. Implementing approaches and ideas developed in response to this goal, we demonstrate the analysis of a 15K run material fracturing study using Slycat, our ensemble analysis system.
In this study, the prediction of wintertime extratropical cyclone activity from subseasonal to seasonal timescale in current dynamical models' reforecasts is investigated. On seasonal time scales, the North American Multi-Model Ensemble (NMME) models show skillful predictions over the eastern North Pacific, North America and the western North Atlantic with at least 5 months lead. The prediction skill is highly related to El Nino-Southern Oscillation (ENSO), as using the ENSO-related SST pattern gives rise to prediction skill with very similar spatial pattern and amplitude. On subseasonal time scales, models in the Seasonal to Sub-seasonal Prediction (S2S) dataset have skillful predictions up to 4 weeks lead over regions from the eastern North Pacific to the western Atlantic, as well as northern Europe, the eastern Atlantic and East Asia. Generally, forecast skill improves with a larger ensemble size. The subseasonal prediction skill from the Pacific to the western Atlantic is related to ENSO, and that over eastern Atlantic, Europe and East Asia are associated with stratospheric polar vortex anomalies. Current models do not show much skill from the Madden-Julian Oscillation (MJO), as the MJO impact on extratropical cyclone activity is not well captured by the models. European Centre for Medium-Range Weather Forecasts (ECMWF) model has the highest single model subseasonal prediction skill. The prediction skill in the ECMWF model is higher than its estimated potential predictability, likely because the signal-to-noise ratio is too low in the model hindcasts.