Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ensembles”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Representational analysis of extended disorder in atomistic ensembles derived from total scattering data

With the increased availability of high-intensity time-of-flight neutron and synchrotron X-ray scattering sources that can access wide ranges of momentum transfer, the pair distribution function method has become a standard analysis technique for studying disorder of local coordination spheres and at intermediate atomic separations. In some cases, rational modeling of the total scattering data (Bragg and diffuse) becomes intractable with least-squares approaches, necessitating reverse Monte Carlo simulations using large atomistic ensembles. However, the extraction of meaningful information from the resulting atomistic ensembles is challenging, especially at intermediate length scales. Representational analysis is used here to describe the displacements of atoms in reverse Monte Carlo ensembles from an ideal crystallographic structure in an approach analogous to tight-binding methods. Rewriting the displacements in terms of a local basis that is descriptive of the ideal crystallographic symmetry provides a robust approach to characterizing medium-range order (and disorder) and symmetry breaking in complex and disordered crystalline materials. Lastly, this method enables the extraction of statistically relevant displacement modes (orientation, amplitude and distribution) of the crystalline disorder and provides directly meaningful information in a locally symmetry-adapted basis set that is most descriptive of the crystal chemistry and physics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

InSituNet: Deep Image Synthesis for Parameter Space Exploration of Ensemble Simulations

We propose InSituNet, a deep learning based surrogate model to support parameter space exploration for ensemble simulations that are visualized in situ. In situ visualization, generating visualizations at simulation time, is becoming prevalent in handling large-scale simulations because of the I/O and storage constraints. However, in situ visualization approaches limit the flexibility of post-hoc exploration because the raw simulation data are no longer available. Although multiple image-based approaches have been proposed to mitigate this limitation, those approaches lack the ability to explore the simulation parameters. Our approach allows flexible exploration of parameter space for large-scale ensemble simulations by taking advantage of the recent advances in deep learning. Specifically, we design InSituNet as a convolutional regression model to learn the mapping from the simulation and visualization parameters to the visualization results. With the trained model, users can generate new images for different simulation parameters under various visualization settings, which enables in-depth analysis of the underlying ensemble simulations. We demonstrate the effectiveness of InSituNet in combustion, cosmology, and ocean simulations through quantitative and qualitative evaluations.

deep learning↗

Ensemble docking to difficult targets in early-stage drug discovery: Methodology and application to fibroblast growth factor 23

Ensemble docking is now commonly used in early-stage in silico drug discovery and can be used to attack difficult problems such as finding lead compounds which can disrupt protein–protein interactions. We give an example of this methodology here, as applied to fibroblast growth factor 23 (FGF23), a protein hormone that is responsible for regulating phosphate homeostasis. The first small-molecule antagonists of FGF23 were recently discovered by combining ensemble docking with extensive experimental target validation data (Science Signaling, 9, 2016, ra113). Here, we provide a detailed account of how ensemble-based high-throughput virtual screening was used to identify the antagonist compounds discovered in reference (Science Signaling, 9, 2016, ra113). Moreover, we perform further calculations, redocking those antagonist compounds identified in reference (Science Signaling, 9, 2016, ra113) that performed well on drug-likeness filters, to predict possible binding regions. These predicted binding modes are rescored with the molecular mechanics Poisson–Boltzmann surface area (MM/PBSA) approach to calculate the most likely binding site. Furthermore, our findings suggest that the antagonist compounds antagonize FGF23 through the disruption of protein–protein interactions between FGF23 and fibroblast growth factor receptor (FGFR).

59 BASIC BIOLOGICAL SCIENCES↗

Autodifferentiable Ensemble Kalman Filters

Data assimilation is concerned with sequentially estimating a temporally evolving state. This task, which arises in a wide range of scientific and engineering applications, is particularly challenging when the state is high-dimensional and the state-space dynamics are unknown. This paper introduces a machine learning framework for learning dynamical systems in data assimilation. Here, our auto-differentiable ensemble Kalman filters (AD-EnKFs) blend ensemble Kalman filters for state recovery with machine learning tools for learning the dynamics. In doing so, AD-EnKFs leverage the ability of ensemble Kalman filters to scale to high-dimensional states and the power of automatic differentiation to train high-dimensional surrogate models for the dynamics. Numerical results using the Lorenz-96 model show that AD-EnKFs outperform existing methods that use expectation-maximization or particle filters to merge data assimilation and machine learning. In addition, AD-EnKFs are easy to implement and require minimal tuning.

autodifferentiation↗

A scalable framework for the global offline community land model ensemble simulation

Current earth system models have a large range of uncertainty, owing to differences in the simulation of feedbacks and insufficient information to constrain model parameters. Parameter disturbance experiment provides a straightforward method to quantify the variation (uncertainty) outputs caused by model inputs. Owing to the software complexity and computational intensity of earth system models, a large-scale simulation framework is needed to support ensemble simulation required by parameter disturbance experiment. This paper presents a parallel framework for the community land model ensemble simulation. After a software structure review of the community land model simulation, a single factor parameter disturbance experiment of a reference computational experiment design is used to demonstrate the software design principles, computational characteristics of individual application, parallel ensemble simulation implementation, as well as the weak scalability of this simulation framework on a high-end computer. Lastly, the paper discusses some preliminary diagnostic analysis results of the single factor parameter disturbance experiments. The framework design considerations and implementation details described in this paper can be beneficial to many other research programmes involving large scale, legacy modelling system.

58 GEOSCIENCES↗

Machine learning for postprocessing ensemble streamflow forecasts

Skillful streamflow forecasts can inform decisions in various areas of water policy and management. We integrate numerical weather prediction ensembles, distributed hydrological model, and machine learning to generate ensemble streamflow forecasts at medium-range lead times (1–7 days). We demonstrate the application of machine learning as postprocessor for improving the quality of ensemble streamflow forecasts. Our results show that the machine learning postprocessor can improve streamflow forecasts relative to low-complexity forecasts (e.g., climatological and temporal persistence) as well as standalone hydrometeorological modeling and neural network. The relative gain in forecast skill from postprocessor is generally higher at medium-range timescales compared to shorter lead times; high flows compared to low–moderate flows, and the warm season compared to the cool ones. Overall, our results highlight the benefits of machine learning in many aspects for improving both the skill and reliability of streamflow forecasts.

54 ENVIRONMENTAL SCIENCES↗

First Principles Investigations for the Ensemble Effects of PdAu and PtAu Bimetallic Nanocatalysts (Final Technical Report)

Bimetallic surfaces with tunable chemical properties have attracted broad attention in recent years due to their ample potential for heterogeneous catalysis applications. The local chemical properties of constituents are strongly altered from their parent metals by 'ligand effect', a term encompassing the influences of charge transfer, orbital rehybridization and lattice strain. In comparison to the aforementioned, the 'ensemble effect' associated with particular arrangements of the active constituents have received much less attention, despite their notable importance towards the determination of reactivity and selectivity of bimetallic catalysts. We performed theoretical studies for understanding the ensemble effects on bimetallic catalysis: (i) simulations for the formation of different ensembles on PdAu and PtAu nanoclusters; (ii) studies of the size, shape, and substrate dependence of their electronic properties; and (iii) simulations for model reactions such as CO oxidation, methanol, ethylene and water dehydrogenation on PdAu and PtAu nanoclusters. In close collaboration with leading experimental groups, our theoretical research elucidated the fundamentals of Au based bimetallic nanocatalysts.

10 SYNTHETIC FUELS↗

In Silico Prediction of the Toxicity of Nitroaromatic Compounds: Application of Ensemble Learning QSAR Approach

In this work, a dataset of more than 200 nitroaromatic compounds is used to develop Quantitative Structure–Activity Relationship (QSAR) models for the estimation of in vivo toxicity based on 50% lethal dose to rats (LD 50 ). An initial set of 4885 molecular descriptors was generated and applied to build Support Vector Regression (SVR) models. The best two SVR models, SVR_A and SVR_B, were selected to build an Ensemble Model by means of Multiple Linear Regression (MLR). The obtained Ensemble Model showed improved performance over the base SVR models in the training set (R 2 = 0.88), validation set (R 2 = 0.95), and true external test set (R 2 = 0.92). The models were also internally validated by 5-fold cross-validation and Y-scrambling experiments, showing that the models have high levels of goodness-of-fit, robustness and predictivity. The contribution of descriptors to the toxicity in the models was assessed using the Accumulated Local Effect (ALE) technique. The proposed approach provides an important tool to assess toxicity of nitroaromatic compounds, based on the ensemble QSAR model and the structural relationship to toxicity by analyzed contribution of the involved descriptors.

54 ENVIRONMENTAL SCIENCES↗

Principles of Bayesian Ensemble Creation: Theoretical and Empirical Observations

Bayesian methods are theoretically optimal given their underlying assumptions. Bayesian model averaging (BMA) is generally considered the standard model for creating ensembles of learners using Bayesian methods, but this technique is often out-performed by more ad hoc methods in empirical studies. It has been proposed that Bayesian model averaging struggles in practice because it accounts for uncertainty about which model is the data-generating model but still operates under the assumption that only one of them is. Thus, BMA is unable to enrich the hypothesis space as effectively as other ensemble creation methods, serving as a form of optimal model selection, not optimal model combination. This work provides empirical verification for this hypothesis using both synthetic and real-world data. We propose several different approaches for Bayesian model combination, and demonstrate that they overcome this problem with BMA. We empirically show that even the most simplistic of Bayesian model combination strategies can compete with the traditional ad hoc techniques of bagging, boosting and stacking, as well as significantly outperforming BMA over a wide variety of cases. We also explore the implications of this observation as it relates to the effectiveness of ensemble learning.

97 MATHEMATICS AND COMPUTING↗

Uncertainty Visualization Challenges in Decision Systems with Ensemble Data & Surrogate Models: Preprint

Uncertainty visualization is a key component in translating important insights from ensemble data into actionable decision-making by visually conveying various aspects of uncertainty within a system. With the recent advent of fast surrogate models for computationally expensive simulations, users can interact with more aspects of data spaces than ever before. However, the integration of ensemble data with surrogate models in a decision-making tool brings up new challenges for uncertainty visualization, namely how to reconcile and communicate the new and different types of uncertainties brought in by surrogates and how to utilize these new data estimates in actionable ways. In this work, we examine these issues as they relate to high-dimensional data visualization, the integration of discrete datasets and the continuous representations of those datasets, and the unique difficulties associated with systems that allow users to iterate between input and output spaces. We assess the role of uncertainty visualization in facilitating intuitive and actionable interaction with ensemble data and surrogate models, and highlight key challenges in this new frontier of computational simulation.

ensemble visualization↗

Utilizing ensemble learning for performance and power modeling and improvement of parallel cancer deep learning CANDLE benchmarks

Abstract Machine learning (ML) continues to grow in importance across nearly all domains in modeling to learn from data. Often a tradeoff exists between a model's ability to minimize bias and variance. In this article, we utilize ensemble learning to combine linear, nonlinear, and tree‐/rule‐based ML methods to cope with the bias‐variance tradeoff and result in more accurate models. We use the datasets collected for two parallel cancer deep learning CANDLE benchmarks, NT3 and P1B2, to build performance and power models based on hardware performance counters using single‐object and multiple‐objects ensemble learning to identify the most important counters for improvement on the Cray XC40 Theta at Argonne National Laboratory. Based on the insights from these models, we improve the performance and energy of P1B2 and NT3 by optimizing the deep learning environments TensorFlow, Keras, Horovod, and Python under the huge page size of 8 MB. Experimental results show that ensemble learning not only produces more accurate models but also provides more robust performance counter ranking. We achieve up to 61.15% performance improvement and up to 62.58% energy saving for P1B2 and up to 55.81% performance improvement and up to 52.60% energy saving for NT3 on up to 24,576 cores.

Wu, Xingfu↗

Ensembles of Networks Produced from Neural Architecture Search

Neural architecture search (NAS) is a popular topic at the intersection of deep learning and high performance computing. NAS focuses on optimizing the architecture of neural networks along with their hyperparameters in order to produce networks with superior performance. Much of the focus has been on how to produce a single best network to solve a machine learning problem, but as NAS methods produce many networks that work very well, this affords the opportunity to ensemble these networks to produce an improved result. Additionally, the diversity of network structures produced by NAS drives a natural bias towards diversity of predictions produced by the individual networks. This results in an improved ensemble over simply creating an ensemble that contains duplicates of the best network architecture retrained to have unique weights.

Herron, Emily↗

Holevo information and ensemble theory of gravity

Holevo information is an upper bound for the accessible classical information of an ensemble of quantum states. In this work, we use Holevo information to investigate the ensemble theory interpretation of quantum gravity. We study the Holevo information in random tensor network states, where the random parameters are the random tensors at each vertex. Based on the results in random tensor network models, we propose a conjecture on the holographic bulk formula of the Holevo information in the gravity case. As concrete examples of holographic systems, we compute the Holevo information in the ensemble of thermal states and thermo-field double states in the Sachdev-Ye-Kitaev model. The results are consistent with our conjecture.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Matrix ensembles with global symmetries and ’t Hooft anomalies from 2d gauge theory

The Hilbert space of a quantum system with internal global symmetry $\textit{G}$ decomposes into sectors labelled by irreducible representations of $\textit{G}$. If the system is chaotic, the energies in each sector should separately resemble ordinary random matrix theory. We show that such “sector-wise” random matrix ensembles arise as the boundary dual of two- dimensional gravity with a $\textit{G}$ gauge field in the bulk. Within each sector, the eigenvalue density is enhanced by a nontrivial factor of the dimension of the representation, and the ground state energy is determined by the quadratic Casimir. We study the consequences of ’t Hooft anomalies in the matrix ensembles, which are incorporated by adding specific topological terms to the gauge theory action. The effect is to introduce projective representations into the decomposition of the Hilbert space. Finally, we consider ensembles with $\textit{G}$ symmetry and time reversal symmetry, and analyze a simple case of a mixed anomaly between time reversal and an internal $\mathbb{Z}$ 2 symmetry.

2D Gravity↗

The lion, the witch, and the wormhole: ensemble averaging the symmetric product orbifold

Abstract We consider the ensemble average of two dimensional symmetric product orbifold CFTs Sym N (𝕋 D ) over the Narain moduli space. We argue for a bulk dual given byNcopies of an abelian Chern-Simons theory coupled to topological gravity, endowed with a discrete gauge symmetry exchanging theNcopies. As a check of this proposal, we calculate the ensemble average of various partition and correlation functions of the symmetric product orbifold theory and compare the resulting expressions to gauge theory quantities in the bulk. We comment on the ensemble average of the tensionless string partition function on AdS 3 × S 3 × 𝕋 4 by considering the specific case ofD= 4 with the addition of supersymmetry.

Physics↗

Trends and low frequency variability of extra-tropical cyclone activity in the ensemble of twentieth century reanalysis

An objective cyclone tracking algorithm is applied to twentieth century reanalysis (20CR) 6-hourly mean sea level pressure fields for the period 1871–2010 to infer historical trends and variability in extra-tropical cyclone activity. The tracking algorithm is applied both to the ensemble-mean analyses and to each of the 56 ensemble members individually. The ensemble-mean analyses are found to be unsuitable for accurately determining cyclone statistics. However, pooled cyclone statistics obtained by averaging statistics from individual members generally agree well with statistics from the NCEP-NCAR reanalyses for 1951–2010, although 20CR shows somewhat weaker cyclone activity over land and stronger activity over oceans. Both reanalyses show similar cyclone trend patterns in the northern hemisphere (NH) over 1951–2010. Homogenized pooled cyclone statistics are analyzed for trends and variability. Conclusions account for identified inhomogeneities, which occurred before 1949 in the NH and between 1951 and 1985 in the southern hemisphere (SH). Cyclone activity is estimated to have increased slightly over the period 1871–2010 in the NH. More substantial increases are seen in the SH. Notable regional and seasonal variations in trends are evident, as is profound decadal or longer scale variability. For example, the NH increases occur mainly in the mid-latitude Pacific and high-latitude Atlantic regions. For the North Atlantic-European region and southeast Australia, the 20CR cyclone trends are in agreement with trends in geostrophic wind extremes derived from in-situ surface pressure observations. European trends are also consistent with trends in the mean duration of wet spells derived from rain gauge data in Europe.

Meteorology & Atmospheric Sciences↗

Assessing probabilistic predictions of ENSO phase and intensity from the North American Multimodel Ensemble

Here we examine the skill of three, five, and seven-category monthly ENSO probability forecasts (1982–2015) from single and multi-model ensemble integrations of the North American Multimodel Ensemble (NMME) project. Three-category forecasts are typical and provide probabilities for the ENSO phase (El Niño, La Niña or neutral). Additional forecast categories indicate the likelihood of ENSO conditions being weak, moderate or strong. The level of skill observed for differing numbers of forecast categories can help to determine the appropriate degree of forecast precision. However, the dependence of the skill score itself on the number of forecast categories must be taken into account. For reliable forecasts with same quality, the ranked probability skill score (RPSS) is fairly insensitive to the number of categories, while the logarithmic skill score (LSS) is an information measure and increases as categories are added. The ignorance skill score decreases to zero as forecast categories are added, regardless of skill level. For all models, forecast formats and skill scores, the northern spring predictability barrier explains much of the dependence of skill on target month and forecast lead. RPSS values for monthly ENSO forecasts show little dependence on the number of categories. However, the LSS of multimodel ensemble forecasts with five and seven categories show statistically significant advantages over the three-category forecasts for the targets and leads that are least affected by the spring predictability barrier. These findings indicate that current prediction systems are capable of providing more detailed probabilistic forecasts of ENSO phase and amplitude than are typically provided.

54 ENVIRONMENTAL SCIENCES↗

Assessing mean climate change signals in the global CORDEX-CORE ensemble

The new Coordinated Output for Regional Evaluations (CORDEX-CORE) ensemble provides high-resolution, consistent regional climate change projections for the major inhabited areas of the world. It serves as a solid scientific basis for further research related to vulnerability, impact, adaptation and climate services in addition to existing CORDEX simulations. The aim of this study is to investigate and document the climate change information provided by the CORDEX-CORE simulation ensemble, as a part of the World Climate Research Programme (WCRP) CORDEX community. An overview of the annual and monthly mean climate change information in selected regions in different CORDEX domains is presented for temperature and precipitation, providing the foundation for detailed follow-up studies and applications. Initially, two regional climate models (RCMs), REMO and RegCM were used to downscale global climate model output. The driving simulations by AR5 global climate models (AR5-GCMs) were selected to cover the spread of high, medium, and low equilibrium climate sensitivity at a global scale. The CORDEX-CORE ensemble has doubled the spatial resolution compared to the previously existing CORDEX simulations in most of the regions (25 $\,\mathrm {km}$ (0.22 $^{\circ }$ /jats:inline-formula>) versus 50 $\,\mathrm {km}$ (0.44 $^{\circ }$ )) leading to a potentially improved representation of, e.g., physical processes in the RCMs. The analysis focuses on changes in the IPCC physical climate reference regions. The results show a general reasonable representation of the spread of the temperature and precipitation climate change signals of the AR5-GCMs by the CORDEX-CORE simulations in the investigated regions in all CORDEX domains by mostly covering the AR5 interquartile range of climate change signals. The simulated CORDEX-CORE monthly climate change signals mostly follow the AR5-GCMs, although for specific regions they show a different change in the course of the year compared to the AR5-GCMs, especially for RCP8.5, which needs to be investigated further in region specific process studies.

54 ENVIRONMENTAL SCIENCES↗