Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Classical-Quantum Algorithm for Solving Stochastic Programs

Stochastic programming provides a rigorous mathematical framework for making decisions under uncertainty in a risk-aware manner. Two-stage stochastic programming is, perhaps, the simplest form of this framework. Here the first-stage variables represent decisions that must be made "here and now" in the face of uncertainty, while the second-stage variables are decisions made after uncertain events. However, the broad adoption of stochastic programming has been hindered by computational challenges caused by the two-stage stochastic programming formulation which requires solving an ensemble of optimization problems. Using quantum amplitude estimation (QAE), quantum computers have shown the theoretic ability to compute expectations with Monte-Carlo methods with quadratically fewer samples than classical methods. In this work, we present a quantum algorithm for computing the expectation term using QAE for given first-stage decisions. Further, we detail methods of computing gradient information from the quantum calculation enabling the application of classical gradient-based optimization techniques. The result is a classical-quantum hybrid method of solving two-stage stochastic programs. These techniques are demonstrated with computational experiments based an engineering optimization problem.

97 MATHEMATICS AND COMPUTING↗

Groups of galaxies in the ROSAT north ecliptic pole survey

The X-ray properties of groups of galaxies are presented. Their distribution of luminosity and temperature appears to be associated with the extrapolation of these distributions from rich clusters of galaxies. The properties of the ensemble of groups of galaxies are almost totally unknown. Only a few X-ray observations of groups that were selected by optical methods were published so far. A sample of eight groups with 'z' inferior to 0.04, of which three have 'z' inferior to 0.03 was investigated. The temperature and the luminosity functions at one point were determined.

Henry, J. Patrick↗

Retrieval of Polar Stratospheric Cloud Microphysical Properties From Lidar Measurements: Dependence on Particle Shape Assumptions

Knowledge of particle sizes and number densities of polar stratospheric clouds (PSCs) is highly important, because they are critical parameters for the modeling of the ozone chemistry of the stratosphere. In situ measurements of PSC particles are rare. the main instrument for the accumulation of PSC data are lidar systems. Therefore the derivation of some microphysical properties of PSCS from the optical parameters measured by lidars would be highly beneficial for ozone research. Inversion of lidar data obtained in the presence of PSCs formed from crystalline particles type 11 and the various nitric acid tri Ydrrate (NAT) types cannot be easily accomplished, because a suitable scattering theory for small faceted crystals has not been readily available tip to now. As a consequence, the T-matrix method is commonly used for the interpretation of these PSC lidar data. Here the assumption is made that the optical properties of an ensemble of spheroids resemble those of crystalline PSCs, and microphysical properties of the PSC are inferred from the optical signatures of the PSC at two or more wavelengths. The problem with the T-matrix approach is that the assumption of spheroidal instead of faceted particles can lead to dramatically wrong results: Usually cloud particle properties are deduced from analysis of lidar profiles of backscatter ratio and depolarization ratio. The particle contribution to the backscatter ratio is given by the product of the particle number density and the backscattering cross section. The latter is proportional to the value of the particle's scattering phase function at 180 degrees scattering angle. At 180 degrees however, the phase functions of rough, faceted crystals and of spheroids with same maximum dimension differ by a factor of 6. From this it follows that for a PSC consisting of faceted crystals, the particle number density is underestimated by roughly the same factor if spheroidal particles are unrealistically assumed. We are currently developing a retrieval technique for determining the microphysical parameters of crystalline PSCs that takes into account the faceted shape of the PSC particles. This approach utilizes finite-difference time-domain (FDTD) calculations of particle optical properties. The accuracy and the free choice of the shape of the scattering particle make the FDTD technique a promising tool for the inversion of PSC lidar data. A first comparison of FDTD and T-matrix calculations will be presented.

Reichardt, Susanne↗

The OMPS Limb Profiler Instrument: An Alternative Data Analysis and Retrieval Algorithm

The upcoming Ozone Mapper and Profiler Suite (OMPS), which will be launched on the NPOESS Preparatory Project (NPP) platform in early 2011, will continue monitoring the global distribution of the Earth's middle atmosphere ozone and aerosol. OMPS is composed of three instruments, namely the Total Column Mapper (heritage: TOMS, OMI), the Nadir Profiler (heritage: SBUV) and the Limb Profiler (heritage: SOLSE/LORE, OSIRIS, SCIAMACHY, SAGE III). The ultimate goal of the mission is to better understand and quantify the rate of stratospheric ozone recovery. The focus of the paper will be on the Limb Profiler (LP) instrument. The LP instrument will measure the Earth fs limb radiance (which is due to the scattering of solar photons by air molecules, aerosol and Earth surface) in the ultra-violet (UV), visible and near infrared, from 285 to 1000 nm. The LP simultaneously images the whole vertical extent of the Earth's limb through three vertical slits, each covering a vertical tangent height range of 100 km and each horizontally spaced by 250 km in the cross-track direction. The focal plane of the LP spectrometer is a two ]dimensional CCD array comprised of 340 x 740 pixels. Several data analysis tools are presently being constructed and tested to retrieve ozone and aerosol vertical distribution from limb radiance measurements. The primary NASA algorithm is based on earlier algorithms developed for the SOLSE/LORE and SAGE III limb scatter missions. The paper will describe an alternative algorithm which will retrieve ozone density and aerosol extinction directly from radiance data collected on individual CCD pixels. This alternative method uses an optimal estimation approach to retrieve ozone and aerosol in the 10-60 km range from the information contained within an ensemble of about 50000 down-linked pixels. Tangent height registration is performed using the Rayleigh Scattering Attitude Sensor (RSAS) technique applied to columns of pixels in the 340-360 nm range. Cloud height is determined by analyzing the radiance first derivative along pixel columns at longer wavelengths. Wavelength registration is performed using rows of pixels and identifying Fraunhofer solar lines within the measured spectra. Special attention is given to stray-light decontamination and modeling of the measured finite spectral/spatial line shape functions.

Rault, Didier F.↗

Weather Impact on Airport Arrival Meter Fix Throughput

Time-based flow management provides arrival aircraft schedules based on arrival airport conditions, airport capacity, required spacing, and weather conditions. In order to meet a scheduled time at which arrival aircraft can cross an airport arrival meter fix prior to entering the airport terminal airspace, air traffic controllers make regulations on air traffic. Severe weather may create an airport arrival bottleneck if one or more of airport arrival meter fixes are partially or completely blocked by the weather and the arrival demand has not been reduced accordingly. Under these conditions, aircraft are frequently being put in holding patterns until they can be rerouted. A model that predicts the weather impacted meter fix throughput may help air traffic controllers direct arrival flows into the airport more efficiently, minimizing arrival meter fix congestion. This paper presents an analysis of air traffic flows across arrival meter fixes at the Newark Liberty International Airport (EWR). Several scenarios of weather impacted EWR arrival fix flows are described. Furthermore, multiple linear regression and regression tree ensemble learning approaches for translating multiple sector Weather Impacted Traffic Indexes (WITI) to EWR arrival meter fix throughputs are examined. These weather translation models are developed and validated using the EWR arrival flight and weather data for the period of April-September in 2014. This study also compares the performance of the regression tree ensemble with traditional multiple linear regression models for estimating the weather impacted throughputs at each of the EWR arrival meter fixes. For all meter fixes investigated, the results from the regression tree ensemble weather translation models show a stronger correlation between model outputs and observed meter fix throughputs than that produced from multiple linear regression method.

Machine Learning Model.↗

Evaluating proxy influence in assimilated paleoclimate reconstructions – Testing the exchangeability of two ensembles of spatial processes

Climate field reconstructions (CFR) attempt to estimate spatiotemporal fields of climate variables in the past using climate proxies such as tree rings, ice cores, and corals. Data Assimilation (DA) methods are a recent and promising new means of deriving CFRs that optimally fuse climate proxies with climate model output. Despite the growing application of DA-based CFRs, little is understood about how much the assimilated proxies change the statistical properties of the climate model data. To address this question, we propose a robust and computationally efficient method, based on functional data depth, to evaluate differences in the distributions of two spatiotemporal processes. In this study, we apply our test to study global and regional proxy influence in DA-based CFRs by comparing the background and analysis states, which are treated as two samples of spatiotemporal fields. We find that the analysis states are significantly altered from the climate-model-based background states due to the assimilation of proxies. Moreover, the difference between the analysis and background states increases with the number of proxies, even in regions far beyond proxy collection sites. Our approach allows us to characterize the added value of proxies, indicating where and when the analysis states are distinct from the background states.

54 ENVIRONMENTAL SCIENCES↗

Thermofield Theory for Finite-Temperature Electronic Structure

Wave function methods have offered a robust, systematically improvable means to study ground-state properties in quantum many-body systems. Theories like coupled cluster and their derivatives provide highly accurate approximations to the energy landscape at a reasonable computational cost. Analogues of such methods to study thermal properties, though highly desirable, have been lacking because evaluating thermal properties involve a trace over the entire Hilbert space, which is a formidable task. Besides, excited-state theories are generally not as well studied as ground-state ones. In this mini-review, we present an overview of a finite-temperature wave function formalism based on thermofield dynamics to overcome these difficulties. Thermofield dynamics allows us to map the equilibrium thermal density matrix to a pure state, i.e., a single wave function, albeit in an expanded Hilbert space. Ensemble averages become expectation values over this so-called thermal state. Around this thermal state, we have developed a procedure to generalize ground-state wave function theories to finite temperatures. As explicit examples, we highlight formulations of mean-field, configuration interaction, and coupled cluster theories for thermal properties of Fermions in the grand-canonical ensemble. To assess the quality of these approximations, we also show benchmark studies for the one-dimensional Hubbard model, while comparing against exact results. We will see that the thermal methods perform similarly to their ground-state counterparts, while merely adding a prefactor to the asymptotic computational cost. Furthermore, they also inherit all the properties, good or bad, from the ground-state methods, signifying the robustness of our formalism and the scope for future development.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

N -representability violations in truncated equation-of-motion coupled-cluster methods

One-electron reduced density matrices (1RDMs) from equation-of-motion (EOM) coupled-cluster with single and double excitations (CCSD) calculations are analyzed to assess their N-representability (i.e., whether they are derivable from a physical N-electron state). We identify EOM-CCSD stationary states whose 1RDMs violate either ensemble-state N-representability conditions or pure-state conditions known as generalized Pauli constraints. As such, these 1RDMs do not correspond to any physical N-electron state. Unphysical states are also encountered in the course of time-dependent EOM-CC simulations; when an external field drives transitions between a pair of stationary states with pure-state N-representable 1RDMs, the 1RDM of the time-dependent state can violate ensemble-state conditions. Furthermore, these observations point to potential challenges in interpreting the results of time-dependent EOM-CCSD simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Short-Term Probabilistic Solar Forecasting via Reinforcement Learning over ECMWF

In this paper, we present an innovative reinforcement learning approach for short-term solar forecasting, leveraging data from the European Centre for Medium-Range Weather Forecasts (ECMWF). The methodology begins with the application of the System Advisor Model (SAM) to transform various ECMWF numerical weather prediction members into predictive photovoltaic power generation. To enhance the precision of deterministic forecasting, we introduce a dynamic model selection algorithm based on Q-learning. This algorithm dynamically identifies and utilizes the most accurate ensemble member for forecasting purposes. Furthermore, we employ a support vector regression surrogate model with a Gaussian distribution to generate probabilistic forecasts, providing a holistic view of solar energy generation uncertainty. To expedite the training process and make it more practical for real-world applications, we integrate a rolling update workflow. This innovative workflow reduces the training period from months to a mere 19 days, making our method highly efficient. Numerical results of the case study show that in comparison to benchmark models, the proposed method improves the deterministic and probabilistic solar forecasting accuracy by up to 40.84% and 48.42%, respectively.

ensemble forecasting↗

STITCHES: creating new scenarios of climate model output by stitching together pieces of existing simulations

Abstract. Climate model output emulation has long been attempted to support impact research, mainly to fill in gaps in the scenario space. Given the computational cost of running coupled earth system models (ESMs), which are usually the domain of supercomputers and require on the order of days to weeks to complete a century-long simulation, only a handful of different scenarios are usually chosen to externally force ESM simulations. An effective emulator, able to run on standard computers in times of the order of minutes rather than days could therefore be used to derive climate information under scenarios that were not run by ESMs. Lately, the necessity of accounting for internal variability has also made the availability of initial-condition ensembles, under a specific scenario, important, further increasing the computational demand. At least so far, emulators have been limited to simplified ESM-like output, either seasonal, annual, or decadal averages of basic quantities, like temperature and precipitation, often emulated independently of one another. With this work, we propose a more comprehensive solution to ESM output emulation. Our emulator, STITCHES, uses existing archives of earth system models' (ESMs) scenario experiments to construct ESM-like output under new scenarios or enrich existing initial-condition ensembles, which is what other emulators also aim to do. Importantly, however, STITCHES' output has the same characteristics of the ESM output it sets out to emulate: multivariate, spatially resolved, and high frequency, representing both the forced component and the internal variability around it. STITCHES extends the idea of time sampling – according to which climate outcomes are stratified by the global warming level at which they manifest themselves, irrespective of the scenario and time at which they occur – to the construction of a continuous history of ESM-like output over the whole 21st century, consistent with a 21st-century trajectory of global surface air temperature (GSAT) derived from the scenario that has been chosen as the target of the emulation. STITCHES does so by first splitting the target GSAT trajectory into decade-long windows, then matching each window in turn to a decade-long window within an existing model simulation from the available scenario runs according to its proximity to the target in absolute size of the temperature anomaly and its rate of change. A look-up table is therefore created of a sequence of existing experiment–time-window combinations that, when stitched together, create a GSAT trajectory “similar” to the target. Importantly, we can then stitch together much more than GSAT from these windows, i.e., any output that the ESM has saved for these existing experiment–time-window combinations, at any frequency and spatial scale available in its archive. We show that the stitching does not introduce artifacts in the great majority of cases (we look at temperature and precipitation at monthly frequency and on the native grid of the ESM and at an index of ENSO activity, the Southern Oscillation Index). This is true even if the criteria for the identification of the decades to be stitched together are chosen to work for a smoothed time series of annual GSAT, a result we expect given the larger amount of noise affecting most other variables at finer spatial scales and higher frequencies, which therefore are more “forgiving” of the stitching. We successfully test the method's performance over many ESMs and scenarios. Only a few exceptions surface, but these less-than-optimal outcomes are always associated with a scarcity of the archived simulations from which we can gather the decade-long windows that form the building blocks of the emulated time series. In the great majority of cases, STITCHES' performance is satisfactory according to metrics that reward consistency in trends, interannual and inter-ensemble variance, and autocorrelation structure of the time series stitched together. The method therefore can be used to create ESM-like output according to new scenarios, on the basis of a trajectory of GSAT produced according to that scenario, which could be easily obtained by a simple climate model. It can also be used to increase the size of existing initial-condition ensembles. There are aspects of our emulator that will immediately disqualify it for specific applications, like when climate information is needed whose characteristics result from accumulated quantities over windows of times longer than those used as pieces by STITCHES, droughts longer than a decade for example. But for many applications, we argue that a stitched product can satisfy the climate information needs of impact researchers. STITCHES cannot emulate ESM output from scenarios that result in GSAT trajectories outside of the envelope available in the archive, nor can it emulate trajectories with shapes different from existing ones (overshoots with negative derivative, for example). Therefore, the size and characteristics of the available archives of ESM output are the principal limitations for STITCHES' deployment. Thus, we argue for the possibility of designing scenario experiments within, for example, the next phase of the Coupled Model Intercomparison Project according to new principles, relieved of the need to produce a number of similar trajectories that vary only in radiative forcing strength but more strategically covering the space of temperature anomalies and rates of change.

54 ENVIRONMENTAL SCIENCES↗

Mapping Composition Evolution through Synthesis, Purification, and Depolymerization of Random Heteropolymers

Random heteropolymers (RHPs) consisting of three or more comonomers have been routinely used to synthesize functional materials. While increasing the monomer variety diversifies the side-chain chemistry, this substantially expands the sequence space and leads to ensemble-level sequence heterogeneity. Most studies have relied on monomer composition and simulated sequences to design RHPs, but the questions remain unanswered regarding heterogeneities within each RHP ensemble and how closely these simulated sequences reflect the experimental outcomes. Here, we quantitatively mapped out the evolution of monomer compositions in four-monomer-based RHPs throughout a design-synthesis-purification-depolymerization process. By adopting a Jaacks method, we first determined 12 reactivity ratios directly from quaternary methacrylate RAFT copolymerization experiments to account for the influences of competitive monomer addition and the reversible activation/deactivation equilibria. The reliability of in silico analysis was affirmed by a quantitative agreement (<4% difference) between the simulated RHP compositions and the experimental results. Furthermore, we mapped out the conformation distribution within each ensemble in different solvents as a function of monomer chemistry, composition, and segmental characteristics via high-throughput computation based on self-consistent field theory (SCFT). These comprehensive studies confirmed monomer composition as a viable design parameter to engineer RHP-based functional materials as long as the reactivity ratios are accurately determined and the livingness of RHP synthesis is ensured.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Interpretation of autoencoder-learned collective variables using Morse–Smale complex and sublevelset persistent homology: An application on molecular trajectories

Dimensionality reduction often serves as the first step toward a minimalist understanding of physical systems as well as the accelerated simulations of them. In particular, neural network-based nonlinear dimensionality reduction methods, such as autoencoders, have shown promising outcomes in uncovering collective variables (CVs). However, the physical meaning of these CVs remains largely elusive. In this work, we constructed a framework that (1) determines the optimal number of CVs needed to capture the essential molecular motions using an ensemble of hierarchical autoencoders and (2) provides topology-based interpretations to the autoencoder-learned CVs with Morse–Smale complex and sublevelset persistent homology. Furthermore, this approach was exemplified using a series of n-alkanes and can be regarded as a general, explainable nonlinear dimensionality reduction method.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Decimated Input Ensembles for Improved Generalization

Recently, many researchers have demonstrated that using classifier ensembles (e.g., averaging the outputs of multiple classifiers before reaching a classification decision) leads to improved performance for many difficult generalization problems. However, in many domains there are serious impediments to such "turnkey" classification accuracy improvements. Most notable among these is the deleterious effect of highly correlated classifiers on the ensemble performance. One particular solution to this problem is generating "new" training sets by sampling the original one. However, with finite number of patterns, this causes a reduction in the training patterns each classifier sees, often resulting in considerably worsened generalization performance (particularly for high dimensional data domains) for each individual classifier. Generally, this drop in the accuracy of the individual classifier performance more than offsets any potential gains due to combining, unless diversity among classifiers is actively promoted. In this work, we introduce a method that: (1) reduces the correlation among the classifiers; (2) reduces the dimensionality of the data, thus lessening the impact of the 'curse of dimensionality'; and (3) improves the classification performance of the ensemble.

Tumer, Kagan↗

Combined assimilation of hydrography and TOPEX data into an Indian Ocean GCM using the adjoint method

To study seasonal circulation and meridional heat transport of the Indian Ocean by synthesizing dynamics with data, climatological monthly temperatures and salinities, surface heat and freshewater fluxes, and wind stresses, together with monthly ensembles of three years (93-95) of TOPEX-derived surface geostrophic velocity anomalies, are assimilated into an Indian Ocean GCM.

Hydrography Indian Ocean TOPEX meridional heat tra↗

An X-ray method for detecting substructure in galaxy clusters - Application to Perseus, A2256, Centaurus, Coma, and Sersic 40/6

We use the moments of the X-ray surface brightness distribution to constrain the dynamical state of a galaxy cluster. Using X-ray observations from the Einstein Observatory IPC, we measure the first moment FM, the ellipsoidal orientation angle, and the axial ratio at a sequence of radii in the cluster. We argue that a significant variation in the image centroid FM as a function of radius is evidence for a nonequilibrium feature in the intracluster medium (ICM) density distribution. In simple terms, centroid shifts indicate that the center of mass of the ICM varies with radius. This variation is a tracer of continuing dynamical evolution. For each cluster, we evaluate the significance of variations in the centroid of the IPC image by computing the same statistics on an ensemble of simulated cluster images. In producing these simulated images we include X-ray point source emission, telescope vignetting, Poisson noise, and characteristics of the IPC. Application of this new method to five Abell clusters reveals that the core of each one has significant substructure. In addition, we find significant variations in the orientation angle and the axial ratio for several of the clusters.

Mohr, Joseph J.↗

Lattice calculation of short-range contributions to neutrinoless double-beta decay 𝜋 − → 𝜋 + ⁢𝑒⁢𝑒 at physical pion mass

Neutrinoless double-beta (0⁢𝜈⁢𝛽⁢𝛽) decays provide an excellent probe for determining whether neutrinos are Dirac or Majorana fermions. The short-range matrix elements associated with the 𝜋 − → 𝜋 + ⁢𝑒⁢𝑒 process contribute at leading order in the 0⁢𝜈⁢𝛽⁢𝛽 decay channel 𝑛⁢𝑛 → 𝑝⁢𝑝⁢𝑒⁢𝑒 through pion exchange between nucleons. However, current lattice calculations show notable discrepancies in predicting these short-range contributions. To address this issue, we perform a lattice QCD calculation of the 𝜋 − → 𝜋 + ⁢𝑒⁢𝑒 matrix elements using domain wall fermion ensembles at the physical pion mass generated by the RBC/UKQCD Collaboration. To mitigate contamination from around-the-world effects, we develop a new method to reconstruct and subtract them directly from lattice data. We then perform nonperturbative renormalization in the regularization-independent symmetric momentum-subtraction scheme (RI/SMOM), using the (𝛾 𝜇 , 𝛾 𝜇 ) and ($\not{𝑞}$, $\not{𝑞}$) projectors. Compared with previous studies, this work reduces the uncertainties in the matrix elements and provides an independent cross-check that helps to reconcile the discrepancies among previous lattice calculations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Advanced Multilevel Monte Carlo Methods

This article reviews the application of some advanced Monte Carlo techniques in the context of multilevel Monte Carlo (MLMC). MLMC is a strategy employed to compute expectations, which can be biassed in some sense, for instance, by using the discretization of an associated probability law. The MLMC approach works with a hierarchy of biassed approximations, which become progressively more accurate and more expensive. Additionally, using a telescoping representation of the most accurate approximation, the method is able to reduce the computational cost for a given level of error versus i.i.d. sampling from this latter approximation. All of these ideas originated for cases where exact sampling from couples in the hierarchy is possible. This article considers the case where such exact sampling is not currently possible. We consider some Markov chain Monte Carlo and sequential Monte Carlo methods, which have been introduced in the literature, and we describe different strategies that facilitate the application of MLMC within these methods.

97 MATHEMATICS AND COMPUTING↗

Autodifferentiable Ensemble Kalman Filters

Data assimilation is concerned with sequentially estimating a temporally evolving state. This task, which arises in a wide range of scientific and engineering applications, is particularly challenging when the state is high-dimensional and the state-space dynamics are unknown. This paper introduces a machine learning framework for learning dynamical systems in data assimilation. Here, our auto-differentiable ensemble Kalman filters (AD-EnKFs) blend ensemble Kalman filters for state recovery with machine learning tools for learning the dynamics. In doing so, AD-EnKFs leverage the ability of ensemble Kalman filters to scale to high-dimensional states and the power of automatic differentiation to train high-dimensional surrogate models for the dynamics. Numerical results using the Lorenz-96 model show that AD-EnKFs outperform existing methods that use expectation-maximization or particle filters to merge data assimilation and machine learning. In addition, AD-EnKFs are easy to implement and require minimal tuning.

autodifferentiation↗