Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stochastic Sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Stochastic Optimization and Uncertainty Quantification of Natrium-based Nuclear-Renewable Energy Systems for Flexible Power Applications in Deregulated Markets

Rapid integration of variable renewable energy sources (VRES) has made modeling and stochastic optimization of hybrid energy systems crucial for studying their long-term performance and viability. However, most studies have focused on just historical data, which may be unreliable for capturing short-term fluctuations, rare events, and long-term patterns of energy demand, price, and the variability of renewable energy sources. For this study, optimal synthetic time series models were developed using Wasserstein distance. The models were validated by comparing the key statistical measures against those of the historical data. They were then used to optimize the integrated Natrium-style advanced energy systems and their long-term (30 years) economics. The stochastic model performs bi-level optimization to find the optimal sizes for the balance of plant and thermal energy storage, while also optimizing energy dispatch to achieve the maximum net present value. In studies of two deregulated markets (California ISO and the Electric Reliability Council of Texas), the integrated Natrium-style system performed better in CAISO than in ERCOT, given higher and more consistent electricity prices during peak-demand periods. The potentially enlarged cost associated with the variable operation and maintenance of the TES system also plays a significant role in driving the system sizing, thus its impacts on the system are investigated in detail through comparison against a baseline case. The study also finds that the bi-level optimization results based on stochastic gradient descent closely match the grid search results. The uncertainty quantification of the stochastic signals provides further NPV-related insights and probability distributions for the case studies. The normal standard error of the mean of NPV for the case with and without TES VOM for CAISO were found to be 7.73M (plus-minus sign) 1.09M USD and 104.99M (plus-minus sign) 1.25M USD, respectively based on a 95% confidence. Given the relatively small NPV variance based on 150 samples, the analysis affords the most robust possible prediction of the techno-economic performance of the integrated Natrium-style energy systems.

25 ENERGY STORAGE↗

Accelerating multilevel Markov Chain Monte Carlo using machine learning models

Here, this work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian inference often substitute computationally expensive high-fidelity models with machine learning models, thereby introducing approximation errors, our approach offers a computationally efficient alternative by augmenting high-fidelity models with low-fidelity ones within a hierarchical framework. The multilevel approach utilizes the low-fidelity machine learning model (MLM) for inexpensive evaluation of proposed samples thereby improving the acceptance of samples by the high-fidelity model. The hierarchy in our multilevel algorithm is derived from geometric multigrid hierarchy. We utilize an MLM to accelerate the coarse level sampling. Training machine learning model for the coarsest level significantly reduces the computational cost associated with generating training data and training the model. We present an MCMC algorithm to accelerate the coarsest level sampling using MLM and account for the approximation error introduced. We provide theoretical proofs of detailed balance and demonstrate that our multilevel approach constitutes a consistent MCMC algorithm. Additionally, we derive the expression for cost reduction due to machine learning model to facilitate cost analysis of the hierarchical sampling algorithm. Our technique is demonstrated on a standard benchmark inference problem in groundwater flow, where we estimate the probability density of a quantity of interest using a four-level MCMC algorithm. Our proposed algorithm accelerates multilevel sampling by a factor of two while achieving similar accuracy compared to sampling using the standard multilevel algorithm.

97 MATHEMATICS AND COMPUTING↗

Seasonal controls on isolated convective storm drafts, precipitation intensity, and life cycle as observed during GoAmazon2014/5

Abstract. Isolated deep convective cloud life cycle and seasonal changes in storm properties are observed for daytime events during the US Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Green Ocean Amazon Experiment (GoAmazon2014/5) campaign to understand controls on storm behavior. Storm life cycles are documented using surveillance radar from initiation through maturity and dissipation. Vertical air velocity estimates are obtained from radar wind profiler overpasses, with the storm environment informed by radiosondes. Dry-season storm conditions favored reduced morning shallow cloud coverage and larger low-level convective available potential energy (CAPE) than wet-season counterparts. The typical dry-season storm reached its peak intensity and size earlier in its life cycle compared with wet-season cells. These cells exhibited updrafts in core precipitation regions (Z>35 dBZ) to above the melting level as well as persistent downdrafts aloft within precipitation adjacent to their cores. Moreover, dry-season cells recorded more intense updrafts to earlier life cycle stages as well as a higher incidence of strong updrafts (i.e., >5 m s−1) at low levels. In contrast, wet-season storms were longer-lived and featured a higher incidence of moderate (i.e., 2–5 m s−1) updrafts aloft. These storms also favored a shift in their most intense properties to later life cycle stages. Strong downdrafts were less frequent within wet-season cells aloft, indicating a potential systematic difference in draft behaviors, as linked to graupel loading and other factors between the seasons. Results from a stochastic parcel model suggest that dry-season cells may expect stronger updrafts at low levels because of larger low-level CAPE in the dry season. Wet-season cells anticipate strong updrafts aloft because of larger free-tropospheric relative humidity and reduced entrainment-driven dilution. Enhanced dry-season downdrafts are partially attributed to increased evaporation, dry-air entrainment mixing, and negative buoyancy in regions adjacent to sampled dry-season cores.

54 ENVIRONMENTAL SCIENCES↗

A stochastic-dynamic model for global atmospheric mass-field statistics

Global atmospheric mass field error correlations based on satellite observations and on numerical forecasts show strong and systematic latitude dependence. A model for the latitude dependent spatial correlation structure of mass field forecast errors is derived from dynamical considerations. Three methods of solution were tested. In the first method, the equation was solved by expansion in spherical harmonics, and the correlation function was computed analytically using the expansion coefficients. In the second method, the finite difference equivalent of the equation was solved using a fast poisson solver. The correlation function was computed using stratified sampling of the individual realizations. In the third method, a higher order equation was derived, and solved directly in finite differences by two successive applications of the fast poisson solver. The three methods were compared for accuracy and efficiency, and the third method was chosen as clearly superior.

Ghil, M.↗

Thermal neutron scattering measurements and modeling of yttrium-hydrides for high temperature moderator applications

In this work, thermal neutron scattering measurements of yttrium hydride from 5 to 1,200 K were conducted to determine the change in inelastic scattering as a function of temperature and to probe for anharmonic effects. Additionally, measurements on samples of YH x from x = 1.62 to 1.90 were done to determine the effects of varying hydrogen concentration on the inelastic spectra. Changes in temperature affected the inelastic spectra in unanticipated ways, indicating that there are anharmonic effects, whereas hydrogen concentration did not significantly affect the inelastic spectra. These measurements were compared against the ENDF/B-VIII.0 thermal scattering files of YH 2 , as well as new thermal scattering files created by using the stochastic temperature-dependent effective potential (s-TDEP). Both libraries were found to be in good agreement with the experimental data at lower temperatures. At higher temperatures, the s-TDEP method is better at predicting the experimentally observed softening of phonon modes in acoustic and optical regions.

36 MATERIALS SCIENCE↗

Inter-Agency Consultative Group for Space Science (IACG): Handbook of Missions and Payloads

The ACE spacecraft design is based on the Charge Composition Explorer (CCE) built by Johns Hopkins University (JHU) and the Applied Physics Lab (APL) for the AMPTE program. ACE is designed as a spinning spacecraft with its spin axis aligned to the Earth-Sun axis. The ACE launch weight will be approx. 633 kg, including 105 kg of scientific instruments and 184 kg of propellant. Using a Delta-class expendable launch vehicle, ACE will be launched into an L1 libration point (240 R(sub e)) orbit. Telemetry will be 6.7 kbps average, using tape recorder storage with daily readout to DSN. The experiment power requirement is approximately 76 W nominal and 96 W peak. The prime objective of the ACE mission is: (1) to determine accurate elemental and isotropic abundances including solar matter, local interstellar matter and local galactic matter; (2) to study the origin of elements and evolutionary processing in galactic nucleosynthesis, galactic evolution, origin and evolution of the solar system; (3) to study coronal formation and solar-wind acceleration processes; and (4) to study particle acceleration and transport, including coronal shock acceleration, stochastic flare acceleration, interplanetary shock acceleration, and interstellar acceleration and propagation. To accomplish this objective, ACE will perform comprehensive and coordinated determinations of the elemental and isotopic composition of energetic nuclei accelerated on the Sun, in interplanetary space, and from galactic sources. These observations will span five decades in energy, from solar wind to galactic cosmic ray energies, and will cover the element range from H-1 to Zr-40. Comparison of these samples of matter will be used to study the origin and subsequent evolution of both solar system and galactic material by isolating the effects of fundamental processes that include nucleosynthesis, charged and neutral particle separation, bulk plasma acceleration, and the acceleration of suprathermal and high-energy particles.

Source record↗

Wide-Field Hubble Space Telescope Observations of the Globular Cluster System in NGC 1399*

We present a comprehensive high spatial resolution imaging study of globular clusters (GCs) in NGC 1399, thecentral giant elliptical cD galaxy in the Fornax galaxy cluster, conducted with the Advanced Camera for Surveys(ACS) aboard theHubble Space Telescope(HST).Using a novel technique to construct drizzled point-spreadfunction libraries for HSTACS data, we accurately determine the fidelity of GC structural parameter measurementsfrom detailed artificial star cluster experiments and show the superior robustness of the GC half-light radius,rh,compared with other GC structural parameters, such as King core and tidal radius. The measurement ofrhfor themajor fraction of the NGC 1399 GC system reveals a trend of increasingrhversus galactocentric distance,Rgal,out to about 10 kpc and a flat relation beyond. This trend is very similar for blue and red GCs, which are found tohave a mean size ratio ofrh,redrh,blue0.820.11 at all galactocentric radii from the core regions of the galaxyout to40 kpc. This suggests that the size difference between blue and red GCs is due to internal mechanismsrelated to the evolution of their constituent stellar populations. Modeling the mass density profile of NGC 1399shows that additional external dynamical mechanisms are required to limit the GC size in the galaxy halo regionstorh2 pc. We suggest that this may be realized by an exotic GC orbit distribution function, an extended darkmatter halo, andor tidal stress induced by the increased stochasticity in the dwarf halo substructure at largergalactocentric distances. We compare our results with the GCrhdistribution functions in various galaxies and findthat the fraction of extended GCs withrh5 pc is systematically larger in late-type galaxies compared with GCsystems in early-type galaxies. This is likely due to the dynamically more violent evolution of early-type galaxies.We match our GCrhmeasurements with radial velocity data from the literature and split the resulting sample at themedianrhvalue into compact and extended GCs. We find that compact GCs show a significantly smaller line-of-sight velocity dispersion,cmp22525 km s1, than their extended counterparts,ext31721 km s1.Considering the weaker statistical correlation in the GCrhcolor and the GCrhRgalrelations, the more significantGC sizedynamics relation appears to be astrophysically more relevant and hints at the dominant influence of theGC orbit distribution function on the evolution of GC structural parameters.

Hubble↗

Fracture Network Influence on Rock Damage and Gas Transport following an Underground Explosion

Simulations of rock damage and gas transport following underground explosions that omit preexisting fracture networks in the subsurface cannot fully characterize the influence of geo-structural variability on gas transport. Previous studies do not consider the impact that fracture network structure and variability have on gas seepage. In this study, we develop a sequentially coupled, axi-symmetric model to look at the damage pattern and resulting gas breakthrough curves following an underground explosion given different fracture network realizations. We simulate 0.327 and 0.164 kT chemical explosives with burial depths of 100 m for 90 stochastically generated fracture networks. Gases quickly reach the surface in 30% of the higher yield simulations and 5% of the lower yield simulations. The fast breakthrough can be attributed to the formation of connected pathways between fractures to the surface. The formation of a connected damage pathway to the surface is not clearly correlated with the fracture intensity (P32) in our simulations. Breakthrough curves with slower transport are highly variable depending on the fracture network sample. The variability in the breakthrough behavior indicates that ignoring the influence of fracture networks on rock damage, which strongly influences the hydraulic properties following an underground explosion, will likely lead to a large underestimation of the uncertainty in the gas transport to the surface. This work highlights the need for incorporation of fracture networks into models for accurately predicting gas seepage following underground explosions.

58 GEOSCIENCES↗

Microscale Constitutive Model Sensitivity on Multiscale Modeling of Fiber Reinforced Composites

Fiber reinforced composites are desirable in applications where low weight and high strength are needed, but are susceptible to microscale variability during manufacturing, making failure predictions difficult. The impact microscale variability has on macroscale mechanical response is difficult to predict due to the computational efficiency needed to simulate many, large, high fidelity, microscale models. In this study, a multiscale approach was taken to model 3-point bend, 4-point bend, and tensile experiments of a unidirectional composite from only having microstructure scans of these samples and constituent properties from literature. These scans were sampled with different sized windows, and statistically equivalent microstructures were generated, then simulated for stiffness, strength, and fracture toughness using an efficient micromechanical. Mesoscale models were created where element sizes equaled microstructure size, and properties were assigned through sampling of microscale simulation results. First, this study showed the effect of using Weibull scaling on constituent matrix strength on macroscale response. Then, a comparison was made between different element sizes and experiments. Finally, model dimensions were fixed, and the effect of randomly distributed local properties alone was examined. Results showed that the scatter of strength and stiffness in the experiments could be predicted well using images of the microscale fiber morphologies and that using stochastic properties produced a 3% coefficient of variation of strength for all experiments.

statistical microstructure↗

Manifold Learning-Based Polynomial Chaos Expansions for High-Dimensional Surrogate Models

In this work we introduce a manifold learning-based method for uncertainty quantification (UQ) in systems describing complex spatiotemporal processes. Our first objective is to identify the embedding of a set of high-dimensional data representing quantities of interest of the computational or analytical model. For this purpose, we employ Grassmannian diffusion maps, a two-step nonlinear dimension reduction technique which allows us to reduce the dimensionality of the data and identify meaningful geometric descriptions in a parsimonious and inexpensive manner. Polynomial chaos expansion is then used to construct a mapping between the stochastic input parameters and the diffusion coordinates of the reduced space. An adaptive clustering technique is proposed to identify an optimal number of clusters of points in the latent space. The similarity of points allows us to construct a number of geometric harmonic emulators which are finally utilized as a set of inexpensive pretrained models to perform an inverse map of realizations of latent features to the ambient space and thus perform accurate out-of-sample predictions. Thus, the proposed method acts as an encoder-decoder system which is able to automatically handle very high-dimensional data while simultaneously operating successfully in the small-data regime. The method is demonstrated on two benchmark problems and on a system of advection-diffusion-reaction equations which model a first-order chemical reaction between two species. In all test cases, the proposed method is able to achieve highly accurate approximations which ultimately lead to the significant acceleration of UQ tasks.

42 ENGINEERING↗

Monte Carlo MP2-F12 for Noncovalent Interactions: The C 60 Dimer

A scalable stochastic algorithm is presented that can evaluate explicitly correlated (F12) second-order many-body perturbation (MP2) energies of weak, noncovalent, intermolecular interactions. It first transforms the formulas of the MP2 and F12 energy differences into a short sum of high-dimensional integrals of Green’s functions in real space and imaginary time. Furthermore, these integrals are then evaluated by the Monte Carlo method augmented by parallel execution, redundant-walker convergence acceleration, direct-sampling autocorrelation elimination, and control-variate error reduction. By sharing electron-pair walkers across the supermolecule and its subsystems spanned by the joint basis set, the statistical uncertainty is reduced by one to 2 orders of magnitude in the MP2 binding energy corrected for the basis-set incompleteness and superposition errors. The method predicts the MP2-F12/aug-cc-pVDZ binding energy of 19.1 ± 4.0 kcal mol –1 for the C 60 dimer at the center distance of 9.748 Å.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Comparing quantum annealing and spiking neuromorphic computing for sampling binary sparse coding QUBO problems

We consider the problem of computing a sparse binary representation of an image. Given an image and an overcomplete, non-orthonormal basis, we aim to find a sparse binary vector indicating the minimal set of basis vectors that when added together best reconstruct the given input. We formulate this problem with an L 2 loss on the reconstruction error, and an L 0 loss on the binary vector enforcing sparsity. First, we solve the sparse representation QUBOs by solving them both on a D-Wave quantum annealer with Pegasus chip connectivity, as well as on the Intel Loihi 2 spiking neuromorphic processor using a stochastic Non-equilibrium Boltzmann Machine (NEBM). Second, using Quantum Evolution Monte Carlo with Reverse Annealing and iterated warm starting on Loihi 2 to evolve the solution quality from the respective machines. We demonstrate that both quantum annealing and neuromorphic computing are suitable for solving binary sparse coding QUBOs.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Optimizing shift selection in multilevel Monte Carlo for disconnected diagrams in lattice QCD

The calculation of disconnected diagram contributions to physical signals is a computationally expensive task in Lattice QCD. To extract the physical signal, the trace of the inverse Lattice Dirac operator, a large sparse matrix, must be stochastically estimated. Because the variance of the stochastic estimator is typically large, variance reduction techniques must be employed. Multilevel Monte Carlo (MLMC) methods reduce the variance of the trace estimator by utilizing a telescoping sequence of estimators. Frequency Splitting is one such method that uses a sequence of inverses of shifted operators to estimate the trace of the inverse lattice Dirac operator, however there is no a priori way to select the shifts that minimize the cost of the multilevel trace estimation. Here we present a sampling and interpolation scheme that is able to predict the variances associated with Frequency Splitting under displacements of the underlying space time lattice. The interpolation scheme is able to predict the variances to high accuracy and therefore chooses shifts that correspond to an approximate minimum of the cost for the trace estimation. We show that Frequency Splitting with the chosen shifts displays significant speedups over multigrid deflation, and that these shifts can be used for multiple configurations within the same ensemble with no penalty to performance.

97 MATHEMATICS AND COMPUTING↗

Stochastic optimization of a uranium oxide reaction mechanism using plasma flow reactor measurements

Abstract In this work, a coupled Monte Carlo Genetic Algorithm (MCGA) approach is used to optimize a gas phase uranium oxide reaction mechanism based on plasma flow reactor (PFR) measurements. The PFR produces a steady Ar plasma containing U, O, H, and N species with high temperature regions (3000–5000 K) relevant to observing UO formation via optical emission spectroscopy. A global kinetic treatment is used to model the chemical evolution in the PFR and to produce synthetic emission signals for direct comparison with experiments. The parameter space of a uranium oxide reaction mechanism is then explored via Monte Carlo sampling using objective functions to quantify the model-experiment agreement. The Monte Carlo results are subsequently refined using a genetic algorithm to obtain an experimentally corroborated set of reaction pathways and rate coefficients. Out of 12 reaction channels targeted for optimization, four channels are found to be well constrained across all optimization runs while another three channels are constrained in select cases. The optimized channels highlight the importance of the OH radical in oxidizing uranium in the PFR. This study comprises a first step toward producing a comprehensive experimentally validated reaction mechanism for gas phase uranium molecular species formation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Dynamics of phage-host interactions in Bacteroides fragilis resolved by single-cell transcriptomics

The interactions between lytic phages and their hosts are typically studied in bulk culture, which obscures cell-cell differences in infection susceptibility or expression of protective factors. Here, we use bacterial single-cell RNA sequencing to profile the transcriptomes of ~50,000 cells from cultures of a human pathobiont, Bacteroides fragilis, infected with a lytic bacteriophage. From a single sampling, we quantified the asynchronous progression of phage infection in individual bacterial cells and reconstructed the infection timeline, characterizing both host and phage transcriptomic changes as infection unfolded. Further, we discovered phenotypic subpopulations of bacteria that remained uninfected. Each cell’s vulnerability to phage infection was influenced by expression of multiple genetic loci, most prominently phase-variable capsular polysaccharide (CPS) biosynthesis pathways and an operon predicted to encode fimbrial genes. These findings uncovered genome-wide phase variation and stochasticity that enable bacterial survival and re-growth without acquiring additional mutations. Overall, we establish bacterial single-cell RNA sequencing as a powerful platform for investigating the dynamics of host-phage interactions and revealing the roles of phase variation and stochasticity in bacterial defenses.

Bacteria↗

Interpolation as a means of shift selection for multilevel Monte Carlo with lattice displacements

The calculation of disconnected diagram contributions to physical signals is a computationally expensive task in Lattice QCD. To extract the physical signal, the trace of the inverse Lattice Dirac operator, a large sparse matrix, must be stochastically estimated. Because the variance of the stochastic estimator is typically large, variance reduction techniques must be employed. Multilevel Monte Carlo (MLMC) methods reduce the variance of the trace estimator by utilizing a telescoping sequence of estimators. Frequency Splitting is one such method that uses a sequence of inverses of shifted operators to estimate the trace of the inverse of the lattice Dirac operator, however there is no a priori way to select the shifts that minimize the cost of the multilevel trace estimation. We present a sampling and interpolation scheme that is able to predict the variances associated with Frequency Splitting under displacements of the underlying space time lattice. The interpolation scheme is able to predict the variances to high accuracy and therefore choose shifts that correspond to an approximate minimum of the cost for the trace estimation. We show that Frequency Splitting with the chosen shifts displays significant speedups over multigrid deflation

Whyte, Travis↗

Learning the ground state of a non-stoquastic quantum Hamiltonian in a rugged neural network landscape

Strongly interacting quantum systems described by non-stoquastic Hamiltonians exhibit rich low-temperature physics. Yet, their study poses a formidable challenge, even for state-of-the-art numerical techniques. Here, we investigate systematically the performance of a class of universal variational wave-functions based on artificial neural networks, by considering the frustrated spin- 1/2 1 / 2 J_1-J_2 J 1 − J 2 Heisenberg model on the square lattice. Focusing on neural network architectures without physics-informed input, we argue in favor of using an ansatz consisting of two decoupled real-valued networks, one for the amplitude and the other for the phase of the variational wavefunction. By introducing concrete mitigation strategies against inherent numerical instabilities in the stochastic reconfiguration algorithm we obtain a variational energy comparable to that reported recently with neural networks that incorporate knowledge about the physical system. Through a detailed analysis of the individual components of the algorithm, we conclude that the rugged nature of the energy landscape constitutes the major obstacle in finding a satisfactory approximation to the ground state wavefunction, and prevents learning the correct sign structure. In particular, we show that in the present setup the neural network expressivity and Monte Carlo sampling are not primary limiting factors.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Decomposing causality into its synergistic, unique, and redundant components

Causality lies at the heart of scientific inquiry, serving as the fundamental basis for understanding interactions among variables in physical systems. Despite its central role, current methods for causal inference face significant challenges due to nonlinear dependencies, stochastic interactions, self-causation, collider effects, and influences from exogenous factors, among others. While existing methods can effectively address some of these challenges, no single approach has successfully integrated all these aspects. Here, we address these challenges with SURD: Synergistic-Unique-Redundant Decomposition of causality. SURD quantifies causality as the increments of redundant, unique, and synergistic information gained about future events from past observations. The formulation is non-intrusive and applicable to both computational and experimental investigations, even when samples are scarce. We benchmark SURD in scenarios that pose significant challenges for causal inference and demonstrate that it offers a more reliable quantification of causality compared to previous methods.

applied mathematics↗