SEARCH · Engineering Papers

Results for “Non linear dynamics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Variational AutoEncoders Reveal Intensifying GPP Extremes in Continental United States based on CESM2 Simulations

Climate extremes significantly impact terrestrial carbon cycle dynamics, necessitating robust methods for detecting and analyzing anomalous behavior in plant productivity. This study presents a novel application of variational autoencoders (VAE) for identifying extreme events in gross primary productivity (GPP) from Community Earth System Model version 2 simulations across four AR6 regions in the Continental United States. We compare VAE-based anomaly detection with traditional singular spectral analysis (SSA) methods across three time periods: 1850-80, 1950-80, and 2050-80 under SSP5-8.5 scenario. The VAE architecture employs three dense layers and a latent space with input sequence length of 12 months, training on normalized GPP time series to reconstruct the GPP and identify anomalies based on reconstruction errors. Extreme events are defined using 5th percentile thresholds applied to both VAE and SSA anomalies. Results demonstrate strong regional agreement between VAE and SSA methods in spatial patterns of extreme event frequencies, despite VAE consistently producing higher threshold values (179-756 GgC for VAE vs. 100-784 GgC for SSA across regions and periods). Both methods reveal increasing magnitudes and frequencies of negative carbon cycle extremes toward 2050-80, particularly in Western and Central North America. The VAE approach shows comparable performance to established SSA techniques while offering computational advantages and enhanced capability for capturing non-linear temporal dependencies in carbon cycle variability. This research demonstrates the potential of deep learning approaches for extremes detection and provides a foundation for improved understanding of future carbon cycle risks under future conditions.

Sharma, Bharat [ORNL] (ORCID:0000000266982487)↗

DOE OSTI2024

Review: Pre-Darcy flows in low-permeability porous media

The widely used Darcy’s law specifies a linear relation between the Darcy velocity of fluid flow and the pressure gradient that drives the flow. However, studies have shown that Darcy velocity can exhibit a nonlinear dependence on the pressure gradient in low-permeability porous media such as clay and shale when the pressure gradient is adequately low. This phenomenon is referred to as low-velocity non-Darcian flow or pre-Darcy flow. This paper provides a comprehensive review of the theories, experimental data, and modeling methods for pre-Darcy flow in low-permeability porous media. The review begins by outlining the fundamental mechanisms underlying pre-Darcy flow that regulate the unique characteristics such as nonlinear dependence of the Darcy velocity on the pressure gradient and its relevance to fluid–rock interactions. The review then proceeds to present a thorough compilation of experimental investigations performed in various low-permeability geomaterials including tight sandstones, shales, and clays. Next, empirical and theoretical models and simulation methods that have been developed to fit and interpret experimental data are reviewed. Finally, the review underscores the challenges encountered in conducting and interpreting pre-Darcy flow experiments and suggests future research directions. By analyzing previous experimental investigations, this review aims to offer a valuable resource for researchers and practitioners seeking to enhance their understanding of fluid dynamics in low-permeability geomaterials. This provides insights into the application of pre-Darcy flow in numerous natural and engineered processes such as shale oil and gas recovery, contaminant transport in low-permeability aquifers, and geological disposal of nuclear waste.

58 GEOSCIENCES↗

DOE OSTI2022

Concept of circular-linear energy recovery accelerator to probe the energy frontier

Energy-frontier accelerators provide powerful tools performing high precision measurements confirming the fundamentals of the physics and broadening new research horizons. Such machines are either driven by circular or linear accelerators. The circular machines, having the centre-of-mass (CM) energy values reaching 200 GeV (for leptons) and above, experience beam energy loss and quality dilution, for example, due to synchrotron radiation, limiting the overall CM energy achievable and requiring a constant energy top-up to compensate the loss and the beam quality dilution. Linear colliders overcome these limitations, while the finite capabilities of generating high average current beams limits the luminosity. This is partially compensated by the quality of the colliding beams. In this work, we suggest a novel design of circular-linear accelerator based on the merging of the “non-emitting”, low-energy storage rings and energy recovery linear accelerators. We suggest using the recently considered dual-axis asymmetric cavities to enable the operation of such a system, and in particular the energy recovery from spent, high-intensity beams. The machine considered, under the scope of the SNOWMASS-2021 initiative, can be potentially used to reach ultimate energy frontiers in high-energy physics as well as to drive next generation light sources. The merging of circular and linear systems, and applications of dual axes cavities, should allow the maintaining of high beam quality, high luminosity, and high energy efficiency, while offering a flexible energy management and opening clear opportunity for reducing the running cost. We note that the numbers shown in the paper are for illustration purpose and can be improved further.

43 PARTICLE ACCELERATORS↗

DOE OSTI2024

Quasi-Lindblad pseudomode theory for open quantum systems

Here, we introduce a new framework to study the dynamics of open quantum systems with linearly coupled Gaussian baths. Our approach replaces the continuous bath with an auxiliary discrete set of pseudomodes with dissipative dynamics, but we further relax the complete positivity requirement in the Lindblad master equation and formulate a quasi-Lindblad pseudomode theory. We show that this quasi-Lindblad pseudomode formulation directly leads to a representation of the bath correlation function in terms of a complex weighted sum of complex exponentials, an expansion that is known to be rapidly convergent in practice and thus leads to a compact set of pseudomodes. The pseudomode representation is not unique and can differ by a gauge choice. When the global dynamics can be simulated exactly, the system dynamics is unique and independent of the specific pseudomode representation. However, the gauge choice may affect the stability of the global dynamics, and we provide an analysis of why and when the global dynamics can retain stability despite losing positivity. We showcase the performance of this formulation across various spectral densities in both bosonic and fermionic problems, finding significant improvements over conventional pseudomode formulations.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2025

Galactic echoes

Gaia has revealed a variety of substructures in the phase space of stars in the Solar neighbourhood, including the vertical ‘Snail’ $(z, v_z)$ in space. Such substructures are often interpreted as the incompletely phase-mixed response of the disc stars to a single perturbation, such as an impulsive encounter with a satellite galaxy. In this paper, we consider the possibility that such structures contain manifestations of phase-space echoes. First established in plasma physics in the 1960s, echoes arise when a collisionless system is perturbed twice: the macroscopic responses to both perturbations mix to small scales in phase space, whereupon they couple non-linearly, producing a third macroscopic ‘echo’ response without the need for a third perturbation. We derive the galactic analogue of the plasma echo theory using angle-action variables and apply it to a one-dimensional model of vertical motion in the Milky Way. We verify the predicted echo behaviour using idealized test particle simulations, both with and without the inclusion of diffusion through orbital scattering off molecular clouds. While we conclude that the Gaia Snail itself is unlikely a (pure) echo effect, the basic physics we uncover is sufficiently generic that we expect phase-space echoes to be common in disc galaxies.

Galaxy: evolution↗

DOE OSTI2022

The root-zone soil moisture spectrum in a mediterranean ecosystem

Storage of water within soil pores of the root zone introduce memory effects in the dynamics of soil moisture that are considerably longer than the integral timescale of many atmospheric processes. Thus, hydro-climatic states can be “sustained” through land-surface heat and water vapor fluxes primarily because they can “feed off” on this long-term soil moisture memory. Root-zone soil moisture memory is only but one feature characterizing the spectrum of soil moisture dynamics, which is analyzed here using a combination of long-term measurements and models. In particular, the spectrum of root-zone soil moisture content in a Mediterranean ecosystem is examined using 14-years of half-hourly measurements. A distinguishing hydro-climatic feature in such ecosystems is that sources (mainly rainfall) and sinks (mainly evapotranspiration) of soil moisture are roughly out of phase with each other. For over 4 decades of time scales and 7 decades of energy, the canonical shape of the measured soil moisture spectrum is shown to be approximately Lorentzian determined by the soil moisture variance and its memory but with two exceptions: the occurrences of a peak at diurnal-to-daily time scales and a weaker peak at near annual time scales. Model calculations and spectral analysis demonstrate that diurnal and seasonal variations in hydroclimate forcing responsible for variability in evapotranspiration had minor impact on the normalized shape of the soil moisture spectrum. However, their impact was captured by adjustments in the temporal variance. These findings indicate that precipitation and not evapotranspiration variability dominates the multi-scaling properties of soil moisture variability consistent with prior climate model simulations. Furthermore, the soil moisture memory inferred by the annual peak of soil moisture (340 d) is consistent with climate model simulations, while the memory evaluated from the loss function of a linearized mass balance approach leads to a smaller value (50 d), highlighting the effect of weak non-stationarity on soil moisture variability.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Achievements and Ongoing Challenges for advanced CFD Boiling Closure Model Development using Physical Insights from Validation-Oriented High-Fidelity Boiling Experiment

The fundamental understanding of the boiling-associated heat transfer, including sliding bubble effect, is still challenging despite the intensive research for decades in both experimental and computational boiling research communities. One of the main difficulties of boiling experiment come from the fact that direct observation of the underlying principle through experiment is very difficult due to the high complexity of the boiling phenomenon. Also, since the heat transfer characteristics associated with boiling is the result of non-linear interaction of various physical parameters coupled to each other, it is challenging to find the relationship between the parameters for modeling. This paper discusses the authors’ past and ongoing boiling research under CASL (Consortium for Advanced Simulation of Light Water Reactors) program, including the efforts to overcome the difficulties of boiling measurement and model development. In particular, we focus on describing the major achievements, lessons learnt, and ongoing challenges for the CFD boiling closure model development based on the high-fidelity subcooled flow boiling experiment at Texas A&M University (TAMU). The major research achievements discussed through this paper include (i) novel boiling measurement strategy and high-fidelity validation data production, (ii) dedicated effort to identify the critical measurement issues in boiling experiment, (iii) new physical insight into sliding bubble heat transfer mechanisms, and (iv) new boiling closure model development. Discussion is also made on the ongoing challenges for the boiling closure model development and the future research plan based on the lessons learnt.

42 ENGINEERING↗

DOE OSTI2023

Linear growth of circuit complexity from Brownian dynamics

How rapidly can a many-body quantum system generate randomness? Using path integral methods, we demonstrate that Brownian quantum systems have circuit complexity that grows linearly with time. In particular, we study Brownian clusters of N spins or fermions with time-dependent all-to-all interactions, and calculate the Frame Potential to characterize complexity growth in these models. In both cases the problem can be mapped to an effective statistical mechanics problem which we study using path integral methods. Within this framework it is straightforward to show that the kth Frame Potential comes within ϵ of the Haar value after a time of order t ~ kN + k log k + log ϵ –1 . Using a bound on the diamond norm, this implies that such circuits are capable of coming very close to a unitary k-design after a time of order t ~ kN. We also consider the same question for systems with a time-independent Hamiltonian and argue that a small amount of time-dependent randomness is sufficient to generate a k-design in linear time provided the underlying Hamiltonian is quantum chaotic. These models provide explicit examples of linear complexity growth that are analytically tractable and are directly applicable to practical applications calling for unitary k-designs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2023

Necessary and sufficient conditions for quadratic stabilizability of switched systems on non-uniform time domains

In this paper, we consider the quadratic stabilizability via state feedback for a particular class of switched systems that evolve on a non-uniform time domain by introducing time scales theory. The system considered switches between a continuous-time subsystem with variable lengths and a discrete-time subsystem with variable discrete step sizes. Necessary and sufficient conditions are derived to guarantee the quadratic stability of this class of switched systems via a switching state feedback law based on the existence of a common positive definite matrix satisfying the quadratic stabilizability condition by considering that the two subsystems are unstable. By state feedback, we mean that the switching among subsystems depends on the system states. Current results for this kind of state switching feedback control are derived only for switched systems evolving on a continuous time domain or a discrete time domain with fixed step’s size. These results are not applicable for the particular class of switched systems where there is a mixing between the continuous and discrete dynamics. This motivates the derivation of a new and more general state feedback control law for switched systems in this work. Here, a numerical example illustrating the results is presented.

42 ENGINEERING↗

DOE OSTI2022

SNICAR-ADv4: a physically based radiative transfer model to represent the spectral albedo of glacier ice

Abstract. Accurate modeling of cryospheric surface albedo is essential for our understanding of climate change as snow and ice surfaces regulate the global radiative budget and sea-level through their albedo and mass balance. Although significant progress has been made using physical principles to represent the dynamic albedo of snow, models of glacier ice albedo tend to be heavily parameterized and not explicitly connected with physical properties that govern albedo, such as the number and size of air bubbles, specific surface area (SSA), presence of abiotic and biotic light absorbing constituents (LACs), and characteristics of any overlying snow. Here, we introduce SNICAR-ADv4, an extension of the multi-layer two-stream delta-Eddington radiative transfer model with the adding–doubling solver that has been previously applied to represent snow and sea-ice spectral albedo. SNICAR-ADv4 treats spectrally resolved Fresnel reflectance and transmittance between overlying snow and higher-density glacier ice, scattering by air bubbles of varying sizes, and numerous types of LACs. SNICAR-ADv4 simulates a wide range of clean snow and ice broadband albedo (BBA), ranging from 0.88 for (30 µm) fine-grain snow to 0.03 for bare and bubble-free ice under direct light. Our results indicate that representing ice with a density of 650 kg m−3 as snow with no refractive Fresnel layer, as done previously, generally overestimates the BBA by an average of 0.058. However, because most naturally occurring ice surfaces are roughened “white ice”, we recommend modeling a thin snow layer over bare ice simulations. We find optimal agreement with measurements by representing cryospheric media with densities less than 650 kg m−3 as snow and larger-density media as bubbly ice with a Fresnel layer. SNICAR-ADv4 also simulates the non-linear albedo impacts from LACs with changing ice SSA, with peak impact per unit mass of LACs near SSAs of 0.1–0.01 m2 kg−1. For bare, bubble-free ice, LACs actually increase the albedo. SNICAR-ADv4 represents smooth transitions between snow, firn, and ice surfaces and accurately reproduces measured spectral albedos of a variety of glacier surfaces. This work paves the way for adapting SNICAR-ADv4 to be used in land ice model components of Earth system models.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Surface structure of linear nanopores in amorphous silica: Comparison of properties for different pore generation algorithms

In this work, we compare the surface structure of linear nanopores in amorphous silica (a-SiO 2 ) for different versions of “pore drilling” algorithms (where the pores are generated by the removal of atoms from the preformed bulk a-SiO 2 ) and for “cylindrical resist” algorithms (where a-SiO 2 is formed around a cylindrical exclusion region). After adding H to non-bridging O, the former often results in a moderate to high density of surface silanol groups, whereas the latter produces a low density. The silanol surface density for pore drilling can be lowered by a final dehydroxylation step, and that for the cylindrical resist approach can be increased by a final hydroxylation step. In this respect, the two classes of algorithms are complementary. We focus on the characterization of the chemical structure of the pore surface, decomposing the total silanol density into components corresponding to isolated and vicinal mono silanols and geminal silanols. The final dehyroxylation and hydroxylation steps can also be tuned to better align some of these populations with the target experimental values.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

Direct numerical simulation of supercritical oxy-methane mixing layers with CO 2 substituted counterparts

Direct numerical simulations (DNS) of temporally developing, three dimensional, CH 4 /CO 2 , CH 4 /O 2 and CO 2 /O 2 mixing layers, are conducted at a supercritical pressure of 300 atm. To effectively model the supercritical regime, the employed formulation includes the compressible form of the governing equations, the cubic Peng-Robinson equation of state and a generalized formulation for heat and mass flux vectors derived from non-equilibrium thermodynamics and fluctuation theory. A linear inviscid stability analysis is also performed for each case, to determine its most unstable wavelength. Flow visualizations reveal the presence of high density gradient magnitude regions for all three mixing layers, with conditional averages indicating increased presence of heavier fluid species within these regions. No significant departures are observed from perfect gas behavior, with compressibility factors very close to unity for all three mixing cases. Applicability of presumed probability density function methods (PDF) is examined for the three supercritical mixing layers. An a priori analysis is also conducted to investigate various simplifying assumptions employed in modeling various subgrid scale (SGS) flux models. Two additional terms are identified in the large eddy simulations (LES) equations, the gradient of SGS contribution of pressure in the momentum equation and the gradient of SGS contribution of heat flux in energy equation, whose magnitudes are similar and comparable with their respective resolved terms. The performance of the scale similarity model to represent these additional terms is investigated. Lastly, the performance of Smagorinsky, gradient and scale similarity models are also investigated.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2022

Hadron spectroscopy of pseudoscalar and vector meson photoproduction using linearly polarised photons at CLAS

The field of hadron spectroscopy is informed by experiments which study excited states of the nucleon by detecting the decay products following excitation with a hadronic, leptonic or electromagnetic probe. Experiments using a polarised beam of photons provide an important contribution to the world data. This thesis describes the analysis of data from one such experiment, the CEBAF Large Acceptance Spectrometer at Jefferson Laboratory, Virginia, USA. In the experiment, an incident beam of electrons passes through a diamond radiator producing a linearly polarised photon beam of energy from 1.1 to 2.1 GeV on a liquid hydrogen target. The analysis method and results for two reaction channels are presented. In the first analysis, the polarisation observables {?, P, T, Ox, Oz} for the reaction ??? p ? K0 S ?+ are extracted simultaneously using likelihood sampling with Markov-Chain Monte-Carlo. The results are presented as angular distributions (cos ?K0S) for bins in photon energy E? for a total of 21 bins. The values extracted for T , Ox and Oz are a first measurement of these quantities for this reaction and the beam asymmetry (?) measurement supplements the one previous measurement for this quantity and extends the energy range over which it has been extracted. The measurement of the recoil polarisation, P, is consistent with previous measurements. In a second analysis, the spin density matrix elements (SDMEs) for ? p ? p ? are extracted using similar analysis techniques. The results are presented as angular distributions (cos ?? ) for bins in photon energy E? for a total of 24 bins. This work is the first to extract all nine SDMEs for the full angular range of the ? meson production. A comparison is made to the predictions of the Vector Meson Dominance (VMD) model and the results provide evidence for contributing processes other than VMD, particularly at more backward angles of the ? meson production. The data also indicate non-helicity conserving process in both the s-channel and the t-channel. The results from the first analysis have been passed to the Juelich-Bonn theory group and the effect of including the new data within their dynamical coupled channel model is described. Several nucleon resonances are affected and the impact on the pole positions, widths and photon decay amplitudes of the affected resonances is described.

Clark, Louise↗

DOE OSTI2023

Bead–Spring Simulation of Ionomer Melts—Studying the Effects of Chain-Length and Associating Group Fraction on Equilibrium Structure and Extensional Flow Behavior

Ionomers are associative polymers with diverse applications ranging from selective membranes and high-performance adhesives to abrasion- and chemical-resistant coatings, insulation layers, vacuum packaging, and foamed sheets. Within equilibrium melt, the ionic or associating groups are known to form thermally reversible, associative clusters whose presence can significantly affect the system’s mechanical, viscoelastic, and transport properties. It is, thus, of great interest to understand how to control such clusters’ size distribution, shape, and stability through the designed choice of polymer architecture and the ionic groups’ fraction, arrangement, and interaction strength. In this work, we represent linear associating polymers using a Kremer–Grest type bead–spring model and perform large-scale MD simulations to explore the effect of polymer chain-length (l) and fraction (f s ) of randomly placed associating groups on the size distribution and stability of formed clusters. We consider different chain-lengths (below and above entanglement), varying fractions of associating groups (represented by ‘sticky’ beads) between 5 and 20%, and a fixed sticky–sticky nonbond interaction strength of four times that between regular non-associating beads. For all melts containing associating groups the equilibrium structure factor S(q) displays a signature ionomer peak at low wave vector q whose intensity increases with increasing f s and l. The average cluster size Nc increases with f s . However, the effect of chain-length on Nc appears to be pronounced only at higher values of f s . Under extensional flows, the computed stress (and viscosity) is higher at higher f s and l regardless of strain rate. Beyond a critical strain rate, we observe fragmentation of the associative clusters, which has interesting effects on the stress/viscous response.

36 MATERIALS SCIENCE↗

DOE OSTI2024

IDAES-PSE 2.5.0 Release

The Institute for the Design of Advanced Energy Systems (IDAES) Integrated Platform is a versatile computational environment offering extensive process systems engineering (PSE) capabilities for optimizing the design and operation of complex, interacting technologies and systems. IDAES enables users to efficiently search vast, complex design spaces to discover the lowest cost, most environmentally sustainable solutions while supporting the full process modeling lifecycle, from conceptual design to dynamic optimization and control. The extensible, open platform empowers users to create models of novel processes and rapidly develop custom analyses, workflows, and end-user applications. IDAES-PSE 2.5.0 Release Highlights Upcoming Changes IDAES will be switching to the new Pyomo solver interface in the next release. Whilst this will hopefully be a smooth transition for most users, there are a few important changes to be aware of. The new solver interface uses a different version of the IPOPT writer (“ipopt_v2”) and thus any custom configuration options you might have set for IPOPT will not carry over and will need to be reset. By default, the new Pyomo linear presolver will be activated with ipopt_v2. Whilst are working to identify any bugs in the presolver, it is possible that some edge cases will remain. IDAES will begin deploying a new set of scaling tools and APIs over the next few releases that make use of the new solver writers. The old scaling tools and APIs will remain for backward compatibility but will begin to be deprecated. New Models, Tools and Features New diagnostics check for near-parallel variables and constraints. New diagnostics tools for identifying causes of infeasibility in models. New example for creating a custom model of a liquid-liquid extractor unit operation. Bug Fixes Fixed bug in Gibbs reactor that caused it to appear to have additional spurious degrees of freedom. Fixed bug in the Modular Property Framework that would cause errors when trying to use phase-based material balances with phase equilibria. Fixed bug in Modular Properties Framework that caused errors when initializing models with non-vapor-liquid phase equilibria. Testing and Robustness Deployed the IDAES Diagnostics Toolbox to confirm that there are no structural or numerical issues in the core model libraries. Additional robustness tests for core model, and some associated improvements in the converge tester class. Fixed a number of issues that were causing unexpected warnings to be emitted during testing. Deprecations and Removals Removed examples for RIPE tool which has not been supported for a number of releases.

AS↗

DOE OSTI2021

Simulation-based Performance Evaluation of Model Predictive Control for Building Energy Systems

The performance of model predictive control (MPC) can be significantly affected by different choices of controller parameters such as the time intervals for model discretization and control sampling. Due to the lack of a systematic understanding on how these parameters affect control performance, they are usually selected arbitrarily in practice.In this paper, the combined impacts of selected time intervals for model discretization and control sampling on the performance of MPC are comprehensively investigated for the first time through detailed simulations. Specifically, a typical MPC strategy is first designed to improve building operations based on a reduced-order model of building dynamics. Then, the performance of the designed MPC is evaluated against different choices of time intervals for model discretization and control sampling on a simulated office building. The detailed simulation results reveal that the time interval for model discretization has a much greater influence on the performance of MPC than the time interval for control sampling. Although the time interval for control sampling usually receives more attentions in practice, it turns out that the time interval for model discretization affects the prediction performance, cost saving, and computation time simultaneously and more significantly. Therefore, the simulation-based performance evaluation presented here sheds light on the impacts of different time intervals and facilitates their selection for practical applications of MPC to building operations

Huang, Sen↗

DOE OSTI2022

Stochastic exciton-scattering theory of optical line shapes: Renormalized many-body contributions

Spectral line shapes provide a window into the local environment coupled to a quantum transition in the condensed phase. In this paper, we build upon a stochastic model to account for non-stationary background processes produced by broad-band pulsed laser stimulation, as distinguished from those for stationary phonon bath. In particular, we consider the contribution of pair-fluctuations arising from the full bosonic many-body Hamiltonian within a mean-field approximation, treating the coupling to the system as a stochastic noise term. Herein, using the Itô transformation, we consider two limiting cases for our model, which lead to a connection between the observed spectral fluctuations and the spectral density of the environment. In the first case, we consider a Brownian environment and show that this produces spectral dynamics that relax to form dressed excitonic states and recover an Anderson–Kubo-like form for the spectral correlations. In the second case, we assume that the spectrum is Anderson–Kubo like and invert to determine the corresponding background. Using the Jensen inequality, we obtain an upper limit for the spectral density for the background. The results presented here provide the technical tools for applying the stochastic model to a broad range of problems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

Robust scalable initialization for Bayesian variational inference with multi-modal Laplace approximations

Predictive modeling typically relies on Bayesian model calibration to provide uncertainty quantification. Variational inference utilizing fully independent (“mean-field”) Gaussian distributions are often used as approximate probability density functions. This simplification is attractive since the number of variational parameters grows only linearly with the number of unknown model parameters. However, the resulting diagonal covariance structure and unimodal behavior can be too restrictive to provide useful approximations of intractable Bayesian posteriors that exhibit highly non-Gaussian behavior, including multimodality. High-fidelity surrogate posteriors for these problems can be obtained by considering the family of Gaussian mixtures. Gaussian mixtures are capable of capturing multiple modes and approximating any distribution to an arbitrary degree of accuracy, while maintaining some analytical tractability. Unfortunately, variational inference using Gaussian mixtures with full-covariance structures suffers from a quadratic growth in variational parameters with the number of model parameters. The existence of multiple local minima due to strong nonconvex trends in the loss functions often associated with variational inference present additional complications, These challenges motivate the need for robust initialization procedures to improve the performance and computational scalability of variational inference with mixture models. In this work, we propose a method for constructing an initial Gaussian mixture model approximation that can be used to warm-start the iterative solvers for variational inference. The procedure begins with a global optimization stage in model parameter space. In this step, local gradient-based optimization, globalized through multistart, is used to determine a set of local maxima, which we take to approximate the mixture component centers. Around each mode, a local Gaussian approximation is constructed via the Laplace approximation. Finally, the mixture weights are determined through constrained least squares regression. The robustness and scalability of the proposed methodology is demonstrated through application to an ensemble of synthetic tests using high-dimensional, multimodal probability density functions. Here, the practical aspects of the approach are demonstrated with inversion problems in structural dynamics.

97 MATHEMATICS AND COMPUTING↗