Techno-economic uncertainty analysis of wet waste-to-biocrude via hydrothermal liquefaction
Not Available
Li, Shuyun↗
SEARCH · Engineering Papers
Results for “stochastic approximation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Toward data assimilation of ship-induced aerosol–cloud interactions
Satellite imagery can detect temporary cloud trails or ship tracks formed from aerosols emitted from large ships traversing our oceans, a phenomenon that global climate models cannot directly reproduce. Ship tracks are observable examples of marine cloud brightening, a potential solar climate intervention that shows promise in helping combat climate change. In this paper, we demonstrate a simulation-based approach in learning the behavior of ship tracks based upon a novel stochastic emulation mechanism. Our method uses wind fields to determine the movement of aerosol–cloud tracks and uses a stochastic partial differential equation (SPDE) to model their persistence behavior. This SPDE incorporates both a drift and diffusion term which describes the movement of aerosol particles via wind and their diffusivity through the atmosphere, respectively. We first present our proposed approach with examples using simulated wind fields and ship paths. We then successfully demonstrate our tool by applying the approximate Bayesian computation method-sequential Monte Carlo for data assimilation.
54 ENVIRONMENTAL SCIENCES↗
Quantum Vibronic Effects on the Electronic Properties of Molecular Crystals
We present a study of molecular crystals, focused on the effect of nuclear quantum motion and anharmonicity on their electronic properties. We consider a system composed of relatively rigid molecules, a diamondoid crystal, and one composed of floppier molecules, NAI-DMAC, a thermally activated delayed fluorescence compound. We compute fundamental electronic gaps at the density functional theory (DFT) level of theory, with the Perdew–Burke–Erzenhof (PBE) and strongly constrained and approximately normed (SCAN) functionals, by coupling first-principles molecular dynamics with a nuclear quantum thermostat. We find a sizable zero-point renormalization (ZPR) of the band gaps, which is much larger in the case of diamondoids (0.6 eV) than for NAI-DMAC (0.22 eV). We show that the frozen phonon (FP) approximation, which neglects intermolecular anharmonic effects, leads to a large error (~50%) in the calculation of the band gap ZPR. Instead, when using a stochastic method, we obtain results in good agreement with those of our quantum simulations for the diamondoid crystal. However, the agreement is worse for NAI-DMAC where intramolecular anharmonicities contribute to the ZPR. Our results highlight the importance of accurately including nuclear and anharmonic quantum effects to predict the electronic properties of molecular crystals.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
GFINNs: GENERIC formalism informed neural networks for deterministic and stochastic dynamical systems
Here we propose the GENERIC formalism informed neural networks (GFINNs) that obey the symmetric degeneracy conditions of the GENERIC formalism. GFINNs comprise two modules, each of which contains two components. We model each component using a neural network whose architecture is designed to satisfy the required conditions. The component-wise architecture design provides flexible ways of leveraging available physics information into neural networks. We prove theoretically that GFINNs are sufficiently expressive to learn the underlying equations, hence establishing the universal approximation theorem. We demonstrate the performance of GFINNs in three simulation problems: gas containers exchanging heat and volume, thermoelastic double pendulum and the Langevin dynamics. In all the examples, GFINNs outperform existing methods, hence demonstrating good accuracy in predictions for both deterministic and stochastic systems.
97 MATHEMATICS AND COMPUTING↗
AEOLUS: Advances in Experimental Design, Optimal Control, and Learning for Uncertain Complex Systems
Sustained advances in the mathematics of modeling and simulation have resulted in the capability today for routine simulation of a number of large scale complex DOE-relevant systems. As remarkable as this capability for solving the so-called forward problem is, it is typically only the first step-an inner loop within an outer loop that explores the simulation model's parameter space and decision space to characterize uncertainty in the model's predictions, learn unknown model parameters from data, design the most informative experiments, determine optimal control strategies, and create optimal designs. Broadly, what unifies all of these outer loop problems is that they are, in one form or another, optimization problems over parameter/control/design space that are constrained by complex uncertain models. To fully realize the power of scientific simulation as a basis for scientific discovery, technological innovation, and rational decision-making, it is imperative to move beyond simulation to tackle the outer loop of optimization for learning from data, experimental design, and control with complex uncertain models. When the models under consideration are large-scale and complex, and when the optimization variable and uncertain parameter spaces are high (or infinite) dimensional, this constitutes a grand challenge of the highest order, and is intractable with conventional methods. To overcome these challenges, the AEOLUS Center was established to develop a unified mathematical, computational, and statistical framework for (1) Learning predictive models from complex data via Bayesian inference and optimization, and (2) Optimizing experiments, processes, and designs using the resulting uncertain models. These problems are intractable with conventional methods, for several reasons: (1) The simulation problems that govern the inner loops of the optimization problems are expensive to execute (due to severe nonlinearity, heterogeneity, multiphysics/multiscale coupling); (2) The optimization variable and uncertain parameter spaces are high dimensional, often stemming from discretizations of infinite dimensional fields such as initial conditions, sources, or material properties. We argue that the key to overcoming these challenges is to develop new mathematical, computational, and statistical methods that exploit the structure of the Bayesian inference and optimization problems mediated by their underlying complex uncertain models. This structure includes the regularity, sparsity, geometry, low intrinsic dimensionality, and multifidelity nature of the maps from uncertain parameter/optimization variable spaces to the specific objectives targeted: Bayesian inference, optimal experimental design, and optimal control design. Black box methods developed as generic tools are incapable of exploiting this structure. To be successful, we must create, integrate, and cross-fertilize ideas across multiple areas of applied math--including approximation theory, Bayesian inference, data science, experimental design, information theory, machine learning, model reduction, optimal control theory, parallel algorithms, PDE-constrained optimization, randomized algorithms, stochastic optimization, and uncertainty quantification--all while exploiting the structure of the problems at hand. With this goal in mind, we have marshaled a team of leading authorities in these areas. While the methods we develop will be broadly applicable across a wide spectrum of DOE problems in which experiments inform models and the systems those models describe must be optimized under uncertainty, we have chosen a specific area, advanced manufacturing and materials, to drive our work. AMM is characterized by complex models across multiple scales, and is a rich source of challenging problems in inference, experimental design, and optimal control, requiring multifaceted and integrated advances in applied mathematics. As such, AMM serves as an excellent vehicle to motivate and demonstrate the advances in applied mathematics developed by our center.
97 MATHEMATICS AND COMPUTING↗
Microgrid design and multi-year dispatch optimization under climate-informed load and renewable resource uncertainty
Microgrids are an increasingly popular solution to provide energy resilience in response to increasing grid dependency and the growing impacts of climate change on grid operations. However, existing microgrid models do not currently consider the uncertain and long-term impacts of climate change when determining a set of design and operational decisions to minimize long-term costs or meet a resilience threshold. In this paper, we develop a novel scenario generation method that accounts for the uncertain effects of (i) climate change on variable renewable energy availability, (ii) extreme heat events on site load, and (iii) population and electrification trends on load growth. Additionally, we develop a two-stage stochastic programming extension of an existing microgrid design and dispatch optimization model to obtain uncertainty-informed and climate-resilient energy system decisions that minimizes long-term costs. Use of sample average approximation to validate our two case studies illustrates that the proposed methodology produces high-quality solutions that add resilience to systems with existing backup generation while reducing expected long-term costs.
24 POWER TRANSMISSION AND DISTRIBUTION↗
A statistical mechanics framework for polymer chain scission, based on the concepts of distorted bond potential and asymptotic matching
To design increasingly tough, resilient, and fatigue-resistant elastomers and hydrogels, the relationship between controllable network parameters at the molecular level (bond type, non-uniform chain length, entanglement density, etc.) to macroscopic quantities that govern damage and failure must be established. Many of the most successful constitutive models for elastomers have been rooted in statistical mechanical treatments of polymer chains. Typically, such constitutive models have used variants of the freely jointed chain model with rigid links. However, since the free energy state of a polymer chain is dominated by enthalpic bond distortion effects as the chain approaches its rupture point, bond extensibility ought to be accounted for if the model is intended to capture chain rupture. To that end, a new bond potential is supplemented to the freely jointed chain model (as derived in the u FJC framework of Buche and Silberstein (2021) and Buche et al. (2022)), which we have extended to yield a tractable, closed-form model of single chain behavior that should be amenable to continuum-level constitutive model development. Inspired by the asymptotically matched u FJC model response in both the low/intermediate chain force and high chain force regimes, a simple, quasi-polynomial bond potential energy function is derived. This bond potential exhibits harmonic behavior near the equilibrium state and anharmonic behavior for large bond stretches tending to a characteristic energy plateau (akin to the Lennard-Jones and Morse bond potentials). Using this bond potential, approximate yet highly-accurate analytical functions for bond stretch and chain force dependent upon chain stretch are established. Then, using this polymer chain model, a stochastic thermal fluctuation-driven chain rupture framework is developed. This framework is based upon a force-modified tilted bond potential that accounts for distortional bond potential energy, allowing for the derivation and subsequent calculation of the dissipated chain scission energy. Here, the cases of rate-dependent and rate-independent scission are accounted for throughout the rupture framework. The impact of Kuhn segment number on chain rupture behavior is also investigated. The model is fit to single chain mechanical response data collected from atomic force microscopy tensile tests for validation and to glean deeper insight into the molecular physics taking place. Due to their analytical nature, this polymer chain model and the associated rupture framework can in the future be implemented in finite element models accounting for fracture and fatigue in polydisperse elastomer networks.
36 MATERIALS SCIENCE↗
A Novel Noise-Aware Classical Optimizer for Variational Quantum Algorithms
A key component of variational quantum algorithms (VQAs) is the choice of classical optimizer employed to update the parameterization of an ansatz. It is well recognized that quantum algorithms will, for the foreseeable future, necessarily be run on noisy devices with limited fidelities. Thus, the evaluation of an objective function (e.g., the guiding function in the quantum approximate optimization algorithm (QAOA) or the expectation of the electronic Hamiltonian in variational quantum eigensolver (VQE)) required by a classical optimizer is subject not only to stochastic error from estimating an expected value but also to error resulting from intermittent hardware noise. Model-based derivative-free optimization methods have emerged as popular choices of a classical optimizer in the noisy VQA setting, based on empirical studies. However, these optimization methods were not explicitly designed with the consideration of noise. In this work we adapt recent developments from the “noise-aware numerical optimization” literature to these commonly used derivative-free model-based methods. We introduce the key defining characteristics of these novel noise-aware derivative-free model-based methods that separate them from standard model-based methods. In conclusion, we study an implementation of such noise-aware derivative-free model-based methods and compare its performance on demonstrative VQA simulations to classical solvers packaged in scikit-quant.
classical optimizers↗
Neutrino-driven Winds in Three-dimensional Core-collapse Supernova Simulations
Abstract In this paper, we analyze the neutrino-driven winds that emerge in 12 unprecedentedly long-duration 3D core-collapse supernova simulations done using the code F ornax . The 12 models cover progenitors with zero-age main-sequence mass between 9 and 60 solar masses. In all our models, we see transonic outflows that are at least 2 times as fast as the surrounding ejecta and that originate generically from a proto−neutron star surface atmosphere that is turbulent and rotating. We find that winds are common features of 3D simulations, even if there is anisotropic early infall. We find that the basic dynamical properties of 3D winds behave qualitatively similarly to those inferred in the past using simpler 1D models, but that the shape of the emergent wind can be deformed, very aspherical, and channeled by its environment. The thermal properties of winds for less massive progenitors very approximately recapitulate the 1D stationary solutions, while for more massive progenitors they deviate significantly owing to aspherical accretion. The Y e temporal evolution in winds is stochastic, and there can be some neutron-rich phases. Though no strong r -process is seen in any model, a weak r -process can be produced, and isotopes up to 90 Zr are synthesized in some models. Finally, we find that there is at most a few percent of a solar mass in the integrated wind component, while the energy carried by the wind itself can be as much as 10%–20% of the total explosion energy.
79 ASTRONOMY AND ASTROPHYSICS↗
Uncertainty Quantification for Data-Driven Machine Learning Models in Nuclear Engineering Applications: Where We Are and What Do We Need?
Machine learning (ML) has been leveraged to tackle a diverse range of tasks in almost all branches of nuclear engineering. Many of the successes in ML applications can be attributed to the recent performance breakthroughs in deep learning, the growing availability of computational power, data, and easy-to-use ML libraries. However, these empirical successes have often outpaced our formal understanding of the ML algorithms. An important but under-rated area is uncertainty quantification (UQ) of ML. ML-based models are subject to approximation uncertainty when they are used to make predictions, due to sources including but not limited to, data noise, data coverage, extrapolation, imperfect model architecture and the stochastic training process. The goal of this paper is to clearly explain and illustrate the importance of UQ of ML. We will elucidate the differences in the basic concepts of UQ of physics-based models and data-driven ML models. Various sources of uncertainties in physical modeling and data-driven modeling will be discussed, demonstrated, and compared. We will also present and demonstrate a few techniques to quantify the ML prediction uncertainties, including Monte Carlo dropout, deep ensemble, Bayesian neural networks, Gaussian Processes and conformal prediction. Lastly, we will discuss the need for building a verification, validation and UQ framework to establish ML credibility.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
A Stochastic Transport Model for the Cumulative Number of Fissions and Deposited Fission Energy
The stochastic theory of neutron transport is extended to describe the cumulative distribution of fission numbers and deposited fission energy in a multiplying assembly. Solutions for the probability distributions are obtained using analytical approximations and Monte Carlo simulation in lumped geometry and in symmetric homogeneous and heterogeneous spheres. The results show the development of a power-law tail in the steady state fission number and deposited energy distributions when the medium is critical, independent of the fission neutron multiplicity distribution and domain heterogeneity. In contrast, the asymptotic decay is faster than exponential in subcritical media due to rapid chain extinction and in supercritical media due to the increasing probability of chain divergence. Here, a formal asymptotic analysis of the problem in lumped geometry with an arbitrary fission neutron multiplicity confirms the existence of power-law tails at critical.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Formulation and solution approach for calibrating activity-based travel demand model-system via microsimulation
This study addresses the problem of calibrating utility-maximizing nested logit activity-based travel demand model-systems. After estimation, it is common practice to use aggregate measurements to calibrate the estimated model-system’s parameters prior to their application in transportation planning, policy making, and operations. However, calibration of activity-based model-systems has received much less attention. Existing calibration approaches are myopic heuristics in the sense that they do not consider the fundamental inter-dependencies among choice-models and do not have a systematic way to adjust model parameters. Also, other purely simulation-based approaches do not perform well in large-scale applications. In this study, we focus on utility-maximizing nested logit activity-based model-systems and calibrating aggregate statistics such as activity shares, mode shares, time-dependent & mode-specific OD flows, and time-dependent & mode-specific sensor counts. We formulate the calibration problem as a simulation-based optimization problem and propose a stochastic gradient-based solution procedure to solve it. The solution procedure relies on microsimulation to calculate expectations of the aggregate statistics of interest to the calibration problem. Additionally, we derive approximate analytical expressions for the gradient of the objective function —that are evaluated through microsimulation on mini-batches of the population. The proposed solution procedure is sensitive to the fundamental structure of the activity-based model-system and is non-myopic in considering the dependencies across its model components. The formulated optimization problem is non-convex, highly nonlinear, and potentially has multiple-minima. Lastly, we show —through a real-world application— that the proposed solution procedure outperforms other state-of-the-art purely simulation-based optimization approaches in terms of computational efficiency, stability, and convergence. We also compare various gradient-based solution algorithms to determine the best algorithm to update the parameters. This work has the potential to facilitate wider and easier application of activity-based model-systems.
97 MATHEMATICS AND COMPUTING↗
N-particle irreducible actions for stochastic fluids
We construct one- and two-particle irreducible (1PI and 2PI) effective actions for the stochastic fluid dynamics of a conserved density undergoing diffusive motion. We compute the 1PI action in one-loop order and the 2PI action in two-loop approximation. We derive a set of Schwinger-Dyson equations and regularize the resulting equations using Pauli-Villars fields. We numerically solve the Schwinger-Dyson equations for a non-critical fluid. We find that higher-loop effects summed by the Schwinger-Dyson renormalize the non-linear coupling. We also find indications of a diffuson-cascade, the appearance of n-loop correction with smaller and smaller exponential suppression.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
On-lattice kinetic Monte Carlo approaches for modeling molecular anisotropy in resveratrol crystallization
Stilbenes are a class of organic compounds with broad-ranging pharmaceutical and agricultural applications, which are typically isolated and purified through recrystallization. We are motivated by reducing experimental waste and optimizing yield via developing predictive simulations for processing-dependent crystal morphologies. Using resveratrol as a model stilbene system, we have developed an approach for simulating crystallization with molecular resolution using on-lattice kinetic Monte Carlo. In this work, we highlight modifications to the Stochastic Parallel PARticle Kinetic Simulator (SPPARKS) software package, which were essential to this application. Key enhancements include the incorporation of non-orthogonal cell shapes and monomer anisotropy approximations using bound hard spheres. This new SPPARKS application has been applied to resveratrol with attachment energy libraries obtained from density functional theory, resulting in excellent agreement with experimental morphology prediction.
crystallization↗
Testing Gravity with Realistic Gravitational Waveforms in Pulsar Timing Arrays
We consider the effects of relaxing the assumption that gravitational waves composing the stochastic gravitational wave background (SGWB) are uncorrelated between frequencies in analyses of the data from Pulsar Timing Arrays (PTAs). While individual monochromatic plane waves are often a good approximation, a background composed of astrophysical sources cannot be monochromatic since an infinite plane wave carries no signal. We consider how relaxing this assumption allows us to extract potential information about modified dispersion relations and other fundamental physics questions, as both the group and phase velocity of waves become relevant. After developing the formalism we carry out simple Gaussian wavepacket examples and then consider more realistic waveforms, such as that from binary inspirals. When the frequency evolves only slowly across the PTA temporal baseline, the monochromatic assumption at an effective mean frequency remains a good approximation and we provide scaling relations that characterize its accuracy.
Hu, Wayne↗
CI-MOR Final Report: Analysis and Validation of Critical Infrastructure Models using Model Order Reduction
This report summarizes the research and capabilities developed as part of the project “Analysis and Validation of Critical Infrastructure Models using Model Order Reduction” (CI-MOR) LDRD project. CI-MOR research enables the solution of large, complex optimization models that naturally arise in national security challenges involving critical infrastructures. Specifically, CI-MOR researchers developed methods to (1) rigorously approximate complex, nonlinear optimization formulations, (2) identify alternative near-optimal solutions, (3) accelerate optimization workflows used for complex applications, and (4) rigorously integrate domain knowledge in stochastic-process models. This report provides an overview of the research done in CI-MOR, and we describe application exemplars used to illustrate CI-MOR capabilities. Furthermore, we describe the software developed by CI-MOR that researchers can leverage to analyze new applications.
97 MATHEMATICS AND COMPUTING↗
Accurate data-driven surrogates of dynamical systems for forward propagation of uncertainty
Stochastic collocation (SC) is a well-known non-intrusive method of constructing surrogate models for uncertainty quantification. In dynamical systems, SC is especially suited for full-field uncertainty propagation that characterizes the distributions of the high-dimensional solution fields of a model with stochastic input parameters. However, due to the highly nonlinear nature of the parameter-to-solution map in even the simplest dynamical systems, the constructed SC surrogates are often inaccurate. Here, this work presents an alternative approach, where we apply the SC approximation over the dynamics of the model, rather than the solution. By combining the data-driven sparse identification of nonlinear dynamics framework with SC, we construct dynamics surrogates and integrate them through time to construct the surrogate solutions. We demonstrate that the SC-over-dynamics framework leads to smaller errors, both in terms of the approximated system trajectories as well as the model state distributions, when compared against full-field SC applied to the solutions directly. We present numerical evidence of this improvement using three test problems: a chaotic ordinary differential equation, and two partial differential equations from solid mechanics.
42 ENGINEERING↗
Integration of multiple coinflip devices for high-quality random sampling
Artificial intelligence, scientific computing, and probabilistic computing use random sampling to approximate solutions to various problems, with larger models requiring a substantial quantity of random numbers. To generate the required vast quantity of random numbers at high rates, we explore so-called “coinflip” devices, which are stochastic microelectronic devices ideally capable of independently generating random bits with a tunable weight at a high rate. However, coinflip devices are inherently analog and demonstrate nonidealities, like temperature dependence and drift, that can introduce determinism into the outputs. We present important considerations for building systems of multiple coinflip devices to produce high-quality bitstreams with low error and little dependency on previous bits. Using tunnel diodes as coinflip devices, we implement a control loop to adapt to temperature dependence and generate fair bitstreams with each device. While this can lead to dependencies between bits in a single bitstream, we demonstrate that combining results generated in parallel with individual tunnel diodes can produce fair and unpredictable bitstreams. The suitability of these bitstreams for use in probabilistic computing is then demonstrated through a Monte Carlo approximation of π.
Taylor, Brady Garland [Sandia National Laboratorie↗