Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “numerical continuation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

From canyons to valleys: Numerically continuing sticky-hard-sphere clusters to the landscapes of smoother potentials

Here, we study the energy landscapes of particles with short-range attractive interactions as the range of the interactions increases. Starting with the set of local minima for 6 ≤ $\textit{N}$ ≤ 12 hard spheres that are “sticky,” i.e., they interact only when their surfaces are exactly in contact, we use numerical continuation to evolve the local minima (clusters) as the range of the potential increases, using both the Lennard-Jones and Morse families of interaction potentials. As the range increases, clusters merge, until at long ranges only one or two clusters are left. We compare clusters obtained by continuation with different potentials and find that for short and medium ranges, up to about 30% of particle diameter, the continued clusters are nearly identical, both within and across families of potentials. For longer ranges, the clusters vary significantly, with more variation between families of potentials than within a family. We analyze the mechanisms behind the merge events and find that most rearrangements occur when a pair of nonbonded particles comes within the range of the potential. An exception occurs for nonharmonic clusters, i.e., those that have a zero eigenvalue in their Hessian, which undergo a more global rearrangement.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Structure-aware Initialization via Numerical Continuation and Informed Priors

Scientific machine learning (SciML) often operates in ill-conditioned, weakly identifiable regimes due to limited data or indirect observations. In such settings, optimization and inference are highly sensitive to the starting point, making initialization--often under-reported--a consequential degree of freedom. Random initialization is not a neutral default as it induces an implicit prior over candidate solutions and can systematically bias the result, producing large run-to-run variability. Here, we formalize this view by treating initialization as a hidden confounder in SciML and develop a unifying theory for structure-aware initialization via numerical continuation, constructing warm starts from related problem instances. Across representative tasks, including physics-informed neural networks, maximum likelihood estimation, and variational inference, warm starts have been shown to consistently reduce optimization effort and improve reliability.

Data integrity↗

Spatially quasi-periodic bifurcations from periodic traveling water waves and a method for detecting bifurcations using signed singular values

We present a method of detecting bifurcations by locating zeros of a signed version of the smallest singular value of the Jacobian. This enables the use of quadratically convergent root-bracketing techniques or Chebyshev interpolation to locate bifurcation points. Only positive singular values have to be computed, though the method relies on the existence of an analytic or smooth singular value decomposition (SVD). The sign of the determinant of the Jacobian, computed as part of the bidiagonal reduction in the SVD algorithm, eliminates slope discontinuities at the zeros of the smallest singular value. We use the method to search for spatially quasi-periodic traveling water waves that bifurcate from large-amplitude periodic waves. The water wave equations are formulated in a conformal mapping framework to facilitate the computation of the quasi-periodic Dirichlet-Neumann operator. We find examples of pure gravity waves with zero surface tension and overhanging gravity-capillary waves. In both cases, the waves have two spatial quasi-periods whose ratio is irrational. We follow the secondary branches via numerical continuation beyond the realm of linearization about solutions on the primary branch to obtain traveling water waves that extend over the real line with no two crests or troughs of exactly the same shape. The pure gravity wave problem is of relevance to ocean waves, where capillary effects can be neglected. Such waves can only exist through secondary bifurcation as they do not persist to zero amplitude. The gravity-capillary wave problem demonstrates the effectiveness of using the signed smallest singular value as a test function for multi-parameter bifurcation problems. This test function becomes mesh independent once the mesh is fine enough.

97 MATHEMATICS AND COMPUTING↗

Method for simultaneous characterization and expansion of reference libraries for small molecule identification

A variational autoencoder (VAE) has been developed to learn a continuous numerical, or latent, representation of molecular structure to expand reference libraries for small molecule identification. The VAE has been extended to include a chemical property decoder, trained as a multitask network, to shape the latent representation such that it assembles according to desired chemical properties. The approach is unique in its application to metabolomics and small molecule identification, focused on properties that are obtained from experimental measurements (m/z, CCS) paired with its training paradigm, which involves a cascade of transfer learning iterations. First, molecular representation is learned from a large dataset of structures with m/z labels. Next, in silico property values are used to continue training. Finally, the network is further refined by being trained with the experimental data. The trained network is used to predict chemical properties directly from structure and generate candidate structures with desired chemical properties. The network is extensible to other training data and molecular representations, and for use with other analytical platforms, for both chemical property and feature prediction as well as molecular structure generation.

Colby, Sean M.↗

Deep learning to generate in silico chemical property libraries and candidate molecules for small molecule identification in complex samples

Comprehensive and unambiguous identification of small molecules in complex samples will revolutionize our understanding of the role of metabolites in biological systems. Existing and emerging technologies have enabled measurement of chemical properties of molecules in complex mixtures and, in concert, are sensitive enough to resolve even stereoisomers. Despite these experimental advances, small molecule identification is inhibited by (i) chemical reference libraries (e.g. mass spectra, collision cross section, and other measurable property libraries) representing <1% of known molecules, limiting the number of possible identifications, and (ii) the lack of a method to generate candidate matches directly from experimental features (i.e. without a library). To this end, we developed a variational autoencoder (VAE) to learn a continuous numerical, or latent, representation of molecular structure to expand reference libraries for small molecule identification. We extended the VAE to include a chemical property decoder, trained as a multitask network, in order to shape the latent representation such that it assembles according to desired chemical properties. The approach is unique in its application to metabolomics and small molecule identification, with its focus on properties that can be obtained from experimental measurements (m/z, CCS) paired with its training paradigm, which involved a cascade of transfer learning iterations. First, molecular representation is learned from a large dataset of structures with m/z labels. Next, in silico property values are used to continue training, as experimental property data is limited. Finally, the network is further refined by being trained with the experimental data. This allows the network to learn as much as possible at each stage, enabling success with progressively smaller datasets without overfitting. Once trained, the network can be used to predict chemical properties directly from structure, as well as generate candidate structures with desired chemical properties. Our approach is orders of magnitude faster than first-principles simulation for CCS property prediction. Additionally, the ability to generate novel molecules along manifolds, defined by chemical property analogues, positions DarkChem as highly useful in a number of application areas, including metabolomics and small molecule identification, drug discovery and design, chemical forensics, and beyond.

Colby, Sean M.↗

Large-scale harmonic balance simulations with Krylov subspace and preconditioner recycling

The multi-harmonic balance method combined with numerical continuation provides an efficient framework to compute a family of time-periodic solutions, or response curves, for large-scale, nonlinear mechanical systems. The predictor and corrector steps repeatedly solve a sequence of linear systems that scale by the model size and number of harmonics in the assumed Fourier series approximation. In this paper, a novel Newton–Krylov iterative method is embedded within the multi-harmonic balance and continuation algorithm to efficiently compute the approximate solutions from the sequence of linear systems that arise during the prediction and correction steps. Further, the method recycles, or reuses, both the preconditioner and the Krylov subspace generated by previous linear systems in the solution sequence. A delayed frequency preconditioner refactorizes the preconditioner only when the performance of the iterative solver deteriorates. The GCRO-DR iterative solver recycles a subset of harmonic Ritz vectors to initialize the solution subspace for the next linear system in the sequence. The performance of the iterative solver is demonstrated on two exemplars with contact-type nonlinearities and benchmarked against a direct solver with traditional Newton–Raphson iterations.

97 MATHEMATICS AND COMPUTING↗

CRNT4SBML: a Python package for the detection of bistability in biochemical reaction networks

Motivation: Signaling pathways capable of switching between two states are ubiquitous within living organisms. They provide the cells with the means to produce reversible or irreversible decisions. Switchlike behavior of biological systems is realized through biochemical reaction networks capable of having two or more distinct steady states which are dependent on initial conditions. Investigation of whether a certain signaling pathway can confer bistability involves a substantial amount of hypothesis testing. The cost of direct experimental testing can be prohibitive. Therefore, constraining the hypothesis space is highly bene?cial. One such methodology is based on Chemical Reaction Network Theory which uses computational techniques to rule out pathways that are not capable of bistability regardless of kinetic constant values and molecule concentrations. Although useful, these methods are complicated from both pureandcomputationalmathematicsperspectives.Thus,theiradoptionisverylimitedamongstbiologists. Results: We brought Chemical Reaction Network Theory approaches closer to experimental biologists by automating all the necessary steps in CRNT4SMBL. The input is based on SBML format which is the community standard for biological pathway communication. The tool parses SBML and derives C-graph representations of the biological pathway with mass action kinetics. Next steps involve an ef?cient search for potential saddle-node bifurcation points using an optimization technique. This type of bifurcation is important as it has the potential of acting as a switching point between two steady states. Finally, if any bifurcation points are present, numerical continuation analysis extends the equilibria branches for generating the diagram. Presence of an S-shaped bifurcation diagram indicates that the pathway acts as a bistable switch for the given optimization parameters. Availability: CRNT4SBML is available via the Python Package Index. The documentation can be found at https://crnt4sbml.readthedocs.io. CRNT4SBML is licensed under the Apache Software License 2.0. Contact: vladislav.petyuk@pnnl.gov

Reyes, Brandon C.↗

A numerical approach for detecting switch-like bistability in mass action chemical reaction networks with conservation laws

Theoretical analysis of signaling pathways can provide a substantial amount of insight into their function. One particular area of research considers signaling pathways capable of assuming two or more stable states given the same amount of signaling ligand. This phenomenon of bistability can give rise to switch-like behavior, a mechanism that governs cellular decision making. Investigation of whether or not a signaling pathway can confer bistability and switch-like behavior, without knowledge of specific kinetic rate constant values, is a mathematically challenging problem. Recently a technique based on optimization has been introduced, which is capable of finding example parameter values that confer switch-like behavior for a given pathway. Although this approach has made it possible to analyze moderately sized pathways, it is limited to reaction networks that presume a uniterminal structure. It is this limited structure we address by developing a general technique that applies to any mass action reaction network with conservation laws. In this paper we developed a generalized method for detecting switch-like bistable behavior in any mass action reaction network with conservation laws. The method involves (1) construction of a constrained optimization problem using the determinant of the Jacobian of the underlying rate equations, (2) minimization of the objective function to search for conditions resulting in a zero eigenvalue, (3) computation of a confidence level that describes if the global minimum has been found and (4) evaluation of optimization values, using either numerical continuation or directly simulating the ODE system, to verify that a bistability region exists. The generalized method has been tested on three motifs known to be capable of bistability. We have developed a variation of an optimization-based method for the discovery of bistability, which is not limited to uniterminal chemical reaction networks. Successful completion of the method provides an S-shaped bifurcation diagram, which indicates that the network acts as a bistable switch for the given optimization parameters.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Automatically adaptive stabilized finite elements and continuation analysis for compaction banding in geomaterials

Under compressive creep, viscoplastic solids experiencing internal mass transfer processes can accommodate singular cnoidal wave solutions as material instabilities at the stationary wave limit. These instabilities appear when the loading rate is significantly faster than the material's capacity to diffusive internal perturbations, leading to localized failure features (e.g., cracks and compaction bands). These cnoidal waves, generally found in fluids, have strong nonlinearities that produce periodic patterns. Due to the singular nature of the solutions, the applicability of the theory is currently limited. Additionally, practical simulation tools require proper regularization to overcome the challenges that singularity induces. We focus on the numerical treatment of the governing equation using a nonlinear approach building on a recent adaptive stabilized finite element method. This automatic refinement method provides an error estimate that drives mesh adaptivity, a crucial feature for the problem at hand. We compare the performance of this adaptive strategy against analytical and standard finite element solutions. We then investigate the sensitivity of the diffusivity ratio, the parameter controlling the process, and identify multiple possible solutions with several stress peaks. We also show the evolution of the spacing between peaks for all solutions as a function of that parameter.

42 ENGINEERING↗

Deep reinforcement learning for complex evaluation of one-loop diagrams in quantum field theory

In this paper we present a technique based on deep reinforcement learning that allows for numerical analytic continuation of integrals that are often encountered in one-loop diagrams in quantum field theory. To extract certain quantities of two-point functions, such as spectral densities, mass poles or multiparticle thresholds, it is necessary to perform an analytic continuation of the correlator in question. At one-loop level in Euclidean space, this results in the necessity to deform the integration contour of the loop integral in the complex plane of the square of the loop momentum, to avoid nonanalyticities in the integration plane. Using a toy model for which an exact solution is known, we train a reinforcement learning agent to perform the required contour deformations. We report our study shows great promise for an agent to be deployed in iterative numerical approaches used to compute nonperturbative two-point functions, such as the quark propagator Dyson-Schwinger equation, or more generally, Fredholm equations of the second kind, in the complex domain.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Convectively coupled Rossby–Gravity waves in a field campaign: How they are captured in reanalysis products

Abstract Convectively coupled equatorial waves are a significant source of atmospheric variability in the tropics. Current numerical models continue to struggle in simulating the coupled diabatic heating fields that are responsible for the development and maintenance of these waves. This study investigates how the diabatic fields associated with Mixed Rossby–Gravity waves (MRGs) are represented in four reanalysis products by using a unique observational dataset from the TRMM‐KWAJEX (Tropical Rainfall Measuring Mission‐Kwajalein Experiment) field campaign. These reanalyses include ERA5, Japanese 55‐year Reanalysis (JRA‐55), Climate Forecast System Reanalysis (CFSR), and Modern‐Era Retrospective Analysis for Research and Applications (MERRA). We found that all four reanalyses captured the MRG structures in winds and temperature, and to a lesser degree in the humidity field except in the boundary layer. However, only the ERA5 and MERRA reanalyses captured the gradual rise and succession of the diabatic heating from boundary layer turbulence, shallow convection, cumulus congestus, and deep convection within the waves. ERA5 is the only product that also captured the gradual rise of the subgrid‐scale vertical transport of moist static energy. All reanalysis products underestimated the diabatic heating from cumulus congestus. Results provide observational basis on what aspects of MRG can be trusted and what cannot in the reanalysis products.

Wang, Xiaocong↗

A high accuracy/resolution spectral element/Fourier–Galerkin method for the simulation of shoaling non-linear internal waves and turbulence in long domains with variable bathymetry

A high-order hybrid continuous-Galerkin numerical method, designed for the simulation of non-linear, non -hydrostatic internal waves and turbulence in long computational domains with complex bathymetry, is presented. The spatial discretization in the non-periodic wave-propagating directions, utilizes the nodal spectral element method. Such a high-order element-based discretization allows the highly accurate representation of complex domain geometry along with the flexibility of concentrating resolution in areas of interest. Under the assumption of the normal-to-isobath propagation of non-linear internal waves, a third periodic direction is incorporated via a Fourier-Galerkin discretization. The distinct non-hydrostatic nature of non-linear internal waves and, any instabilities and turbulence therein, necessitates the numerically challenging solution of the pressure Poisson problem. A defining feature of this work is the application of a domain decomposition approach, combined with block-Jacobi/deflation-based preconditioning to the pressure Poisson problem. Such a combined approach is particularly suitable for the long high aspect-ratio complex domains of interest and enables the efficient high-accuracy reproduction of the non-hydrostatic dynamics of non-linear internal waves. Implementation details are also described in the context of the stability of the solver and its parallelization strategy. A series of benchmarks of increasing complexity demonstrate the robustness of the flow solver. The benchmarks culminate with the three-dimensional simulation of a convectively breaking mode-one non-linear internal wave over a realistic South-China-Sea bathymetric transect and background current/stratification profiles.

Deflation↗

Pairing Correlations across the Superfluid Phase Transition in the Unitary Fermi Gas

In the two-component Fermi gas with a contact interaction, a pseudogap regime can exist at temperatures between the superfluid critical temperature $T_c$ and a temperature $T^\ast > T_c$. This regime is characterized by pairing correlations without superfluidity. However, in the unitary limit of infinite scattering length, the existence of this regime is still debated. To help address this, we have applied finite-temperature auxiliary-field quantum Monte Carlo (AFMC) methods to study the thermodynamics of the superfluid phase transition and signatures of the pseudogap in the spin-balanced homogeneous unitary Fermi gas. We present results at finite filling factor $\textit{ν}$ ≃ 0.06 for the condensate fraction, an energy-staggering pairing gap, the spin susceptibility, and the heat capacity, and compare them to experimental data when available. In contrast to previous AFMC simulations, our model space consists of the complete first Brillouin zone of the lattice, and our calculations are performed in the canonical ensemble of fixed particle number. The canonical ensemble AFMC framework enables the calculation of a model-independent gap, providing direct information on pairing correlations without the need for numerical analytic continuation. We use finite-size scaling to estimate $T_c$ at the corresponding filling factor. In this work, we find that the energy-staggering pairing gap vanishes above $T_c$, showing no pseudogap effects, and that the spin susceptibility shows a substantially reduced signature of a spin gap compared to previously reported AFMC simulations.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Real-Frequency Response Functions at Finite Temperature

Building on previous developments [A. Taheridehkordi, S. H. Curnoe, and J. P. F. LeBlanc, Phys. Rev. B 99, 035120 (2019); A. Taheridehkordi, S. H. Curnoe, and J. P. F. LeBlancPhys. Rev. B101, 125109 (2020); A. Taheridehkordi, S. H. Curnoe, and J. P. F. LeBlancPhys. Rev. B102, 045115 (2020), B. Holm and U. von Barth, Phys. Rev. B 57, 2108 (1998), J. Vičičevic and M. Ferrero, Phys. Rev. B 101, 075113 (2020)], we show that the diagrammatic Monte Carlo technique allows us to compute finite-temperature response functions directly on the real-frequency axis within any field-theoretical formulation of the interacting fermion problem. There are no limitations on the type and nature of the system’s action or whether partial summation and self-consistent treatment of certain diagram classes are used. In particular, by eliminating the need for numerical analytic continuation from a Matsubara representation, our scheme allows us to study spectral densities of arbitrary complexity with controlled accuracy in models with frequency-dependent effective interactions. Finally, for illustrative purposes we consider the problem of the plasmon linewidth in a homogeneous electron gas (jellium).

3-dimensional systems↗

Deep Reinforcement Learning for Distribution System Restoration Using Distributed Energy Resources and Tie-Switches

Distributed energy resources (DERs), such as solar PVs and energy storage, can be used to restore distribution system critical loads after the extreme weather events to increase grid resilience. However, coordinating multiple DERs together with tie-switches for multi-step restoration process under renewable uncertainty is challenging. This paper proposes a deep reinforcement learning to control discrete actions of switching on/off tie switches and DERs for critical load restoration. The restoration problem is first cast into the Markov decision process suitable for DRL. Then, the original soft actor critic (SAC) method for continuous actions has been extended to handle discrete and continuous actions. Numerical comparison results with other stochastic optimization-based approaches on the modified IEEE 33-bus system show that the proposed method can achieve fast critical load restoration in the presence of substation power outage while maintaining system voltage limit throughout the restoration process.

active distribution systems↗

Expanding the representation of aerosol, cloud, and precipitation processes with graph network-based simulators

We explored a novel framework for simulating the small-scale processes that drive the evolution of aerosol, cloud, and precipitation particles, which are a critical gap in the predictive understanding of weather and climate. Particle-based methods have emerged as an effective tool for modeling aerosol-cloud-precipitation interactions, but existing particle-based models are computationally too expensive to simulate the large domains relevant for the atmosphere or to represent the full suite of relevant processes. The lack of a comprehensive and efficient reference model is a critical bottleneck in our understanding of cloud and precipitation processes and our ability to parameterize these processes for regional- and global-scale simulations. To address this need, we explored an approach to accelerate and expand particle-based models using a new machine learning approach, graph network-based simulators (GNS). Rather than modeling the evolution of the system by numerically integrating continuity equations, the GNS represents dynamics through learned message passing. Our aim was to develop fast and accurate surrogate models for particle-based simulations. We explored applying GNS to simulate cloud droplet transport, growth, and evaporation under turbulent conditions, but we found the GNS over-smoothed the simulations. We then applied the GNS to simulate aerosol dynamics through gas condensation and found the GNS was able to reproduce the benchmark, physics-based simulation with high accuracy.

54 ENVIRONMENTAL SCIENCES↗

Systems, methods and computer program products for collaborative agent control

Systems, methods and unmanned agents for collaboratively controlling agents in a collaborative network by one or more agents continuously simulating numeric models of one or more other agents in the network to dramatically reduce the computational bandwidth required between agents, and improve the quality of shared estimates of the agent locations as well as the locations and characteristics of other objects of interest, e.g. targets. Bandwidth is reduced by using the models to intelligently filter data before communicating.

Buerger, Stephen↗

Contribution to the IRPHEP handbook since Physor 2018

The Organisation for Economic Co-operation and Development (OECD), the Nuclear Energy Agency (NEA), the International Reactor Physics Experiment Evaluation Project (IRPhEP) continue to preserve and evaluate integral reactor physics experiment data to support nuclear energy and technology needs. International contributions are collated within the International Handbook of Evaluated Reactor Physics Benchmark Experiments (IRPhEP Handbook). The 2021 edition of the IRPhEP Handbook now contains data for 57 unique nuclear facilities with benchmark specifications for 169 experimental series, of which four are draft evaluations. Distributed with the IRPhEP Handbook and available online is the IRPhEP Database and Analysis Tool (IDAT), allowing users to search and interrogate the data. Since Physor 2018, there have been 11 minor revisions to existing benchmark evaluations, significant revisions to two evaluations, one draft evaluation, and nine new evaluations. The corona virus pandemic has delayed international activities supporting the production of additional content for the IRPhEP Handbook. However, efforts continue for numerous endeavors to complete new reactor physics benchmark evaluations to support current and future validation needs. Those interested in serving as evaluators and/or reviewers are strongly encouraged to participate. This paper provides a summary of IRPhEP content and activities since Physor 2018. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗