Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Variational approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

LATTE: open-source, high-performance traveltime computation, tomography and source location in acoustic and elastic media

Traveltime-based tomography and source location are fundamental approaches for imaging subsurface structures and understanding the spatiotemporal distribution of seismicity from local to global scales. We present an open-source, high-performance framework integrating eikonal equation solvers and adjoint-state theory for traveltime computation, velocity tomography, source location and joint tomography-location in 2-D/3-D acoustic and elastic media. We introduce novel regularization schemes based on total generalized p-variation, structural similarity and multitask machine learning to enhance the fidelity and interpretability of inverted models and source locations. Key features of our implementation also include the ability to leverage both absolute-difference and double-difference traveltime misfits for high-fidelity velocity tomography and source parameter estimation; support for traveltime computation and inversion in diverse 2-D/3-D scenarios with arbitrary source and receiver distributions; and a perturbation-based optimal step-size estimation method to reduce computational costs. In addition, our implementation employs shared-memory and distributed-memory parallelization to provide an efficient solution for traveltime computation, tomography, and source location. In conclusion, we validate the efficacy and accuracy of our approach through multiple synthetic data examples.

58 GEOSCIENCES↗

Unsupervised physics-informed disentanglement of multimodal data

Here, we introduce physics-informed multimodal autoencoders (PIMA) - a variational inference framework for discovering shared information in multimodal datasets. Individual modalities are embedded into a shared latent space and fused through a product-of-experts formulation, enabling a Gaussian mixture prior to identify shared features. Sampling from clusters allows cross-modal generative modeling, with a mixture-of-experts decoder that imposes inductive biases from prior scientific knowledge and thereby imparts structured disentanglement of the latent space. This approach enables cross-modal inference and the discovery of features in high-dimensional heterogeneous datasets. Consequently, this approach provides a means to discover fingerprints in multimodal scientific datasets and to avoid traditional bottlenecks related to high-fidelity measurement and characterization of scientific datasets.

97 MATHEMATICS AND COMPUTING↗

B-PINNs: Bayesian Physics-informal Neural Networks for Forward and Inverse PDE Problems with Noisy Data

We propose a Bayesian physics-informed neural network (B-PINN) to solve both forward and inverse nonlinear problems described by partial differential equations (PDEs) and noisy data. In this Bayesian framework, the Bayesian neural network (BNN) combined with a PINN for PDEs serves as the prior while the Hamiltonian Monte Carlo (HMC) or the variational inference (VI) could serve as an estimator of the posterior. B-PINNs make use of both physical laws and scattered noisy measurements to provide predictions and quantify the aleatoric uncertainty arising from the noisy data in the Bayesian framework. Compared with PINNs, in addition to uncertainty quantification, B-PINNs obtain more accurate predictions in scenarios with large noise due to their capability of avoiding overfitting. We conduct a systematic comparison between the two different approaches for the B-PINNs posterior estimation (i.e., HMC or VI), along with dropout used for quantifying uncertainty in deep neural networks. Our experiments show that HMC is more suitable than VI with mean field Gaussian approximation for the B-PINNs posterior estimation, while dropout employed in PINNs can hardly provide accurate predictions with reasonable uncertainty. Finally, we replace the BNN in the prior with a truncated Karhunen-Loève (KL) expansion combined with HMC or a deep normalizing flow (DNF) model as posterior estimators. The KL is as accurate as BNN and much faster but this framework cannot be easily extended to high-dimensional problems unlike the BNN based framework.

Non linear PDEs, Noisy data, Bysian physics inform↗

A novel methodology for gamma-ray spectra dataset procurement over varying standoff distances and source activities

The adoption of machine learning approaches for gamma-ray spectroscopy has received considerable attention in the literature. Many studies have investigated the deployment of various algorithm architectures to a specific task. However, little attention has been afforded to the development of the datasets leveraged to train the models. Such training datasets typically span a set of environmental or detector parameters to encompass a problem space of interest to a user. Variations in these measurement parameters will also induce fluctuations in the detector response, including expected pile-up and ground scatter effects. Fundamental to this work is the understanding that 1) the underlying spectral shape varies as the measurement parameters change and 2) the statistical uncertainties associated with two spectra impact their level of similarity. While previous studies attribute some arbitrary discretization to the measurement parameters for the generation of their synthetic training data, this work introduces a principled methodology for efficient spectral-based discretization of a problem space. A signal-to-noise ratio (SNR) respective spectral comparison measure and a Gaussian Process Regression (GPR) model are used to predict the spectral similarity across a range of measurement parameters. This innovative approach effectively showcased its capability by dividing a problem space, ranging from 5 cm to 100 cm standoff distances and 5 μCi–100 μCi of 137 Cs, into three unique combinations of measurement parameters. The findings from this work will aid in creating more robust datasets, which incorporate many possible measurement scenarios, reduce the number of required experimental test set measurements, and possibly enable experimental training data collection for gamma-ray spectroscopy.

data science↗

Assessing the Atmospheric Response to Subgrid Surface Heterogeneity in the Single-Column Community Earth System Model, Version 2 (CESM2)

Land-atmosphere interactions are central to the evolution of the atmospheric boundary layer and the subsequent formation of clouds and precipitation. Existing global climate models represent these connections with bulk approximations on coarse spatial scales, but observations suggest that small-scale variations in surface characteristics and co-located turbulent and momentum fluxes can significantly impact the atmosphere. Recent model development efforts have attempted to capture this phenomenon by coupling existing representations of subgrid-scale (SGS) heterogeneity between land and atmosphere models. Such approaches are in their infancy and it is not yet clear if they can produce a realistic atmospheric response to surface heterogeneity. Here, we implement a parameterization to capture the effects of SGS heterogeneity in the Community Earth System Model (CESM2), and compare single-column simulations against high-resolution Weather Research and Forecasting (WRF) large-eddy simulations (LESs), which we use as a proxy for observations. The CESM2 experiments increase the temperature and humidity variances in the lowest atmospheric levels, but the response is weaker than in WRF-LES. In part, this is attributed to an underestimate of surface heterogeneity in the land model due to a lack of SGS meteorology, a separation between deep and shallow convection schemes in the atmosphere, and a lack of explicitly represented mesoscale secondary circulations. These results highlight the complex processes involved in capturing the effects of SGS heterogeneity and suggest the need for parameterizations that communicate their influence not only at the surface but also vertically.

54 ENVIRONMENTAL SCIENCES↗

Dependence of the impurity transport on the dominant turbulent regime in ELM-y H-mode discharges on the DIII-D tokamak

Laser blow-off injections of aluminum and tungsten have been performed on the DIII-D tokamak to investigate the variation of impurity transport in a set of dedicated ion and electron heating scans with a fixed value of the external torque. The particle transport is quantified via the Bayesian inference method, which, constrained by a combination of a charge exchange recombination spectroscopy, soft X-ray measurements, and VUV spectroscopy provides a detailed uncertainty quantification of transport coefficients. Contrasting discharge phases with a dominant electron and ion heating reveal 3-fold drop in the impurity confinement time and order of magnitude increase in midradius impurity diffusion, when additional electron heating is applied. Further, the calculated stationary aluminum density profiles reverse from peaked in electron heated to hollow in the ion heated case, following a similar trend as electron and carbon density. Comparable values of a core diffusion have been observed for W and Al ions, while differences in the propagation dynamics of these impurities are attributed to pedestal and edge transport. Modeling of the core transport with non-linear gyrokinetics code CGYRO, significantly underpredicts the magnitude of the variation in Al transport. Diffusion increases 3-times steeper with additional electron heat flux and 10-times lower diffusion is observed in ion heated case than predicted by the modeling. Here, the CGYRO model quantitatively matches the increase of the Al diffusion when approaching the linear threshold for the transition from the ion temperature gradient (ITG) to trapped electron mode (TEM).

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Improved Decarbonization Planning through Climate Resiliency Modeling

California has set ambitious decarbonization goals concerning both emissions and the portion of energy generated by renewable resources. However, climate change poses considerable uncertainties. Variation in load is driven both by the level of electrification as well as the impact of climate change on weather. Further, climate change stands to make weather more variable, impacting not just load but generation from renewable resources. In this paper, we approach the issue of the impacts of climate change on decarbonization planning from two perspectives. First, we look at the range of decarbonization pathways through 8 pathways that account for differences in socioeconomic development, global emissions, and warming. Second, we develop a more robust way of ensuring the reliability of energy resources planning than the commonly used planning reserve margin. We show that the proposed method can save between 6 and 14 billion dollars in investment and maintenance costs and outline critical policy implications concerning the reliance of power plants for satisfying planning reliability requirements, including the potential retirement of dozens of peaker power plants.

Anderson, Osten P.↗

Topological Characterization and Uncertainty Visualization of Atmospheric Rivers

Atmospheric rivers (ARs) are long, narrow regions of water vapor in the Earth's atmosphere that transport heat and moisture from the tropics to the mid-latitudes. ARs are often associated with extreme weather events in North America and contribute significantly to water supply and flood risk. However, characterizing ARs has been a major challenge due to the lack of a universal definition and their structural variations. Existing AR detection tools (ARDTs) produce distinct AR boundaries for the same event, making the risk assessment of ARs a difficult task. Understanding these uncertainties is crucial to improving the predictability of AR impacts, including their landfall areas and associated precipitation, which could cause catastrophic flooding and landslides over the coastal regions. In this work, we develop an uncertainty visualization framework that captures boundary and interior uncertainties, i.e., structural variations, of an ensemble of ARs that arise from a set of ARDTs. We first provide a statistical overview of the AR boundaries using the contour boxplots of Whitaker et al. that highlight the structural variations of AR boundaries based on their nesting relationships. We then introduce the topological skeletons of ARs based on Morse complexes that characterize the interior variation of an ensemble of ARs. We propose an uncertainty visualization of these topological skeletons, inspired by MetroSets of Jacobson et al. that emphasizes the agreements and disagreements across the ensemble members. Through case studies and expert feedback, we demonstrate that the two approaches complement each other, and together they could facilitate an effective comparative analysis process and provide a more confident outlook on an AR's shape, area, and onshore impact.

54 ENVIRONMENTAL SCIENCES↗

Environmental controls on the light use efficiency of terrestrial gross primary production

Abstract Gross primary production (GPP) by terrestrial ecosystems is a key quantity in the global carbon cycle. The instantaneous controls of leaf‐level photosynthesis are well established, but there is still no consensus on the mechanisms by which canopy‐level GPP depends on spatial and temporal variation in the environment. The standard model of photosynthesis provides a robust mechanistic representation for C 3 species; however, additional assumptions are required to “scale up” from leaf to canopy. As a consequence, competing models make inconsistent predictions about how GPP will respond to continuing environmental change. This problem is addressed here by means of an empirical analysis of the light use efficiency (LUE) of GPP inferred from eddy covariance carbon dioxide flux measurements, in situ measurements of photosynthetically active radiation (PAR), and remotely sensed estimates of the fraction of PAR (fAPAR) absorbed by the vegetation canopy. Focusing on LUE allows potential drivers of GPP to be separated from its overriding dependence on light. GPP data from over 100 sites, collated over 20 years and located in a range of biomes and climate zones, were extracted from the FLUXNET2015 database and combined with remotely sensed fAPAR data to estimate daily LUE. Daytime air temperature, vapor pressure deficit, diffuse fraction of solar radiation, and soil moisture were shown to be salient predictors of LUE in a generalized linear mixed‐effects model. The same model design was fitted to site‐based LUE estimates generated by 16 terrestrial ecosystem models. The published models showed wide variation in the shape, the strength, and even the sign of the environmental effects on modeled LUE. These findings highlight important model deficiencies and suggest a need to progress beyond simple “goodness of fit” comparisons of inferred and predicted carbon fluxes toward an approach focused on the functional responses of the underlying dependencies.

54 ENVIRONMENTAL SCIENCES↗

Predicting soil carbon changes in switchgrass grown on marginal lands under climate change and adaptation strategies

Abstract The United States Great Lakes Region (USGLR) is a critical geographic area for future bioenergy production. Switchgrass ( Panicum virgatum ) is widely considered a carbon (C)‐neutral or C‐negative bioenergy production system, but projected increases in air temperature and precipitation due to climate change might substantially alter soil organic C (SOC) dynamics and storage in soils. This study examined long‐term SOC changes in switchgrass grown on marginal land in the USGLR under current and projected climate, predicted using a process‐based model (Systems Approach to Land‐Use Sustainability) extensively calibrated with a wealth of plant and soil measurements at nine experimental sites. Simulations indicate that these soils are likely a net C sink under switchgrass (average gain 0.87 Mg C ha −1 year −1 ), although substantial variation in the rate of SOC accumulation was predicted (range: 0.2–1.3 Mg C ha −1 year −1 ). Principal component analysis revealed that the predicted intersite variability in SOC sequestration was related in part to differences in climatic characteristics, and to a lesser extent, to heterogeneous soils. Although climate change impacts on switchgrass plant growth were predicted to be small (4%–6% decrease on average), the increased soil respiration was predicted to partially negate SOC accumulations down to 70% below historical rates in the most extreme scenarios. Increasing N fertilizer rate and decreasing harvest intensity both had modest SOC sequestration benefits under projected climate, whereas introducing genotypes better adapted to the longer growing seasons was a much more effective strategy. Best‐performing adaptation scenarios were able to offset >60% of the climate change impacts, leading to SOC sequestration 0.7 Mg C ha −1 year −1 under projected climate. On average, this was 0.3 Mg C ha −1 year −1 more C sequestered than the no adaptation baseline. These findings provide crucial knowledge needed to guide policy and operational management for maximizing SOC sequestration of future bioenergy production on marginal lands in the USGLR.

09 BIOMASS FUELS↗

Twinac: A Universal Framework for Virtual Accelerator Controls

We propose a universal framework for a system of virtual accelerator controls (Twinac), a standard toolkit for research institutions to design, maintain, and use a real-time, end-to-end "digital twin" of their particle accelerator facility. This virtual counterpart will mirror any physical accelerator to provide (1) predictive maintenance; (2) surveillance of hidden environmental factors, such as seasonal temperature variations, which could impact performance of power supplies, magnets, and other instruments; and (3) a capability to model novel ways to operate the accelerator without risking equipment damage. Twinac is envisioned as accelerator facility agnostic, allowing institutions to share and reuse myriad simulation approaches (analytics-based, A.I.-driven, or combinations of the like) across facilities. The Twinac system lays the groundwork for a collaborative network of institutions to maintain and update this shared virtual accelerator technology.

Miceli, Tia M. [Fermilab] (ORCID:0000000265577789)↗

Fractional Laplacian spectral approach to turbulence in a dusty plasma monolayer

This work presents an analytical investigation of anomalous diffusion and turbulence in a dusty plasma monolayer, where energy transport across scales leads to the spontaneous formation of spatially disordered patterns. Many-body simulations of 10,000-particle dusty plasma monolayers are used to demonstrate how the global dynamics depend on the statistical properties of the dust assembly for realistic laboratory conditions. We find that disorder due to variations in the dust size distribution and charge-driven nonlocal interactions resulting in anomalous dust diffusion are key factors for the onset of instabilities. The resulting dynamics exhibit features of inertial turbulence over slightly more than half a decade of scales proportional or smaller than the Debye shielding length. These processes are examined analytically using a recently developed Fractional Laplacian Spectral (FLS) technique, which identifies the active energy channels as a function of scale, disorder concentration, and features of the nonlocal-interactions. The predictions from the theoretical (spectral) analysis demonstrate agreement with the results from the many-body (kinetic) simulations, thus providing a powerful tool for the study of active turbulence.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Spectral-partitioned Kohn-Sham density functional theory

Here we introduce a general, variational scheme for systematic approximation of a given Kohn-Sham free-energy functional by partitioning the density matrix into distinct spectral domains, each of which may be spanned by an independent diagonal representation without requirement of mutual orthogonality. It is shown that by generalizing the entropic contribution to the free energy to allow for independent representations in each spectral domain, the free energy becomes an upper bound to the exact (unpartitioned) Kohn-Sham free energy, attaining this limit as the representations approach Kohn-Sham eigenfunctions. A numerical procedure is devised for calculation of the generalized entropy associated with spectral partitioning of the density matrix. The result is a powerful framework for Kohn-Sham calculations of systems whose occupied subspaces span multiple energy regimes. As a case in point, we apply the proposed framework to warm- and hot-dense matter described by finite-temperature density functional theory, where at high energies the density matrix is represented by that of the free-electron gas, while at low energies it is variationally optimized. We derive expressions for the spectral-partitioned Kohn-Sham Hamiltonian, atomic forces, and macroscopic stresses within the projector-augmented wave (PAW) and the norm-conserving pseudopotential methods. It is demonstrated that at high temperatures, spectral partitioning facilitates accurate calculations at dramatically reduced computational cost. Moreover, as temperature is increased, fewer exact Kohn-Sham states are required for a given accuracy, leading to further reductions in computational cost. Finally, it is shown that standard multiprojector expansions of electronic orbitals within atomic spheres in the PAW method lack sufficient completeness at high temperatures. Spectral partitioning provides a systematic solution for this fundamental problem.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Bayesian inference of heterogeneous epidemic models: Application to COVID-19 spread accounting for long-term care facilities

Here we propose a high dimensional Bayesian inference framework for learning heterogeneous dynamics of a COVID-19 model, with a specific application to the dynamics and severity of COVID-19 inside and outside long-term care (LTC) facilities. We develop a heterogeneous compartmental model that accounts for the heterogeneity of the time-varying spread and severity of COVID-19 inside and outside LTC facilities, which is characterized by time-dependent stochastic processes and time-independent parameters in ~ 1500 dimensions after discretization. To infer these parameters, we use reported data on the number of confirmed, hospitalized, and deceased cases with suitable post-processing in both a deterministic inversion approach with appropriate regularization as a first step, followed by Bayesian inversion with proper prior distributions. To address the curse of dimensionality and the ill-posedness of the high-dimensional inference problem, we propose use of a dimension-independent projected Stein variational gradient descent method, and demonstrate the intrinsic low-dimensionality of the inverse problem. We present inference results with quantified uncertainties for both New Jersey and Texas, which experienced different epidemic phases and patterns. Moreover, we also present forecasting and validation results based on the empirical posterior samples of our inference for the future trajectory of COVID-19.

42 ENGINEERING↗

Finite elements for Matérn-type random fields: Uncertainty in computational mechanics and design optimization

This work highlights an approach for incorporating realistic uncertainties into scientific computing workflows based on finite elements, focusing on prevalent applications in computational mechanics and design optimization. We leverage Matérn-type Gaussian random fields (GRFs) generated using the SPDE method to model aleatoric uncertainties, including environmental influences, variating material properties, and geometric ambiguities. Our focus lies on delivering practical GRF realizations that accurately capture imperfections and variations and understanding how they impact the predictions of computational models as well as the shape and topology of optimized designs. Here we describe a numerical algorithm based on solving a generalized SPDE to sample GRFs on arbitrary meshed domains. The algorithm leverages established techniques and integrates seamlessly with the open-source finite element library MFEM and associated scientific computing workflows, like those found in industrial and national laboratory settings. Our solver scales efficiently for large-scale problems and supports various domain types, including surfaces and embedded manifolds. We showcase its versatility through biomechanics and topology optimization applications, emphasizing the potential to influence these domains. The flexibility and efficiency of SPDE-based GRF generation empowers us to run large-scale optimization problems on 2D and 3D domains, including finding optimized designs on embedded surfaces, and to generate design features and topologies beyond the reach of conventional techniques. Moreover, these capabilities allow us to model and quantify geometric uncertainties on reconstructed submanifolds, such as the interpolated surfaces of cerebral aneurysms provided by postprocessing CT scans. In addition to offering benefits in these specific domains, the proposed techniques transcend specific applications and generalize to arbitrary forward and backward problems in uncertainty quantification involving finite elements.

97 MATHEMATICS AND COMPUTING↗

Fiducial-cosmology-dependent systematics for the DESI 2024 full-shape analysis

We assess the impact of the fiducial cosmology choice on cosmological inference from full-shape (FS) fits of the galaxy power spectrum in the DESI 2024 Data Release 1 (DR1). Using a suite of AbacusSummit DR1 mock catalogues based on the Planck 2018 best-fit cosmology, we quantify potential systematic shifts introduced by analysing the data under five secondary cosmologies — featuring variations in matter density, thawing dark energy, higher effective number of neutrino species, reduced clustering amplitude, and the DESI DR1 BAO best-fit w 0 w a CDM cosmology — relative to DESI's baseline Planck 2018 cosmology. We investigate two complementary FS analysis approaches: full-modelling (FM) and ShapeFit (SF), each with distinct sensitivities to the assumed fiducial model. Across all tracers, we find for FM that systematic shifts induced by fiducial cosmology mismatches remain well below the DESI DR1 statistical uncertainties, with maximum deviations of 0.22σ DR1 in ΛCDM scenarios and 0.12σ DR1+SN when including SN Ia mock data in extended w 0 w a CDM fits. For SF, the shifts in the compressed parameters remain below 0.45σ DR1 for all tracers and cosmologies.

dark energy experiments↗

Quantum-inspired tempering for ground state approximation using artificial neural networks

A large body of work has demonstrated that parameterized artificial neural networks (ANNs) can efficiently describe ground states of numerous interesting quantum many-body Hamiltonians. However, the standard variational algorithms used to update or train the ANN parameters can get trapped in local minima, especially for frustrated systems and even if the representation is sufficiently expressive. We propose a parallel tempering method that facilitates escape from such local minima. This methods involves training multiple ANNs independently, with each simulation governed by a Hamiltonian with a different "driver" strength, in analogy to quantum parallel tempering, and it incorporates an update step into the training that allows for the exchange of neighboring ANN configurations. We study instances from two classes of Hamiltonians to demonstrate the utility of our approach using Restricted Boltzmann Machines as our parameterized ANN. The first instance is based on a permutation-invariant Hamiltonian whose landscape stymies the standard training algorithm by drawing it increasingly to a false local minimum. The second instance is four hydrogen atoms arranged in a rectangle, which is an instance of the second quantized electronic structure Hamiltonian discretized using Gaussian basis functions. We study this problem in a minimal basis set, which exhibits false minima that can trap the standard variational algorithm despite the problem’s small size. We show that augmenting the training with quantum parallel tempering becomes useful to finding good approximations to the ground states of these problem instances.

Albash, Tameem↗

pyFLANK, a graph neural network based null distribution inference model for F ST outlier detection

Detecting genomic regions under selection is essential for understanding how populations adapt to different environments, yet it remains challenging due to the confounding effects of demographic history and linkage disequilibrium (LD). Fixation index (F ST ) is a widely used statistic to identify genomic regions under adaptation. However, identifying genes under selection by defining F ST outliers often remains challenging, owing to confounding effects of underlying demographic history. Traditional methods assume independence among loci and rely on simple demographic models, while newer models perform much better but are computationally expensive and not easily scalable. Here, we present pyFLANK, an open-source and automated Python implementation which detects F ST outliers using a null distribution inferred from quasi-independent loci. Our tool integrates three approaches to identify loci obeying a null distribution: graph neural network (GNN) inference, linkage disequilibrium (LD)-based inference, and user-defined input. Because pyFLANK uses GNN-based inference of quasi-independent loci, it yields a more accurate null model with less need for user parameter input. In simulation experiments, pyFLANK achieved lower false positive rates than current methods while maintaining comparable detection power, indicating that its refined null model better distinguishes true adaptive loci from background variation. The GNN-based model, in particular, detected additional loci associated with phenotypic variance that were not identified by existing methods. Assessments of simulation and real data from different species demonstrate that pyFLANK achieves lower false positive rates compared with other commonly used F ST outlier detectors, while maintaining comparable detection power and excellent computational performance, providing a robust and user-friendly tool for identifying loci under divergent selection. It extends existing F ST outlier frameworks by incorporating explicit LD-aware strategies for null model calibration. The method is intended as a practical and scalable complement to existing genome scan approaches.

FST↗