Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “inverse modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Semi-Analytical Hierarchical Bayesian Inference of Nonlinear Model Structure in Stochastic Dynamics: Applied to Compartmental Models of Infectious Diseases

A Bayesian computational framework for parsimonious inference in stochastic nonlinear dynamical systems is presented. This framework enables the concurrent estimation of system states, time-varying parameters, time-invariant parameters, and the optimal sparsity structure of the model parameters. Because differential equation-based models are often simplified mechanistic or phenomenological representations, robust inference from noisy measurement data requires explicit treatment of model error and uncertainty. Model error and time-varying parameters can be represented as random processes, enabling inference while making minimal assumptions about the underlying sources of discrepancy and variability. Adopting stochastic differential equation representations affords the model significant flexibility, but can also render it susceptible to overfitting during statistical inversion, where the inferred model may track noise rather than the underlying signal. To alleviate the effects of overfitting and to enable the discovery of the optimal sparse representation of the time-invariant parameters, a Bayesian sparse learning algorithm is embedded within the framework. This sparse learning framework adopts an approximate hierarchical Bayesian setting defined by a series of semi-analytical expressions. The model structure inference framework is validated using a stochastic compartmental model for tracking and forecasting active cases of an infectious disease. Compartmental models describe population-level infectious disease dynamics through interactions among population fractions grouped by disease state. Mathematically, such models consist of a system of coupled ordinary differential equations. This example adopts an expressive compartmental model that includes multiple possible interactions between disease states, motivated by early uncertainty surrounding COVID-19 reinfection dynamics and their implications for long-term epidemic forecasting. The sparse learning exercise permits the inference of a priori unknown epidemiological dynamics from simulated public health data, discovering the nested compartmental model that optimizes the trade-off between average data-fit and model complexity. It is shown that inducing sparsity among the model parameters eliminates redundant interactions between compartments, equivalently revealing the optimal coupling structure between differential equations.

97 MATHEMATICS AND COMPUTING↗

A Variational Inference Approach to Inverse Problems with Gamma Hyperpriors

Hierarchical models with gamma hyperpriors provide a flexible, sparse-promoting framework to bridge L 1 and L 2 regularizations in Bayesian formulations to inverse problems. Despite the Bayesian motivation for these models, existing methodologies are limited to maximum a posteriori estimation. The potential to perform uncertainty quantification has not yet been realized. This paper introduces a variational iterative alternating scheme for hierarchical inverse problems with gamma hyperpriors. The proposed variational inference approach yields accurate reconstruction, provides meaningful uncertainty quantification, and is easy to implement. In addition, it lends itself naturally to conduct model selection for the choice of hyperparameters. Here, we illustrate the performance of our methodology in several computed examples, including a deconvolution problem and sparse identification of dynamical systems from time series data.

Bayesian shrinkage↗

Analysis of a Computational Framework for Bayesian Inverse Problems: Ensemble Kalman Updates and MAP Estimators under Mesh Refinement

This paper analyzes a popular computational framework to solve infinite-dimensional Bayesian inverse problems, discretizing the prior and the forward model in a finite-dimensional weighted inner product space. We demonstrate the benefit of working on a weighted space by establishing operator-norm bounds for finite element and graph-based discretizations of Matérn-type priors and deconvolution forward models. For linear-Gaussian inverse problems, we develop a general theory to characterize the error in the approximation to the posterior. We also embed the computational framework into ensemble Kalman methods and MAP estimators for nonlinear inverse problems. Furthermore, our operator-norm bounds for prior discretizations guarantee the scalability and accuracy of these algorithms under mesh refinement.

Bayesian inverse problem↗

Multiscale assessment of North American terrestrial carbon balance

Abstract. Comparisons of carbon uptake estimates from bottom-up terrestrial biosphere models (TBMs) to top-down atmospheric inversions help assess how well we understand carbon dioxide (CO2) exchange between the atmosphere and terrestrial biosphere. Previous comparisons have shown varying levels of agreement between bottom-up and top-down approaches, but they have almost exclusively focused on large, aggregated scales (e.g., global or continental), providing limited insights into reasons for the mismatches. Here we explore how consistency, defined as the spread in net ecosystem exchange (NEE) estimates within an ensemble of TBMs or inversions, varies with at finer spatial scales ranging from 1∘×1∘ to the continent of North America. We also evaluate how well consistency informs accuracy in overall NEE estimates by filtering models based on their agreement with the variability, magnitude, and seasonality in observed atmospheric CO2 drawdowns or enhancements. We find that TBMs produce more consistent estimates of NEE for most regions and at most scales relative to inversions. Filtering models using atmospheric CO2 metrics causes ensemble spread to decrease substantially for TBMs, but not for inversions. This suggests that ensemble spread is likely not a reliable measure of the uncertainty associated with the North American carbon balance at any spatial scale. Promisingly, applying atmospheric CO2 metrics leads to a set of models with converging flux estimates across TBMs and inversions. Overall, we show that multiscale assessment of the agreement between bottom-up and top-down NEE estimates, aided by regional-scale observational constraints is a promising path towards identifying fine-scale sources of uncertainty and improving both ensemble consistency and accuracy. These findings help refine our understanding of biospheric carbon balance, particularly at scales relevant for informing regional carbon-climate feedbacks.

54 ENVIRONMENTAL SCIENCES↗

Efficient 3-D velocity model building using joint inline and crossline plane-wave wave-equation migration velocity analyses

SUMMARY Wave-equation migration velocity analysis (WEMVA) is an image-domain inversion method for velocity model building. Automatic plane-wave WEMVA (PWEMVA) calculates the moveouts of plane-wave common-image gathers (CIGs) by searching a best-fitting parabola with semblance analysis and backprojects residual CIG moveouts into wavefield wave paths with a reflection tomographic kernel. However, 3-D PWEMVA is very computationally expensive because 3-D reflection tomographic inversion requires at least five 3-D reverse-time migrations per iteration and stores two types of source wavefields at model boundaries. We develop a joint inline and crossline PWEMVA method for efficient 3-D velocity model building. We alternatively implement the inline and crossline PWEMVAs with a constraint for each other, in which we iteratively construct the 3-D velocity model update through 1-D spline interpolation of 2-D gradients. The inline and crossline joint inversion is practical since PWEMVA only inverts for low-wavenumber velocity perturbations along wave paths, and the method can take less than 1 per cent of the computational cost of full 3-D PWEMVA. To construct unaliased plane waves for our joint inline and crossline PWEMVA, we develop a 3-D data interpolation method in the frequency–wavenumber (FK) domain to recover regularly and randomly missing traces. The method minimizes the misfit on sufficiently localized data subsets with iterative optimal step lengths and a gradient preconditioner that iteratively selects dominant dips along different azimuths. In numerical experiments, we use a 3-D synthetic seismic data set and a land 3-D field seismic data set acquired at the Farnsworth CO2-EOR (enhanced oil recovery) field to demonstrate the efficacy of our velocity model building and data interpolation methods.

Liu, Xuejian↗

CF + excitation in the interstellar medium

The detection of CF + in interstellar clouds potentially allows astronomers to infer the elemental fluorine abundance and the ionization fraction in ultraviolet-illuminated molecular gas. Because local thermodynamic equilibrium (LTE) conditions are hardly fulfilled in the interstellar medium (ISM), the accurate determination of the CF + abundance requires one to model its non-LTE excitation via both radiative and collisional processes. Here, we report quantum calculations of rate coefficients for the rotational excitation of CF + in collisions with para- and ortho-H 2 (for temperatures up to 150 K). As an application, we present non-LTE excitation models that reveal population inversion in physical conditions typical of ISM photodissociation regions (PDRs). We successfully applied these models to fit the CF + emission lines previously observed toward the Orion Bar and Horsehead PDRs. The radiative transfer models achieved with these new rate coefficients allow the use of CF + as a powerful probe to study molecular clouds exposed to strong stellar radiation fields.

79 ASTRONOMY AND ASTROPHYSICS↗

Self-interacting neutrinos: Solution to Hubble tension versus experimental constraints

Exotic self-interactions among the Standard-Model neutrinos have been proposed as a potential reason behind the tension in the expansion rate, H 0 , of the universe inferred from different observations. We constrain this proposal using electroweak precision observables, rare meson decays, and neutrinoless double-β decay. In contrast to previous works, we emphasize the importance of carrying out this study in a framework with full Standard-Model gauge invariance. We implement this first by working with a relevant set of Standard- Model-Effective-Field-Theory operators and subsequently by considering a UV completion in the inverse See-Saw model. We find that the scenario in which all flavors of neutrinos self-interact universally is strongly constrained, disfavoring a potential solution to the H 0 problem in this case. The scenario with self-interactions only among tau neutrinos is the least constrained and can potentially be consistent with a solution to the H 0 problem.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Effect of the inversion symmetry breaking on the orbital Hall effect: A model study

The orbital Hall effect (OHE) is the transverse flow of orbital moment in a solid in response to an applied electric field, analogous to the flow of spin moment in the spin Hall effect (SHE). Although the effect has not been directly observed, there is ample indirect evidence for its existence in a number of experiments. Here, we show that the OHE is enhanced in solids with broken inversion symmetry, which may be more suitable to observe the effect. The mechanism of the OHE is fundamentally different in solids with inversion symmetry, where the orbital moment is quenched in the Brillouin zone (BZ), from that in a solid with broken inversion symmetry, where an intrinsic orbital moment is already present, the motion of which under the applied electric field could lead to a robust OHE. Using a tight-binding model Hamiltonian of a simple cubic lattice with two atoms in the unit cell, we study the effect of the inversion symmetry breaking on the OHE. We show that with the increase in the strength of the broken symmetry, the magnitude of the intrinsic orbital moment in the Brillouin zone increases. This, in turn, enhances the orbital Hall conductivity, in particular, the part that is directly proportional to the orbital moment in the BZ, which we call the “noncentrosymmetric contribution.” If the spin-orbit coupling is present, which couples the orbital and spin moments, the OHE leads to the SHE, which also becomes enhanced by the broken inversion symmetry. Furthermore, our work has important implications for experimenters, suggesting that noncentrosymmetric solids may be more suitable for direct observation of the OHE.

36 MATERIALS SCIENCE↗

Parameter estimation with maximal updated densities

A recently developed measure-theoretic framework solves a stochastic inverse problem (SIP) for models where uncertainties in model output data are predominantly due to aleatoric (i.e., irreducible) uncertainties in model inputs (i.e., parameters). The subsequent inferential target is a distribution on parameters. Another type of inverse problem is to quantify uncertainties in estimates of “true” parameter values under the assumption that such uncertainties should be reduced as more data are incorporated into the problem, i.e., the uncertainty is considered epistemic. A major contribution of this work is the formulation and solution of such a parameter identification problem (PIP) within the measure-theoretic framework developed for the SIP. The approach is novel in that it utilizes a solution to a stochastic forward problem (SFP) to update an initial density only in the parameter directions informed by the model output data. In other words, this method performs “selective regularization” only in the parameter directions not informed by data. Further, the solution is defined by a maximal updated density (MUD) point where the updated density defines the measure-theoretic solution to the PIP. Another significant contribution of this work is the full theory of existence and uniqueness of MUD points for linear maps with Gaussian distributions. Data-constructed Quantity of Interest (QoI) maps are also presented and analyzed for solving the PIP within this measure-theoretic framework as a means of reducing uncertainties in the MUD estimate. We conclude with a demonstration of the general applicability of the method on two problems involving either spatial or temporal data for estimating uncertain model parameters. The first problem utilizes spatial data from a stationary partial differential equation to produce a MUD estimate of an uncertain boundary condition. The second problem utilizes temporal data obtained from the state-of-the-art ADvanced CIRCulation (ADCIRC) model to obtain a MUD estimate of uncertain wind drag coefficients for a simulated extreme weather event near the Shinnecock Inlet located in the Outer Barrier of Long Island, NY, USA.

42 ENGINEERING↗

Targeted Chemical Looping Materials Discovery by an Inverse Design

Chemical looping with oxygen uncoupling (CLOU) materials is actively sought for combustion of carbonaceous materials to achieve complete conversion and capture of carbon dioxide. These materials may play a vital role in reducing atmospheric carbon via negative carbon output. However, there is no one‐size‐fits‐all approach as different operating conditions and feedstocks may require different CLOU materials. As a result, the exploration and discovery of high‐performance CLOU materials can be a slow process. To address this challenge, a high‐throughput inverse machine learning workflow that identifies optimum materials from perovskite oxides for a given set of targets is developed—temperature and Gibbs free energy of oxygen formation. The model is trained on high‐throughput density functional theory calculations of CLOU materials and inverts the materials design process using a genetic algorithm to produce realistic substituted SrFeO 3‐δ compositions as output. Using the inverse model, it is able to identify several interesting new families of CLOU materials: Sr 1‐ x A x Fe 1‐ y B y O 3‐δ (e.g., A = Ca or K; B = Mg, Bi, Mn, Ni, Co, Cu, or Zn). These materials have shown promising properties, and some of them even outperform the benchmark material in terms of oxygen release kinetics under relevant CLOU operating conditions.

36 MATERIALS SCIENCE↗

Knowledge-informed deep learning for hydrological model calibration: an application to Coal Creek Watershed in Colorado

Abstract. Deep learning (DL)-assisted inverse mapping has shown promise in hydrological model calibration by directly estimating parameters from observations. However, the increasing computational demand for running the state-of-the-art hydrological model limits sufficient ensemble runs for its calibration. In this work, we present a novel knowledge-informed deep learning method that can efficiently conduct the calibration using a few hundred realizations. The method involves two steps. First, we determine decisive model parameters from a complete parameter set based on the mutual information (MI) between model responses and each parameter computed by a limited number of realizations (∼50). Second, we perform more ensemble runs (e.g., several hundred) to generate the training sets for the inverse mapping, which selects informative model responses for estimating each parameter using MI-based parameter sensitivity. We applied this new DL-based method to calibrate a process-based integrated hydrological model, the Advanced Terrestrial Simulator (ATS), at Coal Creek Watershed, CO. The calibration is performed against observed stream discharge (Q) and remotely sensed evapotranspiration (ET) from the water year 2017 to 2019. Preliminary MI analysis on 50 realizations resulted in a down-selection of 7 out of 14 ATS model parameters. Then, we performed a complete MI analysis on 396 realizations and constructed the inverse mapping from informative responses to each of the selected parameters using a deep neural network. Compared with calibration using observations covering all time steps, the new inverse mapping improves parameter estimations, thus enhancing the performance of ATS forward model runs. The Nash–Sutcliffe efficiency (NSE) of streamflow predictions increases from 0.53 to 0.8 when calibrating against Q alone. Using ET observations, on the other hand, does not show much improvement on the performance of ATS modeling mainly due to both the uncertainty of the remotely sensed product and the insufficient coverage of the model ET ensemble in capturing the observation. By using observed Q only, we further performed a multiyear analysis and show that Q is best simulated (NSE > 0.8) by including in the calibration the dry-year flow dynamics that show more sensitivity to subsurface characteristics than the other wet years. Moreover, when continuing the forward runs till the end of 2021, the calibrated models show similar simulation performances during this evaluation period as the calibration period, demonstrating the ability of the estimated parameters in capturing climate sensitivity. Our success highlights the importance of leveraging data-driven knowledge in DL-assisted hydrological model calibration.

54 ENVIRONMENTAL SCIENCES↗

The Influence of Shallow Subsurface Properties on Particle Motion in Acoustic-Seismic Coupling

Atmospheric acoustic waves transmit energy into the solid Earth through air-to-ground coupling. These waves are recorded by seismic sensors and provide insight into both atmospheric phenomena and subsurface properties. Interpreting these signals is often challenging because they are modulated by subsurface structure and the incidence angle of the acoustic wave. This study examines acoustic--seismic coupling generated by the 2012 Camp Minden Explosion, which was recorded by hundreds of seismoacoustic stations. We apply a novel technique to quantify the seismic particle motion, model coupled waves with a propagator matrix approach, and apply a Bayesian inversion to infer properties of the shallow subsurface. Our analysis reveals that prograde motion is widespread and focused in low shear-wave velocity regions, such as the Mississippi Embayment, and retrograde motion is more common in higher shear-velocity areas. Inversion results at some stations produce plausible subsurface models with strong waveform fits, while inversions at other sites are less successful. These results indicate prograde particle motion in air-to-ground coupled waves is more prevalent than previously recognized and may serve as a diagnostic for shallow velocity structure. Our comprehensive modeling and inversion framework provides a potential method to extract layered near-surface properties from acoustic-seismic coupling observations.

58 GEOSCIENCES↗

Spectral statistics of a minimal quantum glass model

Glasses have the interesting feature of being neither integrable nor fully chaotic. They thermalize quickly within a subspace but thermalize much more slowly across the full space due to high free energy barriers which partition the configuration space into sectors. Past works have examined the Rosenzweig-Porter (RP) model as a minimal quantum model which transitions from localized to chaotic behavior. In this work we generalize the RP model in such a way that it becomes a minimal model which transitions from glassy to chaotic behavior, which we term the “Block Rosenzweig-Porter” (BRP) model. We calculate the spectral form factors of both models at all timescales larger than the inverse spectral width. Whereas the RP model exhibits a crossover from localized to ergodic behavior at the Thouless timescale, the new BRP model instead crosses over from glassy to fully chaotic behavior, as seen by a change in the steepness of the ramp of the spectral form factor.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Data-driven prediction of α IIb β 3 integrin activation paths using manifold learning and deep generative modeling

The integrin heterodimer is a transmembrane protein critical for driving cellular process and is a therapeutic target in the treatment of multiple diseases linked to its malfunction. Activation of integrin involves conformational transitions between bent and extended states. Some of the conformations that are intermediate between bent and extended states of the heterodimer have been experimentally characterized, but the full activation pathways remain unresolved both experimentally due to their transient nature and computationally due to the challenges in simulating rare barrier crossing events in these large molecular systems. An understanding of the activation pathways can provide new fundamental understanding of the biophysical processes associated with the dynamic interconversions between bent and extended states and unveil new putative therapeutic targets. In this work, we apply nonlinear manifold learning to coarse-grained molecular dynamics simulations of bent, extended, and two intermediate states of αI I b β3 integrin to learn a low-dimensional embedding of the configurational phase space. We then train deep generative models to learn an inverse mapping between the low-dimensional embedding and high-dimensional molecular space and use these models to interpolate the molecular configurations constituting the activation pathways between the experimentally characterized states. Furthermore, this work furnishes plausible predictions of integrin activation pathways and reports a generic and transferable multi-scale technique to predict transition pathways for biomolecular systems.

97 MATHEMATICS AND COMPUTING↗

Neural Networks to Find the Optimal Forcing for Offsetting the Anthropogenic Climate Change Effects

Abstract Of great relevance to climate engineering is the systematic relationship between the radiative forcing to the climate system and the response of the system, a relationship often represented by the linear response function (LRF) of the system. However, estimating the LRF often becomes an ill-posed inverse problem due to high-dimensionality and nonunique relationships between the forcing and response. Recent advances in machine learning make it possible to address the ill-posed inverse problem through regularization and sparse system fitting. Here, we develop a convolutional neural network (CNN) for regularized inversion. The CNN is trained using the surface temperature responses from a set of Green’s function perturbation experiments as imagery input data together with data sample densification. The resulting CNN model can infer the forcing pattern responsible for the temperature response from out-of-sample forcing scenarios. This promising proof of concept suggests a possible strategy for estimating the optimal forcing to negate certain undesirable effects of climate change. The limited success of this effort underscores the challenges of solving an inverse problem for a climate system with inherent nonlinearity. Significance Statement Predicting the climate response for a given climate forcing is a direct problem, while inferring the forcing for a given desired climate response is often an inverse, ill-posed, problem, posing a new challenge to the climate community. This study makes the first attempt to infer the radiative forcing for a given target pattern of global surface temperature response using a deep learning approach. The resulting deeply trained convolutional neural network inversion model shows promise in capturing the forcing pattern corresponding to a given surface temperature response, with a significant implication on the design of an optimal solar radiation management strategy for curbing global warming. This study also highlights the technical challenges that future research should prioritize in seeking feasible solutions to the inverse climate problem.

Ren, Huiying↗

Enhanced Multi-Dimensional Inversion Through Target-Specific Inversion Parameter Bounds With an Application to Crosswell Electromagnetic for Sequestration Monitoring

In geophysical inversions, lower and upper model parameter bounds are a means of solution stabilization. Further, constraints that intend to let only geologically plausible inverse solutions pass are amenable to lower and upper bounds. Reliable prior information is paramount to construct such bound constraints. It is common practice to narrow and widen bound intervals for regions of, respectively, more and less certain prior information. Contrary to this practice, we experiment with widened bound intervals in zones that are poorly resolved by a given survey configuration but where prior information would suggest structural anomalies of interest. The purpose of enlarged parameter bounds that correlate spatially with predefined targets is to let the inversion explore a larger solution space, thus increasing the potential to resolve otherwise hidden anomalies. Application of the method is based on a carbon-sequestration baseline (pre-injection) crosswell electromagnetic (EM) field survey at the Containment and Monitoring Institute Field Research Station (Alberta, Canada), where impeded measurements led to generally reduced sensitivities for the interwell region. Synthetic-data proofs of concept use augmented bounds designed to boost the resolution of artificial plume targets, indicating an enhanced illumination compared to constant bounds. Comparative field data inversions with spatially variable bounds constructed from prior resistivity and velocity information highlight non-horizontal baseline structures.

3-D electrical resistivity imaging↗