Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

Old-Aged groundwater contributes to mountain hillslope hydrologic dynamics

Understanding connectivity between the soil and deeper bedrock groundwater is needed to accurately predict a watershed’s response to perturbation, such as drought. Yet, the bedrock groundwater dynamics in mountainous environments are typically under-constrained and excluded from watershed hydrologic models. Here, we investigate the role of groundwater characterized with decadal and longer water ages on the hydrologic and mass-transport processes within a steep snow-dominated mountain hillslope in the Central Rocky Mountains (USA). We quantify subsurface and surface water mass-balance, groundwater flowpaths, and age distributions using the ParFlow-CLM integrated hydrologic and EcoSLIM particle tracking models, which are compared to hydrometric and environmental tracer observations. An ensemble of models with varied soil and hydrogeologic parameters reproduces observed groundwater levels and century-scale mean ages inferred from environmental tracers. The numerical models suggest soil water near the toe of the hillslope contains considerable (>60 % of the mass-flux) contributions from bedrock flowpaths characterized with water ages >10 years. Flowpath connectivity between the deeper bedrock and soil systems is present throughout the year, highlighting the potentially critical role of groundwater with old ages on processes such as evapotranspiration and streamflow generation. The coupled numerical model and groundwater age observations show the bedrock groundwater system influences the hillslope hydrodynamics and should be considered in mountain watershed conceptual and numerical models.

54 ENVIRONMENTAL SCIENCES↗

Investigation of hydrometeorological influences on reservoir releases using explainable machine learning methods

Long short-term memory (LSTM) networks have demonstrated successful applications in accurately and efficiently predicting reservoir releases from hydrometeorological drivers including reservoir storage, inflow, precipitation, and temperature. However, due to its black-box nature and lack of process-based implementation, we are unsure whether LSTM makes good predictions for the right reasons. In this work, we use an explainable machine learning (ML) method, called SHapley Additive exPlanations (SHAP), to evaluate the variable importance and variable-wise temporal importance in the LSTM model prediction. In application to 30 reservoirs over the Upper Colorado River Basin, United States, we show that LSTM can accurately predict the reservoir releases with NSE ≥ 0.69 for all the considered reservoirs despite of their diverse storage sizes, functionality, elevations, etc. Additionally, SHAP indicates that storage and inflow are more influential than precipitation and temperature. Moreover, the storage and inflow show a relatively long-term influence on the release up to 7 days and this influence decreases as the lag time increases for most reservoirs. These findings from SHAP are consistent with our physical understanding. However, in a few reservoirs, SHAP gives some temporal importances that are difficult to interpret from a hydrological point of view, probably because of its ignorance of the variable interactions. SHAP is a useful tool for black-box ML model explanations, but the hydrological processes inferred from its results should be interpreted cautiously. More investigations of SHAP and its applications in hydrological modeling is needed and will be pursued in our future study.

54 ENVIRONMENTAL SCIENCES↗

Spatio-temporal Estimates of Disease Transmission Parameters for COVID-19 with a Fully-Coupled, County-Level Model of the United States

Sandia National Laboratories has developed a capability to estimate parameters of epidemiological models from case reporting data to support responses to the COVID-19 pandemic. A differentiating feature of this work is the ability to simultaneously estimate county-specific disease transmission parameters in a nation-wide model that considers mobility between counties. The approach is focused on estimating parameters in a stochastic SEIR model that considers mobility between model patches (i.e., counties) as well as additional infectious compartments. The inference engine developed by Sandia includes (1) reconstruction and (2) transmission parameter inference. Reconstruction involves estimating current population counts within each of the compartments in a modified SEIR model from reported case data. Reconstruction produces input for the inference formulations, and it provides initial conditions that can be used in other modeling and planning efforts. Inference involves the solution of a large-scale optimization problem to estimate the time profiles for the transmission parameters in each county. These provide quantification of changes in the transmission parameter over time (e.g., due to impact of intervention strategies). This capability has been implemented in a Python-based software package, epi_inference, that makes extensive use of Pyomo [5] and IPOPT [10] to formulate and solve the inference formulations.

42 ENGINEERING↗

Thermal and magnetic evolution of a crystallizing basal magma ocean in Earth's mantle

We present the thermochemical evolution of a downward crystallizing basal magma ocean (BMO) overlying the liquid outer core and probe its capability to dissipate enough power to generate and sustain an early dynamo. Furthermore, a total of 61 out of 112 scenarios for a BMO with imposed, present-day heat flux, Q BMO , values of 15, 18, and 21 TW and radiogenic heat, Q r , values of 4, 8, and 12 TW fully crystallized during the age of the Earth. Most of these models are energetically capable of inducing magnetic activity for the first 1.5 Gyrs, at least, with durations extending to 2.5 Gyrs; with final core-mantle boundary (CMB) temperatures of 4400 ±500 K-well within current best estimates for inferred temperatures. None of the models with Q BMO = 12 TW achieved a fully crystallized state, which may reflect a lower bound on the present-day heat flux across the CMB. BMO-powered dynamos exhibit strong dependence on the partition coefficient of iron into the liquid layer and its associated melting-point depression for a lower mantle composition at near-CMB conditions-parameters which are poorly constrained to date. Nonetheless, we show that a crystallizing BMO is a plausible mechanism to sustain an early magnetic field.

58 GEOSCIENCES↗

New approaches to Bayesian uncertainty quantification for Nuclear Science (Final Technical Report)

Inverse problems play a central role in experimentation and theory/data comparisons for many areas of modern Nuclear Physics (NP) and High-Energy Physics (HEP). Bayes’s Theorem is a powerful tool for solving Inverse Problems, providing conceptually transparent and unbiased constraints on theoretical parameters and their uncertainties (“Bayesian Inference”) and enabling the quantification of agreement or tension between models and data. However, analyses based on Bayesian Inference are often challenging for NP and HEP applications, either because of the large number of parameters in the problem, the high computational cost, or both. We propose a multi-institutional collaboration to develop and deploy novel Bayesian analysis tools that advance the scientific scope of a broad range of current and future NP experiments. This project brings together NP domain scientists working on several high-profile NP projects for which new, high-performance Bayesian Uncertainty Quantification (“Bayesian UQ”) methods are essential to carry out the science, and data scientists who are developing state-of-the-art methods applicable to these problems. The NP projects in this proposal comprise measurements of the mass and fundamental nature of the neutrino; study of the Quark-Gluon Plasma that filled the early universe; and mapping of natural and anthropogenic radiation environments. While these NP projects have very different scientific goals, with datasets and analysis approaches that differ significantly, they share common requirements for improving computationally intensive Bayesian analyses using advanced Machine Learning algorithms and will benefit strongly from a coherent effort to develop general solutions. This proposal brings together these projects and forefront ML-based data science algorithms to develop such general solutions. The methods developed in this project will also be more widely applicable, thereby advancing science in the larger Nuclear Physics portfolio.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Quantification of early nonpharmaceutical interventions aimed at slowing transmission of Coronavirus Disease 2019 in the Navajo Nation and surrounding states (Arizona, Colorado, New Mexico, and Utah)

During an early period of the Coronavirus Disease 2019 (COVID-19) pandemic, the Navajo Nation, much like New York City, experienced a relatively high rate of disease transmission. Yet, between January and October 2020, it experienced only a single period of growth in new COVID-19 cases, which ended when cases peaked in May 2020. The daily number of new cases slowly decayed in the summer of 2020 until late September 2020. In contrast, the surrounding states of Arizona, Colorado, New Mexico, and Utah all experienced at least two periods of growth in the same time frame, with second surges beginning in late May to early June. Here, we investigated these differences in disease transmission dynamics with the objective of quantifying the contributions of non-pharmaceutical interventions (NPIs) (e.g., behaviors that limit disease transmission). We considered a compartmental model accounting for distinct periods of NPIs to analyze the epidemic in each of the five regions. We used Bayesian inference to estimate region-specific model parameters from regional surveillance data (daily reports of new COVID-19 cases) and to quantify uncertainty in parameter estimates and model predictions. Our results suggest that NPIs in the Navajo Nation were sustained over the period of interest, whereas in the surrounding states, NPIs were relaxed, which allowed for subsequent surges in cases. Our region-specific model parameterizations allow us to quantify the impacts of NPIs on disease incidence in the regions of interest.

60 APPLIED LIFE SCIENCES↗

A scalable variational method for estimating the latent infection-rate field of an outbreak

In this paper, we explore whether the infection-rate of a disease can serve as a robust monitoring variable in epidemiological surveillance algorithms. The infection-rate is dependent on population mixing patterns that do not vary erratically day-to-day; in contrast, daily case-counts used in contemporary surveillance algorithms are corrupted by reporting errors. The technical challenge lies in estimating the latent infection-rate from case-counts. Here we devise a Bayesian method to estimate the infection-rate across multiple adjoining areal units, and then use it, via an anomaly detector, to discern a change in epidemiological dynamics. We extend an existing model for estimating the infection-rate in an areal unit by incorporating a Markov random field model, so that we may estimate infection-rates across multiple areal units, while preserving spatial correlations observed in the epidemiological dynamics. To carry out the high-dimensional Bayesian inverse problem, we develop an implementation of mean-field variational inference specific to the infection model and integrate it with the random field model to incorporate correlations across counties. The method is tested on estimating the COVID-19 infection-rates across all 33 counties in New Mexico using data from the summer of 2020, and then employing them to detect the arrival of the Fall 2020 COVID-19 wave. We perform the detection using a temporal algorithm that is applied county-by-county. We also show how the infection-rate field can be used to cluster counties with similar epidemiological dynamics.

60 APPLIED LIFE SCIENCES↗

Results of the Workshop on Impact Cratering: Bridging the Gap Between Modeling and Observations

On February 7-9,2003, approximately 60 scientists gathered at the Lunar and Planetary Institute in Houston, Texas, for a workshop devoted to improving knowledge of the impact cratering process. We (co-conveners Elisabetta Pierazzo and Robert Herrick) both focus research efforts on studying the impact cratering process, but the former specializes in numerical modeling while the latter draws inferences from observations of planetary craters. Significant work has been done in several key areas of impact studies over the past several years, but in many respects there seem to be a disconnect between the groups employing different approaches, in particular modeling versus observations. The goal in convening this workshop was to bring together these disparate groups to have an open dialogue for the purposes of answering outstanding questions about the impact process and setting future research directions. We were successful in getting participation from most of the major research groups studying the impact process. Participants gathered from five continents with research specialties ranging from numerical modeling to field geology, and from small-scale experimentation and geochemical sample analysis to seismology and remote sensing.With the assistance of the scientific advisory committee (Bevan French, Kevin Housen, Bill McKinnon, Jay Melosh, and Mike Zolensky), the workshop was divided into a series of sessions devoted to different aspects of the cratering process. Each session was opened by two invited t a b , one given by a specialist in numerical or experimental modeling approaches, and the other by a specialist in geological, geophysical, or geochemical observations. Shorter invited and contributed talks filled out the sessions, which were then concluded with an open discussion time. All modelers were requested to address the question of what observations would better constrain their models, and all observationists were requested to discuss how their observations can constrain modeling efforts.

Herrick, Robert↗

Inference of Expanded Lrp-Like Feast/Famine Transcription Factor Targets in a Non-Model Organism Using Protein Structure-Based Prediction

Widespread microbial genome sequencing presents an opportunity to understand the gene regulatory networks of non-model organisms. This requires knowledge of the binding sites for transcription factors whose DNA-binding properties are unknown or difficult to infer. We adapted a protein structure-based method to predict the specificities and putative regulons of homologous transcription factors across diverse species. As a proof-of-concept we predicted the specificities and transcriptional target genes of divergent archaeal feast/famine regulatory proteins, several of which are encoded in the genome of Halobacterium salinarum. This was validated by comparison to experimentally determined specificities for transcription factors in distantly related extremophiles, chromatin immunoprecipitation experiments, and cis-regulatory sequence conservation across eighteen related species of halobacteria. Through this analysis we were able to infer that Halobacterium salinarum employs a divergent local trans-regulatory strategy to regulate genes (carA and carB) involved in arginine and pyrimidine metabolism, whereas Escherichia coli employs an operon. The prediction of gene regulatory binding sites using structure-based methods is useful for the inference of gene regulatory relationships in new species that are otherwise difficult to infer.

59 BASIC BIOLOGICAL SCIENCES↗

Probabilistic Calibration of Expensive Models using Efficiently Trained Surrogates

Calibration of computational models in the presence of uncertainty is often cast as a Bayesian inference problem and solved via sampling methods, e.g., Markov chain Monte Carlo. When the computational model is expensive, this task becomes intractable due to the large number of samples required to accurately estimate the posterior distribution of the calibration parameters. A popular solution to this problem is to use machine learning to develop a faster-to-evaluate, lower-fidelity substitute for the original model to serve as a surrogate while solving the inference problem. Although considered an offline cost, generating training data to construct this surrogate model can still be an expensive task in practice. An active learning algorithm is presented that focuses training on improving surrogate accuracy specifically in and around the bulk of the posterior distribution, as this is where the model is exercised during calibration. Candidate samples are drawn from families of distributions related to an approximation of the posterior. The sample maximizing predictive variance is then selected for evaluation by the original computational model, yielding a label for the training point. Iterating this approach increases efficiency relative to space filling designs (e.g., Latin hypercube sampling) by avoiding low probability points. Practical considerations are discussed, including the benefits of using a sequential Monte Carlo sampling approach, convergence heuristics, and the importance of both exploration and exploitation given that the true posterior is unknown a priori.

uncertainty quantification↗

A Graphical Model for Fusing Diverse Microbiome Data

This paper develops a Bayesian graphical model for fusing disparate types of count data. The motivating application is the study of bacterial communities from diverse high-dimensional features, in this case, transcripts, collected from different treatments. In such datasets, there are no explicit correspondences between the communities and each corresponds to different factors, making data fusion challenging. We introduce a flexible multinomial-Gaussian generative model for jointly modeling such count data. This latent variable model jointly characterizes the observed data through a common multivariate Gaussian latent space that parameterizes the set of multinomial probabilities of the transcriptome counts. The covariance matrix of the latent variables induces a covariance matrix of co-dependencies between all the transcripts, effectively fusing multiple data sources. We present a computationally scalable variational Expectation-Maximization (EM) algorithm for inferring the latent variables and the parameters of the model. Here, the inferred latent variables provide a common dimensionality reduction for visualizing the data and the inferred parameters provide a predictive posterior distribution. In addition to simulation studies that demonstrate the variational EM procedure, we apply our model to a bacterial microbiome dataset.

59 BASIC BIOLOGICAL SCIENCES↗

A comparison between residential relocation timing of Sydney and Chicago residents: A Bayesian survival analysis

We report that understanding households' behaviour in residential relocation timing is of great importance in the field of transport engineering and economics. This research aims to develop a residential relocation model by considering the potential dynamic impacts of other households' decisions and variables, including economic and demographic attributes, housing features, intra-household decision-making structures, travel mode choice, and other life-course attributes. A multivariate parametric survival model with both fixed and time-varying covariates is developed. To the best of the authors' knowledge, this study is the first paper in the literature of residential relocation timing to propose the use of a Bayesian model in contrast to the widely used classic frequentist approach and have conducted a discussion on its advantages. An emerging residential relocation dataset collected for two cities in Australia and the USA (Sydney and Chicago cities) has been used, which covers residence, vehicle ownership, occupation, education, economic and demographic attributes of respondents. A comprehensive comparison between the results of two cities and a comparison between two Bayesian and frequentist approaches are made. This study confirms the impact of life-course variables, intra-household decision-making behaviours, and sociodemographic attributes on home mobility. According to the model outputs, the accelerating or decelerating impact of explanatory variables on the relocation timing has been almost the same in the two cities. The Bayesian model was confirmed to have some advantages over the frequentist model, including being straightforward to interpret, availability of making inferences on the results, and ease of handling complex models, and optimisation convergence complexities.

99 GENERAL AND MISCELLANEOUS↗

Inferring surface solar absorption from broadband satellite measurements

An atmospheric solar radiation model and surface albedo models that include wavelength dependence and surface anisotropy are combined to study the possibility of inferring the surface solar absorption from satellite measurements. The model includes ocean, desert, pasture land, savannah, and bog surface categories. Problems associated with converting narrowband measurements to broadband quantities are discussed, suggesting that it would be easier to infer surface solar absorption from broadband measurements directly. The practice of adopting a linear relationship between planetary and surface albedo to estimate surface albedos from satellite measurements is examined, showing that the linear conversion between broadband planetary and surface albedos is strongly dependent on vegetation type. It is suggested that there is a linear slope-offset relationship between surface and surface-atmosphere solar absorption.

Cess, Robert D.↗

Scalable and efficient algorithms for the propagation of uncertainty from data through inference to prediction for large-scale problems, with application to flow of the Antarctic ice sheet

The majority of research on efficient and scalable algorithms in computational science and engineering has focused on the forward problem : given parameter inputs, solve the governing equations to determine output quantities of interest. In contrast, in this paper, we consider the broader question: given a (large-scale) model containing uncertain parameters, (possibly) noisy observational data, and a prediction quantity of interest, how do we construct efficient and scalable algorithms to (1) infer the model parameters from the data (the deterministic inverse problem ), (2) quantify the uncertainty in the inferred parameters (the Bayesian inference problem), and (3) propagate the resulting uncertain parameters through the model to issue predictions with quantified uncertainties (the forward uncertainty propagation problem )? We present efficient and scalable algorithms for this end-to-end, data-to-prediction process under the Gaussian approximation and in the context of modeling the flow of the Antarctic ice sheet and its effect on loss of grounded ice to the ocean. The ice is modeled as a viscous, incompressible, creeping, shear-thinning fluid. The observational data come from satellite measurements of surface ice flow velocity, and the uncertain parameter field to be inferred is the basal sliding parameter, represented by a heterogeneous coefficient in a Robin boundary condition at the base of the ice sheet. The prediction quantity of interest is the present-day ice mass flux from the Antarctic continent to the ocean. We show that the work required for executing this data-to-prediction process—measured in number of forward (and adjoint) ice sheet model solves—is independent of the state dimension, parameter dimension, data dimension, and the number of processor cores. The key to achieving this dimension independence is to exploit the fact that, despite their large size, the observational data typically provide only sparse information on model parameters. This property can be exploited to construct a low rank approximation of the linearized parameter-to-observable map via randomized SVD methods and adjoint-based actions of Hessians of the data misfit functional.

54 ENVIRONMENTAL SCIENCES↗

Temporal Coupling of Subsurface and Surface Soil CO 2 Fluxes: Insights From a Nonsteady State Model and Cross-Wavelet Coherence Analysis

Inferences about subsurface CO 2 fluxes often rely on surface soil respiration (R soil ) estimates because directly measuring subsurface microbial and root respiration (collectively, CO 2 production, S Total ), is difficult. To evaluate how well R soil serves as a proxy for S Total , we applied the nonsteady state DEconvolution of Temporally varying Ecosystem Carbon componenTs model (0.01-m vertical resolution), using 6-hourly data from a Wyoming grassland, in six simulations that cross three soil types (clay, sandy loam, and sandy) with two depth distributions of subsurface biota. We used cross-wavelet coherence analysis to examine temporal coherence (localized linear correlation) and offsets (lags) between S Total and R soil and fluxes and drivers (e.g., soil temperature and moisture). Cross-wavelet coherence revealed higher coherence between fluxes and drivers than linear regressions between concurrent variables. Soil texture and moisture exerted the strongest controls over coherence between CO 2 fluxes. Coherence between CO 2 fluxes in all soil types was strong at short (~1 day) and long periods (>8 days), but soil type controlled lags, and rainfall events decoupled the fluxes at periods of 1–8 days for several days in sandy soil, up to 1 week in sandy loam, and for a month or more in clay soil. Concentrating root and microbial biomass nearer the surface decreased lags in all soil types and increased coherence up to 10% in clay soil. The assumption of high temporal coherence between R soil and S Total is likely valid in dry, sandy soil, but may lead to underestimates of short-term STotal in semiarid grasslands with fine-grained and/or wet soil.

54 ENVIRONMENTAL SCIENCES↗

THE PHYSICAL MECHANISM BEHIND M DWARF METALLICITY INDICATORS AND THE ROLE OF C AND O ABUNDANCES

We present near-infrared (NIR) synthetic spectra based on PHOENIX stellar atmosphere models of typical early and mid-M dwarfs with varied C and O abundances. We apply multiple recently published methods for determining M dwarf metallicity to our models to determine the effects of C and O abundances on metallicity indicators. We find that the pseudo-continuum level is very sensitive to C/O and that all metallicity indicators show a dependence on C and O abundances, especially in lower T {sub eff} models. In some cases, the inferred metallicity ranges over a full order of magnitude (>1 dex) when [C/Fe] and [O/Fe] are varied independently by ±0.2. We also find that [(O−C)/Fe], the difference in O and C abundances, is a better tracer of the pseudo-continuum level than C/O. Models of mid-M dwarfs with [C/Fe], [O/Fe], and [M/H] that are realistic in the context of galactic chemical evolution suggest that variation in [(O−C)/Fe] is the primary physical mechanism behind the M dwarf metallicity tracers investigated here. Empirically calibrated metallicity indicators are still valid for most nearby M dwarfs due to the tight correlation between [(O−C)/Fe] and [Fe/H] evident in spectroscopic surveys of solar neighborhood FGK stars. Variations in C and O abundances also affect the spectral energy distribution of M dwarfs. Allowing [O/Fe] to be a free parameter provides better agreement between the synthetic spectra and observed spectra of metal-rich M dwarfs. We suggest that flux-calibrated, low-resolution, NIR spectra can provide a path toward measuring C and O abundances in M dwarfs and breaking the degeneracy between C/O and [Fe/H] present in M dwarf metallicity indicators.

79 ASTRONOMY AND ASTROPHYSICS↗

Variational Bayesian Blind Image Deconvolution: A review

In this study, we provide a review of the recent literature on Bayesian Blind Image Deconvolution (BID) methods. We believe that two events have marked the recent history of BID: the predominance of Variational Bayes (VB) inference as a tool to solve BID problems and the increasing interest of the computer vision community in solving BID problems. VB inference in combination with recent image models like the ones based on Super Gaussian (SG) and Scale Mixture of Gaussians (SMG) representations have led to the use of very general and powerful tools to provide clear images from blurry observations. In the provided review emphasis is paid on VB inference and the use of SG and SMG models with coverage of recent advances in sampling methods. We also provide examples of current state of the art BID methods and discuss problems that very likely will mark the near future of BID.

97 MATHEMATICS AND COMPUTING↗

Probabilistic inference of the structure and orbit of Milky Way satellites with semi-analytic modelling

Semi-analytic modelling furnishes an efficient avenue for characterizing dark matter haloes associated with satellites of Milky Way-like systems, as it easily accounts for uncertainties arising from halo-to-halo variance, the orbital disruption of satellites, baryonic feedback, and the stellar-to-halo mass (SMHM) relation. We use the SatGen semi-analytic satellite generator, which incorporates both empirical models of the galaxy–halo connection as well as analytic prescriptions for the orbital evolution of these satellites after accretion onto a host to create large samples of Milky Way-like systems and their satellites. By selecting satellites in the sample that match observed properties of a particular dwarf galaxy, we can infer arbitrary properties of the satellite galaxy within the cold dark matter paradigm. For the Milky Way’s classical dwarfs, we provide inferred values (with associated uncertainties) for the maximum circular velocity v max and the radius r max at which it occurs, varying over two choices of baryonic feedback model and two prescriptions for the SMHM relation. While simple empirical scaling relations can recover the median inferred value for v max and r max , this approach provides realistic correlated uncertainties and aids interpretability. We also demonstrate how the internal properties of a satellite’s dark matter profile correlate with its orbit, and we show that it is difficult to reproduce observations of the Fornax dwarf without strong baryonic feedback. Furthermore, the technique developed in this work is flexible in its application of observational data and can leverage arbitrary information about the satellite galaxies to make inferences about their dark matter haloes and population statistics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗