Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Linear two-pool models are insufficient to infer soil organic matter decomposition temperature sensitivity from incubations

Abstract Terrestrial carbon (C)-climate feedbacks depend strongly on how soil organic matter (SOM) decomposition responds to temperature. This dependency is often represented in land models by the parameter Q 10 , which quantifies the relative increase of microbial soil respiration per 10 °C temperature increase. Many studies have conducted paired laboratory soil incubations and inferred “active” and “slow” pool Q 10 values by fitting linear two-pool models to measured respiration time series. Using a recently published incubation study (Qin et al. in Sci Adv 5(7):eaau1218, 2019) as an example, here we first show that the very high parametric equifinality of the linear two-pool models may render such incubation-based Q 10 estimates unreliable. In particular, we show that, accompanied by the uncertain initial active pool size, the slow pool Q 10 can span a very wide range, including values as high as 100, although all parameter combinations are producing almost equally good model fit with respect to the observations. This result is robust whether or not interactions between the active and slow pools are considered (typically these interactions are not considered when interpreting incubation data, but are part of the predictive soil carbon models). This very large parametric equifinality in the context of interpreting incubation data is consistent with the poor temporal extrapolation capability of linear multi-pool models identified in recent studies. Next, using a microbe-explicit SOM model (RESOM), we show that the inferred two pools and their associated parameters (e.g., Q 10 ) could be artificial constructs and are therefore unreliable concepts for integration into predictive models. We finally discuss uncertainties in applying linear two-pool (or more generally multiple-pool) models to estimate SOM decomposition parameters such as temperature sensitivities from laboratory incubations. We also propose new observations and model structures that could enable better process understanding and more robust predictive capabilities of soil carbon dynamics.

54 ENVIRONMENTAL SCIENCES↗

Accelerating Machine Learning Inference with GPUs in ProtoDUNE Data Processing

Abstract We study the performance of a cloud-based GPU-accelerated inference server to speed up event reconstruction in neutrino data batch jobs. Using detector data from the ProtoDUNE experiment and employing the standard DUNE grid job submission tools, we attempt to reprocess the data by running several thousand concurrent grid jobs, a rate we expect to be typical of current and future neutrino physics experiments. We process most of the dataset with the GPU version of our processing algorithm and the remainder with the CPU version for timing comparisons. We find that a 100-GPU cloud-based server is able to easily meet the processing demand, and that using the GPU version of the event processing algorithm is two times faster than processing these data with the CPU version when comparing to the newest CPUs in our sample. The amount of data transferred to the inference server during the GPU runs can overwhelm even the highest-bandwidth network switches, however, unless care is taken to observe network facility limits or otherwise distribute the jobs to multiple sites. We discuss the lessons learned from this processing campaign and several avenues for future improvements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Detecting dynamic causal inference in nonlinear two-phase fracture flow

Identifying dynamic causal inference involved in flow and transport processes in complex fractured-porous media is generally a challenging task, because nonlinear and chaotic variables may be positively coupled or correlated for some periods of time, but can then become spontaneously decoupled or non-correlated. In his 2002 paper (Faybishenko, 2002), the author performed a nonlinear dynamical and chaotic analysis of time-series data obtained from the fracture flow experiment conducted by Persoff and Pruess (1995), and, based on the visual examination of time series data, hypothesized that the observed pressure oscillations at both inlet and outlet edges of the fracture result from a superposition of both forward and return waves of pressure propagation through the fracture. In the current paper, the author explores an application of a combination of methods for detecting nonlinear chaotic dynamics behavior along with the multivariate Granger Causality (G-causality) time series test. Based on the G-causality test, the author infers that his hypothesis is correct, and presents a causation loop diagram of the spatial-temporal distribution of gas, liquid, and capillary pressures measured at the inlet and outlet of the fracture. The causal modeling approach can be used for the analysis of other hydrological processes, for example, infiltration and pumping tests in heterogeneous subsurface media, and climatic processes, for example, to find correlations between various meteorological parameters, such as temperature, solar radiation, barometric pressure, etc.

54 ENVIRONMENTAL SCIENCES↗

A large-scale evaluation of automated metadata inference approaches on sensors from air handling units

Building automation systems provide abundant sensor data to enable the potential of using data analytics to, among other things, improve the energy efficiency of the building. However, deployment of these applications for buildings, such as, fault detection and diagnosis (FDD) on multiple buildings remains a challenge due to the non-trivial efforts of organizing, managing and extracting metadata associated with sensors (e.g., information about their location, function, etc.), which is required by applications. One of the reasons leading to the problem is that varying conventions, acronyms, and standards are used to define this metadata. To better understand the nature of the problem, as well as the performance and scalability of existing solutions, in this report we implement and test 6 different time-series based metadata inference approaches on sensors from 614 air handling units (AHU) instrumented in 35 building sites accounting for more than 400 buildings distributed across United States of America. We infer 12 types of sensors and actuators in AHUs required by a rule-based FDD application: AHU performance and assessment rules (APAR). Our results show that: (1) the average performance of these approaches in terms of accuracy is similar across building sites, though there is significant variance; (2) the expected accuracy of classifying the type of points required by APAR for a new unseen building is, on average, 75%; (3) the performance of the model does not decrease as long as training data and testing data are extracted from adjacent months.

42 ENGINEERING↗

Inferring occupant counts from Wi-Fi data in buildings through machine learning

An important approach to curtail building energy consumption is to optimize building control based on occupancy information. Various studies proposed to estimate occupant counts through different approaches and sensors. However, high cost and privacy concerns remain as major barriers, restricting the practice of occupant count detection. In this study, we propose a novel method utilizing data from widely deployed Wi-Fi infrastructure to infer occupant counts through machine learning. Compared with the current indirect measurement methods, our method improves the performance of estimating people count: (1) we avoid privacy concerns by anonymizing and reshuffling the MAC addresses on a daily basis; (2) we adopted a heuristic feature engineer approach to cluster connected devices into different types based on their daily connection duration. We tested the method in an office building located in California. In an area with an average occupancy of 22–27 people and a peak occupancy of 48 - 74 people, the root square mean error on the test set is less than four people. The error is within two people counts for more than 70% of estimations, and less than six counts for more than 90% of estimations, indicating a relatively high accuracy. The major contribution of this study is proposing a novel and accurate approach to detect occupant counts in a non-intrusive way, i.e., utilizing existing Wi-Fi infrastructure in buildings without requiring the installation of extra hardware or sensors. The method we proposed is generic and could be applied to other commercial buildings to infer occupant counts for energy efficient building control.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Onset of magma ocean solidification on Mars inferred from Mn-Cr chronometry

The mantle of Mars probably differentiated through the crystallization of a magma ocean during the first tens of million years (Ma) of Solar System evolution. However, the exact timescale of large-scale silicate differentiation of the martian mantle is debated, and in particular, it remains unclear when differentiation commenced. In this paper, we applied the short-lived 53 Mn- 53 Cr system to martian meteorites in order to date the onset of large-scale mantle differentiation on Mars. The new Cr isotope data demonstrate that martian meteorites exhibit no resolvable radiogenic 53 Cr variations, and instead have a uniform +20.2±1.2 (95% conf.) parts-per-million excess in 53 Cr/ 52 Cr relative to the terrestrial mantle. The investigated groups of martian meteorites are lithologically varied and derive from diverse mantle sources that probably had variable Mn/Cr. Hence, the lack of 53 Cr variability among martian meteorites demonstrates that silicate differentiation on Mars occurred after the extinction of 53 Mn. Provided that the sources of the martian meteorites have Mn/Cr variations that are typical of the terrestrial planets, this result implies that the onset of large-scale silicate differentiation must have occurred later than 20±5 Ma after Solar System formation. The onset of silicate differentiation on Mars inferred here is significantly later than time estimates for segregation of the martian core which conservatively occurred within <10 Ma after Solar System formation. Thus, the new Mn-Cr data imply that there was a small, but resolvable, time gap of at least 5 Ma between core formation and magma ocean solidification on Mars. If the age of core segregation is taken at face value, our results imply that the martian magma ocean remained mostly molten over several Ma. This inferred longevity of the magma ocean is inconsistent with thermal models predicting rapid (<1 Ma) solidification of the martian magma ocean. Although there is currently no unique solution to this conundrum, our results can potentially be explained by a protracted history of impact bombardment that delayed differentiation in a shallow magma ocean on Mars, or perhaps more readily, by the presence of an early and dense atmosphere that acted as an insulator and prevented the magma ocean from cooling quickly.

58 GEOSCIENCES↗

Generalized fiducial inference on differentiable manifolds

We introduce a novel approach to inference on parameters that take values in a Riemannian manifold embedded in a Euclidean space. Parameter spaces of this form are ubiquitous across many fields, including chemistry, physics, computer graphics, and geology. Here, this new approach uses generalized fiducial inference (GFI) to obtain a posterior-like distribution on the manifold, without needing to know local parameterizations that map to the constrained space from an unconstrained Euclidean space. Using mathematical tools from Riemannian geometry, we construct a constrained generalized fiducial distribution (CGFD). A Bernstein-von Mises-type result for the CGFD, which provides intuition for how the desirable asymptotic qualities of the unconstrained generalized fiducial distribution are inherited by the CGFD, is provided. To illustrate the practical use of the CGFD, we provide a proof-of-concept example in the context of a linear logspline density estimation problem, and demonstrate that CGFD-based confidence sets exhibit desirable coverage properties via simulation. As an application, we fit a CGFD to COVID-19 case count data from North Carolina, USA.

97 MATHEMATICS AND COMPUTING↗

A Bayesian statistical approach to inferring particle dynamics from in-situ pump POC and chloropigment data from the Mediterranean Sea

Concentrations of chloropigments and particulate organic carbon (POC) in large-volume in-situ pump samples from the Mediterranean Sea were used to estimate rate constants of processes that control the fate of particles, and specifically chloropigments, in the water column. In this paper we introduce a Bayesian statistical inversion method that combines the data with a new box model and has the capacity to infer rate constants for POC respiration/dissolution, chlorophyll and pheopigment degradation, and particle aggregation and disaggregation. We use first-order kinetics to model disaggregation, and use both first-order and second-order kinetics to model aggregation. Using these methods, the estimated small-particle (1–70 μm) POC respiration rate constant was 2.44 -1.00 +1.69 yr -1 (0.41 yr). The estimated disaggregation and second-order aggregation rate constants were 85.6 -36.4 +63.4 yr -1 (1.17×10 -2 yr) and 2.78 -1.17 +2.01 μM -1 yr -1 , respectively. Using the optimal rate constants and the corresponding particle concentrations, disaggregation is ~4.2 times faster than the small-size POC dissolution rate, which indicates that disaggregation is a dominant processes at the time of sampling. More importantly, by comparing our results with those of previous studies, we conclude that sampling methods have less influence than tracers themselves on inferring particle dynamic rate constants. We previously introduced a somewhat similar approach to modeling SV sediment trap data, but large volume pumps are a much more common sample collection method in oceanographic surveys than SV sediment traps, and thus our new model should have a wider applicability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An iterative learning and inference approach to managing dynamic cyber-vulnerabilities of complex systems

As modern systems become increasingly reliant on cyber-technologies and continue to be integrated with physical systems, managing risks from deliberate and non-deliberate sources is a significant research challenge. Unlike strictly physical systems, cyber-enabled physical systems are influenced by dynamic and evolving technologies, environments, and attack mechanisms. As a result, vulnerabilities are rapidly changing and difficult to detect and manage. While there is recent interest in the dynamic properties of performance through resilience analysis, limited research addresses the dynamic nature of cyber-system vulnerability. This paper presents a dynamic iterative learning approach to evaluate the state of health for systems as related to cyber-vulnerabilities. These time-varying system health characteristics may not be visible, but can be inferred using observable characteristics. The approach recognizes that multiple types of vulnerabilities need to be included in a holistic system health assessment. The methods are applied to the Common Vulnerability Scoring System database containing over 100,000 documented cybersecurity vulnerabilities. This work is the first to acknowledge the dynamic properties of cyber-vulnerability, while also inferring system health using observable data and hidden states of system health. This work will be of interest to managers of large-scale cyber-enabled physical systems who are seeking to prioritize system health investments.

Chatterjee, Samrat↗

A Bayesian model for multivariate discrete data using spatial and expert information with application to inferring building attributes

When modeling sparsely observed multivariate data, strong prior information elicited from experts can be used to bolster predictive accuracy and counteract sampling bias. Similarly, modeling autocorrelation in space can help make use of co-occurrence patterns present in many types of spatial data. To make use of both expert prior information and spatial structure, we propose a novel graphical model for a spatial Bayesian network developed specifically to address challenges in inferring the attributes of buildings from geographically sparse observational data. This model is implemented as the sum of a spatial multivariate Gaussian random field and a tabular conditional probability function in real-valued space prior to projection onto the probability simplex. This modeling form is especially suitable for the usage of prior information in the form of sets of atomic rules obtained from experts. To perform inference with missing data, we implement a Markov chain Monte Carlo scheme composed of alternating steps of Gibbs sampling of missing entries and Hamiltonian Monte Carlo for model parameters. A case study in building attribution is presented to highlight the advantages and limitations of this approach.

97 MATHEMATICS AND COMPUTING↗

A survey of techniques for optimizing transformer inference

Recent years have seen a phenomenal rise in the performance and applications of transformer neural networks. The family of transformer networks, including Bidirectional Encoder Representations from Transformer (BERT), Generative Pretrained Transformer (GPT) and Vision Transformer (ViT), have shown their effectiveness across Natural Language Processing (NLP) and Computer Vision (CV) domains. Transformer-based networks such as ChatGPT have impacted the lives of common men. However, the quest for high predictive performance has led to an exponential increase in transformers' memory and compute footprint. Researchers have proposed techniques to optimize transformer inference at all levels of abstraction. Further, this paper presents a comprehensive survey of techniques for optimizing the inference phase of transformer networks. We survey techniques such as knowledge distillation, pruning, quantization, neural architecture search and lightweight network design at the algorithmic level. We further review hardware-level optimization techniques and the design of novel hardware accelerators for transformers. We summarize the quantitative results on the number of parameters/FLOPs and the accuracy of several models/techniques to showcase the tradeoff exercised by them. We also outline future directions in this rapidly evolving field of research. We believe that this survey will educate both novice and seasoned researchers and also spark a plethora of research efforts in this field.

97 MATHEMATICS AND COMPUTING↗

Applying Gaussian Process Machine Learning and Modern Probabilistic Programming to Satellite Data to Infer CO 2 Emissions

Satellite data provides essential insights into the spatiotemporal distribution of CO 2 concentrations. However, many atmospheric inverse models fail to adequately incorporate the spatial and temporal correlations inherent in satellite observations and often lack rigorous methods for estimating parameters like spatial length scales. We introduce an inference model that processes the spatiotemporal covariance in satellite data and estimates hyperparameters such as covariance length scales. Our approach uses the Gaussian process (GP) machine learning (ML) and modern probabilistic programming languages (PPLs) to perform atmospheric inversions of emissions from satellite data. We develop a GP ML inversion system based on modern PPLs and the GEOS-Chem chemical transport model, simulating atmospheric CO 2 concentrations corresponding to the Orbiting Carbon Observatory-2/3 (OCO-2/3) data for July 2020. In our supervised learning framework, we treat the GEOS-Chem simulated data set as the target, with predictors derived by scaling the target with sector-specific factors hidden from the GP machine. Our results show that the GP model, combined with GPU-enabled PPLs, effectively retrieves true emission scaling factors and infers noise levels concealed within the data. This suggests that our method could be applied over larger areas with more complex covariance structures, enabling comprehensive analysis of the spatiotemporal patterns observed in OCO-2/3 and similar satellite data sets.

54 ENVIRONMENTAL SCIENCES↗

The Role of Normal Stress and Shear Stress Heterogeneity in the Inferred Depth‐Independence of Stress Drop

Earthquake stress drops are inferred to be independent of source depth, contradicting linear scaling predictions for earthquakes as frictional stick‐slip instabilities that assume increasing fault normal stress due to overburden. Here, we examine the scaling between averaged stress drops and increasing normal stress for simulated earthquake sequences in continuum rate‐and‐state fault models. The models produce a weaker dependence of stress drop on normal stress than the linearity of simple friction, which can be well‐fit by a sublinear power‐law. This result is more prominent when the fault dimension is much larger than nucleation scales. In such cases, the averaged behavior of ruptures is dominated by rupture propagation conditions, reflecting more heterogeneous shear stress conditions. As natural faults can be considerably larger than the smallest earthquakes they host, such a weaker scaling between averaged rupture conditions and normal stress may partially explain the lack of an inferred depth‐dependence of earthquake stress drops.

earthquake source↗

Inferring three-nucleon couplings from multi-messenger neutron-star observations

Understanding the interactions between nucleons in dense matter is an important challenge in theoretical physics. Effective field theories have emerged as the dominant approach to address this problem at low energies, with many successful applications to the structure of nuclei and the properties of dense nucleonic matter. However, how far into the interior of neutron stars these interactions can describe dense matter is an open question. Here, we develop a framework that enables the inference of three-nucleon couplings in dense matter directly from astrophysical neutron star observations. We apply this formalism to the LIGO/Virgo gravitational-wave event GW170817 and the X-ray measurements from NASA’s Neutron Star Interior Composition Explorer and establish direct constraints for the couplings that govern three-nucleon interactions in chiral effective field theory. Furthermore, we demonstrate how next-generation observations of a population of neutron star mergers can offer stringent constraints on three-nucleon couplings, potentially at a level comparable to those from laboratory data. Our work directly connects the microscopic couplings in quantum field theories to macroscopic observations of neutron stars, providing a way to test the consistency between low-energy couplings inferred from terrestrial and astrophysical data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Hardware-accelerated inference for real-time gravitational-wave astronomy

The field of transient astronomy has seen a revolution with the first gravitational-wave detections and the arrival of multi-messenger observations they enabled. Transformed by the first detection of binary black hole and binary neutron star mergers, computational demands in gravitational-wave astronomy are expected to grow by at least a factor of two over the next five years as the global network of kilometer-scale interferometers are brought to design sensitivity. With the increase in detector sensitivity, real-time delivery of gravitational-wave alerts will become increasingly important as an enabler of multi-messenger followup. In this work, we report a novel implementation and deployment of deep learning inference for real-time gravitational-wave data denoising and astrophysical source identification. This is accomplished using a generic Inference-as-a-Service model that is capable of adapting to the future needs of gravitational-wave data analysis. Overall, our implementation allows seamless incorporation of hardware accelerators and also enables the use of commercial or private (dedicated) as-a-service computing. Based on our results, we propose a paradigm shift in low-latency and offline computing in gravitational-wave astronomy. Such a shift can address key challenges in peak-usage, scalability and reliability, and provide a data analysis platform particularly optimized for deep learning applications. The achieved sub-millisecond scale latency will also be relevant for any machine learning-based real-time control systems that may be invoked in the operation of near-future and next generation ground-based laser interferometers, as well as the front-end collection, distribution and processing of data from such instruments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Inferring the spread of COVID-19: the role of time-varying reporting rate in epidemiological modelling

The role of epidemiological models is crucial for informing public health officials during a public health emergency, such as the COVID-19 pandemic. However, traditional epidemiological models fail to capture the time-varying effects of mitigation strategies and do not account for under-reporting of active cases, thus introducing bias in the estimation of model parameters. To infer more accurate parameter estimates and to reduce the uncertainty of these estimates, we extend the SIR and SEIR epidemiological models with two time-varying parameters that capture the transmission rate and the rate at which active cases are reported to health officials. Using two real data sets of COVID-19 cases, we perform Bayesian inference via our SIR and SEIR models with time-varying transmission and reporting rates and via their standard counterparts with constant rates; our approach provides parameter estimates with more realistic interpretation, and 1-week ahead predictions with reduced uncertainty. Furthermore, we find consistent under-reporting in the number of active cases in the data that we consider, suggesting that the initial phase of the pandemic was more widespread than previously reported.

42 ENGINEERING↗

TDCOSMO - IV. Hierarchical time-delay cosmography – joint inference of the Hubble constant and galaxy density profiles

The H0LiCOW collaboration inferred via strong gravitational lensing time delays a Hubble constant value of H0 = 73.3−1.8+1.7 km s−1 Mpc−1, describing deflector mass density profiles by either a power-law or stars (constant mass-to-light ratio) plus standard dark matter halos. The mass-sheet transform (MST) that leaves the lensing observables unchanged is considered the dominant source of residual uncertainty in H0. We quantify any potential effect of the MST with a flexible family of mass models, which directly encodes it, and they are hence maximally degenerate with H0. Our calculation is based on a new hierarchical Bayesian approach in which the MST is only constrained by stellar kinematics. The approach is validated on mock lenses, which are generated from hydrodynamic simulations. We first applied the inference to the TDCOSMO sample of seven lenses, six of which are from H0LiCOW, and measured H0 = 74.5−6.1+5.6 km s−1 Mpc−1. Secondly, in order to further constrain the deflector mass density profiles, we added imaging and spectroscopy for a set of 33 strong gravitational lenses from the Sloan Lens ACS (SLACS) sample. For nine of the 33 SLAC lenses, we used resolved kinematics to constrain the stellar anisotropy. From the joint hierarchical analysis of the TDCOSMO+SLACS sample, we measured H0 = 67.4−3.2+4.1 km s−1 Mpc−1. This measurement assumes that the TDCOSMO and SLACS galaxies are drawn from the same parent population. The blind H0LiCOW, TDCOSMO-only and TDCOSMO+SLACS analyses are in mutual statistical agreement. The TDCOSMO+SLACS analysis prefers marginally shallower mass profiles than H0LiCOW or TDCOSMO-only. Without relying on the form of the mass density profile used by H0LiCOW, we achieve a ∼5% measurement of H0. While our new hierarchical analysis does not statistically invalidate the mass profile assumptions by H0LiCOW – and thus the H0 measurement relying on them – it demonstrates the importance of understanding the mass density profile of elliptical galaxies. The uncertainties on H0 derived in this paper can be reduced by physical or observational priors on the form of the mass profile, or by additional data.Key words: gravitational lensing: strong / galaxies: general / galaxies: kinematics and dynamics / distance scale / cosmological parameters / cosmology: observations⋆ The full analysis is available at https://github.com/TDCOSMO/hierarchy_analysis_2020_public.

79 ASTRONOMY AND ASTROPHYSICS↗

Generalized framework for likelihood-based field-level inference of growth rate from velocity and density fields

Measuring the growth rate of large-scale structures ( f ) as a function of redshift has the potential to break degeneracies between modified gravity and dark energy models, when combined with expansion-rate probes. Direct estimates of peculiar velocities of galaxies have attracted interest as a means of estimating fσ 8 . In particular, field-level methods can be used to fit the field nuisance parameter along with cosmological parameters simultaneously. This article aims to provide the community with a unified framework for the theoretical modeling of the likelihood-based field-level inference by performing fast field covariance calculations for velocity and density fields. Our purpose is to lay the foundations for a nonlinear extension of the likelihood-based method at the field level. We have developed a generalized framework, implemented in the dedicated software flip to perform a likelihood-based inference of fσ 8 . We derived a new field covariance model, which includes wide-angle corrections. We also included the models previously described in the literature inside our framework. We compared their performance against ours, and we validated our model by comparing it with the two-point statistics of a recent N-body simulation. The tests we performed have allowed us to validate our software and determine the appropriate wavenumber range to integrate our covariance model and its validity in terms of separation. Our framework allows for a wider wavenumber coverage to be used in our calculations than in previous works, which is particularly interesting for nonlinear model extensions. Finally, our generalized framework allows us to efficiently perform a survey geometry-dependent Fisher forecast of the fσ 8 parameter. We show that the Fisher forecast method we developed gives an error bar that is 30% closer to a full likelihood-based estimation than a standard volume Fisher forecast.

Ravoux, Corentin↗