Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Enabling Highly Efficient Capsule Networks Processing Through A PIM-Based Architecture Design

In recent years, the CNNs have achieved great successes in the image processing tasks, e.g., image recognition and object detection. Unfortunately, traditional CNN's classication is found to be easily misled by increasingly complex image features due to the usage of pooling operations, hence unable to preserve accurate position and pose information of the objects. To address this challenge, a novel neural network structure called Capsule Network has been proposed, which introduces equivariance through capsules to signicantly enhance the learning ability for image segmentation and object detection. Due to its requirement of performing a high volume of matrix operations, CapsNets have been generally accelerated on modern GPU platforms that provide highly optimized software library for common deep learning tasks. However, based on our performance characterization on modern GPUs, CapsNets exhibit low effciency due to the special program and execution features of their routing procedure, including massive unshareable intermediate variables and intensive syn- chronizations, which are very dicult to optimize at software level. To address these challenges, we propose a hybrid computing architecture design named PIM-CapsNet. It preserves GPU's on-chip computing capability for accelerating CNN types of layers in CapsNet, while pipelining with an off-chip in-memory acceleration solution that effectively tackles routing procedure's ineffciency by leveraging the processing-in-memory capability of today's 3D stacked memory. Using routing procedure's inherent parallellization feature, our design enables hierarchical improvements on CapsNet inference effciency through minimizing data movement and maximizing parallel processing in memory. Evaluation results demonstrate that our proposed design can achieve substantial improvement on both performance and energy savings for CapsNet inference, with almost zero accuracy loss. The results also suggest good performance scalability in optimizing the routing procedure with increasing network size.

Zhang, Xingyao↗
DOE OSTI2023

Nonparametric Inference for the Reproductive Rate in Generalized Compartmental Models

We develop a tractable nonparametric model for the time-varying reproductive rate of infectious diseases that combines the structure of a deterministic compartmental model and a stochastic model for incidence data. We use Bayesian inference to estimate, with uncertainty, the reproductive rate of the Coronavirus 2019 outbreak in the U.S. states of California, Florida, Michigan, New Mexico, New York, and Texas from January 2020 to March 2022. Employing the inferred reproductive rates, we estimate the posterior distribution of the time-varying reproduction numbers for each state. Compering the time-varying reproduction numbers across the states, we identify some epidemic waves, potentially driven from changes in human behavior and virus mutations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Time-resolved CO 2 , CO, and N 2 vibrational population measurements in Ns pulse discharge plasmas

Abstract Time-resolved CO 2 and N 2 vibrational populations and translational-rotational temperature are measured in a CO 2 –N 2 plasma sustained by a ns pulse discharge burst in plane-to-plane geometry. Time-resolved, absolute number density of CO generated in the plasma is also inferred from the experimental data. CO 2 and CO vibrational populations are measured by mid-IR, tunable quantum cascade laser absorption spectroscopy, and N 2 vibrational populations are measured by the ns broadband vibrational CARS. Transient excitation of N 2 and CO 2 asymmetric stretch vibrational energy modes is detected during the discharge burst. The time-resolved rate of CO generation does not correlate with N 2 or CO 2 ( ν 3 ) vibrational temperatures, indicating that CO 2 dissociation via the vibrational excitation is insignificant at the present conditions. The rate of CO generation decreases gradually during the discharge burst. The estimated specific energy cost of the CO product is close to that of N atoms in pure nitrogen, measured previously at similar operating conditions. Comparison of the experimental data with the kinetic modeling analysis indicates that CO 2 dissociation in collisions with electronically excited N 2 molecules is the dominant channel of CO generation at the present conditions, although the inferred CO yield in these processes is significantly lower than 1. The effect of vibrational energy transfer between N 2 and CO 2 on the plasma chemical processes is insignificant. The kinetic model underpredicts a rapid reduction of the N 2 and CO 2 ( ν 3 ) vibrational temperatures during the later half of the discharge burst and in the afterglow. V–T relaxation of N 2 by N and O atoms generated in the ns pulse discharge plasma does not affect the vibrational relaxation rate in a significant way. However, rapid V–T relaxation of CO 2 by O atoms has a significant effect on the relaxation rate. The difference between the experimental data and the modeling predictions may be due to the unknown scaling of the CO 2 –O V–T rates with the vibrational quantum number.

Physics↗
DOE OSTI2023

Bayesian inference for the seismic moment tensor using regional waveforms and a data-derived distribution of velocity models

The largest source of uncertainty in any source inversion is the velocity model used to construct the transfer function employed in the forward model that relates observed ground motion to the seismic moment tensor. However, standard inverse procedures often does not quantify uncertainty in the seismic moment tensor due to error in the Green’s functions from uncertain event location and Earth structure. We attempt to incorporate this uncertainty into an estimation of the seismic moment tensor using a distribution of velocity models calculated in a prior effort based on different and complementary data sets. The posterior distribution of velocity models is then used to construct Green’s functions for use in Bayesian inference of an unknown seismic moment tensor using regional waveform data. The combined likelihood is estimated using data-specific error models and the posterior of the seismic moment tensor is estimated and can be interpreted in terms of most-probable source-type.

58 GEOSCIENCES↗
DOE OSTI2026

A Statistician’s Overview of Physics-Informed Neural Networks for Spatio-Temporal Data

The recent success of deep neural network models with physical constraints (so-called, Physics-Informed Neural Networks, PINNs) has led to renewed interest in the incorporation of mechanistic information in predictive models. Statisticians and others have long been interested in this problem, which has led to several practical and innovative solutions dating back decades. In this overview, we focus on the problem of data-driven prediction and inference of dynamic spatio-temporal processes that include mechanistic information, such as would be available from partial differential equations, with a strong focus on the quantification of uncertainty associated with data, process, and parameters. Here, we give a brief review of several paradigms and focus our attention on Bayesian implementations given they naturally accommodate uncertainty quantification. We then show that it is straight-forward to include the Bayesian PINN (B-PINN) within the Bayesian hierarchical model (BHM) framework that has long been considered for modeling dynamic spatio-temporal processes. Such a BHM-PINN is illustrated via a simulation study in which a latent nonlinear Burgers’ equation PDE governs the dynamics of Poisson distributed spatio-temporal data. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

Bayesian↗
DOE OSTI2021

Attend and Decode: 4D fMRI Task State Decoding Using Attention Models

Source code for Brain Attend and Decode paper. Functional magnetic resonance imaging (fMRI) is a neuroimaging modality that captures the blood oxygen level in a subject's brain while the subject either rests or performs a variety of functional tasks under different conditions. Given fMRI data, the problem of inferring the task, known as task state decoding, is challenging due to the high dimensionality (hundreds of million sampling points per datum) and complex spatio-temporal blood flow patterns inherent in the data. In this work, we propose to tackle the fMRI task state decoding problem by casting it as a 4D spatiotemporal classification problem. We present a novel architecture called Brain Attend and Decode (BAnD), that uses residual convolutional neural networks for spatial feature extraction and self-attention mechanisms for temporal modeling. We achieve significant performance gain compared to previous works on a 7-task benchmark from the large-scale Human Connectome Project-Young Adult (HCP-YA) dataset. We also investigate the transferability of BAnD's extracted features on unseen HCP tasks, either by freezing the spatial feature extraction layers and retraining the temporal model, or finetuning the entire model. The pre-trained features from BAnD are useful on similar tasks while finetuning them yields competitive results on unseen tasks/conditions.

Ng, BrendaM.↗
DOE OSTI2024

Revealing complex subsurface dynamics with continuous seismic monitoring: Observations using distributed acoustic sensing and surface orbital vibrators during hydraulic fracturing

Understanding hydraulic fracturing is crucial to improving the stimulation of unconventional reservoirs and increasing fluid production. This study develops a novel seismic monitoring technology using distributed acoustic sensing (DAS) and surface orbital vibrators (SOV) to capture fracture seismic response and mechanical properties at high temporal intervals. We analyze continuous time-lapse vertical seismic profiling (VSP) data acquired every hour during the first nine days of treatment of an unconventional reservoir in the Austin Chalk/Eagle Field Laboratory. The VSP data contain clear seismic signals scattered from the activated fractures. The spatiotemporal changes of the fracture reflectivity revealed by the SOV/DAS data correlate well with the observations of fracture locations inferred from low-frequency DAS data. These results capture the fracture opening and closure processes, as well as highlight potential prestage activations of the fractures due to hydraulic connectivity with preexisting fracture systems. Therefore, analysis of the presented data set provides a unique opportunity to understand fracture initiation and subsequent evolution, not only in the context of unconventional resources but also in enhanced geothermal systems.

Correa, Julia↗
DOE OSTI2023

The 100-month Swift catalogue of supergiant fast X–ray transients

Supergiant fast X-ray transients (SFXTs) are high mass X-ray binaries (HMXBs) displaying X-ray outbursts that can reach peak luminosities up to 10 38 erg s -1 and spend most of their lives in more quiescent states with luminosities as low as 10 32 -10 33 erg s -1 . During the quiescent states, less luminous flares are also frequently observed with luminosities of 10 34 -10 35 erg s -1 . The main goal of the comprehensive and uniform analysis of the SFXT Swift triggers presented in this paper is to provide tools to predict whether a transient that has no known X-ray counterpart may be an SFXT candidate. These tools can be exploited for the development of future missions exploring the variable X-ray sky through large field-of-view instruments. We examined all available data on outbursts of SFXTs that triggered the Swift/Burst Alert Telescope (BAT) collected between 2005 August 30 and 2014 December 31, in particular those for which broad-band data, including the Swift/X-ray Telescope (XRT) data, are also available. This work complements and extends our previous catalogue of SFXT flares detected by BAT from 2005 February 12 to 2013 May 31, since we now include the additional BAT triggers recorded until the end of 2014 (i.e. beyond the formal first 100 months of the Swift mission). Due to a change in the mission’s observational strategy, virtually no SFXT triggers obtained a broad-band response after 2014. We processed all BAT and XRT data uniformly by using the Swift Burst Analyser to produce spectral evolution dependent flux light curves for each outburst in the sample. The BAT data allowed us to infer useful diagnostics to set SFXT triggers apart from the general γ-ray burst population, showing that SFXTs uniquely give rise to image triggers and are simultaneously very long, faint, and ‘soft’ hard-X-ray transients. We find that the BAT data alone can discriminate very well the SFXTs from other classes of fast transients, such as anomalous X-ray pulsars and soft gamma repeaters. On the contrary, the XRT data collected around the time of the BAT triggers are shown to be decisive for distinguishing SFXTs from, for instance, accreting millisecond X-ray pulsars and jetted tidal disruption events. The XRT observations of 35 (out of 52 in total) SFXT BAT triggers show that in the soft X-ray energy band, SFXTs display a decay in flux from the peak of the outburst of at least three orders of magnitude within a day and rarely undergo large re-brightening episodes, favouring in most cases a rapid decay down to the quiescent level within three to five days (at most).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Quantum-Inspired Bayesian Sampling for Uncertainty Quantification and Machine Learning (Final Technical Report)

With increasing simulation and measurement data, machine learning and artificial intelligence have been widely used in computational decision-making of complex engineering systems. The resulting tools, such as uncertainty quantification solvers, reinforcement learning, and physics-informed machine learning, have achieved great success in critical DOE tasks such as material discovery and design, energy system modeling and control, and numerical weather and climate prediction. A core topic in scientific machine learning and artificial intelligence is Bayesian inference: given an observed data set, people want to estimate the posterior distribution of a (possibly large) number of hidden parameters. Due to the flexibility and weak assumptions, Bayesian sampling has been the mainstream Bayesian inference solvers despite the rapid progress of approximate Bayesian inference. Classical Bayesian sampling methods such as Markov-chain Monte Carlo suffer from a low-acceptance rate due to the random walk nature, therefore state-of-the-art techniques use Hamiltonian Monte Carlo and its variants to efficiently draw posterior samples in a high dimension. The key idea of Hamiltonian Monte Carlo and its variants is to simulate the Hamiltonian dynamics of a classical particle with a fixed mass, and their performance significantly degrades when the posterior distribution is highly spiky or has multiple modes. Leveraging the idea of quantum physics, this project has investigated new theory, algorithms and applications of Bayesian inference (especially Bayesian sampling). The main results include: (1) novel quantum-inspired Bayesian sampling methods that can lead to better accuracy for challenging multi-modal or spiky distributions, (2) more scalable machine learning framework leveraging tensor-compressed Bayesian inference, and (3) Bayesian and sampling approaches for verifying the robustness of continuous and binary neural networks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Integration of a DER Management System in Riverside. Final report

The tasks in this project covered various aspects, including algorithm development, algorithm integration into a commercial Active Network Management (ANM) platform, hardware-in-the-loop (HIL) testing in an industry-standard testing platform, pilot demonstration in Riverside, California, and also cost and benefit analysis. The DERMS platform in this project can host different algorithms developed on different platforms (e.g., MATLAB and Python) and it can interact with different hardware devices (e.g., different PV inverters, battery inverters, and different sensors). The DER control solution are based on an advanced model-free, layered, and clustered DER control paradigm. At the core of the DER control algorithms was the concept of Extremum Seeking (ES), which is a model-free probing-based control technique. The ES-based control algorithms were tested on major real-world inverters; both individually and in a cluster. It was shown that even legacy equipment (or when paired with a few additional advanced equipment) can support such advanced control. The monitoring algorithms utilize a heterogeneous set of legacy and advanced sensor measurements, such as behind-the-meter DER sensors, distribution-level Phase Measurement Units, distribution-substation Supervisory Control and Data Acquisition (SCADA), and line current sensors, with their limited availability; in order to infer practical network conditions. Sensor data are utilized to achieve resource forecasting, phase identification, and distribution system state estimation. The technology that was developed and demonstrated in this project could be transformational to utilities, including the smaller municipal utilities such as in Riverside, which may not have the resources to deploy advanced distribution system and DERMS solutions in order to support high penetration of solar power integration. This project created a real-world prototype to provide utilities with an assessment of smart grid monitoring and control technologies.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Measuring cosmological distances using cluster edges as a standard ruler

ABSTRACT The line-of-sight velocity dispersion profile of galaxy clusters exhibits a ‘kink’ corresponding to the spatial extent of orbiting galaxies. Because the spatial extent of a cluster is correlated with the amplitude of the velocity dispersion profile, we can utilize this feature as a gravity-calibrated standard ruler. Specifically, the amplitude of the velocity dispersion data allows us to infer the physical cluster size. Consequently, observations of the angular scale of the ‘kink’ in the profile can be translated into a distance measurement to the cluster. Assuming the relation between cluster radius and cluster velocity dispersion can be calibrated from simulations, we forecast that with existing data from the Sloan Digital Sky Survey we will be able to measure the Hubble constant with 3.0 per cent precision. Implementing our method with data from the Dark Energy Spectroscopic Instrument (DESI) will result in a 1.3 per cent measurement of the Hubble constant. Adding cosmological supernova data improves the uncertainty of the DESI measurement to 0.7 per cent. While these error estimates are statistical only, they provide strong motivation for pursuing the necessary simulation program required to characterize and calibrate the systematic uncertainties impacting our proposed measurement. Whether or not our proposed measurement can in fact result in competitive H0 constraints will depend on what the eventual systematics floor for this method is.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Shedding light on shadow generalized parton distributions

The feasibility of extracting generalized parton distributions (GPDs) from deeply virtual Compton scattering (DVCS) data has recently been questioned because of the existence of an infinite set of so-called “shadow GPDs” (SGPDs). These SGPDs depend on the process and manifest as multiple solutions (at a fixed scale 𝑄 2 ) to the inverse problem that needs to be solved to infer GPDs from DVCS data. SGPDs therefore pose a significant challenge for extracting GPDs from DVCS data. With this motivation we study the extent to which QCD evolution can provide constraints on SGPDs. This is possible because the known classes of SGPDs begin to contribute to observables after evolution, and can then be constrained (at the input scale 𝑄$^{2}_{0}$) by data that has a finite 𝑄 2 range. The impact that SGPDs could have on determining the total angular momentum, pressure and sheer force distributions, and tomography is also discussed. We find that 𝑄 2 evolution, given empirical data over a wide range of skewness (𝜉 ) and 𝑄 2 scales, constrains the SGPDs studied at low 𝑥 and low 𝜉. If this finding generalizes to all SGPDs—and we have not been able to find any SGPDs with qualitatively different behavior—then this potentially makes extraction of GPDs from DVCS possible over a limited range of 𝑥 and 𝜉.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Mixture Model Framework for Traumatic Brain Injury Prognosis Using Heterogeneous Clinical and Outcome Data

Prognoses of Traumatic Brain Injury (TBI) outcomes are neither easily nor accurately determined from clinical indicators. This is due in part to the heterogeneity of damage inflicted to the brain, ultimately resulting in diverse and complex outcomes. Using a data-driven approach on many distinct data elements may be necessary to describe this large set of outcomes and thereby robustly depict the nuanced differences among TBI patients’ recovery. In this work, we develop a method for modeling large heterogeneous data types relevant to TBI. Our approach is geared toward the probabilistic representation of mixed continuous and discrete variables with missing values. The model is trained on a dataset encompassing a variety of data types, including demographics, blood-based biomarkers, and imaging findings. In addition, it includes a set of clinical outcome assessments at 3, 6, and 12 months post-injury. The model is used to stratify patients into distinct groups in an unsupervised learning setting. We use the model to infer outcomes using input data, and show that the collection of input data reduces uncertainty of outcomes over a baseline approach. In addition, we quantify the performance of a likelihood scoring technique that can be used to self-evaluate the extrapolation risk of prognosis on unseen patients.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Libpanda: A High Performance Library for Vehicle Data Collection

Cyber-Physical Systems (CPS) generally involve time-critical components due to physical dynamics, therefore necessitating high-performance subsystems. This is also true in data collection scenarios to infer physical phenomena. This paper covers Libpanda as an example of a component that has been designed to address performance issues in CPS implementations. Libpanda is a C++ library that interfaces software with a Comma.ai Panda device. Pandas are used for installation in modern vehicles to read the vehicle CAN bus, providing rich sensor data and limited vehicle control through message injection. The motivation to design lib-panda stems from the lack of performance in Python-based code that runs on inexpensive hardware like a Raspberry Pi. In such situations, Python code would result in utilizing 92% CPU while also dropping around 40% of the CAN packet due to bottlenecks. Without using different tools, inconsistent data collection means a loss of time-based vehicle state interpretation. Libpanda addresses these issues through implementation in a different language and implementation of different design paradigms involving asynchronous calls and multithreading. The Panda also features a GPS module that allows multiple instances to synchronize clocks for large-scale data collection scenarios. Libpanda has been designed with time-synchronization in mind to aid in the measurement of inter-vehicle dynamics. The performance improvements of libpanda have resulted in it becoming an important component in automotive dynamics research that requires a higher technical performance in large-scale experiments.

Bunting, Matthew↗