Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Variational inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Your Clean Graphene is Still Not Clean

Researchers working with thin samples, such as monolayer graphene, are consistently struggling against contamination. Indeed, the problem of hydrocarbon contamination is known from the earliest days of electron microscopy and efforts to reduce this problem are ubiquitous to almost all high-vacuum experiments. Accurate knowledge of the behavior of such contamination is essential for electron beam (e-beam) based atomic fabrication, where it is aspired to select and control matter on an atom-by-atom basis. Here, the vexing question of hydrocarbon contamination on graphene is taken up. Image intensity is used to directly reveal the presence of diffusing hydrocarbons on ostensibly clean graphene. These diffusing hydrocarbons are previously inferred but not directly observed. Surprising dynamic variations of the concentration of these hydrocarbons impels questions about their origin. Here, some possible explanations are presented and some tentative conclusions are drawn. This work updates the conceptual model of “clean graphene” and offers refinements to the description of e-beam induced hydrocarbon deposition.

atomic fabrication↗
DOE OSTI2020

Equation of State of CO 2 Shock Compressed to 1 TPa

Equation-of-state (pressure, density, temperature, internal energy) and reflectivity measurements on shock-compressed CO 2 at and above the insulating-to-conducting transition reveal new insight into the chemistry of simple molecular systems in the warm-dense-matter regime. CO 2 samples were precompressed in diamond-anvil cells to tune the initial densities from 1.35 g/cm 3 (liquid) to 1.74 g/cm 3 (solid) at room temperature and were then shock compressed up to 1 TPa and 93 000 K. Lastly, variation in initial density was leveraged to infer thermodynamic derivatives including specific heat and Gruneisen coefficient, exposing a complex bonded and moderately ionized state at the most extreme conditions studied.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

Performance Study of CXL Memory Topology

This paper presents a comprehensive evaluation of the performance impact of various Compute Express Link (CXL) memory topologies, with a particular emphasis on CXL switches, in the context of High- Performance Computing (HPC) and Large Language Model (LLM) inference workloads. Our study unveils significant performance variations across different topologies, demonstrating that certain configurations yield superior performance for specific workloads. These findings underscore the critical importance of tailored topol- ogy selection in optimizing system performance. Additionally, we address the inherent challenges associated with integrating CXL switches, including overhead considerations and routing complex- ities. Our research highlights the necessity for thorough evalua- tion methodologies to fully leverage CXL technology’s potential in contemporary computing environments. These insights provide valuable guidance for system architects and data center operators in designing and optimizing CXL-based infrastructures for diverse workload requirements.

CXL, memory, Artificial Intelligence (AI), HPC↗
DOE OSTI2021

Bayesian inference of heterogeneous epidemic models: Application to COVID-19 spread accounting for long-term care facilities

Here we propose a high dimensional Bayesian inference framework for learning heterogeneous dynamics of a COVID-19 model, with a specific application to the dynamics and severity of COVID-19 inside and outside long-term care (LTC) facilities. We develop a heterogeneous compartmental model that accounts for the heterogeneity of the time-varying spread and severity of COVID-19 inside and outside LTC facilities, which is characterized by time-dependent stochastic processes and time-independent parameters in ~ 1500 dimensions after discretization. To infer these parameters, we use reported data on the number of confirmed, hospitalized, and deceased cases with suitable post-processing in both a deterministic inversion approach with appropriate regularization as a first step, followed by Bayesian inversion with proper prior distributions. To address the curse of dimensionality and the ill-posedness of the high-dimensional inference problem, we propose use of a dimension-independent projected Stein variational gradient descent method, and demonstrate the intrinsic low-dimensionality of the inverse problem. We present inference results with quantified uncertainties for both New Jersey and Texas, which experienced different epidemic phases and patterns. Moreover, we also present forecasting and validation results based on the empirical posterior samples of our inference for the future trajectory of COVID-19.

42 ENGINEERING↗
DOE OSTI2024

Ensemble variational Fokker-Planck methods for data assimilation

Particle flow filters solve Bayesian inference problems by smoothly transforming a set of particles into samples from the posterior distribution. Particles move in state space under the flow of an McKean-Vlasov-Itˆo process. This work introduces the Variational Fokker-Planck (VFP) framework for data assimilation, a general approach that includes previously known particle flow filters as special cases. The McKean-Vlasov-Itˆo process that transforms particles is defined via an optimal drift that depends on the selected diffusion term. It is established that the underlying probability density - sampled by the ensemble of particles - converges to the Bayesian posterior probability density. For a finite number of particles the optimal drift contains a regularization term that nudges particles toward becoming independent random variables. Based on this analysis, we derive computationally-feasible approximate regularization approaches that penalize the mutual information between pairs of particles, and avoid particle collapse. Moreover, the diffusion plays a role akin to a particle rejuvenation approach that aims to alleviate particle collapse. The VFP framework is very flexible. Different assumptions on prior and intermediate probability distributions can be used to implement the optimal drift, and localization and covariance shrinkage can be applied to alleviate the curse of dimensionality. A robust implicit-explicit method is discussed for the efficient integration of stiff McKean- Vlasov-Itˆo processes. Here, the effectiveness of the VFP framework is demonstrated on three progressively more challenging test problems, namely the Lorenz ’63, Lorenz ’96 and the quasi-geostrophic equations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Inferring demographic and selective histories from population genomic data using a 2-step approach in species with coding-sparse genomes: an application to human data

Abstract The demographic history of a population, and the distribution of fitness effects (DFE) of newly arising mutations in functional genomic regions, are fundamental factors dictating both genetic variation and evolutionary trajectories. Although both demographic and DFE inference has been performed extensively in humans, these approaches have generally either been limited to simple demographic models involving a single population, or, where a complex population history has been inferred, without accounting for the potentially confounding effects of selection at linked sites. Taking advantage of the coding-sparse nature of the genome, we propose a 2-step approach in which coalescent simulations are first used to infer a complex multi-population demographic model, utilizing large non-functional regions that are likely free from the effects of background selection. We then use forward-in-time simulations to perform DFE inference in functional regions, conditional on the complex demography inferred and utilizing expected background selection effects in the estimation procedure. Throughout, recombination and mutation rate maps were used to account for the underlying empirical rate heterogeneity across the human genome. Importantly, within this framework it is possible to utilize and fit multiple aspects of the data, and this inference scheme represents a generalized approach for such large-scale inference in species with coding-sparse genomes.

Soni, Vivak (ORCID:0000000294969562)↗
DOE OSTI2022

MetaPop: a pipeline for macro- and microdiversity analyses and visualization of microbial and viral metagenome-derived populations

Abstract Background Microbes and their viruses are hidden engines driving Earth’s ecosystems from the oceans and soils to humans and bioreactors. Though gene marker approaches can now be complemented by genome-resolved studies of inter-(macrodiversity) and intra-(microdiversity) population variation, analytical tools to do so remain scattered or under-developed. Results Here, we introduce MetaPop, an open-source bioinformatic pipeline that provides a single interface to analyze and visualize microbial and viral community metagenomes at both the macro - and microdiversity levels. Macrodiversity estimates include population abundances and α- and β-diversity. Microdiversity calculations include identification of single nucleotide polymorphisms, novel codon-constrained linkage of SNPs, nucleotide diversity ( π and θ ), and selective pressures (pN/pS and Tajima’s D ) within and fixation indices ( F ST ) between populations. MetaPop will also identify genes with distinct codon usage. Following rigorous validation, we applied MetaPop to the gut viromes of autistic children that underwent fecal microbiota transfers and their neurotypical peers. The macrodiversity results confirmed our prior findings for viral populations (microbial shotgun metagenomes were not available) that diversity did not significantly differ between autistic and neurotypical children. However, by also quantifying microdiversity, MetaPop revealed lower average viral nucleotide diversity ( π ) in autistic children. Analysis of the percentage of genomes detected under positive selection was also lower among autistic children, suggesting that higher viral π in neurotypical children may be beneficial because it allows populations to better “bet hedge” in changing environments. Further, comparisons of microdiversity pre- and post-FMT in autistic children revealed that the delivery FMT method (oral versus rectal) may influence viral activity and engraftment of microdiverse viral populations, with children who received their FMT rectally having higher microdiversity post-FMT. Overall, these results show that analyses at the macro level alone can miss important biological differences. Conclusions These findings suggest that standardized population and genetic variation analyses will be invaluable for maximizing biological inference, and MetaPop provides a convenient tool package to explore the dual impact of macro - and microdiversity across microbial communities.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Signatures of optimal codon usage in metabolic genes inform budding yeast ecology

Reverse ecology is the inference of ecological information from patterns of genomic variation. One rich, heretofore underutilized, source of ecologically relevant genomic information is codon optimality or adaptation. Bias toward codons that match the tRNA pool is robustly associated with high gene expression in diverse organisms, suggesting that codon optimization could be used in a reverse ecology framework to identify highly expressed, ecologically relevant genes. To test this hypothesis, we examined the relationship between optimal codon usage in the classic galactose metabolism ( GAL ) pathway and known ecological niches for 329 species of budding yeasts, a diverse subphylum of fungi. We find that optimal codon usage in the GAL pathway is positively correlated with quantitative growth on galactose, suggesting that GAL codon optimization reflects increased capacity to grow on galactose. Optimal codon usage in the GAL pathway is also positively correlated with human-associated ecological niches in yeasts of the CUG-Ser1 clade and with dairy-associated ecological niches in the family Saccharomycetaceae. For example, optimal codon usage of GAL genes is greater than 85% of all genes in the genome of the major human pathogen Candida albicans (CUG-Ser1 clade) and greater than 75% of genes in the genome of the dairy yeast Kluyveromyces lactis (family Saccharomycetaceae). We further find a correlation between optimization in the GAL actose pathway genes and several genes associated with nutrient sensing and metabolism. This work suggests that codon optimization harbors information about the metabolic ecology of microbial eukaryotes. This information may be particularly useful for studying fungal dark matter—species that have yet to be cultured in the lab or have only been identified by genomic material.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Kilonova Detectability with Wide-field Instruments

Abstract Kilonovae are ultraviolet, optical, and infrared transients powered by the radioactive decay of heavy elements following a neutron star merger. Joint observations of kilonovae and gravitational waves can offer key constraints on the source of Galactic r -process enrichment, among other astrophysical topics. However, robust constraints on heavy element production require rapid kilonova detection (within ∼1 day of merger) as well as multiwavelength observations across multiple epochs. In this study, we quantify the ability of 13 wide-field-of-view instruments to detect kilonovae, leveraging a large grid of over 900 radiative transfer simulations with 54 viewing angles per simulation. We consider both current and upcoming instruments, collectively spanning the full kilonova spectrum. The Roman Space Telescope has the highest redshift reach of any instrument in the study, observing kilonovae out to z ∼ 1 within the first day post-merger. We demonstrate that BlackGEM, DECam, GOTO, the Vera C. Rubin Observatory’s LSST, ULTRASAT, VISTA, and WINTER can observe some kilonovae out to z ∼ 0.1 (∼475 Mpc), while DDOTI, MeerLICHT, PRIME, Swift/UVOT, and ZTF are confined to more nearby observations. Furthermore, we provide a framework to infer kilonova ejecta properties following nondetections and explore variation in detectability with these ejecta parameters.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Variational Monte Carlo calculations of n + H 3 scattering

A paramount goal in nuclear physics is to unify ab initio treatments of bound and unbound states. The position-space quantum Monte Carlo (QMC) methods have a long history of successful bound-state calculations in light systems but have seen minimal implementation in unbound systems. Here, we introduce a numerical method to improve the efficiency and accuracy of unbound-state calculations in QMC. As an initial application, we compute scattering observables for the smallest system available to probe three-body forces, the neutron-triton system, using variational Monte Carlo (VMC) wave functions. The method involves inferring long-range amplitudes in the wave function from integrals over the short-range region where all the particles interact. This approach using integral relations is well established in the literature; here, we develop it for the QMC framework. We validate our approach with a consistency check between short-range spectroscopic overlap functions computed from direct evaluation and from the integral relations; scattering amplitudes are long-range asymptotics of those overlaps. Comparison against published benchmark calculations using the same potential demonstrates that when applied to the current VMC wave functions, the integral method produces more accurate scattering observables than direct evaluation from the same variational wave function. However, it still differs noticeably from the exact results. Using additional interactions, we then present phase shifts and mixing parameters for the n + 3 H system. In particular, we present one of the first applications of the Norfolk family of local coordinate-space chiral potentials in unbound systems of A > 2. The Norfolk results accurately describe s-wave scattering but predict p-wave cross sections too large. Compared with previous QMC scattering calculations, the integral method avoids difficulties associated with the precise computation of energy differences and with convergence outside the interaction region, which is particularly severe in the variational calculation. Application of the integral method here paves the way for its use in Green's function Monte Carlo (GFMC) calculations. In GFMC, the wave functions are more accurate, but the high-precision convergence of their tails is slow, and there are additional difficulties in reading out amplitudes. Here, the integral methods will address both of those remaining problems.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

The role of ion-scale micro-turbulence in pedestal width of the DIII-D wide-pedestal QH mode

The low-edge rotation, intrinsically ELM-free, and improved confinement wide-pedestal quiescent H-mode (QH-mode), discovered in DIII-D tokamak, has pedestal widths exceeding the EPED-kinetic-ballooning mode (KBM) model scaling typically by at least 25%. Ion-scale ($k_yp_s$ < 1) microturbulence and its role in setting the pedestal structure is investigated using the radially local δ$f$ gyrokinetic code CGYRO. The electromagnetic trapped electron mode (TEM) is unstable at the pedestal top, while plasma beta (β$_e$) is ∼60% below the KBM onset threshold and the electron temperature gradient mode is found to be unstable in the peak gradient region. Nonlinear simulation reveals that the ion-scale turbulence could produce electron energy flux consistent with the flux inferred from power balance at the pedestal top, with a reasonable variation of the local shearing rate; and the local neoclassical transport from NEO is dominant over the simulated turbulent transport in the ion energy flux channel. The simulated ion-scale turbulence produces much lower electron energy flux than inferred from experiment in the pedestal peak gradient region. A correction to the EPED-KBM pedestal width scaling is obtained based on the two-dimensional scan of pedestal top plasma beta (β$_e$) and normalized electron density and temperature scale lengths,${a}$/${L_n}_e$, ${a}$/${L_T}_n$using CGYRO linear simulations. Mode transitions among TEM, micro-tearing mode, ion-temperature gradient mode and KBM, are observed in the 2D scan at the pedestal top. A fixed normalized growth rate for these drift-type modes is taken to determine the pedestal width scaling, which shows good consistency with the QH experimental database on pedestal heights and widths. The onset of KBM instabilities and the local E × B shear suppression criterion set the lower and upper limit for the pedestal width of standard QH-mode, wide-pedestal QH-mode and type-I ELMy H mode. A potentially higher and wider pedestal is expected from the new scaling of pedestal width. This work presents an improved understanding of the ion-scale micro-turbulence of wide-pedestal QH-mode and sheds light on a promising scenario for future reactors, including ITER and beyond.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

An Accurate, Error-Tolerant, and Energy-Efficient Neural Network Inference Engine Based on SONOS Analog Memory

In this work, we demonstrate SONOS (silicon-oxide-nitrideoxide- silicon) analog memory arrays that are optimized for neural network inference. The devices are fabricated in a 40nm process and operated in the subthreshold regime for in-memory matrix multiplication. Subthreshold operation enables low conductances to be implemented with low error, which matches the typical weight distribution of neural networks, which is heavily skewed toward near-zero values. This leads to high accuracy in the presence of programming errors and process variations. We simulate the end-to-end neural network inference accuracy, accounting for the measured programming error, read noise, and retention loss in a fabricated SONOS array. Evaluated on the ImageNet dataset using ResNet50, the accuracy using a SONOS system is within 2.16% of floating-point accuracy without any retraining. The unique error properties and high On/Off ratio of the SONOS device allow scaling to large arrays without bit slicing, and enable an inference architecture that achieves 20 TOPS/W on ResNet50, a >10× gain in energy efficiency over state-of-the-art digital and analog inference accelerators.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Variation-Resilient FeFET-Based In-Memory Computing Leveraging Probabilistic Deep Learning

Reliability issues stemming from device level nonidealities of nonvolatile emerging technologies like ferroelectric field-effect transistors (FeFETs), especially at scaled dimensions, cause substantial degradation in the accuracy of in-memory crossbar-based AI systems. Here, in this work, we present a variation-aware design technique to characterize the device level variations and to mitigate their impact on hardware accuracy employing a Bayesian neural network (BNN) approach. An effective conductance variation model is derived from the experimental measurements of cycle-to-cycle (C2C) and device-to-device (D2D) variations performed on FeFET devices fabricated using 28 nm high-k metal gate technology. The variations were found to be a function of different conductance states within the given programming range, which sharply contrasts earlier efforts where a fixed variation dispersion was considered for all conductance values. Such variation characteristics formulated for three different device sizes at different read voltages were provided as prior variation information to the BNN to yield a more exact and reliable inference. Near-ideal accuracy for shallow networks (MLP5 and LeNet models) on the MNIST dataset and limited accuracy decline by ~3.8%–16.1% for deeper AlexNet models on CIFAR10 dataset under a wide range of variations corresponding to different device sizes and read voltages, demonstrates the efficacy of our proposed device-algorithm co-design technique.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Climate-driven divergence in plant-microbiome interactions generates range-wide variation in bud break phenology

Soil microbiomes are rapidly becoming known as an important driver of plant phenotypic variation and may mediate plant responses to environmental factors. However, integrating spatial scales relevant to climate change with plant intraspecific genetic variation and soil microbial ecology is difficult, making studies of broad inference rare. Here we hypothesize and show: 1) the degree to which tree genotypes condition their soil microbiomes varies by population across the geographic distribution of a widespread riparian tree, Populus angustifolia; 2) geographic dissimilarity in soil microbiomes among populations is influenced by both abiotic and biotic environmental variation; and 3) soil microbiomes that vary in response to abiotic and biotic factors can change plant foliar phenology. We show soil microbiomes respond to intraspecific variation at the tree genotype and population level, and geographic variation in soil characteristics and climate. Using a fully reciprocal plant population by soil location feedback experiment, we identified a climate-based soil microbiome effect that advanced and delayed bud break phenology by approximately 10 days. These results demonstrate a landscape-level feedback between tree populations and associated soil microbial communities and suggest soil microbes may play important roles in mediating and buffering bud break phenology with climate warming, with whole ecosystem implications.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Kingdom-Wide Analysis of Fungal Protein-Coding and tRNA Genes Reveals Conserved Patterns of Adaptive Evolution

Protein-coding genes evolved codon usage bias due to the combined but uneven effects of adaptive and nonadaptive influences. Studies in model fungi agree on codon usage bias as an adaptation for fine-tuning gene expression levels; however, such knowledge is lacking for most other fungi. Our comparative genomics analysis of over 450 species supports codon usage and transfer RNAs (tRNAs) as coadapted for translation speed and this is most likely a realization of convergent evolution. Rather than drift, phylogenetic reconstruction inferred adaptive radiation as the best explanation for the variation of interspecific codon usage bias. Although the phylogenetic signals for individual codon and tRNAs frequencies are lower than expected by genetic drift, we found remarkable conservation of highly expressed genes being codon optimized for translation by the most abundant tRNAs, especially by inosine-modified tRNAs. As an application, we present a sequence-to-expression neural network that uses codons to reliably predict highly expressed transcripts. The kingdom Fungi, with over a million species, includes many key players in various ecosystems and good targets for biotechnology. Collectively, our results have implications for better understanding the evolutionary success of fungi, as well as informing the biosynthetic manipulation of fungal genes.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

KilonovaNet : Surrogate models of kilonova spectra with conditional variational autoencoders

ABSTRACT Detailed radiative transfer simulations of kilonova spectra play an essential role in multimessenger astrophysics. Using the simulation results in parameter inference studies requires building a surrogate model from the simulation outputs to use in algorithms requiring sampling. In this work, we present kilonovanet, an implementation of conditional variational autoencoders (cVAEs) for the construction of surrogate models of kilonova spectra. This method can be trained on spectra directly, removing overhead time of pre-processing spectra, and greatly speeds up parameter inference time. We build surrogate models of three state-of-the-art kilonova simulation data sets and present in-depth surrogate error evaluation methods, which can in general be applied to any surrogate construction method. By creating synthetic photometric observations from the spectral surrogate, we perform parameter inference for the observed light-curve data of GW170817 and compare the results with previous analyses. Given the speed with which kilonovanet performs during parameter inference, it will serve as a useful tool in future gravitational wave observing runs to quickly analyse potential kilonova candidates.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Revealing Site Occupancy in a Complex Oxide: Terbium Iron Garnet

Complex oxide films stabilized by epitaxial growth can exhibit large populations of point defects which have important effects on their properties. The site occupancy of pulsed laser-deposited epitaxial terbium iron garnet (TbIG) films with excess terbium (Tb) is analyzed, in which the terbium:iron (Tb:Fe)ratio is 0.86 compared to the stoichiometric value of 0.6. The magnetic properties of the TbIG are sensitive to site occupancy, exhibiting a higher compensation temperature (by 90 K) and a lower Curie temperature (by 40 K) than the bulk Tb 3 Fe 5 O 12 garnet. Data derived from X-ray core-level spectroscopy, magnetometry, and molecular field coefficient modeling are consistent with occupancy of the dodecahedral sites by Tb 3+ , the octahedral sites by Fe 3+ , Tb 3+ and vacancies, and the tetrahedral sites by Fe 3+ and vacancies. Energy dispersive X-ray spectroscopy in a scanning transmission electron microscope provides direct evidence of Tb Fe antisites. A small fraction of Fe 2+ is present, and oxygen vacancies are inferred to be present to maintain charge neutrality. In conclusion, variation of the site occupancies provides a path to considerable manipulation of the magnetic properties of epitaxial iron garnet films and other complex oxides, which readily accommodate stoichiometries not found in their bulk counterparts.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Time Series Surface Temperature of Variably Inundated Sediment across 30 North American Rivers

This dataset supports a broader study examining drivers of organic matter chemistry in variably inundated hyporheic zone sediments and further linking that chemistry to biogeochemical rates. The dataset provides surficial temperature time series that can be used to infer the dynamics of inundation prior to the collection of sediments. Those inferred inundation histories can then be used to help interpret variation in the organic matter chemistry. There are related data that will be published, such as FTICR-MS data on organic matter chemistry and sediment moisture. A data package with those data is forthcoming.This dataset is comprised of two folders: (1) ECA1_iButtonData and (2) ECA1_SitePhotos. The ECA1_iButtonData folder contains: (1) file-level metadata, (2) data dictionary, (3) field metadata, (4) installation methods, (5) iButton deployment protocol, (6) readme, and (7) folder of individual time series temperature csv files for each iButton sensor deployed. The ECA1_SitePhotos folder contains site photographs taken in the field. All files are .csv, .txt, .pdf, or .jpg.

54 ENVIRONMENTAL SCIENCES↗