Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “probability generating function”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Bounds on galaxy stochasticity from halo occupation distribution modeling

The joint probability distribution of matter overdensity and galaxy counts in cells is a powerful probe of cosmology, and the extent to which variance in galaxy counts at fixed matter density deviates from Poisson shot noise is not fully understood. The lack of informed bounds on this stochasticity is currently the limiting factor in constraining cosmology with the galaxy–matter probability distribution function (PDF). We investigate stochasticity in the conditional distribution of galaxy counts along lines of sight with fixed matter density, and we present a halo occupation distribution (HOD)-based approach for obtaining plausible ranges for stochasticity parameters. To probe the high-dimensional space of possible galaxy–matter connections, we derive a set of HODs that conserve the galaxies’ linear bias and number density to produce RED M A G I C-like galaxy catalogs within the A BACUS S UMMIT suite of N -body simulations. We study the impact of individual HOD parameters and cosmology on stochasticity and perform a Monte Carlo search in HOD parameter space subject to the constraints on bias and density. In mock catalogs generated by the selected HODs, shot noise in galaxy counts spans both sub-Poisson and super-Poisson values, ranging from 80% to 133% of Poisson variance for cells with mean matter density. Nearly all of the derived HODs show a positive relationship between local matter density and stochasticity. For galaxy catalogs with higher stochasticity, modeling galaxy bias to second order is required for an accurate description of the conditional PDF of galaxy counts at fixed matter density. The presence of galaxy assembly bias also substantially extends the range of stochasticity in the super-Poisson direction. This HOD-based approach leverages degrees of freedom in the galaxy–halo connection to obtain informed bounds on nuisance model parameters and can be adapted to study other parametrizations of shot noise in galaxy counts, in particular to motivate prior ranges on stochasticity for cosmological analyses.

Britt, Dylan (ORCID:000000019905601X)↗

Multi-head attention-based U-Nets for predicting protein domain boundaries using 1D sequence features and 2D distance maps

Abstract The information about the domain architecture of proteins is useful for studying protein structure and function. However, accurate prediction of protein domain boundaries (i.e., sequence regions separating two domains) from sequence remains a significant challenge. In this work, we develop a deep learning method based on multi-head U-Nets (called DistDom) to predict protein domain boundaries utilizing 1D sequence features and predicted 2D inter-residue distance map as input. The 1D features contain the evolutionary and physicochemical information of protein sequences, whereas the 2D distance map includes the structural information of proteins that was rarely used in domain boundary prediction before. The 1D and 2D features are processed by the 1D and 2D U-Nets respectively to generate hidden features. The hidden features are then used by the multi-head attention to predict the probability of each residue of a protein being in a domain boundary, leveraging both local and global information in the features. The residue-level domain boundary predictions can be used to classify proteins as single-domain or multi-domain proteins. It classifies the CASP14 single-domain and multi-domain targets at the accuracy of 75.9%, 13.28% more accurate than the state-of-the-art method. Tested on the CASP14 multi-domain protein targets with expert annotated domain boundaries, the average per-target F1 measure score of the domain boundary prediction by DistDom is 0.263, 29.56% higher than the state-of-the-art method.

59 BASIC BIOLOGICAL SCIENCES↗

Generative Ensemble Regression: Learning Particle Dynamics from Observations of Ensembles with Physics-informed Deep Generative Models

Here, we propose a new method for inferring the governing stochastic ordinary differential equations (SODEs) by observing particle ensembles at discrete and sparse time instants, i.e., multiple “snapshots.” Particle coordinates at a single time instant, possibly noisy or truncated, are recorded in each snapshot but are unpaired across the snapshots. By training a physics-informed generative model that generates “fake” sample paths, we aim to fit the observed particle ensemble distributions with a curve in the probability measure space, which is induced from the inferred particle dynamics. We employ different metrics to quantify the differences between distributions, e.g., the sliced Wasserstein distances and the adversarial losses in generative adversarial networks. We refer to this method as generative “ensemble-regression” (GER), in analogy to the classic “point-regression,” where we infer the dynamics by performing regression in the Euclidean space. We illustrate the GER by learning the drift and diffusion terms of particle ensembles governed by SODEs with Brownian motions and Lévy processes up to 100 dimensions. We also discuss how to treat cases with noisy or truncated observations. Apart from systems consisting of independent particles, we also tackle nonlocal interacting particle systems with unknown interaction potential parameters by constructing a physics-informed loss function. Finally, we investigate scenarios of paired observations and discuss how to reduce the dimensionality in such cases by proving a convergence theorem that provides theoretical support.

97 MATHEMATICS AND COMPUTING↗

Discovering causal structure with reproducing-kernel Hilbert space ε -machines

We merge computational mechanics’ definition of causal states (predictively equivalent histories) with reproducing-kernel Hilbert space (RKHS) representation inference. The result is a widely applicable method that infers causal structure directly from observations of a system’s behaviors whether they are over discrete or continuous events or time. A structural representation—a finite- or infinite-state kernel ϵ-machine—is extracted by a reduced-dimension transform that gives an efficient representation of causal states and their topology. In this way, the system dynamics are represented by a stochastic (ordinary or partial) differential equation that acts on causal states. We introduce an algorithm to estimate the associated evolution operator. Paralleling the Fokker–Planck equation, it efficiently evolves causal-state distributions and makes predictions in the original data space via an RKHS functional mapping. We demonstrate these techniques, together with their predictive abilities, on discrete-time, discrete-value infinite Markov-order processes generated by finite-state hidden Markov models with (i) finite or (ii) uncountably infinite causal states and (iii) continuous-time, continuous-value processes generated by thermally driven chaotic flows. The method robustly estimates causal structure in the presence of varying external and measurement noise levels and for very high-dimensional data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Superconducting gap symmetry from Bogoliubov quasiparticle interference analysis on Sr 2 RuO 4

Here, the nature of the superconducting order parameter in Sr 2 RuO 4 has generated intense interest in recent years. Since the superconducting gap is very small, high-resolution methods such as scanning tunneling spectroscopy might be the best chance to directly resolve the gap symmetry. Recently, a Bogoliubov quasiparticle interference imaging (BQPI) experiment has suggested that the d x 2 –y 2 gap symmetry is appropriate for Sr 2 RuO 4 . In this work, we use a material-specific theoretical approach based onWannier functions of the surface of Sr 2 RuO 4 to calculate the continuum density of states as detected in scanning tunneling microscopy experiments. We examine several different proposed gap order parameters and calculate the expected BQPI pattern for each case. Comparing to the available experimental data, our results suggest that a s' + id xy gap order parameter is the most probable state, but the measured BQPI patterns still display features unaccounted for by the theory for any of the states currently under discussion.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Density estimation via measure transport: Outlook for applications in the biological sciences

Abstract One among several advantages of measure transport methods is that they allow or a unified framework for processing and analysis of data distributed according to a wide class of probability measures. Within this context, we present results from computational studies aimed at assessing the potential of measure transport techniques, specifically, the use of triangular transport maps, as part of a workflow intended to support research in the biological sciences. Scenarios characterized by the availability of limited amount of sample data, which are common in domains such as radiation biology, are of particular interest. We find that when estimating a distribution density function given limited amount of sample data, adaptive transport maps are advantageous. In particular, statistics gathered from computing series of adaptive transport maps, trained on a series of randomly chosen subsets of the set of available data samples, leads to uncovering information hidden in the data. As a result, in the radiation biology application considered here, this approach provides a tool for generating hypotheses about gene relationships and their dynamics under radiation exposure.

gene expression data↗

The Information Length Concept Applied to Plasma Turbulence

A methodology to study statistical properties of anomalous transport in fusion plasma is investigated. Three time traces generated by the full-f gyrokinetic code GKNET are analyzed for this purpose. The time traces consist of heat flux as a function of the radial position, which is studied in a novel manner using statistical methods. The simulation data exhibit transport processes with both medium and long correlation length along the radius. A typical example of a phenomenon with long correlation length is avalanches. In order to investigate the evolution of the turbulent state, two basic configurations are studied, one flux-driven and one gradient-driven with decaying turbulence. The information length concept in tandem with Boltzmann–Gibbs and Tsallis entropy is used in the investigation. It is found that the dynamical states in both flux-driven and gradient-driven cases are surprisingly similar, but the Tsallis entropy reveals differences between them. This indicates that the types of probability distribution function are nevertheless quite different since the higher moments are significantly different.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Feeling the Strain: Quantifying Ligand Deformation in Photosynthesis

Structural distortion of protein-bound ligands can play a critical role in enzyme function by tuning the electronic and chemical properties of the ligand molecule. However, quantifying these effects is difficult due to the limited resolution of protein structures and the difficulty of generating accurate structural restrains for non-protein ligands. Here, we seek to quantify these effects through a statistical analysis of ligand distortion in Chlorophyll (Chl) proteins (CP), where ring deformation is thought to play a role in energy and electron transfer. To assess the accuracy of ring-deformation estimates from available structural data, we take advantage of the C 2 symmetry of Photosystem II (PSII), comparing ring-deformation estimates for equivalent sites both within and between 113 distinct X-ray and Cryogenic electron microscopy (CryoEM) PSII structures. Significantly, we find that several deformation modes exhibit considerable variability in predictions, even for equivalent monomers, down to 2 Å resolution, to an extent that probably prevents their utilization in optical calculations. We further find that refinement restrains play a critical role in determining deformation values to resolution as low as 2 Å. However, for those modes that are well-resolved in the structural data, ring deformation in PSII is strongly conserved across all species tested, from cyanobacteria to algae. Furthermore, these results highlight both the opportunities and limitations inherent in the structure-based analysis of the bioenergetic and optical properties of CPs and other protein-ligand complexes.

14 SOLAR ENERGY↗

LeptonInjector and LeptonWeighter: A neutrino event generator and weighter for neutrino observatories

In this work, we present a high-energy neutrino event generator, called LeptonInjector, alongside an event weighter, called LeptonWeighter. Both are designed for large-volume Cherenkov neutrino telescopes such as IceCube. The neutrino event generator allows for quick and flexible simulation of neutrino events within and around the detector volume, and implements the leading Standard Model neutrino interaction processes relevant for neutrino observatories: neutrino-nucleon deep-inelastic scattering and neutrino-electron annihilation. In this paper, we discuss the event generation algorithm, the weighting algorithm, and the main functions of the publicly available code, with examples. Program summary: Program Titles: LeptonInjector and LeptonWeighter CPC Library link to program files: https://doi.org/10.17632/662gkpjfd9.1 Developer's repository links: https://github.com/icecube/LeptonInjector and https://github.com/icecube/LeptonWeighter Licensing provisions: GNU Lesser General Public License, version 3. Programming Language: C++11 External Routines: • Boost • HDF5 • nuflux (https://github.com/icecube/nuflux) • nuSQuIDS (https://github.com/arguelles/nuSQuIDS) • Photospline (https://github.com/icecube/photospline) • SuiteSparse (https://github.com/DrTimothyAldenDavis/SuiteSparse) Nature of problem: LeptonInjector: Generate neutrino interaction events of all possible topologies and energies throughout and around a detector volume. LeptonWeighter: Reweight Monte Carlo events, generated by a set of LeptonInjector Generators, to any desired physical neutrino flux or cross section. Solution method: LeptonInjector: Projected ranges of generated leptons and the extent of the detector, in terms of column depth, are used to inject events in and around the detector volume. Event kinematics follow distributions provided in cross section files. LeptonWeighter: Event generation probabilities are calculated for each Generator, which are then combined into a generation weight and used to calculate an overall event weight.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Uniform-in-phase-space data selection with iterative normalizing flows

Improvements in computational and experimental capabilities are rapidly increasing the amount of scientific data that are routinely generated. In applications that are constrained by memory and computational intensity, excessively large datasets may hinder scientific discovery, making data reduction a critical component of data-driven methods. Datasets are growing in two directions: the number of data points and their dimensionality. Whereas dimension reduction typically aims at describing each data sample on lower-dimensional space, the focus here is on reducing the number of data points. A strategy is proposed to select data points such that they uniformly span the phase-space of the data. The algorithm proposed relies on estimating the probability map of the data and using it to construct an acceptance probability. An iterative method is used to accurately estimate the probability of the rare data points when only a small subset of the dataset is used to construct the probability map. Instead of binning the phase-space to estimate the probability map, its functional form is approximated with a normalizing flow. Therefore, the method naturally extends to high-dimensional datasets. The proposed framework is demonstrated as a viable pathway to enable data-efficient machine learning when abundant data are available.

97 MATHEMATICS AND COMPUTING↗

Cholesky-based experimental design for Gaussian process and kernel-based emulation and calibration.

Gaussian processes and other kernel-based methods are used extensively to construct approximations of multivariate data sets. The accuracy of these approximations is dependent on the data used. This paper presents a computationally efficient algorithm to greedily select training samples that minimize the weighted L p error of kernel-based approximations for a given number of data. The method successively generates nested samples, with the goal of minimizing the error in high probability regions of densities specified by users. The algorithm presented is extremely simple and can be implemented using existing pivoted Cholesky factorization methods. Training samples are generated in batches which allows training data to be evaluated (labeled) in parallel. For smooth kernels, the algorithm performs comparably with the greedy integrated variance design but has significantly lower complexity. Numerical experiments demonstrate the efficacy of the approach for bounded, unbounded, multi-modal and non-tensor product densities. We also show how to use the proposed algorithm to efficiently generate surrogates for inferring unknown model parameters from data using Bayesian inference.

97 MATHEMATICS AND COMPUTING↗

Simulations of a hypersonic turbulent boundary layer over wavy surfaces

Here, we conduct large-eddy simulations of a Mach 5.84 cold wall turbulent boundary layer over one-dimensional wavy walls with varying amplitudes and wavelengths. Across all wall topologies, a series of alternating shock and expansion waves is shown to influence the entire boundary layer, and generate repeating wave patterns in the turbulent stresses, dispersive stresses, and turbulent kinetic energy budget. The series of alternating shocks and expansions imposes repeating adverse and favourable pressure gradients across the wavy wall, and at sufficient wall amplitude, triggers flow separation in the trough of the wave. Flow separation is demonstrated to influence the behaviour of wall pressure fluctuations over the wavy wall. In attached flows, the prominent frequencies are consistent with integral-scale boundary layer turbulence, whereas in separated flows, a two-decade frequency range is present, akin to two-dimensional shock–boundary layer interactions. Counter-rotating streamwise-oriented structures are observed on the windward side of the wave, which diminish over the wave crest. A conditional analysis demonstrates that these structures are present in the upstream boundary layer, and are amplified with increasing wall amplitude. An examination of the Görtler number and probability density function (PDF) of the fluctuating lateral wall shear stress demonstrates the strong correlation between a large Görtler number and growth of the PDF tail density, suggesting that the amplification of the counter-rotating streamwise-oriented structures are linked to centrifugal instabilities in regions of streamline concavity.

boundary layers↗

Elucidating Biomass-Derived Pyrolytic Lignin Structures from Demethylation Reactions through Density Functional Theory Calculations

Pyrolytic lignin is a fraction of pyrolysis oil that contains a wide range of phenolic compounds that can be used as intermediates to produce fuels and chemicals. However, the characteristics of the raw lignin structure make it difficult to establish a pyrolysis mechanism and determine pyrolytic lignin structures. Herein this study proposes dimer, trimer, and tetramer structures based on their relative thermodynamic stability for a hardwood lignin model in pyrolysis. Different configurations of oligomers were evaluated by varying the positions of the guaiacyl (G) and syringyl (S) units and the bonds βO4 and β5 in the hardwood model lignin through electronic structure calculations. The homolytic cleavage of βO4 bonds is assumed to occur and generate two free radical fragments. These can stabilize by taking hydrogen radicals that may be in solution during the intermediate liquid (pathway 1) formation before the thermal ejection. An alternative pathway (pathway 2) could occur when the radicals use intramolecular hydrogen, turning themselves into stable products. Subsequently, a demethylation reaction can take place, thus generating a methane molecule and new oligomeric lignin-derived molecules. The most probable resulting structures were studied. We used FTIR and NMR spectra of selected model compounds to evaluate our calculation approach. Thermophysical properties were calculated using group contribution methods. The results give insights into the lignin oligomer structures and how these molecules are formed. They also provide helpful information for the design of pyrolysis oil separation and upgrading equipment.

09 BIOMASS FUELS↗

Determinants of synapse diversity revealed by super-resolution quantal transmission and active zone imaging

Neural circuit function depends on the pattern of synaptic connections between neurons and the strength of those connections. Synaptic strength is determined by both postsynaptic sensitivity to neurotransmitter and the presynaptic probability of action potential evoked transmitter release (P r ). Whereas morphology and neurotransmitter receptor number indicate postsynaptic sensitivity, presynaptic indicators and the mechanism that sets P r remain to be defined. To address this, we developed QuaSOR, a super-resolution method for determining P r from quantal synaptic transmission imaging at hundreds of glutamatergic synapses at a time. We mapped the P r onto super-resolution 3D molecular reconstructions of the presynaptic active zones (AZs) of the same synapses at the Drosophila larval neuromuscular junction (NMJ). We find that P r varies greatly between synapses made by a single axon, quantify the contribution of key AZ proteins to P r diversity and find that one of these, Complexin, suppresses spontaneous and evoked transmission differentially, thereby generating a spatial and quantitative mismatch between release modes. Transmission is thus regulated by the balance and nanoscale distribution of release-enhancing and suppressing presynaptic proteins to generate high signal-to-noise evoked transmission.

59 BASIC BIOLOGICAL SCIENCES↗

A Pseudoreversible Normalizing Flow for Stochastic Dynamical Systems with Various Initial Distributions

Here, we present a pseudoreversible normalizing flow method for efficiently generating samples of the state of a stochastic differential equation (SDE) with various initial distributions. The primary objective is to construct an accurate and efficient sampler that can be used as a surrogate model for computationally expensive numerical integration of SDEs, such as those employed in particle simulation. After training, the normalizing flow model can directly generate samples of the SDE’s final state without simulating trajectories. The existing normalizing flow model for SDEs depends on the initial distribution, meaning the model needs to be retrained when the initial distribution changes. The main novelty of our normalizing flow model is that it can learn the conditional distribution of the state, i.e., the distribution of the final state conditional on any initial state, such that the model only needs to be trained once and the trained model can be used to handle various initial distributions. This feature can provide a significant computational saving in studies of how the final state varies with the initial distribution. Additionally, we propose to use a pseudoreversible network architecture to define the normalizing flow model, which has sufficient expressive power and training efficiency for a variety of SDEs in science and engineering, e.g., in particle physics. We provide a rigorous convergence analysis of the pseudoreversible normalizing flow model to the target probability density function in the Kullback–Leibler divergence metric. Numerical experiments are provided to demonstrate the effectiveness of the proposed normalizing flow model.

97 MATHEMATICS AND COMPUTING↗

Is the exquisite specificity of lymphocytes generated by thymic selection or due to evolution?

We have previously argued that the antigen receptors of T and B lymphocytes evolved to be sufficiently specific to avoid massive deletion of clonotypes by negative selection. Their optimal ‘specificity’ level, i.e., probability of binding any particular epitope, was shown to be inversely related to the number of self-antigens that the cells have to be tolerant to. Experiments have demonstrated that T lymphocytes also become more specific during negative selection in the thymus, because cells expressing the most crossreactive receptors have the highest likelihood of binding a self-antigen, and hence to be tolerized (i.e., deleted, anergized, or diverted into a regulatory T cell phenotype). Thus, there are two —not mutually exclusive— explanations for the exquisite specificity of T cells, one involving evolution and the other thymic selection. To better understand the impact of both, we extend a previously developed mathematical model by allowing for T cells with very different binding probabilities in the pre-selection repertoire. We confirm that negative selection tends to tolerize the most crossreactive clonotypes. As a result, the average level of specificity in the functional post-selection repertoire depends on the number of self-antigens, even if there is no evolutionary optimization of binding probabilities. However, the evolutionary optimal range of binding probabilities in the pre-selection repertoire also depends on the number of self-antigens. Species with more self antigens need more specific pre-selection repertoires to avoid excessive loss of T cells during thymic selection, and hence mount protective immune responses. We conclude that both evolution and negative selection are responsible for the high level of specificity of lymphocytes.

59 BASIC BIOLOGICAL SCIENCES↗

The DUNE Near Detector

DUNE is a next-generation experiment aiming to provide precision measurements of neutrino oscillation parameters. It will detect neutrinos produced in the Long-Baseline Neutrino Facility beamline at Fermilab, using a Near Detector situated near the beam target where the neutrinos originate and a Far Detector located 1300 km away in South Dakota. A comparison of the spectra of neutrinos measured at the Far and the Near Detector will allow for the extraction of oscillation probabilities from which the oscillation parameters can be inferred. The specific role of the Near Detector is to serve as the experiment’s control: it will establish the no oscillation null hypothesis, measure and monitor the beam, constrain systematic uncertainties, and provide essential measurements of the neutrino interactions to improve models. The Near Detector complex will include three primary detector components: a liquid argon time projection chamber, a high-pressure gas time projection chamber and an on-axis beam monitor. The three detectors will serve important individual and overlapping functions, with two of them being also able to move transverse to the beam’s axis via the DUNE-PRISM program. The overall mission of the Near Detector, as well as the three sub-detectors’ unique capabilities and physics programs will be discussed in these proceedings.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Development of a Particle Flow Control Mechanism

The next generation of Concentrated Solar Power (CSP) systems are utilizing solid particles as the heat transfer medium. The state-of-the-art particle flow control mechanism currently utilized is the slide-gate mechanism which functions by linearly actuating a gate across a tear-drop shaped opening. The sensitivity, which is a measure of the change in mass flow rate per unit movement of the slide-gate, is 0.354 g/s-mm[1]. The slide-gate’s main shortcomings include particle lodging and particle leakage between the plates, and difficulty actuating under the pressure from the particles. The goal of a new device is to minimize or eliminate these flaws. The new proposed device functions similar to a chuck mechanism in a drill where a rotation of an outer ring produces a change in outlet area through moving “jaws” diagonally. This mechanism aims to solve the issues of the slide-gate by having the jaws on the outside of the particle flow volume to reduce the probability of particle lodging, and the jaw tips are designed to overlap as they actuate to reduce particle leakage. Additionally, the vertical orientation of the device as well as the inclined movement of the jaws allows for easier actuation of the device under pressure. Experiments involving 3D printed prototypes have been carried out, producing a max mass flowrate of about 50 g/s and a sensitivity curve with the equation 𝑦 (𝑔/𝑠) = 0.0851𝑥^2(𝑔/𝑠−𝑚𝑚2) +3.6993𝑥(𝑔/𝑠−𝑚𝑚). These experiments validated the device’s capability to address the shortcomings of the slide-gate. Currently, an aluminum model of the device is being tested at room temperature, and a stainless-steel model is being developed to be tested at 700oC, which is the expected operating temperature of the CSP system. Furthermore, simulations are on-going to predict the mass flowrate of different device configurations at room and high temperatures.

14 SOLAR ENERGY↗