Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “probability generating function”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A machine learning approach to galaxy properties: joint redshift–stellar mass probability distributions with Random Forest

We demonstrate that highly accurate joint redshift–stellar mass probability distribution functions (PDFs) can be obtained using the Random Forest (RF) machine learning (ML) algorithm, even with few photometric bands available. As an example, we use the Dark Energy Survey (DES), combined with the COSMOS2015 catalogue for redshifts and stellar masses. We build two ML models: one containing deep photometry in the griz bands, and the second reflecting the photometric scatter present in the main DES survey, with carefully constructed representative training data in each case. We validate our joint PDFs for 10 699 test galaxies by utilizing the copula probability integral transform and the Kendall distribution function, and their univariate counterparts to validate the marginals. Benchmarked against a basic set-up of the template-fitting code bagpipes, our ML-based method outperforms template fitting on all of our predefined performance metrics. In addition to accuracy, the RF is extremely fast, able to compute joint PDFs for a million galaxies in just under 6 min with consumer computer hardware. Such speed enables PDFs to be derived in real time within analysis codes, solving potential storage issues. As part of this work we have developed galpro 1, a highly intuitive and efficient python package to rapidly generate multivariate PDFs on-the-fly. galpro is documented and available for researchers to use in their cosmology and galaxy evolution studies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Voltage Probability Density Function Shaping Control Strategy Considering Grid Operational Uncertainties

It is well-known that power systems operation always affected by various uncertainties which make the bus voltage a random process that can be characterized by its probability density function (PDF) at any time instant. In this context, this paper presents a novel PDF-based voltage control framework for power systems. By modeling voltage as a stochastic process, we formulate a stochastic differential equationthat captures grid uncertainties. The associated Fokker-Planck-Kolmogorov equation is derived to describe the evolution of the voltage PDF, which enables the formulation of a PDF-shaping control strategy. To simplify the PDF control formulation, a B-spline neural network is introduced for real-time estimation and regulation of the voltage distribution. The proposed PDF control law updates voltage references for energy storage systems and synchronous generators using real-time PDF measurements and feedback signals. The proposed method is validated on a modified Kundur’s two-area system. Simulation results demonstrate that the controller can significantly improve the voltage stability under stochastic conditions, highlighting its effectiveness in modern inverter-rich grids.

Gui, Yonghao [ORNL] (ORCID:0000000250435534)↗
DOE OSTI2023

Oracle-Preserving Latent Flows

A fundamental task in data science is the discovery, description, and identification of any symmetries present in the data. We developed a deep learning methodology for the simultaneous discovery of multiple non-trivial continuous symmetries across an entire labeled dataset. The symmetry transformations and the corresponding generators are modeled with fully connected neural networks trained with a specially constructed loss function, ensuring the desired symmetry properties. The two new elements in this work are the use of a reduced-dimensionality latent space and the generalization to invariant transformations with respect to high-dimensional oracles. The method is demonstrated with several examples on the MNIST digit dataset, where the oracle is provided by the 10-dimensional vector of logits of a trained classifier. We find classes of symmetries that transform each image from the dataset into new synthetic images while conserving the values of the logits. We illustrate these transformations as lines of equal probability (“flows”) in the reduced latent space. These results show that symmetries in the data can be successfully searched for and identified as interpretable non-trivial transformations in the equivalent latent space.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Superspin renormalization and slow relaxation in random spin systems

We develop an excited-state real-space renormalization group (RSRG-X) formalism to describe the dynamics of conserved densities in randomly interacting spin-12 systems. Our formalism is suitable for systems with U(1) and Z2 symmetries, and we apply it to chains of randomly positioned spins with dipolar XX+YY interactions, as arise in Rydberg quantum simulators and other platforms. The formalism generates a sequence of effective Hamiltonians that provide approximate descriptions for dynamics on successively smaller energy scales. These effective Hamiltonians involve “superspins”: two-level collective degrees of freedom constructed from (anti)aligned microscopic spins. Conserved densities can then be understood as relaxing via coherent collective spin flips. For the well-studied simpler case of randomly interacting nearest-neighbor XX+YY chains, the superspins reduce to single spins. Our formalism also leads to a numerical method capable of simulating the dynamics up to an otherwise inaccessible combination of large system size and late time. Focusing on disorder-averaged infinite-temperature autocorrelation functions, in particular the spin survival probability Sp¯(t), we demonstrate quantitative agreement between our algorithm and exact diagonalization (ED) at low but nonzero frequencies. Such agreement holds for chains with nearest-neighbor, next-nearest-neighbor, and long-range dipolar interactions. Our results indicate decay of Sp¯(t) slower than any power law and feature no significant deviation from the ∼1/ln2(t) asymptote expected from the infinite-randomness fixed-point of the nearest-neighbor model. We also apply the RSRG-X formalism to two-dimensional long-range systems of moderate size and find slow late-time decay of Sp¯(t).

Zhao, Yi J↗
DOE OSTI2026

High-throughput validation of phase formability and simulation accuracy of Cantor alloys

High-throughput methods enable accelerated discovery of novel materials in complex systems such as high-entropy alloys, which exhibit intricate phase stability across vast compositional spaces. Computational approaches, including Density Functional Theory (DFT) and calculation of phase diagrams (CALPHAD), facilitate screening of phase formability as a function of composition and temperature. However, the integration of computational predictions with experimental validation remains challenging in high-throughput studies. In this work, we introduce a quantitative confidence metric to assess the agreement between predictions and experimental observations, providing a quantitative measure of the confidence of machine learning models trained on either DFT or CALPHAD input in accounting for experimental evidence. The experimental dataset was generated via high-throughput in-situ synchrotron X-ray diffraction on compositionally varied FeNiMnCr alloy libraries, heated from room temperature to ~1000 °C. Agreement between the observed and predicted phases was evaluated using either temperature-independent phase classification or a model that incorporates a temperature-dependent probability of phase formation. This integrated approach demonstrates where strong overall agreement between computation and experiment exists, while also identifying key discrepancies, particularly in FCC/BCC predictions at Mn-rich regions to inform future model refinement.

36 - MATERIALS SCIENCE↗
DOE OSTI2024

Kinetic Study of Polyvinyl Chloride Pyrolysis with Characterization of Dehydrochlorinated PVC

In this paper, we study the kinetics of polyvinyl chloride (PVC) decomposition using a combination of experimental and computational approaches. Here, we develop a simplified kinetic model that contains only two steps: dehydrochlorination of PVC and further decomposition of the PVC residue. The model is consistent with density functional theory (DFT) calculations and experimental data. Dehydrochlorination is an autocatalytic reaction that starts with a tertiary chloride (Cl) and generates hydrogen chloride (HCl) and benzene as the main products. Benzene and HCl formation rates showed similar trends, indicating that HCl likely catalyzes a homolytic carbon-carbon (C-C) bond cleavage, which gives rise to benzene and an aliphatic fragment. We characterized the structure of dehydrochlorinated PVC (PVC residue) by using thermal gravimetric analysis (TGA), Fourier-transform infrared spectroscopy (FTIR), and nuclear magnetic resonance spectroscopy (NMR). FTIR and NMR results indicate that the PVC residue contains 20% quaternary carbon content, indicating a high concentration of cross-linked molecules. We predict that the most probable structure in the cross-linked centers of the PVC residue is cyclohexadiene, which is supported by DFT calculations, FTIR, and NMR.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

On the Stochastic Stability of Deep Markov Models

Deep Markov models (DMM) are generative models which are scalable and expressive generalization of Markov models for representation, learning, and inference problems. DMMs using deep neural networks to parametrize the transition of Markov probability distributions have recently been shown to provide more expressiveness in modeling sequential data and dynamical system responses. However, the fundamental stochastic stability guarantees of such models have not been thoroughly investigated. In this paper, we present a rigorous analytical method to prove the necessary and sufficient conditions of DMM's stochastic stability. This task is achieved by spectral analysis of the efficiently computed Jacobians of probabilistic maps modeled by deep neural networks. We make theoretical connections between the eigenvalues of neural network's weights and the different activation function types used on the stability and overall dynamic behavior of DMMs with Gaussian distributions. We empirically substantiate our theoretical results on stochastic stability and eigenvalue spectra via several numerical experiments. Formal stability guarantees of DMMs can substantially improve their robustness and trustworthiness, necessary for reliable use in safety-critical real-world applications.

Drgona, Jan↗
DOE OSTI2023

Modeling the Effect of Surface Platinum–Tin Alloys on Propane Dehydrogenation on Platinum–Tin Catalysts

Uncertainty analysis, reported experimental literature data, and density functional theory were synthesized to model the effect of surface tin coverage on platinum-based catalysts for nonoxidative propane dehydrogenation to propylene. Here, this study tests four different platinum–tin skin surface models as potential catalytic sites, Pt 3 Sn/Pt(100), PtSn/Pt(100), Pt 3 Sn/Pt(111), and Pt 2 Sn/Pt(211), and compares them to the corresponding pure Pt surface sites using an uncertainty analysis methodology that uses BEEF-vdW with its ensembles (BMwE) to generate the uncertainty for the energies of the intermediates and transition states. One experimental data set with two experimental observations, selectivity to propylene and turnover frequency of propylene, was used as a calibration data set to evaluate the impact of the experimental data on informing the models. This study finds that the prior model for Pt 3 Sn/Pt(100) is the most active and Pt 2 Sn/Pt(211) is the most selective toward propylene. Active sites on the (100) facet have the highest probability of being responsible for C 1 and C 2 product formations (C–C bond cleavage). Increasing the Sn coverage on the (100) surface facet to a PtSn/Pt(100) active site leads to a significantly reduced rate and might explain the experimentally observed higher selectivity of Sn-doped catalysts relative to pure Pt catalysts. Next, this study finds that for all surfaces, except PtSn/Pt(100), the rate-controlling steps are the initial dehydrogenation steps alongside some partially rate-controlling second dehydrogenation steps. For PtSn/Pt(100), only the initial terminal dehydrogenation step to CH 3 CH 2 CH 2 * and second dehydrogenation steps are rate-controlling. Next, the calibrated models for all surfaces were found to be selective toward propylene production and model the reported turnover frequency successfully. Nevertheless, Pt 2 Sn/Pt(211) emerges as the active site with some (minor) evidence as the main active site based on Jeffreys’ scale interpretation of Bayes factors. This observation agrees with prior studies that also found step sites to be most likely the most relevant active sites for pure Pt catalysts. Overall, the results indicate that tin, in addition to affecting the binding strength of the adsorbed species, prevents deeper dehydrogenation (reducing coking) and cracking reactions through increasing activation barriers for unwanted side reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Large-scale Gravitational Lens Modeling with Bayesian Neural Networks for Accurate and Precise Inference of the Hubble Constant

We investigate the use of approximate Bayesian neural networks (BNNs) in modeling hundreds of time delay gravitational lenses for Hubble constant (H 0 ) determination. Here, our BNN was trained on synthetic Hubble Space Telescope quality images of strongly lensed active galactic nuclei with lens galaxy light included. The BNN can accurately characterize the posterior probability density functions (PDFs) of model parameters governing the elliptical power-law mass profile in an external shear field. We then propagate the BNN-inferred posterior PDFs into an ensemble H 0 inference, using simulated time delay measurements from a plausible dedicated monitoring campaign. Assuming well-measured time delays and a reasonable set of priors on the environment of the lens, we achieve a median precision of 9.3% per lens in the inferred H 0 . A simple combination of a set of 200 test lenses results in a precision of 0.5 km s –1 Mpc –1 (0.7%), with no detectable bias in this H 0 recovery test. The computation time for the entire pipeline—including the generation of the training set, BNN training and H0 inference—translates to 9 minutes per lens on average for 200 lenses and converges to 6 minutes per lens as the sample size is increased. Being fully automated and efficient, our pipeline is a promising tool for exploring ensemble-level systematics in lens modeling for H 0 inference.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Fixed Source Sensitivity Calculations for Inertial Confinement Fusion Applications

A numerical code library was developed for the radiation transport code MCNP6.3 to calculate generalized response sensitivity coefficients for fixed source neutron transport problems with applications to inertial confinement fusion (ICF) experiments. The new MCNP6.3 dependency is used to generate a novel time convolution response that represents a neutron time-of-flight (nToF) signal. The traditional suite of macroscopic cross-section sensitivities and constrained fixed source probability distribution sensitivities are available for both the standard and the new response tallies in this library. However, novel sensitivity coefficients for the constrained hyperparameters of analytic fixed source probability distributions are emphasized in this work for their connection to ICF neutron transport models. Particularly, advanced Monte Carlo methods are developed for calculating the sensitivity of a nToF signal to perturbations in an ICF plasma’s ion temperature and burn history as well as perturbations in the target liner mass density and the shape parameters of the nToF detector’s impulse response function. Together, these capabilities form an advanced suite of computational tools that can be used to analyze and extract information from any ICF experimental platform.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Multiplicity dependence of charged-particle intra-jet properties in pp collisions at $\sqrt{s}$ = 13 TeV

The first measurement of the multiplicity dependence of intra-jet properties of leading charged-particle jets in proton–proton (pp) collisions is reported. The mean charged particle multiplicity and jet fragmentation distributions are measured in minimum-bias and high-multiplicity pp collisions at center-of-mass energy $\sqrt{s}$ = 13 TeV using the ALICE detector. Jets are reconstructed from charged particles produced in the midrapidity region (|η| < 0.9) using the sequential recombination anti-k T algorithm with jet resolution parameters R = 0.2, 0.3, and 0.4 for the trans verse momentum (p T ) interval 5–110 GeV/c. The high multiplicity events are selected by the forward V0 scintilla tor detectors. The mean charged-particle multiplicity inside the leading jet cone rises monotonically with increasing jet p T in qualitative agreement with previous measurements at lower energies. The distributions of jet fragmentation function variables z ch and ξ ch are measured for different jet-p T intervals. Jet-p T independent fragmentation of leading jets is observed for wider jets except at high- and low-z ch values. The observed “hump-backed plateau” structure in the ξ ch distribution indicates suppression of low-p T particles. In high-multiplicity events, an enhancement of the fragmen tation probability of low-z ch particles accompanied by a suppression of high-zch particles is observed compared to minimum-bias events. This behavior becomes more promi nent for low-p T jets with larger jet radius. The results are compared with predictions of QCD-inspired event generators, PYTHIA 8 with Monash 2013 tune and EPOS LHC. It is found that PYTHIA 8 qualitatively reproduces the jet modification in high-multiplicity events except at high jet p T . These measurements provide important constraints to models of jet fragmentation.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Bounds on galaxy stochasticity from halo occupation distribution modeling

The joint probability distribution of matter overdensity and galaxy counts in cells is a powerful probe of cosmology, and the extent to which variance in galaxy counts at fixed matter density deviates from Poisson shot noise is not fully understood. The lack of informed bounds on this stochasticity is currently the limiting factor in constraining cosmology with the galaxy–matter probability distribution function (PDF). We investigate stochasticity in the conditional distribution of galaxy counts along lines of sight with fixed matter density, and we present a halo occupation distribution (HOD)-based approach for obtaining plausible ranges for stochasticity parameters. To probe the high-dimensional space of possible galaxy–matter connections, we derive a set of HODs that conserve the galaxies’ linear bias and number density to produce RED M A G I C-like galaxy catalogs within the A BACUS S UMMIT suite of N -body simulations. We study the impact of individual HOD parameters and cosmology on stochasticity and perform a Monte Carlo search in HOD parameter space subject to the constraints on bias and density. In mock catalogs generated by the selected HODs, shot noise in galaxy counts spans both sub-Poisson and super-Poisson values, ranging from 80% to 133% of Poisson variance for cells with mean matter density. Nearly all of the derived HODs show a positive relationship between local matter density and stochasticity. For galaxy catalogs with higher stochasticity, modeling galaxy bias to second order is required for an accurate description of the conditional PDF of galaxy counts at fixed matter density. The presence of galaxy assembly bias also substantially extends the range of stochasticity in the super-Poisson direction. This HOD-based approach leverages degrees of freedom in the galaxy–halo connection to obtain informed bounds on nuisance model parameters and can be adapted to study other parametrizations of shot noise in galaxy counts, in particular to motivate prior ranges on stochasticity for cosmological analyses.

Britt, Dylan (ORCID:000000019905601X)↗
DOE OSTI2022

Multi-head attention-based U-Nets for predicting protein domain boundaries using 1D sequence features and 2D distance maps

Abstract The information about the domain architecture of proteins is useful for studying protein structure and function. However, accurate prediction of protein domain boundaries (i.e., sequence regions separating two domains) from sequence remains a significant challenge. In this work, we develop a deep learning method based on multi-head U-Nets (called DistDom) to predict protein domain boundaries utilizing 1D sequence features and predicted 2D inter-residue distance map as input. The 1D features contain the evolutionary and physicochemical information of protein sequences, whereas the 2D distance map includes the structural information of proteins that was rarely used in domain boundary prediction before. The 1D and 2D features are processed by the 1D and 2D U-Nets respectively to generate hidden features. The hidden features are then used by the multi-head attention to predict the probability of each residue of a protein being in a domain boundary, leveraging both local and global information in the features. The residue-level domain boundary predictions can be used to classify proteins as single-domain or multi-domain proteins. It classifies the CASP14 single-domain and multi-domain targets at the accuracy of 75.9%, 13.28% more accurate than the state-of-the-art method. Tested on the CASP14 multi-domain protein targets with expert annotated domain boundaries, the average per-target F1 measure score of the domain boundary prediction by DistDom is 0.263, 29.56% higher than the state-of-the-art method.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Generative Ensemble Regression: Learning Particle Dynamics from Observations of Ensembles with Physics-informed Deep Generative Models

Here, we propose a new method for inferring the governing stochastic ordinary differential equations (SODEs) by observing particle ensembles at discrete and sparse time instants, i.e., multiple “snapshots.” Particle coordinates at a single time instant, possibly noisy or truncated, are recorded in each snapshot but are unpaired across the snapshots. By training a physics-informed generative model that generates “fake” sample paths, we aim to fit the observed particle ensemble distributions with a curve in the probability measure space, which is induced from the inferred particle dynamics. We employ different metrics to quantify the differences between distributions, e.g., the sliced Wasserstein distances and the adversarial losses in generative adversarial networks. We refer to this method as generative “ensemble-regression” (GER), in analogy to the classic “point-regression,” where we infer the dynamics by performing regression in the Euclidean space. We illustrate the GER by learning the drift and diffusion terms of particle ensembles governed by SODEs with Brownian motions and Lévy processes up to 100 dimensions. We also discuss how to treat cases with noisy or truncated observations. Apart from systems consisting of independent particles, we also tackle nonlocal interacting particle systems with unknown interaction potential parameters by constructing a physics-informed loss function. Finally, we investigate scenarios of paired observations and discuss how to reduce the dimensionality in such cases by proving a convergence theorem that provides theoretical support.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Discovering causal structure with reproducing-kernel Hilbert space ε -machines

We merge computational mechanics’ definition of causal states (predictively equivalent histories) with reproducing-kernel Hilbert space (RKHS) representation inference. The result is a widely applicable method that infers causal structure directly from observations of a system’s behaviors whether they are over discrete or continuous events or time. A structural representation—a finite- or infinite-state kernel ϵ-machine—is extracted by a reduced-dimension transform that gives an efficient representation of causal states and their topology. In this way, the system dynamics are represented by a stochastic (ordinary or partial) differential equation that acts on causal states. We introduce an algorithm to estimate the associated evolution operator. Paralleling the Fokker–Planck equation, it efficiently evolves causal-state distributions and makes predictions in the original data space via an RKHS functional mapping. We demonstrate these techniques, together with their predictive abilities, on discrete-time, discrete-value infinite Markov-order processes generated by finite-state hidden Markov models with (i) finite or (ii) uncountably infinite causal states and (iii) continuous-time, continuous-value processes generated by thermally driven chaotic flows. The method robustly estimates causal structure in the presence of varying external and measurement noise levels and for very high-dimensional data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Superconducting gap symmetry from Bogoliubov quasiparticle interference analysis on Sr 2 RuO 4

Here, the nature of the superconducting order parameter in Sr 2 RuO 4 has generated intense interest in recent years. Since the superconducting gap is very small, high-resolution methods such as scanning tunneling spectroscopy might be the best chance to directly resolve the gap symmetry. Recently, a Bogoliubov quasiparticle interference imaging (BQPI) experiment has suggested that the d x 2 –y 2 gap symmetry is appropriate for Sr 2 RuO 4 . In this work, we use a material-specific theoretical approach based onWannier functions of the surface of Sr 2 RuO 4 to calculate the continuum density of states as detected in scanning tunneling microscopy experiments. We examine several different proposed gap order parameters and calculate the expected BQPI pattern for each case. Comparing to the available experimental data, our results suggest that a s' + id xy gap order parameter is the most probable state, but the measured BQPI patterns still display features unaccounted for by the theory for any of the states currently under discussion.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

Density estimation via measure transport: Outlook for applications in the biological sciences

Abstract One among several advantages of measure transport methods is that they allow or a unified framework for processing and analysis of data distributed according to a wide class of probability measures. Within this context, we present results from computational studies aimed at assessing the potential of measure transport techniques, specifically, the use of triangular transport maps, as part of a workflow intended to support research in the biological sciences. Scenarios characterized by the availability of limited amount of sample data, which are common in domains such as radiation biology, are of particular interest. We find that when estimating a distribution density function given limited amount of sample data, adaptive transport maps are advantageous. In particular, statistics gathered from computing series of adaptive transport maps, trained on a series of randomly chosen subsets of the set of available data samples, leads to uncovering information hidden in the data. As a result, in the radiation biology application considered here, this approach provides a tool for generating hypotheses about gene relationships and their dynamics under radiation exposure.

gene expression data↗
DOE OSTI2024

The Information Length Concept Applied to Plasma Turbulence

A methodology to study statistical properties of anomalous transport in fusion plasma is investigated. Three time traces generated by the full-f gyrokinetic code GKNET are analyzed for this purpose. The time traces consist of heat flux as a function of the radial position, which is studied in a novel manner using statistical methods. The simulation data exhibit transport processes with both medium and long correlation length along the radius. A typical example of a phenomenon with long correlation length is avalanches. In order to investigate the evolution of the turbulent state, two basic configurations are studied, one flux-driven and one gradient-driven with decaying turbulence. The information length concept in tandem with Boltzmann–Gibbs and Tsallis entropy is used in the investigation. It is found that the dynamical states in both flux-driven and gradient-driven cases are surprisingly similar, but the Tsallis entropy reveals differences between them. This indicates that the types of probability distribution function are nevertheless quite different since the higher moments are significantly different.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗