Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Gaussian distribution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

On the Stochastic Stability of Deep Markov Models

Deep Markov models (DMM) are generative models which are scalable and expressive generalization of Markov models for representation, learning, and inference problems. DMMs using deep neural networks to parametrize the transition of Markov probability distributions have recently been shown to provide more expressiveness in modeling sequential data and dynamical system responses. However, the fundamental stochastic stability guarantees of such models have not been thoroughly investigated. In this paper, we present a rigorous analytical method to prove the necessary and sufficient conditions of DMM's stochastic stability. This task is achieved by spectral analysis of the efficiently computed Jacobians of probabilistic maps modeled by deep neural networks. We make theoretical connections between the eigenvalues of neural network's weights and the different activation function types used on the stability and overall dynamic behavior of DMMs with Gaussian distributions. We empirically substantiate our theoretical results on stochastic stability and eigenvalue spectra via several numerical experiments. Formal stability guarantees of DMMs can substantially improve their robustness and trustworthiness, necessary for reliable use in safety-critical real-world applications.

Drgona, Jan↗
DOE OSTI2021

Assessment of Local Observation of Atomic Ordering in Alloys via the Radial Distribution Function: A Computational and Experimental Approach

As a powerful analytical technique, atom probe tomography (APT) has the capacity to acquire the spatial distribution of millions of atoms from a complex sample. However, extracting information at the Ångstrom-scale on atomic ordering remains a challenge due to the limits of the APT experiment and data analysis algorithms. The development of new computational tools enable visualization of the data and aid understanding of the physical phenomena such as disorder of complex crystalline structures. Here, we report progress towards this goal using two steps. We describe a computational approach to evaluate atomic ordering in the crystal structure by generating radial distribution functions (RDF). Atomic ordering is rendered as the Fractional Cumulative Radial Distribution Function (FCRDF) which allows for greater visibility of local compositions at short range in the structure. Further, we accommodate in the analysis additional parameters such as uncertainty in the atomic coordinates and the atomic abundance to ascertain short-range ordering in APT data sets. We applied the FCRDF analysis to synthetic and experimental APT data sets for Ni 3 Al. The ability to observe a signal of atomic ordering consistent with the known L1 2 crystal structure is heavily dependent on spatial uncertainty, irrespective of abundance. Detection of atomic ordering is subject to an upper limit of spatial uncertainty of atoms described with Gaussian distributions with a standard deviation of 1.3 Å. The FCRDF analysis was also applied to the APT data set for a six-component alloy, Al 1.3 CoCrCuFeNi. In this case, we are currently able to visualize elemental segregation at the nanoscale, though unambiguous identification of atomic ordering at the Ångstrom (nearest-neighbor) scale remains a goal.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Learning likelihood ratios with neural network classifiers

The likelihood ratio is a crucial quantity for statistical inference in science that enables hypothesis testing, construction of confidence intervals, reweighting of distributions, and more. Many modern scientific applications, however, make use of data- or simulation-driven models for which computing the likelihood ratio can be very difficult or even impossible. By applying the so-called “likelihood ratio trick,” approximations of the likelihood ratio may be computed using clever parametrizations of neural network-based classifiers. A number of different neural network setups can be defined to satisfy this procedure, each with varying performance in approximating the likelihood ratio when using finite training data. We present a series of empirical studies detailing the performance of several common loss functionals and parametrizations of the classifier output in approximating the likelihood ratio of two univariate and multivariate Gaussian distributions as well as simulated high-energy particle physics datasets.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Feature learning and generalization in deep networks with orthogonal weights

Fully-connected deep neural networks with weights initialized from independent Gaussian distributions can be tuned to criticality, which prevents the exponential growth or decay of signals propagating through the network. However, such networks still exhibit fluctuations that grow linearly with the depth of the network, which may impair the training of networks with width comparable to depth. We show analytically that rectangular networks with tanh activations and weights initialized from the ensemble of orthogonal matrices have corresponding preactivation fluctuations which are independent of depth, to leading order in inverse width. Moreover, we demonstrate numerically that, at initialization, all correlators involving the neural tangent kernel (NTK) and its descendants at leading order in inverse width—which govern the evolution of observables during training—saturate at a depth of ~20, rather than growing without bound as in the case of Gaussian initializations. We speculate that this structure preserves finite-width feature learning while reducing overall noise, thus improving both generalization and training speed in deep networks with depth comparable to width. We provide some experimental justification by relating empirical measurements of the NTK to the superior performance of deep non-linear orthogonal networks trained under full-batch gradient descent on the MNIST and CIFAR-10 classification tasks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Small angle scattering of diblock copolymers profiled by machine learning

We outline a machine learning strategy for quantitively determining the conformation of AB-type diblock copolymers with excluded volume effects using small angle scattering. Complemented by computer simulations, a correlation matrix connecting conformations of different copolymers according to their scattering features is established on the mathematical framework of a Gaussian process, a multivariate extension of the familiar univariate Gaussian distribution. We show that the relevant conformational characteristics of copolymers can be probabilistically inferred from their coherent scattering cross sections without any restriction imposed by model assumptions. This work not only facilitates the quantitative structural analysis of copolymer solutions but also provides the reliable benchmarking for the related theoretical development of scattering functions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1993

Polarimetric backscattering from sea ice

Polarimetric backscattering from sea ice is presented. Theoretical models for backscattering are first presented for various ice types. Then, theoretical results are compared with experimental data for new thin ice, first-year ice, and multi-year ice. Sea ice is modeled as a layer medium containing random scatterers and rough interfaces. For multi-year sea ice with snow cover, the sea ice layer is modeled as an ice background with embedded spheroidal air bubbles and the snow layer as air with ice grains. The hummocky topography on multi-year ice is characterized by a Gaussian distribution which has an averaging effect on backscattering coefficients. First-year sea ice is described by an ice medium hosting ellipsoidal brine inclusions. These inclusions are oriented preferentially in the vertical direction due to the columnar structure of first-year sea ice. Azimuthally, the orientation of the brine pockets are random corresponding to the random c-axes in sea ice, unless the axes are oriented by sea currents. For thin ice in newly opened leads, it has been observed that there exists a thin brine layer with very high salinity on the top surface of the new ice. This brine layer is depicted as a medium with high permittivity which can significantly affect electromagnetic scattering signatures from the lower thin ice layer, with a higher fractional volume of brine inclusions due to higher salinity as compared to thick first-year sea ice. The rough medium interfaces are described as Gaussian rough surfaces characterized by root-mean-square heights and surface correlation lengths. The contribution from rough surface, calculated under the Kirchhoff approximation or small perturbation method, is assumed to be independent from volume scattering. The total loss including absorption and scattering losses in the scattering media is represented by the imaginary part of effective permittivity obtained from the strong fluctuation theory. The polarimetric scattering coefficients for different ice types are then derived under the distorted Born approximation.

Nghiem, S. V.↗
DOE OSTI2022

Conditional H I Mass Functions and the H I -to-halo Mass Relation in the Local Universe

We present a new H I mass estimator that relates log 10 (M HI /M * ) to a linear combination of four galaxy properties: stellar surface mass density, color index u - r, stellar mass, and concentration index, with the scatter of individual galaxies around the mean H I mass modeled with a Gaussian distribution function. We calibrate the estimator using the xGASS sample, including both H I detection and nondetection, and constrain the model parameters through Bayesian inferences. Tests with mock catalogs demonstrate that our estimator provides unbiased H I masses for optical samples like SDSS. We apply our estimator to the SDSS spectroscopic sample to estimate the H I mass function (HIMF) of local galaxies, as well as the conditional H I mass function in galaxy groups and the H I –halo mass relation. Our HIMF agrees with the ALFALFA measurements at M HI ≳ 5 × 10 9 M ⊙ , but with higher amplitude and a steeper slope at lower masses. We show that this discrepancy is caused primarily by the cosmic variance, which is corrected for the SDSS sample but not for ALFALFA. The total CHIMFs for all halo masses can be described by a single Schechter function, while those of central galaxies show a double-Gaussian profile. The total H I mass in a group increases monotonically with halo mass, but for central galaxies, the H I mass shows weak dependence on halo mass when M h ≳ 10 12 M ⊙ . The observed H I –halo mass relation is not reproduced by current hydrodynamic simulations and semianalytic models of galaxy formation.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Parameter estimation with maximal updated densities

A recently developed measure-theoretic framework solves a stochastic inverse problem (SIP) for models where uncertainties in model output data are predominantly due to aleatoric (i.e., irreducible) uncertainties in model inputs (i.e., parameters). The subsequent inferential target is a distribution on parameters. Another type of inverse problem is to quantify uncertainties in estimates of “true” parameter values under the assumption that such uncertainties should be reduced as more data are incorporated into the problem, i.e., the uncertainty is considered epistemic. A major contribution of this work is the formulation and solution of such a parameter identification problem (PIP) within the measure-theoretic framework developed for the SIP. The approach is novel in that it utilizes a solution to a stochastic forward problem (SFP) to update an initial density only in the parameter directions informed by the model output data. In other words, this method performs “selective regularization” only in the parameter directions not informed by data. Further, the solution is defined by a maximal updated density (MUD) point where the updated density defines the measure-theoretic solution to the PIP. Another significant contribution of this work is the full theory of existence and uniqueness of MUD points for linear maps with Gaussian distributions. Data-constructed Quantity of Interest (QoI) maps are also presented and analyzed for solving the PIP within this measure-theoretic framework as a means of reducing uncertainties in the MUD estimate. We conclude with a demonstration of the general applicability of the method on two problems involving either spatial or temporal data for estimating uncertain model parameters. The first problem utilizes spatial data from a stationary partial differential equation to produce a MUD estimate of an uncertain boundary condition. The second problem utilizes temporal data obtained from the state-of-the-art ADvanced CIRCulation (ADCIRC) model to obtain a MUD estimate of uncertain wind drag coefficients for a simulated extreme weather event near the Shinnecock Inlet located in the Outer Barrier of Long Island, NY, USA.

42 ENGINEERING↗
NASA NTRS1981

An ultrasonic transducer with Gaussian radial velocity distribution

A transducer with a velocity profile which is Gaussian as a function of radius and independent of angle is described. In materials evaluation applications requiring the interrogation of modified far field patterns of an ultrasonic transducer, it is desirable to use a transducer which produces a beam with a Gaussian profile. A computer aided electrode design and calibrated three dimensional interferometric optical and ultrasonic measurements of the far field distribution are presented.

Zerwekh, P. S.↗
DOE OSTI2023

Multi-Fidelity Gaussian Process for Distribution System Voltage Probabilistic Estimation with PVs

The increasing penetration of behind-the-meter PVs causes challenges to maintain voltage security due to the lack of distribution system visibility. This paper proposes a nonlinear autoregressive Gaussian process (NARGP) approach to fuse limited number of SCADA/AMI data together with historical pseudo measurements for distribution node voltage probabilistic estimation. The high-fidelity SCADA data are fused with the low-fidelity AMI and pseudo measurements by the autoregressive algorithm embedded in the Gaussian process. This allows us to use multi-fidelity data to achieve entire distribution system voltage visibility. Numerical results carried out on the IEEE 123node system demonstrate that the NARGP method is able to obtain high accuracy in estimating bus voltage and quantifying estimation uncertainties as compared to other approaches.

distribution system estimation↗
DOE OSTI2022

Tuning the Coherent Propagation of Organic Exciton‐Polaritons through Dark State Delocalization

Abstract While there have been numerous reports of long‐range polariton transport at room‐temperature in organic cavities, the spatiotemporal evolution of the propagation is scarcely reported, particularly in the initial coherent sub‐ps regime, where photon and exciton wavefunctions are inextricably mixed. Hence the detailed process of coherent organic exciton‐polariton transport and, in particular, the role of dark states has remained poorly understood. Here, femtosecond transient absorption microscopy is used to directly image coherent polariton motion in microcavities of varying quality factor. The transport is found to be well‐described by a model of band‐like propagation of an initially Gaussian distribution of exciton‐polaritons in real space. The velocity of the polaritons reaches values of ≈ 0.65 × 10 6 m s −1 , substantially lower than expected from the polariton dispersion. Further, it is found that the velocity is proportional to the quality factor of the microcavity. This unexpected link between the quality‐factor and polariton velocity is suggested to be a result of varying admixing between delocalized dark and polariton states.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Evolution of the SARS-CoV -2 proteome in three dimensions (3D) during the first 6 months of the COVID -19 pandemic

Understanding the molecular evolution of the SARS-CoV-2 virus as it continues to spread in communities around the globe is important for mitigation and future pandemic preparedness. Three-dimensional structures of SARS-CoV-2 proteins and those of other coronavirusess archived in the Protein Data Bank were used to analyze viral proteome evolution during the first 6 months of the COVID-19 pandemic. Analyses of spatial locations, chemical properties, and structural and energetic impacts of the observed amino acid changes in >48 000 viral isolates revealed how each one of 29 viral proteins have undergone amino acid changes. Catalytic residues in active sites and binding residues in protein–protein interfaces showed modest, but significant, numbers of substitutions, highlighting the mutational robustness of the viral proteome. Energetics calculations showed that the impact of substitutions on the thermodynamic stability of the proteome follows a universal bi-Gaussian distribution. Here detailed results are presented for potential drug discovery targets and the four structural proteins that comprise the virion, highlighting substitutions with the potential to impact protein structure, enzyme activity, and protein–protein and protein–nucleic acid interfaces. Characterizing the evolution of the virus in three dimensions provides testable insights into viral protein function and should aid in structure-based drug discovery efforts as well as the prospective identification of amino acid substitutions with potential for drug resistance.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Generalized filtered lifting line theory for arbitrary chord lengths and application to wind turbine blades

Abstract The filtered lifting line theory is an analytical approach used to solve the equations of flow subjected to body forces with a Gaussian distribution, such as used in the actuator line model. In the original formulation, the changes in chord length along the blade were assumed to be small. This assumption can lead to errors in the induced velocities predicted by the theory compared to full solutions of the equations. In this work, we revisit the original derivation and provide a more general formulation that can account for significant changes in chord along the blade. The revised formulation can be applied to wings with significant changes in chord along the span, such as wind turbine blades.

17 WIND ENERGY↗
DOE OSTI2021

Medium-induced radiative kernel with the Improved Opacity Expansion

We calculate the fully differential medium-induced radiative spectrum at next-to-leading order (NLO) accuracy within the Improved Opacity Expansion (IOE) framework. This scheme allows us to gain analytical control of the radiative spectrum at low and high gluon frequencies simultaneously. The high frequency regime can be obtained in the standard opacity expansion framework in which the resulting power series diverges at the characteristic frequency ω c ~ q^L 2 . In the IOE, all orders in opacity are resumed systematically below ωc yielding an asymptotic series controlled by logarithmically suppressed remainders down to the thermal scale T « ω c , while matching the opacity expansion at high frequency. Furthermore, we demonstrate that the IOE at NLO accuracy reproduces the characteristic Coulomb tail of the single hard scattering contribution as well as the Gaussian distribution resulting from multiple soft momentum exchanges. Finally, we compare our analytic scheme with a recent numerical solution, that includes a full resummation of multiple scatterings, for LHC-inspired medium parameters. Furthermore, we find a very good agreement both at low and high frequencies showcasing the performance of the IOE which provides for the first time accurate analytic formulas for radiative energy loss in the relevant perturbative kinematic regimes for dense media.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Toroidal magnetic field ripple in the presence of misaligned toroidal field coils on the COMPASS-U tokamak

Homogeneity of the toroidal magnetic field is a critical aspect of the tokamak fusion device. It is affected by the design of toroidal magnetic field coils and their manufacturing and assembly misalignments. The magnetic field of the COMPASS-U project is analysed using toroidal field ripple quantity. Here ANSYS modelling of bitter-plate-designed toroidal field coils is performed to prepare an accurate simplistic representation of the coils using a virtual current line. Toroidal field ripple is analysed using a Gaussian distribution of possible misalignments. The worst-case toroidal field ripple corresponding to the technical drawings only slightly exceeds the chosen limit of 0.5%.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Uncertainty quantification of a deep learning fuel property prediction model

Deep learning models are being widely used in the field of combustion. Given the black-box nature of typical neural network based models, uncertainty quantification (UQ) is critical to ensure the reliability of predictions as well as the training datasets, and for a principled quantification of noise and its various sources. Deep learning surrogate models for predicting properties of chemical compounds and mixtures have been recently shown to be promising for enabling data-driven fuel design and optimization, with the ultimate goal of improving efficiency and lowering emissions from combustion engines. In this study, UQ is performed for a multi-task deep learning model that simultaneously predicts the research octane number (RON), Motor Octane Number (MON), and Yield Sooting Index (YSI) of pure components and multicomponent blends. The deep learning model is comprised of three smaller networks: Extractor 1, Extractor 2, and Predictor, and a mixing operator. The molecular fingerprints of individual components are encoded via Extractor 1 and Extractor 2, the mixing operator generates fingerprints for mixtures/blends based on linear mixing operation, and the predictor maps the fingerprint to the target properties. Two different classes of UQ methods, Monte Carlo ensemble methods and Bayesian neural networks (BNNs), are employed for quantifying the epistemic uncertainty. Combinations of Bernoulli and Gaussian distributions with DropConnect and DropOut techniques are explored as ensemble methods. All the DropConnect, DropOut and Bayesian layers are applied to the predictor network. Aleatoric uncertainty is modeled by assuming that each data point has an independent uncertainty associated with it. The results of the UQ study are further analyzed to compare the performance of BNN and ensemble methods. Although this study is confined to UQ of fuel property prediction, the methodologies are applicable to other deep learning frameworks that are being widely used in the combustion community.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Testing and signal identification for two-sample high-dimensional covariances via multi-level thresholding

The paper considers testing and signal identification for covariance matrices from two populations of marginally sub-Gaussian distributed. A multi-level thresholding procedure is proposed for testing the equality of two high-dimensional covariance matrices, which is designed to detect sparse and faint differences between the covariances. A novel -statistic composition is developed to establish the asymptotic distribution of the thresholding statistics in conjunction with the matrix blocking and the coupling techniques. It is shown that the proposed test is more powerful than the existing tests in detecting sparse and weak signals in covariances. Multiple testing procedures are constructed to discover different covariances and the sub-groups of variables with different covariance structures between the two populations. The proposed procedures are based on the multi-level thresholding test, which are able to control the false discovery proportion () with high power. Simulation experiments and a case study on the returns of the S&P 500 stocks before and after the COVID-19 pandemic are conducted to demonstrate and compare the utilities of the proposed methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

TransformerG2G: Adaptive time-stepping for learning temporal graph embeddings using transformers

Dynamic graph embedding has emerged as a very effective technique for addressing diverse temporal graph analytic tasks (i.e., link prediction, node classification, recommender systems, anomaly detection, and graph generation) in various applications. Such temporal graphs exhibit heterogeneous transient dynamics, varying time intervals, and highly evolving node features throughout their evolution. Hence, incorporating long-range dependencies from the historical graph context plays a crucial role in accurately learning their temporal dynamics. In this paper, we develop a graph embedding model with uncertainty quantification, TransformerG2G, by exploiting the advanced transformer encoder to first learn intermediate node representations from its current state (t) and previous context (over timestamps [t–1,t–l], l is the length of context). Moreover, we employ two projection layers to generate lower-dimensional multivariate Gaussian distributions as each node's latent embedding at timestamp t. We consider diverse benchmarks with varying levels of "novelty" as measured by the TEA (Temporal Edge Appearance) plots. Here, our experiments demonstrate that the proposed TransformerG2G model outperforms conventional multi-step methods and our prior work (DynG2G) in terms of both link prediction accuracy and computational efficiency, especially for high degree of novelty. Furthermore, the learned time-dependent attention weights across multiple graph snapshots reveal the development of an automatic adaptive time stepping enabled by the transformer. Importantly, by examining the attention weights, we can uncover temporal dependencies, identify influential elements, and gain insights into the complex interactions within the graph structure. For example, we identified a strong correlation between attention weights and node degree at the various stages of the graph topology evolution.

97 MATHEMATICS AND COMPUTING↗