Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Variational methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Combining variational autoencoders and physical bias for improved microscopy data analysis *

Electron and scanning probe microscopy produce vast amounts of data in the form of images or hyperspectral data, such as electron energy loss spectroscopy or 4D scanning transmission electron microscope, that contain information on a wide range of structural, physical, and chemical properties of materials. To extract valuable insights from these data, it is crucial to identify physically separate regions in the data, such as phases, ferroic variants, and boundaries between them. In order to derive an easily interpretable feature analysis, combining with well-defined boundaries in a principled and unsupervised manner, here we present a physics augmented machine learning method which combines the capability of variational autoencoders to disentangle factors of variability within the data and the physics driven loss function that seeks to minimize the total length of the discontinuities in images corresponding to latent representations. Our method is applied to various materials, including NiO-LSMO, BiFeO 3 , and graphene. The results demonstrate the effectiveness of our approach in extracting meaningful information from large volumes of imaging data. The customized codes of the required functions and classes to develop phyVAE is available at https://github.com/arpanbiswas52/phy-VAE.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

In-Line Optical Transmission Imaging of Decals for Quality Control - Task 3

Quality monitoring is a critical aspect for manufacturing systems. Ideally the monitoring would be done in-line, be non-contact, non-destructive, and fast. This would enable reduced scrap and higher throughput. This poster presents an optical transmission method for evaluating and mapping coatings. With the method shown in the poster we can visualize optical variations on the macro and micro scales. This allows us to see the overall trend in loading in both the cross web and down web directions. Furthermore, we can visualize defects such dewetting spots, streaks, clumps, and pinholes where there is a lack of coating. The optical transmission signal has been found to be proportional to the IrOx loading signal using XRF measurements. Therefore, an optical transmission setup can be installed in-line and allow for a fast, non-contact method for mapping loading variations and defects.

coating uniformity↗
DOE OSTI2020

High-resolution analogue of time-domain phonon spectroscopy in the transmission electron microscope

Femtosecond photoexcitation of semiconducting materials leads to the generation of coherent acoustic phonons (CAPs), the behaviours of which are linked to intrinsic and engineered electronic, optical and structural properties. While often studied with pump-probe spectroscopic techniques, the influence of nanoscale structure and morphology on CAP dynamics can be challenging to resolve with these all-optical methods. Here, we used ultrafast electron microscopy (UEM) to resolve variations in CAP dynamics caused by differences in the degree of crystallinity in as-prepared and annealed GaAs lamellae. Following in situ femtosecond photoexcitation, we directly imaged the generation and propagation dynamics of hypersonic CAPs in a mostly amorphous and, following an in situ photothermal anneal, a mostly crystalline lamella. Subtle differences in both the initial hypersonic velocities and the asymptotic relaxation behaviours were resolved via construction of space-time contour plots from phonon wavefronts. Comparison to bulk sound velocities in crystalline and amorphous GaAs reveals the influence of the mixed amorphous-crystalline morphology on CAP dispersion behaviours. Further, an increase in the asymptotic velocity following annealing establishes the sensitivity of quantitative UEM imaging to both structural and compositional variations through differences in bonding and elasticity. Lastly, implications of extending the methods and results reported here to elucidating correlated electronic, optical and structural behaviours in semiconducting materials are discussed.

42 ENGINEERING↗
DOE OSTI2022

Variational Quantum Circuits to Prepare Low Energy Symmetry States

We explore how to build quantum circuits that compute the lowest energy state corresponding to a given Hamiltonian within a symmetry subspace by explicitly encoding it into the circuit. We create an explicit unitary and a variationally trained unitary that maps any vector output by ansatz A(α → ) from a defined subspace to a vector in the symmetry space. The parameters are trained varitionally to minimize the energy, thus keeping the output within the labelled symmetry value. The method was tested for a spin XXZ Hamiltonian using rotation and reflection symmetry and H 2 Hamiltonian within S z = 0 subspace using S 2 symmetry. We have found the variationally trained unitary gives good results with very low depth circuits and can thus be used to prepare symmetry states within near term quantum computers.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2026

Demystifying Piecewise and Localized Scatter Correction Methods

Multiplicative scatter is a common source of noise in near-infrared spectroscopy and other related instrumental techniques. A wide variety of methods are commonly used for the correction of multiplicative scatter. However, the majority of such methods assume that the parameters that describe the scatter are constant throughout the measured spectrum, which is often not the case. This work investigates a family of methods that perform scatter correction using local regions of neighboring wavelengths in order to better account for wavelength-dependent scattering. The methods in question are piecewise standard normal variate, localized standard normal variate, piecewise multiplicative scatter correction, and localized multiplicative scatter correction. This work describes the theoretical and algorithmic foundations of the family of local region-based scatter correction methods and compares their application and optimization at a qualitative and quantitative level using several datasets.

NIR spectroscopy↗
DOE OSTI2023

Robust scalable initialization for Bayesian variational inference with multi-modal Laplace approximations

Predictive modeling typically relies on Bayesian model calibration to provide uncertainty quantification. Variational inference utilizing fully independent (“mean-field”) Gaussian distributions are often used as approximate probability density functions. This simplification is attractive since the number of variational parameters grows only linearly with the number of unknown model parameters. However, the resulting diagonal covariance structure and unimodal behavior can be too restrictive to provide useful approximations of intractable Bayesian posteriors that exhibit highly non-Gaussian behavior, including multimodality. High-fidelity surrogate posteriors for these problems can be obtained by considering the family of Gaussian mixtures. Gaussian mixtures are capable of capturing multiple modes and approximating any distribution to an arbitrary degree of accuracy, while maintaining some analytical tractability. Unfortunately, variational inference using Gaussian mixtures with full-covariance structures suffers from a quadratic growth in variational parameters with the number of model parameters. The existence of multiple local minima due to strong nonconvex trends in the loss functions often associated with variational inference present additional complications, These challenges motivate the need for robust initialization procedures to improve the performance and computational scalability of variational inference with mixture models. In this work, we propose a method for constructing an initial Gaussian mixture model approximation that can be used to warm-start the iterative solvers for variational inference. The procedure begins with a global optimization stage in model parameter space. In this step, local gradient-based optimization, globalized through multistart, is used to determine a set of local maxima, which we take to approximate the mixture component centers. Around each mode, a local Gaussian approximation is constructed via the Laplace approximation. Finally, the mixture weights are determined through constrained least squares regression. The robustness and scalability of the proposed methodology is demonstrated through application to an ensemble of synthetic tests using high-dimensional, multimodal probability density functions. Here, the practical aspects of the approach are demonstrated with inversion problems in structural dynamics.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A matrix completion algorithm for efficient calculation of quantum and variational effects in chemical reactions

This work examines the viability of matrix completion methods as cost-effective alternatives to full nuclear Hessians for calculating quantum and variational effects in chemical reactions. The harmonic variety-based matrix completion (HVMC) algorithm, developed in a previous study (https://doi.org/10.1063/5.0018326), exploits the low-rank character of the polynomial expansion of potential energy to recover, using a small sample, vibrational frequencies (square roots of nuclear Hessian eigenvalues) constituting the reaction path. Furthermore, these frequencies are essential for calculating rate coefficients using variational transition state theory with multidimensional tunneling (VTST-MT). HVMC performance is examined for four SN2 reactions and five hydrogen transfer reactions, with each H-transfer reaction consisting of at least one vibrational mode strongly coupled to the reaction coordinate. HVMC is robust and captures zero-point energies, vibrational free energies, zero-curvature tunneling, and adiabatic ground state and free energy barriers as well as their positions on the reaction coordinate. For medium to large reactions involving H-transfer, with the exception of the most complex Ir catalysis system, less than 35% of total eigenvalue information is necessary for accurate recovery of key VTST-MT observables.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Algorithm 1049: The Delaunay Density Diagnostic

Accurate approximation of a real-valued function depends on two aspects of the available data: the density of inputs within the domain of interest and the variation of the outputs over that domain. There are few methods for assessing whether the density of inputs is sufficient to identify the relevant variations in outputs—i.e., the “geometric scale” of the function—despite the fact that sampling density is closely tied to the success or failure of an approximation method. In this article, we introduce a general purpose, computational approach to detecting the geometric scale of real-valued functions over a fixed domain using a deterministic interpolation technique from computational geometry. The algorithm is intended to work on scalar data in moderate dimensions (2–10). Our algorithm is based on the observation that a sequence of piecewise linear interpolants will converge to a continuous function at a quadratic rate (in L 2 norm) if and only if the data are sampled densely enough to distinguish the feature from noise (assuming sufficiently regular sampling). We present numerical experiments demonstrating how our method can identify feature scale, estimate uncertainty in feature scale, and assess the sampling density for fixed (i.e., static) datasets of input–output pairs. Finally, we include analytical results in support of our numerical findings and have released lightweight code that can be adapted for use in a variety of data science settings.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Increased signal-to-noise ratios within experimental field trials by regressing spatially distributed soil properties as principal components

Environmental variability poses a major challenge to any field study. Researchers attempt to mitigate this challenge through replication. Thus, the ability to detect experimental signals is determined by the degree of replication and the amount of environmental variation, noise, within the experimental system. A major source of noise in field studies comes from the natural heterogeneity of soil properties which create microtreatments throughout the field. In addition, the variation within different soil properties is often nonrandomly distributed across a field. We explore this challenge through a sorghum field trial dataset with accompanying plant, microbiome, and soil property data. Diverse sorghum genotypes and two watering regimes were applied in a split-plot design. We describe a process of identifying, estimating, and controlling for the effects of spatially distributed soil properties on plant traits and microbial communities using minimal degrees of freedom. Importantly, this process provides a method with which sources of environmental variation in field data can be identified and adjusted, improving our ability to resolve effects of interest and to quantify subtle phenotypes.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Errant Beam Prognostics with Machine Leaning at SNS Accelerator

Particle Accelerators are complex machine with many pieces of equipment running in synchronization to deliver required beam. However, faults in particle accelerators reduce the availability of the beam for experiments affecting the overall science output. To avoid these faults, we apply anomaly detection techniques to predict any unusual behavior and perform preemptive actions to improve the total availability. Many researchers have adopted semi-supervised Machine Learning (ML) methods such as auto-encoders and variational auto-encoders for such tasks. However, supervised ML techniques designed for similarity learning such as Siamese Neural Network (SNN) can outperform semi-supervised or unsupervised methods for anomaly prediction. One of the challenges associated with application of ML models to particle accelerators is the variability in observed data over time due to system configuration changes. We employ conditional models such as Conditional Siamese Neural Networks (CSNN), and Conditional-VAE (CVAE) to learn the variability in the data by using beam configuration parameters as conditional input. We apply these models for errant beam prediction at Spallation Neutron Source accelerator under different system configurations and compare their performance. We demonstrate that CSNN outperforms CVAE in our application. This talk will present the data source, collection, analysis, data-preparation, model development, hyper-parameter studies and the results.

Rajput, Kishansingh↗
DOE OSTI2020

Nitrogen Fertilization Restructured Spatial Patterns of Soil Organic Carbon and Total Nitrogen in Switchgrass and Gamagrass Croplands in Tennessee USA

Nitrogen (N) fertilizers can potentially alter spatial distribution of soil organic carbon (SOC) and total nitrogen (TN) concentrations in croplands such as switchgrass (SG: Panicum virgatum L.) and gamagrass (GG: Tripsacum dactyloides L.), but it remains unclear whether these effects are the same between crops and under different rates of fertilization. 13 C and 15 N are two important proxy measures of soil biogeochemistry, but they were rarely examined as to their spatial distributions in soil. Based on a three-year long fertilization experiment in Middle Tennessee, USA, the top mineral horizon soils (0–15 cm) were collected using a spatially explicit design within two 15-m 2 plots under three fertilization treatments in SG and GG croplands. A total of 288 samples were collected based on 12 plots and 24 samples in each plot. The fertilization treatments were no N input (NN), low N input (LN: 84 kg N ha -1 in urea) and high N input (HN: 168 kg N ha -1 in urea). The SOC, TN, SOC/TN (C: N), δ 13 C and δ 15 N were quantified and their within-plot variations and spatial distributions were achieved via descriptive and geostatistical methods. Results showed that SG generally displayed 10~120% higher plot-level variations in all variables than GG, and the plot-level variations were 20~77% higher in NN plots than LN and HN plots in SG but they were comparable in unfertilized and fertilized plots in GG. Relative to NN, LN and HN showed more significant surface trends and spatial structures in SOC and TN in both croplands, and the fertilization effect appeared more pronounced in SG. Spatial patterns in C: N, δ 13 C and δ 15 N were comparable among different fertilization treatments in both croplands. The descending within-plot variations were also identified among variables (SOC > TN > δ 15 N > C: N > δ 13 C). This study demonstrated that N fertilizations generally reduced the plot-level variance and simultaneously re-established spatial structures of SOC and TN in bioenergy croplands, which little varied with fertilization rate but was more responsive in switchgrass cropland.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Spatial variation of the low-temperature micro-photoluminescence of THM-grown CdZnTeSe

The quaternary compound CdZnTeSe (CZTS) has emerged as a next-generation detector material. Unlike CdZnTe (CZT), CZTS has the distinct advantages of little or no sub-grain boundary networks and a much lower concentration of Te inclusions, plus better compositional homogeneity. Thus, the material is expected to offer better spatial charge-transport homogeneity compared to CZT. However, an inhomogeneous distribution of point defects in both CZT and CZTS, such as Cd vacancies and residual impurities, can impose additional spatial inhomogeneity of the resistivity, carrier mobilities, and carrier lifetimes of the material. To investigate the spatial distribution of such defects in CZTS, low-temperature photoluminescence (PL) spectroscopic studies were performed at different positions along a single crystalline CZTS sample surface, which was grown by the traveling heater method (THM). In conclusion, the intensity variation of the PL emission of excitons bound to a neutral acceptor defect (A 0 , X), which is likely dominated by an acceptor like Cu-related level, with respect to the PL emission line from a neutral donor-bound exciton (D 0 , X) exhibited significant spatial variation, while the peak energy positions were approximately uniform due to the high compositional and bandgap homogeneity of the material.

II-VI semiconductor↗
DOE OSTI2022

Parameter Calibration for Johnson Cook and Preston-Tonks-Wallace Material Strength Models with Uncertainty Quantification

In this study we perform a Bayesian calibration of the parameters in the Johnson Cook (JC) material strength model, with uncertainty, using experiments with for a range of low and medium strain rates. For the parameter calibration, we used a variational Bayesian approach with experimental data from Hopkinson bar and quasi-static tests done on Oxygen Free High Conductivity (OFHC) copper. The estimated parameter values matched well with experimental data for a modest range of strain rates and temperatures. Through this method, we also recovered uncertainty and correlation information for the estimated parameter values. We also compared our results to a calibration of parameters in the Preston-Tonks-Wallace (PTW) material strength model, using the same variational Bayesian method. The parameters estimated for both models provided good agreement with the experimental data.

36 MATERIALS SCIENCE↗
DOE OSTI2025

In‐situ Analysis of Paste Properties in Resonant Acoustic Mixers for Quality Monitoring

Formulation control is key to achieving consistent target properties of energetic materials, as feedstock variations and slight deviations in the ratios of different ingredients can have major effects on final product properties, particularly in dense pastes with high particle loading >65 vol.%. In large‐scale operations, it is imperative to either correct or remove batches of material that perform outside baseline property specifications as early as possible to avoid unnecessary processing of suboptimal material. Quality monitoring is the practice of measuring material properties during processing using process analytical technologies as opposed to only testing the properties of the final product; it is a key principle in the quality‐by‐design frameworks used for designing formulations and manufacturing processes. Herein, a process analytical technology method for correlating material properties of dense pastes directly after mixing in a Resonant Acoustic Mixer to motor data is developed and used to detect differences in the particle content of dense paste formulations. This method was also capable of detecting variations in powder feedstock properties, such as particle packing efficiency, and is sensitive enough to detect changes of 2 wt.% in the total solids content of the formulation. The techniques presented herein show excellent promise for use as a process analytical technology capable of quantifying formulation effects on material movement modes during resonant acoustic mixing.

Materials science↗
DOE OSTI2026

Multi-Modal Bayesian Neural Network Surrogates with Conjugate Last-Layer Estimation

As data collection and simulation capabilities advance, multi-modal learning, the task of learning from multiple modalities and sources of data, is becoming an increasingly important area of research. Surrogate models that learn from data of multiple auxiliary modalities to support the modeling of a highly expensive quantity of interest have the potential to aid outer loop applications such as optimization, inverse problems, or sensitivity analyses when multi-modal data are available. We develop two multi-modal Bayesian neural network surrogate models and leverage conditionally conjugate distributions in the last layer to estimate model parameters using stochastic variational inference (SVI). We provide a method to perform this conjugate SVI estimation in the presence of partially missing observations. Here, we demonstrate improved prediction accuracy and uncertainty quantification compared to unimodal surrogate models for both scalar and time series data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Ground state property calculations of LiH n complexes using IBM Qiskit’s quantum simulator

In this study, the variational quantum eigensolver (VQE) on a quantum simulator is used in calculating ground state electronic structure properties of the LiH n , n = 1–3, complexes including their singly charged ions. Results calculated using classical electronic structure algorithms are also included. We investigate the use of the unitary coupled cluster with singles and doubles (UCCSD) Ansatz using VQE within Qiskit and compare results to full configuration interaction (FCI) calculations. Computed ground state energies, electron affinities, ionization potentials, and dipole moments are considered. We report the first-of-its-kind simulated quantum computing results of selected LiH n species and use the parity orbital to qubit mapping scheme. We find that VQE/UCCSD results are comparable to classical coupled clusters with singles and doubles for all considered systems with respect to FCI. A VQE calculation cost evaluation is included in which we evaluate performance using both Jordan–Wigner and parity orbital to qubit mapping schemes. We also discuss some of the current limitations of utilizing VQE for the study of chemical systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Quantifying Microstructure Variability in Laser Powder Bed Fusion 316 L Stainless Steel Microstructures with Spatial Statistics

Here, we have explored data-driven methods for material microstructure quantification that improve sensitivity to microstructural changes compared to traditional approaches. The methods integrate multiple microstructural properties, including grain morphology, crystallographic orientation, and material phase information. The simpler method employs maps of the Euclidean distance transformation metric to evaluate the morphology of grain boundary networks. The more intensive approach employs generalized spherical harmonic mapping for crystallographic orientations, per-pixel phase information, and a variational auto-encoder for dimensionality reduction and results in a multidimensional clustering of by microstructure similarity. Applied to an experimental dataset of additively manufactured steel, both methods detected slight variations in samples produced under nominally identical processing conditions. Both methods were able to distinguish between samples from multiple (nominally identical) builds, while the generalized spherical harmonics-based method could additionally cluster data samples rotated at two orientations on the build plate. The improved sensitivity of the methods, demonstrated through comparison with traditional microstructure characterization techniques, offers advantages for microstructure quantification and comparisons in advanced manufacturing applications.

SS316L↗
DOE OSTI2025

The DESI Y1 RR Lyrae catalog I: Empirical modeling of the cyclic variation of spectroscopic properties and a chemodynamical analysis of the outer halo

We present the catalog of RR Lyrae stars observed in the first year of operations of the Dark Energy Spectroscopic Instrument (DESI) survey. This catalog contains 6,240 RR Lyrae stars out to $\sim100$ kpc from the Galactic center and over 12,000 individual epochs with homogeneously-derived stellar atmospheric parameters. We introduce a novel methodology to model the cyclical variation of the spectroscopic properties of RR Lyrae from single-epoch measurements. We employ this method to infer the radial velocity and effective temperature variation of fundamental mode and first-overtone RR Lyrae stars and to determine their systemic velocities and mean temperatures. For fundamental mode pulsators, we obtain radial velocity curves with amplitudes of $\sim$30--50 km s$^{-1}$ and effective temperature curves with 300--1,000 K variations, whereas for first-overtone pulsators these amplitudes are $\sim20$ km s$^{-1}$ and $\sim 600$ K, respectively. We use our sample to study the metallicity distribution of the halo and its dependence on Galactocentric distance ($R_{\rm GC}$). Using a radius-dependent mixture model, we split the data into chemodynamically distinct components and find that our inner halo sample ($R_{\rm GC}\lesssim50$ kpc) is predominantly composed of stars with [Fe/H] $\sim-1.5$ dex and largely radial orbits (with an anisotropy parameter $\beta\sim0.94$), that we associate with the Gaia-Sausage-Enceladus merger event. Stars in the outer halo field exhibit a broader and more metal-poor [Fe/H] distribution with more circular orbits ($\beta\sim0.39$). The metallicity gradient of the metal-rich and the metal-poor components is found to be $0.005$ and $0.010$ dex kpc$^{-1}$, respectively. Our catalog highlights DESI's tantalizing potential for studying the Milky Way and the pulsation properties of RR Lyrae stars in the era of large spectroscopic surveys.

79 ASTRONOMY AND ASTROPHYSICS↗