Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “inverse modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Machine learning-based real-time kinetic profile reconstruction in DIII-D

Abstract Kinetic equilibrium reconstruction plays a vital role in the physical analysis of plasma stability and control in fusion tokamaks. However, the traditional approach is subjective and prone to human biases. To address this, the consistent automatic kinetic equilibrium reconstruction (CAKE) method was introduced, providing objective results. Nonetheless, its offline nature limits its application in real-time plasma control systems (PCSs). To address this limitation, we present RTCAKENN, a machine learning model that approximates 7 CAKE-level output profiles, namely pressure, inverse q , toroidal current density, electron temperature and density, carbon ion impurity temperature and rotation profiles, using real-time available inputs. The deep neural network consists of an encoder layer, where the scalars and interdependent inputs such as plasma boundary coordinates and motional Stark effect data are encoded using multi-layer perceptrons (MLPs), while profile inputs are encoded by 1D convolutional layers. The encoded data is passed through a MLP for latent feature extraction, before being decoded in the decoding layers, which consist of upsampling and convolutional layers. RTCAKENN has been implemented in the DIII-D PCS and our model achieves accuracy comparable to CAKE and surpasses existing real-time alternatives. Through clever dropout training, RTCAKENN exhibits robustness and can operate even in the absence of Thomson scattering data or charge exchange recombination data. It executes in under 8 ms in the real-time environment, enabling future application in real-time control and analysis.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Adversarial autoencoder ensemble for fast and probabilistic reconstructions of few-shot photon correlation functions for solid-state quantum emitters

Second-order photon correlation measurements [g (2) (τ) functions] are widely used to classify single-photon emission purity in quantum emitters or to measure the multiexciton quantum yield of emitters that can simultaneously host multiple excitations – such as quantum dots – by evaluating the value of g (2) (τ = 0). Accumulating enough photons to accurately calculate this value is time consuming and could be accelerated by fitting of few-shot photon correlations. Here, we develop an uncertainty-aware, deep adversarial autoencoder ensemble (AAE) that reconstructs noise-free g (2) (τ) functions from noise-dominated, few-shot inputs. The model is trained with simulated g (2) (τ) functions that are facilely generated by Poisson sampling time bins. The AAE reconstructions are performed orders-of-magnitude faster, with reconstruction errors and estimates of g (2) (τ = 0) that are lower in variance and similar in accuracy compared to Maximum likelihood estimation and Levenberg-Marquardt least-squares fitting approaches, for simulated and experimentally measured few-shot g (2) (τ) functions (~100 two-photon events) of InP/ZnS/ZnSe and CdS/CdSe/CdS quantum dots. The deep-ensemble model comprises eight individual autoencoders, allowing for probabilistic reconstructions of noise-free g (2) (τ) functions, and we show that the predicted variance scales inversely with number of shots, with comparable uncertainties to computationally intensive Markov chain Monte Carlo sampling. Furthermore, this work demonstrates the advantage of machine learning models to perform uncertainty-aware, fast, and accurate reconstructions of simple Poisson-distributed photon correlation functions, allowing for on-the-fly reconstructions and accelerated materials characterization of solid-state quantum emitters.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Deep Image Prior Enabled Full Waveform Inversion (Final Technical Report)

MS Student Naveen Gupta worked on the problem of full waveform inversion (FWI) using neural networks as shown in Figure 1. Our goal was to learn a neural network to represent the subsurface velocity model, which when fed into the FWI module (implemented using a numerical forward model of wave equations) produces amplitude estimates that match with ground-truth observations of amplitude. We used neural networks to solve the inverse problem of estimating velocity distributions for a given seismic amplitude data such that, once trained, our neural network model can generate a distribution of velocity profiles for different random vectors fed as inputs to the neural network model.

97 MATHEMATICS AND COMPUTING↗

Morphogenic Growth 3D Printing

Inspired by nature's morphogenesis, a new 3D printing process –growth printing (GP)– takes advantage of a self‐propagating curing front to produce 3D polymeric parts following a growth‐like development plan. The propagation of the curing front is driven by the exothermic polymerization of dicyclopentadiene (DCPD), which transforms the liquid resin into a stiff polymer as it propagates at 1 mm s −1 . GP is triggered when a heated initiator contacts the uncured liquid resin in an open container. The initiator nucleates the frontal polymerization reaction and the isotropic radial propagation of the growth front. Simultaneously, the initiator is moved up across the free surface of the resin, pulling the cured object out of the uncured resin. The motion trajectory of the initiator with respect to the free resin surface controls the growth morphology of the 3D part. An inverse design algorithm is developed to produce 3D parts by modeling the reaction‐diffusion‐driven solidification process. This process has substantial energy savings and high printing speeds.

3D printing↗

Evolution of the Electronic and Excitonic Properties in 2D Ruddlesden–Popper Perovskites Induced by Bifunctional Ligands

2D Ruddlesden–Popper metal‐halide perovskites exhibit structural diversity due to a variety of choices of organic ligands. Incorporating bifunctional ligands in such materials is particularly intriguing since it can result in novel electronic properties and functions. However, an in‐depth understanding of the effects of bifunctional ligands on perovskite structures and, consequently, their electronic and excitonic properties, is still lacking. Here, in this work, n = 1 2D perovskites built with organic ligands containing ─CN, ─OH, ─COOH, ─phenyl (Ph), and ─CH 3 functional groups are investigated using ultraviolet and inverse photoemission spectroscopies, density functional theory calculations, and tight‐binding model analyses. The experimentally determined electronic gaps of the ─CN, ─COOH, ─Ph, and ─CH 3 based perovskites exhibit a strong correlation with the in‐plane Pb─I─Pb bond angle, while the ─OH based perovskite deviates from the linear trend. Based on the band structure calculations, this anomaly is attributed to the out‐of‐plane dispersion, caused predominantly by significant interlayer electronic coupling that is present in ─OH based perovskites. These results highlight the complex and diverse impacts of organic ligands on electronic properties, especially in terms of the involvement of strong interlayer electronic coupling. The impact of the bifunctional ligands on the evolution of the exciton binding energy is also addressed.

2D perovskites↗

An adaptive Hessian approximated stochastic gradient MCMC method

Bayesian approaches have been successfully integrated into training deep neural networks. One popular family is stochastic gradient Markov chain Monte Carlo methods (SG-MCMC), which have gained increasing interest due to their ability to handle large datasets and the potential to avoid overfitting. Although standard SG-MCMC methods have shown great performance in a variety of problems, they may be inefficient when the random variables in the target posterior densities have scale differences or are highly correlated. Here, we present an adaptive Hessian approximated stochastic gradient MCMC method to incorporate local geometric information while sampling from the posterior. The idea is to apply stochastic approximation (SA) to sequentially update a preconditioning matrix at each iteration. The preconditioner possesses second-order information and can guide the random walk of a sampler efficiently. Instead of computing and saving the full Hessian of the log posterior, we use limited memory of the samples and their stochastic gradients to approximate the inverse Hessian-vector multiplication in the updating formula. Moreover, by smoothly optimizing the preconditioning matrix via SA, our proposed algorithm can asymptotically converge to the target distribution with a controllable bias under mild conditions. To reduce the training and testing computational burden, we adopt a magnitude-based weight pruning method to enforce the sparsity of the network. Our method is user-friendly and demonstrates better learning results compared to standard SG-MCMC updating rules. The approximation of inverse Hessian alleviates storage and computational complexities for large dimensional models. Numerical experiments are performed on several problems, including sampling from 2D correlated distribution, synthetic regression problems, and learning the numerical solutions of heterogeneous elliptic PDE. The numerical results demonstrate great improvement in both the convergence rate and accuracy.

97 MATHEMATICS AND COMPUTING↗

Multi-energy reconstructions, central electron temperature measurements, and early detection of the birth and growth of runaway electrons using a versatile soft x-ray pinhole camera at MST

A multi-energy soft x-ray pinhole camera has been designed, built, and deployed at the Madison Symmetric Torus to aid the study of particle and thermal transport, as well as MHD stability physics. This novel imaging diagnostic technique employs a pixelated x-ray detector in which the lower energy threshold for photon detection can be adjusted independently on each pixel. The detector of choice is a PILATUS3 100 K with a 450 μm thick silicon sensor and nearly 100 000 pixels sensitive to photon energies between 1.6 and 30 keV. An ensemble of cubic spline smoothing functions has been applied to the line-integrated data for each time-frame and energy-range, obtaining a reduced standard-deviation when compared to that dominated by photon-noise. The multi-energy local emissivity profiles are obtained from a 1D matrix-based Abel-inversion procedure. Central values of Te can be obtained by modeling the slope of the continuum radiation from ratios of the inverted radial emissivity profiles over multiple energy ranges with no a priori assumptions of plasma profiles, magnetic field reconstruction constraints, high-density limitations, or need of shot-to-shot reproducibility. In tokamak plasmas, a novel application has recently been tested for early detection, 1D imaging, and study of the birth, exponential growth, and saturation of runaway electrons at energies comparable to 100 × Te,0; thus, early results are also presented.

Delgado-Aparicio, L. F. (ORCID:0000000167394380)↗

Symmetry instability induced by topological phase transitions

The symmetry-topology interplay dictates how to define order parameters and classify material ordered phases. However, current understanding of this interplay has been predominately approached from a one-sided perspective, with topological states being classified within the constraints imposed by specific fixed symmetries. Here, in this study, we complete this full circle by demonstrating spontaneous symmetry breaking that results from a periodic alteration of topological phases induced by light in a centrosymmetric Dirac material ZrTe 5 . The distinguishing feature is the observation of robust correlation and striking anomalies in the fluence and temperature dependence of key transport parameters. First, both shift current 𝐽 𝑠 and displacement current 𝐽 𝑑 , arising from interband transition and infrared phonon driving, respectively, along with charge carrier pumping, exhibit similar behaviors. Second, they all peak at similar low pump fluence, followed by a subsequent reduction as the fluence further increases. This behavior cannot be explained by conventional energetically allowed, direct excitations. Third, all the three observables exhibit anomalies when they approach the topological phase transition temperature. These results highlight the unique low-energy pumping behaviors in ZrTe 5 , characterized by reversible fluence dependence and a “hinge-like” interaction that connects various electronic and lattice observables, including phonons, charge carriers, and currents. Our findings, supported by model analysis, provide key insights into the fragility of crystalline (inversion) and time-reversal symmetries during the dynamics of topological phase transitions. This fragility drives spontaneous symmetry breaking, evidenced by the synchronized emergence of off-resonant infrared phonons and broken-symmetry photocurrents.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

OASIS: Offsetting Active Reconstruction Attacks in Federated Learning

Federated Learning (FL) has garnered significant attention for its potential to protect user privacy while enhancing model training efficiency. For that reason, FL has found its use in various domains, from health care to industrial engineering, especially where data cannot be easily exchanged due to sensitive information or privacy laws. However, recent research has demonstrated that FL protocols can be easily compromised by active reconstruction attacks executed by dishonest servers. These attacks involve the malicious modification of global model parameters, allowing the server to obtain a verbatim copy of users' private data by inverting their gradient updates. Tackling this class of attack remains a crucial challenge due to the strong threat model. In this paper, we propose a defense mechanism, namely OASIS, based on image augmentation that effectively counteracts active reconstruction attacks while preserving model performance. We first uncover the core principle of gradient inversion that enables these attacks and theoretically identify the main conditions by which the defense can be robust regardless of the attack strategies. We then construct our defense with image augmentation showing that it can undermine the attack principle. Comprehensive evaluations demonstrate the efficacy of the defense mechanism highlighting its feasibility as a solution.

deep neural networks↗

Multi-Modal Bayesian Neural Network Surrogates with Conjugate Last-Layer Estimation

As data collection and simulation capabilities advance, multi-modal learning, the task of learning from multiple modalities and sources of data, is becoming an increasingly important area of research. Surrogate models that learn from data of multiple auxiliary modalities to support the modeling of a highly expensive quantity of interest have the potential to aid outer loop applications such as optimization, inverse problems, or sensitivity analyses when multi-modal data are available. We develop two multi-modal Bayesian neural network surrogate models and leverage conditionally conjugate distributions in the last layer to estimate model parameters using stochastic variational inference (SVI). We provide a method to perform this conjugate SVI estimation in the presence of partially missing observations. Here, we demonstrate improved prediction accuracy and uncertainty quantification compared to unimodal surrogate models for both scalar and time series data.

97 MATHEMATICS AND COMPUTING↗

Pragmatic Uncertainty Quantification and Propagation in Inverse Estimation of Structural Dynamics Parameters given Material Property Uncertainties and Limited Sensor Data

In this report we demonstrate some relatively simple and inexpensive methods to effectively account for various sources of epistemic lack-of-knowledge type uncertainty in inverse problems. The demonstration problem involves inverse estimation of six parameters of a bolted joint that attaches a kettlebell shaped object to a thick plate. The parameters are efficiently inverted in a modal-based model calibration using gradient-based optimization. Two material properties of the kettlebell are treated as uncertain to within given epistemic uncertainty bounds. We apply and test interval and sparse-sample probabilistic approaches to account for uncertainty in the estimated parameters (and various scalar functionals of the parameters as generic quantities of interest, QOIs) due to uncertainties in the material properties. We also investigate the error effects of limited numbers of vibration sensors (accelerometers) on the kettlebell and plate, and therefore abbreviated excitation/response information in the parameter inversions. We propose and demonstrate a Leave-K-Sensors-Out “cross-prediction” UQ approach to estimate related uncertainties on the parameters and QOI functionals. We indicate how uncertainties from material properties and limited sensors are treated in a combined manner. The economical combined UQ approach involves just three to five samples (i.e. three to five inverse simulations), with no added complication or error/uncertainty from use of surrogate models for affordability. Finally, we describe a related economical UQ approach for handling potential parameter solution non-uniqueness and numerical optimization related precision uncertainties in the estimated parameter values. Indicated further research is identified.

36 MATERIALS SCIENCE↗

Modeling nanoparticle charge distribution in the afterglow of non-thermal plasmas and comparison with measurements

Particle charging in the afterglows of non-thermal plasmas typically take place in a non-neutral space charge environment. We model the same by incorporating particle-ion collision rate constant models, developed in prior work by analyzing particle-ion trajectories calculated using Langevin Dynamics simulations, into species transport equations for ions, electrons and charged particles in the afterglow. A scaling analysis of particle charging and additional Langevin Dynamics calculations of the particle-ion collision rate constant are presented to extend the range of applicability to ion electrostatic to thermal energy ratios of 300 and diffusive Knudsen number (that scales inversely with gas pressure) up to 2000. The developed collision rate constant models are first validated by comparing predictions of particle charge against measured values in a stationary, non-thermal DC plasma from past PK-4 campaigns published in Phys. Rev. Lett. 93(8): 085001 and Phys. Rev. E 72(1): 016406). The comparisons reveal excellent agreement within ±35% for particles of radius 0.6,1.0,1.3 μm in the gas pressure range of ~20-150 Pa. The experiments to probe particle charge distributions by Sharma et al. (J. Physics D: Appl. Phys. 53(24): 245204) are modeled using the validated particle-ion collision rate constant models and the calculated charge fractions are compared with measurements. The comparisons reveal that the ion/electron concentration and gas temperature in the afterglow critically influence the particle charge and the predictions are generally in qualitative agreement with the measurements. Along with critical assessment of the modeling assumptions, several recommendations are presented for future experimental design to probe charging in afterglows.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Inverse design for waveguide dispersion with a differentiable mode solver

Inverse design of optical components based on adjoint sensitivity analysis has the potential to address the most challenging photonic engineering problems. However, existing inverse design tools based on finite-difference-time-domain (FDTD) models are poorly suited for optimizing waveguide modes for adiabatic transformation or perturbative coupling, which lies at the heart of many important photonic devices. Among these, dispersion engineering of optical waveguides is especially challenging in ultrafast and nonlinear optical applications involving broad optical bandwidths and frequency-dependent anisotropic dielectric material response. In this work, we develop gradient back-propagation through a general-purpose electromagnetic eigenmode solver and use it to demonstrate waveguide dispersion optimization for second harmonic generation with maximized phase-matching bandwidth. This optimization of three design parameters converges in eight steps, reducing the computational cost of optimization by ∼100x compared to exhaustive search and identifying new designs for broadband optical frequency doubling of laser sources in the 1.3–1.4 µm wavelength range. Furthermore, we demonstrate that the computational cost of gradient back-propagation is independent of the number of parameters, as required for optimization of complex geometries. This technique enables practical inverse design for a broad range of previously intractable photonic devices.

Gray, Dodd (ORCID:000000030469599X)↗

A scalable variational method for estimating the latent infection-rate field of an outbreak

In this paper, we explore whether the infection-rate of a disease can serve as a robust monitoring variable in epidemiological surveillance algorithms. The infection-rate is dependent on population mixing patterns that do not vary erratically day-to-day; in contrast, daily case-counts used in contemporary surveillance algorithms are corrupted by reporting errors. The technical challenge lies in estimating the latent infection-rate from case-counts. Here we devise a Bayesian method to estimate the infection-rate across multiple adjoining areal units, and then use it, via an anomaly detector, to discern a change in epidemiological dynamics. We extend an existing model for estimating the infection-rate in an areal unit by incorporating a Markov random field model, so that we may estimate infection-rates across multiple areal units, while preserving spatial correlations observed in the epidemiological dynamics. To carry out the high-dimensional Bayesian inverse problem, we develop an implementation of mean-field variational inference specific to the infection model and integrate it with the random field model to incorporate correlations across counties. The method is tested on estimating the COVID-19 infection-rates across all 33 counties in New Mexico using data from the summer of 2020, and then employing them to detect the arrival of the Fall 2020 COVID-19 wave. We perform the detection using a temporal algorithm that is applied county-by-county. We also show how the infection-rate field can be used to cluster counties with similar epidemiological dynamics.

60 APPLIED LIFE SCIENCES↗

Evaluation of top-down and bottom-up global terrestrial respiration estimates and their mismatch with model simulations

Terrestrial respiration is one of the most poorly understood processes in the global carbon cycle, making respiration predictions uncertain. However, expanding observations and machine learning approaches have led to a proliferation of estimates. We compiled total ecosystem and heterotrophic respiration estimates derived from top-down atmospheric inversions and bottom-up upscaling of ecosystem observations and compared them with dynamic vegetation models (DGVM) simulations over the 1980-2020 period. Our analysis revealed a convergence in mean annual global total ecosystem respiration estimates between top-down 97.1 (± SD 6.8) PgC yr-1 and bottom-up 98.5 (+/-13.4) PgC yr-1, which were both significantly lower than the ensemble mean from DGVMs estimates 133.7 (±4.7) PgC yr-1. We also found similar temporal trends between top-down estimates with a mean of 0.075 (±0.05) PgC yr-2, and bottom-up estimates of 0.05 (±0.05) PgC yr-2, which were 5 to 7 times smaller than the ensemble mean trend of 0.34 PgC yr-2 simulated by DGVMs. Global heterotrophic respiration showed much less agreement, ranging from top-down estimates of 42.7 (±4.0) PgC yr-1 to bottom-up estimates of 51.5 (±4.0) PgC yr-1 and a significantly larger ensemble model mean estimate of 60.8 PgC yr-1 (±1.9). The temporal trends in observation-based bottom-up estimates of heterotrophic respiration of 0.03 PgC yr-2 were five times lower than the model ensemble mean 0.15 PgC yr-2. Large regional disagreements in heterotrophic respiration estimates and simulations were evident in tropical and boreal latitudes. Therefore, improved regional and heterotrophic respiration estimates are necessary to reduce uncertainties regarding the future vulnerability of soil carbon.

Ballantyne, Ashley↗

Overview of IMPACT Data Acquisition System and Data Reduction Process

This report documents the development of the data acquisition system (DAS) and data reduction methodologies for the Irradiated Material Property Accelerated Characterization Test (IMPACT) experiment at the Advanced Test Reactor (ATR). The IMPACT experiment is designed to enable in-pile measurement of thermal conductivity in metallic nuclear fuels, specifically U-10Zr, using an instrumented thermal conductivity probe. The DAS supports both passive temperature monitoring and active thermal interrogation of the probe through controlled AC and DC excitation. Significant modifications to laboratory-scale systems were required to accommodate the higher resistance paths associated with the in-pile application. Custom electronics and relay-controlled measurement sequencing were developed to enable the measurement and sufficient power delivery to the sensing region. A reduced-order, axisymmetric thermal model based on the thermal quadrupoles method is presented to support data interpretation. This model enables efficient evaluation of transient heat transfer behavior and facilitates solution of the inverse problem required to extract thermal properties from measured signals. Multiple boundary condition formulations are discussed to address varying experimental time scales and geometries. Additionally, machine learning techniques are introduced to support data reduction and improve confidence in inverse solutions. Convolutional neural networks are applied to identify the presence of gas gaps and other evolving geometric features that significantly impact thermal response during irradiation. These efforts contribute to the broader integration of digital twin frameworks and real-time modeling capabilities within the Advanced Fuels Campaign.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Physics-informed machine learning of the correlation functions in bulk fluids

The Ornstein–Zernike (OZ) equation is the fundamental equation for pair correlation function computations in the modern integral equation theory for liquids. In this work, machine learning models, notably physics-informed neural networks and physics-informed neural operator networks, are explored to solve the OZ equation. The physics-informed machine learning models demonstrate great accuracy and high efficiency in solving the forward and inverse OZ problems of various bulk fluids. The results highlight the significant potential of physics-informed machine learning for applications in thermodynamic state theory.

97 MATHEMATICS AND COMPUTING↗

Evaluation of a preliminary regional Earth model through comparison of synthetic and observed waveform data

In this report, we document the process related to developing a regional geologic model of a 605 x 1334 km area centered around Utah and encompassing surrounding states. This model is developed to test the effect that composition of a model has on the generation of synthetic data with the intent of using this information to improve upon full waveform moment tensor inversions. We compare observed data from three seismic events and five stations to the synthetic data generated by a preliminary model derived from a geologic framework model (GFM) developed by the USGS. The synthetic data and observed data comparisons indicate that our preliminary model performs well at smaller offset distances in the northern and central sections of the model. However, the southern stations consistently display synthetic data P- and S-wave arrival times that do not match the observed data arrival times, indicating that the velocity structure of the southern part of the model especially is inaccurate.

58 GEOSCIENCES↗