Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “variational Monte Carlo”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Bayesian Spatially Varying Multi-Regularization Image Deblurring

Many scientific experiments such as those found in astronomy, geology, microbiology, and X-ray radiography require the use of high-energy instruments to capture images. Since blur and noise are inevitably present in any imaging system, the images must be \deblurred" to extract the full information content. Mathematically, image deblurring is an ill-posed inverse problem that requires regularization. The regularization, in turn, has a large effect on the deblurred image: different regularization strengths, and types, lead to drastically different reconstructions. Moreover, many images contain a mixture of smooth and sharp features which suggests the use of multi-regularization, i.e., varying the type of regularization (e.g. Tikhonov or total variation) across the image. We address these issues by formulating the image deblurring problem within a hierarchical Bayesian framework in which we spatially adapt the strength of the regularization and also vary the regularization type across the image. In this way, the image itself, along with corresponding regularization strength at each pixel, are described jointly by a posterior distribution which we can sample by Markov chain Monte Carlo (MCMC) methods. We illustrate our techniques on simplified test problems and apply them to high-energy X-ray images taken at the Nevada National Security Site. Numerical tests show that our new method is robustly applicable and increases the quality of the image reconstruction when compared to other (Bayesian) methods.

97 MATHEMATICS AND COMPUTING↗

Taylor approximation variance reduction for approximation errors in PDE-constrained Bayesian inverse problems

In numerous applications, surrogate models are used as a replacement for accurate parameter-to-observable mappings when solving large-scale inverse problems governed by partial differential equations (PDEs). The surrogate model may be a computationally cheaper alternative to the accurate parameter-to-observable mappings and/or may ignore additional unknowns or sources of uncertainty. The Bayesian approximation error (BAE) approach provides a means to account for the induced uncertainties and approximation errors, i.e. the errors between the accurate parameter-to-observable mapping and the surrogate. The statistics of these errors are, however, in general unknown a priori, and are thus calculated using Monte Carlo sampling. Although the sampling is typically carried out offline, i.e. before considering the data, the process can still represent a computational bottleneck. In this work, we develop a scalable computational approach for reducing the costs associated with the sampling stage of the BAE approach. Specifically, we consider the Taylor expansion of the accurate and surrogate forward models with respect to the uncertain parameter fields either as a control variate for variance reduction or as a means to directly and efficiently approximate the mean and covariance of the approximation errors. We propose efficient methods for evaluating the expressions for the mean and covariance of the Taylor approximations based on linear(-ized) PDE solves. Furthermore, the proposed approach is independent of the dimension of the uncertain parameter, depending instead on the intrinsic dimension of the data, ensuring scalability to high-dimensional problems. The potential benefits of the proposed approach are demonstrated for two high-dimensional inverse problems governed by PDE examples, namely for the estimation of a distributed Robin boundary coefficient in a linear diffusion problem, and for a coefficient estimation problem governed by a nonlinear diffusion problem.

Bayesian approximation error↗

Accelerated coupled Monte Carlo-Thermal hydraulic calculations using a hybrid GTF-diffusion-based prediction block: first results

Accurate predictions of spatial power and temperature distributions require the coupling of a neutron transport solver with a thermal-hydraulic (TH) feedback. Nowadays, Monte Carlo (MC) codes are widely coupled to TH solvers, typically via a Picard iteration (PI) method, due to the higher fidelity that such frameworks can produce. To speed up a PI, a prediction step can produce an improved initial guess for a source distribution and feed it to the MC code. Recent work investigated a prediction step that uses generalized transfer functions (GTFs) to predict the macroscopic cross sections' variations following a perturbation in TH properties, such as coolant density. The previous method also relied on first order perturbation (FOP) theory to predict perturbed power profiles, rather than using an expensive MC iterate. The implemented FOP method relied on generating a fission matrix from which the forward and adjoint Eigenmodes were extracted and later used to for power calculations. The generation of the fission matrix can introduce a significant computational overhead, therefore undermining the performance of the proposed hybrid technique when applied to high-dimensional problems, e.g., full core calculations. This work attempts to improve the GTF-FOP prediction step by replacing the FOP solver with a nodal diffusion solver, thus eliminating the need to calculate a fission matrix. The GTF-diffusion step was tested for various moderator density perturbations. In each case, the predicted power distribution showed good agreement with the reference case. The latter is attributed to the generally good prediction of most spatially distributed macroscopic cross sections, except the transport cross section, which will become the focus of future work. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Quantitative Biostratigraphic Analysis and Age Estimates of Middle Cretaceous Sequences in The Baltimore Canyon Trough, Offshore Mid-Atlantic U.S. Margin

ABSTRACT We applied quantitative methods to previously published biostratigraphic data from the Baltimore Canyon Trough (offshore of the Mid-Atlantic U.S.A.) to provide an improved chronostratigraphic framework for Cretaceous sequences. Here, we successfully used graphic correlation of 228 planktonic foraminifera, nannofossil, and palynological events spanning 22 wells to define assemblage and interval zones as well as major paleoenvironmental changes in the Dawson Canyon, Logan Canyon (three sequences), and Missisauga Formations (two sequences, undifferentiated here). Ranking and scaling techniques were not successful because of the of the limited number of usable biostratigraphic markers. The ages of the sequences previously identified using well logs and seismic profiles were temporally constrained based on chronostratigraphically significant biostratigraphic markers that we identified: the late Cenomanian to Turonian DCx sequence (Rotalipora cushmani and Thalmanninella greenhornensis); the early Cenomanian LC1 sequence; the middle and late Albian LC2 sequence (Braarudosphaera africana, Planomalina buxtorfi, and Spinidinium vestitum); the late Aptian LC3 sequence (Cyclonephelium tabulatum); and the early Aptian to Barremian Missisauga sequences (Aptea anaphrissa, Pseudoceratium pelliferum, and Muderongia simplex). These five biostratigraphic associations are correlated with six prominent seismic reflectors and sequence boundaries that can be traced across the basin. Duration of hiatuses associated with these sequence boundaries are uncertain, though our Monte Carlo analysis allows extraction of age estimates from broad and sometimes contradictory ranges and suggests correlation of hiatuses with global sea-level falls. Together, these seismic and biostratigraphic interpretations can be applied (1) to evaluate reservoir continuity and the viability of offshore carbon storage reservoirs in the Baltimore Canyon Trough, (2) to better define the tectonostratigraphic evolution of the basin, and (3) to contribute to the understanding of regional and global variations in Cretaceous sea level.

Paleontology↗

Learning the ground state of a non-stoquastic quantum Hamiltonian in a rugged neural network landscape

Strongly interacting quantum systems described by non-stoquastic Hamiltonians exhibit rich low-temperature physics. Yet, their study poses a formidable challenge, even for state-of-the-art numerical techniques. Here, we investigate systematically the performance of a class of universal variational wave-functions based on artificial neural networks, by considering the frustrated spin- 1/2 1 / 2 J_1-J_2 J 1 − J 2 Heisenberg model on the square lattice. Focusing on neural network architectures without physics-informed input, we argue in favor of using an ansatz consisting of two decoupled real-valued networks, one for the amplitude and the other for the phase of the variational wavefunction. By introducing concrete mitigation strategies against inherent numerical instabilities in the stochastic reconfiguration algorithm we obtain a variational energy comparable to that reported recently with neural networks that incorporate knowledge about the physical system. Through a detailed analysis of the individual components of the algorithm, we conclude that the rugged nature of the energy landscape constitutes the major obstacle in finding a satisfactory approximation to the ground state wavefunction, and prevents learning the correct sign structure. In particular, we show that in the present setup the neural network expressivity and Monte Carlo sampling are not primary limiting factors.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Ca-isotopes as a robust tracer of magmatic differentiation

The large mass difference (~10%) between the two most abundant isotopes of calcium, 40 Ca and 44 Ca, gives Ca great potential in tracking mass-dependent fractionation during magmatic processes. Resolvable Ca-isotope fractionation during fractional crystallization of magma, particularly by feldspar in evolved melts, has been theoretically inferred but not robustly tested in nature. To further explore the effects of magmatic differentiation on Ca-isotope systematics, we studied the late-Permian alkaline igneous suite of the Øyangen Caldera, Oslo Rift, Norway, consisting of volcanic and intrusive units ranging from basanitic to rhyolitic compositions. Major and trace element variations and modeling demonstrate that the main series of samples (N = 21), including basanites, ring-dyke syenites, and central-dome syenites, likely documents a co-genetic and closed-system fractional crystallization sequence. Our data show minimal δ 44/40 Ca variation (< 0.05 ‰) in the intermediate magma and a marked increase in δ 44/40 Ca in the felsic magma of the Øyangen Caldera (from 0.62 ± 0.02 ‰ to 1.15 ± 0.03 ‰ relative to Ca standard, SRM915a). The systematic increase is best explained by equilibrium isotopic fractionation dominated by alkali feldspar in the fractionating mineral assemblage. This is further supported by strong correlations between δ 44/40 Ca, CaO, and Eu/Eu* in the main-series samples. Implementing a Monte Carlo approach, isotopic modeling of the liquid line of descent using Rayleigh fractionation is highly consistent with the observed Ca-isotope evolution. For the first time, we confirm prominent Ca stable isotope fractionation in felsic-stage differentiation of alkaline magma and constrain the isotope fractionation factors of plagioclase and K-feldspar. Integrated with extant estimations on mineral fractionation factors from the literature, our results suggest increasing fractionation effects of rock-forming minerals with decreasing Ca content. Finally, the affirmation of significant Ca-isotope fractionation in alkaline magma by feldspar empowers the application of Ca as a versatile tracer of crustal evolution, allowing further tests in other magmatic conditions across various planetary objects.

58 GEOSCIENCES↗

Sensor Distortion Effects in Photon Monte Carlo Simulations

We present a detailed method to simulating sensor distortions using a photon and electron Monte Carlo method. We use three-dimensional electrostatic simulations to parameterize the perturbed electric field profile for nonideal sensor details. We follow the conversion of simulated photons, and the subsequent response of the converted electrons to the electric field pattern. These nonideal sensor details can be implemented efficiently in a Monte Carlo approach. We demonstrate that the nonideal sensor distortions have a variety of observable consequence including the modification of the astrometric pattern; the distortion of the electron diffusion size and shape; and the distortion of flats. We show analytic validation of the diffusion physics, reproduce two kinds of edge distortion, and show qualitative validation of field-free regions, lithography errors, and fringing. We also demonstrate that there are two related effects of doping variation having different observable consequences. We show that field distortions from accumulated electrons lead to intensity-dependent point-spread functions and the sublinear variance in flats. The method is implemented in the Photon Simulator and the code is publicly available.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Joint Modeling of Wind Speed and Wind Direction Through a Conditional Approach

Atmospheric near surface wind speed and wind direction play an important role in many applications, ranging from air quality modeling, building design, wind turbine placement to climate change research. It is therefore crucial to accurately estimate the joint probability distribution of wind speed and direction. In this work, we develop a conditional approach to model these two variables, where the joint distribution is decomposed into the product of the marginal distribution of wind direction and the conditional distribution of wind speed given wind direction. To accommodate the circular nature of wind direction, a von Mises mixture model is used; the conditional wind speed distribution is modeled as a directional dependent Weibull distribution via a two-stage estimation procedure, consisting of a directional binned Weibull parameter estimation, followed by a harmonic regression to estimate the dependence of the Weibull parameters on wind direction. A Monte Carlo simulation study indicates that our method outperforms two other approaches in estimation efficiency: one that utilizes periodic spline quantile regression and another that generates data from the commonly used Abe-Ley distribution for cylindrical data. We illustrate our method by using the output from a regional climate model to investigate how the joint distribution of wind speed and direction may change under some future climate scenarios. Our method indicates significant changes in the variation of wind speed with respect to some directions.

17 WIND ENERGY↗

Studies of Localization Effects on Transverse Kinematic Imbalance in the GENIE Generator

The forthcoming Deep Underground Neutrino Experiment (DUNE) requires precise modeling of neutrino--nucleus interactions to achieve its neutrino-oscillation measurement goals. GENIE, the Monte Carlo event generator used by DUNE and other Fermilab-based experiments as a central value model for neutrino-nucleus cross sections, exhibits known discrepancies in comparison to MicroBooNE cross section data, especially when considering neutrino scattering events' transverse kinematic imbalance (TKI). For quasielastic-like measurements, the data show a larger transverse missing momentum tail while maintaining a peak similar to that predicted by the baseline GENIE model. Previous attempts at a solution include variations of final-state interaction (FSI) strengths, incorrectly decreasing both the peak and tail, thus leaving the discrepancy unresolved. This work investigates whether inconsistencies between local and global treatments of intranuclear physics contribute to the observed mismodeling. In this work, GENIE FSI routines have been modified to directly utilize intranuclear particle positions, thereby introducing a newly localized momentum treatment in correlation with the nominal density in both the hA and hN intranuclear cascade models for their 2018 and 2025 variants. Meson-exchange-current (MEC) localization was also tested for the hN 2018 model. Comparisons of the intranuclear nucleons' ("scattering center") momentum and its radial dependence validate the localization implementation. However, while such consistent localization produces modest changes in the proton momentum spectrum at low-to-medium momenta, only small changes are observed in the TKI distributions. These changes are insufficient to account for the discrepancy with MicroBooNE data. Although a localized treatment improves the internal consistency of the GENIE model, the origin of the TKI discrepancy remains unresolved by such a solution.

Bulla, Braden [Ctr. Coll., Danville; Fermilab]↗

Observation of Cosmic-Ray Anisotropy in the Southern Hemisphere with 12 yr of Data Collected by the IceCube Neutrino Observatory

We analyzed the 7.92 × 10 11 cosmic-ray-induced muon events collected by the IceCube Neutrino Observatory from 2011 May 13, when the fully constructed experiment started to take data, to 2023 May 12. This data set provides an up-to-date cosmic-ray arrival direction distribution in the Southern Hemisphere with unprecedented statistical accuracy covering more than a full period length of a solar cycle. Improvements in Monte Carlo event simulation and better handling of year-to-year differences in data processing significantly reduce systematic uncertainties below the level of statistical fluctuations compared to the previously published results. We confirm the observation of a change in the angular structure of the cosmic-ray anisotropy between 10 TeV and 1 PeV, more specifically in the 100–300 TeV energy range. For the first time, we analyzed the angular power spectrum at different energies. The observed variations of the power spectra with energy suggest relatively reduced large-scale features at high energy compared to those of medium and small scales. The large volume of data enhances the statistical significance at higher energies, up to the PeV scale, and smaller angular scales, down to approximately 6° compared to previous findings.

79 ASTRONOMY AND ASTROPHYSICS↗

VarIabiLity seLection of AstrophysIcal sources iN PTF (VILLAIN): I. Structure function fits to 71 million objects

Light-curve variability is well-suited to characterizing objects in surveys with high cadence and a long baseline. This is especially relevant in view of the large datasets to be produced by the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). We aim to determine variability parameters for objects in the Palomar Transient Factory (PTF) and explore differences between quasars (QSOs), stars, and galaxies. We relate variability and colour information in preparation for future surveys. We fit joint likelihoods to structure functions (SFs) of 71 million PTF light curves with a Markov chain Monte Carlo method. For each object, we assume a power-law SF and extract two parameters: the amplitude on timescales of one year, A, and a power-law index, γ. With these parameters and colours in the optical (Pan-STARRS1) and mid-infrared (WISE), we identify regions of parameter space dominated by different types of spectroscopically confirmed objects from SDSS. Candidate QSOs, stars, and galaxies are selected to show their parameter distributions. QSOs show high-amplitude variations in the R band, and the highest γ values. Galaxies have a broader range of amplitudes and their variability shows relatively little dependency on timescale. With variability and colours, we achieve a photometric selection purity of 99.3% for QSOs. Even though hard cuts in monochromatic variability alone are not as effective as seven-band magnitude cuts, variability is useful in characterizing object subclasses. Through variability, we also find QSOs that were erroneously classified as stars in the SDSS. We discuss perspectives and computational solutions in view of the upcoming LSST.

79 ASTRONOMY AND ASTROPHYSICS↗

Beam-induced backgrounds measured in the ATLAS detector during local gas injection into the LHC beam vacuum

Inelastic beam-gas collisions at the Large Hadron Collider (LHC), within a few hundred metres of the ATLAS experiment, are known to give the dominant contribution to beam backgrounds. These are monitored by ATLAS with a dedicated Beam Conditions Monitor (BCM) and with the rate of fake jets in the calorimeters. These two methods are complementary since the BCM probes backgrounds just around the beam pipe while fake jets are observed at radii of up to several metres. In order to quantify the correlation between the residual gas density in the LHC beam vacuum and the experimental backgrounds recorded by ATLAS, several dedicated tests were performed during LHC Run 2. Local pressure bumps, with a gas density several orders of magnitude higher than during normal operation, were introduced at different locations. The changes of beam-related backgrounds, seen in ATLAS, are correlated with the local pressure variation. In addition the rates of beam-gas events are estimated from the pressure measurements and pressure bump profiles obtained from calculations. Using these rates, the efficiency of the ATLAS beam background monitors to detect beam-gas events is derived as a function of distance from the interaction point. These efficiencies and characteristic distributions of fake jets from the beam backgrounds are found to be in good agreement with results of beam-gas simulations performed with theFluka Monte Carlo programme.

43 PARTICLE ACCELERATORS↗

Influence of temporal variations in plasma conditions on the electric potential near self-organized dust chains

Self-organization of dust grains into stable filamentary dust structures (or “chains”) largely depends on dynamic interactions between individual charged dust grains and complex electric potential arising from the distribution of charges within a local plasma environment. Recent studies have shown that the positive column of the gas discharge plasma in the Plasmakristall-4 (PK-4) experiment at the International Space Station supports the presence of fast-moving ionization waves, which lead to variations of plasma parameters by up to an order of magnitude from the average background values. The highly variable environment resulting from ionization waves may have interesting implications for the dynamics and self-organization of dust particles, particularly concerning the formation and stability of dust chains. Here, we investigate the electric potential surrounding dust chains in the PK-4 experiment by employing a molecular dynamics model of the dust and ions with boundary conditions supplied by a particle-in-cell with Monte Carlo collision simulation of the ionization waves. The model is used to examine the effects of the plasma conditions within different regions of the ionization wave and compare the resulting dust structure to that obtained by employing the time-averaged plasma conditions. Here, the comparison between simulated dust chains and experimental data from the PK-4 experiment shows that the time-averaged plasma conditions do not accurately reproduce observed results for dust behavior, indicating that more careful treatment of plasma conditions in the presence of ionization waves is required. It is further shown that commonly used analytic forms of the electric potential do not accurately describe the electric potential near charged dust grains under these plasma conditions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

On the Interplay of Electronic and Lattice Screening on Exciton Binding in Two-Dimensional Lead Halide Perovskites

We use path integral Monte Carlo to study the energetics of excitons in layered, hybrid organic–inorganic perovskites in order to elucidate the relative contributions of dielectric confinement and electron–phonon coupling. While the dielectric mismatch between polar perovskite layers and nonpolar ligand layers significantly increases the exciton binding energy relative to their three-dimensional bulk crystal counterparts, formation of exciton polarons attenuates this effect. The contribution from polaron formation is found to be a nonmonotonic function of the lead halide layer thickness, which is clarified by a general variational theory. Accounting for both of these effects provides a description of exciton binding energies in good agreement with experimental measurements. By studying isolated layers and stacked layered crystals of various thicknesses, with ligands of varying polarity, we provide a systematic understanding of the excitonic behavior of this class of materials and how to engineer their photophysics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Role of electron correlation on the adenine dimer interaction for non-equilibrium geometries: a benchmark Quantum Monte Carlo study

The accurate description of non-covalent interactions is critical for understanding the structure, dynamics, and eventual function of biomolecules. The adenine dimer serves as a benchmark system for computational methods due to its role in nucleic acid structures and its rich conformational landscape. In this study, we employ benchmark diffusion quantum Monte Carlo (DMC) methods to investigate the relative energies and role of electron correlation on a set of adenine dimer conformations generated via a search of the potential energy landscape using the global optimizer algorithm. Relative DMC energies are compared against a wide range of density functional theory (DFT) approximation results. We find that although most of the DFT functionals perform well for low-energy structures, their accuracy varies significantly for higher-energy conformations, including stacked and T-shaped structures. A large fraction of the variation is due to the treatment of the van der Waals interaction. BLYP, B3LYP, and PBE0 significantly improve with added D4 dispersion, while the recent r2SCAN-D4 and ωB97M-V functionals show the least scatter and closest agreement with the DMC. These findings highlight the delicate nature of these interactions in biomolecular systems and provide guidance for simulations of their structure and dynamics and for the development of machine learned interatomic potentials.

Washburn, Laurel [ORNL] (ORCID:0000000324179335)↗

A Fundamental Economic Assessment of Recovering Rare Earth Elements and Critical Minerals from Acid Mine Drainage Using a Network Sourcing Strategy

In recent years, acid mine drainage (AMD) has emerged as a promising unconventional source of rare earth elements (REEs) and other critical minerals (CMs) such as cobalt and manganese. In this regard, AMD provides a natural heap leaching effect that extracts and concentrates REE/CM from the host strata creating a partially enriched feedstock suitable for downstream extraction, separation, and recovery. While several prior studies have described processes and approaches for the valorization of AMD, very few have described the supply chain and infrastructure requirements as well as the associated economic assessment. To that end, this paper provides a fundamental economic assessment of REE/CM recovery from AMD using a network sourcing strategy in addition to a robust, flexible feedstock separations and refining facility. The methodology of this paper follows that of a typical techno-economic analysis with capital and operating costs estimated using AACE Class IV (FEL-2) guidelines. To demonstrate the range of possible outcomes, four pricing scenarios were modeled including contemporary prices (September, 2021) as well as the minimum and maximum prices over the last decade. In addition, five production scenarios were considered reflecting variations in the product suite, ranging from full elemental separation to magnet REE and CM production only (i.e., Pr, Nd, Tb, Dy, Y, Sc, Co, and Mn). The results of this analysis show that, with the exception of the minimum price scenario, all operational configurations have positive economic indicators with rates of return varying from 25% to 32% for the contemporary price scenario. The optimal configuration was determined to be production of Co, Mn, and all REEs except for mischmetal, which is not recovered. Sensitivity analysis and Monte Carlo simulation show that capital cost and HCl consumption are the two major factors influencing rate of return, thus indicating opportunities for future technology development and cost optimization. Implications of the study and a cooperative profit-sharing model for sourcing are also described.

42 ENGINEERING↗

Starting-point-independent quantum Monte Carlo calculations of iron oxide

Quantum Monte Carlo (QMC) methods are useful for studies of strongly correlated materials because they are many body in nature and use the physical Hamiltonian. Typical calculations assume as a starting point a wave function constructed from single-particle orbitals obtained from one-body methods, e.g., density functional theory. However, mean-field-derived wave functions can sometimes lead to systematic QMC biases if the mean-field result poorly describes the true ground state. In this study, we examine the accuracy and flexibility of QMC trial wave functions using variational and fixed-node diffusion QMC estimates of the total spin density and lattice distortion of antiferromagnetic iron oxide (FeO) in the ground state B1 crystal structure. We found that for relatively simple wave functions the predicted lattice distortion was controlled by the choice of single-particle orbitals used to construct the wave function, rather than by subsequent wave function optimization techniques within QMC. By optimizing the orbitals with QMC, we then demonstrate starting-point independence of the trial wave function with respect to the method by which the orbitals were constructed by demonstrating convergence of the energy, spin density, and predicted lattice distortion for two qualitatively different sets of orbitals. The results suggest that orbital optimization is a promising method for accurate many-body calculations of strongly correlated condensed phases.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Diffusion-Model-Assisted Supervised Learning of Generative Models for Density Estimation

Here, we present a supervised learning framework of training generative models for density estimation. Generative models, including generative adversarial networks (GANs), normalizing flows, and variational auto-encoders (VAEs), are usually considered as unsupervised learning models, because labeled data are usually unavailable for training. Despite the success of the generative models, there are several issues with the unsupervised training, e.g., requirement of reversible architectures, vanishing gradients, and training instability. To enable supervised learning in generative models, we utilize the score-based diffusion model to generate labeled data. Unlike existing diffusion models that train neural networks to learn the score function, we develop a training-free score estimation method. This approach uses mini-batch-based Monte Carlo estimators to directly approximate the score function at any spatial-temporal location in solving an ordinary differential equation (ODE), corresponding to the reverse-time stochastic differential equation (SDE). This approach can offer both high accuracy and substantial time savings in neural network training. Once the labeled data are generated, we can train a simple, fully connected neural network to learn the generative model in the supervised manner. Compared with existing normalizing flow models, our method does not require the use of reversible neural networks and avoids the computation of the Jacobian matrix. Compared with existing diffusion models, our method does not need to solve the reverse-time SDE to generate new samples. As a result, the sampling efficiency is significantly improved. We demonstrate the performance of our method by applying it to a set of 2D datasets as well as real data from the University of California Irvine (UCI) repository.

97 MATHEMATICS AND COMPUTING↗