Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “reversible computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

SQUARE: Strategic Quantum Ancilla Reuse for Modular Quantum Programs via Cost-Effective Uncomputation

Compiling high-level quantum programs to machines that are size constrained (i.e. limited number of quantum bits) and time constrained (i.e. limited number of quantum operations) is challenging. In this paper, we present SQUARE (Strategic QUantum Ancilla REuse), a compilation infrastructure that tackles allocation and reclamation of scratch qubits (called ancilla) in modular quantum programs. At its core, SQUARE strategically performs uncomputation to create opportunities for qubit reuse. Current Noisy Intermediate-Scale Quantum (NISQ) computers and forward-looking Fault-Tolerant (FT) quantum computers have fundamentally different constraints such as data locality, instruction parallelism, and communication overhead. Our heuristic-based ancilla-reuse algorithm balances these considerations and fits computations into resource-constrained NISQ or FT quantum machines, throttling parallelism when necessary. To precisely capture the workload of a program, we propose an improved metric, the "active quantum volume," and use this metric to evaluate the effectiveness of our algorithm. Furthermore, our results show that SQUARE improves the average success rate of NISQ applications by 1.47X. Surprisingly, the additional gates for uncomputation create ancilla with better locality, and result in substantially fewer swap gates and less gate noise overall. SQUARE also achieves an average reduction of 1.5X (and up to 9.6X) in active quantum volume for FT machines.

compiler optimization↗

Two Circuits for Directing and Controlling Ballistic Fluxons

Reversible logic schemes using flux solitons (fluxons) on long Josephson junctions (LJJs) have recently been proposed. The attraction of the fluxon is that it propagates ballistically along an LJJ until it encounters a change in the character of the LJJ, often a designed circuit element. Logic gates involve fluxons interacting with circuit elements and with other fluxons. However, testing of ballistic fluxon circuits requires other circuits outside the logic family to direct and control fluxon motion. Here we discuss two such non-reversible fluxon control circuits. First, the polarity filter gate is a simple non-reversible gate that allows one polarity of fluxon to pass, while reflecting the other polarity. In the off state both polarities reflect. Second, the polarity separator generalizes on the polarity filter concept and allows separation of the two fluxon polarities into different LJJs. We discuss simulations of these structures and possible applications.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Qubit Assignment Using Time Reversal

As quantum computers with large numbers of qubits become increasingly available, experiments executed on a given device may not utilize all available qubits. In this case, the outcome of executing a quantum program will depend on the ability to efficiently select a subset of high-performing physical qubits. For any given quantum program and device there are many ways to assign physical qubits for execution of the program, and assignments will differ in performance due to the variability in quality across qubits and entangling operations on a single device. Evaluating the performance of each assignment using fidelity estimation introduces significant experimental overhead and will be infeasible for many applications, while relying on standard device benchmarks provides incomplete information about the performance of any specific program. Furthermore, the number of possible assignments grows combinatorially in the number of qubits on the device and in the program, motivating the use of heuristic optimization techniques. We demonstrate a practical solution to the problem of qubit assignment by using simulated annealing with a cost function based on the Loschmidt echo, a diagnostic that measures the reversibility of a quantum process. We provide theoretical justification for this choice of cost function by demonstrating that the optimal qubit assignment coincides with the optimal qubit assignment based on state fidelity in the weak error limit, and we provide experimental justification using diagnostics performed on Google’s superconducting qubit devices. We then establish the performance of simulated annealing for qubit assignment using classical simulations of noisy devices as well as optimization experiments performed on a quantum processor. Our results demonstrate that the use of Loschmidt echoes and simulated annealing provides a scalable and flexible approach to optimizing qubit assignment on near-term hardware.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Generative Thermodynamic Computing

Here, we introduce a generative modeling framework for thermodynamic computing, in which structured data are synthesized from noise by the natural time evolution of a physical system governed by Langevin dynamics. While conventional diffusion models use neural networks to perform denoising, here the information needed to generate structure from noise is encoded by the dynamics of a thermodynamic system. Training proceeds by maximizing the probability with which the computer generates the reverse of a noising trajectory, which ensures that the computer generates data with minimal heat emission. We demonstrate this framework within a digital simulation of a thermodynamic computer. If realized in analog hardware, such a system would function as a generative model that produces structured samples without the need for artificially injected noise or active control of denoising.

Whitelam, Stephen [Lawrence Berkeley National Labo↗

Reversing inverse Hall-Petch and direct computation of Hall-Petch coefficients

A 2D bicrystal atomistic model of dislocation transmission through a Σ11<101>{131} symmetric-tilt grain boundary reveals details of Hall-Petch breakdown in the single dislocation regime in Al, Ni, and Cu. Partly based on a previous study, this research determines the stress required for a single dislocation to be transmitted through the Σ11 boundary and finds that single dislocation transmission typically deviates from Hall-Petch behavior because the leading partial dislocation becomes trapped in the boundary and emits glissile grain boundary disconnections that cause boundary sliding deformation at stresses well below boundary transmission stresses. Thus, mechanisms of inverse Hall-Petch, namely grain boundary shear and sliding, are shown to operate in lieu of grain boundary transmission in the single dislocation regime. However, by controlling the applied stresses, inverse Hall-Petch can be reversed and typical Hall- Petch grain boundary transmission regained. This, in turn, allows the direct computation of Hall-Petch coefficients. Further, a second dislocation on the same slip plane preserves typical Hall-Petch behavior for Al and Ni and does not lead to boundary sliding events, thus implying a critical grain size for Hall-Petch breakdown based on the pileup model.

36 MATERIALS SCIENCE↗

Fostering a Guiding Multiscale Model for the Development of Advanced MgB 2 Hydrogen Storage Materials (Final Technical Report)

Project Goal and Objective. The demand for energy and for an upgraded energy infrastructure has steadily grown, as have the needs for energy independence and alternatives to our reliance on petroleum. Hydrogen is considered the most viable fuels for wide-scale implementation in the near future as it is less-polluting, non-toxic, and has more stored energy than petroleum. It is envisioned that hydrogen can eventually become the prime energy carrier, integrating the transportation, grid, and chemical sectors in a way that improves resiliency, diversifies feedstocks, and affords new economic opportunities. A key remaining challenge is the development materials with enhanced gravimetric and volumetric hydrogen storage capacities that offer a higher performance than compressed gas. These materials would eliminate the need for large-scale compression, thereby dramatically reducing the footprint and cost of gas storage. The high gravimetric and volumetric hydrogen capacities of complex hydrides has prompted an intensive investigation of the potential of this class of materials as hydrogen storage media over the past 25 years. Among the many complex hydrides that have been explored, magnesium borohydride, Mg(BH 4 ) 2 , has been found to possess the best combination of practical thermodynamic properties. These include a gravimetric H 2 density of 14.9 wt% H 2 and thermodynamics for the dehydrogenation of Mg(BH 4 ) 2 to MgB 2 (equation 1) (ΔH° = 39 kJ/mol H 2 , ΔS = 112 J/K mol H 2 ) which lie in the narrow window required Mg(BH 4 ) 2 $\Leftrightarrow$ MgB 2 + 4 H 2 (1) for reversibility under moderate pressure and temperature. However, overcoming the extremely slow kinetics of the reversible release of hydrogen by this material in the solid state is a daunting challenge. At temperatures greater than 400 °C, the borohydride releases up to 14 wt% hydrogen giving MgB 2 . We discovered that the direct re-hydrogenation of MgB 2 to Mg(BH 4 ) 2 can be accomplished under 950 bar H 2 at 400 °C. While this demonstrated that complete reversibility can be achieved, the conditions employed are far too extreme for commercial hydrogen storage applications. More recently, we found through US DOE funded research projects (EERE HyMARC and HySCOR), that hydrogen cycling, can be accomplish at much milder conditions upon modification of the borohydride or boride. Guided by these discoveries these discoveries, the objective of this research project was to obtain key information that will enable the development of a model of reversible hydrogenation of MgB 2 to Mg(BH 4 ) 2 . The ultimate goal of our efforts is to attain a model of this transformation that can be utilized to accelerate development further advanced materials. This project directly follows on discoveries that were made over the course of a US DOE, EERE HyMARC project that was focused on improvement of the hydrogen cycling kinetics of modified MgB 2 . We found that that mechanical milling with graphene results the desired, pronounced kinetic enhancement. The dramatic lowering of the conditions required for the hydrogenation of MgB 2 is a significant step towards overcoming its chemical inertness allowing its development as a practical onboard hydrogen storage material. However, the exact nature of the modification(s) of MgB 2 that is responsible for its activation towards hydrogenation is completely unknown. This situation is not unique, as efforts to develop hydrogen storage materials typically have a narrow focus rather than a comprehensive approach that takes atomic level bonding and structure; molecular dynamics; long range, nano- and mesoscale-structure and their interconnection all into account. The goal of this project was the development of a comprehensive, multi-scale computational model of reversible hydrogenation of MgB 2 to Mg(BH 4 ) 2 that can be utilized for development of higher performance versions of the modified material. Development of the model requires determination of: 1) the bulk, nano-scale, and meso-scale structural changes occurring at elevated pressure following mechano-chemical modification of MgB 2 ; 2) the reaction pathway of the reversible hydrogenation of MgB 2 to Mg(BH 4 ) 2 ; 3) the effect of elevated pressure and mechano-chemical modification on the chemical reaction pathways; 4) the interactions at solid-gas interfaces; and particle surfaces; and 5) the kinetics and thermodynamic parameters associated with each step of the hydrogenation reaction pathway. This investigation required advanced techniques as preliminary, standard XRD, 11 B NMR, and FTIR analysis showed no signs of material modification. In order to gain this level of understanding of modified MgB 2 , required the teaming of a diverse group of experts and state-of-the art experimental capabilities at the University of Hawaii at Manoa (UHM) and collaborating National Laboratories: Craig Jensen , Department of Chemistry (PI and Project Director), solid state, solution, and high pressure NMR spectroscopy; solid-state synthesis; and high pressure hydrogenation (collaboration with SNL); Godwin Severa , Hawaii Natural Energy Institute (co-PI) calorimetry; infrared and Raman spectroscopy (collaboration with NREL); Dera , high pressure X-ray diffraction including in situ experiments (collaboration with ANL); Hope Ishii , Hawaii Institute of Geophysics electron microscopy investigations (collaboration with LBNL); and Joe Brown , Mechanical Engineering , material electronic structure and electric field effects.

08 HYDROGEN↗

Phase-space sensitivity (weight functions) of 3 MeV proton diagnostics

Abstract The weight function W ( X ) is a diagnostic sensitivity to phase-space variables X that relates the measured signal C to the distribution function F ( X ) through the equation C = ∫ W ( X ) F ( X ) d X . In the present work, an algorithm to calculate W for a diagnostic that measures 3 MeV protons produced in d(d,p)t fusion reactions between a fast ion and a thermal deuteron is developed. The emitted protons escape the tokamak on curved orbits and are detected. These curved orbits constitute effective diagnostic ‘sightlines’. The presented algorithm accounts for the complications associated with these curved sightlines. An initial calculation of time-reversed proton orbits computes effective solid angles and sightlines for the relevant range of incident proton velocity vectors. These precomputed orbits are then used within the framework of FIDASIM (2020 Plasma Phys. Cont. Fusion 62 105008) to calculate the reactivity averaged over the thermal distribution of the ‘target’ deuterons and the probability that a fast ion of specified energy and pitch has a gyroangle that is consistent with the kinematic equations along each of the sightlines. Comparisons with analytic formulas and with independent calculations for the Mega Amp Spherical Tokamak 3 MeV proton diagnostic verify the algorithm.

Physics↗

Shear reflectivity compensation in full-waveform inversion using least-squares reverse-time migration

SUMMARY The computational cost of elastic-waveform inversion is too high for inverting PP reflections, while using acoustic full-waveform inversion (FWI) is inaccurate because it does not depend on the shear modulus/velocity/impedance that affects elastic PP wavefield amplitudes. To solve this problem, we develop a waveform inversion method that uses acoustic least-squares reverse-time migration (LSRTM) to compensate the shear reflectivity for acoustic FWI. Our method is based on the quasi-elastic-wave equation developed by Chapman et al. (2014). The quasi-elastic-wave equation uses a linearized acoustic-wave equation with shear modulus μ as a virtual source to correct the acoustic PP wavefield amplitudes toward elastic ones. Our waveform inversion method inverts for elastic parameters by minimizing the L2 norm of the difference between recorded and predicted PP reflections modelled using the quasi-elastic-wave equation. Numerical tests on synthetic and field data show that our method can properly handle the amplitudes of elastic PP reflections and provides an accurate estimate of the P- and S-wave velocities/impedances and, in some cases, the density. The method does not need the computationally expensive numerical solution to the elastic-wave equation. It also gives a better estimate of elastic parameters than a pure LSRTM method for elastic PP reflections.

Feng, Zongcai↗

Impact of large-scale effects on mass transfer and concentration polarization in Reverse Osmosis membrane systems

Here, we present well-resolved computational fluid dynamics simulations of a large-scale reverse osmosis membrane-spacer configuration (1 m). Our computational model solves the flow and transport equations with variable solute-dependent properties. We utilize a high resolution computational mesh to resolve all relevant length scales associated with spacer-induced mixing and thin concentration boundary layers. An important contribution of this work is the development of a modified mass-transfer correlation that accounts for the development of the concentration boundary layer along the channel. A set of 2D axisymmetric simulations were performed for a spiral wound module layer with varying cross-flow conditions and spacer diameters which indicate a significant entrance length effect for concentration profile development at lower flow rates while mixing effects dominate at higher flow rates. The mass-transfer correlations at higher flow rates compare well with published correlations while a surrogate model for Sherwood number was obtained that depends on an additional similarity variable that accounted for entrance length effects at lower flow rates. Finally, a large-scale membrane-spacer design relevant to high-pressure reverse osmosis is studied with a non-uniform arrangement of spacers, which indicate a substantial saving in pressure drop (~40%) compared to traditional uniformly spaced pattern with minor variations (~2%) in concentration polarization, product water quality (~1%) and water recovery (~7%) compared to a uniform spacer pattern.

97 MATHEMATICS AND COMPUTING↗

An empirical investigation of organic software product lines

Abstract Software product line engineering is a best practice for managing reuse in families of software systems that is increasingly being applied to novel and emerging domains. In this work we investigate the use of software product line engineering in one of these new domains, synthetic biology. In synthetic biology living organisms are programmed to perform new functions or improve existing functions. These programs are designed and constructed using small building blocks made out of DNA. We conjecture that there are families of products that consist of common and variable DNA parts, and we can leverage product line engineering to help synthetic biologists build, evolve, and reuse DNA parts. In this paper we perform an investigation of domain engineering that leverages an open-source repository of more than 45,000 reusable DNA parts. We show the feasibility of these new types of product line models by identifying features and related artifacts in up to 93.5% of products, and that there is indeed both commonality and variability. We then construct feature models for four commonly engineered functions leading to product lines ranging from 10 to 7.5 × 10 20 products. In a case study we demonstrate how we can use the feature models to help guide new experimentation in aspects of application engineering. Finally, in an empirical study we demonstrate the effectiveness and efficiency of automated reverse engineering on both complete and incomplete sets of products. In the process of these studies, we highlight key challenges and uncovered limitations of existing SPL techniques and tools which provide a roadmap for making SPL engineering applicable to new and emerging domains.

97 MATHEMATICS AND COMPUTING↗

Computationally Guided Design of Multiple Impurities Tolerant Electrode (Final Report)

The current project was based on a combined experimental and computational approach, which can help recommend better cathode materials under multiple impurities conditions. The PI will mainly take in charge of experimental and computational thermodynamics of the selected cathode materials for the SOFC applications under multiple impurities. While the co-PI will run the electrochemical tests of the cathodes recommended and eventually the long-term degradation tests. At the end of the project, a multiple tolerant cathode material based on the combined experimental and computational approach will be recommended and the reliability of the commonly used accelerated testing will be evaluated. It will address multiple impurities poisoning effect of SO2, CO2, Cr and H2O on the LSM, LSCF and LNO cathodes by identifying the formation of the detrimental secondary phases by XRD, SEM and TEM techniques. And further recommended cathode material will be subjected to electrochemical testing and the most promising ones will be applied to long-term tests. The hybrid approach the PI proposed will not only be applied to the design of multiple impurities tolerant cathodes but will also be considered in the future oxygen electrode applications in SOECs or reversible SOCs. This hybrid computational and experimental approach includes four sections: 1) Investigation of single impurity poisoning on LSM, LSCF and LNO cathodes in the presence of SO2, CO2, Cr. In this section, LSM, LSCF cathodes from FuelCellMaterials and LNO cathodes from Sol-Gel synthesis will be heat-treated in the above single impurity. And the formation of the secondary phases as well as the corresponding simulations will be cross compared, which shows good agreement between each other. Meanwhile, the accelerated testing approach will be evaluated in these systems compared with the previous published work to understand the reliability of the approach. 2) Investigation of multiple impurities poisoning on LSM, LSCF and LNO cathodes in the presence of Cr+H2O, SO2+Cr and SO2+Cr+H2O conditions. We have also applied these 3 candidate cathodes under these multiple impurities’ conditions and the long-term degradation mechanism of the multiple impurities will be understood with the help of the combined experimental and computational approach. Meanwhile, the synergistic effect of those impurities will be compared with the individual ones in the same cathode system to further reveal the actual operating conditions. 3) Electrochemical testing and polarization of the recommended cathode. We have demonstrated very low polarization resistance in LSCF (core)-LSM (shell) electrodes using MSD process and analyzed impedance spectra using DRT analysis and confirming that the low polarization resistance in LSM infiltrated MSD cells is due to reduction in polarization resistance associated with O2-adsorption process. 4). Long-term degradation testing. We have developed a versatile MSD-based process to deposit various continuous coatings onto porous scaffolds and established baseline for longer term Cr-impurity testing in future projects.

36 MATERIALS SCIENCE↗

Solar Energetic Proton Access to the Inner Magnetosphere During the September 7–8, 2017 Event

Here, the access of solar energetic protons into the inner magnetosphere on September 7–8, 2017 is investigated by following reversed proton trajectories to compute the proton cutoff energy using the Dartmouth geomagnetic cutoff code (Kress et al., 2010, https://doi.org/10.1029/2009sw000488). The cutoff energies for protons coming from the west and east direction, the minimum and maximum cutoff energy respectively, are calculated every 5 min along the orbit of Van Allen Probes using TS07 and the Lyon-Fedder-Mobarry (LFM) MHD magnetic field model. The result shows that the cutoff energy increases significantly as the radial distance decreases, and that the cutoff energy decreases with the building up of the ring current during magnetic storms. Solar wind dynamic pressure also affects cutoff suppression (Kress et al., 2004, https://doi.org/10.1029/2003gl018599). The LFM-RCM model shows stronger suppression of cutoff energy than TS07 during strong solar wind driving conditions. The simulation result is compared with proton flux measurements, showing consistent variation of the cutoff location during the September 7–8, 2017 geomagnetic storm.

79 ASTRONOMY AND ASTROPHYSICS↗

Rejection of low-molecular weight neutral organics is highly sensitive to reverse osmosis system design and operation

A computational model was developed to investigate the significance of system design and operating conditions on the rejection of neutral, low-MW organics by reverse osmosis for potable reuse. Here, the model demonstrated that the decrease in local rejection as net driving pressure decreases is substantially greater for moderately rejected compounds than for highly rejected compounds. At recovery values less than 70%, the local permeate concentration can exceed the pressure vessel feed concentration for moderately rejected compounds. System-level rejection of moderately rejected compounds is likewise substantially more sensitive to operating conditions than highly rejected compounds. The findings highlight a drawback of relying on rejection results from bench-scale testing that operates at low recovery, which invariably has higher rejection than full-scale systems operating at similar pressure. The analysis demonstrates a trade-off in which the low-pressure, high-recovery operation desired for potable reuse systems can be detrimental to the removal of low-MW neutral organics. The removal of low-MW neutral organics can be improved if organics rejection is explicitly evaluated during the design process.

42 ENGINEERING↗

High-temperature carbon dioxide capture in a porous material with terminal zinc hydride sites

Carbon capture can mitigate point-source carbon dioxide (CO 2 ) emissions, but hurdles remain that impede the widespread adoption of amine-based technologies. Capturing CO 2 at temperatures closer to those of many industrial exhaust streams (>200°C) is of interest, although metal oxide absorbents that operate at these temperatures typically exhibit sluggish CO 2 absorption kinetics and instability to cycling. Here, in this study, we report a porous metal–organic framework featuring terminal zinc hydride sites that reversibly bind CO 2 at temperatures above 200°C—conditions that are unprecedented for intrinsically porous materials. Gas adsorption, structural, spectroscopic, and computational analyses elucidate the rapid, reversible nature of this transformation. Extended cycling and breakthrough analyses reveal that the material is capable of deep carbon capture at low CO 2 concentrations and high temperatures relevant to postcombustion capture.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Computational flow modeling of triply periodic minimal surfaces as feed channel spacers in ultra-high pressure reverse osmosis applications

Triply periodic minimal surfaces (TPMS) are a special class of mathematical surfaces characterized by a high surface area-to-volume ratio. They have generated considerable interest in fields such as acoustics, heat transfer, and membrane-based filtration processes. This study evaluates the performance of four different TPMS designs—Schoen Gyroid, Schoen Crossed Layers of Parallels (CLP), Schoen Transverse Crossed Layers of Parallels (tCLP), and Schwarz-Primitive—when used as feed channel spacers under ultra-high pressure reverse osmosis (UHPRO) conditions, at approximately 200 bar. Our experimentally validated computational fluid dynamics model reveal different flow patterns within the feed channels for each of the four TPMS designs, leading to varying hydrodynamic and permeation properties. Under the simulated UHPRO conditions, the Gyroid and tCLP designs yield up to a 23% increase in average permeate velocity and a 14% reduction in average membrane-surface concentration relative to a non-woven spacer of the same porosity. Furthermore, the enhanced performance comes with an increased feed channel pressure drop, although it only constitutes less than 4% of the operating pressure when extrapolated for a meter-long membrane module. Additionally, the study analyzes the effects of varying inlet velocity and spacer porosity on membrane performance. Overall, this research provides valuable insights into the potential use of TPMS spacers in UHPRO applications.

36 MATERIALS SCIENCE↗

Reverse Osmosis Simulation Data

This dataset consists of computational fluid dynamics (CFD) output for various spacer configurations in a feed-water channel in reverse osmosis (RO) applications. Feed-water channels transport brine solution to the RO membrane surfaces. The spacers embedded in the channels help improve membrane performance by disrupting the concentration boundary layer growth on membrane surfaces. Refer to the "Related Work" resource below for more details. This dataset considers a feed-water channel of length 150mm. The inlet brine velocity and concentration are fixed at 0.1m/s and 100kg/m3 respectively. The diameter of the cylindrical spacers is fixed as 0.3mm and six varying inter-spacer distances of 0.75mm, 1mm, 1.5mm, 2mm, 2.5mm, and 3mm are simulated. The dataset comprising the steady, spatial fields of solute concentration, velocity, and density near each spacer is placed in the folder corresponding to the spacer configuration considered. We run two sets of CFD simulations and include the outputs from both sets for each configuration: (1) with a coarser mesh, producing low-resolution (LR) data of spatial resolution 20x20, and (2) with a finer mesh, producing high-resolution (HR) data of spatial resolution 100x100. These data points can be treated as images with the quantities of interest as their channels and can be used to train machine learning models to learn a mapping from the LR images as inputs to the HR images as outputs.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Cost-optimal selection of pH control for mineral scaling prevention in high recovery reverse osmosis desalination

Conference proceedings for Foundations of Computer Aided Process Design (FOCAPD) 2024 that details a cost optimization model for pH control to prevent mineral scaling in high recovery reverse osmosis. This work applies a framework for incorporating detailed water chemistry predictions such as precipitation, pH change, and mineral scaling tendencies with process-scale optimization. It demonstrates that the acid choice for pH control can have a significant impact on pretreatment costs.

Amusat, Oluwamayowa↗

Diffusion-Model-Assisted Supervised Learning of Generative Models for Density Estimation

Here, we present a supervised learning framework of training generative models for density estimation. Generative models, including generative adversarial networks (GANs), normalizing flows, and variational auto-encoders (VAEs), are usually considered as unsupervised learning models, because labeled data are usually unavailable for training. Despite the success of the generative models, there are several issues with the unsupervised training, e.g., requirement of reversible architectures, vanishing gradients, and training instability. To enable supervised learning in generative models, we utilize the score-based diffusion model to generate labeled data. Unlike existing diffusion models that train neural networks to learn the score function, we develop a training-free score estimation method. This approach uses mini-batch-based Monte Carlo estimators to directly approximate the score function at any spatial-temporal location in solving an ordinary differential equation (ODE), corresponding to the reverse-time stochastic differential equation (SDE). This approach can offer both high accuracy and substantial time savings in neural network training. Once the labeled data are generated, we can train a simple, fully connected neural network to learn the generative model in the supervised manner. Compared with existing normalizing flow models, our method does not require the use of reversible neural networks and avoids the computation of the Jacobian matrix. Compared with existing diffusion models, our method does not need to solve the reverse-time SDE to generate new samples. As a result, the sampling efficiency is significantly improved. We demonstrate the performance of our method by applying it to a set of 2D datasets as well as real data from the University of California Irvine (UCI) repository.

97 MATHEMATICS AND COMPUTING↗