Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “generative diffusion model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Phase-space entropy cascade and irreversibility of stochastic heating in nearly collisionless plasma turbulence

We consider a nearly collisionless plasma consisting of a species of “test particles” in one spatial and one velocity dimension, stirred by an externally imposed stochastic electric field—a kinetic analog of the Kraichnan model of passive advection. The mean effect on the particle distribution function is turbulent diffusion in velocity space—known as stochastic heating. Accompanying this heating is the generation of fine-scale structure in the distribution function, which we characterize with the collisionless (Casimir) invariant C 2 ∝ ∫ ∫ d x d v 〈 f 2 〉 —a quantity that here plays the role of (negative) entropy of the distribution function. We find that C 2 is transferred from large scales to small scales in both position and velocity space via a phase-space cascade enabled by both particle streaming and nonlinear interactions between particles and the stochastic electric field. We compute the steady-state fluxes and spectrum of C 2 in Fourier space, with k and s denoting spatial and velocity wave numbers, respectively. In our model, the nonlinearity in the evolution equation for the spectrum turns into a fractional Laplacian operator in k space, leading to anomalous diffusion. Whereas even the linear phase mixing alone would lead to a constant flux of C 2 to high s (towards the collisional dissipation range) at every k , the nonlinearity accelerates this cascade by intertwining velocity and position space so that the flux of C 2 is to both high k and high s simultaneously. Integrating over velocity (spatial) wave numbers, the k -space ( s -space) flux of C 2 is constant down to a dissipation length (velocity) scale that tends to zero as the collision frequency does, even though the rate of collisional dissipation remains finite. The resulting spectrum in the inertial range is a self-similar function in the ( k , s ) plane, with power-law asymptotics at large k and s . Our model is fully analytically solvable, but the asymptotic scalings of the spectrum can also be found via a simple phenomenological theory whose key assumption is that the cascade is governed by a “critical balance” in phase space between the linear and nonlinear timescales. We argue that stochastic heating is made irreversible by this entropy cascade and that, while collisional dissipation accessed via phase mixing occurs only at small spatial scales rather than at every scale as it would in a linear system, the cascade makes phase mixing even more effective overall in the nonlinear regime than in the linear one. Published by the American Physical Society 2024

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

HIGH-FIDELITY SIMULATION OF SOOT FORMATION AND THERMAL RADIATION IN A LABORATORY-SCALE RICH-QUENCH-LEAN BURNER

High-fidelity simulations of a swirl-stabilized turbulent spray flame in a laboratory-scale aero-combustor have been performed to evaluate the predictability of state-of-the-art models in capturing soot formation. The simulations employ a complex chemical mechanism developed for Jet-A with PAH chemistry, coupled with the Hybrid Method of Moments (HMOM) soot model, and a Lagrangian dilute spray model for the fuel injection. Two simulations are performed to compare the results when thermal radiation is neglected or included in the solution with a mean spectral model. Modeling closures for the soot differential diffusion effects in mixture fraction space, as well as turbulence-radiation interaction are also evaluated using the data generated by the simulations. Given the degree of complexity of the simulation, the results showed good agreement with experimental measurements of the spatial distribution of the soot volume fraction ensemble average. A closer agreement with the experiment is observed when thermal radiation is included in the solution. Thermal radiation is observed to reduce the flame temperature and increase the flame intermittency, denoted by the increase in the temperature standard deviation in mixture fraction space. The reduction in temperature also leads to a reduction in PAH production and soot volume fraction. Turbulence is observed to have different effects on radiative emission depending on the mixture fraction. Turbulent scalar fluctuations significantly enhance radiative emission in fuel lean mixtures and can also play a role for fuel rich conditions. The statistical description of the turbulence-radiation interaction, previously proposed in the literature, was observed to correctly reproduce the high-fidelity results. Model coefficients were provided for swirl-stabilized flames. The soot differential diffusion model, previously proposed in the literature, based on the residual between the exact term and its model approximation, was also evaluated. The residual correction term further improved the agreement with exact differential diffusion term evaluated with the high-fidelity simulation data in mixture fraction space. The results suggest that the effective turbulent Lewis number can be equal to unity in simulations of turbulent non-premixed recirculating flames.

Soriano, Bruno [Sandia National Laboratories (SNL)↗
DOE OSTI2025

Using convolutional neural networks to accelerate three-dimensional coherent synchrotron radiation computations

Calculating the effects of coherent synchrotron radiation (CSR) is one of the most computationally expensive tasks in accelerator physics. Here, we use convolutional neural networks (CNNs), along with a latent conditional diffusion (LCD) model, trained on physics-based simulations to speed up calculations. Specifically, we produce the 3D CSR wakefields generated by electron bunches in circular orbit in the steady-state condition. Two datasets are used for training and testing the models: wakefields generated by three-dimensional Gaussian electron distributions and wakefields from a sum of up to 25 three-dimensional Gaussian distributions. The CNNs are able to accurately produce the 3D wakefields ∼250–1000 times faster than the numerical calculations, while the LCD achieves a gain of a factor of ∼34. We also test the extrapolation and out-of-distribution generalization ability of the models. They generalize well on distributions with larger spreads than what they were trained on but struggle with smaller spreads.

43 PARTICLE ACCELERATORS↗
DOE OSTI2026

Enabling probabilistic learning on manifolds through double diffusion maps

Here, we present a generative learning framework for probabilistic sampling that extends Probabilistic Learning on Manifolds (PLoM), which is designed to generate statistically consistent realizations of a random vector in a finite-dimensional Euclidean space, informed by a (representative) set of observations. In its original form, PLoM constructs a reduced-order probabilistic model by combining three main components: (a) kernel density estimation to approximate the underlying probability measure, (b) Diffusion Maps to characterize the manifold of the data, and (c) a reduced-order Itô Stochastic Differential Equation (ISDE) to sample from the learned distribution. However, its sampling dynamics are posed in the ambient space and the retained number of reduced coordinates is chosen by projection-reconstruction error. In practice, this often (i) requires more coordinates than the data’s intrinsic dimension to achieve stable sampling and (ii) lacks a smooth, basis-independent lifting back to the data domain; moreover, standard Diffusion Maps emphasize harmonic eigenfunctions and can miss non-harmonic latent structure. We address these limitations by decoupling geometry learning from sampling: a first Diffusion Maps pass identifies non-harmonic coordinates on which we formulate a full-order ISDE directly in the latent space, while Double Diffusion Maps captures multiscale geometric features and Geometric Harmonics (GH) learns a smooth lifting map to the ambient variables that is independent of the particular diffusion basis. This hybrid design preserves the system’s dynamical richness with a compact geometric representation and enables principled out-of-sample inference. The effectiveness and robustness of the proposed method are illustrated through two numerical studies: one based on data generated from two-dimensional Hermite polynomial functions and another based on high-fidelity simulations of a detonation wave in a reactive flow.

Double diffusion maps↗
DOE OSTI2025

Gray-Scott reaction-diffusion

This dataset consists of 1000 records in a single HDF5 file generated from the simulation code available at: https://github.com/lezahlie/greyscott_simulation. More about the Gray-Scott model is explained here https://visualpde.com/nonlinear-physics/gray-scott.html.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Simulating the CMS High Granularity Calorimeter with ML

Detector simulation is a key component of physics analysis and related activities in CMS. In the upcoming High Luminosity LHC era, simulation will be required to use a smaller fraction of computing in order to satisfy resource constraints. At the same time, CMS will be upgraded with the new High Granularity Calorimeter (HGCal), which requires significantly more resources to simulate than the existing CMS calorimeters. This computing challenge motivates the use of generative machine learning models as surrogates to replace full physics-based simulation. We study the application of state-of-the-art diffusion models to simulate particle showers in the CMS HGCal. We will discuss methods to overcome the challenges posed by the high-dimensional, irregular geometry of the HGCal. The quality of the showers produced by the diffusion model will be assessed by comparison to the full GEANT4-based simulation. The increase in simulation throughput will be quantified and methods to accelerate the diffusion model inference will also be discussed.

Amram, Oz↗
DOE OSTI2024

Simulative Prediction of Solar Illuminance and Application of the Du-Sharples Model in Estimating Adapted Daylighting Metrics for an Urban Environment

The practice of daylighting in indoor spaces can significantly reduce electricity consumption and carbon emissions, improve human productivity, and enhance mood and cognitive perception. This work discussed the recent developments in daylighting science and practice, computed the periodic variations in average diurnal daylight levels for each month, quantified in terms of global horizontal illuminance and diffuse horizontal illuminance, for Kolkata, India, a city with tropical wet and dry climate, with two empirical luminous efficacy models of estimating solar illuminance, and assessed daylighting metrics with the Du-Sharples model. A program was formulated that could compute and generate daylight data with monthly-hourly solar irradiation data and the Du-Sharples model was utilized to predict dirt-corrected daylighting metrics for three glazing transmittance values and five elemental carbon deposition levels on glazing material. The highest monthly average global horizontal illuminance is recorded in April (64.05 klx for Littlefair model and 66.82 klx for Muneer-Kinghorn model) and the highest monthly average diffuse horizontal illuminance is recorded in July (33.23 klx for Littlefair model and 30.63 klx for Muneer-Kinghorn model). Further, the computed yearly average global and diffuse horizontal illuminance levels agree well with a previous study that applied the Perez model. Yearly average horizontal work surface illuminance level remained >1.5 klx for window-towall area ratio >30 %. The approach adopted in this work and the temporal variation charts of computed exterior daylight level data may assist building service engineers, architects, and indoor lighting practitioners in making informed policy decisions at different stages of building planning.

Engineering↗
DOE OSTI2024

Thermal diffusion, exhaust gas recirculation and blending effects on lean premixed hydrogen flames

Thermodiffusively-unstable lean premixed hydrogen flames are investigated using two-dimensional direct numerical simulation employing finite-rate chemical kinetics. Three databases are generated focussing on the inclusion of the Soret effect, the recirculation of exhaust gas, and blending with methane. A simple rescaling of a classic thermal diffusion model is presented and shown to mimic multicomponent diffusion with very low computational cost and little-to-no loss in accuracy. It is also shown that a previously developed model for mean local flame speeds in lean premixed hydrogen flames can still be used provided Soret effects are taken into account in one-dimensional calculations. The addition of exhaust gas to the unburned mixture is found to enhance thermodiffusive instability; the primary mechanism for this was shown to be the highly-efficient third-body nature of water, with the reduction of adiabatic flame temperature a second-order effect. Again, the existing mean local flame speed model proved sufficient. Finally, blending with methane was found to reduce the thermodiffusive response of the flame, more so than the existing model suggests, despite adjustment of the fuel Lewis number; an adapted model is presented to account for this.

08 HYDROGEN↗
DOE OSTI2025

Megahertz Rate Optical Diagnostics of Explosively Generated Soot

Detonation of a solid explosive produces a turbulent and luminous post‐detonation fireball containing condensed carbon soot. Diagnostics of soot dynamics are needed for model validation and to interpret emission signals. Diffuse back‐illumination extinction imaging (DBI‐EI) and laser‐induced incandescence (LII) are two common optical diagnostics for flame soot. This work extends both to measure time‐resolved soot dynamics from a 12 mm HMX hemisphere. DBI‐EI measured line‐of‐sight optical extinction exceeds 99% in some regions. Results are tomographically inverted to obtain a signal proportional to the soot volume fraction. Pulse‐burst LII measures are presented at 1 MHz. For the first time, LII results are combined with DBI‐EI extinction measurements to quantify and correct for signal trapping. Following this, spatially and temporally resolved DBI‐EI and LII measures are shown to be in reasonable agreement. Finally, experimental results are compared against recently developed simulations. Quantitative differences in the soot mixing dynamics are resolved. These findings motivate future model improvements and demonstrate ongoing needs for diagnostic advancements for heavily sooting environments.

diffuse back-illumination extinction imaging↗
DOE OSTI2025

jaxhps: An elliptic PDE solver built with machine learning in mind

Elliptic partial differential equations (PDEs) can model many physical phenomena, such as electrostatics, acoustics, wave propagation, and diffusion. In scientific machine learning settings, a high-throughput PDE solver may be required to generate a training dataset, run in the inner loop of an iterative algorithm, or interface directly with a deep neural network. To provide value to machine learning users, such a PDE solver must be compatible with standard automatic differentiation frameworks, scale efficiently when run on graphics processing units (GPUs), and maintain high accuracy for a large range of input parameters. We have designed the jaxhps package with these use-cases in mind by implementing a highly efficient and accurate solver for elliptic problems with native hardware acceleration and automatic differentiation support.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

MOSCATO Development and Integration in Fiscal Year 2025: Implementation of Multiphase, Multiphysics Modeling Capabilities for Molten Salt Systems

MOSCATO (Molten Salt Chemistry and Transport) is a multiphysics code that provides high-fidelity, coupled simulations of fluid flow, heat transfer, mass transfer, chemistry, electrochemical phenomena, and alloy corrosion for molten salt systems. In FY25, significant developments were made to the code package, enhancing its capabilities for modeling all relevant phenomena within operating moltens salt reactors (MSRs). The developments and activities in FY25 included: 1. Implementation of Level-Set methods to enable modeling of single-bubble behavior in molten salts. In FY25, the Level-Set two-phase flow modeling implementation was improved to simulate single bubble behavior with molten salt media. The large density and viscosity ratios between typical gases and molten salt liquids present challenges for these types of numerical solvers. With enhancements to the pressure projection method, MOSCATO’s Level-Set solver was able to be successfully validated to experiments related to helium bubble rise in stagnant molten salt. The simulated bubble rising velocity showed reasonable good agreement with experimental measurements. The bubble shape and dynamics were also visually compared with experimental snapshots, demonstrating a good qualitative match. 2. Generation of mass transfer correlations for multiphase flow systems. To enable calculations of the tritium transport across the interface between gas bubbles and salt, we modeled high- Schmidt-number mass transfer around a sphere across a broad range of Reynolds numbers. The mesh near the sphere surface was highly refined to resolve steep concentration gradients caused by the low diffusion coefficient. Literature-based mass transfer correlations were compared with the numerical results, and modifications were proposed to improve agreement, particularly at higher Schmidt numbers. These mass transfer correlations were subsequently provided to other national laboratories to help enable high quality mass transfer simulations using lower-order solvers under development within the NEAMS program. 3. Preliminary implementation of a bubbly flow solver. To model bubbly flow in molten salt, we implemented a bubbly flow solver for void fractions less than 5%. To do so, an algebraic relative velocity model that assumes small bubbles with rapid momentum equilibration was added to MOSCATO to compute bubble velocities. Preliminary comparisons with experimental data showed reasonable agreement, and further improvements are underway. 4. Generation of mass transfer correlations for MSRE subchannel The Molten-Salt Reactor Experiment (MSRE) was a landmark historical project that demonstrated the feasibility of molten-salt reactor technology. The MSRE campaign also generated a significant body of experimental data and reports that continue to support molten-salt–related research. In this report, the MSRE core subchannel was used as the reference geometry for a mass transfer study performed with MOSCATO. The geometry and computational mesh were adapted from a previous study, providing adequate resolution for the relatively low Reynolds number in this case. Additional mesh refinement was applied to reach higher Schmidt numbers, enabling the derivation of a reliable mass-transfer correlation for the present scenario. 5. Simulations of oxygen ingressions into molten salt. In the previous fiscal year, we initiated a study to simulate oxygen ingression in stagnant salt. As oxygen enters the salt through its surface, it reacts with Ce 3+ to form solid CeO 2 and other reaction products. To more fully capture the complex diffusion-convection-reaction mechanisms, capabilities for modeling natural convection in the salt vessel were added. These were needed as the flow of the ingressed gas induced flow in the salt caused by surface shear and non-isothermal effects. With these updated physics in place, we were able to successfully reproduce the experimental results for the rate of change of CeCl 3 concentrations versus time. 6. Flow corrosion model validation. In FY24, MOSCATO’s corrosion model was validated against static corrosion experiments. In FY25, this work was extended to a flow corrosion experiment, where FLiNaK salt was driven by natural convection, with initial salt impurities to initiate corrosion. Despite uncertainties in parameters such as elemental diffusion coefficients in the alloy and unknown H + concentrations, the simulations achieved good agreement with experimental results, especially in predicting sample mass losses.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Electrolytic gold plating, stripping, and ion transport dynamics through a solid-state iodide perovskite

The pronounced electrochemical reactivity between halide perovskites and metal electrodes can introduce mobile extrinsic metal ions which can cause device instability or enable novel functionalities. Here we systematically investigate the kinetics of gold cation (Au + ) migration in indium tin oxide (ITO)/methylammonium lead triiodide (MAPbI 3 )/Au model devices under long-term potentiostatic biasing. Scanning electron microscopy (SEM), X-ray photoelectron spectroscopy (XPS), and density functional theory (DFT) analyses reveal that Au + ions, electrochemically generated at the Au anode, traverse the perovskite layer with diffusion coefficients on the order of 10 −11 to 10 −10 cm 2 s −1 and are subsequently reduced at the cathode as Au 0 clusters, resembling metal plating behavior in electrolytic cells and solid-state batteries during charging. Furthermore, reversing the applied bias strips the plated Au 0 , revealing reversibility suitable for bipolar resistive switching devices and providing direct evidence of the electrochemical and ionic nature of Au transport within the perovskite matrix. Quantitatively determining diffusion coefficients and ion concentrations provides foundational inputs for future drift-diffusion modelling opportunities and allows us to relate our findings to implications on long term operation of devices like photovoltaic modules. These results clearly demonstrate the solid-state electrochemical nature of perovskite devices, highlight methods to be more quantitative about ion transport properties, provide and emphasize the importance of disentangling electro-, photo-, photoelectrochemical processes for understanding device performance and unlocking new functionalities.

14 SOLAR ENERGY↗
DOE OSTI2024

The ab initio non-crystalline structure database: empowering machine learning to decode diffusivity

Non-crystalline materials exhibit unique properties that make them suitable for various applications in science and technology, ranging from optical and electronic devices and solid-state batteries to protective coatings. However, data-driven exploration and design of non-crystalline materials is hampered by the absence of a comprehensive database covering a broad chemical space. In this work, we present the largest computed non-crystalline structure database to date, generated from systematic and accurate ab initio molecular dynamics (AIMD) calculations. We also show how the database can be used in simple machine-learning models to connect properties to composition and structure, here specifically targeting ionic conductivity. These models predict the Li-ion diffusivity with speed and accuracy, offering a cost-effective alternative to expensive density functional theory (DFT) calculations. Furthermore, the process of computational quenching non-crystalline structures provides a unique sampling of out-of-equilibrium structures, energies, and force landscape, and we anticipate that the corresponding trajectories will inform future work in universal machine learning potentials, impacting design beyond that of non-crystalline materials. In addition, combining diffusion trajectories from our dataset with models that predict liquidus viscosity and melting temperature could be utilized to develop models for predicting glass-forming ability.

36 MATERIALS SCIENCE↗
DOE OSTI2024

A finite difference informed random walker (FDiRW) solver for strongly inhomogeneous diffusion problems

In nature, many complex multi-physics coupling problems exhibit strong diffusivity inhomogeneity. For instance, in the context of radionuclide absorption by porous wasteform materials within a flowing waste stream, the difference of species’ diffusivity in solid and liquid phases spans by 3~8 orders of magnitude. To solve the diffusion equations with strongly inhomogeneous diffusivity, traditional discretization-based methods, such as the Finite Difference Method (FDM), require infinitesimally small time steps (<10 -10 ) as high spatial resolutions are employed in most microstructure evolution processes, leading to prohibitively high computational costs. Here, this work developed an integrated numerical approach (FDiRW: Finite Difference informed Random Walk) to tackle this challenge. The idea is that utilizing the Random Walk concept, the fast diffusion is modeled as a superposition of point source’s solution for a concentration distribution while FDM is used to obtain the point source’s solution at each node. A mesh-coarsening algorithm is developed to generate an exclusive coarse mesh for FDiRW approach to maximize its efficiency. The effectiveness of the coarse mesh-based FDiRW approach is validated by benchmarking Finite Difference solutions. Numerical results demonstrated that FDiRW achieves a remarkable 1000x computational efficiency improvement over FDM while preserving desired accuracy for a medium-sized model of 192 × 192 × 192 grids. Finally, as models scale up, a floating-point operations (PLOPs) analysis of the FDiRW algorithm reveals that its computational complexity grows quadratically in terms of the number of nodes employed in computation.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Coupled cluster and dislocation dynamics modeling of microstructure evolution in irradiated materials

We develop here a coupled cluster and dislocation dynamics framework to study the microstructure evolution of irradiated materials. The framework not only accounts for the three dimensional diffusion of radiation-generated clusters, but also their interaction with dislocation networks and the resultant climb motion of discrete dislocations within finite crystals. The framework is solved with a superposition solution scheme, and is applied to investigate the evolution of the irradiation-induced dislocation loops in zirconium (Zr), considering the effects of various bias factors including the diffusion anisotropy difference (DAD) of interstitials and interstitial clusters, the dislocation bias of defects to discrete dislocation segments, and the production bias of defects from the radiation cascade. We find that the DAD is the most critical factor influencing the kinetics of the loop evolution in Zr, while the recombination/interaction of mobile defects can induce a strong spatial dependence of the loop evolution together with the DAD. Here, the method is also adopted to study the evolution of interstitial $\langle$a$\rangle$ and vacancy $\langle$c$\rangle$ dislocation loop ensembles consistent with the microstructure observed during irradiation-induced growth of Zr. Our findings not only reveal the spatial dependence of the size and ellipticity of the dislocation loops, but also suggest a limit on the anisotropy factor of interstitials to reproduce the co-growth of $\langle$a$\rangle$ and $\langle$c$\rangle$ loops in zirconium, in good agreement with experimental observations and other simulation results.

Bias factors↗
DOE OSTI2025

An Optimization-Based Coupling of Reduced Order Models with an Efficient Reduced Adjoint Basis Generation Approach

Optimization-based coupling (OBC) is an attractive alternative to traditional Lagrange multiplier approaches in multiple modeling and simulation contexts. However, application of OBC to time-dependent problems has been hindered by the computational cost of finding the stationary points of the associated Lagrangian, which requires primal and adjoint solves. This issue can be mitigated by using OBC in conjunction with computationally efficient reduced order models (ROMs). To demonstrate the potential of this combination, in this paper, we develop an optimization-based ROM-ROM coupling for a transient advection-diffusion transmission problem. We pursue the “optimize-then-reduce” path toward solving the minimization problem at each time step and solve reduced space adjoint system of equations, where the main challenge in this formulation is the generation of adjoint snapshots and reduced bases for the adjoint systems required by the optimizer. One of the main contributions of the paper is a new technique for an efficient adjoint snapshot collection for gradient-based optimizers in the context of optimization-based ROM-ROM couplings. In conclusion, we present numerical studies demonstrating the accuracy of the approach along with comparison between various approaches for selecting a reduced order basis for the adjoint systems, including decay of snapshot energy, average iteration counts, and timings.

coupled problems↗
DOE OSTI2025

From clutter to clarity: Emergent neural operators via questionnaire metrics

Real-world datasets in chemical engineering and bioengineering processes—such as those from catalytic reactors, multiphase flows, polymerization reactors, bioreactors, and clinical trials—can often be unlabeled or disorganized, rendering the training of existing supervised learning models ineffective at learning the underlying dynamics. To salvage these datasets for decision-making, we first seek to obtain clarity from the cluttered data. Here, we present a framework for developing “structural” generative models, discovering emergent equations, and constructing efficient emulators from scrambled datasets by integrating unsupervised organizational learning techniques (Questionnaires) with advanced deep learning architectures (Deep Hidden Physics Models and Deep Operator Networks). Our approach is demonstrated on two illustrative model systems: (a) a 1D advection–diffusion partial differential equation representing a winding underground pipe and (b) an ensemble of Stuart–Landau oscillators, an agent-based system of coupled ordinary differential equations. In both cases, we successfully reconstruct meaningful spatial, temporal, and parameter embeddings from scrambled data, enabling good predictions of system dynamics. As a result, we highlight the framework’s potential for broader applications, enabling data-driven system identification in fields with inherently disorganized or hidden parameter spaces.

42 ENGINEERING↗
DOE OSTI2025

From disorganized data to emergent dynamic models: Questionnaires to partial differential equations

Starting with sets of disorganized observations of spatially varying and temporally evolving systems, obtained at different (also disorganized) sets of parameters, we demonstrate the data-driven derivation of parameter dependent, evolutionary partial differential equation (PDE) models capable of generating the data. This tensor type of data is reminiscent of shuffled (multidimensional) puzzle tiles. The independent variables for the evolution equations (their “space” and “time”) as well as their effective parameters are all emergent , i.e. determined in a data-driven way from our disorganized observations of behavior in them. We use a diffusion map based questionnaire approach to build a smooth parametrization of our emergent space/time/parameter space for the data. This approach iteratively processes the data by successively observing them on the “space,” the “time” and the “parameter” axes of a tensor. Once the data become organized, we use machine learning (here, neural networks) to approximate the operators governing the evolution equations in this emergent space. Our illustrative examples are based (i) on a simple advection–diffusion model; (ii) on a previously developed vertex-plus-signaling model of Drosophila embryonic development; and (iii) on two complex dynamic network models (one neuronal and one coupled oscillator model) for which no obvious smooth embedding geometry is known a priori. This allows us to discuss features of the process like symmetry breaking, translational invariance, and autonomousness of the emergent PDE model, as well as its interpretability.

generative models↗