Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Artificial diffusion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Towards universal unfolding of detector effects in high-energy physics using denoising diffusion probabilistic models

Correcting for detector effects in experimental data, particularly through unfolding, is critical for enabling precision measurements in high-energy physics. However, traditional unfolding methods face challenges in scalability, flexibility, and dependence on simulations. We introduce a novel approach to multidimensional object-wise unfolding using conditional Denoising Diffusion Probabilistic Models (cDDPM). Our method utilizes the cDDPM for a non-iterative, flexible posterior sampling approach, incorporating distribution moments as conditioning information, which exhibits a strong inductive bias that allows it to generalize to unseen physics processes without explicitly assuming the underlying distribution. Our results highlight the potential of this method as a step towards a "universal" unfolding tool that reduces dependence on truth-level assumptions, while enabling the unfolding of a wide range of measured distributions with improved adaptability and accuracy.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Valuation of Surface Coatings in High-Energy Density Lithium-ion Battery Cathode Materials

Artificial barriers, usually with either electrochemically active or inactive coating materials, are deployed on cathode material surfaces to mitigate detrimental side reactions by suppressing direct contact of cathode and electrolyte called surface coatings. These surface coatings are commonly known to increase the wettability of liquid electrolyte and reduce the interfacial charge transfer resistance. An important caveat is the selection of appropriate coating material with appropriate thickness for achieving enhanced electrochemical performance. As modern battery materials are increasingly developed with some type of surface coating, a careful and thorough examination of their role in mitigating the cycle life issues of cathode materials is paramount. Here, this comprehensive review article extensively covers the selection criteria of coating materials based on their chemical and physical properties and electrochemical functionalities. Additionally, the article discusses the concept of critical coating thickness and methods of achieving homogeneous coating architectures that deliver desired performance benefits. Furthermore, this comprehensive article summarizes the recent advancements, effectiveness, necessity of cathode surface coatings and identifies the key aspect of structure-property correlation between coating type/thickness and lithium-ion diffusion through coating layers as the linchpin that validates surface coating approaches especially for high capacity nickel-rich cathodes.

25 ENERGY STORAGE↗

Cell Free and Immobilization Technologies (CFIT)

Today, several key factors negatively impact the production of fuels and chemicals from renewable sources. Common hindrances in the biological production of biochemicals are: (1) end-product or intermediate toxicity to the microbial biocatalyst, (2) the diversion of carbon to biomass formation, and (3) co-production of undesired byproducts. A particularly attractive alternative is to eliminate the biocatalyst entirely and instead operate the desired metabolic pathways in isolation, thus circumventing the roadblocks of biological toxicity, lower yields, and lack of specificity. However, cell-free enzyme systems still suffer from low productivities owing in part to the effects of free diffusion of intermediates, lack of long term enzyme stability, cofactor cost or inefficient recycling rates, and finally, the cost of enzyme production/purification. This project represents a new effort to propose innovative and cost competitive routes to producing biochemicals from a variety of feedstocks using cell free approaches. These routes will help reduce the current risk and cost associated with classical cell free production. Cell free technologies show promise for application to the production of toxic/inhibitory products or products difficult to separate from microbial growth media and can help reduce the production barriers in multiple areas of biological conversion of feedstocks to biochemicals. More specifically, we are developing new technologies and routes that could be used to produce high value biochemicals such as 2,3 BDO and terpenes (among many others) from biomass derived C5/C6 sugars or lignin but also from waste byproducts such as glycerol. This project will lead to significant innovation and also lead to new concepts and rational design of pathways and enzymes. Within this project, we will develop new metabolic enzyme cascades that will represent natural or artificial combinations of enzymes to produce the desired biochemicals from a variety of feedstocks. We are also developing basic design principals for constructing synthetic metabolons, using fusion proteins and synthetic protein scaffolds, to promote substrate channeling and stability while conserving peak activity. Additionally, our efforts include a techno economic analysis (TEA) of cell free approaches to provide the sensitivities of the process to enzyme loading, activity, pH, reactor volumes, cofactor recycling rates. Finally, we are focusing on further increasing stability, operating lifetime and efficiency of the pathway enzymes by immobilization on support surfaces. We are also focus on immobilizing pathway enzymes or combinations of enzymes on several different conducting polymers and evaluate the effect on stability and operating lifetime. As more combinations become available we will conduct a more systematic study of the means of immobilizing these enzymes. This preliminary work will enable the in-depth study of cofactor recycling at these interfaces using mediators for electron transfer. Taken together, these approaches will enable process intensification, continuous operation, lower capital and separations costs and end-product flexibility, and thus has the potential to contribute significantly to BETO's goals of cost competitive biofuels and bioproducts. To date we have demonstrated 1) the conversion of pyruvate to 2,3 BDO (4 enzymes with cofactor recycling, no additional cofactors needed) at >100g/L (>3g/L/h) using our enzyme tethering approach, 2) Generated mutants of a key redox enzyme with >180- fold improvement in NADH utilization over WT to >85% of NADPH utilization. 3) Produced mevalonate at >10g/L from glucose, limonene at >10g/L from mevalonate and more than >5g/L from glucose with crude enzyme preparations and complete cofactor recycling. 4) successfully generated fully active cross-linked aggregates (CLEAs) of NOX, a cofactor-regenerating water-forming oxidase that is key to our process with increased stability 5) Engineered and identified enzymes able to use the biomimetic cofactor NMN and synthesized new synthetic cofactors.

biocatalysis↗

Remote Mesoscopic Signatures of Induced Magnetic Texture in Graphene

Mesoscopic conductance fluctuations are a ubiquitous signature of phase-coherent transport in small conductors, exhibiting universal character independent of system details. Here, however, we demonstrate a pronounced breakdown of this universality, due to the interplay of local and remote phenomena in transport. Our experiments are performed in a graphene-based interaction-detection geometry, in which an artificial magnetic texture is induced in the graphene layer by covering a portion of it with a micromagnet. When probing conduction at some distance from this region, the strong influence of remote factors is manifested through the appearance of giant conductance fluctuations, with amplitude much larger than e 2 / h . This violation of one of the fundamental tenets of mesoscopic physics dramatically demonstrates how local considerations can be overwhelmed by remote signatures in phase-coherent conductors.

36 MATERIALS SCIENCE↗

Photoexcitation of Fe 3 O Nodes in MOF Drives Water Oxidation at pH=1 When Ru Catalyst Is Present

Abstract Artificial photosynthesis strives to convert the energy of sunlight into sustainable, eco‐friendly solar fuels. However, systems with light‐driven water oxidation reaction (WOR) at pH=1 are rare. Broadly used [Ru(bpy) 3 ] 2+ (bpy=2,2’‐bipyridine) photosensitizer has a fixed +1.23 V potential which is insufficient to drive most water oxidation catalysts (WOCs) in acid, while Fe 2 O 3 , featuring the highly oxidizing holes, is not stable at low pH. Here, the key examples of Fe‐based metal–organic framework (MOF) water oxidation photoelectrocatalysts active at pH=1 are presented. Fe‐MIL‐126 and Fe MOF‐dcbpy structures were formed with 4,4’‐biphenyl dicarboxylate (bpdc), 2,2’‐bipyridine‐5,5’‐dicarboxylate (dcbpy) linkers and their mixtures. Presence of dcbpy linkers allows integration of metal‐based catalysts via coordination to 2,2’‐bipyridine fragments. Fe‐based MOFs were doped with Ru‐based precursors to achieve highly active MOFs bearing [Ru(bpy)(dcbpy)(H 2 O) 2 ] 2+ WOC. Materials were analyzed with X‐ray diffraction (XRD), scanning electron microscopy (SEM), Fourier transform infra‐red (FTIR) spectroscopy, resonance Raman, X‐ray absorption spectroscopy, fs optical pump‐probe, electron paramagnetic resonance (EPR), diffuse reflectance and electric conductivity measurements and were modeled by band structure calculations. It is shown that under reaction conditions, Fe III and Ru III oxidation states are present, indicating rate‐limiting electron transfer in MOF. Fe 3 O nodes emerge as photosensitizers able to drive prolonged O 2 evolution in acid. Further developments are possible via MOF's linker modification for enhanced light absorption, electrical conductivity, reduced MOF solubility in acid, Ru‐WOC modification for faster WOC catalysis, or Ru‐WOC substitution to 3d metal‐based systems. The findings give further insight for development of light‐driven water splitting systems based on Earth‐abundant metals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

PRIMED for the Future: Purposing Raw Intake for Machine Learning-Enabled Detection (Final Report)

The COVID-19 pandemic demonstrated how a novel, elusive, and diffuse biological threat can engender uncertainty and misinformation, and it underscored the need for flexible analytical modalities agnostic to the identity of biological material. Yet even before the pandemic, recognition of the limitations of the current, list-based approach, which focuses on known pathogens and biotoxins, and of the importance of agent-agnostic biodetection was growing within the biosecurity community. In a 2018 report on “Biodefense in the Age of Synthetic Biology,” for example, the National Academy of Sciences stated that “an overreliance on the Select Agent List is a systematic weakness affecting many aspects of the United States’ current biodefense mitigation capability”. More recently, a group of biodefense researchers proposed the identification and adoption of “bioagent-agnostic signatures (BASs)” as a way of detecting and characterizing not only existing agents but also novel ones, an approach they believe will “enable a more flexible and resilient biodefense posture”. Indeed, the future of biodetection requires us to begin developing novel analytics that can identify anomalies and/or characteristics that indicate a potential threat, whether known or unknown, without looking for a specific signature that has been identified previously. To assess potential threats more rapidly, it is critical to develop agnostic artificial intelligence (AI)/machine learning (ML) systems that can be employed for real-time assessment of the nature and source of a perturbation. Such systems should be multi scale and multi-dimensional, integrating sensor data from a range of biological, chemical, and physical application spaces. Emerging deep learning (DL) models demonstrate exceptional promise for identification of discriminatory features within multi-dimensional datasets. DL models have the capacity to recognize and encode highly complex patterns in a wide range of input data modalities, including images, text, and biological/chemical/physical spectra. As such, they can execute a wide range of assessments and determinations that have traditionally required a human operator. The promise of advances in DL is apparent in the realm of human health and medicine. DL models have been validated for evaluating a variety of clinical threats to human health in a range of contexts, including infection and cancer, and they demonstrated improved performance in predicting stroke relative to human neurologists in some categories of data. Continuously evolving advances in AI/ML are expected to support more efficient evaluation of raw sequence, spectroscopy, and spectrometry data. For instance, recent advances and deployment of large language models (LLM) such as Generative Pre training Transformer (GPT) and Bidirectional Encoder Representations from Transformers (BERT) have already motivated application of these models for biological function prediction. As frameworks such as LLMs become larger and more complex in their representations, their capacity to serve as pre-trained models that can be fine-tuned for biological/biodetection purposes will similarly be amplified. While existing and emerging AI/ML have found broad applicability and use cases in the clinical sciences, development for environmental evaluation and biodetection has been limited. Functionalizing such capabilities for this purpose requires an understanding of the existing technical landscape and how the respective tools and algorithms are currently being employed. This landscape awareness then allows an assessment of the current practical capabilities of existing models and the anticipated requirements and development efforts that will be needed to adapt available algorithms for biodetection applications relevant to DHS. Leveraging expertise in biodetection, ML, and operational biodetection, the effort described in this report is comprised of a systematic landscape assessment (Subtask 2.1), comparative evaluation (Subtask 2.2), and formulation of a value proposition (Subtask 2.3) for the prospect of ML-enabled, agnostic biodetection from raw, or minimally-processed, datasets.

59 BASIC BIOLOGICAL SCIENCES↗

PRIMED for the Future: Purposing Raw Intake for Machine Learning-Enabled Detection

The COVID-19 pandemic demonstrated how a novel, elusive, and diffuse biological threat can engender uncertainty and misinformation, and it underscored the need for flexible analytical modalities agnostic to the identity of biological material. Yet even before the pandemic recognition of the limitations of the current, list-based approach, which focuses on known pathogens and biotoxins, and of the importance of agent-agnostic biodetection, was growing within the biosecurity community. In a 2018 report on “Biodefense in the Age of Synthetic Biology,” for example, the National Academy of Sciences stated that “an overreliance on the Select Agent List is a systematic weakness affecting many aspects of the United States’ current biodefense mitigation capability." More recently, a group of biodefense researchers proposed the identification and adoption of “bioagent-agnostic signatures (BASs)” as a way of detecting and characterizing not only existing agents but also novel ones, an approach they believe will “enable a more flexible and resilient biodefense posture." Indeed, the future of biodetection requires us to begin developing novel analytics that can identify anomalies and/or characteristics that indicate a potential threat, whether known or unknown, without looking for a specific signature that has been identified previously. To assess potential threats more rapidly, it is critical to develop agnostic artificial intelligence (AI)/machine learning (ML) systems that can be employed for real-time assessment of the nature and source of a perturbation. Such systems should be multiscale and multi-dimensional, integrating sensor data from a range of biological, chemical, and physical application spaces. Emerging deep learning (DL) models demonstrate exceptional promise for identification of discriminatory features within multi-dimensional datasets. DL models have the capacity to recognize and encode highly complex patterns in a wide range of input data modalities, including images, text, and biological/chemical/physical spectra. As such, they can execute a wide range of assessments and determinations that have traditionally required a human operator.

59 BASIC BIOLOGICAL SCIENCES↗

A study of convective core overshooting as a function of stellar mass based on two-dimensional hydrodynamical simulations

ABSTRACT We perform two-dimensional (2D) numerical simulations of core convection for zero-age main-sequence stars covering a mass range from 3 to 20 M⊙. The simulations are performed with the fully compressible time-implicit code music. We study the efficiency of overshooting, which describes the ballistic process of convective flows crossing a convective boundary, as a function of stellar mass and luminosity. We also study the impact of artificially increasing the stellar luminosity for 3 M⊙ models. The simulations cover hundreds to thousands of convective turnover time-scales. Applying the framework of extreme plume events previously developed for convective envelopes, we derive overshooting lengths as a function of stellar masses. We find that the overshooting distance (dov) scales with the stellar luminosity (L) and the convective core radius (rconv). We derive a scaling law $d_{\rm ov} \propto L^{1/3} r_{\rm conv}^{1/2}$, which is implemented in a one-dimensional stellar evolution code and the resulting stellar models are compared to observations. The scaling predicts values for the overshooting distance that significantly increase with stellar mass, in qualitative agreement with observations. Quantitatively, however, the predicted values are underestimated for masses ≳10 M⊙. Our 2D simulations show the formation of a nearly adiabatic layer just above the Schwarzschild boundary of the convective core, as exhibited in recent three-dimensional simulations of convection. The most luminous models show a growth in size with time of the nearly adiabatic layer. This growth seems to slow down as the upper edge of the nearly adiabatic layer gets closer to the maximum overshooting length and as the simulation time exceeds the typical thermal diffusive time-scale in the overshooting layer.

79 ASTRONOMY AND ASTROPHYSICS↗

Photophysics of nanographenes: from polycyclic aromatic hydrocarbons to graphene nanoribbons

Graphene quantum dots (GQDs) and nanoribbons (GNRs) are classes of nanographene molecules that exhibit highly tunable photophysical properties. There have been great strides in recent years to advance our understanding of nanographene photophysics and develop their use in light-harvesting systems, such as artificial photosynthesis. Here, we review the latest studies of GQDs and GNRs which have shed new light onto their photophysical underpinnings through computational and advanced spectroscopic techniques. We discuss how the size, symmetry, and shape of nanographenes influence their molecular orbital structures and, consequentially, their spectroscopic signatures. The scope of this review is to comprehensively lay out the general photophysics of nanographenes starting with benzene and building up to larger polycyclic aromatic hydrocarbons, GQDs, and GNRs. We also explore a collection of publications from recent years that build upon the current understanding of nanographene photophysics and their potential application in light-driven processes from display, lasing, and sensing technology to photocatalytic water splitting.

59 BASIC BIOLOGICAL SCIENCES↗

Predictive scale-bridging simulations through active learning

Throughout computational science, there is a growing need to utilize the continual improvements in raw computational horsepower to achieve greater physical fidelity through scale-bridging over brute-force increases in the number of mesh elements. For instance, quantitative predictions of transport in nanoporous media, critical to hydrocarbon extraction from tight shale formations, are impossible without accounting for molecular-level interactions. Similarly, inertial confinement fusion simulations rely on numerical diffusion to simulate molecular effects such as non-local transport and mixing without truly accounting for molecular interactions. With these two disparate applications in mind, we develop a novel capability which uses an active learning approach to optimize the use of local fine-scale simulations for informing coarse-scale hydrodynamics. Our approach addresses three challenges: forecasting continuum coarse-scale trajectory to speculatively execute new fine-scale molecular dynamics calculations, dynamically updating coarse-scale from fine-scale calculations, and quantifying uncertainty in neural network models.

97 MATHEMATICS AND COMPUTING↗

DiffESM: Conditional Emulation of Temperature and Precipitation in Earth System Models With 3D Diffusion Models

Earth system models (ESMs) are essential for understanding the interaction between human activities and the Earth's climate. However, the computational demands of ESMs often limit the number of simulations that can be run, hindering the robust analysis of risks associated with extreme weather events. While low-cost climate emulators have emerged as an alternative to emulate ESMs and enable rapid analysis of future climate, many of these emulators only provide output on at most a monthly frequency. This temporal resolution is insufficient for analyzing events that require daily characterization, such as heat waves or heavy precipitation. We propose using diffusion models, a class of generative deep learning models, to effectively downscale ESM output from a monthly to a daily frequency. Trained on a handful of ESM realizations, reflecting a wide range of radiative forcings, our DiffESM model takes monthly mean precipitation or temperature as input, and is capable of producing daily values with statistical characteristics close to ESM output. Combined with a low-cost emulator providing monthly means, this approach requires only a small fraction of the computational resources needed to run a large ensemble. We evaluate model behavior using a number of extreme metrics, showing that DiffESM closely matches the spatio-temporal behavior of the ESM output it emulates in terms of the frequency and spatial characteristics of phenomena such as heat waves, dry spells, or rainfall intensity.

54 ENVIRONMENTAL SCIENCES↗

Investigating shock-induced chemical reactions in Ni+Al multilayers: A continuum-based mesoscale approach with Arrhenius kinetics and artificial thermal conduction

A new continuum-based mesoscale modeling approach for shock-induced chemical reactions (SICRs) in Ni+Al multilayers is demonstrated in Sandia’s shock physics hydrocode, CTH. The approach utilizes Arrhenius-type kinetics and artificial thermal conduction. Our work builds upon previous efforts to parameterize equations of state for Ni x Al y [J. Appl. Phys. 137, 075102 (2025)], as well as simulations of inert shocks in realistic 2D microstructures [J. Appl. Phys. 137, 225301 (2025)]. To calibrate the reaction kinetics, pairs of the reaction coordinate, R′, vs time are extracted from the molecular dynamics (MD) literature. Here, the MD-informed kinetics are used to simulate the dynamic evolution of pressure and temperature in 2D mesoscale simulations. Overall, the MD-informed kinetics obtained for planar interfaces are too slow, as initial reaction is not observed on a nanosecond time scale. Even with quasi-periodic shock focusing leading to the formation of so-called “hot-spots,” the hot spots are unable to grow and coalesce using the fitted Arrhenius rate constants. However, by increasing the rate constants by two orders of magnitude, SICRs are observed at a shock pressure near 30 GPa, which is supported by experiments. Consequently, these mesoscale simulations suggest that unresolved shear-based mechanical mixing might possibly account for the discrepancies in kinetic rates, with shock-generated intense perturbations, interfacial vortical flows, and elevated temperatures serving as favorable reaction conditions. Future work will calibrate a shear-dependent reaction rate from the MD simulations with realistic interfaces that are wavy, diffuse, and disordered.

Kittell, David E. [Sandia National Laboratories (S↗

Performance of high-order Godunov-type methods in simulations of astrophysical low Mach number flows

High-order Godunov methods for gas dynamics have become a standard tool for simulating different classes of astrophysical flows. Their accuracy is mostly determined by the spatial interpolant used to reconstruct the pair of Riemann states at cell interfaces and by the Riemann solver that computes the interface fluxes. In most Godunov-type methods, these two steps can be treated independently, so that many different schemes can in principle be built from the same numerical framework. Because astrophysical simulations often test out the limits of what is feasible with the computational resources available, it is essential to find the scheme that produces the numerical solution with the desired accuracy at the lowest computational cost. However, establishing the best combination of numerical options in a Godunov-type method to be used for simulating a complex hydrodynamic problem is a nontrivial task. In fact, formally more accurate schemes do not always outperform simpler and more diffusive methods, especially if sharp gradients are present in the flow. For this work, we used our fully compressible Seven-League Hydro (SLH) code to test the accuracy of six reconstruction methods and three approximate Riemann solvers on two- and three-dimensional (2D and 3D) problems involving subsonic flows only. We considered Mach numbers in the range from 10 −3 to 10 −1 , which are characteristic of many stellar and geophysical flows. In particular, we considered a well-posed, 2D, Kelvin–Helmholtz instability problem and a 3D turbulent convection zone that excites internal gravity waves in an overlying stable layer. Although the different combinations of numerical methods converge to the same solution with increasing grid resolution for most of the quantities analyzed here, we find that (i) there is a spread of almost four orders of magnitude in computational cost per fixed accuracy between the methods tested in this study, with the most performant method being a combination of a low-dissipation Riemann solver and a sextic reconstruction scheme; (ii) the low-dissipation solver always outperforms conventional Riemann solvers on a fixed grid when the reconstruction scheme is kept the same; (iii) in simulations of turbulent flows, increasing the order of spatial reconstruction reduces the characteristic dissipation length scale achieved on a given grid even if the overall scheme is only second order accurate; (iv) reconstruction methods based on slope-limiting techniques tend to generate artificial, high-frequency acoustic waves during the evolution of the flow; and (v) unlimited reconstruction methods introduce oscillations in the thermal stratification near the convective boundary, where the entropy gradient is steep.

79 ASTRONOMY AND ASTROPHYSICS↗

Tensile Property and Lifetime Prediction for Low-Temperature Aged Uranium-Niobium Alloys

Thermal aging models and lifetime predictions for uranium-niobium (U-Nb) alloys were created using an approach similar to those previously employed. Lifetime estimates for generic U-6Nb components were thus updated; the reported value being 800 years. This update represents a small change in lifetime vs. that of the 2012 assessment (540 years). This lifetime estimate emerged from consideration of several model fits specific to the aging datasets and properties chosen. Aging was quantified using quasi-static tensile properties measured on specimens artificially aged for up to 10 years. The major change relative to the most recent 2012 LANL assessment was that a more comprehensive body of U-Nb literature data was mined, in addition to being augmented by the latest LANL and UK AWE data. The tensile data compilation was published separately (LANL report LA-14493, December 2016). Recognizing the chemical banding of industrially produced U-6Nb, models were developed for the mid-range (6 wt.%) and extrema (4 and 8 wt.%) compositions. Lifetime estimates were calculated for all three alloy classes (4, 6, 8 wt.% nominal) and two measures of total tensile elongation (TE) to failure, namely TE-ext. — extensometer method, and TE-NCD — normalized crosshead displacement method. The conservative assumption was made that whichever composition (4, 6, or 8 wt.% Nb) and property (TE-ext or TE-NCD) was the first to cross the ductility failure threshold would limit the lifetime of the entire component. Tensile strength properties did not figure into the lifetime predictions, but could be useful as age-sensitive diagnostics and were also modeled. Of these, only first yield strength is expected to show a change at 40°C aging vs. time = 0 over the ~100-year timespan of engineering interest. Second yield strength evolves more slowly, and ultimate tensile strength slower still. Among all the models, the apparent activation energies for aging were mostly in the narrow 29– 37 kcal/mol range, which is close to that for diffusion of Nb in gamma-uranium. This agreement may be coincidental. The data from recent long-term aging studies substantially improved the model fit quality and robustness of the lifetimes. Appendices document sensitivity studies of the model fits and lifetimes with respect to using more limited datasets. These results highlight the limitations of relying solely on data from scattered literature studies and smaller datasets more generally.

36 MATERIALS SCIENCE↗

Quantifying local and global mass balance errors in physics-informed neural networks

Physics-informed neural networks (PINN) have recently become attractive for solving partial differential equations (PDEs) that describe physics laws. By including PDE-based loss functions, physics laws such as mass balance are enforced softly in PINN. This paper investigates how mass balance constraints are satisfied when PINN is used to solve the resulting PDEs. We investigate PINN’s ability to solve the 1D saturated groundwater flow equations (diffusion equations) for homogeneous and heterogeneous media and evaluate the local and global mass balance errors. We compare the obtained PINN’s solution and associated mass balance errors against a two-point finite volume numerical method and the corresponding analytical solution. We also evaluate the accuracy of PINN in solving the 1D saturated groundwater flow equation with and without incorporating hydraulic heads as training data. We demonstrate that PINN’s local and global mass balance errors are significant compared to the finite volume approach. Tuning the PINN’s hyperparameters, such as the number of collocation points, training data, hidden layers, nodes, epochs, and learning rate, did not improve the solution accuracy or the mass balance errors compared to the finite volume solution. Mass balance errors could considerably challenge the utility of PINN in applications where ensuring compliance with physical and mathematical properties is crucial.

54 ENVIRONMENTAL SCIENCES↗

From Latent Dynamics to Meaningful Representations

While representation learning has been central to the rise of machine learning and artificial intelligence, a key problem remains in making the learnt representations meaningful. For this the typical approach is to regularize the learned representation through prior probability distributions. However such priors are usually unavailable or are ad hoc. To deal with this, recent efforts have shifted towards leveraging the insights from physical principles to guide the learning process. In this spirit, we propose a purely dynamics-constrained representation learning framework. Instead of relying on predefined probabilities, we restrict the latent representation to follow overdamped Langevin dynamics with a learnable transition density — a prior driven by statistical mechanics. We show this is a more natural constraint for representation learning in stochastic dynamical systems, with the crucial ability to uniquely identify the ground truth representation. We validate our framework for different systems including a real-world fluorescent DNA movie dataset. Here, we show that our algorithm can uniquely identify orthogonal, isometric and meaningful latent representations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Learning effective stochastic differential equations from microscopic simulations: Linking stochastic numerics to deep learning

We identify effective stochastic differential equations (SDEs) for coarse observables of fine-grained particle- or agent-based simulations; these SDEs then provide useful coarse surrogate models of the fine scale dynamics. We approximate the drift and diffusivity functions in these effective SDEs through neural networks, which can be thought of as effective stochastic ResNets. The loss function is inspired by, and embodies, the structure of established stochastic numerical integrators (here, Euler–Maruyama and Milstein); our approximations can thus benefit from backward error analysis of these underlying numerical schemes. They also lend themselves naturally to “physics-informed” gray-box identification when approximate coarse models, such as mean field equations, are available. Existing numerical integration schemes for Langevin-type equations and for stochastic partial differential equations can also be used for training; we demonstrate this on a stochastically forced oscillator and the stochastic wave equation. Our approach does not require long trajectories, works on scattered snapshot data, and is designed to naturally handle different time steps per snapshot. We consider both the case where the coarse collective observables are known in advance, as well as the case where they must be found in a data-driven manner.

97 MATHEMATICS AND COMPUTING↗