Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “complex network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Improving materials property predictions for graph neural networks with minimal feature engineering *

Graph neural networks (GNNs) have been employed in materials research to predict physical and functional properties, and have achieved superior performance in several application domains over prior machine learning approaches. Recent studies incorporate features of increasing complexity such as Gaussian radial functions, plane wave functions, and angular terms to augment the neural network models, with the expectation that these features are critical for achieving a high performance. Here, we propose a GNN that adopts edge convolution where hidden edge features evolve during training and extensive attention mechanisms, and operates on simple graphs with atoms as nodes and distances between them as edges. As a result, the same model can be used for very different tasks as no other domain-specific features are used. With a model that uses no feature engineering, we achieve performance comparable with state-of-the-art models with elaborate features for formation energy and band gap prediction with standard benchmarks; we achieve even better performance when the dataset size increases. Although some domain-specific datasets still require hand-crafted features to achieve state-of-the-art results, our selected architecture choices greatly reduce the need for elaborate feature engineering and still maintain predictive power in comparison.

42 ENGINEERING↗

Learning Only on Boundaries: A Physics-Informed Neural Operator for Solving Parametric Partial Differential Equations in Complex Geometries

Recently, deep learning surrogates and neural operators have shown promise in solving partial differential equations (PDEs). However, they often require a large amount of training data and are limited to bounded domains. In this work, we present a novel physics-informed neural operator method to solve parameterized boundary value problems without labeled data. By reformulating the PDEs into boundary integral equations (BIEs), we can train the operator network solely on the boundary of the domain. This approach reduces the number of required sample points from $O(N^d)$ to $O(N^{d-1}$), where $d$ is the domain’s dimension, leading to a significant acceleration of the training process. Additionally, our method can handle unbounded problems, which are unattainable for existing physics-informed neural networks (PINNs) and neural operators. Finally, our numerical experiments show the effectiveness of parameterized complex geometries and unbounded problems.

97 MATHEMATICS AND COMPUTING↗

ZeoNet: 3D convolutional neural networks for predicting adsorption in nanoporous zeolites

Zeolites are one of the most widely used materials in the chemical industry due to their nanometer-sized pores that can adsorb and react upon molecules selectively. With hundreds of known framework topologies and hundreds of thousands of computationally predicted structures, the ability to rapidly predict zeolite performance allows researchers to prioritize their efforts on the most promising structures for a given application. Although the accuracy of forcefield-based atomistic simulations has advanced significantly in the past two decades, these simulations can be computationally expensive, especially for long-chain, complex molecules. Here, we present ZeoNet, a representation learning framework using convolutional neural networks (ConvNets) and 3D volumetric representations for predicting adsorption in zeolites. ZeoNet was trained on the task of predicting Henry's constants for adsorption, k H , of n-octadecane in more than 330 000 known and predicted zeolite materials. Employing a 3D grid based on the distances to solvent-accessible surfaces, a volumetric representation that can be generated efficiently, the best-performing ZeoNet achieved a correlation coefficient r 2 = 0.977 and a mean-squared error MSE = 3.8 in ln k H , which corresponds to an error of 9.3 kJ mol -1 in adsorption free energy. In comparison, a model based on hand-designed geometric features has values of r 2 = 0.783 and MSE = 35.7. ZeoNet is also relatively efficient and can process ≈8 structures per second on an Nvidia RTX 2080TI GPU, orders of magnitude faster than forcefield-based simulations. A systematic analysis was conducted to investigate how the choice of ConvNet architectures, the linear dimension (L) and spatial resolution (Δd) of the distance grids, batch size, optimizer, and learning rate impact the model performance. We found that ConvNets based on the ResNet architecture offer the best tradeoff between expressiveness and efficiency. The performance for all models reaches a plateau at L = 30–45 Å and depends less sensitively on grid resolution, with a small benefit around Δd = 0.30–0.45 Å. Finally, saliency maps were visualized to identify which regions of the materials contributed the most to model predictions. It was found, interestingly, that the predictions are driven primarily by the accessible pore volume rather than the region occupied by the framework atoms.

36 MATERIALS SCIENCE↗

Embedding hard physical constraints in neural network coarse-graining of three-dimensional turbulence

In recent years, deep learning approaches have shown much promise in modeling complex systems in the physical sciences. A major challenge in deep learning of partial differential equations is enforcing physical constraints and boundary conditions. In this work, we propose a general framework to directly embed the notion of an incompressible fluid into convolutional neural networks, and apply this to coarse-graining of turbulent flow. These physics-embedded neural networks leverage interpretable strategies from numerical methods and computational fluid dynamics to enforce physical laws and boundary conditions by taking advantage the mathematical properties of the underlying equations. Here, we demonstrate results on three-dimensional fully developed turbulence, showing that this technique drastically improves local conservation of mass, without sacrificing performance according to several other metrics characterizing the fluid flow.

97 MATHEMATICS AND COMPUTING↗

CONCURRENT, CONDENSED STEIN VARIATIONAL GRADIENT DESCENT FOR UNCERTAINTY QUANTIFICATION OF NEURAL NETWORKS

In this work, we propose a Stein variational gradient descent (SVGD) method to concurrently sparsify, train, and provide uncertainty quantification (UQ) of a complexly parameterized model, such as a neural network (NN). It employs a graph reconciliation and condensation process to reduce complexity and increase similarity in the Stein ensemble of parameterizations. Therefore, the proposed concurrent, condensed SVGD (ccSVGD) method can provide UQ on parameters, not just outputs. Furthermore, the parameter reduction speeds up the convergence of the Stein gradient descent as it reduces the combinatorial complexity by aligning and differentiating the sensitivity to parameters. These properties are demonstrated with an illustrative example and an application to a mechanical response representation problem in solid mechanics.

42 ENGINEERING↗

Scattering-based structural inversion of soft materials via Kolmogorov–Arnold networks

Small-angle scattering techniques are indispensable tools for probing the structure of soft materials. However, traditional analytical models often face limitations in structural inversion for complex systems, primarily due to the absence of closed-form expressions of scattering functions. To address these challenges, we present a machine learning framework based on the Kolmogorov–Arnold Network (KAN) for directly extracting real-space structural information from scattering spectra in reciprocal space. This model-independent, data-driven approach provides a versatile solution for analyzing intricate configurations in soft matter. By applying the KAN to lyotropic lamellar phases and colloidal suspensions—two representative soft matter systems—we demonstrate its ability to accurately and efficiently resolve structural collectivity and complexity. Here, our findings highlight the transformative potential of machine learning in enhancing the quantitative analysis of soft materials, paving the way for robust structural inversion across diverse systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

New Mechanistic and Reaction Pathway Insights for Oxidative Coupling of Methane (OCM) over Supported Na 2 WO 4 /SiO 2 Catalysts

Abstract The complex structure of the catalytic active phase, and surface‐gas reaction networks have hindered understanding of the oxidative coupling of methane (OCM) reaction mechanism by supported Na 2 WO 4 /SiO 2 catalysts. The present study demonstrates, with the aid of in situ Raman spectroscopy and chemical probe (H 2 ‐TPR, TAP and steady‐state kinetics) experiments, that the long speculated crystalline Na 2 WO 4 active phase is unstable and melts under OCM reaction conditions, partially transforming to thermally stable surface Na‐WO x sites. Kinetic analysis via temporal analysis of products (TAP) and steady‐state OCM reaction studies demonstrate that ( i ) surface Na‐WO x sites are responsible for selectively activating CH 4 to C 2 H x and over‐oxidizing CH y to CO and ( ii ) molten Na 2 WO 4 phase is mainly responsible for over‐oxidation of CH 4 to CO 2 and also assists in oxidative dehydrogenation of C 2 H 6 to C 2 H 4 . These new insights reveal the nature of catalytic active sites and resolve the OCM reaction mechanism over supported Na 2 WO 4 /SiO 2 catalysts.

Sourav, Sagar↗

New Mechanistic and Reaction Pathway Insights for Oxidative Coupling of Methane (OCM) over Supported Na 2 WO 4 /SiO 2 Catalysts

Abstract The complex structure of the catalytic active phase, and surface‐gas reaction networks have hindered understanding of the oxidative coupling of methane (OCM) reaction mechanism by supported Na 2 WO 4 /SiO 2 catalysts. The present study demonstrates, with the aid of in situ Raman spectroscopy and chemical probe (H 2 ‐TPR, TAP and steady‐state kinetics) experiments, that the long speculated crystalline Na 2 WO 4 active phase is unstable and melts under OCM reaction conditions, partially transforming to thermally stable surface Na‐WO x sites. Kinetic analysis via temporal analysis of products (TAP) and steady‐state OCM reaction studies demonstrate that ( i ) surface Na‐WO x sites are responsible for selectively activating CH 4 to C 2 H x and over‐oxidizing CH y to CO and ( ii ) molten Na 2 WO 4 phase is mainly responsible for over‐oxidation of CH 4 to CO 2 and also assists in oxidative dehydrogenation of C 2 H 6 to C 2 H 4 . These new insights reveal the nature of catalytic active sites and resolve the OCM reaction mechanism over supported Na 2 WO 4 /SiO 2 catalysts.

Sourav, Sagar↗

Jet tagging in the Lund plane with graph networks

The identification of boosted heavy particles such as top quarks or vector bosons is one of the key problems arising in experimental studies at the Large Hadron Collider. In this article, we introduce LundNet, a novel jet tagging method which relies on graph neural networks and an efficient description of the radiation patterns within a jet to optimally disentangle signatures of boosted objects from background events. We apply this framework to a number of different benchmarks, showing significantly improved performance for top tagging compared to existing state-of-the-art algorithms. We study the robustness of the LundNet taggers to non-perturbative and detector effects, and show how kinematic cuts in the Lund plane can mitigate overfitting of the neural network to model-dependent contributions. Finally, we consider the computational complexity of this method and its scaling as a function of kinematic Lund plane cuts, showing an order of magnitude improvement in speed over previous graph-based taggers.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Deep learning of free boundary and Stefan problems

Free boundary problems appear naturally in numerous areas of mathematics, science and engineering. These problems present a great computational challenge because they necessitate numerical methods that can yield an accurate approximation of free boundaries and complex dynamic interfaces. In this work, we propose a multi-network model based on physics-informed neural networks to tackle a general class of forward and inverse free boundary problems called Stefan problems. Specifically, we approximate the unknown solution as well as any moving boundaries by two deep neural networks. Besides, we formulate a new type of inverse Stefan problems that aim to reconstruct the solution and free boundaries directly from sparse and noisy measurements. We demonstrate the effectiveness of our approach in a series of benchmarks spanning different types of Stefan problems, and illustrate how the proposed framework can accurately recover solutions of partial differential equations with moving boundaries and dynamic interfaces. All code and data accompanying this manuscript are publicly available at https://github.com/PredictiveIntelligenceLab/DeepStefan.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Ab-Initio molecular dynamics simulations of binary NaCl-ThCl 4 and ternary NaCl-ThCl 4 -UCl 3 molten salts

Molten salt reactor (MSR) with Thorium (Th) fuel cycle has attracted growing attention due to its merits such as safety, low radioactive waste production, and non-proliferation. The design and safe operation of MSR rely on a thorough understanding of the thermophysical properties of molten salts over a wide range of composition and temperature. However, experimental data of Th-based molten salts are limited due to the inherent challenges of dealing with corrosive molten salts and the radioactive nature of actinides. Here, in this work, thermophysical properties including density, heat capacity, thermal expansion coefficient, and mixing energy of binary NaCl-ThCl 4 and ternary NaCl-ThCl 4 -UCl 3 molten salts are explored using ab-initio molecular dynamic simulations (AIMD) with the dDsC dispersion correction. The calculated mixing energy of binary NaCl-ThCl 4 exhibits a minimum close to the eutectic composition. The heat capacity of the mixtures is linearly dependent on the mole fraction of each component. 7-fold and 6-fold coordinated Th complexes are dominant in the mixtures. 8-fold coordinated Th complex increases with ThCl 4 fraction due to the formation of network structures. The average coordination number of Th exhibits a minimum near the eutectic composition. The minimum mixing energy for the ternary mixtures is observed in systems with a composition close to [NaCl] 0.5 [ThCl 4 ] 0.25 [UCl 3 ] 0.25 . The density positively deviates from the ideal solution in mixtures near this composition. These results are important to fill the data and knowledge gap of ThCl 4 molten salts.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Structure and properties of densified silica glass: characterizing the order within disorder

The broken symmetry in the atomic-scale ordering of glassy versus crystalline solids leads to a daunting challenge to provide suitable metrics for describing the order within disorder, especially on length scales beyond the nearest neighbor that are characterized by rich structural complexity. Here, we address this challenge for silica, a canonical network-forming glass, by using hot versus cold compression to (i) systematically increase the structural ordering after densification and (ii) prepare two glasses with the same high-density but contrasting structures. The structure was measured by high-energy X-ray and neutron diffraction, and atomistic models were generated that reproduce the experimental results. The vibrational and thermodynamic properties of the glasses were probed by using inelastic neutron scattering and calorimetry, respectively. Traditional measures of amorphous structures show relatively subtle changes upon compacting the glass. The method of persistent homology identifies, however, distinct features in the network topology that change as the initially open structure of the glass is collapsed. The results for the same high-density glasses show that the nature of structural disorder does impact the heat capacity and boson peak in the low-frequency dynamical spectra. Densification is discussed in terms of the loss of locally favored tetrahedral structures comprising oxygen-decorated SiSi 4<:sub> tetrahedra.

36 MATERIALS SCIENCE↗

A neural network-based approach to predicting absorption in nanostructured, disordered photoelectrodes

Disordered nanostructures in photoelectrodes can increase light absorption in photoelectrochemical system designs. Predicting their optical properties is an elusive task due to the immensity of unique configurations and the intrinsic variance of each. A neural network trained from a small subset of simulations can emulate the complex absorption properties of the entire configuration space for a model disordered system with quantifiable accuracy and computational efficiency.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Activated penetrant dynamics in glass forming liquids: size effects, decoupling, slaving, collective elasticity and correlation with matrix compressibility

In this work, we employ the microscopic self-consistent cooperative hopping theory of penetrant activated dynamics in glass forming viscous liquids and colloidal suspensions to address new questions over a wide range of high matrix packing fractions and penetrant-to-matrix particle size ratios. The focus is on the mean activated relaxation time of smaller tracers in a hard sphere fluid of larger particle matrices. This quantity also determines the penetrant diffusion constant and connects directly with the structural relaxation time probed in an incoherent dynamic structure factor measurement. The timescale of the non-activated fast dissipative process is also studied and is predicted to follow power laws with the contact value of the penetrant–matrix pair correlation function and the penetrant–matrix size ratio. For long time penetrant relaxation, in the relatively lower packing fraction metastable regime the local cage barriers are dominant and matrix collective elasticity effects unimportant. As packing fraction and/or penetrant size grows, much higher barriers emerge and the collective elasticity associated with the correlated matrix dynamic displacement that facilitates penetrant hopping becomes important. This results in a non-monotonic variation with packing fraction of the degree of decoupling between the matrix and penetrant alpha relaxation times. The conditions required for penetrant hopping to become slaved to the matrix alpha process are determined, which depend mainly on the penetrant to matrix particle size ratio. By analyzing the absolute and relative importance of the cage and elastic barriers we establish a mechanistic understanding of the origin of the predicted exponential growth of the penetrant hopping time with size ratio predicted at very high packing fractions. A dynamics-thermodynamics power law connection between the penetrant activation barrier and the matrix dimensionless compressibility is established as a prediction of theory, with different scaling exponents depending on whether matrix collective elasticity effects are important. Quantitative comparisons with simulations of the penetrant relaxation time, diffusion constant, and transient localization length of tracers in dense colloidal suspensions and cold viscous liquids reveal good agreements. Multiple new predictions are made that are testable via future experiments and simulations. Extension of the theoretical approach to more complex systems of high experimental interest (nonspherical molecules, semiflexible polymers, crosslinked networks) interacting via variable hard or soft repulsions and/or short range attractions is possible, including under external deformation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Temperature-dependent collective magnetization reversal in a network of ferromagnetic nanowires

The collective behavior of geometrically frustrated magnetization in connected networks of ferromagnetic nanowires, known as artificial spin ice, leads to complex magnetotransport behavior in those structures. Here, we present temperature- and current-dependent magnetotransport studies on a connected square artificial spin-ice system and correlate our observations to micromagnetic simulations. We find that the field at which the lattice magnetization collectively switches increases as the temperature is lowered. Our experimental findings highlight the importance of the global and local temperatures for the onset of a collective magnetization reversal in the connected system. These studies may also provide useful insights into novel storage concepts and applications in neuromorphic computing.

36 MATERIALS SCIENCE↗

A Computational Framework for Control Co-Design of Resilient Cyber–Physical Systems With Applications to Microgrids

Critical infrastructure networks, such as power and transportation networks, can be modelled as cyber-physical systems. As the complexity of such systems grow, there is need for developing metrics and design tools that will co-optimize the physical components of the system and the control policies to guarantee resilience against cyber and natural threats. To that end, we develop a simulation-based control co-design computational framework that will concurrently determine the system and control parameters of a cyber-physical system to meet pre-specified resilience, operational and economic objectives. Here, the capabilities of the developed co-design engine is demonstrated by designing the physical components and control parameters of a microgrid system that will meet its resiliency objectives when subjected to various cyber and physical threats.

97 MATHEMATICS AND COMPUTING↗

Tritium Transport Modeling at the Pore Scale in Ceramic Breeder Materials Using TMAP8

Fusion reactors depend on the blanket material to breed and release tritium at the same rate or faster than it is consumed by the fusion reaction. Cellular ceramic breeders (CCBs) are dense materials that can maintain a high tritium breeding ratio while promoting tritium release because of highly connected pores. Assessing the tritium breeding capabilities of these materials requires a combination of extensive experimental and modeling efforts. In this work, we develop and calibrate a multiphysics model of tritium transport. This novel model accounts for ceramic and pore diffusion, trapping and detrapping, and several surface reactions at the pore surface. We perform a sensitivity analysis and calibrate the model by comparing its predictions against experimental measurements of deuterium absorption. The calibrated model is then used to model tritium absorption in samples with different pore microstructures to investigate the effect of pore interconnectivity on tritium absorption. The model is part of the development of the multiscale, multiphysics framework for tritium transport [i.e., the Tritium Migration Analysis Program (TMAP8)], which is itself built on top of the finite-element multiphysics framework multiphysics object-oriented simulation environment (MOOSE). This study demonstrates some of TMAP8’s capabilities and is the first step toward assessing the tritium breeding capabilities of ceramic breeder material designs.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Identification of a diguanylate cyclase expressed in the presence of plants and its application for discovering candidate gene products involved in plant colonization by Pantoea sp. YR343

Microbial colonization of plant roots is a highly complex process that requires the coordination and regulation of many gene networks, yet the identities and functions of many of these gene products have yet to be discovered. Pantoea sp. YR343, a gamma-proteobacterium isolated from the rhizosphere of Populus deltoides , forms robust biofilms along the root surfaces of Populus and possesses plant growth-promoting characteristics. In this work, we identified three diguanylate cyclases in the plant-associated microbe Pantoea sp. YR343 that are expressed in the presence of plant roots. One of these diguanylate cyclases, DGC2884, localizes to discrete sites in the cells and its overexpression results in reduced motility and increased EPS production and biofilm formation. We performed a genetic screen by expressing this diguanylate cyclase from an inducible promoter in order to identify candidate gene products that may be involved in root colonization by Pantoea sp. YR343. Further, we demonstrate the importance of other domains in DGC2884 to its activity, which in combination with the genes identified by transposon mutagenesis, may yield insights into the mechanisms of plant association as well as the activity and regulation of homologous enzymes in medically and agriculturally relevant microbes.

59 BASIC BIOLOGICAL SCIENCES↗