Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Network Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

ThermoPore: Predicting part porosity based on thermal images using deep learning

Part qualification is often a critical and labor-intensive process in additive manufacturing, particularly in the detection of defects such as porosity, which stands to benefit significantly from advancements in machine learning. We present a deep learning approach for quantifying and localizing ex-situ porosity within Laser Powder Bed Fusion fabricated samples utilizing in-situ thermal image monitoring data. Our goal is to build the real time porosity map of parts based on thermal images acquired during the build. The quantification task builds upon the established Convolutional Neural Network model architecture to predict pore count and the localization task leverages the spatial and temporal attention mechanisms of the novel Video Vision Transformer model to indicate areas of expected porosity. Our model for porosity quantification achieved a R 2 score of 0.57 and our model for porosity localization produced an average Intersection over Union (IoU) score of 0.32 and a maximum of 1.0. This work is setting the foundations of part porosity “Digital Twins” based on additive manufacturing monitoring data and can be applied downstream to reduce time-intensive post-inspection and testing activities during part qualification and certification. In addition, we seek to accelerate the acquisition of crucial insights normally only available through ex-situ part evaluation by means of machine learning analysis of in-situ process monitoring data.

Deep learning↗
DOE OSTI2024

Multilabel proportion prediction and out-of-distribution detection on gamma spectra of short-lived fission products

In the machine learning problem of multilabel classification, the objective is to determine for each test instance which classes the instance belongs to. In this work, we consider an extension of multilabel classification, called multilabel proportion prediction, in the context of radioisotope identification (RIID) using gamma spectra data. We aim to not only predict radioisotope proportions, but also identify out-of-distribution (OOD) spectra. We achieve this goal by viewing gamma spectra as discrete probability distributions, and based on this perspective, we develop a custom semi-supervised loss function that combines a traditional supervised loss with an unsupervised reconstruction error function. Our approach was motivated by its application to the analysis of short-lived fission products from spent nuclear fuel. In particular, we demonstrate that a neural network model trained with our loss function can successfully predict the relative proportions of 37 radioisotopes simultaneously. The model trained with synthetic data was then applied to measurements taken by Pacific Northwest National Laboratory (PNNL) to conduct analysis typically done by subject-matter experts. Here, we also extend our approach to successfully identify when measurements are OOD, and thus should not be trusted, whether due to the presence of a novel source or novel proportions.

Anomaly detection↗
DOE OSTI2024

Design and evaluation of a dilute flow particle-to-air heat exchanger for energy storage applications

The use of inert and redox-active particles for high-temperature energy storage requires the development of components that can efficiently transfer energy to high-pressure working fluids like supercritical carbon dioxide (sCO 2 ). Dilute flow reactors can enable high working fluid outlet temperatures and minimal parasitic losses compared to moving packed bed and fluidized bed reactors. This research uses both computational and experimental methods to explore the design trade-offs and practical challenges of a novel component for transferring energy from dilute flows of hot, reduced metal oxide (MO x ) particles to sCO 2 in tubes. A discretized thermal resistance network model, which accounts for particle hydrodynamics, multi-mode heat transfer, and reaction equilibrium, guides the design of a prototype device. This device is experimentally tested with a surrogate heat transfer fluids and inert particle temperatures up to 400°C and a heat duty exceeding 1 kW. The data are used to validate the thermal hydraulic sub-models, allowing for the simulation of reacting particle scenarios. Under nominal design conditions, the flow rate of reactive particles is predicted to be 30% lower than that of inert particles for the same energy recovered, with over 70% of the stored particle energy transferred to the sCO 2 . Furthermore, these findings can inform the design of more efficient energy recovery reactors for particle-based systems and can be integrated into system-level concentrated solar power models with thermal storage to optimize operating conditions.

14 SOLAR ENERGY↗
DOE OSTI2026

Thermoelectric heating and cooling–integrated dishwasher with thermal energy storage

Household dishwashers must address several performance goals: maximize washing and drying performance, while minimizing cycle duration, energy consumption, and water consumption. This study develops and examines a novel thermoelectric heating and cooling (TEHC) system with thermal energy storage applied to a household dishwasher (DW), aiming to improve the energy and drying performance of a commercially-available dishwasher while maintaining its washing performance, water consumption, and cycle duration. Experimental testing conducted on the novel TEHC-DW system demonstrates an 8.7% reduction in total energy consumption, lowering the per-cycle usage to 0.952 kWh, and a 40% reduction in energy consumption for internal water heating. The novel TEHC-DW system also demonstrates better drying performance, shortening the drying time by 42% to reach the same remaining moisture content as a commercially-available system. In addition, a resistance-capacitance network model is developed that predicts total drying time, total energy consumption, and the highest temperature reached in the tub (53.4 °C). The model accuracy is validated with experimental data (within ±1 K), and the model functions as a design tool via a parametric study to evaluate the next-generation design and the effect of the number of thermoelectric modules and thermoelectric driving force (i.e., current). Overall, this study demonstrates the potential for TEHC technology to improve energy efficiency and drying performance in household dishwashers.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Multi-modal characterization and simulation of human epileptic circuitry

Temporal lobe epilepsy is the fourth most common neurological disorder, with about 40% of patients not responding to pharmacological treatment. Increased cellular loss is linked to disease severity and pathological phenotypes such as heightened seizure propensity. While the hippocampus is the target of therapeutic interventions, the impact of the disease at the cellular level remains unclear. Here, we show that hippocampal granule cells change with disease progression as measured in living, resected hippocampal tissue excised from patients with epilepsy. We show that granule cells increase excitability and shorten response latency while also enlarging in cellular volume and spine density. Single-nucleus RNA sequencing combined with simulations ascribes the changes to three conductances: BK, Cav2.2, and Kir2.1. In a network model, we show that these changes related to disease progression bring the circuit into a more excitable state, while reversing them produces a less excitable, “early-disease-like” state.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Incorporating PCM-enabled thermal energy storage into 3D printable cementitious composites

This paper delineates the feasibility of incorporating microencapsulated phase change materials (mPCM) into 3D printable cementitious composite materials. A comprehensive experimental program was carried out to evaluate the impacts of mPCM on the printability, microstructures, mechanical and thermal properties of cementitious 3D printing ‘inks’. Results showed that the mPCM affected the printability of the cementitious ink material based on its physical properties (e.g., particle size) and volume loading – at lower volume loadings, mPCM increased the flowability of the cementitious ink material while leading to increased compressive strength and thermal conductivity for the hardened printed material. However, further increase in mPCM dosage led to a decrease in printability and, therefore, decrease in compressive strength and thermal conductivity as compared to the reference mixture. Here the results also showed that the inclusion of mPCM influence the printing parameters. In general, the inclusion of higher volume contents of mPCM necessitates a higher extrusion rate to achieve a desirable extrudability. Lastly, a thermal network model was formulated for 3D printed mPCM charged building components (e.g., wall). The study shows that microencapsulated PCM materials have good potential to be used in 3D printable cementitious mixtures for improving the thermal and energy performance of 3D printed buildings.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Machine learning enabled discovery of superhard and ultrahard carbon polymorphs

The demand for multifunctional materials has motivated the move from near-equilibrium materials to metastable i.e. out-of-equilibrium phases that can meet several desired target properties. The search for such metastable phases with exotic properties is non-trivial and often serendipitous. Inverse design approaches based on evolutionary search have been powerful tools, but such traditional searches have focused on identifying primarily stable and metastable materials with the lowest enthalpy. The inverse design of materials, with a focus on a desired property such as, for example, hardness is a challenging task because of the expensive computational cost involved in sampling multiple structures. The recent advances in machine learning have brought new powerful AI techniques to the forefront which can potentially revolutionize the inverse design and discovery of materials, especially metastable phases capable of meeting multifunctionality. Here, in this work, we develop and apply an automated reinforcement learning workflow for inverse design that integrates first principles physics and atomistic simulations with machine learning (ML), and high-performance computing to allow rapid exploration of the superhard and ultrahard metastable phases of Carbon. We demonstrate an automatic machine learning based inverse design workflow to map new undiscovered metastable states ranging from near equilibrium to those far-from-equilibrium that satisfy multiple property objectives, specifically bulk moduli, shear moduli and hardness. We create a comprehensive library of carbon stable and metastable phases with varying hardness and subsequently shortlist 10 top performing candidate carbon structures, including two newly reported phases, based on their hardness and characterize their temperature dependent mechanical properties. A neural network model is built using featurization of allotropes of carbon to predict the quasi-harmonic Gibbs free energies. The Gibbs free energies of the top performing phases are analyzed to get an estimate of the experimental synthesizability of these superhard and ultrahard carbon phases. In general, we show using machine learning based inverse design approaches how hitherto inaccessible metastable states can be identified and potentially synthesized to meet the demand for multifunctional materials.

Balasubramanian, Karthik [Univ. of Illinois, Chica↗
DOE OSTI2023

Stochastic generation of electrolyzer anode catalyst layers

Here, we introduce a stochastic methodology to reproduce the complex pore structure observed in commercial iridium catalyst layers. This method preserves the α pore (pores smaller than 250 nm) and β pore (pores greater than or equal to 250 nm) regions of the catalyst layer. The morphology of the generated materials was validated by comparing the pore size distributions of generated materials against those obtained from commercial materials imaged using x-ray nano computed tomography. We further demonstrate that the pore size distributions of the generated materials are statistically indistinguishable from the imaged catalyst layers, indicating that the stochastic methodology is capable of accurately reproducing catalyst layer morphology. Pore network modelling was conducted on the generated catalyst materials to simulate single-phase permeability, electrical conductivity, and ionic conductivity, and these properties were found to be within experimentally measured ranges for electrolyzer catalyst layers. Additionally, simulations were performed on the generated materials with varying ionomer and iridium catalyst loadings. As the ionomer loading is added, proton conductivity increases exponentially, which demonstrates the importance of optimizing ionomer loading, considering that these effects will be exacerbated in the hydration and temperature conditions of operating electrolyzers. The stochastic material generation method presented in this work is a powerful tool for the development of novel low loading catalyst layers, where the effect of various structural parameters on electrolyzer performance characteristics can be explored.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Neural-network based collision operators for the Boltzmann equation

Kinetic gas dynamics in rarefied and moderate-density regimes have complex behavior associated with collisional processes. These processes are generally defined by convolution integrals over a high-dimensional space (as in the Boltzmann operator), or require evaluating complex auxiliary variables (as in Rosenbluth potentials in Fokker-Planck operators) that are challenging to implement and computationally expensive to evaluate. In this work, we develop a data-driven neural network model that augments a simple and inexpensive BGK collision operator with a machine-learned correction term, which improves the fidelity of the simple operator with a small overhead to overall runtime. The composite collision operator has a tunable fidelity and, in this work, is trained using and tested against a direct-simulation Monte-Carlo (DSMC) collision operator.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Anti-symmetric barron functions and their approximation with sums of determinants

A fundamental problem in quantum physics is to encode functions that are completely anti-symmetric under permutations of identical particles. The architecture of neural network models for the electron wave function typically comprises an equivariant component followed by a summation of determinants. The recently introduced Generic Antisymmetric (GA) block is designed to enhance the expressivity of such neural wave functions, and it was found that the 2-layer GA block achieved more accurate energies than the corresponding single-determinant FermiNet architecure, suggesting its promise as a way to improve the expressivity of neural wave functions. In this paper we show how the function expressed by the 2-layer GA block can be decomposed into a sum of determinants. We formalize this result by defining the antisymmetric Barron space as a generalized version of the 2-layer GA block and providing an appromation theorem for this function class. This result can be viewed as a negative result showing that the 2-layer GA block is not more expressive than using multiple determinants.

Abrahamsen, Nilin↗
DOE OSTI2025

Binding and Translocation of Substrate Allosterically Promotes Functional Interactions Within the AlkB–AlkG Electron Transfer Complex

The alkane monooxygenase AlkB and rubredoxin AlkG form an electron transfer complex that hydroxylates terminal alkanes to produce alcohols. The recent cryoEM study of Fontimonas thermophila AlkB-AlkG complex revealed its architecture, including a dodecane (D12) substrate at the active site. However, FtAlkBG molecular mechanism of action of remains unknown. Here, in this study, we examined its dynamics and interactions by multiscale computations, including molecular dynamics simulations, elastic network models, and QM/MM of the oxygen activation mechanism at the AlkB catalytic site. D12 maintained stable interactions within the catalytic site during two MD runs, coordinated by hydrophobic residues L263-L264, I267, I133. A third extended run revealed that D12 could translocate to a membrane-exposed site near S49/F46 along a hydrophobic channel gated by I54. During this translocation, D12 was temporarily stabilized at intermediate sites IS1 (lined by I27/L30-G31/G50/L53-I54/P59/S124/A127-V128) and IS2 (I33-G34/L37/L45-F46/S49) before nearly exiting the protein, and diffused back to the active site, assisted by L30. Substrate binding and translocation across those intermediate sites affects the coupling between the iron centers in AlkBG, and interfacial interactions between AlkB-AlkG. The channel was further connected to the cytosol, near two surface-exposed arginines, potentially allowing for O 2 passage. The allosteric effects between D12 putative entry site, catalytic site and AlkB-AlkG interface were analyzed by ENM-based methods which confirmed the cooperative perturbation-responses and strongly correlated movements of residues belonging to those distal regions. Our study provides new mechanistic insights into key sites and their interactions that could be targeted for developing AlkB-variants with desirable alkane conversion functions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Navigating high-dimensional process-structure–property relations in nanocrystalline Pt-Au alloys with machine learning

For decades, materials scientists have relied on the process-structure–property paradigm to guide investigations into material behaviors. Traditional studies often examine a limited number of process-structure–property variables, striving to elucidate mechanisms governing material response. However, this approach is time consuming and can limit exploration, as well as the discovery of process-structure–property relations in novel materials. In this paper, we combined combinatorial sputter deposition and multi-modal high-throughput materials characterization with feedforward neural networks to establish high-dimensional process-structure–property relations in Pt-Au alloys, yielding nanocrystalline alloys with high hardness and low resistivity relevant to electrical contact switch applications. We mapped three indicators of process conditions (composition and two atomic deposition characteristics) onto four indicators of material structure (X-ray diffraction, film thickness, density, and surface roughness) and two indicators of material properties (hardness and resistivity), resulting in 784 unique combinations evaluated over a 13-dimensional space. The neural networks predicted Pt-Au alloys with 18–24 at.% Au, when deposited at specific conditions, to have a nanoindentation hardness up to 7.2 GPa. This high hardness value, comparable to some steels, represents a 3-fold improvement in hardness over “hard gold”, a commonly used electrical contact alloy, while maintaining requisite electrical conductivity. The neural network models provide an avenue to identify expected process windows capable of maximizing material performance.

Electrical contact materials↗
DOE OSTI2025

Unveiling X-ray absorption signatures of boron nitride via first-principles simulation and machine learning

Boron nitride (BN) allotropes hold great promise in many advanced applications ranging from optical and photonic devices to energy storage and battery systems to tribological components. The diverse functionalities of this material stem from BN’s highly tunable structural and electronic properties, which are governed by the versatile boron–nitrogen bonding configurations. Exploring the structural landscape of BN can unveil novel structures possessing unique properties suited for specific applications, therefore accelerating the design of next-generation advanced functional materials. In this work, we leverage boron K-edge X-ray absorption spectroscopy (XAS) as an effective probe for local structural features and chemical environments. A total of 210 BN crystal structures are generated via analogies to the extensive array of carbon allotropes, and XAS is simulated for each unique local motif within the resulting collection of structures. A mapping between structural features and spectral signatures was established by synergizing first-principle simulations with data-driven based post-analysis approaches. Specifically, we developed a neural network model that can satisfactorily predict spectra line shapes from local structural descriptors. Toward automatic spectroscopic interpretation of any new BN structures, supervised machine learning models, trained on this structure–spectrum dataset, can accurately infer local coordination environments from simulated XAS, highlighting the strength of this unique approach of combining high-fidelity first-principles simulation and machine-learning to accelerate target design of novel BN materials via rational understanding of local structure-spectrum correlations.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Neural network reconstruction of the DIII-D tokamak plasma boundary using a reduced set of diagnostics

This study investigates the feasibility of reconstructing the last closed flux surface in the DIII-D tokamak using neural network models trained on reduced input feature sets, addressing an ill-posed task. Two models are compared: one trained solely on coil currents and another incorporating coil currents, plasma current and loop voltage. The model trained exclusively on coil currents achieved a mean point displacement of $0.04$ m on a held-out test set, while the inclusion of plasma current and loop voltage reduced the error to $0.03$ m. This comparison highlights the trade-offs between input feature complexity and reconstruction accuracy, demonstrating the potential of machine learning algorithms to perform effectively in data-limited environments, such as those expected in fusion power plants due to diagnostic constraints imposed by the presence of blankets and shielding.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Three-Dimensional Pore Networks in Miocene Stevens Sandstone of California: Implications for CO 2 Geologic Storage

The Miocene Stevens Sandstone in the San Joaquin Basin of California is increasingly recognized as a promising candidate for CO 2 geological storage due to the enormous storage capacity, proven sealing, and existing infrastructure. In this study, computed microtomography imaging and pore network modeling were employed to investigate the influence of pore geometry and wettability on the CO 2 injectivity and residual trapping. Image analysis revealed that a significant fraction of the cement and matrix consists of microporous regions. The microporosity can substantially increase the overall pore space, yet its contribution to permeability remains modest, particularly in samples with low permeability. The intrinsic heterogeneity of turbidite reservoirs further complicates the reservoir properties among different layers. Two-phase flow simulations under varying wettability conditions (water-wet, weak water-wet, and neutral-wet) demonstrated that the CO 2 injection is predominantly controlled by macropores. CO 2 invades microporous regions only after these larger pores are filled. The presence of microporosity leads to a decrease in both initial and residual CO 2 saturations, with the magnitude of the reduction being influenced by wettability. Neutral-wet scenarios exhibit higher CO 2 mobility and thus lower residual trapping than water-wet scenarios. The results imply that heterogeneity in pore geometry and cement distribution across different layers can result in stratified CO 2 flow pathways, complicating efforts to predict injection performance. Overall, the Stevens Sandstone shows considerable promise for CO 2 geologic storage, but effective implementation will require detailed characterization of the pore structure as well as the integration of reactive fluid flow to account for potential mineral dissolution and fines migration.

fluids↗
DOE OSTI2024

A Deep Learning Based Framework to Identify Undocumented Orphaned Oil and Gas Wells from Historical Maps: A Case Study for California and Oklahoma

Undocumented Orphaned Wells (UOWs) are wells without an operator that have limited or no documentation with regulatory authorities. An estimated 310,000 to 800,000 UOWs exist in the United States (US), whose locations are largely unknown. These wells can potentially leak methane and other volatile organic compounds to the atmosphere, and contaminate groundwater. In this study, we developed a novel framework utilizing a state-of-the-art computer vision neural network model to identify the precise locations of potential UOWs. The U-Net model is trained to detect oil and gas well symbols in georeferenced historical topographic maps, and potential UOWs are identified as symbols that are further than 100 m from any documented well. A custom tool was developed to rapidly validate the potential UOW locations. We applied this framework to four counties in California and Oklahoma, leading to the discovery of 1301 potential UOWs across >40,000 km 2 . We confirmed the presence of 29 UOWs from satellite images and 15 UOWs from magnetic surveys in the field with a spatial accuracy on the order of 10 m. This framework can be scaled to identify potential UOWs across the US since the historical maps are available for the entire nation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Single-Point Extrapolation to the Complete Basis Set Limit through Deep Learning

Machine learning (ML) offers an attractive method for making predictions about molecular systems while circumventing the need to run expensive electronic structure calculations. Once trained on ab initio data, the promise of ML is to deliver accurate predictions of molecular properties that were previously computationally infeasible. In this work, we develop and train a graph neural network model to correct the basis set incompleteness error (BSIE) between a small and large basis set at the RHF and B3LYP levels of theory. Our results show that, when compared to fitting to the total potential, an ML model fitted to correct the BSIE is better at generalizing to systems not seen during training. We test this ability by training on single molecules while evaluating on molecular complexes. We also show that ensemble models yield better behaved potentials in situations where the training data is insufficient. However, even when only fitting to the BSIE, acceptable performance is only achieved when the training data sufficiently resemble the systems one wants to make predictions on. As a result, the test error of the final model trained to predict the difference between the cc-pVDZ and cc-pV5Z potential is 0.184 kcal/mol for the B3LYP density functional, and the ensemble model accurately reproduces the large basis set interaction energy curves on the S66x8 dataset.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Processing-Dependent Structure and Poroelasticity of Nafion in Liquid Water

Ionomers act as the solid polymer electrolyte membrane in many modern electrochemical devices, yet the role of their nanostructure in modulating the poroelastic response remains poorly understood, especially in liquid water, where few techniques can measure simultaneous transport-mechanical properties. Poroelastic Relaxation Indentation (PRI) is uniquely suited for measuring time-dependent transport-mechanical properties of porous solids, specifically hydraulic diffusivity, elastic modulus, Poisson’s ratio, and intrinsic permeability, for porous solids. While ionomers such as Nafion are not porous in the typical sense, Nafion has a nanophase-segregated structure that, when fully swollen in liquid water, behaves as a poroelastic solid with a coupled mechanical-transport response. Using a poroelastic framework, we investigate how casting and pretreatment of Nafion membranes alter their poroelastic response in liquid environments. We characterize both extruded and dispersion-cast Nafion membranes pretreated in water at 25 or 100 °C and relate the mechanical-transport properties to the ionomer structure via hydrophilic and intercrystalline domain spacing measured using Small-Angle X-ray Scattering (SAXS). At 25 °C, dispersion-cast membranes exhibit distinctly lower hydraulic diffusivity and intrinsic permeability than extruded membranes but with comparable mechanical properties. Pretreatment at 100 °C increases hydrophilic domain spacing, improving transport but at the expense of mechanical stiffness. Dispersion-cast membranes respond more strongly to pretreatment than extruded membranes. Using the Carman-Kozeny pore network model and the hydrophilic domain-spacing, we estimate the pore radius and tortuosity to show how pretreatment reduces structure-related tortuosity differences between dispersion-cast and extruded membranes. Here, in this work, we show that nanophase-segregated materials such as Nafion can be rigorously characterized using poroelasticity, resulting in physically meaningful transport-mechanical properties. Coupling PRI with SAXS provides insights into the nanostructural features that govern the coupled mechanical-transport response. By establishing PRI for a nanophase-segregated material, this approach opens avenues for this technique’s application in other hydrated polymeric materials not typically considered to be poroelastic.

Shen, Margaret [University of California, Berkeley↗