Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “prediction methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Differentiable modelling to unify machine learning and physical models for geosciences

Process-based modelling offers interpretability and physical consistency in many domains of geosciences but struggles to leverage large datasets efficiently. Machine-learning methods, especially deep networks, have strong predictive skills yet are unable to answer specific scientific questions. Here, in this Perspective, we explore differentiable modelling as a pathway to dissolve the perceived barrier between process-based modelling and machine learning in the geosciences and demonstrate its potential with examples from hydrological modelling. ‘Differentiable’ refers to accurately and efficiently calculating gradients with respect to model variables or parameters, enabling the discovery of high-dimensional unknown relationships. Differentiable modelling involves connecting (flexible amounts of) prior physical knowledge to neural networks, pushing the boundary of physics-informed machine learning. It offers better interpretability, generalizability, and extrapolation capabilities than purely data-driven machine learning, achieving a similar level of accuracy while requiring less training data. Additionally, the performance and efficiency of differentiable models scale well with increasing data volumes. Under data-scarce scenarios, differentiable models have outperformed machine-learning models in producing short-term dynamics and decadal-scale trends owing to the imposed physical constraints. Differentiable modelling approaches are primed to enable geoscientists to ask questions, test hypotheses, and discover unrecognized physical relationships. Future work should address computational challenges, reduce uncertainty, and verify the physical significance of outputs.

58 GEOSCIENCES↗
DOE OSTI2022

Mechanistic insights into metal, nitrogen doped carbon catalysts for oxygen reduction: progress in computational modeling

We report metal and nitrogen doped carbon materials (denoted as M–N–C) synthesized through high-temperature pyrolysis have been found to exhibit activity for oxygen reduction reaction (ORR) approaching that of Pt and electrochemical stability higher than previous MN 4 -containing macrocyclic molecular catalysts. Tremendous efforts have thus been devoted to the advancement of M–N–C catalysts as an economical alternative to Pt-based catalysts for proton exchange membrane fuel cell cathodes with a focus on simultaneously improving activity and stability. To this end, novel computational modeling techniques have been developed and applied to acquire knowledge crucial for accelerating the pace of M–N–C catalyst development. In this review, recent progress in computational method development, as well as the predictions of chemical structure of active sites, reaction pathways, ORR kinetics, and catalyst stability in electrochemical environments, are critically surveyed. Moreover, the crucial role of computational modeling to elucidate the functional mechanism of M–N–C catalysts for ORR in acid media and enable rational design of M–N–C catalysts is discussed with a visionary outlook for the field.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Diffusion of Sn donors in β-Ga 2 O 3

Diffusion of the n-type dopant Sn in β-Ga 2 O 3 is studied using secondary-ion mass spectrometry combined with hybrid functional calculations. The diffusion of Sn from a Sn-doped bulk substrate with surface orientation (001) into an epitaxial layer is observed after heat treatments in the temperature range of 1050–1250 °C. Calculated formation energies of Sn-related and intrinsic defects show that the migration of Sn is mediated by Ga vacancies ( V Ga ) through the formation and dissociation of intermittent mobile V Ga Sn Ga complexes. The evolution of the Sn concentration vs depth profiles after heat treatments can be well described by a reaction–diffusion model. Using model parameters guided by the hybrid functional calculations, we extract a V Ga Sn Ga complex migration barrier of 3.0 ± 0.4 eV with a diffusion coefficient of 2 × 10 –1 cm 2 /s. The extracted migration barrier is consistent with our theoretical predictions using the nudged elastic band method, which shows migration barriers of 3.42, 3.15, and 3.37 eV for the [100], [010], and [001] directions, respectively.

36 MATERIALS SCIENCE↗
DOE OSTI2026

INR-TEM: Robust cavity detection in multifocus TEM images via implicit neural representations

When characterizing materials using transmission electron microscopy (TEM) images, detecting and quantifying small features in microstructures, such as cavities, pose significant challenges. Off-the-shelf object detection models, including YOLOv8, show considerable performance degradation, particularly when images vary in resolution and the objects of interest possess a low percentage of the total image region of interest. In this study, we introduce a novel detection pipeline that incorporates an implicit neural representation (INR)-based detection method, INR-TEM, and two-modality imaging (e.g., under-focused and over-focused images typically acquired during materials characterization) to improve object detection performance. The INR-TEM method incorporates a pixel-wise prediction principle inspired by pixel-wise centerness weighting. INR-TEM demonstrates superior robustness to resolution variability, maintaining high detection accuracy even at low image resolutions compared to YOLOv8. To leverage INR-TEM effectively in real-world two-modality characterization applications, we further integrate a two-stage motion correction pipeline designed explicitly for aligning multifocus TEM images. The alignment process, comprising keypoint (based on scale-invariant feature transform, SIFT) and intensity matching, significantly mitigates the adverse effects of perceived motion-induced image degradation during through-focal TEM imaging, directly enhancing INR-TEM’s detection capability over conventional single-focus images. Our integrated INR-TEM cavity detection framework notably improves performance across various cavity sizes, outperforming off-the-shelf YOLOv8 detections that rely on a single image modality.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

An integrated manifold learning approach for high-dimensional data feature extractions and its applications to online process monitoring of additive manufacturing

As an effective dimension reduction and feature extraction technique, manifold learning has been successfully applied to high-dimensional data analysis. With the rapid development of sensor technology, a large amount of high-dimensional data such as image streams can be easily available. Thus, a promising application of manifold learning is in the field of sensor signal analysis, particular for the applications of online process monitoring and control using high-dimensional data. The objective of this study is to develop a manifold learning-based feature extraction method for process monitoring of Additive Manufacturing (AM) using online sensor data. Due to the non-parametric nature of most existing manifold learning methods, their performance in terms of computational efficiency, as well as noise resistance has yet to be improved. To address this issue, this study proposes an integrated manifold learning approach termed multi-kernel metric learning embedded isometric feature mapping (MKML-ISOMAP) for dimension reduction and feature extraction of online high-dimensional sensor data such as images. Based on the extracted features with the utilization of supervised classification and regression methods, an online process monitoring methodology for AM is implemented to identify the actual process quality status. Finally, in the numerical simulation and real-world case studies, the proposed method demonstrates excellent performance in both prediction accuracy and computational efficiency.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Transformer-powered surrogates close the ICF simulation-experiment gap with extremely limited data

Abstract Recent advances in machine learning, specifically transformer architecture, have led to significant advancements in commercial domains. These powerful models have demonstrated superior capability to learn complex relationships and often generalize better to new data and problems. This paper presents a novel transformer-powered approach for enhancing prediction accuracy in multi-modal output scenarios, where sparse experimental data is supplemented with simulation data. The proposed approach integrates transformer-based architecture with a novel graph-based hyper-parameter optimization technique. The resulting system not only effectively reduces simulation bias, but also achieves superior prediction accuracy compared to the prior method. We demonstrate the efficacy of our approach on inertial confinement fusion experiments, where only 10 shots of real-world data are available, as well as synthetic versions of these experiments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Non-asymptotic analysis of ensemble Kalman updates: effective dimension and localization

Many modern algorithms for inverse problems and data assimilation rely on ensemble Kalman updates to blend prior predictions with observed data. Ensemble Kalman methods often perform well with a small ensemble size, which is essential in applications where generating each particle is costly. This paper develops a non-asymptotic analysis of ensemble Kalman updates, which rigorously explains why a small ensemble size suffices if the prior covariance has moderate effective dimension due to fast spectrum decay or approximate sparsity. Here, we present our theory in a unified framework, comparing everal implementations of ensemble Kalman updates that use perturbed observations, square root filtering and localization. As part of our analysis, we develop new dimension-free covariance estimation bounds for approximately sparse matrices that may be of independent interest.

Mathematics↗
DOE OSTI2022

GFINNs: GENERIC formalism informed neural networks for deterministic and stochastic dynamical systems

Here we propose the GENERIC formalism informed neural networks (GFINNs) that obey the symmetric degeneracy conditions of the GENERIC formalism. GFINNs comprise two modules, each of which contains two components. We model each component using a neural network whose architecture is designed to satisfy the required conditions. The component-wise architecture design provides flexible ways of leveraging available physics information into neural networks. We prove theoretically that GFINNs are sufficiently expressive to learn the underlying equations, hence establishing the universal approximation theorem. We demonstrate the performance of GFINNs in three simulation problems: gas containers exchanging heat and volume, thermoelastic double pendulum and the Langevin dynamics. In all the examples, GFINNs outperform existing methods, hence demonstrating good accuracy in predictions for both deterministic and stochastic systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Coefficient-to-Basis Network: a fine-tunable operator learning framework for inverse problems with adaptive discretizations and theoretical guarantees

We propose a Coefficient-to-Basis Network (C2BNet), a novel framework for solving inverse problems within the operator learning paradigm. C2BNet efficiently adapts to different discretizations through fine-tuning, using a pre-trained model to significantly reduce computational cost while maintaining high accuracy. Unlike traditional approaches that require retraining from scratch for new discretizations, our method enables seamless adaptation without sacrificing predictive performance. Furthermore, we establish theoretical approximation and generalization error bounds for C2BNet by exploiting low-dimensional structures in the underlying datasets. Our analysis demonstrates that C2BNet adapts to low-dimensional structures without relying on explicit encoding mechanisms, highlighting its robustness and efficiency. To validate our theoretical findings, we conducted extensive numerical experiments that showcase the superior performance of C2BNet on several inverse problems. The results confirm that C2BNet effectively balances computational efficiency and accuracy, making it a promising tool to solve inverse problems in scientific computing and engineering applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

The Atacama Cosmology Telescope: Detection of the pairwise kinematic Sunyaev-Zel’dovich effect with SDSS DR15 galaxies

We present a 5.4$\sigma$ detection of the pairwise kinematic Sunyaev-Zel'dovich (kSZ) effect using Atacama Cosmology Telescope (ACT) and $\it{Planck}$ CMB observations in combination with Luminous Red Galaxy samples from the Sloan Digital Sky Survey (SDSS) DR15 catalog. Results are obtained using three ACT CMB maps: co-added 150 GHz and 98 GHz maps, combining observations from 2008-2018 (ACT DR5), which overlap with SDSS DR15 over 3,700 sq. deg., and a component-separated map using night-time only observations from 2014-2015 (ACT DR4), overlapping with SDSS DR15 over 2,089 sq. deg. Comparisons of the results from these three maps provide consistency checks in relation to potential frequency-dependent foreground contamination. A total of 343,647 galaxies are used as tracers to identify and locate galaxy groups and clusters from which the kSZ signal is extracted using aperture photometry. We consider the impact of various aperture photometry assumptions and covariance estimation methods on the signal extraction. Theoretical predictions of the pairwise velocities are used to obtain best-fit, mass-averaged, optical depth estimates for each of five luminosity-selected tracer samples. A comparison of the kSZ-derived optical depth measurements obtained here to those derived from the thermal SZ effect for the same sample is presented in a companion paper.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Impact of late-time neutrino emission on the diffuse supernova neutrino background

In the absence of high-statistics supernova neutrino measurements, estimates of the diffuse supernova neutrino background (DSNB) hinge on the precision of simulations of core-collapse supernovae. Understanding the cooling phase of protoneutron star (PNS) evolution (≳ 1 s after core bounce) is crucial, since approximately 50% of the energy liberated by neutrinos is emitted during the cooling phase. We model the cooling phase with a hybrid method by combining the neutrino emission predicted by 3D hydrodynamic simulations with several cooling-phase estimates, including a novel two-parameter correlation depending on the final baryonic PNS mass and the time of shock revival. We find that the predicted DSNB event rate at Super-Kamiokande can vary by a factor of ~2–3 depending on the cooling-phase treatment. Here we also find that except for one cooling estimate, the range in predicted DSNB events is largely driven by the uncertainty in the neutrino mean energy. With a good understanding of the late-time neutrino emission, more precise DSNB estimates can be made for the next generation of DSNB searches.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Correlation of Diffusion Limited Oxidation to Color Difference in Accelerated Aging of Electrical Cable Insulation

Diffusion limited oxidation (DLO) as a phenomenon has complicated material lifetime predictions from accelerated aging studies. Many methods to analyze DLO have been developed in recent years. However, an analytical tool for high throughput and low-cost analysis of DLO affected samples remains absent from the literature. Color differences in polymers exposed to oxidative conditions have recently been observed and correlated to increased concentrations of oxidation products. Herein, total color difference was utilized to rapidly quantify DLO in ethylene propylene rubber (EPR) polymeric cable insulation specimens. Insulation specimens were aged at 121 °C, 136 °C, 150 °C, and 165 °C and a 10% ?E*ab difference between the specimen edge and specimen center was used as the threshold for DLO. Based on these specifications DLO was observed in EPR insulation specimen at temperatures of 136 °C and above, with an increasing degree of DLO observed as the time of exposure increased. The method presented in this work represents a quantitative and high-throughput method for the investigation of DLO with a low cost barrier for entry.

diffusion limited oxidation, DLO, nuclear, electri↗
DOE OSTI2026

Structure-aware Initialization via Numerical Continuation and Informed Priors

Scientific machine learning (SciML) often operates in ill-conditioned, weakly identifiable regimes due to limited data or indirect observations. In such settings, optimization and inference are highly sensitive to the starting point, making initialization--often under-reported--a consequential degree of freedom. Random initialization is not a neutral default as it induces an implicit prior over candidate solutions and can systematically bias the result, producing large run-to-run variability. Here, we formalize this view by treating initialization as a hidden confounder in SciML and develop a unifying theory for structure-aware initialization via numerical continuation, constructing warm starts from related problem instances. Across representative tasks, including physics-informed neural networks, maximum likelihood estimation, and variational inference, warm starts have been shown to consistently reduce optimization effort and improve reliability.

Data integrity↗
DOE OSTI2025

Deep Neural Network Assisted Distributed Strain and Temperature Fiber Sensor System for Natural Gas Pipeline Monitoring

Natural gas pipeline integrity monitoring is crucial to detect potential leaks, find structural issues, and prevent environmental damage. This article presents a system of natural gas pipeline monitoring that uses a specialized double Brillouin peak sensing fiber along with the Brillouin optical time domain analysis (BOTDAs) technique. The calibrated sensing fiber coefficients for strain and temperature are 41.8 kHz/ με and 0.9 MHz/°C for peak 1; and 47.2 kHz/ με , and 1.11 MHz/°C for peak 2, respectively. Initially, lab tests were performed by installing a short section of double Brillouin peak fiber (DBPF) on a 1-in steel pipe under pressure up to 1000 per square inch (psi) at elevated temperatures. Simultaneous distributed measurements of temperature and pressure-induced hoop strain were successfully measured. Considering the long processing speed to extract Brillouin frequency shift (BFS), we employ a novel probabilistic deep neural network (PDNN) framework for rapid BFS prediction. Additionally, using the Finite Element Method, the effects of the pipeline pressure on hoop strain were modeled and compared to the experimental hoop strain under the same set of pipeline conditions. Finally, an actual 4-in outer diameter steel natural gas pipeline was used for pilot-scale tests, where hoop strain was measured at various pressure levels. Leaks were simulated to demonstrate accurate pipeline integrity monitoring. At an internal pipe pressure of 1000 psi, hoop strain of approximately 300 με was observed, and the sensitivity was calculated as 0.28 με /psi. The results of this pilot-scale study demonstrated that the system is capable of performing distributed monitoring sufficient to detect pipeline pressure and the presence of leaks to ensure the safe operation of gas pipelines in the field.

03 NATURAL GAS↗
DOE OSTI2024

Efficient mapping between void shapes and stress fields using Deep Convolutional Neural Networks with sparse data

Establishing fast and accurate structure-to-property relationships is an important component in the design and discovery of advanced materials. Physics-based simulation models like the finite element method (FEM) are often used to predict deformation, stress, and strain fields as a function of material microstructure in material and structural systems. Such models may be computationally expensive and time intensive if the underlying physics of the system is complex. This limits their application to solve inverse design problems and identify structures that maximize performance. In such scenarios, surrogate models are employed to make the forward mapping computationally efficient to evaluate. However, the high dimensionality of the input microstructure and the output field of interest often renders such surrogate models inefficient, especially when dealing with sparse data. Deep convolutional neural network (CNN) based surrogate models have shown great promise in handling such high-dimensional problems. In this paper, a single ellipsoidal void structure under a uniaxial tensile load represented by a linear elastic, high-dimensional and expensive-to-query, FEM model. We consider two deep CNN architectures, a modified convolutional autoencoder framework with a fully connected bottleneck and a UNet CNN, and compare their accuracy in predicting the von Mises stress field for any given input void shape in the FEM model. Additionally, a sensitivity analysis study is performed using the two approaches, where the variation in the prediction accuracy on unseen test data is studied through numerical experiments by varying the number of training samples from 20 to 100.

surrogate modeling; convolutional neural networks;↗
DOE OSTI2023

Skyrme-Hartree-Fock-Bogoliubov mass models on a 3D mesh: III. From atomic nuclei to neutron stars

Here, we present BSkG3, the latest entry in the Brussels-Skyrme-on-a-grid series of large-scale models of nuclear structure based on an energy density functional. Compared to its predecessors, the new model offers a more realistic description of nucleonic matter at the extreme densities relevant to neutron stars. This achievement is made possible by incorporating a constraint on the infinite nuclear matter properties at high densities in the parameter adjustment, ensuring in this way that the predictions of BSkG3 for the nuclear Equation of State are compatible with the observational evidence for heavy pulsars with M > 2M ⊙ . Instead of the usual phenomenological pairing terms, we also employ a more microscopically founded treatment of nucleon pairing, resulting in extrapolations to high densities that are in line with the predictions of advanced many-body methods and are hence more suited to the study of superfluidity in neutron stars. By adopting an extended form of the Skyrme functional, we are able to reconcile the description of matter at high densities and at saturation density: the new model further refines the description of atomic nuclei offered by its predecessors. A qualitative improvement is our inclusion of ground state reflection asymmetry, in addition to the spontaneous breaking of rotational, axial, and time-reversal symmetry. Quantitatively, the model offers lowered root-mean-square deviations on 2457 masses (0.631 MeV), 810 charge radii (0.0237 fm) and an unmatched accuracy with respect to 45 primary fission barriers of actinide nuclei (0.33 MeV). Reconciling the complexity of neutron stars with those of atomic nuclei establishes BSkG3 as a tool of choice for applications to nuclear structure, the nuclear equation of state and nuclear astrophysics in general.

Physics↗
DOE OSTI2022

Longitudinal Trajectories of Memory Performance in Patients with Early-Stage Breast Cancer

Background. While breast cancer and its treatments may affect cognition, the longitudinal trajectories of cognition among those receiving differing cancer treatment types remain poorly understood. Prior research suggests hippocampal-prefrontal cortex network integrity may influence cognition, although how this network predicts performance over time remains unclear. Methods. We conducted a prospective trial including 69 patients with early-stage breast cancer receiving adjuvant therapy and 12 controls. Longitudinal cognitive testing was conducted at four visits: pretreatment-baseline, 6-7 months, 14-15 months, and 23-24 months. Cognitive composite scores of episodic memory, executive functioning, and processing speed were assessed at each timepoint. Baseline structural MRI was obtained in a subset of these participants, and hippocampal and prefrontal cortex regional volumes were extracted. Results. Longitudinal linear mixed modeling revealed significant group by time interactions on memory performance, controlling for age and education. Post hoc analyses revealed this effect was driven by patients treated with chemotherapy or chemotherapy plus hormone therapy, who demonstrated the least improvement in memory scores over time. Treatment group did not significantly influence the relationship between time and processing speed or executive functioning. Neither pretreatment hippocampal nor prefrontal volume differed between groups, and there were no significant group by time by baseline regional volume effects on cognition. Conclusion. Patients with early-stage breast cancer treated with chemotherapy or chemotherapy plus hormone therapy benefit less from practice effects seen in healthy controls on memory tests. Loss of longitudinal practice effect may be a new and clinically relevant measure for capturing patients’ experience of cognitive difficulties after treatment.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

A New Model for Simulating the Imbibition of a Wetting-Phase Fluid in a Matrix-Fracture Dual Connectivity System

The imbibition experiment is an effective approach for measuring petrophysical properties of porous media, with many such experiments performed over the past decade. Quite some empirical, analytical, and numerical models have been developed to simulate spontaneous imbibition of the wetting phase fluid into porous media, but limitations still exist. In previous studies, the imbibition process has been considered to give a piston-like displacement or the porous medium modeled as multiply-sized pores linked with bonds; both approaches fail to yield comprehensive results due to their neglect of the presence of irregular fractures or nonuniform flow paths through the matrix. By building a numerical model for simulating laboratory-scale experimental data, we performed imbibition tests on several fractured Barnett Shale samples having fractures either parallel ( P ) or transverse ( T ) to the bedding plane and used MATLAB to build a new numerical model by combining the imbibition process in fractures and the matrix using concepts from percolation theory. The experimental data show that the rocks with P -direction fractures have a more steady increase of imbibition rates than the case of T -direction one. As the shale matrix with low pore connectivity hampers the upward water movement, the imbibition rate of shales with T -direction fractures will decrease suddenly after the bottom layer in contact with water is saturated during the initial period. This wetting phase movement (WPM) model can simulate 3D porous media with 2D fractures. The rate of imbibition by fractured porous media is associated with physical parameters such as porosity and fracture distribution (e.g., the number and angle of fractures). Using Monte Carlo methods, we examined fracture parameters and predicted elapsed time and cumulative water imbibition, for the Barnett Shale samples. The results show that the rate of imbibed water mass is sensitive to the number of fractures directly connected to water source, and the connectivity between two neighboring grid cells is a key parameter for the wetting-front progression. The findings of this study can help to better understand the imbibition process with multiple influencing processes and factors in fractured-matrix rocks. Although the experiments, data simulation, and prediction results are based only on Barnett Shale samples, the model is readily applicable to imbibition tests of other fractured rocks to show the spatial and temporal behavior during a dynamic imbibition process that are not easily captured experimentally.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗