Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “residual network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Exploring Physics of Ferroelectric Domain Walls in Real Time: Deep Learning Enabled Scanning Probe Microscopy

The functionality of ferroelastic domain walls in ferroelectric materials is explored in real-time via the in situ implementation of computer vision algorithms in scanning probe microscopy (SPM) experiment. The robust deep convolutional neural network (DCNN) is implemented based on a deep residual learning framework (Res) and holistically nested edge detection (Hed), and ensembled to minimize the out-of-distribution drift effects. The DCNN is implemented for real-time operations on SPM, converting the data stream into the semantically segmented image of domain walls and the corresponding uncertainty. Further the pre-defined experimental workflows perform piezoresponse spectroscopy measurement on thus discovered domain walls, and alternating high- and low-polarization dynamic (out-of-plane) ferroelastic domain walls in a PbTiO 3 (PTO) thin film and high polarization dynamic (out-of-plane) at short ferroelastic walls (compared with long ferroelastic walls) in a lead zirconate titanate (PZT) thin film is reported. This work establishes the framework for real-time DCNN analysis of data streams in scanning probe and other microscopies and highlights the role of out-of-distribution effects and strategies to ameliorate them in real time analytics.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Precise Modeling of a Complex Solenoidal Magnetic Field Using a Combination of Analytic Functions and a PINN

We demonstrate an iterative approach to modeling a sparsely measured magnetic field in a large-bore solenoid. This approach uses a hybrid of traditional and machine learning techniques. The traditional technique is a linear least-squares fit using a series solution to Laplace's equation, while the machine learning technique involves the training of a physics-informed neural network (PINN) on the least-squares fit residuals. We use a newly defined activation function "DELTAsnake," a modification to the snake activation function proposed by Ziyin et al. that allows for stronger curvature and non-monotonicity. The combined model approximately obeys Maxwell's equations to a level sufficient for producing high quality physics simulations and analysis. Our approach is applied to a highly realistic calculation of the expected magnetic field in the Mu2e experiment's Detector Solenoid which includes a simple model for the expected statistical measurement uncertainties. Using ten toy measurement simulations, we demonstrate the capabilities of our model in comparison to the least-squares method alone; the least-squares method alone results in a reduced chi-squared statistic of ${2.15 \pm 0.01}$, while our approach improves the reduced chi-square to ${1.034 \pm 0.005}$. Furthermore, for an average toy simulation, we show that the range of the RMS of the three field component residuals reduces from ${0.07-0.37}$ Gauss to ${0.05-0.07}$ Gauss. We find that this novel method is robust against a realistic systematic uncertainty deriving from Hall probe calibration bias and can be used to significantly reduce the number of measurements required to achieve an accurate model.

Kampa, Cole [Caltech] (ORCID:0000000192972920)↗
DOE OSTI2023

A fine pore-preserved deep neural network for porosity analytics of a high burnup U-10Zr metallic fuel

Abstract U-10 wt.% Zr (U-10Zr) metallic fuel is the leading candidate for next-generation sodium-cooled fast reactors. Porosity is one of the most important factors that impacts the performance of U-10Zr metallic fuel. The pores generated by the fission gas accumulation can lead to changes in thermal conductivity, fuel swelling, Fuel-Cladding Chemical Interaction (FCCI) and Fuel-Cladding Mechanical Interaction (FCMI). Therefore, it is crucial to accurately segment and analyze porosity to understand the U-10Zr fuel system to design future fast reactors. To address the above issues, we introduce a workflow to process and analyze multi-source Scanning Electron Microscope (SEM) image data. Moreover, an encoder-decoder-based, deep fully convolutional network is proposed to segment pores accurately by integrating the residual unit and the densely-connected units. Two SEM 250 × field of view image datasets with different formats are utilized to evaluate the new proposed model’s performance. Sufficient comparison results demonstrate that our method quantitatively outperforms two popular deep fully convolutional networks. Furthermore, we conducted experiments on the third SEM 2500 × field of view image dataset, and the transfer learning results show the potential capability to transfer the knowledge from low-magnification images to high-magnification images. Finally, we use a pre-trained network to predict the pores of SEM images in the whole cross-sectional image and obtain quantitative porosity analysis. Our findings will guide the SEM microscopy data collection efficiently, provide a mechanistic understanding of the U-10Zr fuel system and bridge the gap between advanced characterization to fuel system design.

36 MATERIALS SCIENCE↗
DOE OSTI2023

The N‐terminal intrinsically disordered region of Ncb5or docks with the cytochrome b 5 core to form a helical motif that is of ancient origin

Abstract NADH cytochromeb 5 oxidoreductase (Ncb5or) is a cytosolic ferric reductase implicated in diabetes and neurological conditions. Ncb5or comprises cytochromeb 5 (b 5 ) and cytochromeb 5 reductase (b 5 R) domains separated by a CHORD‐Sgt1 (CS) linker domain. Ncb5or redox activity depends on proper inter‐domain interactions to mediate electron transfer from NADH or NADPH via FAD to heme. While full‐length human Ncb5or has proven resistant to crystallization, we have succeeded in obtaining high‐resolution atomic structures of theb 5 domain and a construct containing the CS andb 5 R domains (CS/b 5 R). Ncb5or also contains an N‐terminal intrinsically disordered region of 50 residues that has no homologs in other protein families in animals but features a distinctive, conserved L 34 MDWIRL 40 motif also present in reduced lateral root formation (RLF) protein in rice and increased recombination center 21 in baker's yeast, all attaching to ab 5 domain. After unsuccessful attempts at crystallizing a human Ncb5or construct comprising the N‐terminal region naturally fused to theb 5 domain, we were able to obtain a high‐resolution atomic structure of a recombinant rice RLF construct corresponding to residues 25–129 of human Ncb5or (52% sequence identity; 74% similarity). The structure reveals Trp 120 (corresponding to invariant Trp 37 in Ncb5or) to be part of an 11‐residue α‐helix (S 116 QMDWLKLTRT 126 ) packing against two of the four helices in theb 5 domain that surround heme (α2 and α5). The Trp 120 side chain forms a network of interactions with the side chains of four highly conserved residues corresponding to Tyr 85 and Tyr 88 (α2), Cys 124 (α5), and Leu 47 in Ncb5or. Circular dichroism measurements of human Ncb5or fragments further support a key role of Trp 37 in nucleating the formation of the N‐terminal helix, whose location in the N/b 5 module suggests a role in regulating the function of this multi‐domain redox enzyme. This study revealed for the first time an ancient origin of a helical motif in the N/b 5 module as reflected by its existence in a class of cytochromeb 5 proteins from three kingdoms among eukaryotes.

Biochemistry & Molecular Biology↗
DOE OSTI2025

Computational design of highly signalling-active membrane receptors through solvent-mediated allosteric networks

Abstract Protein catalysis and allostery require the atomic-level orchestration and motion of residues and ligand, solvent and protein effector molecules. However, the ability to design protein activity through precise protein–solvent cooperative interactions has not yet been demonstrated. Here we report the design of 14 membrane receptors that catalyse G protein nucleotide exchange through diverse engineered allosteric pathways mediated by cooperative networks of intraprotein, protein–ligand and –solvent molecule interactions. Consistent with predictions, the designed protein activities correlated well with the level of plasticity of the networks at flexible transmembrane helical interfaces. Several designs displayed considerably enhanced thermostability and activity compared with related natural receptors. The most stable and active variant crystallized in an unforeseen signalling-active conformation, in excellent agreement with the design models. The allosteric network topologies of the best designs bear limited similarity to those of natural receptors and reveal an allosteric interaction space larger than previously inferred from natural proteins. The approach should prove useful for engineering proteins with novel complex protein binding, catalytic and signalling activities.

Chemistry↗
DOE OSTI2024

Informative and non-informative decomposition of turbulent flow fields

Not all the information in a turbulent field is relevant for understanding particular regions or variables in the flow. Here, we present a method for decomposing a source field into its informative Φ I (x, t) and residual Φ R (x, t) components relative to another target field. The method is referred to as informative and non-informative decomposition (IND). All the necessary information for physical understanding, reduced-order modelling and control of the target variable is contained in Φ I (x, t), whereas Φ R (x, t) offers no substantial utility in these contexts. The decomposition is formulated as an optimisation problem that seeks to maximise the time-lagged mutual information of the informative component with the target variable while minimising the mutual information with the residual component. The method is applied to extract the informative and residual components of the velocity field in a turbulent channel flow, using the wall shear stress as the target variable. We demonstrate the utility of IND in three scenarios: (i) physical insight into the effect of the velocity fluctuations on the wall shear stress; (ii) prediction of the wall shear stress using velocities far from the wall; and (iii) development of control strategies for drag reduction in a turbulent channel flow using opposition control. In case (i), IND reveals that the informative velocity related to wall shear stress consists of wall-attached high- and low-velocity streaks, collocated with regions of vertical motions and weak spanwise velocity. This informative structure is embedded within a larger-scale streak–roll structure of residual velocity, which bears no information about the wall shear stress. In case (ii), the best-performing model for predicting wall shear stress is a convolutional neural network that uses the informative component of the velocity as input, while the residual velocity component provides no predictive capabilities. Finally, in case (iii), we demonstrate that the informative component of the wall-normal velocity is closely linked to the observability of the target variable and holds the essential information needed to develop successful control strategies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Gearbox bearing crack growth prognostics and uncertainty quantification with physics-informed machine learning

This paper introduces the extreme theory of functional connections (X-TFC), a physics-informed machine learning algorithm, and tailors it to estimate the remaining useful life (RUL) of wind turbine gearbox bearings experiencing fatigue crack growth. Unlike purely data-driven methods, X-TFC embeds a physics model, based on Head's theory in this work, into its training objective. The core of X-TFC is a random-projection single-layer neural network trained via an extreme learning machine, which requires only limited damage progression data and solves for output weights with a least-squares optimization algorithm. A composite loss function balances the network's fit to observed degradation data against the residuals of the governing crack growth differential equation, ensuring the learned damage trajectory remains physically plausible. When applied to a vibration-based health-index (HI) dataset measured during the growth of a crack on the inner ring of a high-speed bearing in a wind turbine gearbox (Bechhoefer and Dubé, 2020), X-TFC achieves near-zero prediction bias. Even when trained on only the first 10 %–20 % of the damage progression data, with sufficient physics weighting its predictions remain monotonic and smooth, delivering high prognosability and trendability. To quantify the epistemic uncertainty, we employ a Monte Carlo ensemble of independently initialized X-TFC models trained on noise-perturbed data, which yields confidence intervals around each RUL estimate and captures both model-parameter and epistemic uncertainty. In addition to a vibration-based HI, we demonstrate that the proposed framework can be directly applied to a supervisory control and data acquisition (SCADA) data-based HI (Eftekhari Milani et al., 2026) measured during similar wind turbine gearbox bearing crack faults, preserving its accuracy and interpretability. This extension shows the versatility of our approach, which is applicable to bearings of multiple gearbox manufacturers, models, and ratings using only SCADA data. By integrating domain knowledge with machine learning, X-TFC offers a rapid, reliable tool for crack prognostics. Its adaptability to other bearing failure modes, such as pitch bearing ring cracks, positions X-TFC as a powerful enabler of data-driven, physics-informed asset management in the wind energy sector and beyond.

17 WIND ENERGY↗
DOE OSTI2020

Influence of Process Parameters and Alloy Composition on Crack Mitigation in Selective Laser Melting

Microcracking and residual stresses are key limitations of laser powder bed fusion (LPBF), an additive manufacturing (AM) technique that uses a high power laser to consolidate successive layers of metal powder. For tungsten, these microcracks find their origin in the combination of a ductile-to-brittle transition (DBT) between 200°C and 400°C and high residual stresses. This work utilized in situ high speed video to capture the cracking mechanisms, and combined the experimental results with thermomechanical modeling to unveil correlations between crack network morphology and process parameter-related variables, such as the local temperature and residual stress distributions. Consequently, preheating and alloying with rare earth oxides were adopted as possible crack mitigation strategies, the efficacy of which was tested against the initial fundamental baseline results. Preheating temperatures above 500°C eliminated all cracking, though this threshold is expected to be higher when tungsten powder (higher oxygen content) is introduced. Alloying can serve as an active oxygen getter in the system, but the rare earth oxides in this work were too large to have significant contributions to crack-mitigation.

36 MATERIALS SCIENCE↗
DOE OSTI2022

DISTEMA: distance map-based estimation of single protein model accuracy with attentive 2D convolutional neural network

Abstract Background Estimation of the accuracy (quality) of protein structural models is important for both prediction and use of protein structural models. Deep learning methods have been used to integrate protein structure features to predict the quality of protein models. Inter-residue distances are key information for predicting protein’s tertiary structures and therefore have good potentials to predict the quality of protein structural models. However, few methods have been developed to fully take advantage of predicted inter-residue distance maps to estimate the accuracy of a single protein structural model. Result We developed an attentive 2D convolutional neural network (CNN) with channel-wise attention to take only a raw difference map between the inter-residue distance map calculated from a single protein model and the distance map predicted from the protein sequence as input to predict the quality of the model. The network comprises multiple convolutional layers, batch normalization layers, dense layers, and Squeeze-and-Excitation blocks with attention to automatically extract features relevant to protein model quality from the raw input without using any expert-curated features. We evaluated DISTEMA’s capability of selecting the best models for CASP13 targets in terms of ranking loss of GDT-TS score. The ranking loss of DISTEMA is 0.079, lower than several state-of-the-art single-model quality assessment methods. Conclusion This work demonstrates that using raw inter-residue distance information with deep learning can predict the quality of protein structural models reasonably well. DISTEMA is freely at https://github.com/jianlin-cheng/DISTEMA

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Rapid Inverse Parameter Inference Using Physics-Informed Neural Network

As Li-ion batteries become more essential in today's economy, tools need to be developed to accurately and rapidly diagnose a battery's internal state-of-health. Using a Li-ion battery's (high-rate) voltage response, it is proposed to determine a battery's internal state through Bayesian calibration. However, Bayesian calibration is notoriously slow and requires thousands of model runs. To accelerate parameter inference using Bayesian calibration, a surrogate model is developed to replace the underlying physics-based Li-ion model. Developing a surrogate model for rapid Bayesian calibration analysis is discussed for both the single particle model (SPM) and the pseudo two-dimensional (P2D) model. Surrogate models are constructed using physics-informed neural networks (PINNs) that encode the influence of internal properties on observed voltage responses. In practice, a neural network can be trained by: 1) using simulation results of the physics-based model (i.e., a data-loss approach); 2) using the residuals of the governing equations themselves (i.e., a physics-loss approach); or 3) using a combination of simulation results and governing equation residuals. In the present work, PINNs are developed using a variety of training losses and neural network architectures. In this analysis, it is shown that a PINN surrogate model can be reliably trained with only physics-informed loss. However, using a coupled data-informed and physics-loss approach produced the most accurate PINNs.

Bayesian calibration↗
DOE OSTI2020

Roles of D1-Glu189 and D1-Glu329 in O 2 Formation by the Water-Splitting Mn 4 Ca Cluster in Photosystem II

During the catalytic step that precedes O–O bond formation in Photosystem II, a water molecule deprotonates and moves next to the water-splitting Mn 4 Ca cluster’s O5 oxo bridge. The relocated oxygen, known as O6 or Ox, may serve as a substrate, combining with O5 to form O 2 during the final step in the catalytic cycle, or may be positioned to become a substrate during the next catalytic cycle. Recent serial femtosecond X-ray crystallographic studies show that the flexibility of D1-E189 plays a critical role in facilitating the relocation of O 6 /Ox. In this study, the D1-E189G and D1-E189S mutations were characterized with FTIR difference spectroscopy. The data show that both mutations support Mn 4 Ca cluster assembly, substantially inhibit advancement beyond the S 2 state, and alter the network of H bonds that surrounds the Mn 4 Ca cluster. Previously, the D1-E189Q, D1-E189K, and D1-E189R mutations were shown to have little impact on the activity, electron transfer rates, or spectral properties of Photosystem II. A rationale for this behavior is presented. The residue D1-E329 interacts with water molecules in the O1 water network that has been suggested recently to supply substrate during the catalytic cycle. Characterization of the D1-E329A mutant with FTIR difference spectroscopy shows that this mutation does not substantially perturb the structure of PSII or the water molecules whose O–H stretching modes change during the catalytic cycle. Furthermore, this result provides additional evidence that the water molecules whose vibrational properties change during the S 1 to S 2 transition are confined approximately to the region bounded by D1-N87, D1-N298, and D2-K317.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Analysis of Neural Networks as Random Dynamical Systems

In this report we present our findings and outcomes of the NNRDS (analysis of Neural Networks as Random Dynamical Systems) project. The work is largely motivated by the analogy of a large class of neural networks (NNs) with a discretized ordinary differential equation (ODE) schemes. Namely, residual NNs, or ResNets, can be viewed as a discretization of neural ODEs (NODEs) where the NN depth plays the role of the time evolution. We employ several legacy tools from ODE theory, such as stiffness, nonlocality, autonomicity, to enable regularization of ResNets thus improving their generalization capabilities. Furthermore, armed with NN analysis tools borrowed from the ODE theory, we are able to efficiently augment NN predictions with uncertainty overcoming wellknown dimensionality challenges and adding a degree of trust towards NN predictions. Finally, we have developed a Python library QUiNN (Quantification of Uncertainties in Neural Networks) that incorporates improved-architecture ResNets, besides classical feed-forward NNs, and contains wrappers to PyTorch NN models enabling several major classes of uncertainty quantification methods for NNs. Besides synthetic problems, we demonstrate the methods on datasets from climate modeling and materials science.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Farmer characteristics and decision-making: A model for bioenergy crop adoption

We report the commercial development of biofuels and bioproducts depends on whether renewable biomass feedstock is available while not directly competing with the production of food. Farmers are one of the most important stakeholders in the biofuel supply chain and confront a range of uncertainties while entering the bioenergy market. Their decision-making process is extremely complex and rarely purely rational. Modeling farmer behavior requires considering a wide range of individual-level factors, socio-temporal dynamics, institutional settings, and their interactions. These characteristics make agent-based modeling a suitable framework for evaluating such systems. We developed a model to simulate farmer bioenergy crop adoption behavior across a 50-county study region in Nebraska, Kansas, and Colorado. The analysis considers adoption decisions for two bioenergy feedstocks, crop residues and energy crops. We examine the influence of individual and farm characteristics, market structure, social networks, and media influence on farmer adoption decisions. Our results indicate that different factors can have varied impacts on the speed of adoption for the crop residues and energy crops. Identifying levers that have the most impact on grower adoption can inform the design of interventions both from policy and private sector standpoints with important implications for the future the bioenergy industry.

09 BIOMASS FUELS↗
DOE OSTI2023

Towards a heat- and mass-balanced kinetic model of TATB decomposition

We report TATB (1,3,5-triamino-2,4,6-trinitrobenzene) was thermally degraded by two small-scale analytical methods – simultaneous differential scanning calorimetry and thermogravimetric analysis (SDT) and a hot-stage microscope with Fourier Transform Infrared (FTIR) analysis capabilities. SDT used ramped heating, isothermal soaking, and thermal pretreatment at various conditions. The heat flow and mass loss were monitored during various treatment conditions to derive chemical decomposition kinetics and Arrhenius parameters. FTIR experiments used isothermal heating, and changes were monitored spectroscopically. Solid samples generated at specific conditions were collected from both methods and were analyzed by DMSO extraction followed by chemical speciation by optical and mass spectrometric methods. Characterization provided the following reaction insights: TATB decreases in a sigmoidal pattern in isothermally heated samples. Other soluble products gradually increase in concentration and then abruptly decline in concentration during the second exotherm, such as diamino-dinitro-benzofurazan and amino-nitro-benzodifurazan. FTIR showed gradual changes in the amino and nitro functionality, shifting positions and decreasing intensity for the first 40 min. Then the solid gradually appeared more like an amorphous C with N incorporated, similar to previous studies on thermally degraded TATB-type materials. Extracted residues (DMSO-soluble components removed) examined by FTIR showed an abrupt change in chemical composition between 40- and 45-min isothermal treatment, indicating early forming solids are different than later forming residues. A reliable mass- and energy-balanced global reaction network must include at least two autocatalytic reactions, either in parallel or series, and at least one must have an explicit initiation reaction having a low activation energy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Deducing neutron star equation of state from telescope spectra with machine-learning-derived likelihoods

The interiors of neutron stars reach densities and temperatures beyond the limits of terrestrial experiments, providing vital laboratories for probing nuclear physics. While the star's interior is not directly observable, its pressure and density determine the star's macroscopic structure which affects the spectra observed in telescopes. The relationship between the observations and the internal state is complex and partially intractable, presenting difficulties for inference. Previous work has focused on the regression from stellar spectra of parameters describing the internal state. We demonstrate a calculation of the full likelihood of the internal state parameters given observations, accomplished by replacing intractable elements with machine learning models trained on samples of simulated stars. Our machine-learning-derived likelihood allows us to perform maximum a posteriori estimation of the parameters of interest, as well as full scans. We demonstrate the technique by inferring stellar mass and radius from an individual stellar spectrum, as well as equation of state parameters from a set of spectra. Our results are more precise than pure regression models, reducing the width of the parameter residuals by 11.8% in the most realistic scenario. The neural networks will be released as a tool for fast simulation of neutron star properties and observed spectra.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

AIVT: Inference of turbulent thermal convection from measured 3D velocity data by physics-informed Kolmogorov-Arnold networks

We propose the artificial intelligence velocimetry-thermometry (AIVT) method to reconstruct a continuous and differentiable representation of the temperature and velocity in turbulent convection from measured three-dimensional (3D) velocity data. AIVT is based on physics-informed Kolmogorov-Arnold networks and trained by optimizing a loss function that minimizes residuals of the velocity data, boundary conditions, and governing equations. We apply AIVT to a set of simultaneously measured 3D temperature and velocity data of Rayleigh-Bénard convection, obtained by combining particle image thermometry and Lagrangian particle tracking. This enables us to directly compare machine learning results to true volumetric, simultaneous temperature and velocity measurements. We demonstrate that AIVT can reconstruct and infer continuous, instantaneous velocity and temperature fields and their gradients from sparse experimental data at a high resolution, providing an additional approach for understanding thermal turbulence.

Science & Technology - Other Topics↗
DOE OSTI2025

Self-Supervised T-GCN for Detection of Disturbance and Propagation in Power Grid

Urban power systems increasingly rely on dense sensing to monitor grid reliability, yet disturbance labels are scarce and events are rare. We present a self-supervised spatio-temporal method that detects, localizes, and characterizes grid frequency disturbances across urban areas using only unlabeled data. Our approach trains a tiny Temporal Graph Convolutional Network (T-GCN) to forecast per-site frequency residuals (deviation from 60 Hz). The sensor graph is constructed directly from signals using pre-event Pearson correlation with a cross-correlation lag penalty without geocoding. At inference, node-level anomalies are the model's forecast errors; region-level alarms arise from connected components of high-score nodes. We estimate disturbance propagation by computing per-node arrival times (first persistent exceedance), then fit a planar or time-of-arrival model to obtain direction, speed, and an epicenter proxy. With only three real events collected at decisecond resolution across U.S. cities, we evaluate the T-GCN and report time-to-detect, footprint size, and propagation consistency. We further show that short-window embeddings from the T-GCN's hidden states enable few-shot event-vs-background recognition via a simple prototypical classifier. Despite minimal data and no labels, our system yields fast, spatially coherent detection and interpretable propagation maps, offering a practical, lightweight pathway to city-scale grid resilience analytics.

Niu, Haoran [ORNL] (ORCID:0000000155228297)↗