Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “residual network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Magnetic modulation of solar luminosity by photospheric activity

The behavior of slow changes in solar irradiance S is studied using measurements obtained with radiometers on the SMM and Nimbus 7 spacecraft. The general downtrend in the radiometer readings is examined by removing the influence of sunspot blocking and comparing the residual irradiance variations with changes in facular and network radiation as indicated by the He I 10830 and CaK indices. The time-integrated sunspot and facular contributions to irradiance variation and its implications for active region energetics are considered. The magnetic activity modulation of S over solar cycle 21 from daily data on sunspot blocking and the He I index are simulated, and this simulated irradiance variation is compared to radiometry since 1978. Other recent evidence for an irradiance modulation by magnetic activity is discussed.

Foukal, P.↗

Precise Modeling of a Complex Solenoidal Magnetic Field Using a Combination of Analytic Functions and a PINN

We demonstrate an iterative approach to modeling a sparsely measured magnetic field in a large-bore solenoid. This approach uses a hybrid of traditional and machine learning techniques. The traditional technique is a linear least-squares fit using a series solution to Laplace's equation, while the machine learning technique involves the training of a physics-informed neural network (PINN) on the least-squares fit residuals. We use a newly defined activation function "DELTAsnake," a modification to the snake activation function proposed by Ziyin et al. that allows for stronger curvature and non-monotonicity. The combined model approximately obeys Maxwell's equations to a level sufficient for producing high quality physics simulations and analysis. Our approach is applied to a highly realistic calculation of the expected magnetic field in the Mu2e experiment's Detector Solenoid which includes a simple model for the expected statistical measurement uncertainties. Using ten toy measurement simulations, we demonstrate the capabilities of our model in comparison to the least-squares method alone; the least-squares method alone results in a reduced chi-squared statistic of ${2.15 \pm 0.01}$, while our approach improves the reduced chi-square to ${1.034 \pm 0.005}$. Furthermore, for an average toy simulation, we show that the range of the RMS of the three field component residuals reduces from ${0.07-0.37}$ Gauss to ${0.05-0.07}$ Gauss. We find that this novel method is robust against a realistic systematic uncertainty deriving from Hall probe calibration bias and can be used to significantly reduce the number of measurements required to achieve an accurate model.

Kampa, Cole [Caltech] (ORCID:0000000192972920)↗

A fine pore-preserved deep neural network for porosity analytics of a high burnup U-10Zr metallic fuel

Abstract U-10 wt.% Zr (U-10Zr) metallic fuel is the leading candidate for next-generation sodium-cooled fast reactors. Porosity is one of the most important factors that impacts the performance of U-10Zr metallic fuel. The pores generated by the fission gas accumulation can lead to changes in thermal conductivity, fuel swelling, Fuel-Cladding Chemical Interaction (FCCI) and Fuel-Cladding Mechanical Interaction (FCMI). Therefore, it is crucial to accurately segment and analyze porosity to understand the U-10Zr fuel system to design future fast reactors. To address the above issues, we introduce a workflow to process and analyze multi-source Scanning Electron Microscope (SEM) image data. Moreover, an encoder-decoder-based, deep fully convolutional network is proposed to segment pores accurately by integrating the residual unit and the densely-connected units. Two SEM 250 × field of view image datasets with different formats are utilized to evaluate the new proposed model’s performance. Sufficient comparison results demonstrate that our method quantitatively outperforms two popular deep fully convolutional networks. Furthermore, we conducted experiments on the third SEM 2500 × field of view image dataset, and the transfer learning results show the potential capability to transfer the knowledge from low-magnification images to high-magnification images. Finally, we use a pre-trained network to predict the pores of SEM images in the whole cross-sectional image and obtain quantitative porosity analysis. Our findings will guide the SEM microscopy data collection efficiently, provide a mechanistic understanding of the U-10Zr fuel system and bridge the gap between advanced characterization to fuel system design.

36 MATERIALS SCIENCE↗

The N‐terminal intrinsically disordered region of Ncb5or docks with the cytochrome b 5 core to form a helical motif that is of ancient origin

Abstract NADH cytochromeb 5 oxidoreductase (Ncb5or) is a cytosolic ferric reductase implicated in diabetes and neurological conditions. Ncb5or comprises cytochromeb 5 (b 5 ) and cytochromeb 5 reductase (b 5 R) domains separated by a CHORD‐Sgt1 (CS) linker domain. Ncb5or redox activity depends on proper inter‐domain interactions to mediate electron transfer from NADH or NADPH via FAD to heme. While full‐length human Ncb5or has proven resistant to crystallization, we have succeeded in obtaining high‐resolution atomic structures of theb 5 domain and a construct containing the CS andb 5 R domains (CS/b 5 R). Ncb5or also contains an N‐terminal intrinsically disordered region of 50 residues that has no homologs in other protein families in animals but features a distinctive, conserved L 34 MDWIRL 40 motif also present in reduced lateral root formation (RLF) protein in rice and increased recombination center 21 in baker's yeast, all attaching to ab 5 domain. After unsuccessful attempts at crystallizing a human Ncb5or construct comprising the N‐terminal region naturally fused to theb 5 domain, we were able to obtain a high‐resolution atomic structure of a recombinant rice RLF construct corresponding to residues 25–129 of human Ncb5or (52% sequence identity; 74% similarity). The structure reveals Trp 120 (corresponding to invariant Trp 37 in Ncb5or) to be part of an 11‐residue α‐helix (S 116 QMDWLKLTRT 126 ) packing against two of the four helices in theb 5 domain that surround heme (α2 and α5). The Trp 120 side chain forms a network of interactions with the side chains of four highly conserved residues corresponding to Tyr 85 and Tyr 88 (α2), Cys 124 (α5), and Leu 47 in Ncb5or. Circular dichroism measurements of human Ncb5or fragments further support a key role of Trp 37 in nucleating the formation of the N‐terminal helix, whose location in the N/b 5 module suggests a role in regulating the function of this multi‐domain redox enzyme. This study revealed for the first time an ancient origin of a helical motif in the N/b 5 module as reflected by its existence in a class of cytochromeb 5 proteins from three kingdoms among eukaryotes.

Biochemistry & Molecular Biology↗

Computational design of highly signalling-active membrane receptors through solvent-mediated allosteric networks

Abstract Protein catalysis and allostery require the atomic-level orchestration and motion of residues and ligand, solvent and protein effector molecules. However, the ability to design protein activity through precise protein–solvent cooperative interactions has not yet been demonstrated. Here we report the design of 14 membrane receptors that catalyse G protein nucleotide exchange through diverse engineered allosteric pathways mediated by cooperative networks of intraprotein, protein–ligand and –solvent molecule interactions. Consistent with predictions, the designed protein activities correlated well with the level of plasticity of the networks at flexible transmembrane helical interfaces. Several designs displayed considerably enhanced thermostability and activity compared with related natural receptors. The most stable and active variant crystallized in an unforeseen signalling-active conformation, in excellent agreement with the design models. The allosteric network topologies of the best designs bear limited similarity to those of natural receptors and reveal an allosteric interaction space larger than previously inferred from natural proteins. The approach should prove useful for engineering proteins with novel complex protein binding, catalytic and signalling activities.

Chemistry↗

Informative and non-informative decomposition of turbulent flow fields

Not all the information in a turbulent field is relevant for understanding particular regions or variables in the flow. Here, we present a method for decomposing a source field into its informative Φ I (x, t) and residual Φ R (x, t) components relative to another target field. The method is referred to as informative and non-informative decomposition (IND). All the necessary information for physical understanding, reduced-order modelling and control of the target variable is contained in Φ I (x, t), whereas Φ R (x, t) offers no substantial utility in these contexts. The decomposition is formulated as an optimisation problem that seeks to maximise the time-lagged mutual information of the informative component with the target variable while minimising the mutual information with the residual component. The method is applied to extract the informative and residual components of the velocity field in a turbulent channel flow, using the wall shear stress as the target variable. We demonstrate the utility of IND in three scenarios: (i) physical insight into the effect of the velocity fluctuations on the wall shear stress; (ii) prediction of the wall shear stress using velocities far from the wall; and (iii) development of control strategies for drag reduction in a turbulent channel flow using opposition control. In case (i), IND reveals that the informative velocity related to wall shear stress consists of wall-attached high- and low-velocity streaks, collocated with regions of vertical motions and weak spanwise velocity. This informative structure is embedded within a larger-scale streak–roll structure of residual velocity, which bears no information about the wall shear stress. In case (ii), the best-performing model for predicting wall shear stress is a convolutional neural network that uses the informative component of the velocity as input, while the residual velocity component provides no predictive capabilities. Finally, in case (iii), we demonstrate that the informative component of the wall-normal velocity is closely linked to the observability of the target variable and holds the essential information needed to develop successful control strategies.

97 MATHEMATICS AND COMPUTING↗

An Acoustic Emission and Acousto-Ultrasonic Analysis of Impact Damaged Composite Pressure Vessels

The research presented herein summarizes the development of acoustic emission (AE) and acousto-ultrasonic (AU) techniques for the nondestructive evaluation of filament wound composite pressure vessels. Vessels fabricated from both graphite and kevlar fibers with an epoxy matrix were examined prior to hydroburst using AU and during hydroburst using AE. A dead weight drop apparatus featuring both blunt and sharp impactor tips was utilized to produce a single known energy 'damage' level in each of the vessels so that the degree to which the effects of impact damage could be measured. The damage levels ranged from barely visible to obvious fiber breakage and delamination. Independent neural network burst pressure prediction models were developed from a sample of each fiber/resin material system. Here, the cumulative AE amplitude distribution data collected from low level proof test (25% of the expected burst for undamaged vessels) were used to measure the effects of the impact on the residual burst pressure of the vessels. The results of the AE/neural network model for the inert propellant filled graphite/epoxy vessels 'IM7/3501-6, IM7/977-2 and IM7/8553-45' demonstrated that burst pressures can be predicted from low level AE proof test data, yielding an average error of 5.0%. The trained network for the IM7/977-2 class vessels was also able to predict the expected burst pressure of taller vessels (three times longer hoop region length) constructed of the same material and using the same manufacturing technique, with an average error of 4.9%. To a lesser extent, the burst pressure prediction models could also measure the effects of impact damage to the kevlar/epoxy 'Kevlar 49/ DPL862' vessels. Here though, due to the higher attenuation of the material, an insufficient amount of AE amplitude information was collected to generate robust network models. Although, the worst case trial errors were less than 6%, when additional blind predictions were attempted, errors as high as 50% were produced. An acousto-ultrasonic robotic evaluation system (AURES) was developed for mapping the effects of damage on filament wound pressure vessels prior to hydroproof testing. The AURES injects a single broadband ultrasonic pulse into each vessel at preprogrammed positions and records the effects of the interaction of that pulse on the material volume with a broadband receiver. A stress wave factor in the form of the energy associated with the 750 to 1000 kHz and 1000 to 1250 kHz frequency bands were used to map the potential failure sites for each vessel. The energy map associated with the graphite/epoxy vessels was found to decrease in the region of the impact damage. The kevlar vessels showed the opposite trend, with the energy values increasing around the damage/failure sites.

Walker, James L.↗

Gearbox bearing crack growth prognostics and uncertainty quantification with physics-informed machine learning

This paper introduces the extreme theory of functional connections (X-TFC), a physics-informed machine learning algorithm, and tailors it to estimate the remaining useful life (RUL) of wind turbine gearbox bearings experiencing fatigue crack growth. Unlike purely data-driven methods, X-TFC embeds a physics model, based on Head's theory in this work, into its training objective. The core of X-TFC is a random-projection single-layer neural network trained via an extreme learning machine, which requires only limited damage progression data and solves for output weights with a least-squares optimization algorithm. A composite loss function balances the network's fit to observed degradation data against the residuals of the governing crack growth differential equation, ensuring the learned damage trajectory remains physically plausible. When applied to a vibration-based health-index (HI) dataset measured during the growth of a crack on the inner ring of a high-speed bearing in a wind turbine gearbox (Bechhoefer and Dubé, 2020), X-TFC achieves near-zero prediction bias. Even when trained on only the first 10 %–20 % of the damage progression data, with sufficient physics weighting its predictions remain monotonic and smooth, delivering high prognosability and trendability. To quantify the epistemic uncertainty, we employ a Monte Carlo ensemble of independently initialized X-TFC models trained on noise-perturbed data, which yields confidence intervals around each RUL estimate and captures both model-parameter and epistemic uncertainty. In addition to a vibration-based HI, we demonstrate that the proposed framework can be directly applied to a supervisory control and data acquisition (SCADA) data-based HI (Eftekhari Milani et al., 2026) measured during similar wind turbine gearbox bearing crack faults, preserving its accuracy and interpretability. This extension shows the versatility of our approach, which is applicable to bearings of multiple gearbox manufacturers, models, and ratings using only SCADA data. By integrating domain knowledge with machine learning, X-TFC offers a rapid, reliable tool for crack prognostics. Its adaptability to other bearing failure modes, such as pitch bearing ring cracks, positions X-TFC as a powerful enabler of data-driven, physics-informed asset management in the wind energy sector and beyond.

17 WIND ENERGY↗

Influence of Process Parameters and Alloy Composition on Crack Mitigation in Selective Laser Melting

Microcracking and residual stresses are key limitations of laser powder bed fusion (LPBF), an additive manufacturing (AM) technique that uses a high power laser to consolidate successive layers of metal powder. For tungsten, these microcracks find their origin in the combination of a ductile-to-brittle transition (DBT) between 200°C and 400°C and high residual stresses. This work utilized in situ high speed video to capture the cracking mechanisms, and combined the experimental results with thermomechanical modeling to unveil correlations between crack network morphology and process parameter-related variables, such as the local temperature and residual stress distributions. Consequently, preheating and alloying with rare earth oxides were adopted as possible crack mitigation strategies, the efficacy of which was tested against the initial fundamental baseline results. Preheating temperatures above 500°C eliminated all cracking, though this threshold is expected to be higher when tungsten powder (higher oxygen content) is introduced. Alloying can serve as an active oxygen getter in the system, but the rare earth oxides in this work were too large to have significant contributions to crack-mitigation.

36 MATERIALS SCIENCE↗

DISTEMA: distance map-based estimation of single protein model accuracy with attentive 2D convolutional neural network

Abstract Background Estimation of the accuracy (quality) of protein structural models is important for both prediction and use of protein structural models. Deep learning methods have been used to integrate protein structure features to predict the quality of protein models. Inter-residue distances are key information for predicting protein’s tertiary structures and therefore have good potentials to predict the quality of protein structural models. However, few methods have been developed to fully take advantage of predicted inter-residue distance maps to estimate the accuracy of a single protein structural model. Result We developed an attentive 2D convolutional neural network (CNN) with channel-wise attention to take only a raw difference map between the inter-residue distance map calculated from a single protein model and the distance map predicted from the protein sequence as input to predict the quality of the model. The network comprises multiple convolutional layers, batch normalization layers, dense layers, and Squeeze-and-Excitation blocks with attention to automatically extract features relevant to protein model quality from the raw input without using any expert-curated features. We evaluated DISTEMA’s capability of selecting the best models for CASP13 targets in terms of ranking loss of GDT-TS score. The ranking loss of DISTEMA is 0.079, lower than several state-of-the-art single-model quality assessment methods. Conclusion This work demonstrates that using raw inter-residue distance information with deep learning can predict the quality of protein structural models reasonably well. DISTEMA is freely at https://github.com/jianlin-cheng/DISTEMA

59 BASIC BIOLOGICAL SCIENCES↗

Rapid Inverse Parameter Inference Using Physics-Informed Neural Network

As Li-ion batteries become more essential in today's economy, tools need to be developed to accurately and rapidly diagnose a battery's internal state-of-health. Using a Li-ion battery's (high-rate) voltage response, it is proposed to determine a battery's internal state through Bayesian calibration. However, Bayesian calibration is notoriously slow and requires thousands of model runs. To accelerate parameter inference using Bayesian calibration, a surrogate model is developed to replace the underlying physics-based Li-ion model. Developing a surrogate model for rapid Bayesian calibration analysis is discussed for both the single particle model (SPM) and the pseudo two-dimensional (P2D) model. Surrogate models are constructed using physics-informed neural networks (PINNs) that encode the influence of internal properties on observed voltage responses. In practice, a neural network can be trained by: 1) using simulation results of the physics-based model (i.e., a data-loss approach); 2) using the residuals of the governing equations themselves (i.e., a physics-loss approach); or 3) using a combination of simulation results and governing equation residuals. In the present work, PINNs are developed using a variety of training losses and neural network architectures. In this analysis, it is shown that a PINN surrogate model can be reliably trained with only physics-informed loss. However, using a coupled data-informed and physics-loss approach produced the most accurate PINNs.

Bayesian calibration↗

Roles of D1-Glu189 and D1-Glu329 in O 2 Formation by the Water-Splitting Mn 4 Ca Cluster in Photosystem II

During the catalytic step that precedes O–O bond formation in Photosystem II, a water molecule deprotonates and moves next to the water-splitting Mn 4 Ca cluster’s O5 oxo bridge. The relocated oxygen, known as O6 or Ox, may serve as a substrate, combining with O5 to form O 2 during the final step in the catalytic cycle, or may be positioned to become a substrate during the next catalytic cycle. Recent serial femtosecond X-ray crystallographic studies show that the flexibility of D1-E189 plays a critical role in facilitating the relocation of O 6 /Ox. In this study, the D1-E189G and D1-E189S mutations were characterized with FTIR difference spectroscopy. The data show that both mutations support Mn 4 Ca cluster assembly, substantially inhibit advancement beyond the S 2 state, and alter the network of H bonds that surrounds the Mn 4 Ca cluster. Previously, the D1-E189Q, D1-E189K, and D1-E189R mutations were shown to have little impact on the activity, electron transfer rates, or spectral properties of Photosystem II. A rationale for this behavior is presented. The residue D1-E329 interacts with water molecules in the O1 water network that has been suggested recently to supply substrate during the catalytic cycle. Characterization of the D1-E329A mutant with FTIR difference spectroscopy shows that this mutation does not substantially perturb the structure of PSII or the water molecules whose O–H stretching modes change during the catalytic cycle. Furthermore, this result provides additional evidence that the water molecules whose vibrational properties change during the S 1 to S 2 transition are confined approximately to the region bounded by D1-N87, D1-N298, and D2-K317.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Analysis of Neural Networks as Random Dynamical Systems

In this report we present our findings and outcomes of the NNRDS (analysis of Neural Networks as Random Dynamical Systems) project. The work is largely motivated by the analogy of a large class of neural networks (NNs) with a discretized ordinary differential equation (ODE) schemes. Namely, residual NNs, or ResNets, can be viewed as a discretization of neural ODEs (NODEs) where the NN depth plays the role of the time evolution. We employ several legacy tools from ODE theory, such as stiffness, nonlocality, autonomicity, to enable regularization of ResNets thus improving their generalization capabilities. Furthermore, armed with NN analysis tools borrowed from the ODE theory, we are able to efficiently augment NN predictions with uncertainty overcoming wellknown dimensionality challenges and adding a degree of trust towards NN predictions. Finally, we have developed a Python library QUiNN (Quantification of Uncertainties in Neural Networks) that incorporates improved-architecture ResNets, besides classical feed-forward NNs, and contains wrappers to PyTorch NN models enabling several major classes of uncertainty quantification methods for NNs. Besides synthetic problems, we demonstrate the methods on datasets from climate modeling and materials science.

97 MATHEMATICS AND COMPUTING↗

Farmer characteristics and decision-making: A model for bioenergy crop adoption

We report the commercial development of biofuels and bioproducts depends on whether renewable biomass feedstock is available while not directly competing with the production of food. Farmers are one of the most important stakeholders in the biofuel supply chain and confront a range of uncertainties while entering the bioenergy market. Their decision-making process is extremely complex and rarely purely rational. Modeling farmer behavior requires considering a wide range of individual-level factors, socio-temporal dynamics, institutional settings, and their interactions. These characteristics make agent-based modeling a suitable framework for evaluating such systems. We developed a model to simulate farmer bioenergy crop adoption behavior across a 50-county study region in Nebraska, Kansas, and Colorado. The analysis considers adoption decisions for two bioenergy feedstocks, crop residues and energy crops. We examine the influence of individual and farm characteristics, market structure, social networks, and media influence on farmer adoption decisions. Our results indicate that different factors can have varied impacts on the speed of adoption for the crop residues and energy crops. Identifying levers that have the most impact on grower adoption can inform the design of interventions both from policy and private sector standpoints with important implications for the future the bioenergy industry.

09 BIOMASS FUELS↗

Towards a heat- and mass-balanced kinetic model of TATB decomposition

We report TATB (1,3,5-triamino-2,4,6-trinitrobenzene) was thermally degraded by two small-scale analytical methods – simultaneous differential scanning calorimetry and thermogravimetric analysis (SDT) and a hot-stage microscope with Fourier Transform Infrared (FTIR) analysis capabilities. SDT used ramped heating, isothermal soaking, and thermal pretreatment at various conditions. The heat flow and mass loss were monitored during various treatment conditions to derive chemical decomposition kinetics and Arrhenius parameters. FTIR experiments used isothermal heating, and changes were monitored spectroscopically. Solid samples generated at specific conditions were collected from both methods and were analyzed by DMSO extraction followed by chemical speciation by optical and mass spectrometric methods. Characterization provided the following reaction insights: TATB decreases in a sigmoidal pattern in isothermally heated samples. Other soluble products gradually increase in concentration and then abruptly decline in concentration during the second exotherm, such as diamino-dinitro-benzofurazan and amino-nitro-benzodifurazan. FTIR showed gradual changes in the amino and nitro functionality, shifting positions and decreasing intensity for the first 40 min. Then the solid gradually appeared more like an amorphous C with N incorporated, similar to previous studies on thermally degraded TATB-type materials. Extracted residues (DMSO-soluble components removed) examined by FTIR showed an abrupt change in chemical composition between 40- and 45-min isothermal treatment, indicating early forming solids are different than later forming residues. A reliable mass- and energy-balanced global reaction network must include at least two autocatalytic reactions, either in parallel or series, and at least one must have an explicit initiation reaction having a low activation energy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deducing neutron star equation of state from telescope spectra with machine-learning-derived likelihoods

The interiors of neutron stars reach densities and temperatures beyond the limits of terrestrial experiments, providing vital laboratories for probing nuclear physics. While the star's interior is not directly observable, its pressure and density determine the star's macroscopic structure which affects the spectra observed in telescopes. The relationship between the observations and the internal state is complex and partially intractable, presenting difficulties for inference. Previous work has focused on the regression from stellar spectra of parameters describing the internal state. We demonstrate a calculation of the full likelihood of the internal state parameters given observations, accomplished by replacing intractable elements with machine learning models trained on samples of simulated stars. Our machine-learning-derived likelihood allows us to perform maximum a posteriori estimation of the parameters of interest, as well as full scans. We demonstrate the technique by inferring stellar mass and radius from an individual stellar spectrum, as well as equation of state parameters from a set of spectra. Our results are more precise than pure regression models, reducing the width of the parameter residuals by 11.8% in the most realistic scenario. The neural networks will be released as a tool for fast simulation of neutron star properties and observed spectra.

79 ASTRONOMY AND ASTROPHYSICS↗

AIVT: Inference of turbulent thermal convection from measured 3D velocity data by physics-informed Kolmogorov-Arnold networks

We propose the artificial intelligence velocimetry-thermometry (AIVT) method to reconstruct a continuous and differentiable representation of the temperature and velocity in turbulent convection from measured three-dimensional (3D) velocity data. AIVT is based on physics-informed Kolmogorov-Arnold networks and trained by optimizing a loss function that minimizes residuals of the velocity data, boundary conditions, and governing equations. We apply AIVT to a set of simultaneously measured 3D temperature and velocity data of Rayleigh-Bénard convection, obtained by combining particle image thermometry and Lagrangian particle tracking. This enables us to directly compare machine learning results to true volumetric, simultaneous temperature and velocity measurements. We demonstrate that AIVT can reconstruct and infer continuous, instantaneous velocity and temperature fields and their gradients from sparse experimental data at a high resolution, providing an additional approach for understanding thermal turbulence.

Science & Technology - Other Topics↗