Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “residual network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Self-Supervised T-GCN for Detection of Disturbance and Propagation in Power Grid

Urban power systems increasingly rely on dense sensing to monitor grid reliability, yet disturbance labels are scarce and events are rare. We present a self-supervised spatio-temporal method that detects, localizes, and characterizes grid frequency disturbances across urban areas using only unlabeled data. Our approach trains a tiny Temporal Graph Convolutional Network (T-GCN) to forecast per-site frequency residuals (deviation from 60 Hz). The sensor graph is constructed directly from signals using pre-event Pearson correlation with a cross-correlation lag penalty without geocoding. At inference, node-level anomalies are the model's forecast errors; region-level alarms arise from connected components of high-score nodes. We estimate disturbance propagation by computing per-node arrival times (first persistent exceedance), then fit a planar or time-of-arrival model to obtain direction, speed, and an epicenter proxy. With only three real events collected at decisecond resolution across U.S. cities, we evaluate the T-GCN and report time-to-detect, footprint size, and propagation consistency. We further show that short-window embeddings from the T-GCN's hidden states enable few-shot event-vs-background recognition via a simple prototypical classifier. Despite minimal data and no labels, our system yields fast, spatially coherent detection and interpretable propagation maps, offering a practical, lightweight pathway to city-scale grid resilience analytics.

Niu, Haoran [ORNL] (ORCID:0000000155228297)↗

Fault diagnosis for the Space Shuttle main engine

A conceptual design of a model-based fault detection and diagnosis system is developed for the Space Shuttle main engine. The design approach consists of process modeling, residual generation, and fault detection and diagnosis. The engine is modeled using a discrete time, quasilinear state-space representation. Model parameters are determined by identification. Residuals generated from the model are used by a neural network to detect and diagnose engine component faults. Fault diagnosis is accomplished by training the neural network to recognize the pattern of the respective fault signatures. Preliminary results for a failed valve, generated using a full, nonlinear simulation of the engine, are presented. These results indicate that the developed approach can be used for fault detection and diagnosis. The results also show that the developed model is an accurate and reliable predictor of the highly nonlinear and very complex engine.

Duyar, Ahmet↗

Cross-reactive immunogenicity of group A streptococcal vaccines designed using a recurrent neural network to identify conserved M protein linear epitopes

The M protein of group A streptococci (Strep A) is a major virulence determinant and protective antigen. The N-terminal sequence of the protein defines the more than 200 M types of Strep A and also contains epitopes that elicit opsonic antibodies, some of which cross-react with heterologous M types. Current efforts to develop broadly protective M protein-based vaccines are directed at identifying potential cross-protective epitopes located in the N-terminal regions of cluster-related M proteins for use as vaccine antigens. In this study, we have used a comprehensive approach using the recurrent neural network ABCpred and IEDB epitope conservancy analysis tools to predict 16 residue linear B-cell epitopes from 117 clinically relevant M types of Strep A (~88% of global Strep A infections). Furthermore, to examine the immunogenicity of these epitope-based vaccines, nine peptides that together shared ≥60% sequence identity with 37 heterologous M proteins were incorporated into two recombinant hybrid protein vaccines, in which the epitopes were repeated 2 or 3 times, respectively. The combined immune responses of immunized rabbits showed that the vaccines elicited significant levels of antibodies against all nine vaccine epitopes present in homologous N-terminal 1–50 amino acid synthetic M peptides, as well as cross-reactive antibodies against 16 of 37 heterologous M peptides predicted to contain similar epitopes. The epitope-specificity of the cross-reactive antibodies was confirmed by ELISA inhibition assays and functional opsonic activity was assayed in HL-60-based bactericidal assays. The results provide important information for the future design of broadly protective M protein-based Strep A vaccines.

60 APPLIED LIFE SCIENCES↗

Systematic KMTNet Planetary Anomaly Search. I. OGLE-2019-BLG-1053Lb, a Buried Terrestrial Planet

In order to exhume the buried signatures of “missing planetary caustics” in Korea Microlensing Telescope Network (KMTNet) data, we conducted a systematic anomaly search of the residuals from point-source point-lens fits, based on a modified version of the KMTNet EventFinder algorithm. This search revealed the lowest-mass-ratio planetary caustic to date in the microlensing event OGLE-2019-BLG-1053, for which the planetary signal had not been noticed before. The planetary system has a planet–host mass ratio of q = (1.25 ± 0.13) × 10{sup -5}. A Bayesian analysis yielded estimates of the mass of the host star, M{sub host}=0.61{sub -0.24}{sup +0.29} M{sub ⊙}, the mass of its planet, M{sub planet}=2.48{sub -0.98}{sup +1.19} M{sub ⊕}, the projected planet–host separation, a{sub ⊥}=3.4{sub -0.5}{sup +0.5} au, and the lens distance, D{sub L}=6.8{sub -0.9}{sup +0.6} kpc. The discovery of this very-low-mass-ratio planet illustrates the utility of our method and opens a new window for a large and homogeneous sample to study the microlensing planet–host mass ratio function down to q ~ 10{sup -5}.

47 OTHER INSTRUMENTATION↗

Systematic KMTNet Planetary Anomaly Search. I. OGLE-2019-BLG-1053Lb, a BuriedTerrestrial Planet

In order to exhume the buried signatures of “missing planetary caustics” in Korea Microlensing Telescope Network (KMTNet) data, we conducted a systematic anomaly search of the residuals from point-source point-lens fits, based on a modified version of the KMTNet Event Finder algorithm. This search revealed the lowest-mass-ratio planetary caustic to date in the microlensing event OGLE-2019-BLG-1053, for which the planetary signal had not been noticed before. The planetary system has a planet–host mass ratio ofq= (1.25±0.13) × 10−5. A Bayesian analysis yielded estimates of the mass of the host star, Mhost =-0.61+0.29 -0.24 Mo, the mass of its planet, Mplanet =-2.48 +1.19 -0.98 Mo, the projected planet – host separation, a^= 3.4 +0.5/-0.5 au, and the lens distance, DL =-6.8 +0.6 -0.90kpc.The discovery of this very-low-mass-ratio planet illustrates the utility of our method and opens a new window for a large and homogeneous sample to study the microlensing planet–host mass ratio function down to q∼ 10−5.

Exoplanet detection methods↗

Determining crop residue type and class using satellite acquired data

LANDSAT Thematic Mapper (TM) data for March 23, 1987 with accompanying ground truth data for the study area in Miami County, IN were used to determine crop residue type and class. Principle components and spectral ratioing transformations were applied to the LANDSAT TM data. One graphic information system (GIS) layer of land ownership was added to each original image as the eighth band of data in an attempt to improve classification. Maximum likelihood, minimum distance, and neural networks were used to classify the original, transformed, and GIS-enhanced remotely sensed data. Crop residues could be separated from one another and from bare soil and other biomass. Two types of crop residue and four classes were identified from each LANDSAT TM image. The maximum likelihood classifier performed the best classification for each original image without need of any transformation. The neural network classifier was able to improve the classification by incorporating a GIS-layer of land ownership as an eighth band of data. The maximum likelihood classifier was unable to consider this eighth band of data and thus, its results could not be improved by its consideration.

Zhuang, Xin↗

Monitoring covariance in multivariate time series: Comparing machine learning and statistical approaches

Abstract In complex systems with multiple variables monitored at high‐frequency, variables are not only temporally autocorrelated, but they may also be nonlinearly related or exhibit nonstationarity as the inputs or operation changes. One approach to handling such variables is to detrend them prior to monitoring and then apply control charts that assume independence and stationarity to the residuals. Monitoring controlled systems is even more challenging because the control strategy seeks to maintain variables at prespecified mean levels, and to compensate, correlations among variables may change, making monitoring the covariance essential. In this paper, a vector autoregressive model (VAR) is compared with a multivariate random forest (MRF) and a neural network (NN) for detrending multivariate time series prior to monitoring the covariance of the residuals using a multivariate exponentially weighted moving average (MEWMA) control chart. Machine learning models have an advantage when the data's structure is unknown or may change. We design a novel simulation study with nonlinear, nonstationary, and autocorrelated data to compare the different detrending models and subsequent covariance monitoring. The machine learning models have superior performance for nonlinear and strongly autocorrelated data and similar performance for linear data. An illustration with data from a reverse osmosis process is given.

Weix, Derek↗

Combination of deep neural network with attention mechanism enhances the explainability of protein contact prediction

Abstract Deep learning has emerged as a revolutionary technology for protein residue‐residue contact prediction since the 2012 CASP10 competition. Considerable advancements in the predictive power of the deep learning‐based contact predictions have been achieved since then. However, little effort has been put into interpreting the black‐box deep learning methods. Algorithms that can interpret the relationship between predicted contact maps and the internal mechanism of the deep learning architectures are needed to explore the essential components of contact inference and improve their explainability. In this study, we present an attention‐based convolutional neural network for protein contact prediction, which consists of two attention mechanism‐based modules: sequence attention and regional attention. Our benchmark results on the CASP13 free‐modeling targets demonstrate that the two attention modules added on top of existing typical deep learning models exhibit a complementary effect that contributes to prediction improvements. More importantly, the inclusion of the attention mechanism provides interpretable patterns that contain useful insights into the key fold‐determining residues in proteins. We expect the attention‐based model can provide a reliable and practically interpretable technique that helps break the current bottlenecks in explaining deep neural networks for contact prediction. The source code of our method is available at https://github.com/jianlin-cheng/InterpretContactMap .

59 BASIC BIOLOGICAL SCIENCES↗

Learning interpretable surface elasticity properties from bulk properties via neural network equation learners

Surface elasticity is central to understanding the mechanics and stability of surfaces and interfaces. It is characterized by quantities such as surface tension, residual surface stress, and surface stiffness. However their analytical expressions are typically difficult to derive from atomistic data, and depend strongly on modeling choices. This work presents a neural network-based equation learner which combines customized activation functions and connection-based pruning to discover parsimonious, closed-form equations for surface elasticity from atomistic simulations. Applying the method to seven face-centered cubic (FCC) metals, our equation learner uncovers interpretable equations that describe both low-Miller index and high-Miller index surface properties, capturing long-tail property distributions accurately. The discovered expressions are decoupled into two components: a universal, geometry-driven orientation function, and material-specific baseline coefficients. We find that lower-order properties such as surface tension are fundamentally geometry dependent, while higher-order properties such as surface stress and elasticity show more complex geometry and material dependence. We also relate material dependent coefficients to bulk properties, forming a clear map from bulk material properties to surface elasticity. Overall, this approach demonstrates that interpretable neurosymbolic machine learning can bridge the gap between atomistic simulations and physical laws, enabling the discovery of generalizable structure–property relationships for materials science phenomena such as surface elasticity.

Equation learning↗

Causality-respecting adaptive refinement for PINNs: enabling precise interface evolution in phase field modeling

Physics-informed neural networks (PINNs) have emerged as a powerful tool for solving physical systems described by partial differential equations (PDEs). However, their accuracy in dynamical systems, particularly those involving sharp moving boundaries with complex initial morphologies, remains a challenge. Here, this study introduces an approach combining residual-based adaptive refinement (RBAR) with causality-informed training to enhance the performance of PINNs in solving spatio-temporal PDEs. Our method employs a three-step iterative process: initial causality-based training, RBAR-guided domain refinement, and subsequent causality training on the refined mesh. Applied to the Allen-Cahn equation, a widely-used model in phase field simulations, our approach demonstrates significant improvements in solution accuracy and computational efficiency over traditional PINNs. Notably, we observe an ‘overshoot and relocate’ phenomenon in dynamic cases with complex morphologies, showcasing the method’s adaptive error correction capabilities. This synergistic interaction between RBAR and causality training enables accurate capture of interface evolution, even in challenging scenarios where traditional PINNs fail. Our framework not only resolves the limitations of uniform refinement strategies but also provides a generalizable methodology for solving a broad range of spatio-temporal PDEs. The enhanced performance of the RBAR–causality combined framework demonstrates its strong potential for advancing PINN-based modeling of physical systems characterized by complex, evolving interfaces.

Allen-Cahn equations↗

Research In Nonlinear Flight Control for Tiltrotor Aircraft Operating in the Terminal Area

The research during the first year of the effort focused on the implementation of the recently developed combination of neural net work adaptive control and feedback linearization. At the core of this research is the comprehensive simulation code Generic Tiltrotor Simulator (GTRS) of the XV-15 tilt rotor aircraft. For this research the GTRS code has been ported to a Fortran environment for use on PC. The emphasis of the research is on terminal area approach procedures, including conversion from aircraft to helicopter configuration. This report focuses on the longitudinal control which is the more challenging case for augmentation. Therefore, an attitude command attitude hold (ACAH) control augmentation is considered which is typically used for the pitch channel during approach procedures. To evaluate the performance of the neural network adaptive control architecture it was necessary to develop a set of low order pilot models capable of performing such tasks as, follow desired altitude profiles, follow desired speed profiles, operate on both sides of powercurve, convert, including flaps as well as mastangle changes, operate with different stability and control augmentation system (SCAS) modes. The pilot models are divided in two sets, one for the backside of the powercurve and one for the frontside. These two sets are linearly blended with speed. The mastangle is also scheduled with speed. Different aspects of the proposed architecture for the neural network (NNW) augmented model inversion were also demonstrated. The demonstration involved implementation of a NNW architecture using linearized models from GTRS, including rotor states, to represent the XV-15 at various operating points. The dynamics used for the model inversion were based on the XV-15 operating at 30 Kts, with residualized rotor dynamics, and not including cross coupling between translational and rotational states. The neural network demonstrated ACAH control under various circumstances. Future efforts will include the implementation into the Fortran environment of GTRS, including pilot modeling and NNW augmentation for the lateral channels. These efforts should lead to the development of architectures that will provide for fully automated approach, using similar strategies.

Calise, A. J.↗

High voltage protection network

Circuit protects technical personnel and test equipment from hazardous currents conducted through safety barriers and into data acquisition equipment. Network isolates energy source, restricts arcing to remote area, and dissipates harmlessly residual energy transient.

Cambra, J. M.↗

Time-dependent aerodynamic analysis of ducted and unducted propfans at angle of attack

A three-dimensional unsteady aerodynamic analysis is described for predicting the time-dependent flow about ducted and unducted propfans operating at angle of attack. Although the freestream is assumed to be uniform, the flow relative to the rotating blades varies with circumferential position, resulting in an inherent unsteadiness due to the nonaxial inflow. The time-dependent Euler equations are solved utilizing a Runge-Kutta time-stepping scheme. The analysis is based on a finite-volume discretization employing a multiple-block grid network. To permit the use of large calculation time steps, an implicit residual smoothing scheme previously tested for unsteady flow calculations in two dimensions is extended to three spatial dimensions. For unducted propfans, a single H-type grid block is used for each blade passage to determine the time-periodic flowfield. For ducted propfans (ultra-high bypass fans) a body-centered C-type grid is wrapped about the cowl to improve the accuracy of the analysis in the high gradient flow region near the cowl leading edge. Numerical results are compared with available data for both ducted and unducted propfans operating at angle of attack.

Hall, Edward J.↗

The Impact and Estimation of Uncertainty Correlation for Multi-Angle Polarimetric Remote Sensing of Aerosols and Ocean Color

Multi-angle polarimetric (MAP) measurements contain rich information for characterization of aerosol microphysical and optical properties that can be used to improve atmospheric correction in ocean color remote sensing. Advanced retrieval algorithms have been developed to obtain multiple geophysical parameters in the atmosphere-ocean system, although uncertainty correlation among measurements is generally ignored due to lack of knowledge on its strength and characterization. In this work, we provide a practical framework to evaluate the impact of the angular uncertainty correlation from retrieval results and a method to estimate correlation strength from retrieval fitting residuals. The Fast Multi-Angular Polarimetric Ocean coLor (FastMAPOL) retrieval algorithm, based on neural network forward models, is used to conduct the retrievals and uncertainty quantification. In addition, we also discuss a flexible approach to include a correlated uncertainty model in the retrieval algorithm. The impact of angular correlation on retrieval uncertainties is discussed based on synthetic AirHARP and HARP2 measurements using a Monte Carlo uncertainty estimation method. Correlation properties are estimated using auto-correlation functions based on the fitting residuals from both synthetic AirHARP and HARP2 data and real AirHARP measurement, with the resulting angular correlation parameters found to be larger than 0.9 and 0.8 for reflectance and DoLP, respectively, which correspond to correlation angles of 10° and 5°. Although this study focuses on angular correlation from HARP instruments, the methodology to study and quantify uncertainty correlation is also applicable to other instruments with angular, spectral, or spatial correlations, and can help inform laboratory calibration and characterization of the instrument uncertainty structure.

PACE↗

Network structure in alteration layer of boroaluminosilicate glass formed by aqueous corrosion

Exogenously-added LiCl has been shown to slightly accelerate the corrosion rate of a boroaluminosilicate glass called International Simple Glass (ISG) in aqueous solutions over forward- and residual-rate regimes, while KCl and CsCl impede. To understand the effect of exogenously added electrolytes on resulting hydrous species and the network structure of alteration layers, infrared spectroscopy was implemented. It was found that the fraction of molecular water relative to the surface-bound hydroxyl species is lower in the KCl and CsCl conditions compared to the LiCl and pure water conditions. An approximation for the spectral features of the thin surface films from an experimentally-obtained specular-reflectance infrared (SR-IR) spectrum was proposed; results indicate no significant difference in the Si-O bonding network of the alteration layers formed in the presence of exogenously added LiCl, KCl and CsCl. Furthermore, the observed change in corrosion rates might be linked to the relative abundance of molecular water species in the porous network, rather than the silicate bonding structure.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

LAF-Net: A Deep Residual and Cross-Attention Framework for Day-Ahead Load Forecasting: Preprint

Accurate day-ahead load forecasting is essential for reliable power system operations and market efficiency. System operators such as the Midcontinent Independent System Operator (MISO) rely on forecasts from multiple vendors, yet combining them effectively remains a persistent challenge due to vendor-specific biases. This paper presents a novel LSTM-Attention Fusion Network with Error Representation (LAF-Net) that enhances day-ahead hourly load forecasting through deep residual learning and multi-modal cross-attention. The proposed model builds a historical error memory from past vendor performance and dynamically queries it with future hour context to generate adaptive, hour-specific trust weights for each vendor. A bounded residual correction further refines forecasts by mitigating systematic and temporally localized errors. Tested on real MISO LBA data with multi-vendor forecasts, LAF-Net consistently outperforms the best vendor baseline across all 38 LBAs, achieving more than a 40% reduction in system-level mean absolute error (MAE) during peak load hours relative to the best vendor baseline.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Static and Dynamic Thermomechanical Properties of Phase-Separated Epoxy Networks with Tuned Microstructures

Here, polymerization-induced phase separation is a useful method for the construction of heterogeneous epoxy networks with properties exceeding their homogeneous counterparts. In this work, we examine the static and dynamic thermomechanical properties of phase-separated epoxy networks salient to their application as encapsulants. Three heterogeneous epoxy-amine networks with nano-, meso-, and macro-phase-separated morphologies comprised of hard and soft domains are compared to a rigid, unstructured network. The glass transition profiles of the heterogeneous networks are complex, spanning many decades in the frequency domain. The nanophase-separated morphology leads to higher coefficient of thermal expansion, yet surprisingly is characterized by reduced residual stress. Under both quasi-static and dynamic compression (strain rates of order 10 –3 and 10 3 s –1 , respectively), the nanophase-separated network also exhibits higher modulus and strength. In split-Hopkinson bar experiments, the energy dissipation characteristics of the epoxy networks were nearly identical. Curiously, however, the Hugoniot response of the macro-phase-separated network determined by ballistic shockwave analysis indicates a remarkable ability of this material to mitigate shockwave propagation in comparison to many homogeneous and heterogeneous polymer materials. Collectively, this work reveals several previously unreported phenomena with respect to structure–property relationships in phase-separated epoxy networks, illustrating the potential value of systematically tuned microstructures for optimization of application-specific physical properties.

36 MATERIALS SCIENCE↗

Flow over an espresso cup: inferring 3-D velocity and pressure fields from tomographic background oriented Schlieren via physics-informed neural networks

Tomographic background oriented Schlieren (Tomo-BOS) imaging measures density or temperature fields in three dimensions using multiple camera BOS projections, and is particularly useful for instantaneous flow visualizations of complex fluid dynamics problems. We propose a new method based on physics-informed neural networks (PINNs) to infer the full continuous three-dimensional (3-D) velocity and pressure fields from snapshots of 3-D temperature fields obtained by Tomo-BOS imaging. The PINNs seamlessly integrate the underlying physics of the observed fluid flow and the visualization data, hence enabling the inference of latent quantities using limited experimental data. In this hidden fluid mechanics paradigm, we train the neural network by minimizing a loss function composed of a data mismatch term and residual terms associated with the coupled Navier–Stokes and heat transfer equations. We first quantify the accuracy of the proposed method based on a two-dimensional synthetic data set for buoyancy-driven flow, and subsequently apply it to the Tomo-BOS data set, where we are able to infer the instantaneous velocity and pressure fields of the flow over an espresso cup based only on the temperature field provided by the Tomo-BOS imaging. Moreover, we conduct an independent PIV experiment to validate the PINN inference for the unsteady velocity field at a centre plane. To explain the observed flow physics, we also perform systematic PINN simulations at different Reynolds and Richardson numbers and quantify the variations in velocity and pressure fields. Furthermore, the results in this paper indicate that the proposed deep learning technique can become a promising direction in experimental fluid mechanics.

97 MATHEMATICS AND COMPUTING↗