Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Residual networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

High voltage protection network

Circuit protects technical personnel and test equipment from hazardous currents conducted through safety barriers and into data acquisition equipment. Network isolates energy source, restricts arcing to remote area, and dissipates harmlessly residual energy transient.

Cambra, J. M.↗

Time-dependent aerodynamic analysis of ducted and unducted propfans at angle of attack

A three-dimensional unsteady aerodynamic analysis is described for predicting the time-dependent flow about ducted and unducted propfans operating at angle of attack. Although the freestream is assumed to be uniform, the flow relative to the rotating blades varies with circumferential position, resulting in an inherent unsteadiness due to the nonaxial inflow. The time-dependent Euler equations are solved utilizing a Runge-Kutta time-stepping scheme. The analysis is based on a finite-volume discretization employing a multiple-block grid network. To permit the use of large calculation time steps, an implicit residual smoothing scheme previously tested for unsteady flow calculations in two dimensions is extended to three spatial dimensions. For unducted propfans, a single H-type grid block is used for each blade passage to determine the time-periodic flowfield. For ducted propfans (ultra-high bypass fans) a body-centered C-type grid is wrapped about the cowl to improve the accuracy of the analysis in the high gradient flow region near the cowl leading edge. Numerical results are compared with available data for both ducted and unducted propfans operating at angle of attack.

Hall, Edward J.↗

The Impact and Estimation of Uncertainty Correlation for Multi-Angle Polarimetric Remote Sensing of Aerosols and Ocean Color

Multi-angle polarimetric (MAP) measurements contain rich information for characterization of aerosol microphysical and optical properties that can be used to improve atmospheric correction in ocean color remote sensing. Advanced retrieval algorithms have been developed to obtain multiple geophysical parameters in the atmosphere-ocean system, although uncertainty correlation among measurements is generally ignored due to lack of knowledge on its strength and characterization. In this work, we provide a practical framework to evaluate the impact of the angular uncertainty correlation from retrieval results and a method to estimate correlation strength from retrieval fitting residuals. The Fast Multi-Angular Polarimetric Ocean coLor (FastMAPOL) retrieval algorithm, based on neural network forward models, is used to conduct the retrievals and uncertainty quantification. In addition, we also discuss a flexible approach to include a correlated uncertainty model in the retrieval algorithm. The impact of angular correlation on retrieval uncertainties is discussed based on synthetic AirHARP and HARP2 measurements using a Monte Carlo uncertainty estimation method. Correlation properties are estimated using auto-correlation functions based on the fitting residuals from both synthetic AirHARP and HARP2 data and real AirHARP measurement, with the resulting angular correlation parameters found to be larger than 0.9 and 0.8 for reflectance and DoLP, respectively, which correspond to correlation angles of 10° and 5°. Although this study focuses on angular correlation from HARP instruments, the methodology to study and quantify uncertainty correlation is also applicable to other instruments with angular, spectral, or spatial correlations, and can help inform laboratory calibration and characterization of the instrument uncertainty structure.

PACE↗

Network structure in alteration layer of boroaluminosilicate glass formed by aqueous corrosion

Exogenously-added LiCl has been shown to slightly accelerate the corrosion rate of a boroaluminosilicate glass called International Simple Glass (ISG) in aqueous solutions over forward- and residual-rate regimes, while KCl and CsCl impede. To understand the effect of exogenously added electrolytes on resulting hydrous species and the network structure of alteration layers, infrared spectroscopy was implemented. It was found that the fraction of molecular water relative to the surface-bound hydroxyl species is lower in the KCl and CsCl conditions compared to the LiCl and pure water conditions. An approximation for the spectral features of the thin surface films from an experimentally-obtained specular-reflectance infrared (SR-IR) spectrum was proposed; results indicate no significant difference in the Si-O bonding network of the alteration layers formed in the presence of exogenously added LiCl, KCl and CsCl. Furthermore, the observed change in corrosion rates might be linked to the relative abundance of molecular water species in the porous network, rather than the silicate bonding structure.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

LAF-Net: A Deep Residual and Cross-Attention Framework for Day-Ahead Load Forecasting: Preprint

Accurate day-ahead load forecasting is essential for reliable power system operations and market efficiency. System operators such as the Midcontinent Independent System Operator (MISO) rely on forecasts from multiple vendors, yet combining them effectively remains a persistent challenge due to vendor-specific biases. This paper presents a novel LSTM-Attention Fusion Network with Error Representation (LAF-Net) that enhances day-ahead hourly load forecasting through deep residual learning and multi-modal cross-attention. The proposed model builds a historical error memory from past vendor performance and dynamically queries it with future hour context to generate adaptive, hour-specific trust weights for each vendor. A bounded residual correction further refines forecasts by mitigating systematic and temporally localized errors. Tested on real MISO LBA data with multi-vendor forecasts, LAF-Net consistently outperforms the best vendor baseline across all 38 LBAs, achieving more than a 40% reduction in system-level mean absolute error (MAE) during peak load hours relative to the best vendor baseline.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Static and Dynamic Thermomechanical Properties of Phase-Separated Epoxy Networks with Tuned Microstructures

Here, polymerization-induced phase separation is a useful method for the construction of heterogeneous epoxy networks with properties exceeding their homogeneous counterparts. In this work, we examine the static and dynamic thermomechanical properties of phase-separated epoxy networks salient to their application as encapsulants. Three heterogeneous epoxy-amine networks with nano-, meso-, and macro-phase-separated morphologies comprised of hard and soft domains are compared to a rigid, unstructured network. The glass transition profiles of the heterogeneous networks are complex, spanning many decades in the frequency domain. The nanophase-separated morphology leads to higher coefficient of thermal expansion, yet surprisingly is characterized by reduced residual stress. Under both quasi-static and dynamic compression (strain rates of order 10 –3 and 10 3 s –1 , respectively), the nanophase-separated network also exhibits higher modulus and strength. In split-Hopkinson bar experiments, the energy dissipation characteristics of the epoxy networks were nearly identical. Curiously, however, the Hugoniot response of the macro-phase-separated network determined by ballistic shockwave analysis indicates a remarkable ability of this material to mitigate shockwave propagation in comparison to many homogeneous and heterogeneous polymer materials. Collectively, this work reveals several previously unreported phenomena with respect to structure–property relationships in phase-separated epoxy networks, illustrating the potential value of systematically tuned microstructures for optimization of application-specific physical properties.

36 MATERIALS SCIENCE↗

Flow over an espresso cup: inferring 3-D velocity and pressure fields from tomographic background oriented Schlieren via physics-informed neural networks

Tomographic background oriented Schlieren (Tomo-BOS) imaging measures density or temperature fields in three dimensions using multiple camera BOS projections, and is particularly useful for instantaneous flow visualizations of complex fluid dynamics problems. We propose a new method based on physics-informed neural networks (PINNs) to infer the full continuous three-dimensional (3-D) velocity and pressure fields from snapshots of 3-D temperature fields obtained by Tomo-BOS imaging. The PINNs seamlessly integrate the underlying physics of the observed fluid flow and the visualization data, hence enabling the inference of latent quantities using limited experimental data. In this hidden fluid mechanics paradigm, we train the neural network by minimizing a loss function composed of a data mismatch term and residual terms associated with the coupled Navier–Stokes and heat transfer equations. We first quantify the accuracy of the proposed method based on a two-dimensional synthetic data set for buoyancy-driven flow, and subsequently apply it to the Tomo-BOS data set, where we are able to infer the instantaneous velocity and pressure fields of the flow over an espresso cup based only on the temperature field provided by the Tomo-BOS imaging. Moreover, we conduct an independent PIV experiment to validate the PINN inference for the unsteady velocity field at a centre plane. To explain the observed flow physics, we also perform systematic PINN simulations at different Reynolds and Richardson numbers and quantify the variations in velocity and pressure fields. Furthermore, the results in this paper indicate that the proposed deep learning technique can become a promising direction in experimental fluid mechanics.

97 MATHEMATICS AND COMPUTING↗

Utilization of an Advanced Sensor network to determine fuel heating value and Real-Time net unit heat rate during transient operation

Coal-fired utility boilers are being increasingly used as variable electricity generation to resolve the imbalance in the energy market from the expansion of intermittent renewable energy. The frequent transient operation required to meet residual energy demand has created a challenge for coal-fired units to operate efficiently. This work utilizes an advanced sensor network (ASN) to calculate net unit heat rate (NUHR) of a coal-fired boiler in real time through combustion calculations and statistical correlations to provide the tools for optimizing dynamic operation. Real-time heating values that were necessary to determine fuel input energy to calculate accurate NUHR were found using both fundamental and data-driven methods. Real-time NUHR shows distinct shifts that reflect changes in process conditions that will improve the ability to optimize transient operation. Data-driven heating value correlations had 24% lower root mean square error (RMSE) than the fundamental combustion calculation approach when compared to daily retrospective proximate analysis. Furthermore, the data-driven method RMSE improved by 7% with the inclusion of ASN data. Future work is to validate by comparing unit performance with and without the inclusion of NUHR as a control parameter for the dynamic neural network.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Residual-based error correction for neural operator accelerated infinite-dimensional Bayesian inverse problems

We explore using neural operators, or neural network representations of nonlinear maps between function spaces, to accelerate infinite-dimensional Bayesian inverse problems (BIPs) with models governed by nonlinear parametric partial differential equations (PDEs). Neural operators have gained significant attention in recent years for their ability to approximate the parameter-to-solution maps defined by PDEs using as training data solutions of PDEs at a limited number of parameter samples. The computational cost of BIPs can be drastically reduced if the large number of PDE solves required for posterior characterization are replaced with evaluations of trained neural operators. However, reducing error in the resulting BIP solutions via reducing the approximation error of the neural operators in training can be challenging and unreliable. We provide an a priori error bound result that implies certain BIPs can be ill-conditioned to the approximation error of neural operators, thus leading to inaccessible accuracy requirements in training. To reliably deploy neural operators in BIPs, we consider a strategy for enhancing the performance of neural operators: correcting the prediction of a trained neural operator by solving a linear variational problem based on the PDE residual. We show that a trained neural operator with error correction can achieve a quadratic reduction of its approximation error, all while retaining substantial computational speedups of posterior sampling when models are governed by highly nonlinear PDEs. The strategy is applied to two numerical examples of BIPs based on a nonlinear reaction–diffusion problem and deformation of hyperelastic materials. We demonstrate that posterior representations of the two BIPs produced using trained neural operators are greatly and consistently enhanced by error correction.

97 MATHEMATICS AND COMPUTING↗

Photometric redshift estimation with convolutional neural networks and galaxy images: Case study of resolving biases in data-driven methods

Deep-learning models have been increasingly exploited in astrophysical studies, but these data-driven algorithms are prone to producing biased outputs that are detrimental for subsequent analyses. In this work, we investigate two main forms of biases: class-dependent residuals, and mode collapse. We do this in a case study, in which we estimate photometric redshift as a classification problem using convolutional neural networks (CNNs) trained with galaxy images and associated spectroscopic redshifts. We focus on point estimates and propose a set of consecutive steps for resolving the two biases based on CNN models, involving representation learning with multichannel outputs, balancing the training data, and leveraging soft labels. The residuals can be viewed as a function of spectroscopic redshift or photometric redshift, and the biases with respect to these two definitions are incompatible and should be treated individually. We suggest that a prerequisite for resolving biases in photometric space is resolving biases in spectroscopic space. Experiments show that our methods can better control biases than benchmark methods, and they are robust in various implementing and training conditions with high-quality data. Our methods hold promises for future cosmological surveys that require a good constraint of biases, and they may be applied to regression problems and other studies that make use of data-driven models. Nonetheless, the bias-variance tradeoff and the requirement of sufficient statistics suggest that we need better methods and optimized data usage strategies.

79 ASTRONOMY AND ASTROPHYSICS↗

Hydration of ferric chloride and nitrate in aqueous solutions: water-mediated ion pairing revealed by Raman spectroscopy

Iron is the most abundant transition metal in the earth's crust and is important for the proper functioning of many technological and natural processes. Despite the importance, a complete microscopic understanding of the hydration of ferric ions and water mediated ion pairing has not been realized. Hydrated Fe(III) is difficult to study due to the process of complexation to the anion and hydrolysis of the hydrating water molecules leading to a heterogeneous solution with diverse speciation. Here, ferric chloride and nitrate aqueous solutions are studied using polarized Raman spectroscopy as a function of concentration and referenced to their respective sodium salt or mineral acid. Perturbed water spectra (PWS) were generated using multivariate curve resolution-alternating least squares (MCR-ALS) to show the residual spectral response uniquely attributable to the hydration of ferric speciation. The hydrogen bonding network associated with the hydrating water molecules in ferric chloride solutions are found to be more similar to hydrochloric acid solutions, whereas in ferric nitrate solutions, the network behaves more similar to sodium nitrate, despite increased acidity. Thus, in the FeNO 3 and FeCl 3 solutions, ion pairing and coordination, respectively, are significantly influencing the hydration spectra signature. These results further reveal concentration dependent changes to the hydrogen bonding network, hydrating water symmetry, and changes to the relative abundance of solvent shared ion pairs that are governed primarily by the ferric salt identity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Room-temperature neutron and X-ray data collection of 3CL M pro from SARS-CoV-2

The replication of SARS-CoV-2 produces two large polyproteins, pp1a and pp1ab, that are inactive until cleavage by the viral chymotrypsin-like cysteine protease enzyme (3CL M pro ) into a series of smaller functional proteins. At the heart of 3CL M pro is an unusual catalytic dyad formed by the side chains of His41 and Cys145 and a coordinated water molecule. The catalytic mechanism by which the enzyme operates is still unknown, as crucial information on the protonation states within the active site is unclear. To experimentally determine the protonation states of the catalytic site and of the other residues in the substrate-binding cavity, and to visualize the hydrogen-bonding networks throughout the enzyme, room-temperature neutron and X-ray data were collected from a large H/D-exchanged crystal of ligand-free (apo) 3CL M pro .

3CL Mpro↗

Measurement of the power spectral density of phase of the hydrogen maser

Hydrogen masers are being developed for the Deep Space Network as improved frequency standards, in order to achieve better timing accuracies, reduced Doppler residuals, and lower phase noise in the tracking system. Performance data for the masers are given in two forms: time domain performance, useful for analyzing time keeping systems and Doppler systems; and frequency domain performance, useful for analyzing tracking systems. Particular attention is given to frequency domain performance, as obtained from both time domain measurements and direct measurements.

Sward, A.↗

A hybrid neurocomputing/numerical strategy for nonlinear structural analysis

A hybrid neurocomputing/numerical strategy is presented for geometrically nonlinear analysis of structures. The strategy combines model-free data processing capabilities of computational neural networks with a Pade approximants-based perturbation technique to predict partial information about the nonlinear response of structures. In the hybrid strategy, multilayer feedforward neural networks are used to extend the validity of solutions by using training samples produced by Pade approximations to the Taylor series expansion of the response function. The range of validity of the training samples is taken to be the radius of convergence of Pade approximants and is estimated by setting a tolerance on the diverging approximants. The norm of residual vector of unbalanced forces in a given element is used as a measure to assess the quality of network predictions. To further increase the accuracy and the range of network predictions, additional training data are generated by either applying linear regression to weight matrices or expanding the training data by using predicted coefficients in a Taylor series. The effectiveness of the hybrid strategy is assessed by performing large-deflection analysis of a doubly-curved composite panel with a circular cutout, and postbuckling analyses of stiffened composite panels subjected to an in-plane edge shear load. In all the problems considered, the hybrid strategy is used to predict selective information about the structural response, namely the total strain energy and the maximum displacement components only.

Szewczyk, Z. Peter↗

Impact of Polymer Rheology on Gel Treatment Performance of Horizontal Wells with Severe Channeling

Summary Gel treatment has been a cost-effective method to control the conformance of a reservoir with severe heterogeneity problems. The water channels in such reservoirs can be classified as open fractures or high permeability porous media with pore-throat network. Many simulation studies have been conducted to discuss gel treatment performance for conformance control. However, nobody considered the polymer rheology difference in open fractures and porous media in simulation. Previous simulation studies also ignored the residual resistance factor as a function of rock permeability rather than a constant parameter. In this study, a conceptual simulation model was established to simulate the linear flow system for the reservoir with horizontal wells considering the two factors mentioned above. The results demonstrate that the gel treatment always provides the better placement results in the open fracture type channel than pore-throat network type channel. Moreover, it is very necessary to consider residual resistance factor as a function of permeability, which is based on the experimental results and can provide much greater plugging efficiency in the higher permeable channels than constant residual resistance factor. Sensitivity analysis studies and multifactor analysis indicate that increasing oil viscosity and permeability ratio has a strong positive influence on conformance control results, which indicate in-situ gel treatment can be better applied in heavy or viscous oil reservoirs with fracture-like channels. Besides, the results also indicate that in reservoirs with severe channeling problem where channel velocity was high, the differences of gelant placement and profile improvement in models with two different types of channels could be enlarged greatly.

Engineering↗

LossLens: Diagnostics for Machine Learning Through Loss Landscape Visual Analytics

Modern machine learning often relies on optimizing a neural network's parameters using a loss function to learn complex features. Beyond training, examining the loss function with respect to a network's parameters (i.e., as a loss landscape) can reveal insights into the architecture and learning process. While the local structure of the loss landscape surrounding an individual solution can be characterized using a variety of approaches, the global structure of a loss landscape, which includes potentially many local minima corresponding to different solutions, remains far more difficult to conceptualize and visualize. To address this difficulty, we introduce LossLens, a visual analytics framework that explores loss landscapes at multiple scales. LossLens integrates metrics from global and local scales into a comprehensive visual representation, enhancing model diagnostics. Here we demonstrate LossLens through two case studies: visualizing how residual connections influence a ResNet-20, and visualizing how physical parameters influence a physics-informed neural network (PINN) solving a simple convection problem.

97 MATHEMATICS AND COMPUTING↗

Absolute positioning using DORIS tracking of the SPOT-2 satellite

The ability of the French DORIS system operating on the SPOT-2 satellite to provide absolute site positioning at the 20-30-centimeter level using 80 d of data is demonstrated. The accuracy of the vertical component is comparable to that of the horizontal components, indicating that residual troposphere error is not a limiting factor. The translation parameters indicate that the DORIS network realizes a geocentric frame to about 50 nm in each component. The considerable amount of data provided by the nearly global, all-weather DORIS network allowed this complex parameterization required to reduce the unmodeled forces acting on the low-earth satellite. Site velocities with accuracies better than 10 mm/yr should certainly be possible using the multiyear span of the SPOT series and Topex/Poseidon missions.

Watkins, M. M.↗

Prebiotic Chemistry of Pluto

We present the case for the presence of complex organic molecules, such as amino acids and nucleobases, formed by abiotic processes on the surface and in near-subsurface regions of Pluto. Pluto's surface is tinted with a range of non-ice substances with colors ranging from light yellow to red to dark brown; the colors match those of laboratory organic residues called tholins. Tholins are broadly characterized as complex, macromolecular organic solids consisting of a network of aromatic structures connected by aliphatic bridging units (e.g., Imanaka et al.,2004; Materese et al.,2014, 2015). The synthesis of tholins in planetary atmospheres and in surface ices has been explored in numerous laboratory experiments, and both gas- and solid-phase varieties are found on Pluto. A third variety of tholins, exposed at a site of tectonic surface fracturing called Virgil Fossae, appears to have come from a reservoir in the subsurface. Eruptions of tholin-laden liquid H2O from a subsurface aqueous repository appear to have covered portions of Virgil Fossae and its surroundings with a uniquely colored deposit (D.P. Cruikshank, personal communication) that is geographically correlated with an exposure of H2O ice that includes spectroscopically detected NH3 (C.M. Dalle Ore, personal communication). The subsurface organic material could have been derived from presolar or solar nebula processes, or might have formed in situ. Photolysis and radiolysis of a mixture of ices relevant to Pluto's surface composition (N2, CH4, CO) have produced strongly colored, complex organics with a significant aromatic content having a high degree of nitrogen substitution similar to the aromatic heterocycles pyrimidine and purine (Materese et al.,2014, 2015; Cruikshank et al.,2016). Experiments with pyrimidines and purines frozen in H2O-NH3 ice resulted in the formation of numerous nucleobases, including the biologically relevant guanine, cytosine, adenine, uracil, and thymine (Materese et al.,2017). The red material associated with the H2O ice may contain nucleobases resulting from energetic processing on Pluto's surface or in the interior. Some other Kuiper Belt objects also exhibit red colors similar to those found on Pluto and may therefore carry similar inventories of complex organic materials. The widespread and ubiquitous nature of similarly complex organic materials observed in a variety of astronomical settings drives the need for additional laboratory and modeling efforts to explain the origin and evolution of organic molecules. Pluto observations reveal complex organics on a small body that remains close to its place of origin in the outermost regions of the Solar System.

Cruikshank, D. P.↗