Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “residual network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

RhizoNet: semantic segmentation of plant roots using CNN (RhizoNet) v0.0.1

RhizoNet is designed for the semantic segmentation of plant root scans, utilizing a sophisticated deep learning network known as Residual Unet. It specializes in processing color images of plants cultivated in a hydroponic EcoFAB system, captured using an Epson scanner. The core of the algorithm is based on Residual U-nets, which significantly improve prediction accuracy. This is achieved through the implementation of a convex hull operation, which effectively delineates the primary root component by leveraging spatio-temporal image data. This enables researchers to accurately assess predicted biomass and monitor plant growth over time.

Ushizima, Daniela↗
DOE OSTI2026

Gravitational Lenses in UNIONS and Euclid (GLUE). I. A Search for Strong Gravitational Lenses in UNIONS with Subaru, CFHT, and Pan-STARRS Data

We present the results of our pipeline for discovering strong gravitational lenses in the ongoing Ultraviolet Near-Infrared Optical Northern Survey (UNIONS). We successfully train a deep residual convolutional neural network based on CMU-Deeplens architecture, which is designed to detect strong lenses in ground-based imaging surveys. We train on images of real strong lenses and deploy on a sample of 8 million galaxies in areas with full coverage in the g, r, and i filters—the first multiband search for strong gravitational lenses in UNIONS. Following human inspection and grading, we report the discovery of a total of 1346 new strong-lens candidates, of which 146 are Grade A, 199 are Grade B, and 1001 are Grade C. Of these candidates, 283 have lens galaxy spectroscopic redshifts from the Sloan Digital Sky Survey, and an additional 297 have them from the Dark Energy Spectroscopic Instrument Data Release 1. We find 15 of these systems display evidence of both lens and source galaxy redshifts in spectral superposition. We also report the spectroscopic confirmation of seven lensed sources in high-quality systems, all with z > 2.1, using the Keck Near Infrared Echellette Spectrograph and the Gemini Near-Infrared Spectrograph.

Storfer, Christopher J. [University of Hawaii, Hon↗
NASA NTRS1992

Adaptive low-bandwidth tracking of Galileo and Pioneer 10 carriers

In the Deep Space Network, tracking of residual carrier phase typically occurs with a fixed-bandwidth phase-locked loop using a bandwidth sufficiently wide to prevent loss of lock under worst-case conditions of signal dynamics, received signal phase noise, and receiver phase noise. Much of the time, however, such a high bandwidth is not required and may inflict unnecessarily heavy penalties on loop signal-to-noise ratios. This article describes a technique for improving tracking performance by permitting initial tracking at narrow bandwidths and gradually widening the loop as needed. The cost is a requirement for signal buffering, which is relatively inexpensive for low data rate applications. Results based on off-line processing of recorded carrier data from Galileo and Pioneer 10 are presented, and show potential 10-16 dB gains in loop SNR over worst-case fixed-bandwidth tracking.

Watola, D. A.↗
NASA NTRS2008

Model-Based Fault Tolerant Control

The Model Based Fault Tolerant Control (MBFTC) task was conducted under the NASA Aviation Safety and Security Program. The goal of MBFTC is to develop and demonstrate real-time strategies to diagnose and accommodate anomalous aircraft engine events such as sensor faults, actuator faults, or turbine gas-path component damage that can lead to in-flight shutdowns, aborted take offs, asymmetric thrust/loss of thrust control, or engine surge/stall events. A suite of model-based fault detection algorithms were developed and evaluated. Based on the performance and maturity of the developed algorithms two approaches were selected for further analysis: (i) multiple-hypothesis testing, and (ii) neural networks; both used residuals from an Extended Kalman Filter to detect the occurrence of the selected faults. A simple fusion algorithm was implemented to combine the results from each algorithm to obtain an overall estimate of the identified fault type and magnitude. The identification of the fault type and magnitude enabled the use of an online fault accommodation strategy to correct for the adverse impact of these faults on engine operability thereby enabling continued engine operation in the presence of these faults. The performance of the fault detection and accommodation algorithm was extensively tested in a simulation environment.

Kumar, Aditya↗
DOE OSTI2020

Extended Physics-Informed Neural Networks (XPINNs): A Generalized Space-Time Domain Decomposition Based Deep Learning Framework for Nonlinear Partial Differential Equations

Here we propose a generalized space-time domain decomposition approach for the physics-informed neural networks (PINNs) to solve nonlinear partial differential equations (PDEs) on arbitrary complex-geometry domains. The proposed framework, named eXtended PINNs ( X P I N N s ), further pushes the boundaries of both PINNs as well as conservative PINNs (cPINNs), which is a recently proposed domain decomposition approach in the PINN framework tailored to conservation laws. Compared to PINN, the XPINN method has large representation and parallelization capacity due to the inherent property of deployment of multiple neural networks in the smaller subdomains. Unlike cPINN, XPINN can be extended to any type of PDEs. Moreover, the domain can be decomposed in any arbitrary way (in space and time), which is not possible in cPINN. Thus, XPINN offers both space and time parallelization, thereby reducing the training cost more effectively. In each subdomain, a separate neural network is employed with optimally selected hyperparameters, e.g., depth/width of the network, number and location of residual points, activation function, optimization method, etc. A deep network can be employed in a subdomain with complex solution, whereas a shallow neural network can be used in a subdomain with relatively simple and smooth solutions. We demonstrate the versatility of XPINN by solving both forward and inverse PDE problems, ranging from one-dimensional to three-dimensional problems, from time-dependent to time-independent problems, and from continuous to discontinuous problems, which clearly shows that the XPINN method is promising in many practical problems. The proposed XPINN method is the generalization of PINN and cPINN methods, both in terms of applicability as well as domain decomposition approach, which efficiently lends itself to parallelized computation. The XPINN code is available on h t t p s : / / g i t h u b . c o m / A m e y a J a g t a p / X P I N N s .

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Allosterically coupled conformational dynamics in solution prepare the sterol transfer protein StarD4 to release its cargo upon interaction with target membranes

Complex mechanisms regulate the cellular distribution of cholesterol, a critical component of eukaryote membranes involved in regulation of membrane protein functions directly and through the physiochemical properties of membranes. StarD4, a member of the steroidogenic acute regulator-related lipid-transfer (StART) domain (StARD)-containing protein family, is a highly efficient sterol-specific transfer protein involved in cholesterol homeostasis. Its mechanism of cargo loading and release remains unknown despite recent insights into the key role of phosphatidylinositol phosphates in modulating its interactions with target membranes. We have used large-scale atomistic Molecular dynamics (MD) simulations to study how the dynamics of cholesterol bound to the StarD4 protein can affect interaction with target membranes, and cargo delivery. We identify the two major cholesterol (CHL) binding modes in the hydrophobic pocket of StarD4, one near S136&S147 (the Ser-mode), and another closer to the putative release gate located near W171, R92&Y117 (the Trp-mode). We show that conformational changes of StarD4 associated directly with the transition between these binding modes facilitate the opening of the gate. To understand the dynamics of this connection we apply a machine-learning algorithm for the detection of rare events in MD trajectories (RED), which reveals the structural motifs involved in the opening of a front gate and a back corridor in the StarD4 structure occurring together with the spontaneous transition of CHL from the Ser-mode of binding to the Trp-mode. Further analysis of MD trajectory data with the information-theory based NbIT method reveals the allosteric network connecting the CHL binding site to the functionally important structural components of the gate and corridor. Mutations of residues in the allosteric network are shown to affect the performance of the allosteric connection. These findings outline an allosteric mechanism which prepares the CHL-bound StarD4 to release and deliver the cargo when it is bound to the target membrane.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Protein conformational switch discerned via network centrality properties

Network analysis has emerged as a powerful tool for examining structural biology systems. The spatial organization of the components of a biomolecular structure has been rendered as a graph representation and analyses have been performed to deduce the biophysical and mechanistic properties of these components. For proteins, the analysis of protein structure networks (PSNs), especially via network centrality measurements and cluster coefficients, has led to identifying amino acid residues that play key functional roles and classifying amino acid residues in general. Whether these network properties examined in various studies are sensitive to subtle (yet biologically significant) conformational changes remained to be addressed. Here, we focused on four types of network centrality properties (betweenness, closeness, degree, and eigenvector centralities) for conformational changes upon ligand binding of a sensor protein (constitutive androstane receptor) and an allosteric enzyme (ribonucleotide reductase). We found that eigenvector centrality is sensitive and can distinguish salient structural features between protein conformational states while other centrality measures, especially closeness centrality, are less sensitive and rather generic with respect to the structural specificity. We also demonstrated that an ensembleinformed, modified PSN with static edges removed (which we term PSN*) has enhanced sensitivity at discerning structural changes.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Super-resolution and segmentation deep learning for breast cancer histopathology image analysis

Traditionally, a high-performance microscope with a large numerical aperture is required to acquire high-resolution images. However, the images’ size is typically tremendous. Therefore, they are not conveniently managed and transferred across a computer network or stored in a limited computer storage system. As a result, image compression is commonly used to reduce image size resulting in poor image resolution. Here, we demonstrate custom convolution neural networks (CNNs) for both super-resolution image enhancement from low-resolution images and characterization of both cells and nuclei from hematoxylin and eosin (H&E) stained breast cancer histopathological images by using a combination of generator and discriminator networks so-called super-resolution generative adversarial network-based on aggregated residual transformation (SRGAN-ResNeXt) to facilitate cancer diagnosis in low resource settings. The results provide high enhancement in image quality where the peak signal-to-noise ratio and structural similarity of our network results are over 30 dB and 0.93, respectively. The derived performance is superior to the results obtained from both the bicubic interpolation and the well-known SRGAN deep-learning methods. In addition, another custom CNN is used to perform image segmentation from the generated high-resolution breast cancer images derived with our model with an average Intersection over Union of 0.869 and an average dice similarity coefficient of 0.893 for the H&E image segmentation results. Finally, we propose the jointly trained SRGAN-ResNeXt and Inception U-net Models, which applied the weights from the individually trained SRGAN-ResNeXt and inception U-net models as the pre-trained weights for transfer learning. The jointly trained model’s results are progressively improved and promising. We anticipate these custom CNNs can help resolve the inaccessibility of advanced microscopes or whole slide imaging (WSI) systems to acquire high-resolution images from low-performance microscopes located in remote-constraint settings.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

MULTISTEP AND CONTINUOUS PHYSICS-INFORMED NEURAL NETWORK METHODS FOR LEARNING GOVERNING EQUATIONS AND CONSTITUTIVE RELATIONS

In this work, we investigate the applicability and relative merit of discrete and continuous versions of physics-informed neural network (PINN) methods for learning unknown governing equations or constitutive relations in a nonlinear dynamical system. In the case of unknown dynamics, entire right-hand-side (RHS) equations of the ordinary differential equations are unknown. In the case of unknown constitutive relations, however, the RHS equations are known up to the specification of constitutive relations (that may depend on the state of the system). We use a deep neural network to model unknown governing equations or constitutive relations. The discrete PINN approach combines classical multistep discretization methods for dynamical systems with neural-network-based machine learning methods. On the other hand, the continuous versions utilize deep neural networks to minimize the residual function for the continuous governing equations. We use the case of a fedbatch bioreactor system to study the effectiveness of these approaches and discuss conditions for their applicability. Our results indicate that the accuracy of the trained neural network models is much higher for the cases where we only have to learn a constitutive relation instead of all dynamics. This finding corroborates the well-known fact from scientific computing that building as much structural information as is available into an algorithm can enhance its efficiency and/or accuracy.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

The Solvation of the E. coli CheY Phosphorylation Site Mapped by XFMS

The Escherichia coli CheY protein belongs to a large bacterial response regulator superfamily. X-ray hydroxy radical foot-printing with mass spectroscopy (XFMS) has shown that allosteric activation of CheY by its motor target triggers a concerted internalization of aromatic sidechains. We reanalyzed the XFMS data to compare polar versus non-polar CheY residue positions. The polar residues around and including the 57D phosphorylated site had an elevated hydroxy radical reactivity. Bioinformatic measures revealed that a water-mediated hydrogen bond network connected this ring of residues with the central 57D. These residues solvated 57D to energetically stabilize the apo-CheY fold. The abundance of these reactive residues was reduced upon activation. This result was supported by the bioinformatics and consistent with the previously reported activation-induced increase in core hydrophobicity. It further illustrated XFMS detection of structural waters. Direct contacts between the ring residues and the phosphorylation site would stabilize the aspartyl phosphate. In addition, we report that the ring residue, 18R, is a constant central node in the 57D solvation network and that 18R non-polar substitutions determine CheY diversity as assessed by its evolutionary trace in bacteria with well-studied chemotaxis. These results showcase the importance of structured water dynamics for phosphorylation-mediated signal transduction.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Upsampling Monte Carlo Reactor Simulation Tallies in Depleted Sodium-Cooled Fast Reactor Assemblies Using a Convolutional Neural Network

The computational demand of neutron Monte Carlo transport simulations can increase rapidly with the spatial and energy resolution of tallied physical quantities. Convolutional neural networks have been used to increase the resolution of Monte Carlo simulations of light water reactor assemblies while preserving accuracy with negligible additional computational cost. Here, we show that a convolutional neural network can also be used to upsample tally results from Monte Carlo simulations of sodium-cooled fast reactor assemblies, thereby extending the applicability beyond thermal systems. The convolutional neural network model is trained using neutron flux tallies from 300 procedurally generated nuclear reactor assemblies simulated using OpenMC. Validation and test datasets included 16 simulations of procedurally generated assemblies, and a realistic simulation of a European sodium-cooled fast reactor assembly was included in the test dataset. We show the residuals between the high-resolution flux tallies predicted by the neural network and high-resolution Monte Carlo tallies on relative and absolute bases. The network can upsample tallies from simulations of fast reactor assemblies with diverse and heterogeneous materials and geometries by a factor of two in each spatial and energy dimension. The network’s predictions are within the statistical uncertainty of the Monte Carlo tallies in almost all cases. This includes test assemblies for which burnup values and geometric parameters were well outside the ranges of those in assemblies used to train the network.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Evolutionary diversity of proton and water channels on the oxidizing side of photosystem II and their relevance to function

One of the reasons for the high efficiency and selectivity of biological catalysts arise from their ability to control the pathways of substrates and products using protein channels, and by modulating the transport in the channels using the interaction with the protein residues and the water/hydrogen-bonding network. Here, this process is clearly demonstrated in Photosystem II (PS II), where its light-driven water oxidation reaction catalyzed by the Mn 4 CaO 5 cluster occurs deep inside the protein complex and thus requires the transport of two water molecules to and four protons from the metal center to the bulk water. Based on the recent advances in structural studies of PS II from X-ray crystallography and cryo-electron microscopy, in this review we compare the channels that have been proposed to facilitate this mass transport in cyanobacteria, red and green algae, diatoms, and higher plants. The three major channels (O1, O4, and Cl1 channels) are present in all species investigated; however, some differences exist in the reported structures that arise from the different composition and arrangement of membrane extrinsic subunits between the species. Among the three channels, the Cl1 channel, including the proton gate, is the most conserved among all photosynthetic species. We also found at least one branch for the O1 channel in all organisms, extending all the way from Ca/O1 via the ‘water wheel’ to the lumen. However, the extending path after the water wheel varies between most species. The O4 channel is, like the Cl1 channel, highly conserved among all species while having different orientations at the end of the path near the bulk. The comparison suggests that the previously proposed functionality of the channels in T. vestitus (Ibrahim et al., Proc Natl Acad Sci USA 117:12624–12635, 2020; Hussein et al., Nat Commun 12:6531, 2021) is conserved through the species, i.e. the O1-like channel is used for substrate water intake, and the tighter Cl1 and O4 channels for proton release. The comparison does not eliminate the potential role of O4 channel as a water intake channel. However, the highly ordered hydrogen-bonded water wire connected to the Mn 4 CaO 5 cluster via the O4 may strongly suggest that it functions in proton release, especially during the S 0 → S 1 transition (Saito et al., Nat Commun 6:8488, 2015; Kern et al., Nature 563:421–425, 2018; Ibrahim et al., Proc Natl Acad Sci USA 117:12624–12635, 2020; Sakashita et al., Phys Chem Chem Phys 22:15831–15841, 2020; Hussein et al., Nat Commun 12:6531, 2021).

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Cryo-EM structures of the small-conductance Ca 2+ -activated K Ca 2.2 channel

Small-conductance Ca 2+ -activated K + (K Ca 2.1-K Ca 2.3) channels modulate neuronal and cardiac excitability. We report cryo-electron microscopy structures of the K Ca 2.2 channel in complex with calmodulin and Ca 2+ , alone or bound to two small molecule inhibitors, at 3.18, 3.50, 2.99 and 2.97 angstrom resolution, respectively. Extracellular S3-S4 loops in β-hairpin configuration form an outer canopy over the pore with an aromatic box at the canopy’s center. Each S3-S4 β-hairpin is tethered to the selectivity filter in the neighboring subunit by inter-subunit hydrogen bonds. This hydrogen bond network flips the aromatic residue (Tyr362) in the filter’s GYG signature by 180°, causing the outer selectivity filter to widen and water to enter the filter. Disruption of the tether by a mutation narrows the outer selectivity filter, realigns Tyr362 to the position seen in other K + channels, and significantly increases unitary conductance. UCL1684, a mimetic of the bee venom peptide apamin, sits atop the canopy and occludes the opening in the aromatic box. AP14145, an analogue of a therapeutic for atrial fibrillation, binds in the central cavity below the selectivity filter and induces closure of the inner gate. These structures provide a basis for understanding the small unitary conductance and pharmacology of K Ca 2.x channels.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

De novo design of obligate ABC-type heterotrimeric proteins

The de novo design of three protein chains that associate to form a heterotrimer (but not any of the possible two-chain heterodimers) and that can drive the assembly of higher-order branching structures is an important challenge for protein design. We designed helical heterotrimers with specificity conferred by buried hydrogen bond networks and large aromatic residues to enhance shape complementary packing. We obtained ten designs for which all three chains cooperatively assembled into heterotrimers with few or no other species present. Crystal structures of a helical bundle heterotrimer and extended versions, with helical repeat proteins fused to individual subunits, showed all three chains assembling in the designed orientation. We used these heterotrimers as building blocks to construct larger cyclic oligomers, which were structurally validated by electron microscopy. Our three-way junction designs provide new routes to complex protein nanostructures and enable the scaffolding of three distinct ligands for modulation of cell signaling.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Observation of Unprecedented Fractional Magnetization Plateaus in a New Shastry-Sutherland Ising Compound

Geometrically frustrated magnetic systems, such as those based on the Shastry-Sutherland lattice (SSL), offer a rich playground for exploring unconventional magnetic states. The delicate balance between competing interactions in these systems leads to the emergence of novel phases. We present the characterization of Er 2 ⁢Be 2⁢ GeO 7 , an SSL compound with Er 3+ ions forming orthogonal dimers separated by nonmagnetic layers whose structure is invariant under the 𝑃⁢$\bar{4}21$⁢𝑚 space group. Neutron scattering reveals an antiferromagnetic dimer structure at zero field, typical of Ising spins on that lattice and consistent with the anisotropic magnetization observed. However, magnetization measurements exhibit fractional plateaus at 1/4 and 1/2 of saturation, in contrast to the expected 1/3 plateau of the SSL Ising model. By comparing the energy of candidate states with ground-state lower bounds we show that this behavior requires spatially anisotropic interactions, leading to an anisotropic Shastry-Sutherland Ising model symmetric under the 𝐶⁢𝑚⁢𝑚⁢2 space group. This anisotropy is consistent with the small orthorhombic distortion observed with single-crystal neutron diffraction. The other properties, including thermodynamics, which have been investigated theoretically using tensor networks, point to small residual interactions, potentially due to further couplings and quantum fluctuations. This study highlights Er 2 ⁢Be 2 ⁢GeO 7 as a promising platform for investigating exotic magnetic phenomena.

Yadav, Lalit [Duke University, Durham, NC (United ↗
DOE OSTI2021

Deep-learning-based image registration for nano-resolution tomographic reconstruction

Nano-resolution full-field transmission X-ray microscopy has been successfully applied to a wide range of research fields thanks to its capability of non-destructively reconstructing the 3D structure with high resolution. Due to constraints in the practical implementations, the nano-tomography data is often associated with a random image jitter, resulting from imperfections in the hardware setup. Without a proper image registration process prior to the reconstruction, the quality of the result will be compromised. Here a deep-learning-based image jitter correction method is presented, which registers the projective images with high efficiency and accuracy, facilitating a high-quality tomographic reconstruction. This development is demonstrated and validated using synthetic and experimental datasets. We report the method is effective and readily applicable to a broad range of applications. Together with this paper, the source code is published and adoptions and improvements from our colleagues in this field are welcomed.

deep learning↗
NASA NTRS1972

EUV observations of the chromospheric network.

Extreme ultraviolet observations of a quiet region of the sun on Aug. 18, 1969, with the Harvard spectroheliometer on OSO 6 indicate that the chromospheric network can be observed in lines of the chromosphere and transition region (T = 840,000 K) with almost identical structure. At coronal heights, the network changes but some residual structure can still be discerned in Mg X and perhaps Si XII, although there is little or no evidence remaining in Fe XVI.

Reeves, E. M.↗