Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “residual network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Utilization of an Advanced Sensor network to determine fuel heating value and Real-Time net unit heat rate during transient operation

Coal-fired utility boilers are being increasingly used as variable electricity generation to resolve the imbalance in the energy market from the expansion of intermittent renewable energy. The frequent transient operation required to meet residual energy demand has created a challenge for coal-fired units to operate efficiently. This work utilizes an advanced sensor network (ASN) to calculate net unit heat rate (NUHR) of a coal-fired boiler in real time through combustion calculations and statistical correlations to provide the tools for optimizing dynamic operation. Real-time heating values that were necessary to determine fuel input energy to calculate accurate NUHR were found using both fundamental and data-driven methods. Real-time NUHR shows distinct shifts that reflect changes in process conditions that will improve the ability to optimize transient operation. Data-driven heating value correlations had 24% lower root mean square error (RMSE) than the fundamental combustion calculation approach when compared to daily retrospective proximate analysis. Furthermore, the data-driven method RMSE improved by 7% with the inclusion of ASN data. Future work is to validate by comparing unit performance with and without the inclusion of NUHR as a control parameter for the dynamic neural network.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Residual-based error correction for neural operator accelerated infinite-dimensional Bayesian inverse problems

We explore using neural operators, or neural network representations of nonlinear maps between function spaces, to accelerate infinite-dimensional Bayesian inverse problems (BIPs) with models governed by nonlinear parametric partial differential equations (PDEs). Neural operators have gained significant attention in recent years for their ability to approximate the parameter-to-solution maps defined by PDEs using as training data solutions of PDEs at a limited number of parameter samples. The computational cost of BIPs can be drastically reduced if the large number of PDE solves required for posterior characterization are replaced with evaluations of trained neural operators. However, reducing error in the resulting BIP solutions via reducing the approximation error of the neural operators in training can be challenging and unreliable. We provide an a priori error bound result that implies certain BIPs can be ill-conditioned to the approximation error of neural operators, thus leading to inaccessible accuracy requirements in training. To reliably deploy neural operators in BIPs, we consider a strategy for enhancing the performance of neural operators: correcting the prediction of a trained neural operator by solving a linear variational problem based on the PDE residual. We show that a trained neural operator with error correction can achieve a quadratic reduction of its approximation error, all while retaining substantial computational speedups of posterior sampling when models are governed by highly nonlinear PDEs. The strategy is applied to two numerical examples of BIPs based on a nonlinear reaction–diffusion problem and deformation of hyperelastic materials. We demonstrate that posterior representations of the two BIPs produced using trained neural operators are greatly and consistently enhanced by error correction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Photometric redshift estimation with convolutional neural networks and galaxy images: Case study of resolving biases in data-driven methods

Deep-learning models have been increasingly exploited in astrophysical studies, but these data-driven algorithms are prone to producing biased outputs that are detrimental for subsequent analyses. In this work, we investigate two main forms of biases: class-dependent residuals, and mode collapse. We do this in a case study, in which we estimate photometric redshift as a classification problem using convolutional neural networks (CNNs) trained with galaxy images and associated spectroscopic redshifts. We focus on point estimates and propose a set of consecutive steps for resolving the two biases based on CNN models, involving representation learning with multichannel outputs, balancing the training data, and leveraging soft labels. The residuals can be viewed as a function of spectroscopic redshift or photometric redshift, and the biases with respect to these two definitions are incompatible and should be treated individually. We suggest that a prerequisite for resolving biases in photometric space is resolving biases in spectroscopic space. Experiments show that our methods can better control biases than benchmark methods, and they are robust in various implementing and training conditions with high-quality data. Our methods hold promises for future cosmological surveys that require a good constraint of biases, and they may be applied to regression problems and other studies that make use of data-driven models. Nonetheless, the bias-variance tradeoff and the requirement of sufficient statistics suggest that we need better methods and optimized data usage strategies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Room-temperature neutron and X-ray data collection of 3CL M pro from SARS-CoV-2

The replication of SARS-CoV-2 produces two large polyproteins, pp1a and pp1ab, that are inactive until cleavage by the viral chymotrypsin-like cysteine protease enzyme (3CL M pro ) into a series of smaller functional proteins. At the heart of 3CL M pro is an unusual catalytic dyad formed by the side chains of His41 and Cys145 and a coordinated water molecule. The catalytic mechanism by which the enzyme operates is still unknown, as crucial information on the protonation states within the active site is unclear. To experimentally determine the protonation states of the catalytic site and of the other residues in the substrate-binding cavity, and to visualize the hydrogen-bonding networks throughout the enzyme, room-temperature neutron and X-ray data were collected from a large H/D-exchanged crystal of ligand-free (apo) 3CL M pro .

3CL Mpro↗
NASA NTRS1972

Measurement of the power spectral density of phase of the hydrogen maser

Hydrogen masers are being developed for the Deep Space Network as improved frequency standards, in order to achieve better timing accuracies, reduced Doppler residuals, and lower phase noise in the tracking system. Performance data for the masers are given in two forms: time domain performance, useful for analyzing time keeping systems and Doppler systems; and frequency domain performance, useful for analyzing tracking systems. Particular attention is given to frequency domain performance, as obtained from both time domain measurements and direct measurements.

Sward, A.↗
NASA NTRS1995

A hybrid neurocomputing/numerical strategy for nonlinear structural analysis

A hybrid neurocomputing/numerical strategy is presented for geometrically nonlinear analysis of structures. The strategy combines model-free data processing capabilities of computational neural networks with a Pade approximants-based perturbation technique to predict partial information about the nonlinear response of structures. In the hybrid strategy, multilayer feedforward neural networks are used to extend the validity of solutions by using training samples produced by Pade approximations to the Taylor series expansion of the response function. The range of validity of the training samples is taken to be the radius of convergence of Pade approximants and is estimated by setting a tolerance on the diverging approximants. The norm of residual vector of unbalanced forces in a given element is used as a measure to assess the quality of network predictions. To further increase the accuracy and the range of network predictions, additional training data are generated by either applying linear regression to weight matrices or expanding the training data by using predicted coefficients in a Taylor series. The effectiveness of the hybrid strategy is assessed by performing large-deflection analysis of a doubly-curved composite panel with a circular cutout, and postbuckling analyses of stiffened composite panels subjected to an in-plane edge shear load. In all the problems considered, the hybrid strategy is used to predict selective information about the structural response, namely the total strain energy and the maximum displacement components only.

Szewczyk, Z. Peter↗
DOE OSTI2022

Impact of Polymer Rheology on Gel Treatment Performance of Horizontal Wells with Severe Channeling

Summary Gel treatment has been a cost-effective method to control the conformance of a reservoir with severe heterogeneity problems. The water channels in such reservoirs can be classified as open fractures or high permeability porous media with pore-throat network. Many simulation studies have been conducted to discuss gel treatment performance for conformance control. However, nobody considered the polymer rheology difference in open fractures and porous media in simulation. Previous simulation studies also ignored the residual resistance factor as a function of rock permeability rather than a constant parameter. In this study, a conceptual simulation model was established to simulate the linear flow system for the reservoir with horizontal wells considering the two factors mentioned above. The results demonstrate that the gel treatment always provides the better placement results in the open fracture type channel than pore-throat network type channel. Moreover, it is very necessary to consider residual resistance factor as a function of permeability, which is based on the experimental results and can provide much greater plugging efficiency in the higher permeable channels than constant residual resistance factor. Sensitivity analysis studies and multifactor analysis indicate that increasing oil viscosity and permeability ratio has a strong positive influence on conformance control results, which indicate in-situ gel treatment can be better applied in heavy or viscous oil reservoirs with fracture-like channels. Besides, the results also indicate that in reservoirs with severe channeling problem where channel velocity was high, the differences of gelant placement and profile improvement in models with two different types of channels could be enlarged greatly.

Engineering↗
DOE OSTI2024

LossLens: Diagnostics for Machine Learning Through Loss Landscape Visual Analytics

Modern machine learning often relies on optimizing a neural network's parameters using a loss function to learn complex features. Beyond training, examining the loss function with respect to a network's parameters (i.e., as a loss landscape) can reveal insights into the architecture and learning process. While the local structure of the loss landscape surrounding an individual solution can be characterized using a variety of approaches, the global structure of a loss landscape, which includes potentially many local minima corresponding to different solutions, remains far more difficult to conceptualize and visualize. To address this difficulty, we introduce LossLens, a visual analytics framework that explores loss landscapes at multiple scales. LossLens integrates metrics from global and local scales into a comprehensive visual representation, enhancing model diagnostics. Here we demonstrate LossLens through two case studies: visualizing how residual connections influence a ResNet-20, and visualizing how physical parameters influence a physics-informed neural network (PINN) solving a simple convection problem.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1992

Absolute positioning using DORIS tracking of the SPOT-2 satellite

The ability of the French DORIS system operating on the SPOT-2 satellite to provide absolute site positioning at the 20-30-centimeter level using 80 d of data is demonstrated. The accuracy of the vertical component is comparable to that of the horizontal components, indicating that residual troposphere error is not a limiting factor. The translation parameters indicate that the DORIS network realizes a geocentric frame to about 50 nm in each component. The considerable amount of data provided by the nearly global, all-weather DORIS network allowed this complex parameterization required to reduce the unmodeled forces acting on the low-earth satellite. Site velocities with accuracies better than 10 mm/yr should certainly be possible using the multiyear span of the SPOT series and Topex/Poseidon missions.

Watkins, M. M.↗
NASA NTRS2019

Prebiotic Chemistry of Pluto

We present the case for the presence of complex organic molecules, such as amino acids and nucleobases, formed by abiotic processes on the surface and in near-subsurface regions of Pluto. Pluto's surface is tinted with a range of non-ice substances with colors ranging from light yellow to red to dark brown; the colors match those of laboratory organic residues called tholins. Tholins are broadly characterized as complex, macromolecular organic solids consisting of a network of aromatic structures connected by aliphatic bridging units (e.g., Imanaka et al.,2004; Materese et al.,2014, 2015). The synthesis of tholins in planetary atmospheres and in surface ices has been explored in numerous laboratory experiments, and both gas- and solid-phase varieties are found on Pluto. A third variety of tholins, exposed at a site of tectonic surface fracturing called Virgil Fossae, appears to have come from a reservoir in the subsurface. Eruptions of tholin-laden liquid H2O from a subsurface aqueous repository appear to have covered portions of Virgil Fossae and its surroundings with a uniquely colored deposit (D.P. Cruikshank, personal communication) that is geographically correlated with an exposure of H2O ice that includes spectroscopically detected NH3 (C.M. Dalle Ore, personal communication). The subsurface organic material could have been derived from presolar or solar nebula processes, or might have formed in situ. Photolysis and radiolysis of a mixture of ices relevant to Pluto's surface composition (N2, CH4, CO) have produced strongly colored, complex organics with a significant aromatic content having a high degree of nitrogen substitution similar to the aromatic heterocycles pyrimidine and purine (Materese et al.,2014, 2015; Cruikshank et al.,2016). Experiments with pyrimidines and purines frozen in H2O-NH3 ice resulted in the formation of numerous nucleobases, including the biologically relevant guanine, cytosine, adenine, uracil, and thymine (Materese et al.,2017). The red material associated with the H2O ice may contain nucleobases resulting from energetic processing on Pluto's surface or in the interior. Some other Kuiper Belt objects also exhibit red colors similar to those found on Pluto and may therefore carry similar inventories of complex organic materials. The widespread and ubiquitous nature of similarly complex organic materials observed in a variety of astronomical settings drives the need for additional laboratory and modeling efforts to explain the origin and evolution of organic molecules. Pluto observations reveal complex organics on a small body that remains close to its place of origin in the outermost regions of the Solar System.

Cruikshank, D. P.↗
NASA NTRSDate not supplied

Unlocking the Mysteries of the Moon’s Shadowed Regions

The Moon poles host large quantities of water-ice deposits in the permanently shadowed regions (PSRs), which are vital for enabling sustainable human space exploration, making these regions high-priority targets for upcoming Artemis missions [1]. Unfortunately, today, the best available orbital lunar imagery [2, 3] lacks the meter-scale resolution and signal needed to understand the geomorphology and trafficability of PSRs, complicating the planning and execution of future missions seeking to explore PSRs. We have developed an image enhancement tool called HORUS (Hyper-effective nOise Removal Unet Software) [4, 5], designed to enhance LRO Narrow-Angle Camera (NAC) optical low-light imagery of permanently shadowed regions by effectively removing the CCD-related, photon, and other residual noises that corrupt the images. The tool is composed of two deep learning neural networks trained on environmental metadata and real and synthetic imagery, the latter generated by a physical noise model (LROC). We demonstrated that HORUS effectively produces low-noise, high-resolution images (~1.5m/px), achieving a 5 to 10x improvement over existing long-exposure images of PSRs. HORUS allows scientists and engineers to identify geomorphic features (e.g., craters and boulders) in shadowed regions as small as 3 meters across as well as to peek inside of small shadowed regions, for the first time. The tool was deployed and thoroughly validated for NASA's VIPER mission [6], where it was applied to 20 candidate target regions across the lunar South Pole. Additionally, we conducted different approaches to validate the resulting HORUS-processed images. With HORUS denoised images, VIPER scientists can increase their confidence on what surface features (previously unseen) exist in the shadowed regions, helping them plan rover traverses more safely and efficiently (e.g., Fig. 1) In this manuscript, we will describe how VIPER scientists are utilizing HORUS denoised images to extract new information from the terrain and increase their confidence in what surface features exist in the shadowed regions. In combination with other high-resolution images and digital elevation maps, HORUS images are helping the team analyze potential lading and science sites, as well as planning traverses more safely and efficiently (e.g., Fig. 1). Additionally, we will describe how HORUS tool unlocks a broad range of scientific and exploration applications to other Artemis and CPLS missions to the lunar poles, including (but not limited to) geomorphic analysis, change detection, surface hazard detection, and terrain relative navigation.

artificial intelligence↗
DOE OSTI2024

Generative $β$-hairpin design using a residue-based physicochemical property landscape

De novo peptide design is a new frontier that has broad application potential in the biological and biomedical fields. Most existing models for de novo peptide design are largely based on sequence homology that can be restricted based on evolutionarily derived protein sequences and lack the physicochemical context essential in protein folding. Generative machine learning for de novo peptide design is a promising way to synthesize theoretical data that are based on, but unique from, the observable universe. In this study, we created and tested a custom peptide generative adversarial network intended to design peptide sequences that can fold into the -hairpin secondary structure. This deep neural network model is designed to establish a preliminary foundation of the generative approach based on physicochemical and conformational properties of 20 canonical amino acids, for example, hydrophobicity and residue volume, using extant structure-specific sequence data from the PDB. The beta generative adversarial network model robustly distinguishes secondary structures of hairpin from α helix and intrinsically disordered peptides with an accuracy of up to 96% and generates artificial -hairpin peptide sequences with minimum sequence identities around 31% and 50% when compared against the current NCBI PDB and nonredundant databases, respectively. These results highlight the potential of generative models specifically anchored by physicochemical and conformational property features of amino acids to expand the sequence-to-structure landscape of proteins beyond evolutionary limits.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Identifying Sample Provenance From SEM/EDS Automated Particle Analysis via Few-Shot Learning Coupled With Similarity Graph Clustering

Automated particle analysis (APA) provides a vast amount of compositional data via energy-dispersive X-ray spectroscopy along with size and shape data via scanning electron microscopy for individual particles in a sample. In many instances, APA data are leveraged to support identification of the source of a sample based on the detection of particles of a specific composition. Often, the particles that provide context make up a minuscule portion of the sample. Additionally, the interpretation of complex samples can be difficult due to the diversity of compositions both in the mixture and within a particle. In this work, we demonstrate a method to compute and cluster similarity graphs that describe inter-particle relationships within a sample using a multi-modal few-shot learning neural network. Here, as a proof-of-concept, we show that samples known to have been exposed to gunshot residue can be distinguished from samples occasionally mistaken for gunshot residue. Our workflow builds upon standard APA techniques and data processing methods to unveil additional information in a readily interpretable and quantitatively comparable format.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Hybrid Cyber-attack Detection in Photovoltaic Farms

Here, to address the cyber-physical security in PV farms, a hybrid cyber-attack detection is proposed in this manuscript. To secure PV farms, the proposed method integrates model-based and data-driven methods by fusing the detection score at the device and system levels. First, a model-based cyber-attack detection method is developed for each PV inverter. A residual between the estimation of the Kalman filter and measurement is calculated. By leveraging the calculated residual from all inverters, a squared Mahalanobis distance is developed for device detection score generation. At the system level, a convolutional neural network (CNN) is proposed to detect cyber-attack using the waveform data at the point of common coupling (PCC) in PV farms. To improve the CNN detection accuracy, a set of well-designed features are extracted from the raw waveform data. Finally, a weighted detection score fusion method is proposed to combine device and system detection scores by using their complementary strength. The feasibility and robustness of the proposed method are validated by testing cases and a comparative experiment.

14 SOLAR ENERGY↗
DOE OSTI2023

B56$δ$ long-disordered arms form a dynamic PP2A regulation interface coupled with global allostery and Jordan’s syndrome mutations

Intrinsically disordered regions (IDR) and short linear motifs (SLiMs) play pivotal roles in the intricate signaling networks governed by phosphatases and kinases. B56δ (encoded by PPP2R5D) is a regulatory subunit of protein phosphatase 2A (PP2A) with long IDRs that harbor a substrate-mimicking SLiM and multiple phosphorylation sites. De novo missense mutations in PPP2R5D cause intellectual disabilities (ID), macrocephaly, Parkinsonism, and a broad range of neurological symptoms. Our single-particle cryo-EM structures of the PP2A-B56δ holoenzyme reveal that the long, disordered arms at the B56δ termini fold against each other and the holoenzyme core. This architecture suppresses both the phosphatase active site and the substrate-binding protein groove, thereby stabilizing the enzyme in a closed latent form with dual autoinhibition. The resulting interface spans over 190 Å and harbors unfavorable contacts, activation phosphorylation sites, and nearly all residues with ID-associated mutations. Our studies suggest that this dynamic interface is coupled to an allosteric network responsive to phosphorylation and altered globally by mutations. Furthermore, we found that ID mutations increase the holoenzyme activity and perturb the phosphorylation rates, and the severe variants significantly increase the mitotic duration and error rates compared to the normal variant.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Insights into the Oxidation Mechanism of Vivianite to Metavivianite from First-Principles Calculations

Vivianite, a hydrous ferrous iron-phosphate mineral (Fe 3 (PO 4 ) 2 ·8H 2 O), readily oxidizes in contact with air yielding the less hydrous mixed-valent iron-phosphate mineral metavivianite. This topotactic transformation nominally occurs by oxidative dehydrogenation in which outgoing electrons from the iron sublattice are charge compensated by hydrolysis of structural water. However, the details of this internal charge balancing mechanism that allows the structure to remain electrostatically stable remain unknown. Here, in this study, we use density functional theory (DFT) calculations and ab initio thermodynamics (AIT) to evaluate the energetics of this process in terms of hydrogen release as a function of environmental variables such as partial pressure and temperature. The results show a thermodynamic driving force for vivianite phase transformation as oxidation progresses that is triggered by its rigid structure that has a limited accommodation for hydrogen vacancies. In contrast, metavivianite has a more flexible lattice and hydrogen bond network that stabilizes these hydrogen defects. Metavivianite is shown to be a stable intermediate for 66% residual Fe 2+ down to 33% Fe 2+ , below which other phases/structures such as santabarbarite should be more thermodynamically favorable. Our study provides a basis for experimental tests of our mechanistic findings and helps fill a basic knowledge gap about the solid-state process that defines how vivianite interacts with its surrounding environment.

Sassi, Michel [Pacific Northwest National Laborato↗
DOE OSTI2024

p14 ARF forms meso-scale assemblies upon phase separation with NPM1

NPM1 is an abundant nucleolar chaperone that, in addition to facilitating ribosome biogenesis, contributes to nucleolar stress responses and tumor suppression through its regulation of the p14 Alternative Reading Frame tumor suppressor protein (p14 ARF ). Oncogenic stress induces p14 ARF to inhibit MDM2, stabilize p53 and arrest the cell cycle. Under non-stress conditions, NPM1 stabilizes p14 ARF in nucleoli, preventing its degradation and blocking p53 activation. However, the mechanisms underlying the regulation of p14 ARF by NPM1 are unclear because the structural features of the p14 ARF -NPM1 complex were elusive. Here we show that p14 ARF assembles into a gel-like meso-scale network upon phase separation with NPM1. This assembly is mediated by intermolecular contacts formed by hydrophobic residues in an α-helix and β-strands within a partially folded N-terminal portion of p14 ARF . These hydrophobic interactions promote phase separation with NPM1, enhance p14 ARF nucleolar partitioning, restrict NPM1 diffusion within condensates and nucleoli, and reduce cellular proliferation. Our structural analysis provides insights into the multifaceted chaperone function of NPM1 in nucleoli by mechanistically linking the nucleolar localization of p14 ARF to its partial folding and meso-scale assembly upon phase separation with NPM1.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Structural mechanisms for VMAT2 inhibition by tetrabenazine

The vesicular monoamine transporter 2 (VMAT2) is a proton-dependent antiporter responsible for loading monoamine neurotransmitters into synaptic vesicles. Dysregulation of VMAT2 can lead to several neuropsychiatric disorders including Parkinson’s disease and schizophrenia. Furthermore, drugs such as amphetamine and MDMA are known to act on VMAT2, exemplifying its role in the mechanisms of actions for drugs of abuse. Despite VMAT2’s importance, there remains a critical lack of mechanistic understanding, largely driven by a lack of structural information. Here, we report a 3.1 Å resolution cryo-electron microscopy (cryo-EM) structure of VMAT2 complexed with tetrabenazine (TBZ), a non-competitive inhibitor used in the treatment of Huntington’s chorea. We find TBZ interacts with residues in a central binding site, locking VMAT2 in an occluded conformation and providing a mechanistic basis for non-competitive inhibition. We further identify residues critical for cytosolic and lumenal gating, including a cluster of hydrophobic residues which are involved in a lumenal gating strategy. Our structure also highlights three distinct polar networks that may determine VMAT2 conformational dynamics and play a role in proton transduction. The structure elucidates mechanisms of VMAT2 inhibition and transport, providing insights into VMAT2 architecture, function, and the design of small-molecule therapeutics.

59 BASIC BIOLOGICAL SCIENCES↗