Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Denoise”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Chapter 4 - Recent Advances in Identification of Differential Equations from Noisy Data: IDENT Review

Differential equations and numerical methods are extensively used to model various real-world phenomena in science and engineering. With modern developments, we aim to find the underlying differential equation from a single observation of time-dependent data. If we assume that the differential equation is a linear combination of various linear and nonlinear differential terms, then the identification problem can be formulated as solving a linear system. The goal then reduces to finding the optimal coefficient vector that best represents the time derivative of the given data. We review some recent works on the identification of differential equations. We find some common themes for the improved accuracy: (i) The formulation of linear system with proper denoising is important, (ii) how to utilize sparsity and model selection to find the correct coefficient support needs careful attention, and (iii) there are ways to improve the coefficient recovery. We present an overview and analysis of recent developments on the topic.

97 MATHEMATICS AND COMPUTING↗

GrainPaint: A multi-scale diffusion-based generative model for microstructure reconstruction of large-scale objects

Simulation-based approaches to microstructure generation can suffer from a variety of limitations, such as high memory usage, long computational times, and difficulties in generating complex geometries. Generative machine learning models present a way around these issues, but they have previously been limited by the fixed size of their generation area. Here, we present a new microstructure generation methodology leveraging advances in inpainting using denoising diffusion models to overcome this generation area limitation. We show that microstructures generated with the presented methodology are statistically similar to grain structures generated with a kinetic Monte Carlo simulator, SPPARKS.

36 MATERIALS SCIENCE↗

Concentration fluctuations and flammability of cryo-compressed hydrogen and methane jets

Compressed hydrogen stored at cryogenic temperatures has a much higher density than room-temperature storage, which enables large-scale hydrogen storage and transport. An understanding of the release of cryogenic hydrogen from pressurized vessels is needed to evaluate the risk and safety concerns with the use of this fuel. Here, the present work extends the analysis of previous experimental studies that measured the gas concentrations of cryo-compressed hydrogen jets and methane jets using a laser Raman scattering diagnostic system. Since the Raman signals are very small, a denoising algorithm was applied to significantly reduce the noise to enable statistical analysis of the data. The transient features of the turbulent jets were characterized by their concentration intermittencies and probability density functions (PDFs). A two-part PDF was developed to predict the bimodal features of the jet concentration distributions. Then, the flammability factors of the cryogenic jets were calculated based on the intermittency and the PDF.

33 ADVANCED PROPULSION SYSTEMS↗

Preliminary study of radio frequency waves in hypervelocity impact plasma

Orbital debris and meteoroids can cause mechanical and electrical anomalies by impacting spacecraft. Although mechanical damage tends to occur only from particles with masses >10 –3 g, electrical damage can be a result of hypervelocity (> 10 km/s) impacts (HVI) even with smaller particles. In HVI, the projectile speed exceeds the speed of sound in the material and has enough energy to create plasma by ionizing the material near the surface, which can then emit radio frequency (RF) waves. In this paper, we conduct a preliminary study on the characteristics of impact-generated RF emission with the ultimate goal of building an RF predictive model for risk assessment of HVI electrical effects that can damage spacecraft. First, we introduce wavelet analysis as a method for denoising and quantifying the total RF signal energy. An appropriate mother wavelet and the number of decomposition levels are selected using a synthetic signal. Second, the total energy of the RF emission is calculated using Parseval’s theorem. Results suggest that the total RF signal energy is proportional to the energy flux of the impactor. Lastly, spectrograms of the RF emission are analyzed to characterize features that can be used in the future to predict impacts that can cause electrical damage to satellites.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

WeakIdent: Weak formulation for identifying differential equation using narrow-fit and trimming

Data-driven identification of differential equations is an interesting but challenging problem, especially when the given data are corrupted by noise. When the governing differential equation is a linear combination of various differential terms, the identification problem can be formulated as solving a linear system, with the feature matrix consisting of linear and nonlinear terms multiplied by a coefficient vector. This product is equal to the time derivative term, and thus generates dynamical behaviors. The goal is to identify the correct terms that form the equation to capture the dynamics of the given data. We propose a general and robust framework to recover differential equations using a weak formulation with two new mechanisms, narrow-fit and trimming, for both ordinary and partial differential equations (ODEs and PDEs). The weak formulation facilitates an efficient and robust way to handle noise, and two new mechanisms, narrow-fit and trimming, improve the coefficient support and value recoveries respectively. For each sparsity level, Subspace Pursuit is utilized to find an initial set of support from the large dictionary. Then, we focus on highly dynamic regions (rows of the feature matrix), and error normalize the feature matrix in the narrow-fit step. The support is further updated via trimming the terms that contribute the least. Finally, the support set of features with the smallest Cross-Validation error is chosen as the result. A comprehensive set of numerical experiments are presented for both systems of ODEs and PDEs with various noise levels. The proposed method gives a robust recovery of the coefficients, and a significant denoising effect which can handle up to 100% noise-to-signal ratio for some equations. We compare the proposed method with several state-of-the-art algorithms for the recovery of differential equations.

97 MATHEMATICS AND COMPUTING↗

Characterization of Fuel Cladding Chemical Interaction on a High Burnup U-10Zr Metallic Fuel via Electron Energy Loss Spectroscopy Enhanced by Machine Learning

Fuel cladding chemical interaction (FCCI) is one of the main performance limiting factors for metallic nuclear fuels. The interaction destabilizes the martensitic microstructure and deteriorates mechanical properties of HT-9 cladding. The detection of low atomic number elements (Z<10) and overlapping of elemental peaks can be problematic in interpreting energy dispersive X-ray spectroscopy (EDS) data. Electron energy loss spectroscopy (EELS) provides precise elemental edge energy values and can detect elements with a low atomic number. This work utilizes EELS to study the distribution of lanthanides and light elements at the interaction region. The sample was prepared from the FCCI region of a U-10Zr (wt.%) solid fuel with HT-9 cladding, irradiated to a burnup of 13.2 at.%. Processing the EELS data included three major steps: 1) enhance the signal to noise ratio by denoising the spectrum with principal component analysis (PCA) method, removing background and performing deconvolution; 2) identify chemical elements with core energy loss edges; 3) confirm different phases using a popular machine learning method, K-means. This work presents qualitative assessment of lanthanides and light elements like carbon (C) and oxygen (O) enhanced by the application of machine learning algorithms. By comparing with EDS elemental maps, EELS provides higher resolution chemical maps, reveals the distribution of carbon at the interaction region supporting the formation of zirconium carbide, a rind-like microstructure feature that was proposed to mitigate the chemical interaction. Furthermore, the plasmon peak map was also found to indicate an energy shift associated with the formation of phases/compounds. K-means clustering method was used on the processed electron energy loss (EEL) spectrum to automatically reveal different phases. The resulting clustered maps from K-means clustering align well with elemental maps confirming certain phases, especially Fe-Ce and Zr-C, in the FCCI region.

EELS↗

Automatic recognition system for document digitization in nuclear power plants

With the increasing number of data-driven models in nuclear applications, large volumes of numerical data are required to accurately model and predict the health status of a plant component. However, many historical operation logs that contain useful information are not fully utilized due to the lack of a systematic approach of digitization. To overcome this issue, this study proposes an automatic pipeline for extracting information from handwritten tabular documents collected from nuclear power plants. In our pipeline, we first denoise scanned documents with morphological operations, and then extract relevant parts from individual pages using both traditional computer vision and neural network methods. Handwriting recognition is applied to obtain text and numbers. As the most challenging step is how to crop only relevant information, the main focus of our paper is to detect tables and cells from scanned handwritten documents. Here we evaluate the efficiency and accuracy of our proposed method on handwritten operational reports obtained from a real-world case study. The results demonstrate the high accuracy and practicality of our proposed method.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Multiphysics modeling of printed surface acoustic wave thermometers

Surface acoustic wave (SAW) transducers are a class of sensors and actuators that operate on the fundamental principle of piezoelectricity. Aerosol jet printing and other additive manufacturing techniques have resulted in the low-cost fabrication of low-power and small-footprint SAW devices that are suitable for sensing in high-temperature and radioactive environments. In this work, we developed a series of temperature-dependent finite element models for a SAW transducer consisting of printed silver interdigitated transducers (IDTs) deposited onto piezoelectric lithium niobate. Modeling accuracy was evaluated experimentally from room temperature to 200 °C using an aerosol-jet-printed SAW thermometer. A time-domain study enabled visualization of the wave propagation and successfully guided the denoising of the scattering parameter measurement. Additionally, frequency-domain models using traditional modal analysis or the unique port boundary condition feature in COMSOL Multiphysics accurately predicted the temperature-driven natural frequency drift in the SAW thermometer. The finite element models developed in this study serve to facilitate the computer-aided design of future SAW transducers for applications in harsh environments.

47 OTHER INSTRUMENTATION↗

Nanoscale and Element-Specific Lattice Temperature Measurements Using Core-Loss Electron Energy-Loss Spectroscopy

Measuring nanoscale local temperatures, particularly in vertically integrated and multicomponent systems, remains challenging. Spectroscopic techniques like X-ray absorption and core-loss electron energy-loss spectroscopy (EELS) are sensitive to lattice temperature, but understanding thermal effects is nontrivial. This work explores the potential for nanoscale and element-specific core-loss thermometry by comparing the Si L2,3 edge’s temperature- dependent redshift against plasmon energy expansion thermometry (PEET) in a scanning TEM. Using density functional theory (DFT), time-dependent DFT, and the Bethe−Salpeter equation, we ab initio model both the Si L 2,3 and plasmon redshift. We find that the core-loss redshift occurs due to bandgap reduction from electron−phonon renormalization. Our results indicate that despite lower core-loss signal intensity compared to plasmon features, core-loss thermometry has key advantages and can be more accurate through standard spectral denoising. Specifically, we show that the Varshni equation easily interprets the core-loss redshift for semiconductors, which avoids plasmon spectral convolution for PEET in complex junctions and interfaces. We also find that core-loss thermometry is more accurate than PEET at modeling thermal lattice expansion in semiconductors, unless the specimen’s temperature-dependent dielectric properties are fully characterized. Furthermore, core-loss thermometry has the potential to measure nanoscale heating in multicomponent materials and stacked interfaces with elemental specificity at length scales smaller than the plasmon’s wave function.

Bethe–Salpeter equation↗

Visualizing Millisecond Atomic Dynamics of Nanocrystals in Liquid

Atomic structures of nanomaterials are inherently dynamic and continuously reshaped through interactions with chemical species and external stimuli. Such dynamics are further amplified as the size and dimensionality of nanomaterials decrease. Despite advances in analytical methods, it remains challenging to capture the structural dynamics of nanomaterials in reactive environments with both atomic spatial resolution and commensurate temporal resolution. Here, in this study, we directly visualize atomic-scale dynamics of gold (Au) nanocrystals in reactive liquid environments with millisecond-speed liquid-cell electron microscopy (EM) and deep-learning denoising. We uncover reversible fluctuations in the local crystallinity of Au nanocrystals dependent on the surrounding chemical environment. These transient fluctuations, driven by interactions at nanocrystal–liquid interfaces, critically influence the dissolution kinetics and grain boundary relaxation. By overcoming the spatiotemporal limitations in conventional liquid-cell EM, our findings provide insights into how transient nanoscale structures dictate the stability and reactivity of nanomaterials.

Kang, Sungsu [University of Chicago, IL (United St↗

Deep learning for exploring ultra-thin ferroelectrics with highly improved sensitivity of piezoresponse force microscopy

Hafnium oxide-based ferroelectrics have been extensively studied because of their existing ferroelectricity, even in ultra-thin film form. However, studying the weak response from ultra-thin film requires improved measurement sensitivity. In general, resonance-enhanced piezoresponse force microscopy (PFM) has been used to characterize ferroelectricity by fitting a simple harmonic oscillation model with the resonance spectrum. However, an iterative approach, such as traditional least squares (LS) fitting, is sensitive to noise and can result in the misunderstanding of weak responses. In this study, we developed the deep neural network (DNN) hybrid with deep denoising autoencoder (DDA) and principal component analysis (PCA) to extract resonance information. The DDA/PCA-DNN improves the PFM sensitivity down to 0.3 pm, allowing measurement of weak piezoresponse with low excitation voltage in 10-nm-thick Hf 0.5 Zr 0.5 O 2 thin films. Our hybrid approaches could provide more chances to explore the low piezoresponse of the ultra-thin ferroelectrics and could be applied to other microscopic techniques.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Hardware-accelerated inference for real-time gravitational-wave astronomy

The field of transient astronomy has seen a revolution with the first gravitational-wave detections and the arrival of multi-messenger observations they enabled. Transformed by the first detection of binary black hole and binary neutron star mergers, computational demands in gravitational-wave astronomy are expected to grow by at least a factor of two over the next five years as the global network of kilometer-scale interferometers are brought to design sensitivity. With the increase in detector sensitivity, real-time delivery of gravitational-wave alerts will become increasingly important as an enabler of multi-messenger followup. In this work, we report a novel implementation and deployment of deep learning inference for real-time gravitational-wave data denoising and astrophysical source identification. This is accomplished using a generic Inference-as-a-Service model that is capable of adapting to the future needs of gravitational-wave data analysis. Overall, our implementation allows seamless incorporation of hardware accelerators and also enables the use of commercial or private (dedicated) as-a-service computing. Based on our results, we propose a paradigm shift in low-latency and offline computing in gravitational-wave astronomy. Such a shift can address key challenges in peak-usage, scalability and reliability, and provide a data analysis platform particularly optimized for deep learning applications. The achieved sub-millisecond scale latency will also be relevant for any machine learning-based real-time control systems that may be invoked in the operation of near-future and next generation ground-based laser interferometers, as well as the front-end collection, distribution and processing of data from such instruments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

De novo design of protein structure and function with RFdiffusion

Abstract There has been considerable recent progress in designing new proteins using deep-learning methods 1–9 . Despite this progress, a general deep-learning framework for protein design that enables solution of a wide range of design challenges, including de novo binder design and design of higher-order symmetric architectures, has yet to be described. Diffusion models 10,11 have had considerable success in image and language generative modelling but limited success when applied to protein modelling, probably due to the complexity of protein backbone geometry and sequence–structure relationships. Here we show that by fine-tuning the RoseTTAFold structure prediction network on protein structure denoising tasks, we obtain a generative model of protein backbones that achieves outstanding performance on unconditional and topology-constrained protein monomer design, protein binder design, symmetric oligomer design, enzyme active site scaffolding and symmetric motif scaffolding for therapeutic and metal-binding protein design. We demonstrate the power and generality of the method, called RoseTTAFold diffusion (RFdiffusion), by experimentally characterizing the structures and functions of hundreds of designed symmetric assemblies, metal-binding proteins and protein binders. The accuracy of RFdiffusion is confirmed by the cryogenic electron microscopy structure of a designed binder in complex with influenza haemagglutinin that is nearly identical to the design model. In a manner analogous to networks that produce images from user-specified inputs, RFdiffusion enables the design of diverse functional proteins from simple molecular specifications.

Science & Technology - Other Topics↗

De novo design of high-affinity binders of bioactive helical peptides

Many peptide hormones form an α-helix on binding their receptors, and sensitive methods for their detection could contribute to better clinical management of disease. De novo protein design can now generate binders with high affinity and specificity to structured proteins. However, the design of interactions between proteins and short peptides with helical propensity is an unmet challenge. Here we describe parametric generation and deep learning-based methods for designing proteins to address this challenge. We show that by extending RFdiffusion to enable binder design to flexible targets, and to refining input structure models by successive noising and denoising (partial diffusion), picomolar-affinity binders can be generated to helical peptide targets by either refining designs generated with other methods, or completely de novo starting from random noise distributions without any subsequent experimental optimization. The RFdiffusion designs enable the enrichment and subsequent detection of parathyroid hormone and glucagon by mass spectrometry, and the construction of bioluminescence-based protein biosensors. The ability to design binders to conformationally variable targets, and to optimize by partial diffusion both natural and designed proteins, should be broadly useful.

59 BASIC BIOLOGICAL SCIENCES↗

Label-free nanoscopy of cell metabolism by ultrasensitive reweighted visible stimulated Raman scattering

Nanoscopic imaging of cell metabolism is hindered by the incompatibility of small metabolites with fluorescent dyes and the limited resolution of imaging mass spectrometry. We present ultrasensitive reweighted visible stimulated Raman scattering (URV-SRS), a label-free vibrational nanoscopy technique that enables multiplexed detection of metabolic nanostructures within cells. We developed an extensively chirped spectral focusing visible SRS microscope that achieves a detection limit of 4,000 molecules and introduced a self-supervised learning-based denoiser to robustly suppress non-independent SRS noise by over 7.2 dB. The instrumentation-based signal enhancement and computation-based noise suppression synergistically improved the detection sensitivity by 50 times over near-infrared SRS. Leveraging this enhanced sensitivity, we further pushed the resolution to nanoscopic levels by introducing Fourier reweighting to amplify sub-100 nm spatial frequencies previously overwhelmed by noise. Validated by Fourier ring correlation, URV-SRS achieves a lateral resolution of 86 nm in cellular imaging. Here, we applied URV-SRS to elucidate the reprogramming of metabolic nanostructures associated with virus replication in Vero E6 host cells and to compositionally delineate subcellular fatty acid synthesis in engineered Escherichia coli, demonstrating its capability towards nanoscopic spatial metabolomics.

59 BASIC BIOLOGICAL SCIENCES↗

Deep learning-based noise filtering toward millisecond order imaging by using scanning transmission electron microscopy

Application of scanning transmission electron microscopy (STEM) to in situ observation will be essential in the current and emerging data-driven materials science by taking STEM’s high affinity with various analytical options into account. As is well known, STEM’s image acquisition time needs to be further shortened to capture a targeted phenomenon in real-time as STEM’s current temporal resolution is far below the conventional TEM’s. However, rapid image acquisition in the millisecond per frame or faster generally causes image distortion, poor electron signals, and unidirectional blurring, which are obstacles for realizing video-rate STEM observation. Here we show an image correction framework integrating deep learning (DL)-based denoising and image distortion correction schemes optimized for STEM rapid image acquisition. By comparing a series of distortion corrected rapid scan images with corresponding regular scan speed images, the trained DL network is shown to remove not only the statistical noise but also the unidirectional blurring. This result demonstrates that rapid as well as high-quality image acquisition by STEM without hardware modification can be established by the DL. The DL-based noise filter could be applied to in-situ observation, such as dislocation activities under external stimuli, with high spatio-temporal resolution.

47 OTHER INSTRUMENTATION↗

Structural differences between human and mouse neurons and their implementation in generative AIs

Mouse and human brains have different functions that depend on their neuronal networks. We analyzed nanometer-scale three-dimensional structures of brain tissues of the mouse medial prefrontal cortex and compared them with structures of the human anterior cingulate cortex. The obtained results indicated that mouse neuronal somata are smaller and neurites are thinner than those of human neurons. We implemented these characteristics of mouse neurons in convolutional layers of a generative adversarial network (GAN) and a denoising diffusion implicit model (DDIM), which were then subjected to image generation tasks using photo datasets of cat faces, cheese, human faces, birds, and automobiles. The mouse-mimetic GAN outperformed a standard GAN in the image generation task using the cat faces and cheese photo datasets, but underperformed for human faces and birds. The mouse-mimetic DDIM gave similar results, suggesting that the nature of the datasets affected the results. Analyses of the five datasets indicated differences in their image entropy, which should influence the number of parameters required for image generation. The preferences of the mouse-mimetic AIs coincided with the impressions commonly associated with mice. The relationship between the neuronal network and brain function should be investigated by implementing other biological findings in artificial neural networks.

generative AI↗

Achieving precise multiparameter measurements with distributed optical fiber sensor using wavelength diversity and deep neural networks

The development of advanced distributed optical fiber sensing systems that are capable of performing accurate and spatially resolved multiparameter measurements is of great interest to a wide range of scientific and industrial applications. Here, in this paper, we propose and experimentally demonstrate a wavelength diversity based advanced distributed optical fiber sensor system to accomplish multiparameter sensing while greatly enhancing measurement accuracy. A suite of deep neural network (DNN) algorithms are developed and verified for data denoising, rapid Brillouin frequency shift estimation, and vibration data event classification. As a proof-of-concept, we demonstrate the effectiveness of the proposed advanced wavelength diversity distributed fiber sensor system assisted by DNN for simultaneous, independent measurements of static strain, temperature, and acoustic vibrations over a 25 km long sensing fiber at 3 m spatial resolution. These results suggest the potential for an intelligent multiparameter monitoring system with enhanced performance in advanced structural health monitoring applications.

47 OTHER INSTRUMENTATION↗