Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “noisy data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Geometrical-Based Generative Adversarial Network to Enhance Digital Rock Image Quality

X-ray microcomputed tomography (micro-CT) is a common tool for the study of porous media structures and properties. High-quality micro-CT data are required to accurately capture pore structures. Acquiring high-quality micro-CT data, however, is not always possible, owing to application limitations and experimental constraints. Therefore, we propose a geometrical-based generative adversarial network (GAN) to rapidly restore noisy micro-CT images to their clean counterparts. The training data and related ground-truth (GT) data are scanned for 7 min and 9.5 h, respectively. To evaluate the performance of the geometrical-based GAN, a 6003 voxel image that has never been used for training is reconstructed and compared with the corresponding GT image. Histogram matching and linear normalization are implemented to adjust the histogram of the reconstructed image to that of the GT image. A watershed-based segmentation method is then applied to delineate pore and solid phases. Lastly, we measure the Minkowski functionals and petrophysical properties, including absolute permeability, pore size distribution, drainage capillary pressure-saturation curve, and imbibition relative permeability, to estimate the physical accuracy of the denoised image. The results show that the proposed geometrical-based GAN can accurately restore noisy micro-CT data. By reducing the scanning time from 9.5 h to 7 min, the expenditure of collecting micro-CT can be decreased significantly. This is particularly important for applications where time-lapse images of a dynamic process are required, high-throughput imaging is necessary for real-time data analysis, or where the quantification of large sample volumes is required.

58 GEOSCIENCES↗
DOE OSTI2023

A case study of denoising microseismic data in the Farnsworth, TX CO 2 EOR site

As geologic carbon sequestration projects begin to be funded with a higher degree of frequency, microseismic monitoring will become more necessary to establish caprock integrity and induced seismicity risk. The Farnsworth, TX site, which hosts enhanced oil recovery operations, provides an ideal laboratory to test essential components of microseismic monitoring such as surface station placement, denoising, and different autopicker methods. We find that despite careful optimization, the surface station placement at the Farnsworth site was insufficient given the high level of background noise from the industrial operations at the oil field. Thus, we use only borehole geophone data in our processing. Two denoising techniques were examined: the DeepDenoiser and the continuous wavelet transform. The continuous wavelet transform was shown to be a valuable tool in converting between raw waveforms to processed denoised waveforms for microseismic monitoring. In the case of the noisy waveforms, only ten detections are found, compared with 90 in the denoised data for a two-hour window. The DeepDenoiser suffered from the fact that the training data was regional earthquake data. In addition, the PhaseNet machine-learning autopicker was applied to both the noisy and the denoised data, and this algorithm detected thousands of more arrivals in the data denoised with the continuous wavelet transform technique.

58 GEOSCIENCES↗
DOE OSTI2024

Multitiered computational methodology for extracting three-dimensional rotational diffusion coefficients from x-ray photon correlation spectroscopy data without structural information

X-ray photon correlation spectroscopy (XPCS) is a powerful technique for analyzing particle systems by investigating their dynamics in suspensions across a broad range of temporal and spatial scales. This is done by illuminating samples with coherent x-ray beams and calculating the correlation function of the obtained x-ray scattering images. XPCS is uniquely suited for studying Brownian dynamics, consisting of translational and rotational diffusion. While traditional XPCS image analysis techniques can extract translational diffusion components, they are unable to estimate rotational diffusion coefficients. Here, we introduce a methodology that combines the angular-temporal cross-correlation analysis and a algorithmic framework called Multi-Tiered Estimation for Correlation Spectroscopy in 3D for estimating three-dimensional rotational diffusion coefficients from XPCS images of three-dimensional particle systems. We demonstrate our methodology for extracting rotational diffusion coefficients from XPCS data by applying it to simulated noisy x-ray images of systems of crossing nanotubes and proteins that evolve under translational and rotational Brownian motion for different diffusion rates. Furthermore, our results show that our approach determines rotational diffusion coefficients within a few percent error.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

mystic : software for autonomous discovery and design under uncertainty

Throughout the diverse range of science and engineering applications, there is a growing desire to develop computational methods that can reliably predict the behavior of complex systems. Specifically, there is a strategic need for tools that can robustly forecast the behavior of complex physical systems, where data may be high-dimensional, noisy, or sparse, and models of the system may be time-dependent or include uncertainty. We use mystic to build tools that leverage statistical learning, physics-informed learning, and active learning in the efficient generation of reliably predictive surrogates for complex physical systems. mystic is a robust, proven, open-source optimization and uncertainty quantification toolkit with over a decade of use in the design and optimization of neutron instrumentation, solar-powered drones, and gasguns, and in iterative tuning of models for Raman spectroscopy and elastoplastic materials strength. Recent developments have focused on automated learning of statistically robust surrogates under uncertainty, with applications in materials in extreme environments, nanostructures, materials simulations and strength models, and the failure of shielding under particle radiation. In 2020, McKerns demonstrated active learning of optimally robust surrogates with respect to new simulated data for molecular dynamics simulations of materials mixing in warm dense matter, and is currently applying active learning to the automated steering of particle accelerator beams and the optimal design and control of quantum optical sensor instrumentation.

42 ENGINEERING↗
DOE OSTI2022

Towards physics-inspired data-driven weather forecasting: integrating data assimilation with a deep spatial-transformer-based U-NET in a case study with ERA5

Abstract. There is growing interest in data-driven weather prediction (DDWP), e.g., using convolutional neural networks such as U-NET that are trained on data from models or reanalysis. Here, we propose three components, inspired by physics, to integrate with commonly used DDWP models in order to improve their forecast accuracy. These components are (1) a deep spatial transformer added to the latent space of U-NET to capture rotation and scaling transformation in the latent space for spatiotemporal data, (2) a data-assimilation (DA) algorithm to ingest noisy observations and improve the initial conditions for next forecasts, and (3) a multi-time-step algorithm, which combines forecasts from DDWP models with different time steps through DA, improving the accuracy of forecasts at short intervals. To show the benefit and feasibility of each component, we use geopotential height at 500 hPa (Z500) from ERA5 reanalysis and examine the short-term forecast accuracy of specific setups of the DDWP framework. Results show that the spatial-transformer-based U-NET (U-STN) clearly outperforms the U-NET, e.g., improving the forecast skill by 45 %. Using a sigma-point ensemble Kalman (SPEnKF) algorithm for DA and U-STN as the forward model, we show that stable, accurate DA cycles are achieved even with high observation noise. This DDWP+DA framework substantially benefits from large (O(1000)) ensembles that are inexpensively generated with the data-driven forward model in each DA cycle. The multi-time-step DDWP+DA framework also shows promise; for example, it reduces the average error by factors of 2–3. These results show the benefits and feasibility of these three components, which are flexible and can be used in a variety of DDWP setups. Furthermore, while here we focus on weather forecasting, the three components can be readily adopted for other parts of the Earth system, such as ocean and land, for which there is a rapid growth of data and need for forecast and assimilation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

AmeriFlux US-GL1 Stannard Rock

This is the AmeriFlux version of the carbon flux data for the site US-GL1 Stannard Rock. Site Description - Stannard Rock is located 39 km from the nearest shore (Keweenaw Peninsula) in Lake Superior, 44 miles NNE of Marquette, Michigan, and 24 miles ESE of Manitou Island. The site is located on the historic Stannard Rock Lighthouse, which was completed in 1882. Eddy covariance instrumentation was installed in 2008 by a network of scientists from both US and Canada, eventually to be called the Great Lakes Evaporation Network (GLEN). The intent of GLEN has been to provide observations of over-lake meteorology and evaporation, improve forecasting of Great Lakes water levels, and support a wide variety of stakeholders, including the National Weather Service (NWS), Environment and Climate Change Canada, National Oceanic and Atmospheric Administration, U.S. Coast Guard, recreational boaters and commercial shipping, emergency management officials, and the Great Lakes research community. The eddy covariance station along with other ancillary meteorological instrumentation is located at an approximate elevation of 39.2 meters above mean lake water level. Meteorological data from the lighthouse are sent to the National Data Buoy Center, where they can be viewed in real-time at http://www.ndbc.noaa.gov/station_page.php?station=stdm4 Uncorrected half-hour fluxes were computed directly on the logger using a 30-minute block averaging period as high-frequency data were not available. The half hour flux measurements downloaded from the datalogger were post-processed with the following filters and corrections. Latent and sensible heat and carbon dioxide fluxes were corrected with 2-D coordinate rotation. Although the primary objective of data collection at Stannard Rock was to quantify the evaporative flux, additional preliminary measurements of the carbon dioxide concentration and flux from the LI-7500 are also included in this dataset but it is advised to use the carbon data with caution. Carbon data reported in this dataset includes turbulent fluxes of CO2 with no storage correction (FC, µmol m-2 s-1) and CO2 density in mole fraction of wet air (CO2), which was originally output on the datalogger as average CO2 density (mg m-2 s-1) and converted into µmol mol-1 using air temperature and pressure in post-processing. Webb, Pearman, and Leuning terms were applied to account for density fluctuations for water vapor and CO2. Sonic path length, high-frequency attenuation and sensor separation were accounted for according to Horst and Massman, and the oxygen absorption correction for the KH2O hygrometer was also applied. Latent and sensible heat fluxes were assumed to be unrealistic above an absolute value of 1000 W m-2 and were removed. Both carbon flux (FC) and carbon dioxide mole fraction in wet air (CO2) and were assumed to be unrealistic above 1000 µmol m-2 s-1 and 1000 µmol mol-1 respectively. Spikes in latent and sensible heat and carbon fluxes and densities (often due to periods of precipitation) were identified by computing the mean and standard deviation over a moving, overlapping window of 336 half-hours (7 days), similar to Shao et al., and were removed when the flux was more than 1.5 standard deviations from the moving window’s mean. While Vickers and Mahrt use a threshold of 3.5 standard deviations from the mean, a conservative value of 1.5 was chosen due to the noisy nature of over-lake data at this particular site. This process was repeated twice for latent and sensible heat, and carbon dioxide fluxes and densities and therefore it is possible that some real, realistic data was filtered out in this process. No detrending was performed. As per AmeriFlux standards, no friction velocity (USTAR, m s-1) filtering was performed.

Spence, Chris↗
DOE OSTI2025

AmeriFlux FLUXNET-1F US-GL1 Stannard Rock

This is the AmeriFlux Management Project (AMP) created FLUXNET-1F version of the carbon flux data for the site US-GL1 Stannard Rock. This is the FLUXNET version of the carbon flux data for the site US-GL1 Stannard Rock produced by applying the standard ONEFlux (1F) software. Site Description - Stannard Rock is located 39 km from the nearest shore (Keweenaw Peninsula) in Lake Superior, 44 miles NNE of Marquette, Michigan, and 24 miles ESE of Manitou Island. The site is located on the historic Stannard Rock Lighthouse, which was completed in 1882. Eddy covariance instrumentation was installed in 2008 by a network of scientists from both US and Canada, eventually to be called the Great Lakes Evaporation Network (GLEN). The intent of GLEN has been to provide observations of over-lake meteorology and evaporation, improve forecasting of Great Lakes water levels, and support a wide variety of stakeholders, including the National Weather Service (NWS), Environment and Climate Change Canada, National Oceanic and Atmospheric Administration, U.S. Coast Guard, recreational boaters and commercial shipping, emergency management officials, and the Great Lakes research community. The eddy covariance station along with other ancillary meteorological instrumentation is located at an approximate elevation of 39.2 meters above mean lake water level. Meteorological data from the lighthouse are sent to the National Data Buoy Center, where they can be viewed in real-time at http://www.ndbc.noaa.gov/station_page.php?station=stdm4 Uncorrected half-hour fluxes were computed directly on the logger using a 30-minute block averaging period as high-frequency data were not available. The half hour flux measurements downloaded from the datalogger were post-processed with the following filters and corrections. Latent and sensible heat and carbon dioxide fluxes were corrected with 2-D coordinate rotation. Although the primary objective of data collection at Stannard Rock was to quantify the evaporative flux, additional preliminary measurements of the carbon dioxide concentration and flux from the LI-7500 are also included in this dataset but it is advised to use the carbon data with caution. Carbon data reported in this dataset includes turbulent fluxes of CO2 with no storage correction (FC, µmol m-2 s-1) and CO2 density in mole fraction of wet air (CO2), which was originally output on the datalogger as average CO2 density (mg m-2 s-1) and converted into µmol mol-1 using air temperature and pressure in post-processing. Webb, Pearman, and Leuning terms were applied to account for density fluctuations for water vapor and CO2. Sonic path length, high-frequency attenuation and sensor separation were accounted for according to Horst and Massman, and the oxygen absorption correction for the KH2O hygrometer was also applied. Latent and sensible heat fluxes were assumed to be unrealistic above an absolute value of 1000 W m-2 and were removed. Both carbon flux (FC) and carbon dioxide mole fraction in wet air (CO2) and were assumed to be unrealistic above 1000 µmol m-2 s-1 and 1000 µmol mol-1 respectively. Spikes in latent and sensible heat and carbon fluxes and densities (often due to periods of precipitation) were identified by computing the mean and standard deviation over a moving, overlapping window of 336 half-hours (7 days), similar to Shao et al., and were removed when the flux was more than 1.5 standard deviations from the moving window’s mean. While Vickers and Mahrt use a threshold of 3.5 standard deviations from the mean, a conservative value of 1.5 was chosen due to the noisy nature of over-lake data at this particular site. This process was repeated twice for latent and sensible heat, and carbon dioxide fluxes and densities and therefore it is possible that some real, realistic data was filtered out in this process. No detrending was performed. As per AmeriFlux standards, no friction velocity (USTAR, m s-1) filtering was performed.

Spence, Chris [Environment and Climate Change Cana↗
DOE OSTI2020

Automated Identification of Molecular Crystals’ Packing Motifs

Packing motifs—patterns in how molecules orient relative to one another in a crystal structure—are an important concept in many subdisciplines of materials science because of correlations observed between specific packing motifs and properties of interest. That said, packing motif data sets have remained small and noisy due to intensive manual labeling processes and insufficient labeling schemes. The most prominent labeling algorithms calculate relative interplanar angles of nearest neighbor molecules to determine the packing motif of a molecular crystal, but this simple approach can fail when neighbors are naively sampled isotropically around the crystal structure. To remedy this issue, here we propose an optimization algorithm, which rotates the molecular crystal structure to find representative molecules that inform the packing motif. We package this algorithm into an automated framework—Autopack—which both optimally rotates the crystal structure and labels the packing motif based on the appropriate neighboring molecules. In this work, we detail the Autopack framework and its performance, which shows improvements compared to previous state-of-the-art labeling methods, providing the first quantitative point of comparison for packing motif labeling algorithms. Furthermore, using Autopack (available at https://ipo.llnl.gov/technologies/software/autopack), we perform the first large-scale study of potential relationships between chemicals’ compositions and packing motifs, which shows that these relationships are more complex than previously hypothesized from studies that used only tens of polycyclic aromatic hydrocarbon molecules. Autopack’s capabilities help pose next steps for crystal engineering research focusing not only on a molecule’s adoption of a specific packing motif but also on new structure–property relationships.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Measurements of Single Event Upset in ATLAS IBL

Effects of Single Event Upsets (SEU) and Single Event Transients (SET) are studied in the FE-I4B chip of the innermost layer of the ATLAS pixel system. SEU/SET affect the FE-I4B Global Registers as well as the settings for the individual pixels, causing, among other things, occupancy losses, drops in the low voltage currents, noisy pixels, and silent pixels. Quantitative data analysis and simulations indicate that SET dominate over SEU on the load line of the memory. Operational issues and mitigation techniques are presented.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Evaluation of a generalized least squares algorithm for infrasound beamforming with coherent background noise

Infrasonic signals of interest can occur during periods with persistent, coherent, background noise, which may be natural or anthropogenic. For high signal-to-noise (SNR) ratio transient signals, an ‘overprinting’ of the coherent background may occur, and the signal may still be detected. However, this approach fails for low SNR signals of interest, which may be obscured by coherent noise. An infrasound beamforming method based on generalized least squares (GLS) is investigated for detecting transient signals of interest in the presence of coherent and incoherent background noise. This approach relies on an estimate of the noise covariance, captured in a covariance matrix, to effectively null contributions to the array response from noisy directions of arrival. Synthetic array data is used to investigate the performance of the GLS beamformer compared to the Bartlett beamformer when coherent and incoherent backgrounds are present. Additionally, the effects of array element number and relative strength of the interfering signal on the GLS estimates is investigated. GLS empirical area under the curve estimates suggest that the beamformer can recover coherent power for a signal of interest lower in amplitude than the coherent background, but this effectiveness degrades more quickly with SNR for a four element array compared to a six or eight element infrasound array. Finally, infrasound from the Forensic Surface Experiment, a bolide signal observed at IMS array I37NO, and a volcanic signal recorded at the Alaska Volcano Observatory array ADKI are used to evaluate GLS performance on recorded data. A ten minute window was used to capture the background noise, and the coherent background signal was nulled in all three examples.

58 GEOSCIENCES↗
DOE OSTI2025

Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNet

Modern data-driven surrogate models for weather forecasting provide accurate short-term predictions but inaccurate and nonphysical long-term forecasts. This paper investigates online weather prediction using machine learning surrogates supplemented with partial and noisy observations. We empirically demonstrate and theoretically justify that, despite the long-time instability of the surrogates and the sparsity of the observations, filtering estimates can remain accurate in the long-time horizon. As a case study, we integrate the Fourier Forecasting Neural Network (FourCastNet), a weather surrogate model, within a variational data assimilation framework using partial, noisy ERA5 global reanalysis data from the European Centre for Medium-Range Weather Forecasts (ECMWF). Here, our results show that filtering estimates remain accurate over a year-long assimilation window and provide effective initial conditions for forecasting tasks, including extreme event prediction.

Data assimilation↗
DOE OSTI2026

Learning genetic perturbation effects with variational causal inference

Advances in sequencing technologies have enhanced the understanding of gene regulation in cells. In particular, Perturb-seq has enabled high-resolution profiling of the transcriptomic response to genetic perturbations at the single-cell level. This understanding has implications in functional genomics and potentially for identifying therapeutic targets. Various computational models have been developed to predict perturbational effects. While deep learning models excel at interpolating observed perturbational data, they tend to overfit in the lack of enough data and may not generalize well to unseen perturbations. In contrast, mechanistic models, such as linear causal models based on gene regulatory networks, hold greater potential for extrapolation, as they encapsulate regulatory information that can predict responses to unseen perturbations. However, their application has been limited to small studies due to overly simplistic assumptions, making them less effective in handling noisy, large-scale single-cell data. We propose a hybrid approach that combines a mechanistic causal model with variational deep learning, termed Single Cell Causal Variational Autoencoder (SCCVAE). The mechanistic model employs a learned regulatory network to represent perturbational changes as shift interventions that propagate through the learned network. SCCVAE integrates this mechanistic causal model into a variational autoencoder, generating rich, comprehensive transcriptomic responses. Our results indicate that SCCVAE exhibits superior performance over current state-of-the-art baselines for extrapolating to predict unseen perturbational responses. Additionally, for the observed perturbations, the latent space learned by SCCVAE allows for the identification of functional perturbation modules and simulation of single-gene knockdown experiments of varying penetrance, presenting a robust tool for interpreting and interpolating perturbational responses at the single-cell level.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

CryoSegNet: accurate cryo-EM protein particle picking by integrating the foundational AI image segmentation model and attention-gated U-Net

Picking protein particles in cryo-electron microscopy (cryo-EM) micrographs is a crucial step in the cryo-EM-based structure determination. However, existing methods trained on a limited amount of cryo-EM data still cannot accurately pick protein particles from noisy cryo-EM images. The general foundational artificial intelligence–based image segmentation model such as Meta’s Segment Anything Model (SAM) cannot segment protein particles well because their training data do not include cryo-EM images. Here, we present a novel approach (CryoSegNet) of integrating an attention-gated U-shape network (U-Net) specially designed and trained for cryo-EM particle picking and the SAM. The U-Net is first trained on a large cryo-EM image dataset and then used to generate input from original cryo-EM images for SAM to make particle pickings. CryoSegNet shows both high precision and recall in segmenting protein particles from cryo-EM micrographs, irrespective of protein type, shape and size. On several independent datasets of various protein types, CryoSegNet outperforms two top machine learning particle pickers crYOLO and Topaz as well as SAM itself. The average resolution of density maps reconstructed from the particles picked by CryoSegNet is 3.33 Å, 7% better than 3.58 Å of Topaz and 14% better than 3.87 Å of crYOLO. It is publicly available at https://github.com/jianlin-cheng/CryoSegNet

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Data Summarization and Inference at Scale

This is the final report for the DOE ASCR grant SC-0022260, Data Summarization and Inference at Scale, PI: Alex Pothen, Purdue University. The goal of the project was to solve data-intensive and compute-intensive problems in the physical sciences, engineering, information science, data science, etc. by designing and implementing new algorithms that could work with a subset of the data. The four subgoals were: (a) The solution of problems where the data is too large to be stored in the memory of a computer. In this streaming model of computation, the data arrives as a stream of elements to the computer, each element is processed as it arrives, and a decision is made to discard the data or to store it; only a small subset of the data proportional to the size of the output solution is stored, and when all the data has been streamed, a solution to the problem is computed from the stored subset. (b) The use of machine learning methods to compute solutions to data-intensive problems. The use of GPUs is critical to obtain high performance on machine learning tasks, but their memory sizes are smaller relative to that of CPUs. For large-scale problems, the data is sampled many times, and small samples are used with repetition, for robustness, to compute solutions to inference tasks. This sampling reduces the memory required to solve the problem, but attention is needed to avoid slow convergence to the solutions, and reduced accuracy of inference. We propose submodular optimization, Large Language Models, and physics-informed neural networks to enable GPU computations here. (c) Modeling and visualization of high-dimensional data using interpretable features. Clinical proteomic data sets from immunology for the detection of cancer and other diseases are temporal and high-dimensional, and algorithms for visualizing these data sets using clinically interpretable features are lacking. We propose methods that compute distances based on the optimal transportation problem and graph edit distances to address this problem. We also propose the use of optimal transport-based distances, spatial statistics, and network structure to classify image data sets, We apply these algorithms to electron micrographs of the peripheral nervous system in the digestive tract. (d) The design of data-intensive algorithms on emerging architectures, specifically, noisy, intermediate-scale quantum (NISQ) devices. Quantum computers offer the possibility of exploring large solution spaces due to the principle of superposition, but current quantum computers are limited by few qubits, short coherence times due to noise, poor interconections among the qubits, etc. We propose the use of the divide and conquer paradigm to solve large-scale problems, wherein collections of small subproblems are solved on the quantum devices, and the solutions to the subproblems are integrated into a solution for the original problem on a classical computer.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

DISSIDE: Dynamic In Silico Sample Identification for Discrete Evaluation

DISSIDE uses novel unsupervised learning to select samples that best represent the strongest a priori discrete pattern in a given data set. It further removes major outliers and "noisy" samples that do not fit discrete patterns well or represent outliers in groups below a defined n value. It then estimates the fit and strength of the a priori discrete pattern using both unconstrained and constrained methods for raw and cleaned data

LeBrun, Erick↗
DOE OSTI2022

Qubit noise deconvolution

We present a noise deconvolution technique to remove a wide class of noises when performing arbitrary measurements on qubit systems. In particular, we derive the inverse map of the most common single qubit noisy channels, and exploit it at the data processing step to obtain noise-free estimates of observables evaluated on a qubit system subject to known noise. We illustrate a self-consistency check to ensure that the noise characterization is accurate providing simulation results for the deconvolution of a generic Pauli channel, as well as experimental evidence of the deconvolution of decoherence noise occurring on Rigetti quantum hardware.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Flatfielding of hybrid pixel detectors in tender x-ray scattering

The ability of the soft matter interfaces beamline at National Synchrotron Light Source II to access x-ray energy in the tender x-ray regime, i.e., from 2.1 to 5 keV, enables new resonant x-ray scattering studies at the sulfur K-edge and others. We present a new approach to correct data acquired in the tender x-ray regime with a Pilatus3 detector in order to improve the data quality and to correct the various artifacts inherent to hybrid pixel detectors, such as variations in modules’ efficiency or noisy detector module junctions. Further, this new flatfielding significantly enhances the data quality and enables detection of weak scattering signals.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

A Denoising Autoencoder for Improved Kikuchi Pattern Quality and Indexing in Electron Backscatter Diffraction

The rapid collection and indexing of electron diffraction patterns as produced via electron backscatter diffraction (EBSD) has enabled crystallographic orientation and structural determination, as well as additional property-determining strain and dislocation density information with increasing speed, resolution, and efficiency. Pattern indexing quality is reliant on the noise of the collected electron diffraction patterns, which is often convoluted by sample preparation and data collection parameters. EBSD acquisition is sensitive to many factors and thus can result in low confidence index (CI), poor image quality (IQ), and improper minimization of fit, which can result in noisy datasets and misrepresent the microstructure. In an attempt to enable both higher speed EBSD data collection and enable greater orientation fit accuracy with noisy datasets, an image denoising autoencoder was implemented to improve pattern quality. Here, we show that EBSD data processed through the autoencoder results in a higher CI, IQ, and a more accurate degree of fit. In addition, using denoised datasets in HR-EBSD cross correlative strain analysis can result in reduced phantom strain from erroneous calculations due to the increased indexing accuracy and improved correspondence between collected and simulated patterns.

36 MATERIALS SCIENCE↗