Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image representation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Atomic-scale Imaging of PGM-free Catalyst Active Sites by 30 keV 4D-STEM

Platinum group metal (PGM)-free catalysts have attracted a large amount of attention due to their potential for enabling low-cost, commercially viable hydrogen fuel cells and electrolyzers [1]. Degradation of cell performance remains a significant challenge, however, currently limiting implementation of devices that utilize PGM-free materials [2]. Controlling degradation in these materials requires a better understanding of the atomic structure of active sites, thought to be FeN4 structures within a graphitic carbon lattice, which would enable more accurate prediction of the associated degradation pathways. The exact structural arrangement of active sites in these materials is still debated since a range of structures have been computationally predicted and methods to directly validate these models are still needed [1,3-5].While scanning transmission electron microscopy (STEM) has provided initial glimpses into the nature of the proposed active sites, detailed evaluation of the structure of these sites is challenging since they involve defects, edges, and nitrogen dopants in the graphitic lattice, which are susceptible to beam damage [6,7]. Conventional STEM imaging and spectroscopy methods exacerbate this problem with dose-inefficiency or nonideal contrast characteristics for imaging light and heavy elements simultaneously. A method that minimizes damage while generating dose-efficient, easily-interpretable contrast for both light and heavy elements is therefore needed to facilitate imaging of sensitive active site atomic structure.Here, we demonstrate direct atomic-scale imaging of PGM-free catalyst active sites by low-voltage four-dimensional (4D)-STEM. To accomplish this, we pair a 30 keV aberration-corrected probe, which minimizes knock-on damage, with a fast pixelated detector that has optimal performance at low beam energies [8]. We show how this setup enables relatively simple center-of-mass (CoM) techniques [9,10] to produce images with an increased signal-to-noise ratio (SNR) and light-element contrast over conventional imaging modes, allowing the entire active site structure to be imaged at the atomic scale. Moreover, we show how electron ptychography [11,12] enables images with further improved characteristics to be obtained, for example by minimizing residual aberrations, which provides a more accurate structural representation. The increased understanding that these low-voltage 4D-STEM techniques will provide about the atomic structure of PGM-free active sites and their associated degradation pathways will facilitate rational design of next-generation materials, promoting development of low-cost hydrogen fuel cells, electrolyzers, and other energy conversion devices [13]. References:[1] U Martinez et al., Adv. Mater. 31 (2019), p. 1806545.[2] Y Shao et al., Adv. Mater. 31 (2019), p. 1807615.[3] J Kneebone et al., J. Phys. Chem. C 121, (2017), p.16283.[4] T Mineva et al., ACS Catal. 9 (2019), p. 9359.[5] J Li et al., Nat. Catal. 4 (2021), p. 10.[6] T Susi et al., ACS Nano 6 (2012), p. 8837.[7] P Zelenay and DJ Myers, US Department of Energy Hydrogen and Fuel Cells Program 2017 Annual Merit Review and Peer Evaluation Meeting, Washington, DC (2017).[8] H Ryll et al., J. Inst. 11 (2016), p. P04006.[9] K Müller et al., Nat. Commun. 5 (2014), p. 5653.[10] I Lazic et al., Ultramicroscopy 160 (2016), p. 265.[11] H Yang et al., Nat. Commun. 7 (2016), p. 12532.[12] Y Jiang et al., Nature 559 (2018), p. 343. [13] Research sponsored by the Hydrogen and Fuel Cell Technologies Office, Office of Energy Efficiency and Renewable Energy, US Department of Energy (DOE). Research was conducted at the Center for Nanophase Materials Sciences, which is a DOE Office of Science User Facility.

Zachman, Michael↗
DOE OSTI2020

Blockchain based Communication Architectures with Applications to Private Security Networks

Existing communication protocols in high consequence security networks are highly centralized. While this naively makes the controls easier to physically secure, external actors require fewer resources to disrupt the system because there are fewer points in the system can be destroyed or interrupted without the entire system failing. We present a solution to this problem using a proof-of-work-based blockchain implementation built on MultiChain. We construct a test-bed network containing two types of data input: visual imagers and microwave sensor information. These data types are ubiquitous in perimeter intrusion detection security systems and allow a realistic representation of a real-world network architecture. The cameras in this system use an object detection algorithm to nd important targets in the scene. The raw data from the camera and the outputs from the detection algorithm are then placed in a transaction on the distributed ledger. Similarly, microwave data is used to detect relevant events and are placed in a transaction. These transactions are then bundled into blocks and broadcast to the rest of the network using the Bitcoin-based MultiChain protocol. We develop five tests to examine the security metrics of our network. We performed the five security metric test using different sized networks from 7 to 39 nodes to determine how the metrics scale with respect to size. We nd that when compared to a centralized architecture our implementation provides a resiliency increase that is expected from a blockchain-based protocol without slowing the system so much that a human operator would notice. Furthermore, our approach is able to detect tampering in real time. Based on these results, we theorize that security networks in general could use a blockchain-based approach in a meaningful way.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Droplet collection efficiencies inferred from satellite retrievals constrain effective radiative forcing of aerosol–cloud interactions

Abstract. Process-oriented observational constraints for the anthropogenic effective radiative forcing due to aerosol–cloud interactions (ERFaci) are highly desirable because the uncertainty associated with ERFaci poses a significant challenge to climate prediction. The contoured frequency by optical depth diagram (CFODD) analysis supports the evaluation of model representation of cloud liquid-to-rain conversion processes because the slope of a CFODD, generated from joint MODerate Resolution Imaging Spectroradiometer (MODIS)-CloudSat cloud retrievals, provides an estimate of cloud droplet collection efficiency in single-layer warm liquid clouds. Here, we present an updated CFODD analysis as an observational constraint on the ERFaci due to warm rain processes and apply it to the U.S. Department of Energy's Energy Exascale Earth System Model version 2 (E3SMv2). A series of sensitivity experiments shows that E3SMv2 droplet collection efficiencies and ERFaci are highly sensitive to autoconversion, i.e., the rate of mass transfer from cloud liquid to rain, yielding a strong correlation between the CFODD slope and the shortwave component of ERFaci (ERFaciSW; Pearson's R=-0.91). E3SMv2's CFODD slope (0.20 ± 0.04) is in agreement with observations (0.20 ± 0.03). The strong sensitivity of ERFaciSW to the CFODD slope provides a useful constraint on highly uncertain warm rain processes, whereby ERFaciSW, constrained by MODIS-CloudSat, is estimated by calculating the intercept of the linear association between the ERFaciSW and the CFODD slopes, using the MODIS-CloudSat CFODD slope as a reference.

Beall, Charlotte M. (ORCID:0000000311370835)↗
DOE OSTI2021

Thermodynamics of order and randomness in dopant distributions inferred from atomically resolved imaging

Abstract Exploration of structure-property relationships as a function of dopant concentration is commonly based on mean field theories for solid solutions. However, such theories that work well for semiconductors tend to fail in materials with strong correlations, either in electronic behavior or chemical segregation. In these cases, the details of atomic arrangements are generally not explored and analyzed. The knowledge of the generative physics and chemistry of the material can obviate this problem, since defect configuration libraries as stochastic representation of atomic level structures can be generated, or parameters of mesoscopic thermodynamic models can be derived. To obtain such information for improved predictions, we use data from atomically resolved microscopic images that visualize complex structural correlations within the system and translate them into statistical mechanical models of structure formation. Given the significant uncertainties about the microscopic aspects of the material’s processing history along with the limited number of available images, we combine model optimization techniques with the principles of statistical hypothesis testing. We demonstrate the approach on data from a series of atomically-resolved scanning transmission electron microscopy images of Mo x Re 1- x S 2 at varying ratios of Mo/Re stoichiometries, for which we propose an effective interaction model that is then used to generate atomic configurations and make testable predictions at a range of concentrations and formation temperatures.

25 ENERGY STORAGE↗
DOE OSTI2023

Vegetation Representation Influences Projected Streamflow Changes in the Colorado River Basin

Vegetation parameters for the Variable Infiltration Capacity (VIC) hydrologic model were recently updated using observations from the Moderate Resolution Imaging Spectroradiometer (MODIS). Previous work showed that these MODIS-based parameters improved VIC evapotranspiration simulations when compared to eddy covariance observations. Due to the importance of evapotranspiration within the Colorado River basin, this study provided a basin-by-basin calibration of VIC soil parameters with updated MODIS-based vegetation parameters to improve streamflow simulations. Interestingly, while both configurations had similar historic streamflow performance, end-of-century hydrologic projections, driven by 29 downscaled global climate models under the RCP8.5 emissions scenario, differed between the two configurations. The calibrated MODIS-based configuration had an ensemble mean that simulated little change in end-of-century annual streamflow volume (+0.4%) at Lees Ferry, Arizona, relative to the historical period (1960–2005). In contrast, the previous VIC configuration, which is used to inform decisions about future water resources in the Colorado River basin, projected an 11.7% decrease in annual streamflow. Both VIC configurations simulated similar amounts of evapotranspiration in the historical period. However, the MODIS-based VIC configuration did not show as much of an increase in evapotranspiration by the end of the century, primarily within the upper basin’s forested areas. Differences in evapotranspiration projections were the result of the MODIS-based vegetation parameters having lower leaf area index values and less forested area compared to previous vegetation estimates used in recent Colorado River basin hydrologic projections. These results highlight the need to accurately characterize vegetation and better constrain climate sensitivities in hydrologic models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Experimental Observations of the Topology of Convolutional Neural Network Activations

Topological data analysis (TDA) is a branch of computational mathematics, bridging algebraic topology and data science, that provides compact, noise-robust representations of complex structures. Deep neural networks (DNNs) learn millions of parameters associated with a series of transformations defined by the model architecture resulting in high-dimensional, difficult to interpret internal representations of input data. As DNNs become more ubiquitous across multiple sectors of our society, there is increasing recognition that mathematical methods are needed to aid analysts, researchers, and practitioners in understanding and interpreting how these models' internal representations relate to the final classification. In this paper we apply cutting edge techniques from TDA with the goal of gaining insight towards interpretability of convolutional neural networks used for image classification. We use two common TDA approaches to explore several methods for modeling hidden layer activations as high-dimensional point clouds, and provide experimental evidence that these point clouds capture valuable structural information about the model's process. First, we demonstrate that a distance metric based on persistent homology can be used to quantify meaningful differences between layers and discuss these distances in the broader context of existing representational similarity metrics for neural network interpretability. Second, we show that a mapper graph can provide semantic insight as to how these models organize hierarchical class knowledge at each layer. These observations demonstrate that TDA is a useful tool to help deep learning practitioners unlock the hidden structures of their models.

topological data analysis, deep learning↗
DOE OSTI2025

Experimental study of multiple-orientation muon tomography with image optimization in sparse data environments

Due to the high penetrating power of cosmic-ray muons, they can be used to probe very thick and dense objects. As muons are charged particles, they can be tracked by ionization detectors, determining the position and direction of the muons. With detectors on either side of an object to measure particle direction change, scattering information within the object can be found. This can be used to produce a scattering-intensity image within the object related to density and atomic number. Such imaging is typically performed with a single detector-object orientation, taking advantage of the more intense downward flux of muons, producing planar imaging with some depth-of-field information in the third dimension. Several simulation studies were published with multiorientation tomography, which can form a three-dimensional representation faster than a single-orientation view. In this study, experimental muon-scatter-based tomography was performed using a concrete filled steel drum with several different metal wedges inside, with the drum between detector planes. Data were collected from different detector-object orientations by rotating the steel drum. The data collected from each orientation were combined using two different tomographic methods. A traditional inverse Radon transform approach used for computed tomography and a combination of multiple depth-of-field reconstructions were applied to the data. As cosmic-ray muon flux imaging is rate limited, the imaging techniques were compared for sparse data. Using the combined depth-of-field reconstruction technique, fewer detector-object orientations were needed to reconstruct images that could be used to differentiate the metal wedges.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Grassmannian Diffusion Maps--Based Dimension Reduction and Classification for High-Dimensional Data

This work introduces the Grassmannian diffusion maps (GDMaps), a novel nonlinear dimensionality reduction technique that defines the affinity between points through their representation as low-dimensional subspaces corresponding to points on the Grassmann manifold. Here, the method is designed for applications, such as image recognition and data-based classification of constrained high-dimensional data where each data point itself is a high-dimensional object (i.e., a large matrix) that can be compactly represented in a lower-dimensional subspace. The GDMaps is composed of two stages. The first is a pointwise linear dimensionality reduction wherein each high-dimensional object is mapped onto the Grassmann manifold representing the low-dimensional subspace on which it resides. The second stage is a multipoint nonlinear kernel-based dimension reduction using diffusion maps to identify the subspace structure of the points on the Grassmann manifold. To this end, an appropriate Grassmannian kernel is used to construct the transition matrix of a random walk on a graph connecting points on the Grassmann manifold. Spectral analysis of the transition matrix yields low-dimensional Grassmannian diffusion coordinates embedding the data into a low-dimensional reproducing kernel Hilbert space. Further, a novel data classification/recognition technique is developed based on the construction of an overcomplete dictionary of reduced dimension whose atoms are given by the Grassmannian diffusion coordinates. Three examples are considered. First, a "toy" example shows that the GDMaps can identify an appropriate parametrization of structured points on the unit sphere. The second example demonstrates the ability of the GDMaps to revealing the intrinsic subspace structure of high-dimensional random field data. In the last ex- ample, a face recognition problem is solved considering face images subject to varying illumination conditions, changes in face expressions, and occurrence of occlusions. The technique presented high recognition rates (i.e., 95% in the best case) using a fraction of the data required by conventional methods.

42 ENGINEERING↗
DOE OSTI2021

Gaussian process analysis of electron energy loss spectroscopy data: multivariate reconstruction and kernel control

Abstract Advances in hyperspectral imaging including electron energy loss spectroscopy bring forth the challenges of exploratory and physics-based analysis of multidimensional data sets. The multivariate linear unmixing methods generally explore similarities in the energy dimension, but ignore correlations in the spatial domain. At the same time, Gaussian process (GP) explicitly incorporate spatial correlations in the form of kernel functions but is computationally intensive. Here, we implement a GP method operating on the full spatial domain and reduced representations in the energy domain. In this multivariate GP, the information between the components is shared via a common spatial kernel structure, while allowing for variability in the relative noise magnitude or image morphology. We explore the role of kernel constraints on the quality of the reconstruction, and suggest an approach for estimating them from the experimental data. We further show that spatial information contained in higher-order components can be reconstructed and spatially localized.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Detecting operons in bacterial genomes via visual representation learning

Contiguous genes in prokaryotes are often arranged into operons. Detecting operons plays a critical role in inferring gene functionality and regulatory networks. Human experts annotate operons by visually inspecting gene neighborhoods across pileups of related genomes. These visual representations capture the inter-genic distance, strand direction, gene size, functional relatedness, and gene neighborhood conservation, which are the most prominent operon features mentioned in the literature. By studying these features, an expert can then decide whether a genomic region is part of an operon. We propose a deep learning based method named Operon Hunter that uses visual representations of genomic fragments to make operon predictions. Using transfer learning and data augmentation techniques facilitates leveraging the powerful neural networks trained on image datasets by re-training them on a more limited dataset of extensively validated operons. Our method outperforms the previously reported state-of-the-art tools, especially when it comes to predicting full operons and their boundaries accurately. Furthermore, our approach makes it possible to visually identify the features influencing the network’s decisions to be subsequently cross-checked by human experts.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Random filters for enriching the discriminatory power of topological representations

Topological representations of data are inherently coarse summaries which endows them with certain desirable properties like stability but also potentially inhibits their discriminatory power relative to fine-scale learned features. In this work we present a novel framework for enriching the discriminatory power of topological representations based on random filters and capturing ``interference topology'' rather than direct topology. We show that our random filters outperform previously explored structured image filters while requiring orders of magnitude less computational time. The approach is demonstrated on the MNIST dataset but is broadly applicable across data sets and modalities. This work is concluded with a discussion of the mathematical intuition underlying the approach and identification of future directions to enable deeper understanding and theoretical results.

Jorgenson, Grayson S.↗
DOE OSTI2022

Random Filters for Enriching the Discriminatory Power of Topological Representations

Topological representations of data are inherently coarse summaries which endows them with certain desirable properties like stability but also potentially inhibits their discriminatory power relative to fine-scale learned features. In this work we present a novel framework for enriching the discriminatory power of topological representations based on random filters and capturing "interference topology'' rather than direct topology. We show that our random filters outperform previously explored structured image filters while requiring orders of magnitude less computational time. The approach is demonstrated on the MNIST dataset but is broadly applicable across data sets and modalities. This work is concluded with a discussion of the mathematical intuition underlying the approach and identification of future directions to enable deeper understanding and theoretical results.

Jorgenson, Grayson S.↗
DOE OSTI2022

TopTemp: Parsing Precipitate Structure from Temper Topology

Technological advances are in part enabled by the development of novel manufacturing processes that give rise to new materials or material property improvements. Development and evaluation of new manufacturing methodologies is labor-, time-, and resource-intensive expensive due to complex, poorly defined relationships between advanced manufacturing process parameters and the resulting microstructures. In this work, we present a topological representation of temper (heat-treatment) dependent material micro-structure, as captured by scanning electron microscopy, called TopTemp. We show that this topological representation is able to support temper classification of microstructures in a data limited setting, generalizes well to previously unseen samples, is robust to image perturbations, and captures domain interpretable features. The presented work outperforms conventional deep learning baselines and is a first step towards improving understanding of process parameters and resulting material properties.

Kassab, Lara↗
DOE OSTI2024

First experimental study of multiple orientation muon tomography, with image optimization in sparse data environments

Due to the high penetrating power of cosmic ray muons, they can be used to probe very thick and dense objects. As charged particles, they can be tracked by ionization detectors, determining the position and direction of the muons. With detectors on either side of an object, particle direction changes can be used to extract scattering information within an object. This can be used to produce a scattering intensity image within the object related to density and atomic number. Such imaging is typically performed with a single detector-object orientation, taking advantage of the more intense downward flux of muons, producing planar imaging with some depth-of-field information in the third dimension. Several simulation studies have been published with multi-orientation tomography, which can form a three-dimensional representation faster than a single orientation view. In this work we present the first experimental multiple orientation muon tomography study. Experimental muon-scatter based tomography was performed using a concrete filled steel drum with several different metal wedges inside, between detector planes. Data was collected from different detector-object orientations by rotating the steel drum. The data collected from each orientation were then combined using two different tomographic methods. Results showed that using a combination of multiple depth-of-field reconstructions, rather than a traditional inverse Radon transform approach used for CT, resulted in more useful images for sparser data. As cosmic ray muon flux imaging is rate limited, the imaging techniques were compared for sparse data. Using the combined depth-of-field reconstruction technique, fewer detector-object orientations were needed to reconstruct images that could be used to differentiate the metal wedge compositions.

Applied Physics (physics.app-ph)↗
DOE OSTI2020

High-Energy X-ray Tomographic Analysis of Precursor Metal Powders (Ti-6Al-4V) Used for Additive Manufacturing

We utilized high-energy x-ray tomography to characterize Ti-6Al-4V metal powders (both as-received and recycled) used in powder-bed additive manufacturing process. The image processing workflow was developed to process and analyze large amount of data objectively by computer program. The distribution of size and shape of the metal particles as well as defect (mainly porosity) inside the particles was analyzed with the statistical representation and resolution in micrometer. The result revealed that circular-shaped porosity with various sizes could be embedded in the powder particles. These porosities could potentially be transferred to the 3D printed part and critically affect the mechanical performance of the component. The present study shows the effectiveness of characterizing metal powders using x-ray imaging techniques where sufficient number of particles can be sampled within tens of minutes with a minimum sample preparation and high accuracy. Clear structural differences in the as-received and recycled powders were delineated that helps in determining the feasibility of using the recycled powders.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Multiscale characterization and representation of variability in ceramic matrix composites

Low density, high strength, and high creep and oxidation resistance properties of ceramic matrix composites (CMCs) make them an ideal choice for use in extreme environments in space and military applications. This paper presents a detailed characterization study of structural and manufacturing flaws in Carbon fiber Silicon-Carbide-Nitride matrix (C/SiNC) CMCs at different length-scales. Energy-dispersive spectroscopy (EDS) is used for the chemical characterization of the material’s elemental constituents. High-resolution multiscale graphs obtained from scanning electron microscope (SEM) and confocal laser scanning microscope (LSM) are used to characterize the distribution and morphology of defects at different length scales. This is followed by the classification and quantification of the common manufacturing defects. An image processing algorithm based on the image segmentation process is developed to quantify the variability of various scale-dependent architectural parameters. Finally, a three-dimensional stochastic representative volume element (SRVE) generation algorithm is developed to provide precise representations of material textures at multiple length scales. The developed algorithm accurately accounts for material features and flaws based on a range of multiscale structural and defects characterization results.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Photometric redshift estimation with convolutional neural networks and galaxy images: Case study of resolving biases in data-driven methods

Deep-learning models have been increasingly exploited in astrophysical studies, but these data-driven algorithms are prone to producing biased outputs that are detrimental for subsequent analyses. In this work, we investigate two main forms of biases: class-dependent residuals, and mode collapse. We do this in a case study, in which we estimate photometric redshift as a classification problem using convolutional neural networks (CNNs) trained with galaxy images and associated spectroscopic redshifts. We focus on point estimates and propose a set of consecutive steps for resolving the two biases based on CNN models, involving representation learning with multichannel outputs, balancing the training data, and leveraging soft labels. The residuals can be viewed as a function of spectroscopic redshift or photometric redshift, and the biases with respect to these two definitions are incompatible and should be treated individually. We suggest that a prerequisite for resolving biases in photometric space is resolving biases in spectroscopic space. Experiments show that our methods can better control biases than benchmark methods, and they are robust in various implementing and training conditions with high-quality data. Our methods hold promises for future cosmological surveys that require a good constraint of biases, and they may be applied to regression problems and other studies that make use of data-driven models. Nonetheless, the bias-variance tradeoff and the requirement of sufficient statistics suggest that we need better methods and optimized data usage strategies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Analysis of Interpretable Data Representations for 4D-STEM Using Unsupervised Learning

Abstract Understanding the structure of materials is crucial for engineering devices and materials with enhanced performance. Four-dimensional scanning transmission electron microscopy (4D-STEM) is capable of mapping nanometer-scale local crystallographic structure over micron-scale field of views. However, 4D-STEM datasets can contain tens of thousands of images from a wide variety of material structures, making it difficult to automate detection and classification of structures. Traditional automated analysis pipelines for 4D-STEM focus on supervised approaches, which require prior knowledge of the material structure and cannot describe anomalous or deviant structures. In this article, a pipeline for engineering 4D-STEM feature representations for unsupervised clustering using non-negative matrix factorization (NMF) is introduced. Each feature is evaluated using NMF and results are presented for both simulated and experimental data. It is shown that some data representations more reliably identify overlapping grains. Additionally, real space refinement is applied to identify spatially distinct sample regions, allowing for size and shape analysis to be performed. This work lays the foundation for improved analysis of nanoscale structural features in materials that deviate from expected crystallographic arrangement using 4D-STEM.

Bruefach, Alexandra (ORCID:0000000209323477)↗