Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Computational imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Computing water flow through complex landscapes – Part 2: Finding hierarchies in depressions and morphological segmentations

Depressions – inwardly draining regions of digital elevation models – present difficulties for terrain analysis and hydrological modeling. Analogous “depressions” also arise in image processing and morphological segmentation, where they may represent noise, features of interest, or both. Here we provide a new data structure – the depression hierarchy – that captures the full topologic and topographic complexity of depressions in a region. We treat depressions as networks in a way that is analogous to surface-water flow paths, in which individual sub-depressions merge together to form meta-depressions in a process that continues until they begin to drain externally. This hierarchy can be used to selectively fill or breach depressions or to accelerate dynamic models of hydrological flow. Complete, well-commented, open-source code and correctness tests are available on GitHub and Zenodo.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Image-Based Fracture Surface Defect Characterization Methods for Additively Manufactured Ti-6Al-4V Tested in Fatigue

Abstract Fatigue initiation in additively manufactured samples/parts often occurs at processed-induced defects such as lack-of-fusion (LoF), keyhole, or other morphological/microstructural defects that have unique characteristics and measurable qualities. Attempts at identifying and minimizing such defects have utilized optimized processing conditions along with in situ and ex situ characterization that includes metallography and/or X-ray computed tomography (XCT). This paper highlights the benefits of using fracture surface analyses to detect and quantify defects that may not be detected by metallography/XCT due to sectioning and resolution limits. In addition to using manual quantification of fatigue initiating LoF and keyhole defects on fracture surfaces, image-based machine learning using convolutional neural networks such as U-Net were also used to automate the process. Statistical analyses were used to identify the extreme cases of defects that initiated and accelerated fatigue and to model the distribution of defect size and shape characteristics to distinguish the type of defect. Initial results show agreement between trained machine learning models and ground truth data in defect segmentation, and the distributions of defect characteristics are distinguishable to particular process-induced defect types.

Materials Science↗
DOE OSTI2021

Energy-efficient Mott activation neuron for full-hardware implementation of neural networks

To circumvent the von Neumann bottleneck, substantial progress has been made towards in-memory computing with synaptic devices. However, compact nanodevices implementing non-linear activation functions are required for efficient full-hardware implementation of deep neural networks. Here, in this work, we present an energy-efficient and compact Mott activation neuron based on vanadium dioxide and its successful integration with a conductive bridge random access memory (CBRAM) crossbar array in hardware. The Mott activation neuron implements the rectified linear unit function in the analogue domain. The neuron devices consume substantially less energy and occupy two orders of magnitude smaller area than those of analogue complementary metal–oxide semiconductor implementations. The LeNet-5 network with Mott activation neurons achieves 98.38% accuracy on the MNIST dataset, close to the ideal software accuracy. We perform large-scale image edge detection using the Mott activation neurons integrated with a CBRAM crossbar array. Our findings provide a solution towards large-scale, highly parallel and energy-efficient in-memory computing systems for neural networks.

electrical and electronic engineering↗
DOE OSTI2023

Gumby: Quantifying multi-modal model resiliency

With the rise of cheap data and sensors, more use cases are emerging for multi-input models. Research has shown that including multiple data modalities can improve performance, suggesting that deep learning models can successfully learn to leverage complementary information from different modalities. However, this improved predictive power comes with unanticipated costs: additional inputs change model resiliency and expand the threat space for adversarial attacks. We first provide theoretical underpinnings for how adversarial success scales with input dimension. We then characterize the performance of a suite of multispectral deep learning models with different fusion approaches, quantify their relative reliance on different input bands, and evaluate their robustness to naturalistic and adversarial image corruptions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Identification of uncommon objects in containers

A system for identifying in an image an object that is commonly found in a collection of images and for identifying a portion of an image that represents an object based on a consensus analysis of segmentations of the image. The system collects images of containers that contain objects for generating a collection of common objects within the containers. To process the images, the system generates a segmentation of each image. The image analysis system may also generate multiple segmentations for each image by introducing variations in the selection of voxels to be merged into a segment. The system then generates clusters of the segments based on similarity among the segments. Each cluster represents a common object found in the containers. Once the clustering is complete, the system may be used to identify common objects in images of new containers based on similarity between segments of images and the clusters.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Computationally Efficient Multiscale Neural Networks Applied to Fluid Flow in Complex 3D Porous Media

Abstract The permeability of complex porous materials is of interest to many engineering disciplines. This quantity can be obtained via direct flow simulation, which provides the most accurate results, but is very computationally expensive. In particular, the simulation convergence time scales poorly as the simulation domains become less porous or more heterogeneous. Semi-analytical models that rely on averaged structural properties (i.e., porosity and tortuosity) have been proposed, but these features only partly summarize the domain, resulting in limited applicability. On the other hand, data-driven machine learning approaches have shown great promise for building more general models by virtue of accounting for the spatial arrangement of the domains’ solid boundaries. However, prior approaches building on the convolutional neural network (ConvNet) literature concerning 2D image recognition problems do not scale well to the large 3D domains required to obtain a representative elementary volume (REV). As such, most prior work focused on homogeneous samples, where a small REV entails that the global nature of fluid flow could be mostly neglected, and accordingly, the memory bottleneck of addressing 3D domains with ConvNets was side-stepped. Therefore, important geometries such as fractures and vuggy domains could not be modeled properly. In this work, we address this limitation with a general multiscale deep learning model that is able to learn from porous media simulation data. By using a coupled set of neural networks that view the domain on different scales, we enable the evaluation of large ( $$>512^3$$ > 512 3 ) images in approximately one second on a single graphics processing unit. This model architecture opens up the possibility of modeling domain sizes that would not be feasible using traditional direct simulation tools on a desktop computer. We validate our method with a laminar fluid flow case using vuggy samples and fractures. As a result of viewing the entire domain at once, our model is able to perform accurate prediction on domains exhibiting a large degree of heterogeneity. We expect the methodology to be applicable to many other transport problems where complex geometries play a central role.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Imaging nanoscale carrier, thermal, and structural dynamics with time-resolved and ultrafast electron energy-loss spectroscopy

Time-resolved and ultrafast electron energy-loss spectroscopy (EELS) is an emerging technique for measuring photoexcited carriers, lattice dynamics, and near-fields across femtosecond to microsecond timescales. When performed in either a specialized scanning transmission electron microscope or ultrafast electron microscope (UEM), time-resolved and ultrafast EELS can directly image charge carriers, lattice vibrations, and heat dissipation following photoexcitation or applied bias. Yet, recent advances in theoretical calculations and electron optics are often required to realize the full potential of ultrafast EEL spectrum imaging. Here, in this review, we present a comprehensive overview of the recent progress in the theory and instrumentation of time-resolved and ultrafast EELS. We begin with an introduction to the technique, followed by a physical description of the loss function. We outline approaches for calculating and interpreting ground-state and transient EEL spectra spanning low-loss plasmons to core-level excitations analogous to x-ray absorption. We then survey the current state of time-resolved and ultrafast EELS techniques beyond photon-induced near-field electron microscopy, highlighting abilities to image carrier and thermal dynamics. Finally, we examine future directions enabled by emerging technologies, including electron beam monochromation, in situ and operando cells, laser-free UEM, and high-speed direct electron detectors. These advances position time-resolved and ultrafast EELS as a critical tool for uncovering nanoscale dynamic processes in quantum materials and solar energy conversion devices.

Computational methods↗
DOE OSTI2022

Asphericity Can Cause Nonuniform Lithium Intercalation in Battery Active Particles

Uniform intercalation is desired to enable next-generation Li-ion batteries. While we expect nonuniformity in materials undergoing a phase change, single-phase intercalation materials such as nickel manganese cobalt oxide are believed to lithiate uniformly at the particle/electrolyte interface. However, recent imaging reveals nonuniform lithiation. Motivated by this discrepancy, we examine if aspherical particle shape can cause such nonuniformity since the conventional belief is based on spherical particle theory. We obtain real particle geometries using rapid lab-based X-ray computed tomography and subsequently perform physics-based calculations accounting for electrochemical reactions at the particle/electrolyte interface and lithium transport inside the particle bulk. The aspherical geometry breaks the symmetry and causes nonuniform reaction distribution. Such nonuniformity is exacerbated as the particle becomes more aspherical. We report the proposed mechanism represents a fundamental limit on achievable lithiation uniformity in aspherical particles in the absence of other mechanisms causing inhomogeneity, such as grain structure, nonuniform carbon-binder coating, etc.

25 ENERGY STORAGE↗
DOE OSTI2022

Inference for Nonparanormal Partial Correlation via Regularized Rank-Based Nodewise Regression

Abstract Partial correlation is a common tool in studying conditional dependence for Gaussian distributed data. However, partial correlation being zero may not be equivalent to conditional independence under non-Gaussian distributions. In this paper, we propose a statistical inference procedure for partial correlations under the high-dimensional nonparanormal (NPN) model where the observed data are normally distributed after certain monotone transformations. The NPN partial correlation is the partial correlation of the normal transformed data under the NPN model, which is a more general measure of conditional dependence. We estimate the NPN partial correlations by regularized nodewise regression based on the empirical ranks of the original data. A multiple testing procedure is proposed to identify the nonzero NPN partial correlations. The proposed method can be carried out by a simple coordinate descent algorithm for lasso optimization. It is easy-to-implement and computationally more efficient compared to the existing methods for estimating NPN graphical models. Theoretical results are developed to show the asymptotic normality of the proposed estimator and to justify the proposed multiple testing procedure. Numerical simulations and a case study on brain imaging data demonstrate the utility of the proposed procedure and evaluate its performance compared to the existing methods. Data used in preparation of this article were obtained from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Fourier method for 3-dimensional data fusion of X-ray Computed Tomography and ultrasound

X-ray Computed Tomography (CT) is essential for nondestructive inspection of many manufactured components but is susceptible to various forms of artifacts and noise. In particular, multi-detector row cone-beam CT systems can suffer from so called “cone-beam” artifacts and partial volume effects, particularly on planar edges at the periphery of the field of view in the cone angle dimension. Uni-directional ultrasonic testing methods generally have extremely accurate in-plane depth resolution but poorer lateral resolution due to physical and geometric constraints. This paper presents a novel technique called Computed Tomographic Fusion (CT-F) which uses three-dimensional Fourier filtering to combine x-ray cone-beam CT reconstructions and ultrasound data in the frequency space. The result is a single image with improved accuracy and quality. CT-F mitigates artifacts while allowing for rapid, accurate characterization of large three-dimensional CT volumes. Finally, using simulations and experiments, we demonstrate artifact reduction and edge contrast improvement in volumetric reconstructions.

42 ENGINEERING↗
DOE OSTI2020

An automated cluster surface scanning method for exploring reaction paths on metal-cluster surfaces

Metal-cluster surfaces present a wide variety of unique coordination environments. This complexity makes it difficult to manually probe the surface reactivity of such clusters. Here, we present a simple and automated method to systematically discover reaction pathways on cluster surfaces, based on the automated cluster surface scanning (ACSS) technique for mapping out potential energy surfaces. We showcase our method on 55-atom icosahedral Cu and Ag clusters, where we determine the activation energies of four elementary steps common in heterogeneous catalysis – hydrogen recombination (H* + H* → H 2 * + *), oxygen recombination (O* + O* → O 2 * + *), water formation (OH* + H* → H 2 O* + *), and CO oxidation (CO* + O* → CO 2 * + *) – with density functional theory calculations (DFT-PBE + D3). We show that the ACSS method requires significantly less human effort than the established manually performed climbing-image nudged elastic band (MP + CI-NEB) technique and locates transition states with comparable accuracy (root-mean-squared error of 0.10 eV) and similar computational cost. Rigorous sampling of the potential energy surface with the ACSS method allows one to locate all lowest-energy reaction pathways obtained via the MP+CI-NEB approach, as well as alternative pathways that one may have missed with the MP+CI-NEB approach due to the many possible pathways available on these clusters. The accuracy and efficiency afforded by the ACSS method could enable high-throughput exploration of the diverse reactivity of metal clusters.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Material coherence from trajectories via Burau eigenanalysis of braids

In this paper, we provide a numerical tool to study a material’s coherence from a set of 2D Lagrangian trajectories sampling a dynamical system, i.e., from the motion of passive tracers. We show that eigenvectors of the Burau representation of a topological braid derived from the trajectories have levelsets corresponding to components of the Nielsen–Thurston decomposition of the dynamical system. One can thus detect and identify clusters of space–time trajectories corresponding to coherent regions of the dynamical system by solving an eigenvalue problem. Unlike previous methods, the scalable computational complexity of our braid-based approach allows the analysis of large amounts of trajectories.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Quasiparticle Spectroscopy, Transport, and Magnetic Properties of Nb Films Used in Superconducting Qubits

Niobium thin films on silicon substrate used in the fabrication of superconducting qubits have been characterized using scanning and transmission electron microscopy, electrical transport, magnetization, the London penetration depth - based quasiparticle spectroscopy, and real-space real-time magneto-optical imaging. Here we study niobium films to provide an example of a comprehensive analytical set that may benefit superconducting circuits such as those used in quantum computers. The films have a superconducting transition temperature of T c = 9.35 K and a fairly clean superconducting gap. The estimated superfluid density is enhanced at intermediate temperatures. These observations are consistent with the recent theory of anisotropic strong-coupling superconductivity in Nb and indicate outstanding quality. However, the response to the magnetic field is complicated, exhibiting significantly irreversible behavior and insufficient heat dissipation (to a substrate), leading to thermomagnetic instabilities. This may present a challenge for further improvement of transmon quantum coherence. Possible mitigation strategies are discussed.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Imaging and controlling vortex dynamics in mesoscopic superconductor–normal-metal–superconductor arrays

Harnessing the properties of vortices in superconductors is crucial for fundamental science and technological applications; thus, it has been an ongoing goal to locally probe and control vortices. Here, we use a scanning probe technique that enables studies of vortex dynamics in superconducting systems by leveraging the resonant behavior of a raster-scanned, magnetic-tipped cantilever. This experimental setup allows us to image and control vortices, as well as extract key energy scales of the vortex interactions. Applying this technique to lattices of superconductor island arrays on a metal, we obtain a variety of striking spatial patterns that encode information about the energy landscape for vortices in the system. We interpret these patterns in terms of local vortex dynamics and extract the relative strengths of the characteristic energy scales in the system, such as the vortex-magnetic field and vortex-vortex interaction strengths, as well as the vortex chemical potential. We also demonstrate that the relative strengths of the interactions can be tuned and show how these interactions shift with an applied bias. The high degree of tunability and local nature of such vortex imaging and control not only enable new understanding of vortex interactions, but also have potential applications in more complex systems such as those relevant to quantum computing.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2020

A computational model tracks whole-lung Mycobacterium tuberculosis infection and predicts factors that inhibit dissemination

Mycobacterium tuberculosis (Mtb), the causative infectious agent of tuberculosis (TB), kills more individuals per year than any other infectious agent. Granulomas, the hallmark of Mtb infection, are complex structures that form in lungs, composed of immune cells surrounding bacteria, infected cells, and a caseous necrotic core. While granulomas serve to physically contain and immunologically restrain bacteria growth, some granulomas are unable to control Mtb growth, leading to bacteria and infected cells leaving the granuloma and disseminating, either resulting in additional granuloma formation (local or non-local) or spread to airways or lymph nodes. Dissemination is associated with development of active TB. It is challenging to experimentally address specific mechanisms driving dissemination from TB lung granulomas. Herein, we develop a novel hybrid multi-scale computational model, MultiGran, that tracks Mtb infection within multiple granulomas in an entire lung. MultiGran follows cells, cytokines, and bacterial populations within each lung granuloma throughout the course of infection and is calibrated to multiple non-human primate (NHP) cellular, granuloma, and whole-lung datasets. We show that MultiGran can recapitulate patterns of in vivo local and non-local dissemination, predict likelihood of dissemination, and predict a crucial role for multifunctional CD8+ T cells and macrophage dynamics for preventing dissemination.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Infrared-Fused Vision-Based Thermoregulation Performance Estimation for Personal Thermal Comfort-Driven HVAC System Controls

Thermal comfort is one of the primary factors influencing occupant health, well-being, and productivity in buildings. Existing thermal comfort systems require occupants to frequently communicate their comfort vote via a survey which is impractical as a long-term solution. Here, we present a novel thermal infrared-fused computer vision sensing method to capture thermoregulation performance in a non-intrusive and non-invasive manner. In this method, we align thermal and visible images, detect facial segments (i.e., nose, eyes, face boundary), and accordingly read the temperatures from the appropriate coordinates in the thermal image. We focus on the human face since it is often clearly visible to cameras and is not merged into a hot background (unlike hands). We use a regularized Gaussian Mixture model to track the thermoregulation changes over time and apply a heuristic algorithm to extract hot and cold indices. We present a personalized and a generalized comfort modeling method, selected based on the availability of the occupant historical indices measurements in a neutral environment, and use the time-series of the hot and cold indices to define corrections to HVAC system operations in the form of setpoint constraints. To evaluate the efficacy of our proposed approach in responding to thermal stimuli, we designed a series of controlled experiments to simulate exposure to cold and hot environments. While applying personalized modeling showed an acceptable average accuracy of 91.3%, the generalized model’s average accuracy was only 65.2%. This shows the importance of having access to physiological records in modeling and assessing comfort. We also found that individual differences should be considered in selecting the cooling and heating rates when some knowledge of the occupant’s overall thermal preference is available.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗