Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,711 records · Page 95

Data-driven materials research enabled by natural language processing and information extraction

Given the emergence of data science and machine learning throughout all aspects of society, but particularly in the scientific domain, there is increased importance placed on obtaining data. Data in materials science are particularly heterogeneous, based on the significant range in materials classes that are explored and the variety of materials properties that are of interest. This leads to data that range many orders of magnitude, and these data may manifest as numerical text or image-based information, which requires quantitative interpretation. The ability to automatically consume and codify the scientific literature across domains - enabled by techniques adapted from the field of natural language processing - therefore has immense potential to unlock and generate the rich datasets necessary for data science and machine learning. This review focuses on the progress and practices of natural language processing and text mining of materials science literature and highlights opportunities for extracting additional information beyond text contained in figures and tables in articles. Here, we discuss and provide examples for several reasons for the pursuit of natural language processing for materials, including data compilation, hypothesis development, and understanding the trends within and across fields. Current and emerging natural language processing methods along with their applications to materials science are detailed. We, then, discuss natural language processing and data challenges within the materials science domain where future directions may prove valuable.

36 MATERIALS SCIENCE↗

Super-Resolution Ptychography with Small Segmented Detectors

To overcome the spatial resolution limit set by aperture-limited diffraction in traditional scanning transmission electron microscopy, microscopists have developed ptychography enabled by iterative phase retrieval algorithms and high-dynamic-range pixel array detectors. Current detector designs are limited by the data rate off chip, so a high-pixel-count detector has a proportionally lower frame rate than the few-segment detectors used for differential phase contrast (DPC) imaging. This slower acquisition speed leads to heightened vulnerability to scan noise, drift, and potential sample damage. This creates opportunities for repurposing fast segmented detectors for ptychography by trading a reduction in reciprocal space pixels for an increase in real space pixels. Here, we explore a strategy of oversampling in real space and instead apply detector pixel upsampling during the reconstruction process. Further, we demonstrate the viability of achieving super-resolution ptychography on thin objects using only 2 × 2 detector pixels, surpassing the resolution of integrated DPC (iDPC) imaging. With optimization using simulated datasets and experiments on MoTe 2 /WSe 2 bilayer moiré superlattices, we achieved super-resolution ptychography reconstructions under rapid acquisition conditions (37.5 pA, 1 μs dwell time), yielding over 50% improvements in contrast and information limit compared to annular dark field and iDPC imaging on the same detectors.

2D materials↗

Special Nuclear Material Hold-up Measurement

Facilities that process special nuclear material (SNM) generally have a variety of equipment, shielding, and nearby radiation sources, which can pose challenges when performing nondestructive analysis (NDA) within the facility, as shown in Figure 1. In this figure, the left image features two individuals performing a holdup measurement of a large duct at a posting, utilizing a detector probe attached to a yardstick to reduce some aspect of the measurement uncertainty. Note that the distance to the holdup within the pipe from the posting cannot be accounted for. The right image similarly features several individuals guiding a holdup measurement of a ducting pipe several meters overhead, by attaching a detector probe to a long handle and lining that up with a posting on the outside of the pipe. SNM processing begets SNM holdup, and this difficulty with accurate NDA can result in unaccounted accumulation of SNM holdup within a process or area. Normal SNM processing operations can accumulate holdup within filters, pumps, pipes, ducts, other equipment, and facility support systems, as demonstrated by Figure 2. It is important for deactivation and decommissioning (D&D) gloveboxes and their ancillary equipment, material accountability, criticality safety, facility operations, waste management, radiation safety, and security to accurately characterize the location, composition, and quantity of this holdup to minimize these associated risks and potential diversion pathways. Current NDA techniques for assay of holdup are expensive, time consuming, and have high uncertainty.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Revealing the aging process of solid electrolyte interphase on SiOx anode

Abstract As one of the most promising alternatives to graphite negative electrodes, silicon oxide (SiO x ) has been hindered by its fast capacity fading. Solid electrolyte interphase (SEI) aging on silicon SiO x has been recognized as the most critical yet least understood facet. Herein, leveraging 3D focused ion beam-scanning electron microscopy (FIB-SEM) tomographic imaging, we reveal an exceptionally characteristic SEI microstructure with an incompact inner region and a dense outer region, which overturns the prevailing belief that SEIs are homogeneous structure and reveals the SEI evolution process. Through combining nanoprobe and electron energy loss spectroscopy (EELS), it is also discovered that the electronic conductivity of thick SEI relies on the percolation network within composed of conductive agents (e.g., carbon black particles), which are embedded into the SEI upon its growth. Therefore, the free growth of SEI will gradually attenuate this electron percolation network, thereby causing capacity decay of SiO x . Based on these findings, a proof-of-concept strategy is adopted to mechanically restrict the SEI growth via applying a confining layer on top of the electrode. Through shedding light on the fundamental understanding of SEI aging for SiO x anodes, this work could potentially inspire viable improving strategies in the future.

25 ENERGY STORAGE↗

Bayesian Active Learning for Scanning Probe Microscopy: From Gaussian Processes to Hypothesis Learning

Recent progress in machine learning methods and the emerging availability of programmable interfaces for scanning probe microscopes (SPMs) have propelled automated and autonomous microscopies to the forefront of attention of the scientific community. However, enabling automated microscopy requires the development of task-specific machine learning methods, understanding the interplay between physics discovery and machine learning, and fully defined discovery workflows. This, in turn, requires balancing the physical intuition and prior knowledge of the domain scientist with rewards that define experimental goals and machine learning algorithms that can translate these to specific experimental protocols. Here, we discuss the basic principles of Bayesian active learning and illustrate its applications for SPM. We progress from the Gaussian process as a simple data-driven method and Bayesian inference for physical models as an extension of physics-based functional fits to more complex deep kernel learning methods, structured Gaussian processes, and hypothesis learning. These frameworks allow for the use of prior data, the discovery of specific functionalities as encoded in spectral data, and exploration of physical laws manifesting during the experiment. Here, the discussed framework can be universally applied to all techniques combining imaging and spectroscopy, SPM methods, nanoindentation, electron microscopy and spectroscopy, and chemical imaging methods and can be particularly impactful for destructive or irreversible measurements.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Toward nanoscale molecular mass spectrometry imaging via physically constrained machine learning on co-registered multimodal data

Mass spectrometry imaging (MSI) plays a pivotal role in investigating the chemical nature of complex systems that underly our understanding in biology and medicine. Multiple fields of life science such as proteomics, lipidomics and metabolomics benefit from the ability to simultaneously identify molecules and pinpoint their distribution across a sample. However, achieving the necessary submicron spatial resolution to distinguish chemical differences between individual cells and generating intact molecular spectra is still a challenge with any single imaging approach. Here, we developed an approach that combines two MSI techniques, matrix-assisted laser desorption/ionization (MALDI) and time-of-flight secondary ion mass spectrometry (ToF-SIMS), one with low spatial resolution but intact molecular spectra and the other with nanometer spatial resolution but fragmented molecular signatures, to predict molecular MSI spectra with submicron spatial resolution. The known relationships between the two MSI channels of information are enforced via a physically constrained machine-learning approach and directly incorporated in the data processing. We demonstrate the robustness of this method by generating intact molecular MALDI-type spectra and chemical maps at ToF-SIMS resolution when imaging mouse brain thin tissue sections. This approach can be readily adopted for other types of bioimaging where physical relationships between methods have to be considered to boost the confidence in the reconstruction product.

97 MATHEMATICS AND COMPUTING↗

Cell Population–resolved Multiomics Atlas of the Developing Lung

The lung is a vital organ that undergoes extensive morphological and functional changes during postnatal development. To disambiguate how different cell populations contribute to organ development, we performed proteomic and transcriptomic analyses of four sorted cell populations from the lung of human subjects aged 0 to 8 years-old with a focus on early life. The cell populations analyzed included epithelial, endothelial, mesenchymal, and immune cells. Our results revealed distinct molecular signatures for each of the sorted cell populations that enable the description of molecular shifts occurring in these populations during post-natal development. Here, we confirmed that the proteome of the different cell populations was distinct regardless of age and identified functions specific to each population. We identified a series of cell population protein markers, including those located at the cell surface, that show differential expression and distribution on RNA in situ hybridization and immunofluorescence imaging. We validated the spatial distribution of AT1 and endothelial cell surface markers. Temporal analyses of the proteome of each of the four populations revealed processes modulated during postnatal development and disambiguating results obtained on whole tissue proteome. Finally, the proteome was compared to a transcriptomics survey performed on the same lung samples to evaluate processes under post-transcriptional control.

59 BASIC BIOLOGICAL SCIENCES↗

Comparison of atomized mass and crater volume in laser ablation

The extent and dynamics of laser ablation are typically studied using crater imaging or by invoking the relationship between atomic emission and the mass removed. The former is a static view of a dynamic process and requires the accumulation of multiple shots in one location. The latter is complex and not absolute without calibration of the optical system with a standard of spectral radiance. We measure the mass of the atomized plume by laser atomic-absorption spectroscopy at 2 µs without external mass calibration; mass uncertainty in laser-ablation atomic absorption spectroscopy (LA-AAS) results from uncertainties in line area fitting, tabulated oscillator strengths, and partition functions as well as a <10% underrepresentation of the mass due to treating the plasma as a single thermodynamic equilibrium. The LA-AAS-measured mass pertains to the atoms in the probed charge states and does not include condensed or molecular species. The ablation efficiency at 300 mbar of helium varies significantly between the two focusing conditions used. A comparison of crater-derived masses and LA-AAS masses suggests that more defocused ablation may result in significant redeposition of material in the crater, distorting the conclusions from drilling studies and crater imaging. More focused ablation conditions result in crater-derived masses that exceed those measured with LA-AAS and suggest melt expulsion or phase explosion.

Merten, Jonathan [Arkansas State University, Jones↗

High-speed x-ray phase contrast imaging and digital image correlation analysis of microscale shock response of an additively manufactured energetic material simulant

The performance of energetic materials subjected to dynamic loading significantly depends on their micro- and meso-scale structural morphology. The geometric versatility offered by additive manufacturing opens new pathways to tailor the performance of these materials. Additively manufactured energetic materials (AMEMs) have a wide range of structural characteristics with a hierarchy of length scales and process-inherent heterogeneities, which are hitherto difficult to precisely control. It is important to understand how these features affect AMEMs’ response under dynamic/shock loading. Therefore, temporally and spatially resolved measurements of both macroscopic behavior and micro- and meso-level processes influencing macroscopic behavior are required. In this paper, we analyze the shock compression response of an AMEM simulant loaded under several impact conditions and orientations. Furthermore, x-ray phase contrast imaging (PCI) is used to track features across the observed shock front and determine the linear shock velocity vs particle velocity equation of state, as well as to quantify the interior deformation fields via digital image correlation (DIC) analyses. Photon Doppler velocimetry is simultaneously used to measure the particle velocities of the specimens, which are consistent with those obtained from x-ray PCI. The DIC analyses provide an assessment of the average strain fields inside the material, showing that the average axial strain depends on the loading intensity and reaches as high as 0.23 for impact velocities up to 1.5 km/s. The overall results demonstrate the utility of x-ray PCI for probing “in-material” equation of state and interior strains associated with dynamic shock compression behavior of the AMEM simulant.

3D printing↗

Adaptive X-ray imaging with reinforcement learning

X-ray imaging is a powerful technique to scan samples in a variety of contexts including biological, environmental and materials science, but commonly requires a synchrotron light source to produce X-rays at sufficient intensity. As these facilities are expensive to operate, the available beam time is limited and always in high demand. Particularly if the illuminated samples are sparse, standard raster scanning methods can be time-consuming, with a majority of that time being spent on areas of the image that carry little information. To increase the efficiency and maximize the information gain for a given time budget, we split the scanning process into a series of steps where previous measurements are used to inform the decision making and adapt the exposure distribution at later stages of the sequence. We formulate this task as a reinforcement learning problem where the goal is to produce a sequence of exposure maps that maximize a predefined scalar metric. We demonstrate the potential of this approach in simulations where the adaptive illumination can accelerate the measurement process by up to an order of magnitude compared with standard raster scanning. Finally, we present the first results from deploying the trained agents on an X-ray fluorescence beamline at the Stanford Synchrotron Radiation Lightsource.

Reinforcement Learning↗

Why is the winner the best?

International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to investigating what can be learnt from these competitions. Do they really generate scientific progress? What are common and successful participation strategies? What makes a solution superior to a competing method? To address this gap in the literature, we performed a multi- center study with all 80 competitions that were conducted in the scope of IEEE ISBI 2021 and MICCAI 2021. Statistical analyses performed based on comprehensive descriptions of the submitted algorithms linked to their rank as well as the underlying participation strategies revealed common characteristics of winning solutions. These typically include the use of multi-task learning (63%) and/or multi-stage pipelines (61%), and a focus on augmentation (100%), im- age preprocessing (97%), data curation (79%), and post- processing (66%). The “typical” lead of a winning team is a computer scientist with a doctoral degree, five years of experience in biomedical image analysis, and four years of experience in deep learning. Two core general development strategies stood out for highly-ranked teams: the reflection of the metrics in the method design and the focus on analyzing and handling failure cases. According to the organizers, 43% of the winning algorithms exceeded the state of the art but only 11% completely solved the respective domain problem. The insights of our study could help researchers (1) improve algorithm development strategies when approaching new problems, and (2) focus on open research questions revealed by this work.

Eisenmann, Matthias↗

Physics-Informed and Data-Driven Prediction of Residual Stress in Three-Dimensional Machining

Efficient and reliable prediction of machining-induced residual stress (RS) is a key requirement for truly integrated computational materials engineering (ICME). Currently available process modeling approaches, including empirical, analytical, and numerical methodologies lack predictive power and require substantial calibration and validation data. Moreover, most model-based approaches consider only two-dimensional (2D) (i.e., orthogonal), cutting processes. Meanwhile, industrial processes such as milling, turning, and drilling are inherently three-dimensional (3D). The present work attempts to bridge the gap between 2D and 3D through careful consideration of the process physics, including geometric, kinematic, and size-effect constraints to realize robust prediction of how RS develops in 3D machining. Using a novel in-situ experimental technique and digital image correlation (DIC) to determine equivalent Hertzian contact widths, contact pressures, and friction coefficients, the proposed methodology leverages a discretized conversion algorithm that includes multi-pass shakedown effects. This paper presents a semi-analytical model to predict machining-induced RS in 3D turning operations, which are used representatively for 3D processes more generally. Rather than follow a ‘brute force’ 3D FEM approach or conduct countless experiments to train a purely data-driven machine learning algorithm, the proposed approach builds on previous 2D modeling work. Through careful consideration of the process physics, including complex geometry/kinematic considerations of 3D turning, the authors demonstrated an experimentally calibrated approach, as well as validation based on published RS data. Model predictions and previously published measurement data of RS depth profiles for turning of Inconel 718 were compared for a range of process parameters. Correlation between the proposed 3D model and validation data was found to be within the margin of experimental error for most conditions. The proposed model appears to capture the overall behavior of 3D RS depth profiles with acceptable accuracy, particularly the key metrics of near-surface stress, peak stress magnitude and location, as well as overall stress profile depth. This report presents a physics-informed, data-driven approach for efficient calibration of a 2D model for machining-induced RS through DIC analysis of in-situ characterized subsurface displacement fields.

42 ENGINEERING↗

Near-Field Imaging of Shallow Chemical Explosions in Granite Using Change Detection Methods with Surface and Borehole Seismic Data

Explosions detonated in geologic media damage it in various ways via processes that include vaporization, fracturing, crushing of interstitial pores, etc. Seismic waves interact with the altered media in ways that could be important to the discrimination, characterization, and location of the explosions. As part of the Source Physics Experiment, we acquired multiple pre- and post-explosion near-field seismic datasets and analyzed changes to seismic P-wave velocity. Our results indicate that the first explosion detonated in an intact media can cause fracturing and, consequently, a decrease in P-wave velocity. After the first explosion, subsequent detonations in the pre-damaged media have limited discernible effects. We hypothesize this is due to the stress-relief provided by a now pre-existing network of fractures into which gasses produced by the explosion migrate. We also see an overall increase in velocity of the damaged region over time, either due to a slow healing process or closing of the fractures by subsequent explosions.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Semi-automatic image annotation using 3D LiDAR projections and depth camera data

Efficient image annotation is necessary to utilize deep learning object recognition neural networks in nuclear safeguards, such as for the detection and localization of target objects like nuclear material containers (NMCs). This capability can help automate the inventory accounting of different types of NMCs within nuclear storage facilities. The conventional manual annotation process is labor-intensive and time-consuming, hindering the rapid deployment of deep learning models for NMC identifications. This paper introduces a novel semi-automatic method for annotating 2D images of nuclear material containers (NMCs) by combining 3D light detection and ranging (LiDAR) data with color and depth camera images collected from a handheld scan system. The annotation pipeline involves an operator manually marking new target objects on a LiDAR-generated map, and projecting these 3D locations to images, thereby automatically creating annotations from the projections. The semi-automatic approach significantly reduces manual efforts and the expertise in image annotation that is required to perform the task, allowing deep learning models to be trained on-site within a few hours. The paper compares the performance of models trained on datasets annotated through various methods, including semi-automatic, manual, and commercial annotation services. The evaluation demonstrates that the semi-automatic annotation method achieves comparable or superior results, with a mean average precision (mAP) above 0.9, showcasing its efficiency in training object recognition models. Additionally, the paper explores the application of the proposed method to instance segmentation, achieving promising results in detecting multiple types of NMCs in various formations.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Quantitative insights into the dislocation source behavior of twin boundaries suggest a new dislocation source mechanism

Pop-in statistics from nanoindentation with spherical indenters are used to determine the stress required to activate dislocation sources in twin boundaries (TBs) in copper and its alloys. The TB source activation stress is smaller than that needed for bulk single crystals, irrespective of the indenter size, dislocation density and stacking fault energy. Because an array of pre-existing Frank partial dislocations is present at a TB, we propose that dislocation emission from the TB occurs by the Frank partials splitting into Shockley partials moving along the TB plane and perfect lattice dislocations, both of which are mobile. The proposed mechanism is supported by recent high resolution transmission electron microscopy images in deformed nanotwinned (NT) metals and may help to explain some of the superior properties of nanotwinned metals (e.g. high strength and good ductility), as well as the process of detwinning by the collective formation and motion of Shockley partial dislocations along TBs.

36 MATERIALS SCIENCE↗

Dark fluxes from electromagnetic cascades

We study dark sector production in electromagnetic (EM) cascades. This problem requires accurate simulations of Standard Model (SM) and dark sector processes, both of which impact angular and energy distributions of emitted particles that ultimately determine flux predictions in a downstream detector. We describe the minimal set of QED processes which must be included to faithfully reproduce a SM cascade, and identify a universal algorithm to generate a dark sector flux given a Monte-Carlo simulation of a SM shower. We provide a new tool, "Image missing", which simulates EM cascades with associated dark vector production, and compare it against existing literature and “off the shelf” tools. The signal predictions at downstream detectors can strongly depend on the nontrivial interplay (and modelling) of SM and dark sector processes, in particular multiple Coulomb scattering and positron annihilation. We comment on potential impacts of these effects for realistic experimental setups.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Radiation Monitoring for Volatilized Zinc Contamination Using Gamma-Ray Imaging and Spectroscopy

Gamma-ray imaging is a tool that has grown in importance in the applications of non-destructive assay (NDA) for radioactive survey and analysis of nuclear facilities. Imaging techniques have shown great promise in providing valuable information involving radioactive waste management and contamination prevention. For the application studied in this work, 65 Zn has been identified as a radioactive contaminant during tritium extraction. Due to the volatile nature of 65 Zn under the pressure and temperature changes during extraction operations, 65 Zn can easily travel through components of the extraction system as vapor, making it difficult to trap. Previous research involving the development of a filtration system showed that the 65 Zn can be trapped, mitigating product contamination. However, during the extraction process, direct analysis of the equipment to confirm that zinc contamination is trapped in the filter and has not spread to other components is impractical. Here, in this situation, the need to assay the location of the contamination with little-to-no interference with operations is vital. In this work, we demonstrate the use of a commercialized 3D position-sensitive CdZnTe (CZT) gamma-ray imaging spectrometer to provide analysis of the 65 Zn contamination. Onsite measurements during an extraction process are studied to assess the location and migration of the 65 Zn. The results obtained from real-time glovebox monitoring demonstrate the feasibility of gamma-ray imaging for localizing the contamination and providing a preliminary qualitative assessment that is intended to be used in future work quantifying the contamination build-up and activity over time.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Asynchronous and Load-Balanced Union-Find for Distributed and Parallel Scientific Data Visualization and Analysis

We present a novel distributed union-find algorithm that features asynchronous parallelism and k-d tree based load balancing for scalable visualization and analysis of scientific data. Applications of union-find include level set extraction and critical point tracking, but distributed union-find can suffer from high synchronization costs and imbalanced workloads across parallel processes. In this study, we prove that global synchronizations in existing distributed union-find can be eliminated without changing final results, allowing overlapped communications and computations for scalable processing. We also use a k-d tree decomposition to redistribute inputs, in order to improve workload balancing. We benchmark the scalability of our algorithm with up to 1,024 processes using both synthetic and application data. Here, we demonstrate the use of our algorithm in critical point tracking and super-level set extraction with high-speed imaging experiments and fusion plasma simulations, respectively.

97 MATHEMATICS AND COMPUTING↗