SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This framework was developed to ingest images/video images to train and test artificial neural network structures for image-based detection of fire and smoke. The code includes data preprocessing, model development, and testing. The framework is designed to work with RGB video imagery.
The modern aberration-corrected scanning electron microscopes have successfully achieved direct visualization of atomic columns with sub-angstrom resolution. With this significant progress, advanced image quantification and analysis is still at its early stages. In this work, we present the complete pathway for the metrology of atomic resolution STEM images. This includes: 1) tips for acquiring high-quality STEM images; 2) denoising and drift-correction for enhancing measurement accuracy; 3) obtaining initial atom positions; 4) indexing the atoms based on unit cell vectors; 4) quantifying the atom column positions with either 2D-gaussian single peak fitting or 5) multi-peak fitting routines for slightly overlapping atomic columns; 6) quantification of lattice distortion/strain within the crystal structures or at the defects/interfaces where the lattice periodicity is disrupted, and 7) some common methods to visualize and present the analysis. Furthermore, a simple self-developed free MATLAB app (EASY-STEM) with a graphical user interface (GUI) will be introduced that can help with the analysis of STEM images without the need for writing dedicated analysis code or software. The advanced data analysis methods presented here can be applied for the local quantification of defect relaxations, local structural distortions, local phase transformations, and non-centrosymmetry in a wide range of materials.
Abstract Accurate predictions of fluid flow, mass transport, and reaction rates critically impact the efficiency and reliability of subsurface exploration and sustainable use of subsurface resources. Quantitative dynamical sensing and imaging can play a pivotal role in the ability to make such predictions. Geophysical thermoacoustic technology has the potential to provide the aforementioned capabilities, since it builds upon the principle that electromagnetic and mechanical wave fields can be coupled through a thermodynamic process. In this letter, we present laboratory experiments featuring the efficacy of thermoacoustic imaging in the monitoring of preferential flow of water in porous media. Our laboratory experimental equipment can be readily packaged in a form factor that fits in a borehole, and the use of multiple acoustic transducers—which can be combined with volumetric coding techniques—has the potential to provide quasi‐real‐time imaging (0.5 Hz video rate) of regions in close proximity (a few meters) of an open field well.
Images of black holes encode both astrophysical and gravitational properties. Detecting highly lensed features in images can differentiate between these two effects. We present an accretion disk emission model coupled to the Adaptive Analytical Ray Tracing (AART) code that allows a fast parameter space exploration of black hole photon ring images produced from synchrotron emission from 10 to 670 GHz. As an application, we systematically study several disk models and compute their total flux density, average radii, and optical depth. The model parameters are chosen around fiducial values calibrated to general relativistic magnetohydrodynamic (GRMHD) simulations and observations of M87*. For the parameter space studied, we characterize the transition between optically thin and thick regimes and the frequency at which the first photon ring is observable. Our results highlight the need for careful definitions of photon ring radius in the image domain, as in certain models the highly lensed photon ring is dimmer than the direct emission at certain angles. We find that at low frequencies the ring radii are set by the electron temperature, while at higher frequencies the magnetic field strength plays a more significant role, demonstrating how multifrequency analysis can also be used to infer plasma parameters. Lastly, we show how our implementation can qualitatively reproduce multifrequency black hole images from GRMHD simulations when adding time variability to our disk model through Gaussian random fields. This approach provides a new method for simulating observations from the Event Horizon Telescope and the proposed Black Hole Explorer space mission.
Bats are notoriously difficult to study, therefore, identifying specific behavioral trends and the precise environmental conditions at the time of collision requires a monitoring solution that can reliably collect relevant data. To date, thermal infrared video surveillance has been extensively applied to study bats and has proven to be a powerful yet cumbersome tool. Current analytical approaches are time consuming because data processing data has not been fully automated. In the past, steps have been taken to record avian and bat activity in conjunction with complicated image processing techniques that separate species from other moving objects within the field of view (i.e. clouds and portions of the wind turbine). Once the videos are collected, the post-processing does not allow real time monitoring and identification, leading to a delay in both studying the behavior of these species and determining the effectiveness of any impact reduction strategy being studied. Moreover, object identification capability is lacking, thus limiting the usefulness of video data. To resolve these issues, we are using open source computer vision and machine learning techniques allowing for automatic detection of objects in real-time with the ability to correlate these objects with environmental variables and recording the flight paths of each object. The code has gone through five rounds of development with images used to train the models. This advancement allows for automated real-time data collection, identification, and tracking, thereby eliminating the need for long and tedious post-analysis processing of the videos. We will discuss the two open source and publicly available machine learning models developed within this scope of this work: 1) a binary model with a 97.5% accuracy in identifying the difference between an object and an empty scene, including wind turbine and clouds; and 2) a multiple classification model with the capability of identifying the type of object detected: bats (90% accuracy), birds (83% accuracy), insects (69% accuracy) and non-biological (99% accuracy).
Within the compressive sensing (CS) framework, one effective way to increase the likelihood of successful signal reconstruction is to employ random processes in the construction of the sensing matrix. This work presents a 3D holey cavity, with diverse frequency modes, to spectrally code, that is, randomize, the ultrasound wave fields. The simulated results show that the use of such a cavity enables imaging simple or complex targets, such as spheres or the letter E, by only a single transceiver—something that is not possible without the use of a coding structure like the cavity. The effect of noise on imaging results and the size of the targets on the first-order Born approximation (BA) are also investigated. Moreover, this study attempts to optimize the cavity, based on a single numerical metric, such as the sum of singular values (SSV) or mutual coherence (MC). Yet, it will be shown that neither of these metrics can consistently compare the norm-one imaging performance between two cavities of different materials or hole sizes. This leaves finding a quantitative metric for these kinds of optimizations an open problem.
MLExchange is a machine learning (ML) operations platform providing web user-interfaces (UIs) for data visualization and analysis pipelines at synchrotron facilities. Among these UIs is the segmentation app which helps synchrotron users utilize ML algorithms to automatically segment high-resolution scientific images with minimal manual annotation effort. In this work, we share code optimizations that significantly speed up the segmentation inference workflow of large data in short time. By optimizing the sequence of CPU-GPU data transfers and introducing CPU parallelization to key operations, we improve the per-device, per-image frame computational efficiency and observe close to 3×$$\times$$ speedup over the original segmentation inference workflow run time when utilizing a single GPU. Further adaptations enabling multi-GPU inference yield more than 40×$$\times$$ speedup with 100 GPUs compared to the optimized single GPU inference workflow. This acceleration of the segmentation inference workflow will provide MLExchange users with easy access to segmentation results with little wait time.
A coded aperture is used to demonstrate emission spectroscopy from multiple one-dimensional measurement locations simultaneously with a single camera. The coded aperture mask has several columns of periodic apertures, each with a unique spatial frequency. Light transmitted through all mask columns is detected through an imaging spectrometer. Dispersed light from the various mask columns overlaps on the spectrometer camera but is separated using Fourier-domain filtering using the known spatial frequencies of the mask. As the coded aperture is placed at an image plane, each Fourier-filtered spectrogram comes from a unique one-dimensional measurement location. This technique represents a significant increase in the amount of spatially and spectrally resolved emission data available using a single emission spectrometer and camera at the expense of some spatial resolution due to the Fourier filtering. This instrument is particularly useful for studying transient, non-repeating events. Megahertz-rate emission spectroscopy from five one-dimensional measurement locations is demonstrated with explosive fireballs using a single camera. Optical design parameters and instrument performance characteristics are discussed.
During the manufacturing of fuel cell and electrolyzer membranes and membrane electrode assemblies (MEAs), real-time, in-line, high-throughput optical-based quality monitoring methods are essential for detecting defects and monitoring thickness variations, thus improving the performance and increasing the durability of fuel cell and electrolyzer in the hydrogen industry. For the MEAs with very opaque coatings, optical transmission-based imaging has been developed and applied in the Roll-to-Roll system using a flashlight and a high-sensitivity CCD camera. We observed high signal-to-noise ratio images while the Roll-to-Roll system ran at 5 ft/min. The entire sample image could quickly be recovered from the discrete frames using customized Python codes for automatic frame cropping and stitching. We detected significant non-uniformities in our experimental MEAs specimen. For fuel cell and low-temperature electrolysis (LTE) transparent membranes, we used optical reflectance hyperspectral imaging with interference fringe-based thickness mapping. We set up a hyperspectral camera to measure various rolls of commercial membranes. The measurement results are analyzed to find the thickness distribution of each roll and to check for defects. Transmission and reflection imaging-based quality monitoring techniques demonstrated in this project can be widely used in the mass production environment to improve the production yield and performance of hydrogen devices.
The developed code is to be used to identify manufacturing defects of nuclear fuel kernels using image processing methods. Past batches of TRi-structural ISOtropic particle (TRISO) fuel kernels have on occasion contained fissures that result in the fuel batch not meeting specifications. The developed code automates the inspection process of these kernels. The code analyzes micrographs of TRISO fuel kernels and outputs a count of total kernels in the sample, a count of the number of defective particles in the sample, as well as processed images for more effective manual inspection. This information output will be used to help identify if defective kernels are present in a fuel batch and quantify the countable fissure fraction.
The fundamental nature of turbulent density fluctuations in standard Wendelstein 7-X (W7-X) stellarator discharges is investigated experimentally via phase contrast imaging (PCI) in combination with gyrokinetic simulations with the code GENE. We find that density fluctuations are ion-temperature-gradient-driven and radially localised in the outer half of the plasma. It is shown that the line-integrated PCI measurements cover the right range of wavenumbers and a favourable toroidal and poloidal location to capture some of the strongest density fluctuations in W7-X. Due to the radial localisation of fluctuations, measured wavenumber–frequency spectra exhibit a dominant phase velocity, which can be related to the E × B rotation velocity at the radial position of a well in the neoclassical radial electric field. The match is robust against variations of heating power and line-integrated density, which is partly due to the localisation of fluctuations and partly due to effects of the radial gradient in the E × B velocity profile on the wavenumber–frequency spectrum. The latter effect is studied with a newly built synthetic PCI diagnostic and global gyrokinetic simulations with GENE-3D.
Improvements in microscopy have enabled the acquisition of data at a scale that is difficult to process manually, making automated machine learning approaches to analyzing experimental images essential. In this project, we developed and applied machine learning (ML) workflows for atomic resolution scanning transmission electron microscopy (STEM) images. This development included improving both methodology as well as generating user-friendly codes. We developed machine learning architectures which, after training, automatically identify the location and types of defects throughout a material. We used these data to produce class-averaged images of 2D atomic coordinates with up to 0.3 pm precision, uncovering the structure and oscillations of long-range strain fields around point defects in WSe 2-2x Te 2x . We also resolved a long-standing problem in this field in the training of ML models, a lack of labeled experimental data, by developing a cycle-GAN that transformed simulated-generated labeled data into labeled data indistinguishable from experiment and therefore suitable for training. This removed the remaining parts of the ML data processing workflow where human intervention was still critical and therefore a bottleneck to working at scale. Codes have been developed and released for this full machine learning workflow. ML approaches to partially automate STEM acquisition were also developed. Finally we applied ML and other advanced data processing methods to several materials science problems in two-dimensional materials, including studying the evolution of hyperuniformity with defect concentration in WSe2, understanding phase transformations in transition metal dichalcogenides during in-situ heating in the STEM, and exploring how 2D interfaces transform from twisted into aligned structures.
As opposed to the Open Computing Language (OpenCL) programming model, in which host and device codes are generally written in different programming languages, SYCL can combine host and device codes for an application in a type-safe way to improve development productivity and performance portability. Hence, this report shows the experimental results of applying the SYCL programming model to medical imaging applications for a study on performance portability and programming productivity between OpenCL and SYCL. Rodinia is a widely used open-source benchmark suite for heterogeneous computing. We choose two medical imaging applications (Heart Wall and Particle Filter) in the benchmark suite, migrate the OpenCL implementations of the applications to the SYCL implementations, and evaluate their performance and productivity on Intel® microprocessors that contain a central processing unit (CPU) and an integrated graphics processing unit (GPU). The maturing SYCL compilers, which are based on a conformant implementation of the SYCL 1.2.1 Khronos specification, have been actively optimized for Intel® computing platforms. The experimental results are promising in terms of the raw performance and productivity. Although the SYCL implementation of the Heart Wall application does not execute successfully on a CPU, the SYCL implementations of the application can achieve comparable or better performance than the OpenCL implementation on Intel® integrated GPUs. For the Particle Filter application, the performance difference between the SYCL and OpenCL implementations is comparable on the GPUs for most cases, but the SYCL implementations are on average 4X faster than the OpenCL implementations on Intel® Xeon® CPUs. For programming productivity, we arguably use lines of code as a way to measure programming productivity in software. The SYCL programs reduce the lines of code of the OpenCL programs by 52% and 38% for the Heart Wall and Particle Filter, respectively. The results indicate that SYCL is a promising programming model for heterogeneous computing with the maturing compilers. We organize the remainder of the report as follows. Section II introduces the SYCL programming model, compares the major differences between an OpenCL program and a SYCL program, and describes the characteristics of the two applications. Section III describes the SYCL programming model in more details, and shows the SYCL implementation of a kernel function in the Particle Filter application as an example. In Section IV, we evaluate the performance of the applications on the CPUs and GPUs. Section V concludes the report.
Additive manufacturing (AM) is an emerging method for cost-efficient fabrication of nuclear reactor parts. AM of metallic structures for nuclear energy applications is currently based on laser powder bed fusion (LPBF) process, which can introduce internal material flaws, such as pores and anisotropy. Integrity of AM structures needs to be evaluated nondestructively because material flaws could lead to premature failures due to exposure to high temperature, radiation and corrosive environment in a nuclear reactor. Thermal tomography (TT) provides a capability for non-destructive evaluation of sub-surface defects in arbitrary size structures. Thermal tomography is a computational method for heat diffusion-based imaging of solids, which provides 3D visualization of data from flash thermography measurements. We investigate thermal tomography imaging and nondestructive evaluation of stainless steel and nickel super alloy metallic structures produced with laser powder bed fusion (LPBF) additive manufacturing (AM) process. Metallic structures produced with LPBF contain defects, and there are limited capabilities to evaluate these structures non-destructively. Thermal tomography reconstruction of 3D apparent spatial effusivity provides information about AM structure geometry and internal material flaws. We study performance of thermal tomography in imaging of metallic structures through COMSOL computer simulations of transient heat transfer, and through reconstruction of data obtained from experimental measurements. Reconstruction of internal defects is investigated using a stainless steel 316L specimen with flat bottom hole (FBH) indentations, and Inconel 718 plate produced with laser powder bed fusion (LPBF) method, which contains imprinted hemispherical shape low density regions containing non-sintered metallic powder. The FBH’s have the same sizes as the imprinted defects in the LPBF specimens, but offer better imaging contrast. Thermal tomography reconstructions provide visualizations of internal defects, and allow for estimation of their sizes and locations. Detection sensitivity of TT is limited by noises. We investigate separation of signal from noise in thermography images using several machine learning (ML) methods, including new spatio-temporal blind source separation (STBSS) and spatio-temporal sparse dictionary learning (STSDL) methods. Performance of the ML methods is benchmarked using thermography data obtained from imaging stainless steel 316L and Inconel 718 specimens produced LPBF method with imprinted calibrated porosity defects. The ML methods are ranked by F-score and execution runtime. Finally, we investigate TT of AM stainless steel 316L specimen with imprinted internal porosity defects using relatively low-cost, small form factor infrared (IR) camera based on uncooled micro bolometer detector. Sparse coding related K-means singular value decomposition (SVD) machine learning, image processing algorithms are developed to improve quality of TT images through removal of Additive white Gaussian noise without blurring the images. Following initial qualification of an AM component for deployment in a nuclear reactor, a compact TT can also be used for in-service nondestructive evaluation (NDE). With capability to perform in-service NDE of the AM component lifecycle, TT data can be used for development of a component digital twin.
These files collectively provide a comprehensive overview of the testing process, data analysis, and validation for the Twin Ocean Power device tested at the O.H. Hinsdale Wave Research Laboratory, supported by TEAMER funding. This resource includes an overview of power results for a series of 7 trials. The files included in this comprehensive overview include a comprehensive log sheet for each trial, a summary of all trials, and processing scripts for the raw data. It includes all raw data in .tsv and MATLAB compatible formats, an average power chart, angular velocity charts for each trial, trial metrics, and power output files. This resource includes images of the Twin Ocean Power Wave Energy Converter device components and movement during testing and video recordings of each trial.
We consider the problem of computing a sparse binary representation of an image. Given an image and an overcomplete, non-orthonormal basis, we aim to find a sparse binary vector indicating the minimal set of basis vectors that when added together best reconstruct the given input. We formulate this problem with an L 2 loss on the reconstruction error, and an L 0 loss on the binary vector enforcing sparsity. First, we solve the sparse representation QUBOs by solving them both on a D-Wave quantum annealer with Pegasus chip connectivity, as well as on the Intel Loihi 2 spiking neuromorphic processor using a stochastic Non-equilibrium Boltzmann Machine (NEBM). Second, using Quantum Evolution Monte Carlo with Reverse Annealing and iterated warm starting on Loihi 2 to evolve the solution quality from the respective machines. We demonstrate that both quantum annealing and neuromorphic computing are suitable for solving binary sparse coding QUBOs.
Aims.Traditional star-galaxy classification techniques often rely on feature estimation from catalogs, a process susceptible to introducing inaccuracies, thereby potentially jeopardizing the classification’s reliability. Certain galaxies, especially those not manifesting as extended sources, can be misclassified when their shape parameters and flux solely drive the inference. We aim to create a robust and accurate classification network for identifying stars and galaxies directly from astronomical images. Methods.The AutoSourceID-Classifier (ASID-C) algorithm developed for this work uses 32x32 pixel single filter band source cutouts generated by the previously developed AutoSourceID-Light (ASID-L) code. By leveraging convolutional neural networks (CNN) and additional information about the source position within the full-field image, ASID-C aims to accurately classify all stars and galaxies within a survey. Subsequently, we employed a modified Platt scaling calibration for the output of the CNN, ensuring that the derived probabilities were effectively calibrated, delivering precise and reliable results. Results.We show that ASID-C, trained on MeerLICHT telescope images and using the Dark Energy Camera Legacy Survey (DECaLS) morphological classification, is a robust classifier and outperforms similar codes such as SourceExtractor. To facilitate a rigorous comparison, we also trained an eXtreme Gradient Boosting (XGBoost) model on tabular features extracted by SourceExtractor. While this XGBoost model approaches ASID-C in performance metrics, it does not offer the computational efficiency and reduced error propagation inherent in ASID-C’s direct image-based classification approach. ASID-C excels in low signal-to-noise ratio and crowded scenarios, potentially aiding in transient host identification and advancing deep-sky astronomy.
Additive manufacturing (AM) is an emerging method for cost-efficient fabrication of nuclear reactor parts. AM of metallic structures for nuclear energy applications is currently based on laser powder bed fusion (LPBF) process, which can introduce internal material flaws, such as pores and anisotropy. Integrity of AM structures needs to be evaluated nondestructively because material flaws could lead to premature failures due to exposure to high temperature, radiation and corrosive environment in a nuclear reactor. Thermal tomography (TT) provides a capability for non-destructive evaluation of sub-surface defects in arbitrary size structures. We investigate TT of AM stainless steel 316L specimen with imprinted internal porosity defects using relatively low-cost, small form factor infrared (IR) camera based on uncooled micro bolometer detector. Sparse coding related K-means singular value decomposition (SVD) machine learning, image processing algorithms are developed to improve quality of TT images through removal of Additive white Gaussian noise without blurring the images. Following initial qualification of an AM component for deployment in a nuclear reactor, a compact TT can also be used for in-service nondestructive evaluation (NDE). With capability to perform in-service NDE of the AM component lifecycle, TT data can be used for development of a component digital twin. MIT research reactor (MITR) has been identified as a representative environment to perform investigation of feasibility of in-service NDE during shutdown. Preliminary study of radiation level in the MITR viewport, with geometric parameters potentially compatible with compact TT system, has been conducted.