Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Beyond Binary: Automated PLC Memory Forensics through RGB Image Analysis and Deep Learning

The introduction of Industry 4.0 and the evolution of industrial control systems (ICS) to adopt Internet-based technologies enhanced productivity, but have inadvertently increased their vulnerability to cyber-based malicious attacks. When an ICS system is compromised, security analysts need to identify the root cause quickly to start the recovery process and develop mitigation strategies to safeguard against future instances. Memory forensics is critical in the analysis process to ascertain what occurred. To date, approaches to analyze the persistent memory in ICS devices are limited, and almost nonexistent for volatile memory. This paper proposes an automated methodology, COMA, for PLC memory dump analysis using computer vision and deep learning techniques. Specifically, COMA converts the sequences of bytes in a PLC memory dump to RGB pixels and creates a deep learning model that learns the underlying patterns and features of pre-labeled forensic artifacts in images and segments them into distinct regions. COMA then uses the trained model to automatically segment new memory images and extract forensic artifacts. We evaluate COMA on a Schneider Electric Modicon M221 PLC involving two cyber-based attack scenarios: (i) code injection and (ii) code modification. The empirical results show that COMA can successfully detect attack artifacts in memory dumps in both scenarios.

Asmar Awad, Rima↗

Detection of Esophageal Fiducial Marker Displacement During Radiation Therapy With a 2-dimensional On-board Imager: Analysis of Internal Margin for Esophageal Cancer

Purpose: To quantify the interfraction displacement of esophageal fiducial markers for primary esophageal cancer radiation therapy. Methods and Materials: Orthogonal 2-dimensional (2D) matching records fused to vertebrae were analyzed in clinically staged T1/2N0 esophageal cancer patients undergoing endoscopic clipping as fiducial metal markers. Displacement of the markers between the digitally reconstructed radiographs and on-board kilovoltage images during radiation therapy was analyzed according to direction and esophageal site. Results: Forty-four patients, with 81 markers (10 proximal, 42 middle, and 29 distal), underwent 367 2D matching sessions during radiation therapy. The mean (SD) absolute marker displacement was 0.26 (0.30) cm in the right–left (RL), 0.50 (0.39) cm in the superior–inferior (SI), and 0.24 (0.21) cm in the anterior–posterior (AP) direction. Displacement was significantly larger in the SI than in the RL and AP directions (P<.0001). In the SI direction, mean absolute displacements of the distal, middle, and proximal esophagus were 0.67 (0.45) cm, 0.42 (0.32) cm, and 0.36 (0.30) cm, respectively. Distal esophagus displacement was significantly larger than those of the middle and proximal esophagus (P<.0001). The estimated internal margin to cover 95% of the cases was 0.75 cm in the RL and AP directions. In the SI direction, the margin was 1.25 cm for the proximal and middle esophagus and 1.75 cm for the distal esophagus. Conclusions: The magnitude of interfraction displacement of esophageal clips was larger in the SI direction, particularly in the distal esophagus, but substantial displacement was observed in other directions and at other esophageal sites. It is practical to take estimated movements into account with internal margins, even if vertebrae-based 2D matching is performed.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Automated Programmable Logic Controller Memory Forensics Using RGB Image Analysis and Deep Learning

The introduction of Industry 4.0 and Internet-based technologies has enhanced industrial control system operations but have inadvertently increased their vulnerabilities to cyber attacks. When an industrial control system is compromised, security analysts need to identify the root cause quickly to start the recovery process and develop mitigation strategies. Memory forensics is critical in the incident analysis process to ascertain what occurred. Approaches for analyzing the persistent memory in industrial control devices are limited and almost nonexistent for volatile memory. This chapter proposes an automated methodology for programmable logic controller memory dump analysis using computer vision and deep learning techniques. The methodology converts the sequences of bytes in a programmable logic controller memory dump to red-green-blue pixels and employs a deep learning model that learns the underlying patterns and features of pre-labeled forensic artifacts in images and segments them into distinct regions. The trained model is employed to automatically segment new memory images and identify forensic artifacts. Evaluation of the methodology on a Schneider Electric Modicon M221 programmable logic controller under code injection and code modification attacks demonstrates its ability to detect attack artifacts in memory dumps.

Asmar Awad, Rima [ORNL] (ORCID:0000000233407742)↗

Image Analysis for Plug Bubbles in Horizontal Flow

Horizontal plug flow is different from horizontal slug flow in that relatively few small bubbles exist in plug flow, whereas slug flow is characterized by highly aerated liquid slugs and liquid films. While the nose position and nose propagation velocity of plug bubbles may provide physical insights in understanding the flow regime transition mechanism between the plug and slug flows, few systematic investigations on these parameters have been performed in previous research. In view of this, this paper presents the development of an image processing method for the purpose of (a) obtaining data for nose position and nose propagation velocity of plug bubbles and (b) benchmarking local four-sensor conductivity probe measurements of time-averaged bubble velocity and void fraction. (authors)

42 ENGINEERING↗

Optical image analysis for graphene layer detection: Enhanced green channel methodology

Graphene, a material of increasing research interest, requires accurate layer identification due to its sensitivity to layer count. Existing methods for graphene layer number identification are either time-consuming or of low accuracy, with high-accuracy methods often requiring expensive processes. This paper aims to address this challenge by proposing a cost-effective and efficient approach. Specifically, the current work highlights only the green channel—one of the three primary color channels (red, green, blue) that make up an optical image—from images of exfoliated graphene flakes for layer count identification. A linear regression is performed between pixel position and substrate green channel value, and this effect is subtracted from the entire optical image to mitigate background effects. By storing the range of green channel values for each type of flake (monolayer, bilayer, or tri-layer) based on a few images, we establish thresholds for identifying different types of layers in a particular setup. Additionally, our methodology allows for flexible threshold tuning using a single reference image, enabling adjustment to changes in detection setup such as illumination level, magnification, or microscope used. Finally, demonstrating high accuracy and flexibility, this methodology presents a suitable technique for graphene layer number identification without the need for large datasets or expensive instruments.

2D materials↗

Phases and interfaces from real space atomically resolved data: Physics-based deep data image analysis

Advances in electron and scanning probe microscopies have led to a wealth of atomically resolved structural and electronic data, often with ~1–10 pm precision. However, knowledge generation from such data requires the development of a physics-based robust framework to link the observed structures to macroscopic chemical and physical descriptors, including single phase regions, order parameter fields, interfaces, and structural and topological defects. Here, we develop an approach based on a synergy of sliding window Fourier transform to capture the local analog of traditional structure factors combined with blind linear unmixing of the resultant 4D data set. This deep data analysis is ideally matched to the underlying physics of the problem and allows reconstruction of the a priori unknown structure factors of individual components and their spatial localization. We demonstrate the principles of this approach using a synthetic data set and further apply it for extracting chemical and physically relevant information from electron and scanning tunneling microscopy data. Furthermore, this method promises to dramatically speed up crystallographic analysis in atomically resolved data, paving the road toward automatic local structure–property determinations in crystalline and quasi-ordered systems, as well as systems with competing structural and electronic order parameters.

36 MATERIALS SCIENCE↗

Image analysis measurements of particle coefficient of restitution for coal gasification applications

New robust Lagrangian computational fluid dynamic (CFD) models are powerful tools that can be used to study the behavior of a diverse population of coal particle sizes, densities, and mineral compositions in entrained gasifiers. By using this approach, the responses of the particles impacting the wall were characterized over a range of velocities (1 to 8 m/s) and incident angles (90 to 20°). Within CFD models, the kinematic coefficient of restitution is the boundary condition defining the particle wall behavior. Four surfaces were studied to simulate the physical conditions of different entrained-flow gasification particle–surface collision scenarios: 1) a flat metal plate 2) a low viscosity silicon adhesive, 3) a high viscosity silicon adhesive, and 4) adhered particles on a flat metal plate with Young's modulus of elasticity ranging from 0.9 to 190 GPa. Entrained flow and drop experiments were conducted with granular coke particles, polyethylene beads and polystyrene pellets. The particle normal and tangential coefficients of restitution were measured using high speed imaging and particle tracking. The measured coefficients of restitution were observed to have a strong dependence on the rebound angles for most of the data. Suitable algebraic expressions for the normal and the tangential component of the coefficient of restitution were developed based upon ANOVA analysis. These expressions quantify the effect of normalized Young's modulus, particle equancy, and relative velocity on the coefficient of restitution. The coefficient of restitution did not have a strong dependence on the particle velocity over the range considered as long as the velocity was above the critical velocity. However, strong correlations were found between the degree of equancy of the particles and the mean coefficient of restitution such that the coefficient of restitution decreased for smaller particle equancies. It was concluded that the degree of equancy and the normalized Young's modulus should be considered in applications such as gasification and other cases involving the impact of non-spherical particles and complex surfaces. Sliding was observed when particles impacted on oblique surfaces; however, the resulting effects were within the range of measurement uncertainties.

01 COAL, LIGNITE, AND PEAT↗

Training calibration-based counterfactual explainers for deep learning models in medical image analysis

The rapid adoption of artificial intelligence methods in healthcare is coupled with the critical need for techniques to rigorously introspect models and thereby ensure that they behave reliably. This has led to the design of explainable AI techniques that uncover the relationships between discernible data signatures and model predictions. In this context, counterfactual explanations that synthesize small, interpretable changes to a given query while producing desired changes in model predictions have become popular. This under-constrained, inverse problem is vulnerable to introducing irrelevant feature manipulations, particularly when the model’s predictions are not well-calibrated. Hence, in this paper, we propose the TraCE (training calibration-based explainers) technique, which utilizes a novel uncertainty-based interval calibration strategy for reliably synthesizing counterfactuals. Given the wide-spread adoption of machine-learned solutions in radiology, our study focuses on deep models used for identifying anomalies in chest X-ray images. Using rigorous empirical studies, we demonstrate the superiority of TraCE explanations over several state-of-the-art baseline approaches, in terms of several widely adopted evaluation metrics. Our findings show that TraCE can be used to obtain a holistic understanding of deep models by enabling progressive exploration of decision boundaries, to detect shortcuts, and to infer relationships between patient attributes and disease severity.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Imaging analysis of nuclear antiviral factors through direct detection of incoming adenovirus genome complexes

Recent studies involving several viral systems have highlighted the importance of cellular intrinsic defense mechanisms through nuclear antiviral proteins that restrict viral propagation. These factors include among others components of PML nuclear bodies, the nuclear DNA sensor IFI16, and a potential restriction factor PHF13/SPOC1. For several nuclear replicating DNA viruses, it was shown that these factors sense and target viral genomes immediately upon nuclear import. In contrast to the anticipated view, we recently found that incoming adenoviral genomes are not targeted by PML nuclear bodies. Here we further explored cellular responses against adenoviral infection by focusing on specific conditions as well as additional nuclear antiviral factors. In line with our previous findings, we show that neither interferon treatment nor the use of specific isoforms of PML nuclear body components results in co-localization between incoming adenoviral genomes and the subnuclear domains. Furthermore, our imaging analyses indicated that neither IFI16 nor PHF13/SPOC1 are likely to target incoming adenoviral genomes. Thus our findings suggest that incoming adenoviral genomes may be able to escape from a large repertoire of nuclear antiviral mechanisms, providing a rationale for the efficient initiation of lytic replication cycle. - Highlights: • Host nuclear antiviral factors were analyzed upon adenovirus genome delivery. • Interferon treatments fail to permit PML nuclear bodies to target adenoviral genomes. • Neither Sp100A nor B targets adenoviral genomes despite potentially opposite roles. • The nuclear DNA sensor IFI16 does not target incoming adenoviral genomes. • PHF13/SPOC1 targets neither incoming adenoviral genomes nor genome-bound protein VII.

60 APPLIED LIFE SCIENCES↗

Satellite image analysis for surveillance, vegetation and climate change

Recently, many studies have provided abundant evidence to show the trend of tree mortality is increasing in many regions, and the cause of tree mortality is associated with drought, insect outbreak, or fire. Unfortunately, there is no current capability available to monitor vegetation changes, and correlate and predict tree mortality with CO{sub 2} change, and climate change on the global scale. Different survey platforms (methods) have been used for forest management. Typical ground-based forest surveys measure tree stem diameter, species, and alive or dead. The measurements are low-tech and time consuming, but the sample sizes are large, running into millions of trees, covering large areas, and spanning many years. These field surveys provide powerful ground validation for other survey methods such as photo survey, helicopter GPS survey, and aerial overview survey. The satellite imagery has much larger coverage. It is easier to tile the different images together, and more important, the spatial resolution has been improved such that close to or even higher than aerial survey platforms. Today, the remote sensing satellite data have reached sub-meter spatial resolution for panchromatic channels (IKONOS 2: 1 m; Quickbird-2: 0.61 m; Worldview-2: 0.5 m) and meter spatial resolution for multi-spectral channels (IKONOS 2: 4 meter; Quickbird-2: 2.44 m; Worldview-2: 2 m). Therefore, high resolution satellite imagery can allow foresters to discern individual trees. This vital information should allow us to quantify physiological states of trees, e.g. healthy or dead, shape and size of tree crowns, as well as species and functional compositions of trees. This is a powerful data resource, however, due to the vast amount of the data collected daily, it is impossible for human analysts to review the imagery in detail to identify the vital biodiversity information. Thus, in this talk, we will discuss the opportunities and challenges to use high resolution satellite imagery and machine learning theory to monitor tree mortality at the level of individual trees.

47 OTHER INSTRUMENTATION↗

SU-E-I-30: Image Analysis in Ultrasonography for Diagnosis of Sjoegren's Syndrome Using Dual-Tree Complex Wavelet Transform

Purpose: Sjoegren's syndrome (SS) is an autoimmune disease invading mainly salivary and lacrimal glands. Ultrasonography is used for an initial and non-invasive examination of this disease. However, the ultrasonography diagnosis tends to lack in objectivity and depends on the operator's skills. The purpose of this study is to propose a computer-aided diagnosis (CAD) system for SS based on a dual-tree complex wavelet transform (DT-CWT) and machine learning. Methods: The subjects of this study were 174 patients suspected of having SS at Nagasaki University Hospital and examined with ultrasonography of the parotid glands. Out of these patients, 77 patients were diagnosed with SS by sialography. A region of interest (ROI) of 128 × 128 pixels was set within the parotid gland that was indicated by a dental radiologist. The DT-CWT was applied to the images in the ROI and every image was decomposed into 72 sub-images of the real and imaginary components in six different resolution levels and six orientations. The statistical features of the sub-image were calculated and used as data input for the support vector machine (SVM) classifier for the detection of SS. A ten-fold cross-validation was employed to verify the Resultof SVM. The accuracy of diagnosis was compared by a CAD system with a human observer performance. Results: The sensitivity, specificity, and accuracy in the detection of SS were 95%, 86%, and 91% through our CAD system respectively, while those by a human observer were 84%, 81%, and 83% respectively. Conclusion: The proposed computer-aided diagnosis system for Sjoegren's syndrome in ultrasonography based on dual-tree complex wavelet transform had a better performance than a human observer.

60 APPLIED LIFE SCIENCES↗

Let’s Unleash the Network Judgment: A Self-Supervised Approach for Cloud Image Analysis

Accurate cloud type identification and coverage analysis are crucial in understanding the Earth’s radiative budget. Traditional computer vision methods rely on low-level visual features of clouds for estimating cloud coverage or sky conditions. Several handcrafted approaches have been proposed; however, scope for improvement still exists. Newer deep neural networks (DNNs) have demonstrated superior performance for cloud segmentation and categorization. These methods, however, need expert engineering intervention in the preprocessing steps—in the traditional methods—or human assistance in assigning cloud or clear sky labels to a pixel for training DNNs. Such human mediation imposes considerable time and labor costs. We present the application of a new self-supervised learning approach to autonomously extract relevant features from sky images captured by ground-based cameras, for the classification and segmentation of clouds. We evaluate a joint embedding architecture that uses self-knowledge distillation plus regularization. We use two datasets to demonstrate the network’s ability to classify and segment sky images—one with ~85,000 images collected from our ground-based camera and another with 400 labeled images from the WSISEG database. We find that this approach can discriminate full-sky images based on cloud coverage, diurnal variation, and cloud base height. Additionally, it semantically segments the cloud areas without labels. The approach shows competitive performance in all tested tasks, suggesting a new alternative for cloud characterization.

54 ENVIRONMENTAL SCIENCES↗

The State of the Art in Root System Architecture Image Analysis Using Artificial Intelligence: A Review

Roots are essential for acquiring water and nutrients to sustain and support plant growth and anchorage. However, they have been studied less than the aboveground traits in phenotyping and plant breeding until recent decades. In modern times, root properties such as morphology and root system architecture (RSA) have been recognized as increasingly important traits for creating more and higher quality food in the “Second Green Revolution”. To address the paucity in RSA and other root research, new technologies are being investigated to fill the increasing demand to improve plants via root traits and overcome currently stagnated genetic progress in stable yields. Artificial intelligence (AI) is now a cutting-edge technology proving to be highly successful in many applications, such as crop science and genetic research to improve crop traits. A burgeoning field in crop science is the application of AI to high-resolution imagery in analyses that aim to answer questions related to crops and to better and more speedily breed desired plant traits such as RSA into new cultivars. This review is a synopsis concerning the origins, applications, challenges, and future directions of RSA research regarding image analyses using AI.

59 BASIC BIOLOGICAL SCIENCES↗