Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “imaging and visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Understanding protein-complex assembly through grand canonical maximum entropy modeling

Inside a cell, heterotypic proteins assemble in inhomogeneous, crowded systems where the abundance of these proteins vary with cell types. While some protein complexes form putative structures that can be visualized with imaging, there are far more protein complexes that are yet to be solved because of their dynamic associations with one another. Nevertheless, it is possible to infer these protein complexes through a physical model. However, it is often not clear to physicists what kind of data from biology is necessary for such a modeling endeavor. Here, we aim to model these clusters of coarse-grained protein assemblies from multiple subunits through the constraints of interactions among the subunits and the chemical potential of each subunit. We obtained the constraints on the interactions among subunits from the known protein structures. We inferred the chemical potential that dictates the particle number distribution of each protein subunit from the knowledge of protein abundance from experimental data. Guided by the maximum entropy principle, we formulated an inverse statistical mechanical method to infer the distribution of particle numbers from the data of protein abundance as chemical potentials for a grand canonical multicomponent mixture. Using grand canonical Monte Carlo simulations, we captured a distribution of high-order clusters in a protein complex of succinate dehydrogenase with four known subunits. The complexity of hierarchical clusters varies with the relative protein abundance of each subunit in distinctive cell types such as lung, heart, and brain. When the crowding content increases, we observed that crowding stabilizes emergent clusters that do not exist in dilute conditions. We, therefore, proposed a testable hypothesis that the hierarchical complexity of protein clusters on a molecular scale is a plausible biomarker of predicting the phenotypes of a cell.

59 BASIC BIOLOGICAL SCIENCES↗

AutoEM

AutoEM is a software application intended to fully automate EM experiments. This automation includes incorporation of a Machine Learning component that will provide feedback analysis and experiment modification in a fully hands-free manner. AutoEM incorporates control of multiple devices, communication with external applications, and user visualization of images, device status, and ML feedback.

Hopkins, Derek [Pacific Northwest National Laborat↗

Towards AI Based Data Classification for Decision Making During Testing

During the development of high-consequence items, test systems should be capable of differentiating between test failures resulting from narrowly missing requirements versus those indicating potentially catastrophic faults. In many instances, classifying the data corresponds to simply identifying whether measured waveforms have approximately the anticipated shape. Cast in this light, the problem reduces to converting raw data into a form optimal for use with neural network classifiers. This manuscript investigates different means of representing raw data for image classification. Raw data plots and Short Time Fourier Transform (STFT) spectrograms are classified by both custom built, small-scale, Convolution Neural Networks (CNN) and open-source, multi-million parameter, pre-trained deep CNNs. In the case of time varying frequency content, the STFTs provide images with greater detail and can be accurately classified with simpler networks. This requires less memory and runs faster than classifying the raw data using the more sophisticated options—making STFTs optimal for applications with memory constraints. STFTs are not a panacea. In some cases the time-domain signal contains useful information that should not be discarded. Rather than using raw data or STFTs, the images can be constructed from both by using red and green channels of an RGB image to visualize the real and imaginary components of the transform, with the raw data occupying the blue channel.

97 MATHEMATICS AND COMPUTING↗

Raman Microscopy Analysis of Wyoming CarbonSAFE Pilot Well Thin Sections for Mineralogy and Organic Matter Characterization

Scanning confocal Raman microspectroscopy (RMS) was used to analyze thin sections for inorganic mineral content and for evaluation of organic material (OM). Thin sections were selected from a stratigraphic test well core in the Powder River Basin, Wyoming under the Wyoming CarbonSAFE project. The well was analyzed with a variety of rock and fluid characterization techniques to determine the feasibility of a commercial-scale CO2 storage site. RMS complements other analyses, including traditional petrography, SEM, porosity and permeability, and XRD For this aspect of the study, RMS is especially important in the evaluation of OM in sealing lithologies. At prospective geologic CO2 storage sites, it is imperative to assess the unconventional oil and gas potential of seals to ensure that any future development would not compromise the integrity of the seals. Whole-slide mineralogical surveys were performed on thin sections from various shale and sandstone formations. Surveys were analyzed with Direct Classical Least Squares to identify and quantify minerals. The location and concentration of minerals was color-coded and overlaid on optical images for visualization of the distribution of minerals. Dense hyperspectral Raman mapping of OM was performed on five thin sections. Eleven spectral parameters diagnostic of organic type and thermal maturity were used to train a Partial Least Squares (PLS) calibration against a set of artificially matured samples spanning the pre- to mid-oil window. The PLS was applied to the study set and a post-mature set. Additionally, the PLS was applied to each point in hyperspectral maps for visualization of trends in maturity across sample sets and discrimination of organic matter types within a given map. In inorganic surveys on thin sections, a total of 14 unique inorganic minerals were identified in Raman spectra including quartz, dolomite, calcite, hematite and anhydrite. Shale thin sections tended to be dominated by organic material. OM was often observed mixed with inorganic minerals. Sand- and mudstones were dominated by inorganic minerals. The PLS extrapolated the post-mature set to reflectances >1.2%. The study set ranged from very immature to postmature in the median of map fit-peak parameters. However, point maturity maps indicate that matrix OM in all study samples is immature and that discreet organic particles selected for mapping, which may be inertinites, bias medians towards more-mature. The work demonstrates the capabilities of RMS to perform both whole-slide mineralogy and OM analysis with applications to formation evaluation in oil & gas, carbon sequestration and mining. Here, analysis of sealing formations in the well indicates high levels of immature organic matter that would not be a viable target for future oil production that could compromise the CO2 storage site. The work brings together diverse disciplines from geology and petrography to analytical chemistry, big data and microscopy.

Myers, Grant↗

Imaging system and method for enhanced visualization of near surface vascular structures

A sub-dermal structure visualization system and method is disclosed. The system may use an illumination module including: a near-infrared (NIR) light source adapted to substantially uniformly illuminate an imaged area including sub-dermal regions thereof with NIR light; and a first optical system including at least one optical element for controlling at least one of spectral and polarization properties of the NIR light prior to illuminating the imaged area. An imaging module rejects unwanted signals from an imaged area while passing desired optical signals that are to be received by an image acquisition module. The desired optical signals can comprise a vein visualization signal to assist in visualizing a vascular structure below a skin layer of a patient.

Demos, Stavros G.↗

Information-Theoretic Exploration of Multivariate Time-Varying Image Databases

Modern scientific simulations produce very large datasets, making interactive exploration of such data computationally prohibitive. An increasingly common data reduction technique is to store visualizations and other data extracts in a database. The Cinema project is one such approach, storing visualizations in an image database for post hoc exploration and interactive image-based analysis. This work focuses on developing efficient algorithms that can quantify various types of multivariate dependencies existing within multi-variable datasets. It applies specific mutual information measures for the quantification of salient regions from multivariate image data. Here, using such information measures, the opacity of the images is modulated so that the salient regions are automatically highlighted and the domain scientists can interactively explore the most relevant regions for scientific discovery.

97 MATHEMATICS AND COMPUTING↗

Pressure Drop with Moving Contact Lines and Dynamic Contact Angles in a Hydrophobic Round Minichannel: Visualization via Synchrotron X-ray Imaging and Verification of Experimental Correlations

In hydrophobic mini- and microchannels, slug flow with moving contact lines is typically generated under various two-phase flow conditions. There is a significant pressure drop in this flow pattern with moving contact lines, which is closely related to the dynamic contact angles. Researchers have investigated dynamic contact angles experimentally for decades, but due to the limitations of visualization techniques, these experiments have typically been conducted in low Weber number regions (We < 10 –3 ). In this study, we clearly visualized the dynamic contact angles of a liquid slug in high Weber number regions (10 –3 < We <1) via synchrotron X-ray imaging with high temporal (~1000 fps) and spatial (~ 2 μm/pixel) resolutions. We precisely measured the pressure drop with moving contact lines in a hydrophobic minichannel (inner diameter = 1.018 mm). On the basis of our experimental data, we verified previous correlations for dynamic contact angles and explored the relationship between pressure drop with moving contact lines and dynamic contact angles.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Smartphone application for visualizing building air leakage

Annually, unwanted air leakage through building envelopes accounts for 4 quads of energy consumption in the United States, which translates to about 10% of total building energy consumption. Locating and sealing leakage sites is crucial fordecreasing building energy consumption. Smartphones are ubiquitous and contain sophisticated cameras and highperformance processors that could be employed to visualize air leakage using the background-oriented schlieren imaging technique, making leak detection cheaper and easier. This technique requires a textured and high-contrast background such as a brick or concrete masonry unit wall, a building air leak that has a temperature difference compared with the ambient air, and an imaging system. This work focuses on using smartphones as the imaging system to visualize air leakages. The paper discusses application development and the results of testing to determine leakage visualization performance as a function of leak temperature. The results show that leaks with a temperature difference greater than 16°C compared with the ambient air temperature were visualized using existing smartphones.

Boudreaux, Philip [ORNL] (ORCID:0000000229564665)↗

In situ tumor model for longitudinal in silico imaging trials

Abstract Objective.In this article, we introduce a computational model for simulating the growth of breast cancer lesions accounting for the stiffness of surrounding anatomical structures.Approach.In our model, ligaments are classified as the most rigid structures while the softer parts of the breast are occupied by fat and glandular tissues As a result of these variations in tissue elasticity, the rapidly proliferating tumor cells are met with differential resistance. It is found that these cells are likely to circumvent stiffer terrains such as ligaments, instead electing to proliferate preferentially within the more yielding confines of the breast’s soft topography. By manipulating the interstitial tumor pressure in direct proportion to the elastic constants of the tissues surrounding the tumor, this model thus creates the potential for realizing a database of unique lesion morphology sculpted by the distinctive topography of each local anatomical infrastructure. We modeled the growth of simulated lesions within volumes extracted from fatty breast models, developed by Graffet alwith a resolution of 50μm generated with the open-source and readily available Virtual Imaging Clinical Trials for Regulatory Evaluation (VICTRE) imaging pipeline. To visualize and validate the realism of the lesion models, we leveraged the imaging component of the VICTRE pipeline, which replicates the siemens mammomat inspiration mammography system in a digital format. This system was instrumental in generating digital mammogram (DM) images for each breast model containing the simulated lesions.Results.By utilizing the DM images, we were able to effectively illustrate the imaging characteristics of the lesions as they integrated with the anatomical backgrounds. Our research also involved a reader study that compared 25 simulated DM regions of interest (ROIs) with inserted lesions from our models with DM ROIs from the DDSM dataset containing real manifestations of breast cancer. In general the simulation time for the lesions was approximately 2.5 hours, but it varied depending on the lesion’s local environment.Significance.The lesion growth model will facilitate and enhance longitudinal in silico trials investigating the progression of breast cancer.

Engineering↗

Designing Unmanned Aerial Survey Monitoring Program to Assess Floating Litter Contamination

Monitoring marine contamination by floating litter can be particularly challenging since debris are continuously moving over a large spatial extent pushed by currents, waves, and winds. Floating litter contamination have mostly relied on opportunistic surveys from vessels, modeling and, more recently, remote sensing with spectral analysis. This study explores how a low-cost commercial unmanned aircraft system equipped with a high-resolution RGB camera can be used as an alternative to conduct floating litter surveys in coastal waters or from vessels. The study compares different processing and analytical strategies and discusses operational constraints. Collected UAS images were analyzed using three different approaches: (i) manual counting (MC), using visual inspection and image annotation with object counts as a baseline; (ii) pixel-based detection, an automated color analysis process to assess overall contamination; and (iii) machine learning (ML), automated object detection and identification using state-of-the-art convolutional neural network (CNNs). Our findings illustrate that MC still remains the most precise method for classifying different floating objects. ML still has a heterogeneous performance in correctly identifying different classes of floating litter; however, it demonstrates promising results in detecting floating items, which can be leveraged to scale up monitoring efforts and be used in automated analysis of large sets of imagery to assess relative floating litter contamination.

Almeida, Sílvia (ORCID:0000000320636826)↗

Fully Integrated Ultra-thin Intraoperative Micro-imager for Cancer Detection Using Upconverting Nanoparticles

Abstract Purpose Intraoperative detection and removal of microscopic residual disease (MRD) remain critical to the outcome of cancer surgeries. Today’s minimally invasive surgical procedures require miniaturization and surgical integration of highly sensitive imagers to seamlessly integrate into the modern clinical workflow. However, current intraoperative imagers remain cumbersome and still heavily dependent on large lenses and rigid filters, precluding further miniaturization and integration into surgical tools. Procedures We have successfully engineered a chip-scale intraoperative micro-imager array—without optical filters or lenses—integrated with lanthanide-based alloyed upconverting nanoparticles (aUCNPs) to achieve tissue imaging using a single micro-chip. This imaging platform is able to leverage the unique optical properties of aUCNPs (long luminescent lifetime, high-efficiency upconversion, no photobleaching) by utilizing a time-resolved imaging method to acquire images using a 36-by-80-pixel, 2.3 mm $$\times$$ × 4.8 mm silicon-based electronic imager micro-chip, that is, less than 100-µm thin. Each pixel incorporates a novel architecture enabling automated background measurement and cancellation. We have validated the performance, spatial resolution, and the background cancellation scheme of the imaging platform, using resolution test targets and mouse prostate tumor sample intratumorally injected with aUCNPs. To demonstrate the ability to image MRD, or tumor margins, we evaluated the imaging platform in visualizing a single-cell thin section of the injected prostate tumor sample. Results Tested on USAF resolution targets, the imager is able to achieve a resolution of 71 µm. We have also demonstrated successful background cancellation, achieving a signal-to-background ratio of 8 when performing ex vivo imaging on aUCNP-injected prostate tumor sample, improved from originally 0.4. The performance of the imaging platform on single-cell layer sections was also evaluated and the sensor achieved a signal-to-background ratio of 4.3 in resolving cell clusters with sizes as low as 200 cells. Conclusion The imaging system proposed here is a scalable chip-scale ultra-thin alternative for bulky conventional intraoperative imagers. Its novel pixel architecture and background correction scheme enable visualization of microscopic-scale residual disease while remaining completely free of lenses and filters, achieving an ultra-miniaturized form factor—critical for intraoperative settings.

59 BASIC BIOLOGICAL SCIENCES↗

Correlative single-cell hard X-ray computed tomography and X-ray fluorescence imaging

Abstract X-ray computed tomography (XCT) and X-ray fluorescence (XRF) imaging are two non-invasive imaging techniques to study cellular structures and chemical element distributions, respectively. However, correlative X-ray computed tomography and fluorescence imaging for the same cell have yet to be routinely realized due to challenges in sample preparation and X-ray radiation damage. Here we report an integrated experimental and computational workflow for achieving correlative multi-modality X-ray imaging of a single cell. The method consists of the preparation of radiation-resistant single-cell samples using live-cell imaging-assisted chemical fixation and freeze-drying procedures, targeting and labeling cells for correlative XCT and XRF measurement, and computational reconstruction of the correlative and multi-modality images. With XCT, cellular structures including the overall structure and intracellular organelles are visualized, while XRF imaging reveals the distribution of multiple chemical elements within the same cell. Our correlative method demonstrates the feasibility and broad applicability of using X-rays to understand cellular structures and the roles of chemical elements and related proteins in signaling and other biological processes.

59 BASIC BIOLOGICAL SCIENCES↗

Optical Imaging for Machine Vision [Slides]

This slide deck is intended for proper specification and procurement of cameras and (thin) lenses for machine vision applications. This will include equations that allow one to calculate image size, field of view, depth of field, and length of extension tubes required to focus the image. This requires knowledge of the camera sensor, lens, distance to imaged object, and visual acuity.

42 ENGINEERING↗

How “hot” are hotspots: Statistically localizing the high-activity areas on soil and rhizosphere images

The topic of microbial hotspots in soil requires not only visualizing their spatial distribution and biochemical analyses, but also statistical approaches to identify these hotspots and separate them from the surrounding activities (background). We hypothesized that each hotspot type (e.g. enzyme activities in the rhizosphere, root exudation, localization of herbicide accumulation) is a result of local process driven by biotic and/or abiotic factors, and the process rates in the hotspots are much faster than those in the soil background. We further hypothesized that the background and hotspot activities in soil belong to different statistical distributions. Consequently, hotspot determination should be based on statistical separation of activities significantly higher than the background. We analyzed for the statistical distributions of grey values on three groups of published images: 1) 14 C images of carbon input by roots into the rhizosphere, 2) 14 C glyphosate accumulation in the plant, and 3) zymogram of leucine aminopeptidase activity in rooted soil. The two Gaussian distributions were fit (the first representing the background, the second the hotspots) to the distribution of grey values in the images, the parameters (means and standard deviations, SD) of the fitted distributions were calculated, and the background was removed. Thus, we identified hotspots as areas outside of the Mean+2SD image intensity (corresponding to the upper ~ 2.5% of activity, being over 97.5% of background values) and finally, visualized images of solely hotspot locations. Finally, these results were compared with previously used decisions on hotspot intensity thresholding (i.e. Top-25% and 17 standard thresholding approaches in ImageJ) and discussed the advantages of the Mean+2SD as well as Mean+3SD approaches. These advantages include: i) simple unification of the thresholding approach for several imaging methods with various principles of activity distribution, ii) identification of hotspots with various activity levels, iii) analysis of “time-specific” hotspots in temporal sequences of images. Compared with 17 standard thresholding methods, we concluded that objectively elucidating and separating the hotspots should be based on statistical distribution analysis, e.g. using the Mean+2SD or Mean+3SD approaches. Furthermore, this simple Mean+2SD approach delivered suitable results for three groups of images and so, helps to understand the processes responsible for the highest activities and elucidate hotspots.

59 BASIC BIOLOGICAL SCIENCES↗

Classification of Cloud Particle Imagery and Thermodynamics (COCPIT): A New Databasing Tool for the Characterization of Cloud Particle Images Captured During DOE Field Campaigns

The Department of Energy for decades has explored the earth system and atmosphere through research and deployment of in-situ and remote sensing platforms during field campaigns. Among these datasets exists a vast supply of cloud particle images that provide visual insight into the complex microphysics in the clouds that span our globe. The millions of images collected over decades of deployments provides a unique opportunity to further our understanding of our atmosphere down to the crystal size. This work over the past 5 years has sought to organize these images into digestible datasets that can then be used by scientists to further our understanding of microphysics. A machine learning model was developed that categorizes over 1.5 million images across 11 weather events with over 90% accuracy according to particle type. The database was then extended to include dimensional characteristics of the particle as well as co-location of environmental properties, such as temperature and water content. Then, to initialize the connection between these data and our understanding of how crystals form and grow, weather research and forecasting simulations were run to generate the growth histories of the classified crystals. This research culminates with 2 databases per event: (1) a database of all classified crystals and their dimensional and environmental properties and (2) simulated growth histories of each crystal. Finally, a user interface was created to allow researchers to explore data statistics.

54 ENVIRONMENTAL SCIENCES↗

Gamma-Ray Imaging to Monitor Accumulating Holdup

Over time, nuclear materials can accumulate in process equipment and keeping track of such material is of interest to many stakeholder communities including safeguards, process monitoring, criticality safety, and radiological safety. Passive gamma-ray imaging provides a visual and quantitative tool that can be applied to this problem, allowing one to determine the amount of material present from the images. In this work we emulate the accumulation of highly enriched uranium (HEU) in a large rectangular stainless-steel duct by stacking 5, 27 × 50 cm2 cards, each of which has approximately 11 g of 235U in oxide form distributed across its surface, behind each other. A series of images were collected using a coded-aperture gamma-ray imager, starting with a single card, adding a second card, etc. Long integrations were collected to allow evaluating the performance of the approach as a function of integration time. The images are analyzed using first principles to determine the amount of material in each image. The results are compared to the known amount of material in each configuration, and as a function of time. The analysis includes a first-principles error propagation and to further evaluate the uncertainty, a boot-strap sampling approach is also applied to the data. The work offers a proof of concept for unattended monitoring of uranium holdup with a quantitative gamma-ray imaging technique.

Ziock, Klaus-Peter↗

Reduced volume of diabetic pancreatic islets in rodents detected by synchrotron X-ray phase-contrast microtomography and deep learning network

The pancreatic islet is a highly structured micro-organ that produces insulin in response to rising blood glucose. Here we develop a label-free and automatic imaging approach to visualize the islets in situ in diabetic rodents by the synchrotron radiation X-ray phase-contrast microtomography (SRμCT) at the ID17 station of the European Synchrotron Radiation Facility. The large-size images (3.2 mm × 15.97 mm) were acquired in the pancreas in STZ-treated mice and diabetic GK rats. Each pancreas was dissected by 3000 reconstructed images. The image datasets were further analysed by a self-developed deep learning method, AA-Net. All islets in the pancreas were segmented and visualized by the three-dimension (3D) reconstruction. After quantifying the volumes of the islets, we found that the number of larger islets (=>1500 μm 3 ) was reduced by 2-fold (wt 1004 ± 94 vs GK 419 ± 122, P < 0.001) in chronically developed diabetic GK rat, while in STZ-treated diabetic mouse the large islets were decreased by half (189 ± 33 vs 90 ± 29, P < 0.001) compared to the untreated mice. Our study provides a label-free tool for detecting and quantifying pancreatic islets in situ. It implies the possibility of monitoring the state of pancreatic islets in vivo diabetes without labelling.

59 BASIC BIOLOGICAL SCIENCES↗