Deep learning predicts microbial interactions from self-organized spatiotemporal patterns
Not Available
59 BASIC BIOLOGICAL SCIENCES↗
SEARCH · Engineering Papers
Results for “Microscopy imaging technology”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Machine Learning Based Software Package for Reproducible Data Analysis for Electron Microscopy
Advances in hardware and computation technologies are enabling large hyperspectral imaging during Electron Microscopy (EM), resulting in datasets being produced at rapidly increasing spatial and temporal resolutions. This presents exciting opportunities for microstructure analysis, but also poses great challenges in data analysis. Under this STTR program, QuesTek Innovations LLC, a leader in the field of integrated computational materials engineering (ICME), collaborated with Lawrence Livermore National Laboratory and Argonne National Laboratory. The team developed an open-source machine learning (ML) powered tool for EM data analysis of multiple systems and data types, and collected EM data for ML model development using the cutting-edge PicoProbe equipment at Argonne National Laboratory.
Lin, Yu↗
Morphotype-resolved characterization of microalgal communities in a nutrient recovery process with ARTiMiS flow imaging microscopy
Microalgae-driven nutrient recovery represents a promising technology for phosphorus removal from wastewater while simultaneously generating biomass that can be valorized to offset treatment costs. As full-scale processes come online, system parameters including biomass composition must be carefully monitored to optimize performance and prevent culture crashes. In this study, flow imaging microscopy (FIM) was leveraged to characterize microalgal community composition in near real-time at a full-scale municipal wastewater treatment plant (WWTP) in Wisconsin, USA, and population and morphotype dynamics were examined to identify relationships between water chemistry, biomass composition, and system performance. Two FIM technologies, FlowCam and ARTiMiS, were evaluated as monitoring tools. ARTiMiS provided a more accurate estimate of total system biomass, and estimates derived from particle area as a proxy for biovolume yielded better approximations than particle counts. Deep learning classification models trained on annotated image libraries demonstrated equivalent performance between FlowCam and ARTiMiS, and convolutional neural network (CNN) classifiers proved significantly more accurate when compared to feature table-based dense neural network (DNN) models. Across a two-year study period, Scenedesmus spp. appeared most important for phosphorus removal, and were negatively impacted by elevated temperatures and increase in nitrite/nitrate concentrations. Chlorella and Monoraphidium also played an important role in phosphorus removal. For both Scenedesmus and Chlorella, smaller morphological types were more often associated with better system performance, whereas larger morphotypes likely associated with stress response(s) correlated with poor phosphorus recovery rates. Furthermore, these results demonstrate the potential of FIM as a critical technology for high-resolution characterization of industrial microalgal processes.
59 BASIC BIOLOGICAL SCIENCES↗
FLIMJ: An open-source ImageJ toolkit for fluorescence lifetime image data analysis
In the field of fluorescence microscopy, there is continued demand for dynamic technologies that can exploit the complete information from every pixel of an image. One imaging technique with proven ability for yielding additional information from fluorescence imaging is Fluorescence Lifetime Imaging Microscopy (FLIM). FLIM allows for the measurement of how long a fluorophore stays in an excited energy state, and this measurement is affected by changes in its chemical microenvironment, such as proximity to other fluorophores, pH, and hydrophobic regions. This ability to provide information about the microenvironment has made FLIM a powerful tool for cellular imaging studies ranging from metabolic measurement to measuring distances between proteins. The increased use of FLIM has necessitated the development of computational tools for integrating FLIM analysis with image and data processing. To address this need, we have created FLIMJ, an ImageJ plugin and toolkit that allows for easy use and development of extensible image analysis workflows with FLIM data. Built on the FLIMLib decay curve fitting library and the ImageJ Ops framework, FLIMJ offers FLIM fitting routines with seamless integration with many other ImageJ components, and the ability to be extended to create complex FLIM analysis workflows. Building on ImageJ Ops also enables FLIMJ’s routines to be used with Jupyter notebooks and integrate naturally with science-friendly programming in, e.g., Python and Groovy. We show the extensibility of FLIMJ in two analysis scenarios: lifetime-based image segmentation and image colocalization. We also validate the fitting routines by comparing them against industry FLIM analysis standards.
47 OTHER INSTRUMENTATION↗
Randomized Algorithms for Scientific Computing (RASC)
Randomized algorithms have propelled advances in artificial intelligence (AI) and represent a foundational research area in advancing AI for Science. Future advancements in DOE Office of Science priority areas such as climate science, astrophysics, fusion, advanced materials, combustion, and quantum computing all require randomized algorithms for surmounting challenges of complexity, robustness, and scalability. Advances in data collection and numerical simulation have changed the dynamics of scientific research and motivate the need for randomized algorithms. For instance, advances in imaging technologies such as X-ray ptychography, electron microscopy, electron energy loss spectroscopy, or adaptive optics lattice light-sheet microscopy collect hyperspectral imaging and scattering data in terabytes, at breakneck speed enabled by state-of-the-art detectors. The data collection is exceptionally fast compared with its analysis. Likewise, advances in high-performance architectures have made exascale computing a reality and changed the economies of scientific computing in the process. Floating-point operations that create data are essentially free in comparison with data movement. Thus far, most approaches have focused on creating faster hardware. Ironically, this faster hardware has exacerbated the problem by making data still easier to create. Under such an onslaught, scientists often resort to heuristic deterministic sampling schemes (e.g., low-precision arithmetic, sampling every nth element) and sacrifice potentially valuable accuracy. Dramatically better results can be achieved via randomized algorithms, reducing the data size as much as or more than naive deterministic subsampling can achieve, while retaining the high accuracy of computing on the full data set. By randomized algorithms we mean those algorithms that employ some form of randomness in internal algorithmic decisions to accelerate time to solution, increase scalability, or improve reliability. Examples include matrix sketching for solving large-scale least-squares problems (see Figure 1) and stochastic gradient descent for training machine learning models. We are not recommending heuristic methods but rather randomized algorithms that have certificates of correctness and probabilistic guarantees of optimality and near-optimality. Such approaches can be useful beyond acceleration, for example, in understanding how to avoid measure zero worst-case scenarios that plague methods such as QR matrix factorization.
97 MATHEMATICS AND COMPUTING↗
Atomic Force Microscopy-Based Force Spectroscopy and Multiparametric Imaging of Biomolecular and Cellular Systems
During the last three decades, a series of key technological improvements turned atomic force microscopy (AFM) into a nanoscopic laboratory to directly observe and chemically characterize molecular and cell biological systems under physiological conditions. In this work, we review key technological improvements that have established AFM as an analytical tool to observe and quantify native biological systems from the micro- to the nanoscale. Native biological systems include living tissues, cells, and cellular components such as single or complexed proteins, nucleic acids, lipids, or sugars. We showcase the procedures to customize nanoscopic chemical laboratories by functionalizing AFM tips and outline the advantages and limitations in applying different AFM modes to chemically image, sense, and manipulate biosystems at (sub)nanometer spatial and millisecond temporal resolution. We further discuss theoretical approaches to extract the kinetic and thermodynamic parameters of specific biomolecular interactions detected by AFM for single bonds and extend the discussion to multiple bonds. Finally, we highlight the potential of combining AFM with optical microscopy and spectroscopy to address the full complexity of biological systems and to tackle fundamental challenges in life sciences.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Contribution of advanced fluorescence nano microscopy towards revealing mitotic chromosome structure
The organization of chromatin into higherorder structures and its condensation process represent one of the key challenges in structural biology. This is important for elucidating several disease states. To address this long-standing problem, development of advanced imaging methods has played an essential role in providing understanding into mitotic chromosome structure and compaction. Amongst these are two fast evolving fluorescence imaging technologies, specifically fluorescence lifetime imaging (FLIM) and superresolution microscopy (SRM). FLIM in particular has been lacking in the application of chromosome research while SRM has been successfully applied although not widely. Furthermore, both these techniques are capable of providing fluorescence imaging with nanometer information. SRM or "nanoscopy" is capable of generating images of DNA with less than 50 nm resolution while FLIM when coupled with energy transfer may provide less than 20 nm information. Here, we discuss the advantages and limitations of both methods followed by their contribution to mitotic chromosome studies. Furthermore, we highlight the future prospects of how advancements in new technologies can contribute in the field of chromosome science.
59 BASIC BIOLOGICAL SCIENCES↗
Five-second STEM dislocation tomography for 300 nm thick specimen assisted by deep-learning-based noise filtering
Scanning transmission electron microscopy (STEM) is suitable for visualizing the inside of a relatively thick specimen than the conventional transmission electron microscopy, whose resolution is limited by the chromatic aberration of image forming lenses, and thus, the STEM mode has been employed frequently for computed electron tomography based three-dimensional (3D) structural characterization and combined with analytical methods such as annular dark field imaging or spectroscopies. However, the image quality of STEM is severely suffered by noise or artifacts especially when rapid imaging, in the order of millisecond per frame or faster, is pursued. Here we demonstrate a deep-learning-assisted rapid STEM tomography, which visualizes 3D dislocation arrangement only within five-second acquisition of all the tilt-series images even in a 300 nm thick steel specimen. The developed method offers a new platform for various in situ or operando 3D microanalyses in which dealing with relatively thick specimens or covering media like liquid cells are required.
47 OTHER INSTRUMENTATION↗
Measuring the metastatic potential of cancer cells
Cancer cells must secrete proteolytic enzymes to invade adjacent tissues and migrate to a new metastatic site. Urokinase (uPA) is a key enzyme related to metastasis in cancers of the lung, colon, gastric, uterine, breast, brain, and malignant melanoma. A NASA technology utilization project has combined fluorescence microscopy, image analysis, and flow cytometry, using fluorescent dyes, and urokinase-specific antibodies to measure uPA and abnormal DNA levels (related to cancer cell proliferation) inside the cancer cells. The project is focused on developing quantitative measurements to determine if a patient's tumor cells are actively metastasizing. If a significant number of tumor cells contain large amounts of uPA (esp. membrane-bound) then the post-surgical chemotherapy or radiotherapy can be targeted for metastatic cells that have already left the primary tumor. These analytical methods have been applied to a retrospective study of biopsy tissues from 150 node negative, stage 1 breast cancer patients. Cytopathology and image analysis has shown that uPA is present in high levels in many breast cancer cells, but not found in normal breast. Significant amounts of uPA also have been measured in glioma cell lines cultured from brain tumors. Commercial applications include new diagnostic tests for metastatic cells, in different cancers, which are being developed with a company that provides a medical testing service using flow cytometry for DNA analysis and hormone receptors on tumor cells from patient biopsies. This research also may provide the basis for developing a new 'magic bullet' treatment against metastasis using chemotherapeutic drugs or radioisotopes attached to urokinase-specific monoclonal antibodies that will only bind to metastatic cells.
Morrison, Dennis R.↗
Label-free functional analysis of root-associated microbes with dynamic quantitative oblique back-illumination microscopy
The increasing global demand for food, coupled with concerns about the environmental impact of synthetic fertilizers, underscores the urgency of developing sustainable agricultural practices. Nitrogen-fixing bacteria, known as diazotrophs, offer a potential solution by converting atmospheric nitrogen into bioavailable forms, reducing the reliance on synthetic fertilizers. However, a deeper understanding of their interactions with plants and other microbes is needed. In this study, we introduce a recently developed label-free 3D quantitative phase imaging technology called dynamic quantitative oblique back-illumination microscopy (DqOBM) to assess the functional dynamic activity of diazotrophs in vitro and in situ. Our experiments involved three different diazotrophs (Sinorhizobium meliloti, Azotobacter vinelandii, and Rahnella aquatilis) cultured on media with amendments of carbon and nitrogen sources. Over 5 days, we observed increased dynamics in nutrient-amended media. These results suggest that the observed bacterial dynamics correlate with their metabolic activity. Furthermore, we applied qOBM to visualize microbial dynamics within the root cap and elongation zone of Arabidopsis thaliana primary roots. This allowed us to identify distinct areas of microbial infiltration in plant roots without the need for fluorescent markers. Our findings demonstrate that DqOBM can effectively characterize microbial dynamics and provide insights into plant-microbe interactions in situ, offering a valuable tool for advancing our understanding of sustainable agriculture.
59 BASIC BIOLOGICAL SCIENCES↗
Soft X-Ray Tomography Has Evolved into a Powerful Tool for Revealing Cell Structures
Over the past three decades, soft X-ray tomography (SXT) has rapidly evolved from a proof-of-concept microscopy method into a high-throughput quantitative imaging modality. This advancement enables researchers to address central questions in cell biology. Despite its relatively short developmental period compared to light and electron microscopy, SXT has emerged as a powerful imaging technology. It enables measuring chemical changes in cellular organelles, analyzing three-dimensional structures of whole cells and creating digital cellular models to study cell motility. We discuss the unique nature of SXT to visualize cells without fixation or labeling, enabling quantitative analyses of organelle chemical composition. We explore SXT microscopes available worldwide, SXT segmentation software, and the diverse cell types studied using this technique. We conclude with emerging directions in SXT imaging, including a brief discussion of recent discoveries that are highly influential and likely to become integral to cell biology textbooks.
Weinhardt, Venera↗
Atomic Force Microscope Active Optical Probe for Single-Molecule Imaging and Time-Resolved Optical Spectroscopy (DOE SBIR Phase II/IIA Final Report)
Actoprobe LLC reports on the results of its DOE SBIR Phase II/IIA project on the development of Atomic Force Microscope Active Optical Probe for Single-Molecule Imaging and Time-Resolved Optical Spectroscopy. While chemistry science and technology greatly benefit from Atomic Force Microscopy in surface characterization, time-resolved chemical imaging on the single-molecule level lags far behind. Current scanning probe microscopy only obtains information about mechanical but not optical/chemical properties. To address this problem, the Actoprobe LLC research team has proposed a novel class of Atomic Force Microscopy probes, Ultra-Fast Pulsed Active Atomic Force Microscopy Optical Probes (UFP AAOPs), that will allow ultrafast time-resolved optical and chemical imaging at the nanoscale. As envisioned, these unique optical probes will perform the functions of conventional Atomic Force Microscopy probes and, in addition, will simultaneously provide chemical information about molecular scale interactions. This innovation is accomplished by integrating an ultrafast pulsed Quantum Dot laser source into an Atomic Force Microscopy probe. This report describes our progress with the fabrication of an ultrafast micrometer-size semiconductor laser, based on “artificial atoms” - Quantum Dots, integrated with an Atomic Force Microscopy probe. In this Phase II/IIA project, we have demonstrated the feasibility of the UFP AAOP concept by fabricating a first prototype of the UFP AAOP. The excellent performance of the probe has been proven in terms of AFM and optical spatial resolution through rigorous tests. The UFP AAOP provides pulses with less than 4 ps duration and higher than 11 GHz repetition rate, and spatial resolution better than 300 nm at 1240 nm wavelength. Technically, it is possible to reduce the pulse width to less than 1 ps and to improve lateral resolution to ~ 0.5 nm, which implies the potential capability for the probe to characterize chemical compounds with single-molecule resolution. The UFP AAOP fabrication procedure has been developed for wafer-scale production of multiple devices, with the yield of the process estimated to be lower than 1% with the limited fabrication capabilities and equipment available for use in the research project. However, using high-volume production tools and special GaAs processing equipment, the yield can be significantly improved, theoretically to ~ 50%. Finally, economic feasibility and scale-up manufacturing potential were analyzed for UFP AAOP and found to be very promising. In summary, the Actoprobe team has successfully demonstrated the feasibility of the UFP AAOP concept.
36 MATERIALS SCIENCE↗
Computer control of a scanning electron microscope for digital image processing of thermal-wave images
Using a recently developed technology called thermal-wave microscopy, NASA Lewis Research Center has developed a computer controlled submicron thermal-wave microscope for the purpose of investigating III-V compound semiconductor devices and materials. This paper describes the system's design and configuration and discusses the hardware and software capabilities. Knowledge of the Concurrent 3200 series computers is needed for a complete understanding of the material presented. However, concepts and procedures are of general interest.
Gilbert, Percy↗
Applications of ultrafast nano-spectroscopy and nano-imaging with tip-based microscopy
Innovation in microscopy has often been critical in advancing both fundamental science and technological progress. Notably, the evolution of ultrafast near-field optical nano-spectroscopy and nano-imaging has unlocked the ability to image at spatial scales from nanometers to ångströms and temporal scales from nanoseconds to femtoseconds. This approach revealed a plethora of fascinating light-matter states and quantum phenomena, including various species of polaritons, quantum phases, and complex many-body effects. This review focuses on the working principles and state-of-the-art development of ultrafast tip-enhanced and near-field microscopy, integrating diverse optical pump-probe methods across the terahertz (THz) to ultraviolet (UV) spectral ranges. It highlights their utility in examining a broad range of materials, including two-dimensional (2D), organic molecular, and hybrid materials. The review concludes with a spatio-spectral-temporal comparison of ultrafast nano-imaging techniques, both within already well-defined domains, and offering an outlook on future developments of ultrafast tip-based microscopy and their potential to address a wider range of materials.
Zhao, Zhichen [Tongji University, Shanghai (China)↗
Multi-beam X-ray ptychography using coded probes for rapid non-destructive high resolution imaging of extended samples
Imaging large areas of a sample non-destructively and with high resolution is of great interest for both science and industry. For scanning coherent X-ray diffraction microscopy, i. e., ptychography, the achievable scan area at a given spatial resolution is limited by the coherent photon flux of modern X-ray sources. Multibeam X-ray ptychography can improve the scanning speed by scanning the sample with several parallel mutually incoherent beams, e. g., generated by illuminating multiple focusing optics in parallel by a partially coherent beam. The main difficulty with this scheme is the robust separation of the superimposed signals from the different beams, especially when the beams and the illuminated sample areas are quite similar. We overcome this difficulty by encoding each of the probing beams with its own X-ray phase plate. This helps the algorithm to robustly reconstruct the multibeam data. We compare the coded multibeam scans to uncoded multibeam and single beam scans, demonstrating the enhanced performance on a microchip sample with regular and repeating structures.
47 OTHER INSTRUMENTATION↗
Super resolution for magneto-optical microscopy
Sub-diffraction limited magneto-optical microscopy, such as Kerr or Faraday effect microscopy, provide many advantages to fields of science and technology for measuring, or imaging, the magnetization structures and magnetization domains of materials. Disclosed is a method and system for performing sub-diffraction limited magneto-optic microscopy. The method includes positioning a microlens or microlens layer relative to a surface of a sample to image the surface of the sample, forming a photonic nanojet to probe the surface of the sample, and receiving light reflected by the surface of the sample or transmitted through the sample at an imaging sensor. The methods and associated systems and devices enable sub-diffraction limited imaging of magnetic domains at resolutions 2 to 8 times the classical diffraction limit.
te Velthuis, Suzanne Gabriëlle Everdine↗
Snapshot multifocal light field microscopy
Light field microscopy (LFM) is an emerging technology for high-speed wide-field 3D imaging by capturing 4D light field of 3D volumes. However, its 3D imaging capability comes at a cost of lateral resolution. In addition, the lateral resolution is not uniform across depth in the light field dconvolution reconstructions. To address these problems, here, we propose a snapshot multifocal light field microscopy (MFLFM) imaging method. The underlying concept of the MFLFM is to collect multiple focal shifted light fields simultaneously. We show that by focal stacking those focal shifted light fields, the depth-of-field (DOF) of the LFM can be further improved but without sacrificing the lateral resolution. Also, if all differently focused light fields are utilized together in the deconvolution, the MFLFM could achieve a high and uniform lateral resolution within a larger DOF. We present a house-built MFLFM system by placing a diffractive optical element at the Fourier plane of a conventional LFM. The optical performance of the MFLFM are analyzed and given. Both simulations and proof-of-principle experimental results are provided to demonstrate the effectiveness and benefits of the MFLFM. We believe that the proposed snapshot MFLFM has potential to enable high-speed and high resolution 3D imaging applications.
He, Kuan↗
Modulating Electron Beam–Sample Interactions in Imaging and Diffraction Modes by Dose Fractionation with Low Dose Rates
Abstract Technological opportunities are explored to enhance detection schemes in transmission electron microscopy (TEM) that build on the detection of single-electron scattering events across the typical spectrum of interdisciplinary applications. They range from imaging with high spatiotemporal resolution to diffraction experiments at the window to quantum mechanics, where the wave-particle dualism of single electrons is evident. At the ultimate detection limit, where isolated electrons are delivered to interact with solids, we find that the beam current dominates damage processes instead of the deposited electron charge, which can be exploited to modify electron beam-induced sample alterations. The results are explained by assuming that all electron scattering are inelastic and include phonon excitation that can hardly be distinguished from elastic electron scattering. Consequently, a coherence length and a related coherence time exist that reflect the interaction of the electron with the sample and change linearly with energy loss. Phonon excitations are of small energy (<100 meV), but they occur frequently and scale with beam current in the irradiated area, which is why we can detect their contribution to beam-induced sample alterations and damage.
47 OTHER INSTRUMENTATION↗