Engineering Papers⌕ Search

Engineering topics

Xu, Yichi

Publications and source records attributed to Xu, Yichi.

5 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Hierarchical deep reinforcement learning reveals a modular mechanism of cell movement

Time-lapse images of cells and tissues contain rich information about dynamic cell behaviours, which reflect the underlying processes of proliferation, differentiation and morphogenesis. However, we lack computational tools for effective inference. Here we exploit deep reinforcement learning (DRL) to infer cell–cell interactions and collective cell behaviours in tissue morphogenesis from three-dimensional (3D) time-lapse images. We use hierarchical DRL (HDRL), known for multiscale learning and data efficiency, to examine cell migrations based on images with a ubiquitous nuclear label and simple rules formulated from empirical statistics of the images. When applied to Caenorhabditis elegans embryogenesis, HDRL reveals a multiphase, modular organization of cell movement. Imaging with additional cellular markers confirms the modular organization as a novel migration mechanism, which we term sequential rosettes. Furthermore, HDRL forms a transferable model that successfully differentiates sequential rosettes-based migration from others. Our study demonstrates a powerful approach to infer the underlying biology from time-lapse imaging without prior knowledge.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2019

Modeling Cell Migration with Convolutional Neural Network and Deep Reinforcement Learning

Cell migration modeling is a longstanding biological challenge, which is regulated by a highly complex set of regulatory mechanisms at multiple scales in a developmental system. This study presents a generic framework for regulatory mechanisms discovery during cell migration. This framework uses convolutional neural networks and reinforcement learning to better study navigation rules and mechanisms during cell migration. This framework adopts a flexible model-free approach that directly takes raw images as the sensory input. It can better handle simulation scenarios that involve cell division during embryogenesis. Computational experiments also prove that this model achieves better performance than a previous model with a fully connected neural network.

Wang, Zi↗
DOE OSTI2018

An Observation Data Driven Simulation and Analysis Framework for Early Stage C. elegans Embryogenesis

Recent developments in cutting-edge live microscopy and image analysis provide a unique opportunity to systematically investigate individual cell’s dynamics as well as simulation-based hypothesis testing. After a summary of data generation and analysis in the observation and modeling efforts related to C. elegans embryogenesis, we develop a systematic approach to model the basic behaviors of individual cells. Next, we present our ideas to model cell fate, division, and movement using 3D time-lapse images within an agent-based modeling framework. Then, we summarize preliminary result and discuss efforts in cell fate, division, and movement modeling. Finally, we discuss the ongoing efforts and future directions for C. elegans embryo modeling, including an inferred developmental landscape for cell fate, a quasi-equilibrium model for cell division, and multi-agent, deep reinforcement learning for cell movement.

3D live images↗
DOE OSTI2018

Deep reinforcement learning of cell movement in the early stage of C.elegans embryogenesis

Motivation: Cell movement in the early phase of Caenorhabditis elegans development is regulated by a highly complex process in which a set of rules and connections are formulated at distinct scales. Previous efforts have demonstrated that agent-based, multi-scale modeling systems can integrate physical and biological rules and provide new avenues to study developmental systems. However, the application of these systems to model cell movement is still challenging and requires a comprehensive understanding of regulatory networks at the right scales. Recent developments in deep learning and reinforcement learning provide an unprecedented opportunity to explore cell movement using 3D time-lapse microscopy images. Results: We present a deep reinforcement learning approach within an agent-based modeling system to characterize cell movement in the embryonic development of C.elegans. Our modeling system captures the complexity of cell movement patterns in the embryo and overcomes the local optimization problem encountered by traditional rule-based, agent-based modeling that uses greedy algorithms. Here, we tested our model with two real developmental processes: the anterior movement of the Cpaaa cell via intercalation and the rearrangement of the superficial left-right asymmetry. In the first case, the model results suggested that Cpaaa’s intercalation is an active directional cell movement caused by the continuous effects from a longer distance (farther than the length of two adjacent cells), as opposed to a passive movement caused by neighbor cell movements. In the second case, a leader-follower mechanism well explained the collective cell movement pattern in the asymmetry rearrangement. These results showed that our approach to introduce deep reinforcement learning into agent-based modeling can test regulatory mechanisms by exploring cell migration paths in a reverse engineering perspective. Lastly, this model opens new doors to explore the large datasets generated by live imaging. Availability and implementation: Source code is available at https://github.com/zwang84/drl4cellmovement.

59 BASIC BIOLOGICAL SCIENCES↗