Skip to main content
placeholder image

Interactive medical image segmentation via a point-based interaction

Journal Article


Abstract


  • Due to low tissue contrast, irregular shape, and large location variance, segmenting the objects from different medical imaging modalities (e.g., CT, MR) is considered as an important yet challenging task. In this paper, a novel method is presented for interactive medical image segmentation with the following merits. (1) Its design is fundamentally different from previous pure patch-based and image-based segmentation methods. It is observed that during delineation, the physician repeatedly check the intensity from area inside-object to outside-object to determine the boundary, which indicates that comparison in an inside-out manner is extremely important. Thus, the method innovatively models the segmentation task as learning the representation of bi-directional sequential patches, starting from (or ending in) the given central point of the object. This can be realized by the proposed ConvRNN network embedded with a gated memory propagation unit. (2) Unlike previous interactive methods (requiring bounding box or seed points), the proposed method only asks the physician to merely click on the rough central point of the object before segmentation, which could simultaneously enhance the performance and reduce the segmentation time. (3) The method is utilized in a multi-level framework for better performance. It has been systematically evaluated in three different segmentation tasks, including CT kidney tumor, MR prostate, and PROMISE12 challenge, showing promising results compared with state-of-the-art methods.

Publication Date


  • 2021

Citation


  • Zhang, J., Shi, Y., Sun, J., Wang, L., Zhou, L., Gao, Y., & Shen, D. (2021). Interactive medical image segmentation via a point-based interaction. Artificial Intelligence in Medicine, 111. doi:10.1016/j.artmed.2020.101998

Scopus Eid


  • 2-s2.0-85097336855

Web Of Science Accession Number


Volume


  • 111

Abstract


  • Due to low tissue contrast, irregular shape, and large location variance, segmenting the objects from different medical imaging modalities (e.g., CT, MR) is considered as an important yet challenging task. In this paper, a novel method is presented for interactive medical image segmentation with the following merits. (1) Its design is fundamentally different from previous pure patch-based and image-based segmentation methods. It is observed that during delineation, the physician repeatedly check the intensity from area inside-object to outside-object to determine the boundary, which indicates that comparison in an inside-out manner is extremely important. Thus, the method innovatively models the segmentation task as learning the representation of bi-directional sequential patches, starting from (or ending in) the given central point of the object. This can be realized by the proposed ConvRNN network embedded with a gated memory propagation unit. (2) Unlike previous interactive methods (requiring bounding box or seed points), the proposed method only asks the physician to merely click on the rough central point of the object before segmentation, which could simultaneously enhance the performance and reduce the segmentation time. (3) The method is utilized in a multi-level framework for better performance. It has been systematically evaluated in three different segmentation tasks, including CT kidney tumor, MR prostate, and PROMISE12 challenge, showing promising results compared with state-of-the-art methods.

Publication Date


  • 2021

Citation


  • Zhang, J., Shi, Y., Sun, J., Wang, L., Zhou, L., Gao, Y., & Shen, D. (2021). Interactive medical image segmentation via a point-based interaction. Artificial Intelligence in Medicine, 111. doi:10.1016/j.artmed.2020.101998

Scopus Eid


  • 2-s2.0-85097336855

Web Of Science Accession Number


Volume


  • 111