TY - GEN
T1 - Self-supervised 3D Skeleton Completion for Vascular Structures
AU - Ren, Jiaxiang
AU - Li, Zhenghong
AU - Cheng, Wensheng
AU - Zou, Zhilin
AU - Park, Kicheon
AU - Pan, Yingtian
AU - Ling, Haibin
N1 - Publisher Copyright: © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.
PY - 2024
Y1 - 2024
N2 - 3D skeleton is critical for analyzing vascular structures with many applications, it is however often limited by the broken skeletons due to image degradation. Existing methods usually correct such skeleton breaks via handcrafted connecting rules or rely on nontrivial manual annotation, which is susceptible to outliers or costly especially for 3D data. In this paper, we propose a self-supervised approach for vasculature reconnection. Specifically, we generate synthetic breaks from confident skeletons and use them to guide the learning of a 3D UNet-like skeleton completion network. To address serious imbalance among different types of skeleton breaks, we introduce three skeleton transformations that largely alleviate such imbalance in synthesized break samples. This allows our model to effectively handle challenging breaks such as bifurcations and tiny fragments. Additionally, to encourage the connectivity outcomes, we design a novel differentiable connectivity loss for further improvement. Experiments on a public medical segmentation benchmark and a 3D optical coherence Doppler tomography (ODT) dataset show the effectiveness of our method. The code is publicly available at https://github.com/reckdk/SkelCompletion-3D.
AB - 3D skeleton is critical for analyzing vascular structures with many applications, it is however often limited by the broken skeletons due to image degradation. Existing methods usually correct such skeleton breaks via handcrafted connecting rules or rely on nontrivial manual annotation, which is susceptible to outliers or costly especially for 3D data. In this paper, we propose a self-supervised approach for vasculature reconnection. Specifically, we generate synthetic breaks from confident skeletons and use them to guide the learning of a 3D UNet-like skeleton completion network. To address serious imbalance among different types of skeleton breaks, we introduce three skeleton transformations that largely alleviate such imbalance in synthesized break samples. This allows our model to effectively handle challenging breaks such as bifurcations and tiny fragments. Additionally, to encourage the connectivity outcomes, we design a novel differentiable connectivity loss for further improvement. Experiments on a public medical segmentation benchmark and a 3D optical coherence Doppler tomography (ODT) dataset show the effectiveness of our method. The code is publicly available at https://github.com/reckdk/SkelCompletion-3D.
KW - 3D skeleton completion
KW - Self-supervised learning
UR - https://www.scopus.com/pages/publications/105007793207
U2 - 10.1007/978-3-031-72120-5_54
DO - 10.1007/978-3-031-72120-5_54
M3 - Conference contribution
SN - 9783031721199
T3 - Lecture Notes in Computer Science
SP - 579
EP - 589
BT - Medical Image Computing and Computer Assisted Intervention - MICCAI 2024 - 27th International Conference, Proceedings
A2 - Linguraru, Marius George
A2 - Feragen, Aasa
A2 - Glocker, Ben
A2 - Giannarou, Stamatia
A2 - Schnabel, Julia A.
A2 - Dou, Qi
A2 - Lekadir, Karim
PB - Springer Science and Business Media Deutschland GmbH
T2 - 27th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2024
Y2 - 6 October 2024 through 10 October 2024
ER -