The Squeeze &amp; Excitation Normalization based nnU-Net for Segmenting Head &amp; Neck Tumors

XIE Juanying; PENG Ying; WANG Mingzhao

doi:10.23919/cje.2022.00.306

Article Contents

Article Navigation > Chinese Journal of Electronics > 2022 > Accepted Manuscript

XIE Juanying, PENG Ying, WANG Mingzhao, “The Squeeze & Excitation Normalization based nnU-Net for Segmenting Head & Neck Tumors,” Chinese Journal of Electronics, in press, doi: 10.23919/cje.2022.00.306, 2022.

Citation:

XIE Juanying, PENG Ying, WANG Mingzhao, “The Squeeze & Excitation Normalization based nnU-Net for Segmenting Head & Neck Tumors,” Chinese Journal of Electronics, in press, doi: 10.23919/cje.2022.00.306, 2022.

Citation:

PDF( 3762 KB)

The Squeeze & Excitation Normalization based nnU-Net for Segmenting Head & Neck Tumors

doi: 10.23919/cje.2022.00.306

1.
School of Computer Science, Shaanxi Normal University, Xi’an 710119, China

More Information

Author Bio:
Juanying XIE is a professor and a Ph.D. student supervisor of the school of computer science of Shaanxi Normal University, Xi’an, China. She received the Ph.D. and M.S. degree from Xidian University in 2012 and 2004, respectively. She received the B.S. degree from Shaanxi Normal University in 1993. Her research interests include machine learning, data mining, and biomedical data analysis. Her research is highly cited, with one article in the top 1% of ESI and one is the top 3 hotspot article of “SCIENTIA SINICA Informationis” and 3 articles was included in F5000. She is an associate editor of Health Information Science and Systems, and an editor board member of the journal of Shaanxi Normal University (Natural Science Edition). (Email: xiejuany@snnu.edu.cn)

Ying PENG received the M.S. degree in the application technology of computer science and B.S. degree in Computer Science from Shaanxi Normal University in 2022 and 2019, respectively. Her research interests include deep learning and biomedical image segmentation. (Email: py183248@snnu.edu.cn)

Mingzhao WANG is a post doctor supervised by professor Juanying Xie at the school of computer science of Shaanxi Normal University, Xi'an, China. He received the Ph.D. degree in bioinformatics and M.S. degree in the application technology of computer science from Shaanxi Normal University in 2021 and 2017, respectively. He received his B.S. degree in computer science from Shanxi Normal University, linfen, China, in 2014. His research interests include machine learning and bioinformatics. (Email: wangmz2017@snnu.edu.cn)
Received Date: 2022-09-09
Accepted Date: 2022-12-13

Available Online: 2023-02-18

Abstract

Abstract

Head and neck cancer is one of the most common malignancies in the world. We propose SE-nnU-Net by adapting SE (Squeeze and Excitation) normalization into nnU-Net, so as to segment head and neck tumors in PET/CT images by combining advantages of SE capturing features of interest regions and nnU-Net configuring itself for a specific task. The basic module referred to convolution-ReLU-SE is designed for SE-nnU-Net. In the encoder it is combined with residual structure while in the decoder without residual structure. The loss function combines Dice loss and Focal loss. The specific data preprocessing and augmentation techniques are developed, and specific network architecture is designed. Furthermore, the deep supervised mechanism is introduced to calculate the loss function using the last four layers of the decoder of SE-nnU-Net. This SE-nnU-net is applied to HECKTOR 2020 and HECKTOR 2021 challenges, respectively, using different experimental design. The experimental results show that SE-nnU-Net for HECKTOR 2020 obtained 0.745, 0.821, and 0.725 in terms of Dice, Precision, and Recall, respectively, while the SE-nnU-Net for HECKTOR 2021 obtains 0.778 and 3.088 in terms of Dice and median HD95, respectively. This SE-nnU-Net for segmenting head and neck tumors can provide auxiliary opinions for doctors’ diagnoses.
- Head and neck tumors,
- PET/CT images,
- Image segmentation,
- SE-nnU-Net,
- SE normalization

FullText(HTML)

References(40)

References

[1]	F. Bray, J. Ferlay, I. Soerjomataram, R. L. Siegel, et al., “Global cancer statistics 2018: Globocan estimates of incidence and mortality worldwide for 36 cancers in 185 countries,” CA: A Cancer Journal for Clinicians, vol.68, no.6, pp.394–424, 2018. doi: 10.3322/caac.21492
[2]	S. L. Breen, J. Publicover, S. De Silva, G. Pond, et al., “Intraobserver and interobserver variability in gtv delineation on fdg-pet-ct images of head and neck cancers,” International Journal of Radiation Oncology Biology Physics, vol.68, no.3, pp.763–770, 2007. doi: 10.1016/j.ijrobp.2006.12.039
[3]	D. Kawahara, M. Tsuneda, S. Ozawa, H. Okamoto, et al., “Stepwise deep neural network (stepwise-net) for head and neck auto-segmentation on ct images”, Computers in Biology and Medicine, vol.143, artilce no.article no.105295, 2022.
[4]	B. Wu, P.-L. Khong, and T. Chan, “Automatic detection and classification of nasopharyngeal carcinoma on pet/ct with support vector machine,” International Journal of Computer Assisted Radiology and Surgery, vol.7, no.4, pp.635–646, 2012. doi: 10.1007/s11548-011-0669-y
[5]	Q. Song, J. Bai, D. Han, S. Bhatia, et al., “Optimal co-segmentation of tumor in pet-ct images with context information,” IEEE Transactions on Medical Imaging, vol.32, no.9, pp.1685–1697, 2013. doi: 10.1109/TMI.2013.2263388
[6]	Y. M. Moe, A. R. Groendahl, M. Mulstad, O. Tomic, et al., “Deep learning for automatic tumour segmentation in pet/ct images of patients with head and neck cancers”, arXiv preprint arXiv: 1908.00841, in press, 2019.
[7]	V. Andrearczyk, V. Oreiller, M. Vallières, J. Castelli, et al., “Automatic segmentation of head and neck tumors and nodal metastases in pet-ct scans”, in Proceedings of the Third Conference on Medical Imaging with Deep Learning, London, UK, vol.121, pp.33–43, 2020.
[8]	Y. Yuan, “Automatic head and neck tumor segmentation in pet/ct with scale attention network”, in Proceedings of First Challenge, HECKTOR 2020, Held in Conjunction with MICCAI 2020, pp.44–52.
[9]	J. Ma and X. Yang, “Combining cnn and hybrid active contours for head and neck tumor segmentation in ct and pet images”, in Proceedings of First Challenge, HECKTOR 2020, Held in Conjunction with MICCAI 2020, Springer, Lima, Peru, vol.12603, pp.59–64, 2021.
[10]	H. Chen, H. Chen, and L. Wang, “Iteratively refine the segmentation of head and neck tumor in fdg-pet and ct images”, in Proceedings of First Challenge, HECKTOR 2020, Held in Conjunction with MICCAI 2020, Springer, Lima, Peru, vol.12603, pp.53–58, 2021.
[11]	F. Isensee, P. F. Jaeger, S. A. Kohl, J. Petersen, and K. H. Maier-Hein, “Nnu-net: A self-configuring method for deep learning-based biomedical image segmentation,” Nature Methods, vol.18, no.2, pp.203–211, 2021. doi: 10.1038/s41592-020-01008-z
[12]	T. Falk, D. Mai, R. Bensch, Ö. Çiçek, et al., “U-net: Deep learning for cell counting, detection, and morphometry,” Nature Methods, vol.16, no.1, pp.67–70, 2019. doi: 10.1038/s41592-018-0261-2
[13]	H. El-Hariri, L. A. S. M. Neto, P. Cimflova, F. Bala, et al., “Evaluating nnu-net for early ischemic change segmentation on non-contrast computed tomography in patients with acute ischemic stroke”, Computers in Biology and Medicine, vol.141, artilce no.article no.105033, 2022.
[14]	G. Zhang, Z. Yang, B. Huo, S. Chai, and S. Jiang, “Multiorgan segmentation from partially labeled datasets with conditional nnu-net”, Computers in Biology and Medicine, vol.136, artilce no.article no.104658, 2021.
[15]	J. Hu, L. Shen, and G. Sun, “Squeeze-and-excitation networks”, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, Utah, USA, pp.7132–7141, 2018.
[16]	L. Rundo, C. Han, Y. Nagano, J. Zhang, et al., “Use-net: Incorporating squeeze-and-excitation blocks into u-net for prostate zonal segmentation of multi-institutional mri datasets”, Neurocomputing, vol.365, pp.31–43, 2019.
[17]	B. Zhang, S. Qi, Y. Wu, X. Pan, et al., “Multi-scale segmentation squeeze-and-excitation unet with conditional random field for segmenting lung tumor from ct images”, Computer Methods and Programs in Biomedicine, vol.222, artilce no.article no.106946, 2022.
[18]	A. Iantsen, V. Jaouen, D. Visvikis, and M. Hatt, “Squeeze-and-excitation normalization for brain tumor segmentation”, in Proceedings of 6th International Workshop, BrainLes 2020, Held in Conjunction with MICCAI 2020, Springer, Lima, Peru, vol.12659, pp.366–373, 2021.
[19]	V. Andrearczyk, V. Oreiller, M. Jreige, M. Vallieres, et al., “Overview of the hecktor challenge at miccai 2020: Automatic head and neck tumor segmentation in pet/ct”, in Proceedings of First Challenge, HECKTOR 2020, Held in Conjunction with MICCAI 2020, Springer, Lima, Peru, vol.12603, pp.1–21, 2021.
[20]	A. Iantsen, D. Visvikis, and M. Hatt, “Squeeze-and-excitation normalization for automated delineation of head and neck primary tumors in combined pet and ct images”, in Proceedings of First Challenge, HECKTOR 2020, Held in Conjunction with MICCAI 2020, Springer, Lima, Peru, vol.12603, pp.37–43, 2021.
[21]	L. R. Dice, “Measures of the amount of ecologic association between species,” Ecology, vol.26, no.3, pp.297–302, 1945. doi: 10.2307/1932409
[22]	D. P. Huttenlocher, G. A. Klanderman, and W. J. Rucklidge, “Comparing images using the hausdorff distance,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.15, no.9, pp.850–863, 1993. doi: 10.1109/34.232073
[23]	L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille, “Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.40, no.4, pp.834–848, 2017.
[24]	J. Xie and Y. Peng, “The head and neck tumor segmentation using nnu-net with spatial and channel ‘squeeze & excitation’blocks”, in Proceedings of First Challenge, HECKTOR 2020, Held in Conjunction with MICCAI 2020, Springer, Lima, Peru, vol.12603, pp.28–36, 2021.
[25]	K. Ghimire, Q. Chen, and X. Feng, “Patch-based 3d unet for head and neck tumor segmentation with an ensemble of conventional and dilated convolutions”, in Proceedings of First Challenge, HECKTOR 2020, Held in Conjunction with MICCAI 2020, Springer, Lima, Peru, vol.12603, pp.78–84, 2021.
[26]	F. Yousefirizi and A. Rahmim, “Gan-based bi-modal segmentation using mumford-shah loss: Application to head and neck tumors in pet-ct images”, in Proceedings of First Challenge, HECKTOR 2020, Held in Conjunction with MICCAI 2020, Springer, Lima, Peru, vol.12603, pp.99–108, 2021.
[27]	S. Zhu, Z. Dai, and N. Wen, “Two-stage approach for segmenting gross tumor volume in head and neck cancer with ct and pet imaging”, in Proceedings of First Challenge, HECKTOR 2020, Held in Conjunction with MICCAI 2020, Springer, Lima, Peru, vol.12603, pp.22–27, 2021.
[28]	M. A. Naser, L. V. van Dijk, R. He, K. A. Wahid, and C. D. Fuller, “Tumor segmentation in patients with head and neck cancers using deep learning based-on multi-modality pet/ct images”, in Proceedings of First Challenge, HECKTOR 2020, Held in Conjunction with MICCAI 2020, Springer, Lima, Peru, vol.12603, pp.85–98, 2021.
[29]	C. Rao, S. Pai, I. Hadzic, I. Zhovannik, et al., “Oropharyngeal tumour segmentation using ensemble 3d pet-ct fusion networks for the hecktor challenge”, in Proceedings of First Challenge, HECKTOR 2020, Held in Conjunction with MICCAI 2020, Springer, Lima, Peru, vol.12603, pp.65–77, 2021.
[30]	V. Andrearczyk, V. Oreiller, S. Boughdad, C. C. L. Rest, et al., “Overview of the hecktor challenge at miccai 2021: Automatic head and neck tumor segmentation and outcome prediction in pet/ct images”, in Proceedings of Second Challenge, HECKTOR 2021, Held in Conjunction with MICCAI 2021, Springer, Strasbourg, France, vol.13209, pp.1–37, 2022.
[31]	C. An, H. Chen, and L. Wang, “A coarse-to-fine framework for head and neck tumor segmentation in ct and pet images”, in Proceedings of Second Challenge, HECKTOR 2021, Held in Conjunction with MICCAI 2021, Springer, Strasbourg, France, vol.13209, pp.50–57, 2022.
[32]	J. Lu, W. Lei, R. Gu, and G. Wang, “Priori and posteriori attention for generalizing head and neck tumors segmentation”, in Proceedings of Second Challenge, HECKTOR 2021, Held in Conjunction with MICCAI 2021, Springer, Strasbourg, France, vol.13209, pp.134–140, 2022.
[33]	F. Yousefirizi, I. Janzen, N. Dubljevic, Y.-E. Liu, et al., “Segmentation and risk score prediction of head and neck cancers in pet/ct volumes with 3d u-net and cox proportional hazard neural networks”, in Proceedings of Second Challenge, HECKTOR 2021, Held in Conjunction with MICCAI 2021, Springer, Strasbourg, France, vol.13209, pp.236–247, 2022.
[34]	J. Ren, B.-N. Huynh, A. R. Groendahl, O. Tomic, et al., “Pet normalizations to improve deep learning auto-segmentation of head and neck tumors in 3d pet/ct”, in Proceedings of Second Challenge, HECKTOR 2021, Held in Conjunction with MICCAI 2021, Springer, Strasbourg, France, vol.13209, pp.83–91, 2022.
[35]	M. A. Naser, K. A. Wahid, L. V. v. Dijk, R. He, et al., “Head and neck cancer primary tumor auto segmentation using model ensembling of deep learning in pet/ct images”, in Proceedings of Second Challenge, HECKTOR 2021, Held in Conjunction with MICCAI 2021, Springer, Strasbourg, France, vol.13209, pp.121–133, 2022.
[36]	A. D. Biase, W. Tang, N. Sourlos, B. Ma, et al., “Skip-scse multi-scale attention and co-learning method for oropharyngeal tumor segmentation on multi-modal pet-ct images”, in Proceedings of Second Challenge, HECKTOR 2021, Held in Conjunction with MICCAI 2021, Springer, Strasbourg, France, vol.13209, pp.109–120, 2022.
[37]	G. Wang, Z. Huang, H. Shen, and Z. Hu, “The head and neck tumor segmentation in pet/ct based on multi-channel attention network”, in Proceedings of Second Challenge, HECKTOR 2021, Held in Conjunction with MICCAI 2021, Springer, Strasbourg, France, vol.13209, pp.68–74, 2022.
[38]	M. Cho, Y. Choi, D. Hwang, S. Y. Yie, et al., “Multimodal spatial attention network for automatic head and neck tumor segmentation in fdg-pet and ct images”, in Proceedings of Second Challenge, HECKTOR 2021, Held in Conjunction with MICCAI 2021, Springer, Strasbourg, France, vol.13209, pp.75–82, 2022.
[39]	M. Meng, Y. Peng, L. Bi, and J. Kim, “Multi-task deep learning for joint tumor segmentation and outcome prediction in head and neck cancer”, in Proceedings of Second Challenge, HECKTOR 2021, Held in Conjunction with MICCAI 2021, Springer, Strasbourg, France, vol.13209, pp.160–167, 2022.
[40]	J. Xie and Y. Peng, “The head and neck tumor segmentation based on 3d u-net”, in Proceedings of Second Challenge, HECKTOR 2021, Held in Conjunction with MICCAI 2021, Springer, Strasbourg, France, vol.13209, pp.92–98, 2022.