Research on Semantic Communication Based on Joint Control Mechanism of Shallow and Deep Neural Network

XIE Wenwu; XIONG Ming; REN Ziqing; WANG Ji; YANG Zhihe

doi:10.23919/cje.2023.00.278

Article Contents

Article Navigation > Chinese Journal of Electronics > 2023 > Uncorrected proof

Wenwu XIE, Ming XIONG, Ziqing REN, et al., “Research on Semantic Communication Based on Joint Control Mechanism of Shallow and Deep Neural Network,” Chinese Journal of Electronics, vol. x, no. x, pp. 1–14, xxxx doi: 10.23919/cje.2023.00.278

Citation:

Wenwu XIE, Ming XIONG, Ziqing REN, et al., “Research on Semantic Communication Based on Joint Control Mechanism of Shallow and Deep Neural Network,” Chinese Journal of Electronics, vol. x, no. x, pp. 1–14, xxxx doi: 10.23919/cje.2023.00.278

Citation:

PDF( 10171 KB)

Research on Semantic Communication Based on Joint Control Mechanism of Shallow and Deep Neural Network

doi: 10.23919/cje.2023.00.278

XIE Wenwu^1
,,
XIONG Ming^1
,,
REN Ziqing^2
,,
WANG Ji^{3
,
,},
YANG Zhihe^1
,

1.
School of Information Science and Engineering, Hunan Institute of Science and Technology, Yueyang 414006, China
2.
Software Engineering at the School of Computer Science, Hefei Normal University, HeFei 230001, China
3.
College of Physical Science and Technology, Central China Normal University Hubei,Wuhan 430079, China

More Information

Author Bio:
Wenwu XIE received the M.S. and Ph.D. degrees in Communication Engineering from the Huazhong Normal University in 2004, 2007 and 2017. He is currently a Professor at Hunan Institute of Science and Technology. His research interests cover communication algorithm, internet of thing, and evolutionary computing. (Email: gavinxie@hnist.edu.cn)

Ming XIONG postgraduate of School of Information Science and Engineering, Hunan Institute of Science and Technology, His research interests include artificial intelligence communication, semantic communication. (Email: 812211120161@vip.hnist.edu.cn)

Ziqing REN female, is a undergraduate student of Software Engineering in the School of Computer Science, Hefei Normal University, Her research interest is semantic communication. of Computer Science, Hefei Normal University, major research direction: semantic communication. (Email: 708868550@qq.com)

Ji WANG is currently an Associate Professor with the Department of Electronics and Information Engineering, Central China Normal University, China. His research interests include space information networks and B5G wireless communications. (Email: jiwang@ccnu.edu.cn)

Zhihe YANG received the M.S.degrees in Computer Technology from Huazhong University of Science and Technology in 2006. He is currently a Professor at Hunan Institute of Science and Technology. His research interests cover internet of thing, Intelligent computing and intelligent information system. (Email: 602641715@qq.com)
Corresponding author: Email: jiwang@ccnu.edu.cn
Received Date: 2023-08-11
Accepted Date: 2023-08-11

Available Online: 2023-08-11

Abstract

Abstract

With the rapid development of deep learning, various semantic communication models are emerging, but the current semantic communication models still have much room for improvement in the coding layer. For this reason, a joint-residual neural networks (Joint-ResNets) framework based on the joint control of shallow neural networks (SNNs) and deep neural networks (DNNs) is proposed to cope with the problems in semantic communication coding. The framework synergizes SNNs and DNNs based on their shared utility, and uses variable weight $\alpha$ term to control the ratio of SNNs and DNNs to fully utilize the simplicity of SNNs and the richness of DNNs. The article details the construction of the Joint-ResNets framework and its canonical use in classical semantic communication models, and illustrates the control mechanism of the variable weight $\alpha$ term in the Joint-ResNets framework and its importance in balancing the model complexity between SNNs and DNNs. The article takes the task-oriented communication model in the device edge collaborative reasoning system as an example for experimentation and analysis. The experimental validation shows that DNNs and SNNs can be combined in a more effective way to standardize semantic coding, which improves the overall predictive performance, interpretability, and robustness of semantic communication models, and this framework is expected to bring new breakthroughs in the field of semantic communication.
- Semantic communication,
- Residual neural networks (ResNets),
- Joint control mechanisms,
- Edge reasoning

FullText(HTML)

References(31)

References

[1]	E. C. Strinati and S. Barbarossa, “6G networks: Beyond Shannon towards semantic and goal-oriented communications,” Computer Networks, vol. 190 article no. 107930, 2021 doi: 10.1016/j.comnet.2021.107930
[2]	J. Bao, P. Basu, M. Dean, et al., “Towards a theory of semantic communication, ” in Proceedings of 2011 IEEE Network Science Workshop, West Point, NY, USA, pp. 110–117, 2011.
[3]	Y. Yang, C. L. Guo, F. F. Liu, et al., “Semantic communications with AI tasks, ” arXiv preprint, arXiv: 2109.14170, 2021.
[4]	W. J. Xu, Y. M. Zhang, F. Y. Wang, et al, “Semantic communication for the internet of vehicles: A multiuser cooperative approach,” IEEE Vehicular Technology Magazine, vol. 18, no. 1, pp. 100–109, 2023 doi: 10.1109/MVT.2022.3227723
[5]	Y. C. Zhang, P. Zhang, J. B. Wei, et al, “Semantic communication for intelligent devices: Architectures and a paradigm,” Scientia Sinica Informationis, vol. 52, no. 5, pp. 907–921, 2022 doi: 10.1360/SSI-2020-0379
[6]	C. H. Liu, C. L. Guo, Y. Yang, et al, “Intelligent task-oriented semantic communications: Theory, technology and challenges,” Journal on Communications, vol. 43, no. 6, pp. 41–57, 2022 doi: 10.11959/j.issn.1000-436x.2022117
[7]	D. L. Huang, X. M. Tao, F. F. Gao, et al., “Deep learning-based image semantic coding for semantic communications, ” in Proceedings of 2021 IEEE Global Communications Conference, Madrid, Spain, pp. 1–6, 2021.
[8]	E. Beck, C. Bockelmann, and A. Dekorsy, “Semantic information recovery in wireless networks, ” arXiv preprint, arXiv: 2204.13366, 2023.
[9]	P. Zhang, W. J. Xu, H. Gao, et al, “Toward wisdom-evolutionary and primitive-concise 6G: A new paradigm of semantic communication networks,” Engineering, vol. 8 pp. 60–73, 2022 doi: 10.1016/j.eng.2021.11.003
[10]	D. Bank, N. Koenigstein, and R. Giryes, “Autoencoders, ” in Machine Learning for Data Science Handbook: Data Mining and Knowledge Discovery Handbook, L. Rokach, O. Maimon, and E. Shmueli, Eds. Springer, Cham, Germany, pp. 353–374, 2023.
[11]	E. Bourtsoulatze, D. B. Kurka, and D. Gündüz, “Deep joint source-channel coding for wireless image transmission,” IEEE Transactions on Cognitive Communications and Networking, vol. 5, no. 3, pp. 567–579, 2019 doi: 10.1109/TCCN.2019.2919300
[12]	Y. M. Saidutta, A. Abdi, and F. Fekri, “Joint source-channel coding for Gaussian sources over AWGN channels using variational autoencoders, ” in Proceedings of 2019 IEEE International Symposium on Information Theory, Paris, France, pp. 1327–1331, 2019.
[13]	K. M. He, X. Y. Zhang, S. Q. Ren, et al., “Deep residual learning for image recognition, ” in Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, pp. 770–778, 2016.
[14]	S. H. Wang, B. C. Mo, and J. H. Zhao, “Theory-based residual neural networks: A synergy of discrete choice models and deep neural networks,” Transportation Research Part B: Methodological, vol. 146 pp. 333–358, 2021 doi: 10.1016/j.trb.2021.03.002
[15]	Y. Wang, J. J. Peng, H. B. Wang, et al, “Progressive learning with multi-scale attention network for cross-domain vehicle re-identification,” Science China Information Sciences, vol. 65, no. 5, article no. 160103, 2022 doi: 10.1007/s11432-021-3383-y
[16]	B. Qian, Y. Wang, H. Z. Yin, et al., “Switchable online knowledge distillation, ” in Proceedings of the 17th European Conference on Computer Vision, Tel Aviv, Israel, pp. 449–466, 2022.
[17]	Y. Wang, “Survey on deep multi-modal data analytics: Collaboration, rivalry, and fusion,” ACM Transactions on Multimedia Computing, Communications, and Applications, vol. 17, no. 1s, article no. 10, 2021 doi: 10.1145/3408317
[18]	K. Hornik, M. Stinchcombe, and H. White, “Multilayer feedforward networks are universal approximators,” Neural Networks, vol. 2, no. 5, pp. 359–366, 1989 doi: 10.1016/0893-6080(89)90020-8
[19]	K. Hornik, “Approximation capabilities of multilayer feedforward networks,” Neural Networks, vol. 4, no. 2, pp. 251–257, 1991 doi: 10.1016/0893-6080(91)90009-T
[20]	M. N. Du, N. H. Liu, and X. Hu, “Techniques for interpretable machine learning,” Communications of the ACM, vol. 63, no. 1, pp. 68–77, 2019 doi: 10.1145/3359786
[21]	I. J. Goodfellow, J. Shlens, and C. Szegedy, “Explaining and harnessing adversarial examples, ” in Proceedings of the 3rd International Conference on Learning Representations, San Diego, CA, USA, 2015.
[22]	X. Glorot and Y. Bengio, “Understanding the difficulty of training deep feedforward neural networks, ” in Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, Sardinia, Italy, pp. 249–256, 2010.
[23]	M. Bianchini and F. Scarselli, “On the complexity of neural network classifiers: A comparison between shallow and deep architectures,” IEEE Transactions on Neural Networks and Learning Systems, vol. 25, no. 8, pp. 1553–1565, 2014 doi: 10.1109/TNNLS.2013.2293637
[24]	Y. Bengio, “Learning deep architectures for AI,” Foundations and Trends^® in Machine Learning, vol. 2, no. 1, pp. 1–127, 2009 doi: 10.1561/2200000006
[25]	S. Dörner, S. Cammerer, J. Hoydis, et al, “Deep learning based communication over the air,” IEEE Journal of Selected Topics in Signal Processing, vol. 12, no. 1, pp. 132–143, 2018 doi: 10.1109/JSTSP.2017.2784180
[26]	R. E. Schapire, “Explaining AdaBoost, ” in Empirical Inference: Festschrift in Honor of Vladimir N. Vapnik, B. Schölkopf, Z. Y. Luo, and V. Vovk, Eds. Springer, Berlin, Germany, pp. 37–52, 2013.
[27]	C. Ying, Q. G. Miao, J. C. Liu, et al, “Advance and prospects of adaboost algorithm,” Acta Automatica Sinica, vol. 39, no. 6, pp. 745–758, 2013 doi: 10.1016/S1874-1029(13)60052-X
[28]	J. W. Shao, Y. Y. Mao, and J. Zhang, “Learning task-oriented communication for edge inference: An information bottleneck approach,” IEEE Journal on Selected Areas in Communications, vol. 40, no. 1, pp. 197–211, 2022 doi: 10.1109/JSAC.2021.3126087
[29]	M. T. Ribeiro, S. Singh, and C. Guestrin, ““Why should i trust you?”: Explaining the predictions of any classifier, ” in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, pp. 1135–1144, 2016.
[30]	D. L. Huang, F. F. Gao, X. M. Tao, et al, “Toward semantic communications: Deep learning-based image semantic coding,” IEEE Journal on Selected Areas in Communications, vol. 41, no. 1, pp. 55–71, 2023 doi: 10.1109/JSAC.2022.3221999
[31]	L. Van der Maaten and G. Hinton, “Visualizing data using t-SNE,” Journal of Machine Learning Research, vol. 9, no. 86, pp. 2579–2605, 2008