Volume 30 Issue 6
Nov.  2021
Turn off MathJax
Article Contents
YIN Qinran, CAO Weiqun. Video-Driven 2D Character Animation[J]. Chinese Journal of Electronics, 2021, 30(6): 1038-1048. doi: 10.1049/cje.2021.07.016
Citation: YIN Qinran, CAO Weiqun. Video-Driven 2D Character Animation[J]. Chinese Journal of Electronics, 2021, 30(6): 1038-1048. doi: 10.1049/cje.2021.07.016

Video-Driven 2D Character Animation

doi: 10.1049/cje.2021.07.016

This work is supported by the National Natural Science Foundation of China (No.61703046) and the Fundamental Research Funds for the Central Universities (No.2015ZCQ-XX).

  • Received Date: 2021-04-15
  • Rev Recd Date: 2021-06-25
  • Available Online: 2021-09-23
  • Publish Date: 2021-11-05
  • Video-driven animation has always been a hot and challenging topic in the field of computer animation. We propose a method of mapping a sequence of human skeletal keypoints in a video onto a two-dimensional character to generate 2D character animation. For a given two-dimensional character picture, we extract the motion of real human in video data, driving the character deformation. We analyze common two-dimensional human body movements, classify the basic posture of the human body, realize the recognition of skeleton posture based on back propagation network, capture human body motion by automatically tracking the position of the human skeleton keypoints coordinates in the video and redirect the motion data to a 2D character. Compared with the traditional method, our work is less affected by video data illumination and background complexity. We calibrate human body motion in videos to a 2D character according to the skeleton topology to avoid motion distortion caused by the difference in skeleton size and ratio. The experimental results show that the proposed algorithm can generate the motion of two-dimensional characters based on the motion of human characters in video data. The animation is natural and smooth, and the algorithm has strong robustness.
  • loading
  • V. Frati and D. Prattichizzo, "Using kinect for hand tracking and rendering in wearable haptics", Proc. of IEEE World Haptics Conference, Istanbul, Turkey, pp.317-321, 2011.
    E. De Aguiar, R. Zayer, C. Theobalt, et al., "Video-driven animation of human body scans", Proc. of 3DTV Conference, Kos, Greece, pp.1-4, 2007.
    T. Lin, L. Lin, and Q. Wang, "Robust stroke-based video animation via layered motion and correspondence", Proc. of the 20th ACM international conference on Multimedia, Nara, Japan, pp.729-732, 2012.
    L. Rui, Y. Jun, L. Xian, et al., "An evaluation framework for virtual articulatory movements based on medical video", Chinese Journal of Electronics, Vol.28, No.3, pp.585-592, 2019.
    Q. Su, X. Bai, H. Fu, et al., "Live sketch:Video-driven dynamic deformation of static drawings", Proc. of the 2018 CHI Conference on Human Factors in Computing Systems, Montréal, Canada, pp.1-12, 2018.
    J. Pan and J. J. Zhang, "Sketch-based skeleton-driven 2D animation and motion capture", Transactions on Edutainment VI, Vol 6758, pp.164-181, 2011.
    A. Jacobson and O. Sorkine, "Stretchable and twistable bones for skeletal shape deformation", Proc. of Proceedings of the 2011 SIGGRAPH Asia Conference, Hong Kong, China, pp.1-8, 2011.
    J. Zhao, L. Li and K. Chee Keong, "3D posture reconstruction and human animation from 2D feature points", Computer Graphics Forum, Vol.24, pp.759-771, 2005.
    Xian-Rui LI, Wen-Jun NI and Ke-Guo LI, "Research and implementation on human posture algorithm of pilot boarding", Acta Electronica Sinica, Vol.47, No.11, pp.2292-2298, 2019.(in Chinese)
    G. B. S. Silva, M. P. Mello, Y. E. Shimabukuro, et al., "Multitemporal classification of natural vegetation cover in brazilian cerrado", Proc. of 2011 6th International Workshop on the Analysis of Multi-temporal Remote Sensing Images (Multi-Temp), Trento, Italy, pp.117-120, 2011.
    C. Tran and M. M. Trivedi, "3-D posture and gesture recognition for interactivity in smart spaces", IEEE Transactions on Industrial Informatics, Vol.8, No.1, pp.178-187, 2011.
    Z. Zhang, "Microsoft kinect sensor and its effect", IEEE Multimedia, Vol.19, No.2, pp.4-10, 2012.
    B. Li, C. Han and B. Bai, "Hybrid approach for human posture recognition using anthropometry and BP neural network based on kinect v2", EURASIP Journal on Image and Video Processing, Vol.2019, No.1, pp.1-15, 2019.
    K. Chen and Q. Wang, "Human posture recognition based on skeleton data", Proc. of IEEE International Conference on Progress in Informatics and Computing (PIC), Nanjing, China, pp.618-622, 2015.
    C. Bregler, L. Loeb, E. Chuang, et al., "Turning to the masters:Motion capturing cartoons", ACM Transactions on Graphics (TOG), Vol.21, No.3, pp.399-407, 2002.
    N. Ben-Zvi, J. Bento, M. Mahler, et al., "Line-drawing video stylization", Computer Graphics Forum, Vol.35, pp.18-32, 2016.
    S. Santosa, F. Chevalier, R. Balakrishnan, et al., "Direct space-time trajectory control for visual media editing", Proc. of the SIGCHI Conference on Human Factors in Computing Systems, Paris, France, pp.1149-1158, 2013.
    R. Williams, The Animator'S Survival Kit:A Manual of Methods, Principles and Formulas for Classical, Computer, Games, Stop Motion and Internet Animators, Macmillan, 2012.
    Z. Cao, T. Simon, S.-E. Wei, et al., "Realtime multi-person 2D pose estimation using part affinity fields", Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, Hawaii, USA, pp.7291-7299, 2017.
    J. Li, J.-h. Cheng, J.-y. Shi, et al., "Brief introduction of back propagation (BP) neural network algorithm and its improvement", Advances in Computer Science and Information Engineering, Vol.169, pp.553-558, 2012.
    X. Glorot, A. Bordes and Y. Bengio, "Deep sparse rectifier neural networks", Proc. of the Fourteenth International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, USA, pp.315-323, 2011.
    R. Memisevic, C. Zach, M. Pollefeys, et al., "Gated softmax classification", Advances in Neural Information Processing Systems, Vol.23, pp.1603-1611, 2010.
    SK Abe, "Topological structural analysis of digitized binary images by border following", Computer Vision, Graphics, and Image Processing, Vol.30, No.1, pp.32-46, 1985.
    R. A. Dwyer, "A faster divide-and-conquer algorithm for constructing delaunay triangulations", Algorithmica, Vol.2, No.1, pp.137-151, 1987.
    D. H. Douglas and T. K. Peucker, "Algorithms for the reduction of the number of points required to represent a digitized line or its caricature", Cartographica:the International Journal for Geographic Information and Geovisualization, Vol.10, No.2, pp.112-122, 1973.
    A. Jacobson, I. Baran, J. Popovic, et al., "Bounded biharmonic weights for real-time deformation", ACM Trans. Graph, Vol.30, No.4, Page 78, 2011.
    L. Gorelick, M. Blank, E. Shechtman, et al., "Actions as spacetime shapes", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.29, No.12, pp.2247-2253, 2007.
    N. S. Willett, H. V. Shin, Z. Jin, et al., "Pose2pose:Pose selection and transfer for 2D character animation", Proc. of the 25th International Conference on Intelligent User Interfaces, Cagliari, Italy, pp.88-99, 2020.
    C. Chan, S. Ginosar, T. Zhou, et al., "Everybody dance now", Proc. of the IEEE/CVF International Conference on Computer Vision, Seoul, Korea, pp.5933-5942, 2019.
  • 加载中


    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views (105) PDF downloads(23) Cited by()
    Proportional views


    DownLoad:  Full-Size Img  PowerPoint