3D Freehand Tracking Based on Relevancy Among Local Motion Models

FENG Zhiquan; YANG Bo; ZHENG Yanwei; XU Tao

Article Contents

Article Navigation > Chinese Journal of Electronics > 2013 > 22(3): 530-536

FENG Zhiquan, YANG Bo, ZHENG Yanwei, et al., “3D Freehand Tracking Based on Relevancy Among Local Motion Models,” Chinese Journal of Electronics, vol. 22, no. 3, pp. 530-536, 2013,

Citation:

FENG Zhiquan, YANG Bo, ZHENG Yanwei, et al., “3D Freehand Tracking Based on Relevancy Among Local Motion Models,” Chinese Journal of Electronics, vol. 22, no. 3, pp. 530-536, 2013,

FENG Zhiquan, YANG Bo, ZHENG Yanwei, et al., “3D Freehand Tracking Based on Relevancy Among Local Motion Models,” Chinese Journal of Electronics, vol. 22, no. 3, pp. 530-536, 2013,

Citation:

FENG Zhiquan, YANG Bo, ZHENG Yanwei, et al., “3D Freehand Tracking Based on Relevancy Among Local Motion Models,” Chinese Journal of Electronics, vol. 22, no. 3, pp. 530-536, 2013,

PDF( 613 KB)

3D Freehand Tracking Based on Relevancy Among Local Motion Models

FENG Zhiquan^{1,2
,},
YANG Bo^1,2,
ZHENG Yanwei^1,2,
XU Tao^1,2

1.
School of Information Science and Engineering, University of Jinan, Jinan 250022, China;
2.
Provincial Key Laboratory for Network Based Intelligent Computing, Jinan 250022, China

Funds: This work is supported by the National Natural Science Foundation of China (No.61173079, No.60973093, No.61173078), the Key Project of Natural Science Foundation of Shandong Province (No.ZR2011FZ003) and Program for New Century Excellent Talents in University (No.NCET-10-0863).

Received Date: 2012-02-01
Rev Recd Date: 2012-12-01
Publish Date: 2013-06-15

Abstract

Abstract

A novel 3D freehand tracking algorithm based on relevancy among local motion models is put forward. Firstly, a specification of the Cognitive and behavioral model (CBM) called PAMT is proposed. Secondly, we regard PAMT as a data structure upon which freehand tracking algorithm is designed, and we describe the PAMT in detail. Lastly, the experimental results are provided. The proposed algorithm is tested in a virtual assembly platform and two other application systems. The highlights of this paper are as follows: (1) A new cognitive and behavioral model, called PAMT, is presented; (2) The PAMT is explained with cognitive model; (3) Focus on describing ‘Attractor' in PAMT with the relevancy among local motion models; (4) Shows us how the PAMT is shaped and used to design the 3D freehand tracker. One of the advantages of PAMT and RLMM model is that it is easier to explore some of the complex correlations among the variables of the 3D hand model. Our experimental results show that, compared with the particle filter and the annealed particle filter, our algorithm effectively reduces dimensionality and can track 3D hand in real-time.
- 3D hand tracking,
- Cognitive behavioral model,
- High dimensionality reduction,
- Human-computer interaction

FullText(HTML)

References(33)

References

R. Cipolla, N.J. Ollinghurst, “Human robot interface by pointing with uncalibrated stereo vision”, Image and Vision Computing, Vol.14, No.3, pp.171-178, 1996.

Lee, Weinshall M.S., Cohen-Solal D., Colmenarez E., Lyons A., D. A. “Computer vision system for on-screen item selection by finger pointing”, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA, pp.1027-1033, 2001.

Christian von Hardenberg, Franois Brard, “Bare-hand humancomputer interaction”, Proceedings of the ACM Workshop on Perceptive User Interfaces, New York, USA, pp.1-8, 2001.

G. McAllister, “Hand tracking for behaviour understanding”, Image and Vision Computing, Vol.20, No.12, pp.827-840, 2002.

Chunku Wang, Wen Gao, Shiguang Shan, “An approach based on phonemes to large vocabulary Chinese sign language recognition”, Proceedings of the 5th IEEE International Conference on Automatic Face and Gesture Recognition. Washington DC, USA, pp.393-398, 2002.

K. Oka, Y. Sato, H. Koike, “Real-time tracking of multiple fingertips and gesture recognition for augmented desk interface systems”, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition, Washington, DC, USA, pp.411-416, 2002.

S. Lenman, L. Bretzner, B. Thuresson, “Computer vision based hand posture interfaces for humancomputer interaction”, Technology Report, Sweden: Department of Numerical Analysis and Computer Science, Royal Institute of Technology, TritanaD0209, 2002.

Qingjie Zhao, Baojun Zhang, Huosheng Hu, “Novel two-step filtering scheme for a logging-while-drilling system”, Computer Physics Communications, Vol.180, No.9, pp.1566-1571, 2009.

Qingjie Zhao, Baojun Zhang, Wei Wang, “Data processing techniques for a wireless data transmission application via mud”, EURASIP Journal on Advances in Signal Processing, pp.1-8, 2011.

Chen Rui, Liu Guoyi, Zhao Guoying, Zhang Jun, Li Hua, “3D human motion tracking based on sequential monte carlo method”, Journal of Computer Aided Design & Computer Graphics, Vol.17, No.1, pp.85-92, 2005.

Ali Erol George Bebis, MirceA Nicolescu, RichArd D. Boyle, XAnder Twombly, “A review on vision-based full DOF hand motion estimation”, IEEE Computer Society Conference on Computer Vision And Pattern Recognition (CVPR'2005), San Diego, CA, USA, pp.15-22, 2005.

M. Bray, E. Koller-Meier, L. Van Gool, “Smart particle filtering for 3D hand tracking”, Procedure of IEEE International Conference on Automatic Face & Gesture Recognition, Seoul, Korea, pp.675-680, 2004.

B. Bray, E. Koller-Meier, M. Muller, Van Gool L., N.N. Schraudolph, “3D hand tracking by rapid stochastic gradient descent using a skinning model”, 1st European Conference on Visual Media Production (CVMP), London, pp.231-237, 2004.

Tony Lin, Hongbin Zha, San-Uk Lee, “Riemannian Manifold Learning for Nonlinear Dimensionality Reduction”, 9th European Conference on Computer Vision (ECCV), Part I, LNCS 3951, Graz, Austria, pp.44-55, 2006.

Y.Wu, J.Y. Lin, T.S. Huang, “Capturing natural hand freehand articulation”, Proc. IEEE International Conference on Computer Vision, Vancouver, Canada, Vol.2, pp.426-432, 2001.

Ankur Agarwal, Bill Triggs, “Tracking articulated motion with piecewise learned dynamical models”, European Conference on Computer Vision. Prague, Czech Republic, pp.54-65, 2004.

Xinyu Xu, Baoxin Li, Rao-Blackwellised, “Particle filter for tracking with application in visual surveillance”, The Second Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, San Diego, CA, USA, pp.17-24, 2005.

M. Kato, Y.W. Chen, G. Xu, “Articulated hand tracking by PCA-ICA approach”, Proceedings of IEEE Conference on Automatic Face and Gesture Recognition, Southampton, UK, pp.329-334, 2006.

M. Bray, E. Koller-Meier, N.N. Schraudolph, Van Gool L., “Fast stochastic optimization for articulated structure tracking”, Image and Vision Computing, Vol.25, No.3, pp.352-364, 2007.

Raskin, Rivlin L., Rudzsky E., “imensionality reduction for articulated body tracking”, 3DTV Conference, Kos Island, pp.14, 2007.

Qing Chen, Emil Petriu M., Nicolas Georganas. D., “3D hand tracking and motion analysis with a combination approach of statistical and syntactic analysis”, IEEE International Workshop on Haptic Audio Visual Environments and their Applications, Ottawa, Canada, pp.56-61, 2007.

N. Vaswani, “Particle filtering for large dimensional state spaces with multimodal observation likelihoods”, IEEE Transactions on Signal Processing, Vol.56, No.10, pp.4583-4597, 2008.

Daubney, Gibson B., Campbell D., N. “Real-time pose estimation of articulated objects using low-level motion”, IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska, USA, pp.1-8, 2008.

Xinxiao Wu, Wei Liang, Yunde Jia, “Tracking articulated objects by learning intrinsic structure of motion”, Pattern Recognition Letters, Vol.30, No.3, pp.267-274, 2009.

Robert Y.Wang, Jovan Popovi′c, “Real-time hand-tracking with a color glove”, ACM Transactions on Graphics (SIGGRAPH 2009), Vol.28, No.3, pp.1-8, 2009.

Zhenbo Li, Patrick Horain, André-Marie Pez, Catherine Pelachaud, “Statistical gesture models for 3D motion capture from a library of gestures with variants”, Gesture Workshop 2009 (GW2009), Bielefeld, Germany, LNAI 5934, pp.219-230, 2010.

B.E. John, 1998. “Cognitive modeling in human-computer interaction”, Proceedings of Graphics Interface, Vancouver, BC, Canada, pp.161-167, 1998.

B.E. John, D.E. Kieras, “Using GOMS for user interface design and evaluation: which technique?”, ACM Transaction. on Computer. Human. Interaction, Vol.3, No.4, pp.287-319, 1996.

Nikolay Stefanov, Aphrodite Galata, Roger Hubbold, “A realtime hand tracker using variable-length Markov models of behaviour”, Computer Vision and Image Understanding, Vol.108, No.1-2, pp.98-115, 2007.

Hix, Deborah, Hartson, Rex H., Developing User Interfaces Ensuring Usability Through Product and Process, New York: John Wiley & Sons. 1993.

Zhiquan Feng, Minming Zhang, Zhigen Pan, Bo Yang, Tao Xu, Haokui Tang, Yi Li, “3D-freehand-pose initialization based on operator's cognitive behavior models”, The Visual Computer, Vol.26, N0.6-8, pp.607-617, 2010.

Feng zhiquan, Yang bo, Zhang Ling, Zheng yanwei, Li yi, Song Xiaona, Wang zhonghua, “Research on camera calibration”,Journal of Information & Computational Science, Vol.5, No.2, pp.647-654, 2008.

D.P. Huttenlocher, G.A. Klanderman, W.J. Rucklidge, “Comparing images using the Hausdorff distance”, IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol.15, No.9, pp.850-863, 1993.

Relative Articles

Supplements(0)

Cited By

Proportional views