Automatic Lip Contour Extraction Using Both Pixel-based and Parametric Models

WU Wenchao; KURUOGLU Ercan Engin; WANG Shilin; LI Shenghong; LI Jianhua

Article Contents

Article Navigation > Chinese Journal of Electronics > 2013 > 22(1): 76-82

WU Wenchao, KURUOGLU Ercan Engin, WANG Shilin, LI Shenghong, LI Jianhua. Automatic Lip Contour Extraction Using Both Pixel-based and Parametric Models[J]. Chinese Journal of Electronics, 2013, 22(1): 76-82.

Citation:

WU Wenchao, KURUOGLU Ercan Engin, WANG Shilin, LI Shenghong, LI Jianhua. Automatic Lip Contour Extraction Using Both Pixel-based and Parametric Models[J]. Chinese Journal of Electronics, 2013, 22(1): 76-82.

Citation:

PDF( 4059 KB)

Automatic Lip Contour Extraction Using Both Pixel-based and Parametric Models

1.
School of Information Security Engineering, Shanghai Jiao Tong University, Shanghai 200240, China;
2.
School of Electrical and Computer Engineering, Georgia Institute of Technology, Georgia 30332, USA;
3.
Institute of Science and Technology of Information, Italian National Council of Research, Via G Moruzzi 1, 56124, Pisa, Italy

Funds: This work was carried out when the first author was with the SJTU-Georgia Tech Graduate Program. This work is supported by the National Natural Science Foundation of China (No.60702043, No.61071152).

Received Date: 2012-05-01
Rev Recd Date: 2012-07-01
Publish Date: 2013-01-05

Abstract

Abstract

Lip segmentation, a sub-step of facial analysis, becomes more and more important in the fields of pattern recognition and human-computer interaction. In this paper, a novel algorithm for lip contour extraction that combines the merits of the pixel-based model and the parametric model is presented. Lip corner detection is the first step of this algorithm, utilizing a three-curve lip model to describe lip contour. The improved “Jumping Snake” algorithm is used to extract feature points for lip model implementation, which makes the novel algorithm more accurate and flexible. It is also made more robust with the introduction of geometric constraints. Experiments show that this approach with geometric constraints provides satisfactory results. It can also serve as an initial attempt for further applications.
- Lip contour extraction,
- Lip segmentation,
- Lip modeling,
- Jumping snake,
- Parametric model

FullText(HTML)

References(26)

References

L.L. Wu, S.J. Wang, “Study on closed-set speaker identificationbased on biomimetic pattern recognition”, Chinese Journal ofElectronics, Vol.18, No.2, pp.259-261, 2009.

J.A. Dargham and A. Chekima, “Lips detection in the normalisedrgb colour scheme”, Proceedings of 2nd Informationand Communication Technologies, ICTTA’06,Damascus, Vol.1,pp.1546-1551, 2006.

V. Vezhnevets, V. Sazonov and A. Andreeva, “A survey onpixel-based skin color detection techniques”, Proceedings ofGRAPHICON03, London, pp.85-92, 2003.

R.L. Hsu, M. Abdel-Mottaleb and A.K. Jain, “Face detectionin color images”, IEEE Transactions on Pattern Analysis andMachine Intelligence, Vol.24, No.5, pp.696-706, 2002.

J.Y. Kim, S.Y. Na and R. Cole, “Lip detection using confidencebased adaptive thresholding”, Lecture Notes in Computer Science,Vol.4291, pp.731-740, 2006.

M. Li, Y.M. Cheung, “Automatic lip localization under face illumination with shadow consideration”, Signal Processing,Vol.89, No.12, pp.2425-2434, 2009.

A.E. Salazar, J.E Hernandez and F. Prieto, “Automatic quantitativemouth shape analysis”, Lecture Notes in Computer Science,Vol.4673, pp.416-423, 2007.

L. Zhang, “Estimation of the mouth features using deformabletemplates”, Proceedings of International Conference on ImageProcessing (ICIP 1997), Washington DC, Vol.3, pp.328-331,1997.

Q.D. Nguyen, M. Milgram, T.H. Nguyen, “Multi featuresmodels for robust lip tracking”, Proceedings of the InternationalConference on Control, Automation, Robotics and Vision,Hanoi, Vietnam, pp.1333-1337, 2008.

R.A. Rao and R.M. Mersereau, “Lip modeling for visual speechrecognition”, 1994 Conference Record of the Twenty-EighthAsilomar Conference on Signals, Systems and Computers, PacificGrove, CA, Vol.1, pp.587-590, 1994.

X. Liu, Y.M. Cheung, M. Li, H. Liu, “A lip contour extractionmethod using localized active contour model with automatic parameterselection”, Proceedings of the IEEE International Conferenceon Pattern Recognition, Istanbul, pp.4332-4335, 2010.

P. Delmas, N. Eveno and M. Li’evin, “Towards robust lip tracking”,Proceedings of the 16th International Conference on PatternRecognition, Quebec, Vol.2, pp.528-531, 2002.

S. Werda, W. Mahdi et al., “Colour and geometric based modelfor lip localisation: Application for lip-reading system”, Proceedingsof 14th International Conference on Image Analysisand Processing (ICIAP 2007), Modena, pp.9-14, 2007.

M.O. Berger, R. Mohr, “Towards Autonomy in Active ContourModels”, 10th international Conference on Pattern Recognition(ICPR’90), Atlantic City, pp.847-851, 1990.

P. Delmas, N. Eveno, M. Lievin, “Towards Robust Lip Tracking”,16th International Conference on Pattern Recognition(ICPR’02), Quebec, pp.528-531, 2002.

T.W. Lewis, D.M. Powers, “Lip Feature Extraction Using RedExclusion”, Proc. Selected papers from Pan-Sydney Workshopon Visual Information Processing, Sydney, Australia. Conferencesin Research and Practice in Information Technology,Eades P. and Jin J., Eds. ACS. Vol.2, pp.61-67, 2001.

R. Rao and R.Mersereau, “Lip modeling for visual speech recognition”,28th Annual Asimolar Conference on Signals, Systems,and Computers, Pacific Grove, IEEE Computer Society, Vol.1,pp.587-590, 1994.

S.L. Wang et al., ‘Automatic lip contour extraction from colorimages”, Pattern Recognition, Vol.37, pp.2375-2387, 2004.

Y.P. Guan, “Automatic extraction of lip based on wavelet edgedetection”, Eighth International Symposium on Symbolic andNumeric Algorithms for Scientific Computing (SYNASC’06),Timisoara, pp.125-132, 2006.

M. Kass, A. Witkins, D. Tersopoulos, “Snakes: Actives contoursmodels”, International Journal of Computer Vision, Vol.1,No.4, pp.321-331, 1988.

Z. Hammal, N. Eveno, A. Caplier and P.Y. Coulon, “Parametricmodels for facial features segmentation”, Signal Process, Vol.86,No.2, pp.399-413, 2006.

L. Zhang, “Estimation of the mouth features using deformabletemplates”, Proceedings of International Conference on ImageProcessing (ICIP 1997), Santa Barbara, Vol.3, pp.328-331,1997.

M.U. Ramos-Sanchez, J. Matas and J. Kittler, “Statistical chromaticitybasedlip tracking with b-splines”, Proceedings of IEEEInternational Conference on Acoustics, Speech and Signal Processing(ICASSP 1997), Munich, pp.IV 2973-IV 2976, 1997.

A.R. Martinez and R. Benavente, “The AR face database”,Technical Report 24, Computer Vision center (CVC), Universidadaut’onoma de barcelona, barcelona, 1998. Technical report.

T. Wark, S. Sridharan et al., “An Approach to Statistical LipModelling for Speaker Identification via Chromatic Feature Extraction”,Proceedings of the 14th International Conference onPattern Recognition, Jain A., Venkatesh S. and Lovell B. (eds.),Brisbane, Queensland Institute of Electrical and Electronics Engineers,New Jersey, USA, pp.123-125, 1998.

A.W.C. Liew, S.H. Leung, W.H. Lau, “Lip contour extractionfrom color images using a deformable model”, Pattern Recognition,Vol.35, pp.2949-2962, 2002.

Relative Articles

Supplements(0)

Cited By

Proportional views