Measurement of Facial Dynamics for Soft Biometrics

详细信息    查看全文

• 作者：Hamdi Dibeklio臒lu (17)
  Albert Ali Salah (18)
  Furkan G眉rp谋nar (19)
  
  17. Pattern Recognition and Bioinformatics Group ; Delft University of Technology ; Delft ; The Netherlands
  18. Department of Computer Engineering ; Bo臒azi莽i University ; Istanbul ; Turkey
  19. Computational Science and Engineering Program ; Bo臒azi莽i University ; Istanbul ; Turkey
  
• 关键词：Face analysis ; Facial dynamics ; Age estimation ; Smile classification ; Kinship estimation ; Affective computing ; Soft biometrics
• 刊名：Lecture Notes in Computer Science
• 出版年：2015
• 出版时间：2015
• 年：2015
• 卷：8912
• 期：1
• 页码：69-84
• 全文大小：870 KB
• 参考文献：1. Jain, AK, Dass, SC, Nandakumar, K Soft Biometric Traits for Personal Recognition Systems. In: Zhang, D, Jain, AK eds. (2004) Biometric Authentication. Springer, Heidelberg, pp. 731-738 CrossRef
  2. Viola, P, Jones, M (2001) Rapid object detection using a boosted cascade of simple features. CVPR 1: pp. 511-518
  3. Li, J., Zhang, Y.: Learning surf cascade for fast and accurate object detection. In: CVPR, pp. 3468鈥?475 (2013)
  4. Mathias, M, Benenson, R, Pedersoli, M, Gool, L Face Detection without Bells and Whistles. In: Fleet, D, Pajdla, T, Schiele, B, Tuytelaars, T eds. (2014) Computer Vision 鈥?ECCV 2014. Springer, Heidelberg, pp. 720-735 CrossRef
  5. Dibeklio臒lu, H, Salah, AA, Gevers, T (2012) A statistical method for 2-d facial landmarking. IEEE Trans. on Image Processing 21: pp. 844-858 CrossRef
  6. Cootes, T, Edwards, G, Taylor, C (2001) Active appearance models. IEEE Trans. on PAMI 23: pp. 681-685 CrossRef
  7. Cristinacce, D, Cootes, T (2008) Automatic feature localisation with constrained local models. Pattern Recognition 41: pp. 3054-3067 CrossRef
  8. Milborrow, S, Nicolls, F Locating Facial Features with an Extended Active Shape Model. In: Forsyth, D, Torr, P, Zisserman, A eds. (2008) Computer Vision 鈥?ECCV 2008. Springer, Heidelberg, pp. 504-513 CrossRef
  9. Xiong, X., De la Torre, F.: Supervised descent method and its applications to face alignment. In: CVPR, pp. 532鈥?39 (2013)
  10. Black, M.J., Yacoob, Y.: Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion. In: ICCV, pp. 374鈥?81 (1995)
  11. Bourel, F., Chibelushi, C.C., Low, A.A.: Robust facial feature tracking. In: Proc. 11th British Machine Vision Conference (2000)
  12. Tao, H, Huang, T (1999) Explanation-based facial motion tracking using a piecewise Bezier volume deformation model. CVPR 1: pp. 611-617
  13. Patras, I., Pantic, M.: Particle filtering with factorized likelihoods for tracking facial features. In: IEEE AFGR, pp. 97鈥?02 (2004)
  14. Pantic, M, Patras, I (2006) Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences. IEEE Trans. on Systems, Man, and Cybernetics, Part B. Cybernetics 36: pp. 433-449
  15. Valstar, MF, Pantic, M (2012) Fully automatic recognition of the temporal phases of facial actions. IEEE Trans. on Systems, Man, and Cybernetics, Part B. Cybernetics 42: pp. 28-43
  16. Yang, S., An, L., Bhanu, B., Thakoor, N.: Improving action units recognition using dense flow-based face registration in video. In: IEEE AFGR, pp. 1鈥? (2013)
  17. Littlewort, G., Whitehill, J., Wu, T., Fasel, I., Frank, M., Movellan, J., Bartlett, M.: The computer expression recognition toolbox (cert). In: IEEE AFGR, pp. 298鈥?05 (2011)
  18. Zafeiriou, L, Antonakos, E, Zafeiriou, S, Pantic, M Joint Unsupervised Face Alignment and Behaviour Analysis. In: Fleet, D, Pajdla, T, Schiele, B, Tuytelaars, T eds. (2014) Computer Vision 鈥?ECCV 2014. Springer, Heidelberg, pp. 167-183 CrossRef
  19. Jeni, LA, L\H{o}rincz, A, Szab贸, Z, Cohn, JF, Kanade, T Spatio-temporal Event Classification Using Time-Series Kernel Based Structured Sparsity. In: Fleet, D, Pajdla, T, Schiele, B, Tuytelaars, T eds. (2014) Computer Vision 鈥?ECCV 2014. Springer, Heidelberg, pp. 135-150 CrossRef
  20. Chen, S., Tian, Y., Liu, Q., Metaxas, D.N.: Segment and recognize expression phase by fusion of motion area and neutral divergence features. In: IEEE AFGR, pp. 330鈥?35 (2011)
  21. Yuce, A., Sorci, M., Thiran, J.P.: Improved local binary pattern based action unit detection using morphological and bilateral filters. In: IEEE AFGR, pp. 1鈥? (2013)
  22. Zhao, G, Pietikainen, M (2007) Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans. on PAMI 29: pp. 915-928 CrossRef
  23. Zhu, Y, Torre, F, Cohn, JF, Zhang, YJ (2011) Dynamic cascades with bidirectional bootstrapping for action unit detection in spontaneous facial behavior. IEEE Trans. on Affective Computing 2: pp. 79-91 CrossRef
  24. Wan, S, Aggarwal, J (2014) Spontaneous facial expression recognition: A robust metric learning approach. Pattern Recognition 47: pp. 1859-1868 CrossRef
  25. S茅n茅chal, T., Turcot, J., El Kaliouby, R.: Smile or smirk? automatic detection of spontaneous asymmetric smiles to understand viewer experience. In: IEEE AFGR, pp. 1鈥? (2013)
  26. Girard, J.M., Cohn, J.F., Mahoor, M.H., Mavadati, S., Rosenwald, D.P.: Social risk and depression: Evidence from manual and automatic facial expression analysis. In: IEEE AFGR, pp. 1鈥? (2013)
  27. Kaya, H., Salah, A.A.: Eyes whisper depression: A cca based multimodal approach. ACM Multimedia (2014)
  28. Yu, X., Zhang, S., Yu, Y., Dunbar, N., Jensen, M., Burgoon, J.K., Metaxas, D.N.: Automated analysis of interactional synchrony using robust facial tracking and expression recognition. In: IEEE AFGR, 1鈥? (2013)
  29. Ekman, P.: Telling lies. Cues to deceit in the marketplace, politics, and marriage. WW. Norton & Company, New York (1992)
  30. Ekman, P, Friesen, W (1978) The Facial Action Coding System: A Technique For The Measurement of Facial Movement. Consulting Psychologists Press Inc., San Francisco, CA
  31. Ekman, P, Friesen, WV (1982) Felt, false, and miserable smiles. J. Nonverbal. Behav. 6: pp. 238-252 CrossRef
  32. Velleman, P.F.: Definition and comparison of robust nonlinear data smoothing algorithms. Journal of the American Statistical Association, 609鈥?15 (1980)
  33. Dibeklio臒lu, H., Gevers, T., Salah, A.A., Valenti, R.: A smile can reveal your age: Enabling facial dynamics in age estimation. ACM Multimedia, 209鈥?18 (2012)
  34. Dibeklio臒lu, H, Salah, AA, Gevers, T Are You Really Smiling at Me? Spontaneous versus Posed Enjoyment Smiles. In: Fitzgibbon, A, Lazebnik, S, Perona, P, Sato, Y, Schmid, C eds. (2012) Computer Vision 鈥?ECCV 2012. Springer, Heidelberg, pp. 525-538 CrossRef
  35. Dibeklio臒lu, H., Salah, A.A., Gevers, T.: Like father, like son: Facial expression dynamics for kinship verification. In: ICCV, pp. 1497鈥?504 (2013)
  36. Cohn, J.F., Schmidt, K.L.: The timing of facial motion in posed and spontaneous smiles. Int. J. of Wavelets, Multiresolution and Information Processing 2, 121鈥?32 (2004)
  37. Dibeklio臒lu, H., Valenti, R., Salah, A.A., Gevers, T.: Eyes do not lie: Spontaneous versus posed smiles. ACM Multimedia, 703鈥?06 (2010)
  38. Pfister, T., Li, X., Zhao, G., Pietikainen, M.: Differentiating spontaneous from posed facial expressions within a generic facial expression recognition framework. In: ICCV Workshops, pp. 868鈥?75 (2011)
  39. Sanders, R (1973) Torsional elasticity of human skin in vivo. Pfl眉gers Archiv European Journal of Physiology 342: pp. 255-260 CrossRef
  40. Peleg, G, Katzir, G, Peleg, O, Kamara, M, Brodsky, L, Hel-Or, H, Keren, D, Nevo, E (2006) Hereditary family signature of facial expression. Proceedings of the National Academy of Sciences 103: pp. 15921-15926 CrossRef
  41. Peng, H, Long, F, Ding, C (2005) Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. on PAMI 27: pp. 1226-1238 CrossRef
  42. Fang, R., Tang, K.D., Snavely, N., Chen, T.: Towards computational models of kinship verification. In: IEEE ICIP, pp. 1577鈥?580 (2010)
  43. Guo, G, Wang, X (2012) Kinship measurement on salient facial features. IEEE Trans. on Instrumentation and Measurement 61: pp. 2322-2325 CrossRef
  44. Zhou, X., Lu, J., Hu, J., Shang, Y.: Gabor-based gradient orientation pyramid for kinship verification under uncontrolled environments. ACM Multimedia, 725鈥?28 (2012)
  
• 作者单位：Face and Facial Expression Recognition from Real World Videos
• 丛书名：978-3-319-13736-0
• 刊物类别：Computer Science
• 刊物主题：Artificial Intelligence and Robotics
  Computer Communication Networks
  Software Engineering
  Data Encryption
  Database Management
  Computation by Abstract Devices
  Algorithm Analysis and Problem Complexity
  
• 出版者：Springer Berlin / Heidelberg
• ISSN：1611-3349

文摘

Facial dynamics contain idiosyncratic information that can help appearance-based systems in a number of tasks. This paper summarizes our research on using facial dynamics as a soft biometric, in establishing the age and kinship similarity, as well as for assessing expression spontaneity. Our findings suggest that high-resolution and high-frequency information gathered from the face can be very informative, and result in systems that go beyond human performance in a number of domains.