Facial Analysis from Continuous Video with Applications to Human-Computer Interface

Bir Bhanu, Xuejun Tan9781402076510, 1402076517, 140207803X, 1402078021

Computer vision algorithms for the analysis of video data are obtained from a camera aimed at the user of an interactive system. It is potentially useful to enhance the interface between users and machines. These image sequences provide information from which machines can identify and keep track of their users, recognize their facial expressions and gestures, and complement other forms of human-computer interfaces.Facial Analysis from Continuous Video with Applications to Human-Computer Interfaces presents a learning technique based on information-theoretic discrimination which is used to construct face and facial feature detectors. This book also describes a real-time system for face and facial feature detection and tracking in continuous video. Finally, this book presents a probabilistic framework for embedded face and facial expression recognition from image sequences.Facial Analysis from Continuous Video with Applications to Human-Computer Interfaces is designed for a professional audience composed of researchers and practitioners in industry. This book is also suitable as a secondary text for graduate-level students in computer science and engineering.

---

Table of contents :
Team DDU……Page 1
Contents……Page 8
List of Figures……Page 12
List of Tables……Page 18
Preface……Page 22
Acknowledgments……Page 24
1. INTRODUCTION……Page 26
1 Facial Analysis for Human-Computer Interface……Page 27
1 The Bayes Classifier……Page 30
1.1 Two-class discrimination problem……Page 31
2.1 Kullback-Leibler divergence……Page 32
2.2 Nonparametric probability models……Page 33
2.3 Learning procedure……Page 34
2.4 Error bootstrapping……Page 38
3 Fast Classification……Page 39
3. FACE AND FACIAL FEATURE DETECTION……Page 40
1 Previous Approaches……Page 41
2.1 Multi-scale detection of faces……Page 42
2.2 Facial feature detection……Page 45
3 Discussion……Page 47
1 Visual Object Tracking and Motion Analysis……Page 50
2 Previous Approaches……Page 52
3.1 Feature matching……Page 53
3.3 Initialization……Page 54
4 Global Head Position Analysis……Page 57
5. FACE AND FACIAL EXPRESSION RECOGNITION……Page 60
1.1 Face recognition……Page 61
1.2 Facial expression analysis……Page 62
2 Modelling Faces by Facial Features……Page 63
2.1 Class-conditional probability of the feature images……Page 65
3 Modeling Temporal Information of Facial Expressions……Page 66
1.1 The Model-Based Approach……Page 68
1.2 Model-Based Analysis……Page 69
1.4 Virtual Agent……Page 70
2 Modelling and Analysis……Page 71
2.1.1 3D Surface Modelling……Page 72
2.1.2 Generic Face Model from MRI Data……Page 73
2.1.3 Face Geometric Model Fitting……Page 74
2.1.4 Face Geometric Model Compression……Page 76
2.2.1 Articulation Parameters……Page 77
2.2.2 Model Deformation……Page 78
2.3.1 Environment Model……Page 80
2.3.2 Texture Mapping……Page 81
3.1 Review of Past and Current Work……Page 82
3.1.2 Rigid Motion……Page 83
3.1.3 Non-Rigid Motion……Page 84
3.2.1 2D-3D Pose Estimation……Page 85
3.2.2 Pose Optimization……Page 87
3.2.3 Filtering and Prediction……Page 88
3.3 Tracking Non-Rigid Local Motion……Page 89
3.3.1 2D Motion + Constraints……Page 90
3.3.2 Model-Based Non-Rigid Local Motion Estimation……Page 92
4 Model-based Video System Implementation……Page 93
4.1 Tracking Non-Rigid Local Motion……Page 94
4.2 Tracking System……Page 95
4.2.2 Tracking Loop……Page 96
4.3 Practical Implementation Issues……Page 97
1.1 FERET database……Page 100
1.2 CMU/MIT database for face detection……Page 101
1.3 Face video database……Page 102
2 Face Detection in Complex Backgrounds……Page 104
2.1 Further comparison issues……Page 107
3.1 Facial feature detection……Page 108
4 Face and Facial Expression Recognition……Page 119
4.1 Face recognition……Page 123
4.2 Facial expression recognition……Page 128
4.3 Model-based Video Coding……Page 131
8. APPLICATION IN AN AUDIO-VISUAL PERSON RECOGNITION SYSTEM……Page 142
1 Speaker Identification Based on MFCC and GMM……Page 143
3 Experimental Results……Page 144
9. CONCLUSIONS……Page 146
Index……Page 158