logo
banner

Journals & Publications

Journals Publications Papers

Papers

A Coupled Hidden Conditional Random Field Model for Simultaneous Face Clustering and Naming in Videos
Dec 16, 2016Author:
PrintText Size A A

Title: A Coupled Hidden Conditional Random Field Model for Simultaneous Face Clustering and Naming in Videos
Authors: Zhang, YF; Tang, ZQ; Wu, BY; Ji, Q; Lu, HQ
Author Full Names: Zhang, Yifan; Tang, Zhiqiang; Wu, Baoyuan; Ji, Qiang; Lu, Hanqing
Source: IEEE TRANSACTIONS ON IMAGE PROCESSING, 25 (12):5780-5792; 10.1109/TIP.2016.2601491 DEC 2016
Language: English
Abstract: For face naming in TV series or movies, a typical way is using subtitles/script alignment to get the time stamps of the names, and tagging them to the faces. We study the problem of face naming in videos when subtitles are not available. To this end, we divide the problem into two tasks: face clustering which groups the faces depicting a certain person into a cluster, and name assignment which associates a name to each face. Each task is formulated as a structured prediction problem and modeled by a hidden conditional random field (HCRF) model. We argue that the two tasks are correlated problems whose outputs can provide prior knowledge of the target prediction for each other. The two HCRFs are coupled in a unified graphical model called coupled HCRF where the joint dependence of the cluster labels and face name association is naturally embedded in the correlation between the two HCRFs. We provide an effective algorithm to optimize the two HCRFs iteratively and the performance of the two tasks on real-world data set can be both improved.
ISSN: 1057-7149
eISSN: 1941-0042
IDS Number: EC5VK
Unique ID: WOS:000388
*Click Here to View Full Record