VlogSense: Understanding nonverbal behavior in social media

old_uid10977
titleVlogSense: Understanding nonverbal behavior in social media
start_date2012/03/08
schedule13h30
onlineno
location_infoAmpère, salle B314
summaryVideo blogging (vlogging) has evolved from its "chat from your bedroom" initial format to a highly creative form of expression and communication, and represents one of the most popular types of user-generated content on sites like YouTube. Recent research in computational social media, including mining of blogs and online social networks, has made much progress on automatically analyzing text sources. However, human communication is more than the words we write: the nonverbal channel - gaze, facial expressions, gestures and postures, prosody - plays a key role in the formation, maintenance, and evolution of a number of fundamental social constructs in face-to-face and remote communication settings. In this talk, I will argue that the nonverbal channel available in vlogging opens several promising research lines in social media, and will present an overview of my group's ongoing work on automatic vlogging analysis from the nonverbal perspective. First, vlogging is multimodal in nature, and I will present audio and visual processing methods to characterize vloggers' nonverbal communicative behavior from cameras and microphones. Then, I will examine connections between vlogging behavior and large-scale social attention. I will also discuss work on personality impressions in vlogging obtained via crowdsourcing, and their relation to nonverbal behavior. The talk will close by presenting some of the open research problems related to this novel form of interaction.
responsiblesLoevenbruck, Welby