Social-Aware Stream codec

The marriage of Social and Multimedia is consummated and now a concrete reality. The association of tweets and TV broadcasts is now very common, as are the sharing of video clips, or video-based viral communication. However, if "live" (read "simultaneous") consumption of media and social streams is quite straightforward as globally "time-aligned", its replayability is more challenging to achieve. Indeed, a social stream, i.e. a time-dependent sequence of connected social objects, has specific properties that must be considered prior to any association with video, audio or text streams. We propose a data model and a codec mechanism that ensure the synchronization, the scalability and the integrity of media-related social interactions within a Social-Aware Multimedia Container. We experimented our solution with concrete use cases (Superbowl 47, French presidential election debate) and demonstrated that our approach is efficient, scalable and compatible with existing Web client and servers.