Joint Block-Based Video Source/Channel Coding for Packet-Switched Networks

Block-based video coders rely on motion compensated block prediction for more data compression. With the introduction of video coding over packet-switched networks such as the Internet and the resulting packet loss that occurs on congested networks, coding mode selection for each macro-block is significant in determining the overall distortion on the decoded video sequence. In this work, we examine the problem of mode selection for macro-blocks in the presence of loss and a channel rate constraint. We present and evaluate several methods for mode selection that attempt to minimize perceptual distortion from packet loss. We formulate simplified problem which is useful for gaining some insight, and present an efficient algorithm to finding an optimal solution.