You could add a "high bandwidth & low latency" mode, where when active, you load the current video + the next one. So when the user goes to the next channel, it's already playing but muted and not visible, and you start playing the next-next channel hidden again :)