Trick play of streaming media

• US 8,365,235 B2
• Filed: 09/05/2008
• Issued: 01/29/2013
• Est. Priority Date: 12/18/2007
• Status: Active Grant

• Current Assignee: Netflix, Inc.
• Original Assignee: Netflix, Inc.
• Inventors: Hunt, Neil D., Twerdahl, Timothy, Traverso M., Marcelo, Shannon, Douglas
• Primary Examiner(s): SHANG, ANNAN Q
• Application Number:
  US12/205,118
• Publication Number:
  US 20090158326A1
• Time in Patent Office: 1,607 Days
• Field of Search: 725 37- 61, 725 87- 89, 209217-231
• US Class Current: 725/88
• CPC Class Codes: G06F 16/743 a collection of video files or sequences
• CPC Class Codes: G06F 16/745 the internal structure of a single video sequence
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04855 Interaction with scrollbars
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate

Abstract

A data processing system, comprising a network interface configured to couple to a data network; one or more processors coupled to the network interface; memory coupled to the one or more processors; a video interface coupled to the one or more processors and configured to output video data to a video display device; logic encoded in one or more computer-readable media wherein execution by the one or more processors causes receiving and storing in the memory a plurality of still images from an audiovisual program, wherein each of the still images is associated with a sequentially later time point within the audiovisual program; receiving first user input specifying invocation of a trick play mode of playing the audiovisual program; generating video output to the video interface wherein the video output comprises a first image position comprising one or more of the still images, a linearly second image position comprising one of the still images, and a linearly third image position comprising one or more of the still images; wherein the still images in the video output are arranged in the image positions in sequential order according to time point within the audiovisual program; generating updated video output to the video interface in which the still image of the second image position is shifted into the first image position, one of the still images of the third image position is shifted into the second image position, and one or more new still images are in the third image position.

Claims

1. A data processing system to simulate video output of a requested trick play mode, the data processing system comprising:

a network interface configured to couple to a data network;

one or more processors coupled to the network interface;

memory coupled to the one or more processors;

a video interface coupled to the one or more processors and configured to output video data to a video display device; and

one or more computer-readable media that include instructions that, when executed by the one or more processors, cause;

receiving and storing in the memory a plurality of different still images from an audiovisual program, wherein each of the still images is associated with a distinct time point within the audiovisual program;

receiving, during normal playback of the audiovisual program, a first user input requesting invocation of a trick play mode of playing the audiovisual program, wherein normal playback of the audiovisual program comprises generating video output based on the audiovisual program, wherein the requested trick play mode comprises one of fast-forward playback and reverse playback of the audiovisual program; and

responsive to the first user input, generating, based on the still images, a video output sequence that simulates video output of the requested trick play mode.

2. The data processing system of claim 1, wherein generating the video output sequence comprises generating video output to the video interface that comprises a first image position comprising a first of the still images, a second image position comprising a second of the still images, and a third image position comprising a third of still images, wherein each still image in the generated video output to the video interface is different, and wherein the instructions are further operable to generate updated video output to the video interface in which the still image of the second image position is shifted into the third image position, the still image of the first image position is shifted into the second image position, and a new still image appears in the first image position.

3. The data processing system of claim 1, wherein generating the video output sequence comprises generating video output to the video interface that comprises a first image position comprising a first of the still images, a second image position comprising a second of the still images, and a third image position comprising a third of still images, wherein each still image in the generated video output to the video interface is different, and wherein the instructions are further operable to select a new still image for the third image position of the updated video output by skipping over one or more of the still images that have been received and stored.

4. The data processing system of claim 1, wherein generating the video output sequence comprises generating video output to the video interface that comprises a first image position comprising a first of the still images, a second image position comprising a second of the still images, and a third image position comprising a third of still images, wherein each still image in the generated video output to the video interface is different, wherein the first user input specifies a particular movement speed among a plurality of movement speeds, wherein the instructions are further operable to select a new still image for the third image position of the updated video output by skipping over one or more of the still images that have been received and stored, and wherein the skipping is performed at a rate proportional to the particular movement speed.

5. The data processing system of claim 1, wherein the instructions are further operable to cause requesting the plurality of still images from a streaming media delivery system in response to receiving user input that selects an audiovisual program from among a plurality of available audiovisual programs.

6. The data processing system of claim 1, wherein the instructions are further operable to perform receiving and storing in the memory the plurality of still images in a first file and receiving and storing in the memory at least a portion of a streaming file representing the audiovisual program.

7. The data processing system of claim 1, wherein the instructions are further operable to perform the receiving and storing the plurality of still images in response to receiving user input that selects the audiovisual program from among a plurality of available audiovisual programs that are displayed in a list.

8. The data processing system of claim 1, wherein the first user input corresponds to selecting and dragging a slider of a media player application.

9. The data processing system of claim 1, wherein normal playback of the audiovisual program comprises generating, based on the audiovisual program, video output at a predefined playback rate and in a predefined playback direction, wherein faster playback comprises generating video output at a playback rate faster than the predefined playback rate of normal playback, and wherein reverse playback comprises generating video output in a playback direction opposite of the predefined playback direction of normal playback.

10. The data processing system of claim 9, where the video output sequence is generated without generating the video output of the requested trick play mode based on the audiovisual program, wherein the video output sequence is not generated directly based on the audiovisual program responsive to the first user input, and wherein the video output of the requested trick play mode is not generated based on the still images, wherein the video output sequence is generated to avoid processing costs associated with generating the video output of the requested trick play mode.

11. The data processing system of claim 10, wherein generating the video output sequence comprises:

generating video output to the video interface that comprises a first image position comprising a first of the still images, a second image position comprising a second of the still images, and a third image position comprising a third of still images, wherein each still image in the generated video output to the video interface is different; and

generating updated video output to the video interface, in which the still image of the second image position is shifted into the first image position, the still image of the third image position is shifted into the second image position, and a new still image appears in the third image position, thereby simulating video output of the requested trick play mode at each of the first, second, and third image positions.

12. The data processing system of claim 11, wherein the still image included in the second image position is more prominently conveyed than the still images included in the first image position and the third image position, respectively, wherein the still images in each of the first, second, and third image positions are arranged substantially linearly along a common line, and wherein the still images in the video output to the video interface are arranged in the first, second, and third image positions in sequential order according to the time points within the audiovisual program.

13. The data processing system of claim 12, wherein the instructions are further operable to, responsive to a second user input requesting invocation of a trick play mode of playing the audiovisual program, the trick play mode comprising a second one of faster playback and reverse playback of the audiovisual program, different from that which is requested in the first user input, generate updated video output to the video interface in which the still image of the second image position is shifted into the third image position, the still image of the first image position is shifted into the second image position, and a new still image appears in the first image position.

14. The data processing system of claim 13, wherein the first user input specifies a particular movement speed among a plurality of movement speeds, wherein the instructions are further operable to select the new still image for the third image position of the updated video output by skipping over one or more of the still images that have been received and stored, and wherein the skipping is performed at a rate proportional to the particular movement speed.

15. The data processing system of claim 14, wherein the instructions are further operable to cause requesting the plurality of still images from a streaming media delivery system in response to receiving user input that selects an audiovisual program from among a plurality of available audiovisual programs, and wherein the instructions are further operable to perform receiving and storing in the memory the plurality of still images in a first file and receiving and storing in the memory at least a portion of a streaming file representing the audiovisual program, wherein the streaming file is stored independently of the second file.

16. A non-transitory machine-readable medium to simulate video output of a requested trick play mode, the non-transitory machine-readable medium comprising one or more sequences of instructions which when executed by one or more processors cause the one or more processors to perform:

receiving and storing in a memory a plurality of different still images from an audiovisual program, wherein each of the still images is associated with a distinct time point within the audiovisual program;

receiving, during normal playback of the audiovisual program, a first user input requesting invocation of a trick play mode of playing the audiovisual program, wherein normal playback of the audiovisual program comprises generating video output based on the audiovisual program, wherein the requested trick play mode comprises one of fast-forward playback and reverse playback of the audiovisual program; and

responsive to the first user input and by operation of the one or more processors when executing the instructions, generating, based on the still images, a video output sequence that simulates video output of the requested trick play mode.

17. The non-transitory machine-readable medium of claim 16, wherein generating the video output sequence comprises generating video output to the video interface that comprises a first image position comprising a first of the still images, a second image position comprising a second of the still images, and a third image position comprising a third of still images, wherein each still image in the generated video output to the video interface is different, and wherein the non-transitory machine-readable medium further comprises instructions which when executed cause generating updated video output in which the still image of the second image position is shifted into the third image position, the still image of the first image position is shifted into the second image position, and a new still image appears in the first image position.

18. The non-transitory machine-readable medium of claim 16, wherein generating the video output sequence comprises generating video output to the video interface that comprises a first image position comprising a first of the still images, a second image position comprising a second of the still images, and a third image position comprising a third of still images, wherein each still image in the generated video output to the video interface is different, and wherein the non-transitory machine-readable medium further comprises instructions which when executed cause selecting a new still image for the third image position of the updated video output by skipping over one or more of the still images that have been received and stored.

19. The non-transitory machine-readable medium of claim 16, wherein generating the video output sequence comprises generating video output to the video interface that comprises a first image position comprising a first of the still images, a second image position comprising a second of the still images, and a third image position comprising a third of still images, wherein each still image in the generated video output to the video interface is different, wherein the first user input specifies a particular movement speed among a plurality of movement speeds, wherein the non-transitory machine-readable medium further comprises instructions which when executed cause selecting a new still image for the third image position of the updated video output by skipping over one or more of the still images that have been received and stored, and wherein the skipping is performed at a rate proportional to the particular movement speed.

20. The non-transitory machine-readable medium of claim 16, further comprising instructions which when executed cause requesting the plurality of still images from a streaming media delivery system in response to receiving user input that selects an audiovisual program from among a plurality of available audiovisual programs.

21. The non-transitory machine-readable medium of claim 16, further comprising instructions which when executed cause receiving and storing in the memory the plurality of still images in a first file and receiving and storing in the memory at least a portion of a streaming file representing the audiovisual program.

22. The non-transitory machine-readable medium of claim 16, further comprising instructions which when executed cause performing the receiving and storing the plurality of still images in response to receiving user input that selects the audiovisual program from among a plurality of available audiovisual programs that are displayed in a list.

23. The non-transitory machine-readable medium of claim 16, wherein the first user input corresponds to selecting and dragging a slider of a media player application.

24. A data processing system to simulate video output of a requested trick play mode, the data processing system comprising:

a network interface configured to couple to a data network;

one or more processors coupled to the network interface;

memory coupled to the one or more processors;

a video interface coupled to the one or more processors and configured to output video data to a video display device; and

one or more computer-readable media that include instructions that, when executed by the one or more processors, causes;

responsive to user selection of an audiovisual program that comprises a plurality of different episodes, generating video output to the video interface, wherein the video output comprises a set of different icons arranged substantially linearly along a common line representing a plurality of the episodes in a sequential order, and wherein a particular icon representing a particular episode that was most recently watched is conveyed more prominently than each of the other icons in the set of icons, and

responsive to a user request, during normal playback of a selected episode of the plurality of episodes of the selected audiovisual program, to invoke a trick play mode of playing the selected episode, generating, based on a plurality of still images previously stored from the selected episode, a video output sequence that simulates video output of the requested trick play mode, wherein normal playback of the audiovisual program comprises generating video output based on the audiovisual program, wherein the requested trick play mode comprises one of fast-forward playback and reverse playback of the audiovisual program.

25. The data processing system of claim 24, wherein each icon that is associated with a previously watched episode comprises a marking indicating that the episode was watched.

26. The data processing system of claim 24, wherein the particular icon further comprises an operation icon representing a playback operation and which when selected causes requesting, receiving and displaying streaming video data of the particular episode.

27. The data processing system of claim 24, wherein the sequential order is an order in which the episodes originally aired.

28. The data processing system of claim 24, wherein the instructions are further operable to perform:

generating the video output to the video interface wherein the video output comprises a first image position comprising one or more of the icons, a second image position comprising the particular icon, and a third image position comprising one or more of the icons, wherein the icons in each of the first, second, and third image positions are arranged linearly along the common line;

receiving user input specifying selection of a different icon representing a different episode of the selected audiovisual program, that is later in the order than the particular episode that was most recently watched; and

generating updated video output to the video interface in which the particular icon is shifted into the first position, one of the icons of the third position is shifted into the second position, and one or more icons representing different episodes that are later in the order are in the third image position.

29. The data processing system of claim 24, wherein the instructions are further operable to perform:

generating the video output to the video interface wherein the video output comprises a first image position comprising one or more of the icons, a second image position comprising the particular icon, and a third image position comprising one or more of the icons, wherein the icons in each of the first, second, and third image positions are arranged linearly along the common line;

receiving user input specifying selection of a different icon representing a different episode that is earlier in the order than the particular episode that was most recently watched; and

generating updated video output to the video interface in which the particular icon is shifted into the third position, one of the icons of the first position is shifted into the second position, and one or more icons representing different episodes that are earlier in the order appear in the first image position.

30. The system of claim 24, wherein the instructions are further operable to perform generating the video output further including a textual summary of the particular episode associated with the particular icon.

31. A non-transitory computer-readable medium to simulate video output of a requested trick play mode, the non-transitory computer-readable medium comprising one or more sequences of instructions which when executed by one or more processors cause the one or more processors to perform:

responsive to user selection of an audiovisual program that comprises a plurality of different episodes, generating video output to the video interface, wherein the video output comprises a set of different icons arranged substantially linearly along a common line representing a plurality of the episodes in a sequential order, and wherein a particular icon representing a particular episode that was most recently watched is conveyed more prominently than each of the other icons in the set of icons; and

responsive to a user request, during normal playback of a selected episode of the plurality of episodes of the selected audiovisual program, to invoke a trick play mode of playing the selected episode, generating, based on a plurality of still images previously stored from the selected episode, a video output sequence that simulates video output of the requested trick play mode, wherein normal playback of the audiovisual program comprises generating video output based on the audiovisual program, wherein the requested trick play mode comprises one of fast-forward playback and reverse playback of the audiovisual program.