Video player with assisted seek

• US 10,545,652 B2
• Filed: 05/08/2016
• Issued: 01/28/2020
• Est. Priority Date: 12/22/2010
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Frumar, Julian, Schrock, Jasson, Junee, Ryan, Ratner, Simon, Stearns, Geoff
• Primary Examiner(s): Tran, Tuyetlien T
• Application Number:
  US15/149,146
• Publication Number:
  US 20160306539A1
• Time in Patent Office: 1,360 Days
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/437 Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server flow control in data networks H04L47/10; streaming protocols, e.g. RTP or RTCP, H04L65/65; scheduling or organising the servicing of application requests in data packet switching networks H04L67/60
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/8153 comprising still images, e.g. texture, background image
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

A method for navigating video content comprising the steps of receiving a video content item; receiving a plurality of thumbnails from the video content item, each thumbnail associated with a time point in the video content item; playing the video content item starting at a first time point; receiving in the user interface a gesture having a magnitude and a direction, the magnitude associated with a speed of playing of the video content item, the direction associated with a direction of playing of the video content item, and the gesture received at a second time point in the video content item; displaying a first subset of the plurality of thumbnails; receiving a selection of a third time point in the video content item; and playing the video content item at the third time point.

Claims

1. A method comprising:

requesting a video content item for viewing;

receiving a stream including the video content item;

receiving a plurality of thumbnails, each thumbnail associated with a time point in the video content item;

playing, in a media player portion of a user interface, the video content item starting at a first time point;

receiving, at a viewing progress bar on the user interface, a selection gesture at a second time point in the video content item;

responsive to the receiving of the selection gesture;

presenting, in the media player portion of the user interface, first content of the video content item at the second time point; and

presenting a first subset of the plurality of thumbnails in a thumbnail portion of the user interface, the first subset of the plurality of thumbnails arranged chronologically and including a thumbnail associated with the second time point, wherein the thumbnail associated with the second time point is amplified in size, reflects the first content of the video content item at the second time point and is presented concurrently with the first content of the video content item at the second time point in the media player portion;

receiving, on the user interface, a drag gesture to a third time point in the video content item, the drag gesture having a magnitude and a direction; and

responsive to the receiving of the drag gesture to the third time point in the video content item, seeking to the third time point in the video content item at a first speed in a first direction based on the magnitude and the direction of the drag gesture while presenting one or more subsets of the plurality of thumbnails at a scrolling speed based on the magnitude of the drag gesture, the one or more subsets of the plurality of thumbnails reflecting one or more portions of the video content item that appear during the seeking, wherein each subset of the plurality of thumbnails corresponds to a respective portion of the video content item that appears during the seeking and is arranged chronologically, wherein when second content of the video content item is presented at a fourth time point occurring during the seeking, at least one thumbnail of the one or more subsets of the plurality of thumbnails is presented concurrently with the second content of the video content item at the fourth time point in the media player portion, and reflects the second content of the video content item at the fourth time point during the seeking.

2. The method of claim 1, further comprising:

receiving a selection of a fifth time point in the video content item associated with one of the one or more subsets of the plurality of thumbnails and a requesting the stream starting at the fifth time point;

receiving the stream of the video content item starting at the fifth time point; and

playing the video content item at the fifth time point.

3. The method of claim 1 wherein:

the video content item is played at a second speed; and

the one or more subsets of the plurality of thumbnails are presented at a third speed based on the second speed.

4. The method of claim 3 wherein the at least one thumbnail is amplified in size in the thumbnail portion of the user interface during the seeking while the second content of the video content item is concurrently presented in the media player portion of the user interface at the fourth time point.

5. The method of claim 1 further comprising presenting an indicator indicating the magnitude and the direction of the drag gesture, the magnitude represented visually by how far the indicator extended, the indicator displayed adjacent to the thumbnail that is displayed at the larger size.

6. A method comprising:

requesting, by a client device from a server over a network, a video content item;

receiving, by the client device from the server over the network, a stream including the video content item;

receiving, by the client device, a plurality of thumbnails, each thumbnail associated with a time point in the video content item;

presenting, in a media player portion of a user interface on the client device, the video content item;

receiving at a viewing progress bar on the user interface a selection gesture at a first time point of the video content item;

responsive to the receiving of the selection gesture;

presenting, in the media player portion of the user interface, first content of the video content item at the first time point;

presenting, in a thumbnail portion of the user interface, a plurality of frames comprising one largest frame; and

presenting, in the thumbnail portion, a first subset of the plurality of thumbnails with each thumbnail of the first subset in each frame of the plurality of frames, the first subset of the plurality of thumbnails arranged chronologically and including a first thumbnail associated with the first time point, wherein the first thumbnail is displayed in the largest frame, reflects the first content of the video content item at the first time point and is presented concurrently with the first content of the video content item at the first time point in the media player portion;

receiving, on the user interface a drag gesture to a second time point in the video content item, the drag gesture having a magnitude and a direction; and

responsive to the receiving of the drag gesture to the third time point in the video content item, seeking to the second time point in the video content item at a first speed in a first direction based on the magnitude and the direction of the drag gesture while presenting one or more subsets of the plurality of thumbnails in the plurality of frames at a scrolling speed based on the magnitude of the drag gesture, the one or more subsets of the plurality of thumbnails reflecting one or more portions of the video content item that appear during the seeking, wherein each subset of the plurality of thumbnails corresponds to a respective portion of the video content item that appears during the seeking and is arranged chronologically, wherein when second content of the video content item is presented at a third time point occurring during the seeking, at least one thumbnail of the one or more subsets of the plurality of thumbnails is presented in the largest frame concurrently with the second content of the video content item at the third time point in the media player portion, and reflects the second content of the video content item at the third time point during the seeking.

7. The method of claim 6 wherein presenting the video content item comprises:

presenting the video content item at a second speed and a second direction responsive to the magnitude and direction of the drag gesture being updated.

8. The method of claim 7 further comprising receiving no gesture on the user interface at a fourth time point in the video content item and presenting the video content item starting at the fourth time point at the second speed and second direction responsive to receiving no gesture.

9. The method of claim 6 wherein the plurality of thumbnails comprise a thumbnail associated with a time point in the video content item that has not yet been received.

10. The method of claim 6 further comprising presenting an indicator indicating the magnitude and the direction of the drag gesture, the magnitude represented visually by how far the indicator extended, the indicator displayed adjacent to the thumbnail that is presented in the largest frame.

11. A non-transitory computer readable medium including instructions, which when executed by a processor, cause the processor to perform operations comprising:

requesting a video content item for viewing;

receiving a stream including the video content item;

receiving a plurality of thumbnails, each thumbnail associated with a time point in the video content item;

playing, in a media player portion of a user interface, the video content item starting at a first time point;

receiving, at a viewing progress bar on the user interface, a selection gesture at a second time point in the video content item;

responsive to the receiving of the selection gesture;

presenting, in the media player portion of the user interface, first content of the video content item at the second time point; and

presenting a first subset of the plurality of thumbnails in a thumbnail portion of the user interface, the first subset of the plurality of thumbnails arranged chronologically and including a thumbnail associated with the second time point, wherein the thumbnail associated with the second time point is amplified in size, reflects the first content of the video content item at the second time point and is presented concurrently with the first content of the video content item at the second time point in the media player portion;

receiving, on the user interface, a drag gesture to a third time point in the video content item, the drag gesture having a magnitude and a direction; and

responsive to the receiving of the drag gesture to the third time point in the video content item, seeking to the third time point in the video content item at a first speed in a first direction based on the magnitude and the direction of the drag gesture while presenting one or more subsets of the plurality of thumbnails at a scrolling speed based on the magnitude of the drag gesture, the one or more subsets of the plurality of thumbnails reflecting one or more portions of the video content item that appear during the seeking, wherein each subset of the plurality of thumbnails corresponds to a respective portion of the video content item that appears during the seeking and is arranged chronologically, wherein when second content of the video content item is presented at a fourth time point occurring during the seeking, at least one thumbnail of the one or more subsets of the plurality of thumbnails is presented concurrently with the second content of the video content item at the fourth time point in the media player portion, and reflects the second content of the video content item at the fourth time point during the seeking.

12. The non-transitory computer readable medium of claim 11, wherein the operations further comprise:

receiving a selection of a fifth time point in the video content item associated with one of the one or more subsets of the plurality of thumbnails and a requesting the stream starting at the fifth time point;

receiving the stream of the video content item starting at the fifth time point; and

playing the video content item at the fifth time point.

13. The non-transitory computer readable medium of claim 11, wherein:

the video content item is played at a second speed; and

the one or more subsets of the plurality of thumbnails are presented at a third speed based on the second speed.

14. The non-transitory computer readable medium of claim 11, wherein:

the at least one thumbnail is amplified in size in the thumbnail portion of the user interface during the seeking while the second content of the video content item is concurrently presented in the media player portion of the user interface at the fourth time point.

15. The non-transitory computer readable medium of claim 11, wherein the operations further comprise:

presenting an indicator indicating the magnitude and the direction of the drag gesture, the magnitude represented visually by how far the indicator extended, the indicator displayed adjacent to the thumbnail that is displayed at the larger size.

16. A system comprising:

a memory; and

a processor, coupled to the memory, to;

request, by a client device from a server over a network, a video content item;

receive, by the client device from the server over the network, a stream including the video content item;

receive, by the client device, a plurality of thumbnails, each thumbnail associated with a time point in the video content item;

present, in a media player portion of a user interface on the client device, the video content item;

receive at a viewing progress bar on the user interface a selection gesture at a first time point of the video content item;

responsive to the receiving of the selection gesture;

present, in the media player portion of the user interface, first content of the video content item at the first time point;

present, in a thumbnail portion of the user interface, a plurality of frames comprising one largest frame; and

present, in the thumbnail portion, a first subset of the plurality of thumbnails with each thumbnail of the first subset in each frame of the plurality of frames, the first subset of the plurality of thumbnails arranged chronologically and including a first thumbnail associated with the first time point, wherein the first thumbnail is displayed in the largest frame, reflects the first content of the video content item at the first time point and is presented concurrently with the first content of the video content item at the first time point in the media player portion;

receive, on the user interface a drag gesture to a second time point in the video content item, the drag gesture having a magnitude and a direction; and

responsive to the receiving of the drag gesture to the third time point in the video content item, seek to the second time point in the video content item at a first speed in a first direction based on the magnitude and the direction of the drag gesture while presenting one or more subsets of the plurality of thumbnails in the plurality of frames at a scrolling speed based on the magnitude of the drag gesture, the one or more subsets of the plurality of thumbnails reflecting one or more portions of the video content item that appear during the seeking, wherein each subset of the plurality of thumbnails corresponds to a respective portion of the video content item that appears during the seeking and is arranged chronologically, wherein when second content of the video content item is presented at a third time point occurring during the seeking, at least one thumbnail of the one or more subsets of the plurality of thumbnails is presented in the largest frame concurrently with the second content of the video content item at the third time point in the media player portion, and reflects the second content of the video content item at the third time point during the seeking.

17. The system of claim 16 wherein to present the video content item, the processor is to present the video content item at a second speed and a second direction responsive to the magnitude and direction of the drag gesture being updated.

18. The system of claim 17 wherein the processor is further to receive no gesture on the user interface at a fourth time point in the video content item and present the video content item starting at the fourth time point at the second speed and second direction responsive to receiving no gesture.

19. The system of claim 16 wherein the plurality of thumbnails comprise a thumbnail associated with a time point in the video content item that has not yet been received.

20. The system of claim 16 wherein the processor is further to present an indicator indicating the magnitude and the direction of the drag gesture, the magnitude represented visually by how far the indicator extended, the indicator displayed adjacent to the thumbnail that is presented in the largest frame.