GESTURE TOUCH INPUTS FOR CONTROLLING VIDEO ON A TOUCHSCREEN

• US 20130307792A1
• Filed: 09/04/2012
• Published: 11/21/2013
• Est. Priority Date: 05/16/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Andres, Isaac, Walker, Jeremy
• Granted Patent: US 9,454,303 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312

Abstract

In general, this disclosure describes novel techniques for controlling video content on a computing device, such as a mobile computing device. For example, a computing device may execute a media application that provides a video output to a presence-sensitive screen of the computing device. During execution of the media application, the presence-sensitive screen may receive a gesture touch input that has motion with respect to the presence-sensitive screen. The computing device may then rewind or fast forward the video output based at least in part on the gesture touch input. The computing device may display, during the rewinding or fast forwarding of the video output, a plurality of frames of the video output concurrently on the presence-sensitive screen in lateral motion corresponding to the rewinding or fast forwarding.

Claims

1. A method comprising:

outputting, by a computing device and for display, video content;

receiving, during display of the video content, an indication of a gesture input that has motion with respect to a presence-sensitive input device operatively coupled to the computing device;

determining, by the computing device, a speed of the motion of the gesture input;

rewinding or fast forwarding, by the computing device, the video content in a direction corresponding to the motion of the gesture input, the rewinding or fast forwarding being at a speed based at least in part on the determined speed of the motion of the gesture input; and

outputting, by the computing device and for display during the rewinding or fast forwarding of the video content, a virtual frame reel, the virtual frame reel comprising a plurality of frames of the video content displayed in lateral motion and in a direction corresponding to the rewinding or fast forwarding.

2. The method of claim 1, further comprising:

selecting frames from the video content that are spaced apart from each other at an interval that is based on the determined speed of motion of the gesture input; and

outputting the selected frames for display in the virtual frame reel.

3. The method of claim 2, further comprising:

outputting for display, during rewinding or fast forwarding the video content, the virtual frame reel in lateral motion at a constant speed while outputting the selected frames for display in the virtual frame reel at the interval based on the determined speed of motion of the gesture input.

4. The method of claim 1, further comprising displaying the plurality of frames of the video content with a frame size such that at least a minimum number of the frames are displayed concurrently.

5. The method of claim 1, further comprising providing user-selectable frame size options, and displaying the plurality of frames of the video content with a frame size that is based at least in part on a user input to the user-selectable frame size options.

6. The method of claim 1, further comprising detecting a size of a screen, and rendering the plurality of frames of the video content with a frame size that is based at least in part on the size of the screen.

9. The method of claim 1, wherein the frame speed slows down over time unless it is reset by a subsequent gesture input.

10. The method of claim 71, wherein the frame speed is directly proportional to the speed measured for the gesture input.

11. The method of claim 1, wherein the frame speed is exponentially proportional to the speed measured for the gesture input.

12. The method of claim 1, wherein the frame speed is directly proportional to the speed measured for the gesture input in a first part of a range of possible speeds for the gesture input, and the frame speed is exponentially proportional to the speed measured for the gesture input in a second part of a range of possible speeds for the gesture input.

13. The method of claim 1, further comprising:

receiving, by the computing device during rewinding or fast forwarding the video content, an indication of a subsequent gesture input that has motion with respect to the presence-sensitive input device; and

rewinding or fast forwarding the video content based on the subsequent gesture input.

14. The method of claim 1, wherein the presence-sensitive input device comprises a presence-sensitive screen that has a current left-right orientation when the presence-sensitive input device receives the gesture input, and wherein rewinding or fast forwarding the video content based on the gesture input comprises rewinding the video content in response to the gesture input having a motion toward a right side of the presence-sensitive screen in the current left-right orientation, and fast forwarding the video content in response to the gesture input having a motion toward a left side of the presence-sensitive screen in the current left-right orientation.

15. The method of claim 1, further comprising:

receiving an indication of a second input that lacks motion with respect to the presence-sensitive input device; and

responding to the second input by interrupting the rewinding or fast forwarding of the video content and either pausing the video content or resuming normal playback of the video content.

16. The method of claim 15, further comprising:

pausing the video content in response to the second input;

receiving a third input, that lacks motion with respect to the presence-sensitive input device; and

responding to the third input by resuming normal playback of the video content.

17. The method of claim 1, further comprising:

providing a prediction of one or more frames that are imminently pending to render for an interspersed display of frames during the rewinding or fast forwarding of the video content; and

modifying a frame buffering process based at least in part on the prediction of the one or more frames that are imminently pending to render.

18. The method of claim 1, wherein the media application outputs the video content for display while still downloading the video content from a server device, the method further comprising:

providing a prediction of one or more frames that are imminently pending to render for an interspersed display of frames during the rewinding or fast forwarding of the video content; and

sending an updated request to the server device for a change in an order in which frames of the video content are to be sent, based on the prediction of the one or more frames that are imminently pending to render for the interspersed display of frames.

19. The method of claim 1, wherein the method is implemented as a feature of an operating system configured to execute on the computing device, and the feature of the operating system is configured to receive indications of gesture inputs and other inputs at the presence-sensitive input device, and to communicate data about the gesture inputs and other inputs to a separate media application.

20. The method of claim 1, further comprising:

executing a boolean method on the computing device that performs evaluations of indications of inputs via the presence-sensitive input device and detects whether an input qualifies as a gesture input that has motion with respect to the presence-sensitive input device; and

if the boolean method detects a gesture input that has motion with respect to the presence-sensitive input device, triggering a scroller class that extends a video class to evaluate properties of the gesture input and to generate a rewind effect or a fast forward effect in the video class based on the properties of the gesture input.

21. The method of claim 20, wherein the properties of the gesture input comprise a direction of the gesture input and one or more of a speed and a duration of the gesture input, and the video class generates either the rewind effect or the fast forward effect based on the direction of the gesture input, and generates the rewind effect or the fast forward effect with a scrolling speed based on one or more of the speed and the duration of the gesture input.

31. The method of claim 2, further wherein the interval based on the determined speed of motion of the gesture input is an initial interval, the method further comprising:

selecting additional frames from the video content that are spaced apart from each other at subsequent intervals that decrease from the initial interval; and

outputting for display, during rewinding or fast forwarding the video content, the image of the virtual frame reel in lateral motion at a constant speed while outputting the selected frames for display in the virtual frame reel at the subsequent intervals that decrease from the initial interval.

32. The method of claim 1, wherein the presence-sensitive input device comprises a presence-sensitive screen.

7-8. -8. (canceled)

22. (canceled)

23. A method comprising:

detecting, by a computing device, a gesture input that has motion with respect to a presence-sensitive output device on which a video content is being displayed;

determining, by the computing device, a speed of the motion of the gesture input;

rewinding or fast forwarding, by the computing device, the video content in a direction corresponding to the gesture input, at a speed based at least in part on the determined speed of the motion of the gesture input;

outputting, by the computing device and for display on the presence-sensitive output device, a virtual frame reel comprising a plurality of frames from the video content, the frames being located in advance of a current frame of the video content at the time the gesture input is detected, each of the frames being separated by an interval in the video content, the interval selected based on the determined speed of motion of the gesture input, wherein the presence-sensitive output device depicts at least two of the frames concurrently, and depicts the virtual frame reel moving across the presence-sensitive output device in lateral motion;

advancing, by the computin device, a counter position indicating a position of a currently depicted frame of the video content based on the gesture input and in coordination with the rewinding or fast forwarding and the displaying of the plurality of frames from the video content; and

resuming, by the computing device, the video content from a portion that corresponds to the advanced counter position.

24. The method of claim 23, wherein the lateral motion of the concurrently displayed frames has a speed of motion that is constant independent of a speed of motion of the gesture input.

25. The method of claim 23, wherein the concurrently displayed frames are separated by a larger frame interval for a faster speed of motion of the gesture input relative to a slower speed of motion of the gesture input.

26. A computing device, comprising:

at least one processor;

machine-readable code stored on the computing device comprising executable instructions that are executable by the at least one processor, and which comprise;

executable instructions to output, for display, a video content;

executable instructions to receive, during display of the video output, an indication of a gesture input that has motion with respect to a presence-sensitive input device operatively coupled to the computing device;

executable instructions to determine a speed of motion of the gesture input;

executable instructions to rewind or fast forward the video content in a direction corresponding to the motion of the gesture input, the rewinding or fast forwarding being at a speed based at least in part on the determined speed of the motion of the gesture input; and

executable instructions to output for display, during the rewinding or fast forwarding the video content, a virtual frame carousel, the virtual frame carousel comprising a plurality of frames of the video content displayed in lateral motion in a direction corresponding to the rewinding or fast forwarding.

27. The computing device of claim 26, further comprising a wireless network interface, wherein the computing device is configured for sending a request through the wireless network interface, and downloading data for the video content through the wireless network interface in response to the request.

28. A non-transitory computer-readable storage medium comprising executable instructions for causing at least one processor of a computing device to perform operations comprising:

outputting, for display, a video content;

receiving, during display of the video output, an indication of a gesture input that has motion with respect to a presence-sensitive input device operatively coupled to the computing device;

determining a speed of motion of the gesture input;

rewinding or fast forwarding the video content in a direction corresponding to the motion of the gesture input, the rewinding or fast forwarding being at a speed based at least in part on the determined speed of the motion of the gesture input; and

outputting for display, during the rewinding or fast forwarding the video content, a virtual frame carousel, the virtual frame carousel comprising a plurality of frames of the video content displayed in lateral motion in a direction corresponding to the rewinding or fast forwarding.

29. The non-transitory computer-readable storage medium of claim 28, further comprising executable instructions for causing the at least one processor of the computing device to perform operations comprising:

sending a request through a wireless network interface;

downloading data for the video content through the wireless network interface in response to the request;

providing the video content to the presence-sensitive screen while the data for the video content is being downloaded;

providing a prediction of one or more frames of the video content that are imminently pending to render the frame carousel during the rewinding or fast forwarding of the video content; and

modifying a frame buffering process based at least in part on the prediction of the one or more frames that are imminently pending to render the frame carousel.

30. The non-transitory computer-readable storage medium of claim 29, further comprising executable instructions for causing the at least one processor of the computing device to perform operations comprising:

sending an updated request for a change in an order in which frames of the video content are to be sent, based on the prediction of the one or more frames that are imminently pending to render the frame carousel.