Method and apparatus for controls based on concurrent gestures

• US 9,430,128 B2
• Filed: 01/06/2011
• Issued: 08/30/2016
• Est. Priority Date: 01/06/2011
• Status: Active Grant

• Current Assignee: ROVI Product Corporation (Xperi Inc.)
• Original Assignee: TiVo Inc. (Adeia Inc.)
• Inventors: Hayes, Robin
• Primary Examiner(s): SUN, LI P
• Application Number:
  US12/986,060
• Publication Number:
  US 20120179970A1
• Time in Patent Office: 2,063 Days
• Field of Search: 715/722, 345/173, 340/3.1
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

In an embodiment, a number of parallel gestures are detected, in a particular area on a touch screen interface of a device. A command is identified based at least on the parallel gestures and an action associated with the command is performed.

Claims

1. A method, comprising:

concurrently detecting a plurality of parallel gestures on a touch screen interface of a first device;

determining a number of the plurality of parallel gestures;

responsive to concurrently detecting the plurality of parallel gestures in a first area of the touch screen interface;

selecting a command from a plurality of commands based on the number of the plurality of parallel gestures, the plurality of commands corresponding to a displayed menu of options each having an option number;

wherein selecting the command comprises selecting which of the plurality of commands corresponds to a particular option, of the displayed menu of options, that has an option number equivalent to the number of parallel gestures, the displayed menu of options including at least one option corresponding to two parallel gestures and another option corresponding to three parallel gestures; and

causing performance of the selected command at the first device or at a second device that is communicatively coupled to the first device;

responsive to concurrently detecting the plurality of parallel gestures in a second area of the touch screen interface, the second area being different than the first area;

causing performance of a trick-play command corresponding to the number of the plurality of parallel gestures, with respect to playback of multimedia content at the first device or at the second device that is communicatively coupled to the first device, the trick-play command being different than the plurality of commands corresponding to the menu of options.

2. The method of claim 1, wherein each of the options corresponds to a bookmark in the multimedia content, wherein performance of the selected command comprises playing the multimedia content from a playing position associated with a particular bookmark that corresponds to the particular option.

3. The method of claim 1, wherein the plurality of parallel gestures comprise a plurality of parallel sliding gestures performed in a same direction.

4. The method of claim 1, wherein determining the number of the plurality of parallel gestures comprises determining a number of tap gestures concurrently performed on the touch screen interface.

5. The method of claim 1, wherein causing performance of the selected command comprises causing performance of the selected command at the second device that is communicatively coupled to the first device.

6. The method of claim 1, wherein the selected command is to navigate a folder hierarchy.

7. A method, comprising:

concurrently detecting a plurality of parallel gestures on a touch screen interface of a remote wireless device;

determining a number of the plurality of parallel gestures;

responsive to concurrently detecting the plurality of parallel gestures in a first area of the touch screen interface;

selecting a playback speed from a plurality of playback speeds based on the number of the plurality of parallel gestures, the plurality of playback speeds including at least one playback speed corresponding to two parallel gestures and another playback speed corresponding to three parallel gestures;

causing playback of multimedia content on a multimedia device at the selected playback speed;

responsive to the plurality of parallel gestures, updating a progress indicator displayed at the remote wireless device to reflect the playback of the multimedia content at the selected playback speed;

responsive to activating the remote wireless device from an inactive state, requesting a progress update for the playback of the multimedia content from the multimedia device, and updating the progress indicator displayed at the remote wireless device to reflect a new playback position of the multimedia content;

responsive to concurrently detecting the plurality of parallel gestures in a second area of the touch screen interface, the second area being different than the first area;

causing a command selection from a plurality of commands corresponding to a displayed menu of options each having an option number, the selected command corresponding to a menu option having an option number equivalent to the number of the plurality of parallel gestures.

8. The method of claim 7, wherein the plurality of playback speeds comprises two or more fast-forward speeds.

9. The method of claim 7, wherein the multimedia device comprises one or both of:

an audio player or a video player.

10. The method of claim 7, further comprising:

calculating a current playback position for the progress indicator based on a previous progress update from the multimedia device and an amount of time elapsed from the previous progress update.

11. The method of claim 7, further comprising determining that the remote wireless device has been activated from the inactive state responsive to input from an accelerometer indicating that the remote wireless device has been picked up.

12. A method, comprising:

concurrently detecting a plurality of parallel gestures on a touch screen interface of a remote wireless device;

determining a number of the plurality of parallel gestures;

responsive to concurrently detecting the plurality of parallel gestures in a first area of the touch screen interface;

selecting a rewind speed from a plurality of rewind speeds based on the number of the plurality of parallel gestures, the plurality of rewind speeds including at least one rewind speed corresponding to two parallel gestures and another rewind speed corresponding to three parallel gestures;

causing rewinding of multimedia content on a multimedia device at the selected rewind speed;

responsive to the plurality of parallel gestures, updating a progress indicator displayed at the remote wireless device to reflect the rewinding of the multimedia content at the selected rewind speed;

responsive to activating the remote wireless device from an inactive state, requesting a progress update for the playback of the multimedia content from the multimedia device, and updating the progress indicator displayed at the remote wireless device to reflect a new playback position of the multimedia content;

responsive to concurrently detecting the plurality of parallel gestures in a second area of the touch screen interface, the second area being different than the first area;

causing a command selection from a plurality of commands corresponding to a displayed menu of options each having an option number, the selected command corresponding to a menu option having an option number equivalent to the number of the plurality of parallel gestures.

13. One or more non-transitory computer readable media storing instructions, which when executed by one or more computing devices, cause performance of:

concurrently detecting a plurality of parallel gestures on a touch screen interface of a first device;

determining a number of the plurality of parallel gestures;

responsive to concurrently detecting the plurality of parallel gestures in a first area of the touch screen interface;

selecting a command from a plurality of commands based on the number of the plurality of parallel gestures, the plurality of commands corresponding to a displayed menu of options each having an option number;

wherein selecting the command comprises selecting which of the plurality of commands corresponds to a particular option, of the displayed menu of options, that has an option number equivalent to the number of parallel gestures, the displayed menu of options including at least one option corresponding to two parallel gestures and another option corresponding to three parallel gestures; and

causing performance of the selected command at the first device or at a second device that is communicatively coupled to the first device;

responsive to concurrently detecting the plurality of parallel gestures in a second area of the touch screen interface, the second area being different than the first area;

causing performance of a trick-play command corresponding to the number of the plurality of parallel gestures, with respect to playback of multimedia content at the first device or at the second device that is communicatively coupled to the first device, the trick-play command being different than the plurality of commands corresponding to the menu of options.

14. The one or more non-transitory computer readable media of claim 13, wherein each of the options corresponds to a bookmark in the multimedia content, wherein performance of the selected command comprises playing the multimedia content from a playing position associated with a particular bookmark that corresponds to the particular option.

15. The one or more non-transitory computer readable media of claim 13, wherein the plurality of parallel gestures comprise a plurality of parallel sliding gestures performed in a same direction.

16. The one or more non-transitory computer readable media of claim 13, wherein determining the number of the plurality of parallel gestures comprises determining a number of tap gestures concurrently performed on the touch screen interface.

17. The one or more non-transitory computer readable media of claim 13, wherein causing performance of the selected command comprises causing performance of the selected command at the second device that is communicatively coupled to the first device.

18. One or more non-transitory computer readable media storing instructions, which when executed by one or more computing devices, cause performance of:

concurrently detecting a plurality of parallel gestures on a touch screen interface of a remote wireless device;

determining a number of the plurality of parallel gestures;

responsive to concurrently detecting the plurality of parallel gestures in a first area of the touch screen interface;

selecting a playback speed from a plurality of playback speeds based on the number of the plurality of parallel gestures, the plurality of playback speeds including at least one playback speed corresponding to two parallel gestures and another playback speed corresponding to three parallel gestures;

causing playback of multimedia content on a multimedia device at the selected playback speed;

responsive to the plurality of parallel gestures, updating a progress indicator displayed at the remote wireless device to reflect the playback of the multimedia content at the selected playback speed;

responsive to activating the remote wireless device from an inactive state, requesting a progress update for the playback of the multimedia content from the multimedia device, and updating the progress indicator displayed at the remote wireless device to reflect a new playback position of the multimedia content;

responsive to concurrently detecting the plurality of parallel gestures in a second area of the touch screen interface, the second area being different than the first area;

causing a command selection from a plurality of commands corresponding to a displayed menu of options each having an option number, the selected command corresponding to a menu option having an option number equivalent to the number of the plurality of parallel gestures.

19. The one or more non-transitory computer readable media of claim 18, wherein the plurality of playback speeds comprises two or more fast-forward speeds.

20. The one or more non-transitory computer readable media of claim 18, wherein the multimedia device comprises one or both of:

an audio player or a video player.

21. The one or more non-transitory computer readable media of claim 18, wherein the instructions, when executed by the one or more computing devices, further cause performance of:

calculating a current playback position for the progress indicator based on a previous progress update from the multimedia device and an amount of time elapsed from the previous progress update.

22. The one or more non-transitory computer readable media of claim 18, wherein the instructions, when executed by the one or more computing devices, further cause determining that the remote wireless device has been activated from the inactive state responsive to input from an accelerometer indicating that the remote wireless device has been picked up.

23. One or more non-transitory computer readable media storing instructions, which when executed by one or more computing devices, cause performance of:

concurrently detecting a plurality of parallel gestures on a touch screen interface of a remote wireless device;

determining a number of the plurality of parallel gestures;

responsive to concurrently detecting the plurality of parallel gestures in a first area of the touch screen interface;

selecting a rewind speed from a plurality of rewind speeds based on the number of the plurality of parallel gestures, the plurality of rewind speeds including at least one rewind speed corresponding to two parallel gestures and another rewind speed corresponding to three parallel gestures;

causing rewinding of multimedia content on a multimedia device at the selected rewind speed;

responsive to the plurality of parallel gestures, updating a progress indicator displayed at the remote wireless device to reflect the rewinding of the multimedia content at the selected rewind speed;

responsive to activating the remote wireless device from an inactive state, requesting a progress update for the playback of the multimedia content from the multimedia device, and updating the progress indicator displayed at the remote wireless device to reflect a new playback position of the multimedia content;

responsive to concurrently detecting the plurality of parallel gestures in a second area of the touch screen interface, the second area being different than the first area;

causing a command selection from a plurality of commands corresponding to a displayed menu of options each having an option number, the selected command corresponding to a menu option having an option number equivalent to the number of the plurality of parallel gestures.

24. A first device comprising:

one or more processors;

logic, implemented at least partly by hardware, configured to concurrently detect a plurality of parallel gestures on a touch screen interface of the first device;

logic, implemented at least partly by hardware, configured to determine a number of the plurality of parallel gestures;

logic, implemented at least partly by hardware, configured to, responsive to concurrently detecting the plurality of parallel gestures in a first area of the touch screen interface;

selecting a command from a plurality of commands based on the number of the plurality of parallel gestures, the plurality of commands corresponding to a displayed menu of options each having an option number;

wherein selecting the command comprises selecting which of the plurality of commands corresponds to a particular option, of the displayed menu of options, that has an option number equivalent to the number of parallel gestures, the displayed menu of options including at least one option corresponding to two parallel gestures and another option corresponding to three parallel gestures; and

causing performance of the selected command at the first device or at a second device that is communicatively coupled to the first device;

logic, implemented at least partly by hardware, configured to, responsive to concurrently detecting the plurality of parallel gestures in a second area of the touch screen interface, the second area being different than the first area;

cause performance of a trick-play command corresponding to the number of the plurality of parallel gestures, with respect to playback of multimedia content at the first device or at the second device that is communicatively coupled to the first device, the trick-play command being different than the plurality of commands corresponding to the menu of options.

25. The first device of claim 24, wherein each of the options corresponds to a bookmark in the multimedia content, wherein performance of the selected command comprises playing the multimedia content from a playing position associated with a particular bookmark that corresponds to the particular option.

26. The first device of claim 24, wherein the plurality of parallel gestures comprise a plurality of parallel sliding gestures performed in a same direction.

27. The first device of claim 24, wherein determining the number of the plurality of parallel gestures comprises determining a number of tap gestures concurrently performed on the touch screen interface.

28. The first device of claim 24, wherein causing performance of the selected command comprises causing performance of the selected command at the second device that is communicatively coupled to the first device.

29. A remote wireless device, comprising:

one or more processors;

logic, implemented at least partly by hardware, configured to concurrently detect a plurality of parallel gestures on a touch screen interface of the remote wireless device;

logic, implemented at least partly by hardware, configured to determine a number of the plurality of parallel gestures;

logic, implemented at least partly by hardware, configured to, responsive to concurrently detecting the plurality of parallel gestures in a first area of the touch screen interface;

select a playback speed from a plurality of playback speeds based on the number of the plurality of parallel gestures, the plurality of playback speeds including at least one playback speed corresponding to two parallel gestures and another playback speed corresponding to are three parallel gestures;

cause playback of multimedia content on a multimedia device at the selected playback speed;

responsive to the plurality of parallel gestures, update a progress indicator displayed at the remote wireless device to reflect the playback of the multimedia content at the selected playback speed;

logic, implemented at least partly by hardware, configured to, responsive to activating the remote wireless device from an inactive state, request a progress update for the playback of the multimedia content from the multimedia device, and update the progress indicator displayed at the remote wireless device to reflect a new playback position of the multimedia content;

logic, implemented at least partly by hardware, configured to, responsive to concurrently detecting the plurality of parallel gestures in a second area of the touch screen interface, the second area being different than the first area;

cause a command selection from a plurality of commands corresponding to a displayed menu of options each having an option number, the selected command corresponding to a menu option having an option number equivalent to the number of the plurality of parallel gestures.

30. The remote wireless device of claim 29, wherein the plurality of playback speeds comprises two or more fast-forward speeds.

31. The remote wireless device of claim 29, wherein the multimedia device comprises one or both of:

an audio player or a video player.

32. The remote wireless device of claim 29, further comprising logic, implemented at least partly by hardware, configured to:

calculating a current playback position for the progress indicator based on a previous progress update from the multimedia device and an amount of time elapsed from the previous progress update.

33. The remote wireless device of claim 29, further comprising logic configured to determine that the remote wireless device has been activated from the inactive state responsive to input from an accelerometer indicating that the remote wireless device has been picked up.

34. A remote wireless device, comprising:

one or more processors;

logic, implemented at least partly by hardware, configured to concurrently detect a plurality of parallel gestures on a touch screen interface of the remote wireless device;

logic, implemented at least partly by hardware, configured to determine a number of the plurality of parallel gestures;

logic, implemented at least partly by hardware, configured to, responsive to concurrently detecting the plurality of parallel gestures in a first area of the touch screen interface;

select a rewind speed from a plurality of rewind speeds based on the number of the plurality of parallel gestures, the plurality of rewind speeds including at least one rewind speed corresponding to two parallel gestures and another rewind speed corresponding to three parallel gestures;

cause rewinding of multimedia content on a multimedia device at the selected rewind speed;

responsive to the plurality of parallel gestures, update a progress indicator displayed at the remote wireless device to reflect the rewinding of the multimedia content at the selected rewind speed;

logic, implemented at least partly by hardware, configured to, responsive to activating the remote wireless device from an inactive state, requesting a progress update for the playback of the multimedia content from the multimedia device, and updating the progress indicator displayed at the remote wireless device to reflect a new playback position of the multimedia content;

logic, implemented at least partly by hardware, configured to, responsive to concurrently detecting the plurality of parallel gestures in a second area of the touch screen interface, the second area being different than the first area;

cause a command selection from a plurality of commands corresponding to a displayed menu of options each having an option number, the selected command corresponding to a menu option having an option number equivalent to the number of the plurality of parallel gestures.