Multiple selection on devices with many gestures

• US 8,924,892 B2
• Filed: 08/29/2008
• Issued: 12/30/2014
• Est. Priority Date: 08/22/2008
• Status: Active Grant

• Current Assignee: Fujifilm Business Innovation Corp. (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.)
• Inventors: Roth, Volker
• Primary Examiner(s): Pillai, Namitha
• Application Number:
  US12/202,066
• Publication Number:
  US 20100050076A1
• Time in Patent Office: 2,314 Days
• Field of Search: 715/863, 715/702, 715/767
• US Class Current: 715/863
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Devices, methods and computer readable mediums storing a program causing a computer to execute a process for interacting with targets on a display, particularly in regards to devices utilizing a multi-touch display that are driven by gestures. The use of such devices, methods, and computer readable mediums storing a program allows the user to interact with devices through the use of multi-touch displays.

Claims

1. A device, comprising:

a display;

a sensing unit sensing a tactile interaction at least on the display;

an activation point near an edge of the display, the activation point identifying a predetermined command in accordance with a position of the activation point on the display, and the activation point not being explicitly displayed;

a detecting unit, detecting a reserved gesture not starting from the activation point and a gesture starting from the activation point representing the predetermined command corresponding to the tactile interaction on the display, wherein the reserved gesture not starting from the activation point, and the gesture starting from the activation point are differentiated; and

a processing unit, processing a command based on the detected gesture, wherein the processing unit executes a reserved command corresponding to the reserved gesture when the detecting unit detects the reserved gesture and wherein the processing unit executes the predetermined command represented by the gesture starting from the activation point, when the detecting unit detects the gesture starting from the activation point.

2. The device in claim 1, wherein the reserved gesture further comprises a continuous plural touch on the display;

and wherein the detecting unit further detects another gesture at the activation point intervening with the plural touch; and

,

wherein the processing unit uses a position at end of the another gesture for processing the reserved command based on the reserved gesture.

3. The device in claim 1, further comprising a display controller, wherein the display controller generates visual feedback to trace a gesture between the activation point identifying the predetermined command and inner portion of the display.

4. The device in claim 3, further comprising a marker placed on the inner portion by the display controller after the gesture has ended;

wherein the marker is a representation of the command.

5. The device in claim 3, wherein the visual feedback comprises displaying a rubber band figure from the activation point to the inner portion of the display;

wherein the rubber band figure stretches and shrinks in reaction to the gesture.

6. The device in claim 5, wherein the visual feedback connects and highlights potential targets as a result of the gesture.

7. The device in claim 1, wherein the activation point is on a bezel alongside the display.

8. The device in claim 1, wherein the gesture starting from the activation point ends at a predetermined inner location on the display

9. A method of interacting with targets on a display, comprising:

providing an activation point near an edge of the display, wherein the activation point identifies a predetermined command in accordance with a position of the activation point on the display, and the activation point is not explicitly displayed;

sensing a tactile interaction at least on the display;

detecting a reserved gesture not starting from the activation point and a gesture starting from the activation point representing the predetermined command corresponding to the tactile interaction on the display, wherein the reserved gesture not starting from the activation point, and the gesture starting from the activation point are differentiated; and

processing a command based on the detected gesture, wherein a reserved command corresponding to the reserved gesture is executed when the reserved gesture is detected, and wherein the predetermined command represented by the gesture starting from the activation point is executed, when the gesture starting from the activation point is detected.

10. The method in claim 9, wherein the gesture originates from either outside the display or from the activation point.

11. The method in claim 9, further comprising generating visual feedback to trace the gesture between the activation point identifying the predetermined command and an inner portion of the display.

12. The method in claim 11, wherein the generating visual feedback further comprises displaying a rubber band figure from the activation point to the inner portion of the display, wherein the rubber band figure stretches and shrinks in reaction to the gesture.

13. The method in claim 9, further comprising placing a marker on an inner portion of the display;

wherein the marker is a representation of the command.

14. The method in claim 9, further comprising highlighting potential targets as a result of the gesture.

15. The method in claim 9, wherein the gesture starting from the activation point ends at a predetermined inner location on the display.

16. A non-transitory computer readable medium storing a program causing a computer to execute a process for interacting with a display, the process comprising:

providing an activation point near edge of a display, wherein of the activation point identifies a predetermined command in accordance with a position of the activation point on the display, and the activation point is not explicitly displayed;

sensing a tactile interaction at least on the display;

detecting a reserved gesture not starting from the activation point and a gesture starting from the activation point representing the predetermined command corresponding to the tactile interaction on the display, wherein the reserved gesture not starting from the activation point, and the gesture starting from the activation point are differentiated; and

processing a command based on the detected gesture, wherein a reserved command corresponding to the reserved gesture is executed when the reserved gesture is detected, and wherein the predetermined command represented by the gesture starting from the activation point is executed, and when the gesture starting from the activation point is detected.

17. The non-transitory computer readable medium in claim 16, further comprising generating visual feedback to trace the gesture between the activation point identifying the predetermined command and an inner portion of the display.

18. The non-transitory computer readable medium in claim 17, further comprising displaying a rubber band figure from the activation point to the inner portion of the display, wherein the rubber band figure stretches and shrinks in reaction to the gesture.

19. The non-transitory computer readable medium in claim 17, further comprising highlighting potential targets as a result of the gesture.

20. The non-transitory computer readable medium in claim 16, further comprising placing a marker on an inner portion of the display;

wherein the marker is a representation of the command.

21. The non-transitory computer readable medium in claim 16, wherein the gesture starting from the activation point ends at a predetermined inner location on the display.

22. A device, comprising:

a sensing unit sensing a tactile interaction on a display, the display having a perimeter, and activation point identifying a predetermined command in accordance with a position of the activation point on the display and disposed near the perimeter of the display, the activation point not being explicitly displayed, and an inner portion within the perimeter, and activation the predetermined command represented by the activation point in response to sensing the tactile interaction on the activation point;

a detecting unit, detecting a reserved gesture not starting from the activation point and a gesture starting from the activation point representing the predetermined command corresponding to the tactile interaction on the display, wherein the reserved gesture not starting from the activation point, and the gesture starting from the activation point are differentiated;

a processing unit, executing a command based on the detected gesture, wherein the processing unit executes a reserved command corresponding to the reserved gesture when the detecting unit detects the reserved gesture, and wherein the processing unit executes the predetermined command represented by the gesture starting from the activation point when the detecting unit detects the gesture starting from the activation point.

23. The device in claim 22, wherein the gesture starting from the activation point ends at a predetermined inner location on the display.