Method, system and computer readable medium for document visualization with interactive folding gesture technique on a multi-touch display

• US 8,997,025 B2
• Filed: 11/24/2010
• Issued: 03/31/2015
• Est. Priority Date: 11/24/2010
• Status: Active Grant

• Current Assignee: Fujifilm Business Innovation Corp. (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Fujifilm Holdings Corporation)
• Inventors: Chiu, Patrick, Liao, Chunyuan, Chen, Francine
• Primary Examiner(s): TAN, ALVIN H
• Application Number:
  US12/954,581
• Publication Number:
  US 20120131516A1
• Time in Patent Office: 1,588 Days
• Field of Search: 715/863
• US Class Current: 715/863
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method, system and computer readable medium for folding a document page object are provided. A method for folding a document page object in a graphical user interface using multi-touch gestures includes establishing at least two contact points on a display; moving at least one of the two contact points to create a fold on the document page object; and displaying the folded document page object.

Claims

1. A method for folding a document page object in a graphical user interface using multi-touch gestures comprising:

establishing at least two contact points on a display;

moving at least one of the at least two contact points to fold the document page object; and

displaying the folded document page object,

wherein the multi-touch gestures control the folding of the document page object according to gesture models that indicate whether the at least two contact points are interpreted symmetrically or asymmetrically and a gesture mapping that maps the moving of the symmetrically or asymmetrically interpreted at least one of the at least two contact points to the folding of the document page,

wherein the gesture models comprise a Symmetric-Parallel (SP) gesture model and an Asymmetric-Serial (AS) gesture model,

wherein the AS gesture model comprises gestures which maintain a first contact point established by a first finger which is in a fixed position while moving a second contact point established by a second finger from a first position to a second position,

wherein the first finger is interpreted as a finger of a non-dominant hand which is in the fixed position while the second contact point is moved by the second finger,

and wherein the second finger is interpreted as a finger of a dominant hand which moves the second contact point from the first position to the second position.

2. The method according to claim 1, wherein the at least two contact points are established by hands of a user;

and

wherein the SP gesture model comprises gestures which move the at least two contact points established by the hands of the user so that the hands have symmetric roles to each other and the moving of any of the at least two contact points are interpreted in a same way.

3. The method according to claim 1, wherein the gesture mapping comprises at least one of a Logical gesture mapping, a Directional gesture mapping, and a Contact Point Constrained (CPC) gesture mapping.

4. The method according to claim 3, wherein in the Logical gesture mapping an amount of movement of a gesture perpendicular to a projection of an intersecting edge is mapped to a fold angle.

5. The method according to claim 3, wherein in the Directional gesture mapping a fold direction is based on a movement of the at least two contact points toward each other or away from each other.

6. The method according to claim 3, wherein in the CPC mapping, the at least two contact points correspond to points on two sections of a document and the sections underneath the at least two contact points follow a movement of a user'"'"'s fingers.

7. The method according to claim 1, wherein the folding is performed in a determined crease location.

8. The method according to claim 7, wherein the crease location is determined by at least one of heuristics, content analysis algorithms, and user interaction.

9. The method according to claim 1, wherein all content on the document page object remains visible after the document page object is folded.

10. A method for performing document visualization using interactive multi-touch folding gestures comprising:

determining gesture models which specify folding actions for a document page object according to user manipulation of a display;

determining a gesture mapping which maps gesture path events for the visualization of the document page object;

folding the document page object according to the determined gesture models and gesture mapping; and

displaying the folded document page object,

wherein the gesture models comprise a Symmetric-Parallel (SP) gesture model and an Asymmetric-Serial (AS) gesture model,

wherein the AS gesture model comprises gestures which maintain a first contact point established by a first finger which is in a fixed position while moving a second contact point established by a second finger from a first position to a second position,

wherein the first finger is interpreted as a finger of a non-dominant hand which is in the fixed position while the second contact point is moved by the second finger,

and wherein the second finger is interpreted as a finger of a dominant hand which moves the second contact point from the first position to the second position.

11. A system for folding a document page object in a graphical user interface using multi-touch gestures comprising:

a processor with a memory;

a gesture model unit which determines gesture models which specify whether inputs for performing folding actions for a document page object according to user manipulation of a display are interpreted symmetrically or asymmetrically;

a gesture mapping unit which determines a gesture mapping which maps symmetrically or asymmetrically interpreted gesture path events for the visualization of the document page object,

wherein the processor executes instructions to fold the document page object according to the determined gesture models and gesture mapping;

a display for displaying the folded document page object;

wherein the gesture models comprise a Symmetric-Parallel (SP) gesture model unit and an Asymmetric-Serial (AS) gesture model unit,

wherein the AS gesture model unit determines whether a first contact point is established by a first finger which is in a fixed position while determining movement of a second contact point established by a second finger from a first position to a second position,

wherein the first finger is interpreted as a finger of a non-dominant hand which is in the fixed position while the second contact point is moved by the second finger,

and wherein the second finger is interpreted as a finger of a dominant hand which moves the second contact point from the first position to the second position.

12. The system according to claim 11, wherein at least two contact points are established by hands of a user;

and

wherein the SP gesture model unit determines movement of the at least two contact points established by the hands of the user so that the hands have symmetric roles to each other and interprets the moving of any of the at least two contact points in the same way.

13. The system according to claim 11, wherein the gesture mapping unit comprises one of a Logical gesture mapping unit, a Directional gesture mapping unit, and a CPC gesture mapping unit.

14. The system according to claim 13, wherein the Logical gesture mapping unit determines an amount of movement of a gesture perpendicular to a projection of an intersecting edge which is mapped to a fold angle.

15. The system according to claim 13, wherein the Directional gesture mapping unit determines a fold direction based on a movement of at least two contact points toward each other or away from each other.

16. The system according to claim 13, wherein the CPC gesture mapping unit determines whether at least two contact points correspond to points on two sections of a document and whether the sections underneath the at least two contact points follow a movement of a user'"'"'s fingers.

17. A computer program product for folding a document page object in a graphical user interface using multi-touch gestures, the computer program product embodied on a non-transitory computer readable medium and when executed by a computer, performs a method comprising:

establishing at least two contact points on a display;

moving at least one of the at least two contact points to fold the document page object; and

displaying the folded document page object,

wherein the multi-touch gestures control the folding of the document page object according to gesture models that indicate whether the at least two contact points are interpreted symmetrically or asymmetrically and a gesture mapping that maps the moving of the symmetrically or asymmetrically interpreted at least one of the at least two contact points to the folding of the document page,

wherein the gesture models comprise a Symmetric-Parallel (SP) gesture model and an Asymmetric-Serial (AS) gesture model,

wherein the AS gesture model comprises gestures which maintain a first contact point established by a first finger which is in a fixed position while moving a second contact point established by a second finger from a first position to a second position,

wherein the first finger is interpreted as a finger of a non-dominant hand which is in the fixed position while the second contact point is moved by the second finger,

and wherein the second finger is interpreted as a finger of a dominant hand which moves the second contact point from the first position to the second position.