Method for providing user interface using multi-point touch and apparatus for same

• US 9,778,780 B2
• Filed: 12/24/2013
• Issued: 10/03/2017
• Est. Priority Date: 12/26/2012
• Status: Active Grant

• Current Assignee: Korea Electronics Technology Institute (Government of South Korea)
• Original Assignee: Korea Electronics Technology Institute (Government of South Korea)
• Inventors: Kim, Kunnyun, Kim, Wonhyo, Kwak, Yeonhwa, Park, Kwangbum
• Primary Examiner(s): Patel, Sanjiv D
• Application Number:
  US14/655,242
• Publication Number:
  US 20160162098A1
• Time in Patent Office: 1,379 Days
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/04166 Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

The present invention relates to a method for providing a user interface using a multi-point touch capable of immediately carrying out various user commands by changing the direction of force applied to two or more different points inside a touch area, and to an apparatus for same, wherein when contact on two or more different points inside the touch area is sensed, directions of force applied to the two or more points are detected while the contact to the two or more points is maintained when the contact on the two or more points is detected, and a predetermined user command is carried out according to a combination of the directions of force detected from the points.

Claims

1. A method of providing a user interface using a multi-point touch, the method being performed by an apparatus that includes a touch region capable of sensing contact and the method comprising:

sensing contact at two or more different points in the touch region;

when the contact with the two or more points is sensed;

sensing whether the contact with the two or more different points is maintained and fixed at corresponding two or more positions in the touch region, and

detecting directions of force applied to the two or more different points; and

executing a predetermined user command according to a combination of the directions of force detected at the two or more different points when the contact with the two or more different points is maintained and fixed at the corresponding two or more positions in the touch region.

2. The method of claim 1, wherein the detecting of the directions of force comprises:

extracting a contact region with a certain area around each point where the contact is sensed;

detecting intensities of the force at multiple sensing points in the contact region; and

determining a direction of the force applied to the point based on a distribution of the intensities of the force detected at the multiple sensing points.

3. The method of claim 2, wherein the determining of the directions of the force comprises determining, as the direction of the force, a direction of a sensing point where a greatest intensity of force is detected with respect to a center of the contact region.

4. The method of claim 1, wherein the executing of the predetermined user command comprises executing the user command according to a combination of the directions of force, the combination being parallel to a line segment connecting the points within a certain margin of error.

5. The method of claim 1, wherein the executing of the predetermined user command comprises executing the user command according to a combination of two directions of force, the combination being inclined at a certain angle with respect to a line segment connecting the points.

6. The method of claim 1, wherein the executing of the predetermined user command comprises performing one or more of rotation, movement, zooming-in, zooming-out, panning, and tilting of a specific object or screen.

7. The method of claim 1, further comprising detecting one or more of a contact time of the points, intensities of the force at the points, and distances between the points,

wherein the executing of the predetermined user command comprises executing the user command in further consideration of one or more of the contact time of the points, the intensities of the force at the points, and the distances between the points in addition to the combination of the directions of force.

8. The method of claim 1, wherein the executing of the user command comprises executing the user command according to a force combination pattern obtained by connecting the directions of force detected at the points in a predetermined order.

9. An apparatus for providing a user interface using a multi-point touch, the apparatus comprising:

a touch input unit including a touch region capable of sensing contact and configured to sense one or more of contact with the touch region, a position of the contact, an intensity of force upon the contact, and a direction of the force; and

a control unit configured to, in response to the contact with the two or more points in the touch region being maintained and fixed at corresponding two or more positions in the touch region;

check directions of force applied to the two or more points, and

execute a predetermined user command according to a combination of the checked directions of force.

10. The apparatus of claim 9, wherein the control unit comprises a touch event processing module configured to set a contact region with a certain area around each point where the contact is sensed, compare intensities of force at multiple sensing points located in the contact region, and determine the direction of force applied to the point.

11. The apparatus of claim 10, wherein the touch event processing module determines, as the direction of force, a direction of a sensing point where a greatest intensity of force is detected with respect to a center of the contact region.

12. The apparatus of claim 9, wherein the control unit,

comprises a pattern extraction module configured to connect the directions of force detected at the two or more different points in a predetermined order and check a force combination pattern, and

executes the user command according to the checked force combination pattern.

13. The apparatus of claim 9, wherein the control unit further detects one or more of a contact time of the points, intensities of the force at the points, and distances between the points, and executes the user command in further consideration of one or more of the contact time of the points, the intensities of the force at the points, and the distances between the points in addition to the combination of the directions of force.

14. A method of providing a user interface using a multi-point touch, the method being performed by an apparatus that includes a touch region capable of sensing contact and the method comprising:

sensing fixed contact at each point of two or more different points in the touch region;

detecting a direction of force applied to each point of the two or more points of the fixed contact; and

executing a predetermined user command according to a combination of the direction of force applied at each point of the two or more points when the fixed contact is stationary, wherein the combination is parallel to a line or a plane as defined by the two or more points or inclined the line or the plane at an angle with respect to the line or the plane.