Automatic orientation of items on a touch screen display utilizing hand direction

• US 20120060127A1
• Filed: 09/06/2010
• Published: 03/08/2012
• Est. Priority Date: 09/06/2010
• Status: Abandoned Application

• Current Assignee: Multi Touch Oy
• Original Assignee: Multi Touch Oy
• Inventors: ILMONEN, Tommi
• Application Number:
  US12/876,192
• Publication Number:
  US 20120060127A1
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Method or orienting items on the display to a user are based on the direction of the user hand, or the user are disclosed. The method relies on detection of the direction of the users'"'"' hand and orienting the item at a selected orientation thereto. An aspect of the invention also includes methods of detecting users'"'"' position about a touch screen display

Claims

1. A method of automatic orientation of an item having an orientation vector τ

, towards a user operating in a surface computing environment having a multi-touch capable display, the method comprises the steps of;

Identifying a user hand touch or gesture affected by the user on the display, at a location associated with an item;

responsive to the hand touch or gesture, determining a hand orientation vector η

;

orienting the item to the user by aligning the item in a predetermined relation between the hand orientation vector η and

the orientation vector τ

of the item.

2. The method as claimed in claim 1, wherein the multi-touch display comprises a computer vision based detection system, and wherein the step of determining the hand orientation direction comprises:

detecting a plurality of finger touch points;

detecting location of a palm attached to the fingers;

identifying which of the detected fingers belong to the detected palm;

determining a plurality of finger vectors between a corresponding plurality of fingers and a point under the palm;

summing the finger vectors to obtain hand orientation direction η

.

3. The method as claimed in claim 1, wherein the multi-touch display comprises a computer vision detection system, and wherein the step of determining the hand orientation direction comprises:

detecting a single finger touch point;

detecting location of a palm attached to the finger;

determining a vector between the finger and a point under the palm.

4. The method as claimed in claim 3 the point under the palm is selected by finding the center of the palm, and selecting a point as an offset to the center of the palm, selected by the relative finger position in the hand.

5. The method as claimed in claim 1, further comprising the step determining if the finger touch points include a thumb touch point, and when a thumb touch point is detected, weighing the thumb vector more than any other detected finger.

6. The method as claimed in claim 1 wherein the display is divided to a plurality of cardinal sectors, and wherein the predetermined relationship between the hand orientation direction and the orientation direction of the item comprises orienting the document in parallel to one the cardinal directions.

7. A method of automatic orientation of an item having an orientation vector τ

, towards a user operating in a surface computing environment having a multi-touch capable display, the item having a widget associate therewith, wherein the widget is further associated with performing a predetermined action on the item, the method comprises the steps of;

Identifying a user hand touch or gesture affected by the user on the display, at a location associated with the widget;

responsive to the hand touch or gesture, determining a hand orientation direction η

, the hand orientation having pre-defined relationship to the location of the arm;

performing the predetermined action on the item; and

,

orienting the item to the user by aligning the item in a predetermined relation between the hand orientation vector η and

the orientation vector τ

of the item.

8. The method as claimed in claim 7, wherein the multi-touch display comprises a computer vision based detection system, and wherein the step of determining the hand orientation direction comprises:

detecting a plurality of finger touch points;

detecting location of a palm attached to the fingers;

identifying which of the detected fingers belong to the detected palm;

determining a plurality of finger vectors between a corresponding plurality of fingers and a point under the palm;

summing the finger vectors to obtain hand orientation direction η

.

9. A method of estimating a user location relative to a multi-touch capable display, the method comprises the steps of:

Identifying a user hand touch on the display, the touch comprising at least a plurality of touch points made by simultaneous touch of a plurality of fingers;

identifying a convergence point associated with the user palm attached to the plurality of fingers;

calculating a plurality of vectors from the convergence point to the corresponding plurality of the fingers;

summing the plurality of vectors to receive a user direction approximating the location of the user relative to the convergence point.

10. A method as claimed in claim 9 further comprising the step of translating the user direction relative to a display coordinate base, by assigning the user direction a magnitude extending from convergence point to the edge of the display along the user direction, to receive a user vector, and summing the user vector with a vector extending from the display coordinate base to the convergence point.

11. A method as claimed in claim 9 wherein the step of identifying the convergence point utilizes image recognition of the palm.