System and method for differentiating between pointers used to contact touch surface

• US 8,456,451 B2
• Filed: 12/01/2008
• Issued: 06/04/2013
• Est. Priority Date: 03/11/2003
• Status: Active Grant

• Current Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Morrison, Gerald D., Holmgren, David E.
• Primary Examiner(s): SHENG, TOM V
• Application Number:
  US12/325,507
• Publication Number:
  US 20090160801A1
• Time in Patent Office: 1,646 Days
• Field of Search: 345/156, 345/157, 345/158, 345/173, 345/175, 345179-183, 178/18.01, 178/18.03, 178/18.09, 178/18.11, 178/19.01
• US Class Current: 345/179
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

A touch system comprises a touch surface and at least one camera acquiring images of the touch surface. A pointer contact data generator generates pointer position data in response to pointer contact with the touch surface, the pointer position data representing where on the touch surface pointer contact is made. A processor communicates with the at least one camera and the pointer contact data generator. The processor analyzes acquired images to determine the type of pointer used to contact the touch surface, and processes the pointer position data in accordance with the determined type of pointer. In the preferred embodiment the processor distinguishes between pointer tip touch surface contacts, pointer backend touch surface contacts and finger touch surface contacts. A writing function is invoked in response to pointer tip touch surface contacts. An erase function is invoked in response to pointer backend touch surface contacts. Mouse events are generated in response to finger touch surface contacts.

Claims

1. A method of updating image data used to present an image on a display in response to pointer interaction on the display surface comprising:

assessing pointer data derived from at least one captured image of the pointer to determine automatically whether the pointer interaction is carried out using a pen tool or a finger; and

updating the image data based on the type and activity of the pointer, wherein during the assessing the orientation of the sides of said pointer is examined by fitting the pointer data to a mathematical model to determine if said pointer is a pen tool or a finger.

2. The method of claim 1 wherein during updating an editing function is performed when said pointer is pen tool and wherein a mouse event is invoked when said pointer is a finger.

3. The method of claim 1 wherein when said pointer is a pen tool, the pointer shape is further assessed to determine whether the pen tool is a writing tool or an erase tool, when said pen tool is a writing tool, the image data being updated so that said image includes writing corresponding to the writing tool activity on said touch surface and when said pen tool is an erase tool, the image data being updated so that writing in said image corresponding to the erase tool activity on said touch surface is removed.

4. The method of claim 3 wherein opposite ends of the pen tool constitute the writing tool and erase tool, said opposite ends having distinct shapes.

5. A method of updating image data used to present a displayed image on a touch surface in response to pointer interaction with said touch surface, said method comprising:

displaying an image on said touch surface;

capturing images looking generally across said touch surface and processing the captured images to generate pointer data when pointer interaction with said touch surface occurs;

determining the orientation of the sides of said pointer by fitting pointer data to a mathematical model to determine if the pointer interaction occurs using a pen tool or a finger; and

updating image data used to present the displayed image on said touch surface based on the generated pointer data and the determined type of pointer.

6. The method of claim 5 wherein when said pointer is a pen tool, the pointer shape is examined to determine whether the pen tool is a writing tool or an erase tool, when said pen tool is a writing tool, the image data being updated so that said image includes writing corresponding to the writing tool interaction on said touch surface and when said pen tool is an erase tool, the image data being updated so that writing in said image corresponding to the erase tool interaction on said touch surface is removed.

7. The method of claim 6 wherein opposite ends of the pen tool constitute the writing tool and erase tool, said opposite ends having distinct shapes.

8. The method of claim 5 wherein during updating an editing function is performed when said pointer is pen tool and wherein a mouse event is invoked when said pointer is a finger.

9. A method of updating image data used to present a displayed image on a touch surface in response to pointer contact on said touch surface, said method comprising the steps of:

displaying an image on said touch surface;

acquiring images of said touch surface and generating pointer data in response to pointer contact with said touch surface;

analyzing the acquired images to determine the type of pointer used to contact the touch surface by fitting the pointer data to a mathematical model thereby to determine the orientation of the sides of the pointer; and

updating image data used to present the displayed image on said touch surface based on the generated pointer data and the determined type of pointer.

10. The method of claim 9 wherein when said pointer is a pen tool, the pointer shape is examined to determine whether the pen tool is a writing tool or an erase tool, when said pen tool is a writing tool, the image data being updated so that said image includes writing corresponding to the writing tool activity on said touch surface and when said pen tool is an erase tool, the image data being updated so that writing in said image corresponding to the erase tool activity on said touch surface is removed.

11. The method of claim 10 wherein opposite ends of the pen tool constitute the writing tool and erase tool, said opposite ends having distinct shapes.

12. The method of claim 10 wherein during updating an editing function is performed when said pointer is pen tool and wherein a mouse event is invoked when said pointer is a finger.

13. A touch system comprising:

a touch surface on which an image is presented;

processing structure responsive to pointer contacts on the touch surface; and

at least one camera to acquire images of said pointer, wherein said processing structure processes said acquired images to determine whether said pointer is a pen tool or a finger based on the orientation of the sides of said pointer by fitting pointer data to a mathematical model and updates the presented image based on the type of pointer and the pointer activity on the touch surface.

14. A touch system according to claim 13 wherein said processing structure edits said presented image when said pointer is a pen tool and invokes a mouse event when said pointer is a finger.

15. A camera-based touch system comprising:

at least two cameras having overlapping fields of view encompassing an area on which pointer contacts are to be made; and

processing structure processing image data generated by said cameras to determine the location of a pointer relative to the area when the pointer is captured in images acquired by the cameras and to determine the type of pointer used to contact the area based on the orientation of the sides of the pointer by fitting pointer data to a mathematical model.

16. A camera-based touch system according to claim 15 wherein said processing structure uses the determined location and pointer type to update a processor-generated image.

17. A camera-based touch system according to claim 16 wherein said processor-generated image is presented on said area.

18. A camera-based touch system according to claim 17 wherein said processing structure examines the orientation of the sides of the pointer to determine whether the pointer is a pen tool or a finger.

19. A camera-based touch system according to claim 18 wherein, when said pointer is a pen tool, said processing structure performs a processor-generated image editing function.

20. A camera-based touch system according to claim 18 wherein, when said pointer is a finger, said processing structure invokes a mouse event.

21. A camera-based touch system according to claim 20 wherein, when said pointer is a pen tool, said processing structure performs a processor-generated image editing function.