Passive touch system and method of detecting user input

• US 8,669,959 B2
• Filed: 02/15/2013
• Issued: 03/11/2014
• Est. Priority Date: 07/05/2000
• Status: Expired due to Term

• Current Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Morrison, Gerald, Singh, Mavinder
• Primary Examiner(s): Liang, Regina
• Application Number:
  US13/768,406
• Publication Number:
  US 20130155029A1
• Time in Patent Office: 389 Days
• Field of Search: 345/156, 345/167, 345/168, 345173-179, 178 1801- 1809
• US Class Current: 345/173
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421

Abstract

A passive touch system includes a passive touch surface and at least two cameras associated with the touch surface. The at least two cameras acquire images of the touch surface from different locations and have overlapping fields of view. A processor receives and processes images acquired by the at least two cameras to detect the existence of a pointer therein and to determine the location of the pointer relative to the touch surface. Actual pointer contact with the touch surface and pointer hover above the touch surface can be determined.

Claims

1. A method comprising:

acquiring first and second images from different viewpoints;

subtracting said first and second images from background images to form first and second difference images;

processing each of said first and second difference images to determine if a region of interest within the difference image including a pointer exists therein, said region of interest being based on summed pixel intensities exceeding a threshold;

for each region of interest, masking the pixels of the region of interest to contrast pixels representing the pointer from pixels representing the background;

determining a position of the pointer based on pointer information calculated from the regions of interest; and

controlling an application based on the determined position of the pointer.

2. The method of claim 1, wherein the first and second images are captured by first and second cameras looking generally across a touch surface.

3. The method of claim 2, wherein the determined position of the pointer is a relative position with respect to the touch surface.

4. The method of claim 1, further comprising determining the velocity of the pointer or the angle of the pointer, wherein the application is controlled further based on the determined pointer velocity or pointer angle.

5. The method of claim 2, further comprising determining whether the pointer is hovering above or in contact with the touch surface.

6. The method of claim 3, further comprising determining whether the pointer is hovering above or in contact with the touch surface.

7. The method of claim 2, further comprising determining the velocity of the pointer or the angle of the pointer, wherein the application is controlled further based on the determined pointer velocity or pointer angle.

8. The method of claim 3, further comprising determining the velocity of the pointer or the angle of the pointer, wherein the application is controlled further based on the determined pointer velocity or pointer angle.

9. An apparatus comprising:

cameras configured to acquire first and second images from different viewpoints;

and at least one processor configured to;

subtract said first and second images from background images to form first and second difference images;

process each of said first and second difference images to determine if a region of interest within the difference image including a pointer exists therein, said region of interest being based on summed pixel intensities exceeding a threshold;

for each region of interest, mask the pixels of the region of interest to contrast pixels representing the pointer from pixels representing the background;

determine a position of the pointer based on pointer information calculated from the regions of interest; and

control an application based on the determined position of the pointer.

10. The apparatus of claim 9, wherein the first and second cameras look generally across a touch surface.

11. The apparatus of claim 10, wherein the determined position of the pointer is a relative position with respect to the touch surface.

12. The apparatus of claim 9, wherein the at least one processor is further configured to determine the velocity of the pointer or the angle of the pointer and further to control the application based on the determined pointer velocity or pointer angle.

13. The apparatus of claim 10, wherein the at least one processor is further configured to determine whether the pointer is hovering above or in contact with the touch surface.

14. The apparatus of claim 11, wherein the at least one processor is further configured to determine whether the pointer is hovering above or in contact with the touch surface.

15. The apparatus of claim 10, wherein the at least one processor is further configured to determine the velocity of the pointer or the angle of the pointer and further to control the application based on the determined pointer velocity or pointer angle.

16. The apparatus of claim 11, wherein the at least one processor is further configured to determine the velocity of the pointer or the angle of the pointer and further to control the application based on the determined pointer velocity or pointer angle.

17. A non-transitory computer-readable medium embodying computer program code that, when executed, causes an apparatus at least to:

acquire first and second images from different viewpoints;

subtract said first and second images from background images to form first and second difference images;

process each of said first and second difference images to determine if a region of interest within the difference image including a pointer exists therein, said region of interest being based on summed pixel intensities exceeding a threshold;

for each region of interest, mask the pixels of the region of interest to contrast pixels representing the pointer from pixels representing the background;

determine a position of the pointer based on pointer information calculated from the regions of interest; and

control an application based on the determined position of the pointer.