INTERACTIVE INPUT SYSTEM AND METHOD

• US 20120007804A1
• Filed: 07/12/2010
• Published: 01/12/2012
• Est. Priority Date: 07/12/2010
• Status: Abandoned Application

• Current Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Morrison, Gerald D., Chtchetinine, Alex, Holmgren, David E., Zhou, Ye, Kabada, Brinda, McReynolds, Daniel Peter, McGibney, Grant Howard, Al-Eryani, Sameh
• Application Number:
  US12/834,734
• Publication Number:
  US 20120007804A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

A method of resolving ambiguities between at least two pointers within a region of interest comprises capturing images of the region of interest and at least one reflection thereof from different vantages using a plurality of imaging devices, processing image data to identify a plurality of targets for the at least two pointers, for each image, determining a state for each target and assigning a weight to the image data based on the state, and calculating a pointer location for each of the at least two pointers based on the weighted image data.

Claims

1. A method of resolving ambiguities between at least two pointers within a region of interest comprising:

capturing images of the region of interest and at least one reflection thereof from different vantages using a plurality of imaging devices;

processing image data to identify a plurality of targets for the at least two pointers;

for each image, determining a state for each target and assigning a weight to the image data based on the state; and

calculating a pointer location for each of the at least two pointers based on the weighted image data.

2. The method of claim 1, wherein the calculating is performed using weighted triangulation.

3. The method of claim 2 further comprising determining real and phantom targets associated with each pointer.

4. The method of claim 3 wherein a high weight is assigned to the image data from an unobstructed image and a low weight is assigned to the image data from an obstructed image.

5. The method of claim 1 comprising:

determining if any of the targets are located within a virtual input area, and discarding the targets located within the virtual input area.

6. An interactive input system comprising:

an input surface divided into at least two input areas;

at least one mirror positioned with respect to the input surface and producing a reflection thereof, thereby defining at least two virtual input areas;

a plurality of imaging devices having at least partially overlapping fields of view, the imaging devices being oriented so that different sets of imaging devices image the input area and virtual input areas; and

processing structure processing image data acquired by the imaging devices to track the position of at least two pointers adjacent the input surface and resolving ambiguities between the pointers.

7. The interactive input system of claim 6, wherein the processing structure comprises a candidate generation procedure module to determine for each input area and virtual input area if consistent candidates exist in image frames captured by the respective set of imaging devices.

8. The interactive input system of claim 7, wherein the processing structure further comprises an association procedure module to associate the consistent candidates with targets associated with the at least two pointers.

9. The interactive input system of claim 8, wherein the processing structure further comprises a tracking procedure module to track the targets in the at least two input regions.

10. The interactive input system of claim 9, wherein the processing structure further comprises a state estimation module to determine locations of the at least two pointers based on information from the association procedure module and the tracking procedure module and image data from the plurality of imaging devices.

11. The interactive input system of claim 10, wherein the processing structure further comprises a disentanglement process module to, when the at least two pointers appear merged, determine locations for each of the pointers based on information from the state estimation module, the tracking procedure module and image data from the plurality of imaging devices.

12. The interactive input system of claim 11, wherein weights are assigned to the image data from each of the plurality of imaging devices.

13. The interactive input system of claim 12, wherein the processing structure uses weighted triangulation for processing the image data.

14. The interactive input system of claim 13, wherein weights are assigned to the image data from each of the plurality of imaging devices.

15. An interactive input system comprising:

a plurality of imaging devices having fields of view encompassing an input area and a virtual input area, the imaging devices being oriented so that different sets of imaging devices image different input regions of the input area and the virtual input area.

16. The interactive input system of claim 15, wherein at least one of the input regions is imaged by all of the imaging devices and wherein at least another of the input regions is imaged by a subset of the imaging devices.

17. The interactive input system of claim 16, wherein at least one of the input regions is viewed by at least three imaging devices.

18. The interactive input system of claim 17, wherein at least three input regions of the input area and the virtual input area are imaged, a central region being imaged by all of the imaging devices and regions on opposite sides of the central region being imaged by different subsets of imaging devices.

19. The interactive input system of claim 15 wherein the plurality of imaging devices comprises at least one real imaging device and at least one virtual imaging device.