Interactive input system and method

• US 9,600,100 B2
• Filed: 01/11/2013
• Issued: 03/21/2017
• Est. Priority Date: 01/11/2012
• Status: Active Grant

• Current Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Taylor, Cameron, Lam, Clinton
• Primary Examiner(s): Siddiqui, Md Saiful A
• Application Number:
  US13/823,638
• Publication Number:
  US 20150123899A1
• Time in Patent Office: 1,530 Days
• Field of Search: 345/1.1, 345/1.3, 345/156, 345/169, 345173-179
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0383 Signal control means within the pointing device
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/97 Determining parameters from multiple pictures depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85

Abstract

An interactive input system comprises at least one imaging device configured to capture image frames of a region of interest comprising a background and at least one background feature. Processing structure is configured to compare the image frames to determine if the location of the at least one background feature has changed signifying system displacement.

Claims

1. An interactive input system, comprising:

at least one imaging device configured to capture image frames of a region of interest comprising a background and at least one background feature, wherein the at least one background feature comprises at least one dedicated discrete light source; and

a processing structure configured to;

receive, from the at least one imaging device, imaging data based on the captured image frames;

receive background vertical intensity profile (VIP) data;

calculate a difference VIP based on the received background VIP data and the received imaging data;

compare the captured image frames to determine whether the location of the at least one background feature in the captured image frames has changed signifying system displacement,

wherein the comparing is partially based on the difference VIP; and

based on the result of the comparing, modify captured image frames to compensate for the system displacement.

2. The interactive input system of claim 1, wherein the at least one imaging device is positioned above a display surface within the region of interest.

3. The interactive input system of claim 2, further comprising an illumination source providing a plane of illumination generally parallel to the display surface.

4. The interactive input system of claim 3, wherein at least one pointer brought into proximity with the background reflects illumination of the plane towards the at least one imaging device.

5. The interactive input system of claim 4, further comprising at least one background feature configured to reflect illumination of the plane towards the at least one imaging device.

6. The interactive input system of claim 1, wherein at least one of the image frames is captured in the event at least one pointer is brought into proximity of the background.

7. The interactive input system of claim 6, wherein at least one of the image frames is a background image frame captured in the event no pointers are within proximity of the background.

8. The interactive input system of claim 7, wherein the processing structure is further configured to calculate a distortion based on the change in location of the at least one background feature.

9. The interactive input system of claim 8, wherein the processing structure is further configured to apply the distortion to one of the background image frame and the image frame captured in the event at least one pointer is brought into proximity of the background.

10. The interactive input system of claim 9, wherein the processing structure is configured to generate a difference image frame by subtracting the background image frame from the image frame captured in the event at least one pointer is brought into proximity of the background.

11. The interactive input system of claim 10, wherein the processing structure is further configured to identify the presence of the at least one pointer in the difference image frame.

12. The interactive input system of claim 11, wherein the processing structure is further configured to calculate the location of the at least one pointer.

13. The interactive input system of claim 1, wherein the background is at least one bezel at least partially surrounding a display surface within the region of interest.

14. The interactive input system of claim 13, wherein the at least one dedicated discrete light source is on the at least one bezel.

15. The interactive input system of claim 13, wherein the at least one background feature comprises a plurality of dedicated discrete light sources at spaced locations on the at least one bezel.

16. The interactive input system of claim 1, wherein the at least one background feature comprises a plurality of dedicated discrete light sources at spaced locations within the region of interest.

17. The interactive input system of claim 1, wherein the processing structure is further configured to:

crop the background VIP data before calculating the difference VIP.

18. The interactive input system of claim 1, wherein the processing structure is further configured to:

calculate difference VIP by subtracting the background VIP data from VIP data for the captured image frames.

19. A method of determining displacement of an interactive input system, the method comprising:

capturing image frames of a region of interest comprising a background and at least one background feature using at least one imaging device, wherein the at least one background feature comprises at least one dedicated discrete light source;

receiving vertical intensity profile (VIP) background data;

calculating a difference VIP based on the VIP background data and the captured image frames;

comparing the captured image frames, based at least in part on the different VIP, to determine whether the location of the at least one background feature in the captured image frames has changed signifying system displacement, and

based on the result of the comparing, modifying the captured image frames to compensate for the system displacement.

20. The method of claim 19, wherein at least one of the image frames is captured in the event at least one pointer is brought into proximity of the background.

21. The method of claim 20, wherein at least one of the image frames is a background image frame captured in the event no pointers are within proximity of the background.

22. The method of claim 21, further comprising, calculating a distortion based on the change in location of the at least one background feature.

23. The method of claim 22, further comprising, applying the distortion to one of the background image frame and the image frame captured in the event at least one pointer is brought into proximity of the background.

24. The method of claim 22, further comprising, generating a difference image frame by subtracting the background image frame from the image frame captured in the event at least one pointer is brought into proximity of the background.

25. The method of claim 24, further comprising, identifying the presence of the at least one pointer in the difference image frame.

26. The method of claim 25, further comprising, calculating the location of the at least one pointer.

27. A non-transitory computer readable medium embodying a computer program comprising instructions, which when executed by a computer, causes the computer to carry out a method, comprising:

receiving vertical intensity profile (VIP) background data;

comparing captured image frames of a region of interest comprising a background and at least one background feature to determine whether the location of the at least one background feature appearing in the captured image frames has changed signifying system displacement, wherein the at least one background feature comprises at least one dedicated discrete light source,

wherein the comparing includes calculating a difference VIP based on the VIP background data and the captured image frames; and

based on the result of the comparing, modifying the captured image frames to compensate for the system displacement.