Interactive input system and information input method therefor

• US 9,189,086 B2
• Filed: 04/01/2010
• Issued: 11/17/2015
• Est. Priority Date: 04/01/2010
• Status: Active Grant

• Current Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Inventors: McGibney, Grant, Radke, Tim
• Primary Examiner(s): Wang-Hurst, Kathy
• Assistant Examiner(s): Shen, Peijie
• Application Number:
  US12/752,882
• Publication Number:
  US 20110242060A1
• Time in Patent Office: 2,056 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421

Abstract

An interactive input system comprises at least one imaging assembly having a field of view looking into a region of interest and capturing image frames and processing structure in communication with the at least one imaging assembly. When a pointer exists in captured image frames, the processing structure demodulates the captured image frames to determine frequency components thereof and examines the frequency components to determine at least one attribute of the pointer.

Claims

1. An interactive input system comprising:

at least one light source configured to emit radiation at a particular frequency into a region of interest;

at least one imaging assembly having a field of view aimed into the region of interest into which at least one active pointers are brought and capturing image frames, each active pointer emitting modulated radiation comprising a combination of subcarrier frequencies unique thereto, each of the subcarrier frequencies being different than the particular frequency; and

processing structure in communication with the at least one imaging assembly and processing captured image frames to detect the existence of a pointer therein, when an active pointer exists in captured image frames, said processing structure demodulating the captured image frames to determine frequency components thereof and examining the frequency components to determine the subcarrier frequency combination of the modulated radiation emitted by the active pointer and thereby to determine at least one predefined attribute of said active pointer and to determine the amplitudes of the subcarrier frequencies of the determined subcarrier frequency combination and thereby to determine another attribute of said active pointer.

2. The interactive input system of claim 1, wherein during demodulating the processing structure applies a transform to the captured image frames.

3. The interactive input system of claim 1, wherein the active pointer is a pen tool emitting modulated radiation into the region of interest.

4. The interactive input system of claim 3, wherein the modulated radiation emitted by the pen tool is infrared radiation.

5. The interactive input system of claim 1, wherein the at least one predefined attribute comprises one of pointer input colour and pointer functionality.

6. The interactive input system of claim 5, wherein the pointer functionality is one of a right mouse click, a left mouse click, and an erasing action.

7. The interactive input system of claim 1, wherein the at least one imaging assembly comprises at least two imaging assemblies.

8. The interactive input system of claim 7, wherein during demodulating the processing structure applies a transform to the captured image frames.

9. The interactive input system of claim 7, wherein the active pointer is a pen tool.

10. The interactive input system of claim 7, wherein the at least one light source is cycled between on and off states.

11. The interactive input system of claim 10, wherein each of said imaging assemblies captures successive image frames, one image frame being captured when the at least one light source is in the on state and one image frame being captured when the at least one light source is in the off state.

12. The interactive input system of claim 11, wherein said processing structure subtracts image frames captured when the at least one light source is in the off state from image frames captured when at least one light source is in the on state to form difference image frames, sums the difference image frames to form a composite image frame, and determines a location of the pointer in the composite image frame.

13. The interactive input system of claim 12, wherein said processing structure further defines an analysis region associated with the pointer location in the composite image frame, and examines frequency components derived from portions of the captured image frames corresponding to the analysis region.

14. The interactive input system of claim 9, wherein the pen tool comprises a pressure sensitive tip, and the pen tool further modulates emitted modulated radiation according to tip pressure.

15. The interactive input system of claim 7, wherein each of the imaging assemblies comprises at least two light sensors having generally identical views of the region of interest and capturing the image frames, the at least two light sensors having exposure periods that are generally staggered.

16. The interactive input system of claim 7, further comprising a bezel at least partially surrounding the region of interest and having a surface in the field of view of said at least two imaging assemblies.

17. The interactive input system of claim 7, wherein the radiation emitted by the at least one light source is infrared radiation.

18. The interactive input system of claim 9, wherein the modulated radiation emitted by the pen tool is infrared radiation.

19. The interactive input system of claim 7, wherein the at least one predefined attribute comprises one of pointer input colour and pointer functionality.

20. The interactive input system of claim 19, wherein the pointer functionality is one of a right mouse click, a left mouse click, and an erasing action.

32. The interactive input system of claim 1 wherein the combination of subcarrier frequencies unique to each active pointer comprises at least three different subcarrier frequencies.

33. The interactive input system of claim 5 wherein the combination of subcarrier frequencies unique to each active pointer comprises at least three different subcarrier frequencies.

34. The interactive input system of claim 7 wherein the combination of subcarrier frequencies unique to each active pointer comprises at least three different subcarrier frequencies.

35. The interactive input system of claim 1, wherein the processing structure is configured to determine differences between the amplitudes of the subcarrier frequencies of the determined subcarrier frequency combination to determine the other attribute.

36. The interactive input system of claim 35, wherein the other attribute is pressure applied by the active pointer to a surface in the field of view of the at least one imaging assembly, and wherein the determined differences correlate to the pressure.

21. A method of inputting information into an interactive input system comprising:

emitting, by at least one light source, radiation at a particular frequency into a region of interest;

capturing, by at least one imaging assembly, image frames of the region of interest into which at least one active pointers are brought, each active pointer emitting modulated radiation comprising a combination of subcarrier frequencies unique thereto, each of the subcarrier frequencies being different than the particular frequency;

processing the captured image frames to detect the existence of a pointer therein; and

when an active pointer exists in captured image frames, demodulating the captured image frames to determine frequency components thereof and examining the frequency components to determine the subcarrier frequency combination of the modulated radiation emitted by the active pointer and thereby to determine at least one predefined attribute of the active pointer and to determine the amplitudes of the subcarrier frequencies of the determined subcarrier frequency combination and thereby to determine another attribute of said active pointer.

22. The method of claim 21, wherein the demodulating further comprises applying a transform to the captured image frames.

23. The method of claim 21, wherein the active pointer is a pen tool.

24. The method of claim 21, wherein the at least one light source is cycled between on and off states.

25. The method of claim 24, wherein the captured image frames comprise image frames captured in the on and off states.

26. The method of claim 24, further comprising:

generating a composite image frame by subtracting image frames captured in the off state from image frames captured in the on state to form difference image frames, and summing the difference image frames;

determining a location of the pointer in the composite image frame; and

defining an analysis region associated with the pointer location in the composite image frame, wherein the examining is carried out with respect to frequency components derived from portions of the captured image frames corresponding to the analysis region.

27. The method of claim 21, wherein the at least one predefined attribute is selected from the group consisting of pointer input colour and pointer functionality.

28. The method of claim 27, wherein the pointer functionality is one of a right mouse click, a left mouse click, and an erasing action.

29. The method of claim 21 wherein the combination of subcarrier frequencies unique to each active pointer comprises at least three different subcarrier frequencies.

30. The method of claim 24 wherein the combination of subcarrier frequencies unique to each active pointer comprises at least three different subcarrier frequencies.

31. The method of claim 27 wherein the combination of subcarrier frequencies unique to each active pointer comprises at least three different subcarrier frequencies.

37. The method of claim 21, further comprising determining differences between the amplitudes of the subcarrier frequencies of the determined subcarrier frequency combination to determine the other attribute.

38. The method of claim 37, wherein the other attribute is pressure applied by the active pointer to a surface in the field of view of the at least one imaging assembly, and wherein the determined differences correlate to the pressure.