Interactive input system and method

• US 9,262,011 B2
• Filed: 03/30/2011
• Issued: 02/16/2016
• Est. Priority Date: 03/30/2011
• Status: Active Grant

• Current Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Keenan, Vaughn E., McGibney, Grant, Rattray, Robbie, Popovich, David Gregory, Wang, Yunqiu Rachel, Gurtler, Patrick James, Willson, Chris, Svensson, Nicholas
• Primary Examiner(s): PARDO, THUY N
• Application Number:
  US13/075,508
• Publication Number:
  US 20120249477A1
• Time in Patent Office: 1,784 Days
• Field of Search: 345173-178, 345/166, 178 1801- 2004
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04109 FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
• CPC Class Codes: G06F 3/042 by opto-electronic means

Abstract

An interactive input system comprises an optical waveguide, a radiation source directing radiation into the optical waveguide, the radiation undergoing total internal reflection within the optical waveguide in response to at least one touch input on a surface of the optical waveguide. At least one imaging device is positioned adjacent to the waveguide, the at least one imaging device having a field of view looking inside the optical waveguide and capturing image frames thereof. Processing structure processes the image frames captured by the at least one imaging device to determine a location of the at least one touch input based on a frequency of reflections of the radiation appearing in the image frame.

Claims

1. An interactive input system comprising:

an optical waveguide;

a radiation source directing radiation into the optical waveguide, the radiation undergoing total internal reflection within the optical waveguide in response to at least one touch input on a touch surface of the optical waveguide;

at least one imaging device positioned adjacent to the optical waveguide and having a field of view looking inside the optical waveguide and capturing image frames thereof;

non-reflective radiation absorbing material positioned about a periphery of the optical waveguide so as not to occlude the field of view of the at least one imaging device, the non-reflective radiation absorbing material configured to absorb the radiation propagating within the optical waveguide that reaches the periphery of the optical waveguide at which the non-reflective radiation absorbing material is positioned; and

processing structure for processing the image frames to determine a location of the at least one touch input based on a frequency of reflections of the radiation in the image frame.

2. The interactive input system of claim 1, wherein the radiation source is positioned on a side of the optical waveguide that is opposite to the touch surface.

3. The interactive input system of claim 1, wherein the processing structure determines the location based also on an angular position of the reflections with respect to the imaging device.

4. The interactive input system of claim 1, wherein the radiation source is connected to a pointer.

5. The interactive input system of claim 4, wherein the pointer is triggered to direct radiation into the optical waveguide in response to touch contact on the surface of the waveguide by a tip of the pointer.

6. The interactive input system of claim 1, wherein the optical waveguide is generally rectangular in shape.

7. The interactive input system of claim 6, wherein at least one of the top and bottom surfaces of the optical waveguide is processed to enhance scattering of radiation.

8. An interactive input system comprising:

an optical waveguide within which radiation can be totally internally reflected, the optical waveguide having two parallel surfaces and an image extraction surface extending between the parallel surfaces to permit the radiation reaching the image extraction surface to escape;

at least one imaging device having a field of view aimed at the image extraction surface to capture image frames thereof;

non-reflective radiation absorbing material positioned about a periphery of the optical waveguide so as not to occlude the field of view of the at least one imaging device, the non-reflective radiation absorbing material configured to absorb the radiation propagating within the optical waveguide that reaches the periphery of the optical waveguide at which the non-reflective radiation absorbing material is positioned; and

processing structure for processing the image frames captured by the at least one imaging device to determine a location of at least one touch input on one or more of the parallel surfaces based on a frequency of reflections of the radiation in the image frames.

9. The interactive input system of claim 8, wherein the image extraction surface has an extraction angle with respect to the surface of the waveguide that is greater than a critical angle of the waveguide.

10. The interactive input system of claim 9, wherein the extraction angle is one of:

45 degrees, 55 degrees, 90 degrees.

11. The interactive input system of claim 8, wherein the processing structure determines the location based also on an angular position of the reflections with respect to the imaging device.

12. The interactive input system of claim 8, further comprising:

a radiation source directing background radiation through the optical waveguide via at least one of the parallel surfaces,

wherein in the event that at least one pointer contacts or is proximate to one of the parallel surfaces, at least a portion of the background radiation being directed through the optical waveguide is reflected off of the respective pointer back into and along the optical waveguide.

13. The interactive input system of claim 12 further comprising a display panel, wherein the radiation source is positioned between the optical waveguide and the display panel.

14. A method for determining the location of a pointer in touch contact with an optical waveguide causing radiation within the waveguide to undergo total internal reflection, the method comprising:

capturing images of the inside of the optical waveguide using at least one imaging device;

absorbing the radiation propagating within the optical waveguide that reaches a periphery of the optical waveguide using a non-reflective radiation absorbing material positioned about the periphery so as not to occlude the field of view of the at least one imaging device; and

processing the images to determine the location of the pointer based on a frequency of reflections of the radiation and an angular position of the reflections with respect to the position of the imaging device.

15. The method of claim 14 wherein the processing comprises:

calculating a vertical intensity profile for the captured images;

finding a maximum vertical intensity profile; and

determining the frequency of reflections of the radiation along an image column corresponding to a maximum value of the vertical intensity profile.

16. The method of claim 15 wherein the determining comprises:

converting the captured images into a frequency domain; and

applying a frequency domain analysis method to the captured images.

17. The method of claim 15 further comprising:

identifying a pointer distance to the at least one imaging device corresponding to the frequency of reflections of the radiation.

18. The method of claim 17 wherein the angular position of the reflections with respect to the position of the imaging device corresponds to a pointer angle.

19. The method of claim 18 wherein the processing further comprises:

identifying the pointer angle corresponding to the maximum value of the vertical intensity profile.

20. An interactive input system comprising:

an optical waveguide within which radiation can be totally internally reflected, the optical waveguide having two parallel surfaces;

an extraction block having an input face against a portion of one of the parallel surfaces, wherein the extraction block permits radiation in the optical waveguide that reaches the portion to escape into the extraction block via the input face and to exit the extraction block via an output face;

an imaging device having a field of view looking at the output face and capturing image frames thereof; and

non-reflective radiation absorbing material positioned about a periphery of the optical waveguide so as not to occlude the field of view of the imaging device, the non-reflective radiation absorbing material configured to absorb the radiation propagating within the optical waveguide that reaches the periphery of the optical waveguide at which the non-reflective radiation absorbing material is positioned.

21. The interactive input system of claim 20, wherein the output face of the extraction block is at an angle, with respect to the input face of the extraction block, greater than a critical angle of the optical waveguide.

22. The interactive input system of claim 21, wherein the angle is 55 degrees to the surface of the waveguide.

23. The interactive input system of claim 20, further comprising:

a radiation source directing background radiation through the optical waveguide via at least one of the parallel surfaces,

wherein in the event at least one pointer contacts one of the parallel surfaces, at least a portion of the background radiation being directed through the optical waveguide is reflected off of the respective pointer back into and along the optical waveguide.

24. The interactive input system of claim 23 further comprising a display panel, wherein the radiation source is positioned to emit background radiation towards the display panel to reflect off of the display panel and into the optical waveguide.

25. The interactive input system of claim 24, further comprising a redirection structure for receiving the background radiation emitted by the radiation source and directing the background radiation towards the display panel.

26. The interactive input system of claim 25, wherein the redirection structure is one of a prism and a mirror.

27. The interactive input system of claim 20, further comprising a lens positioned between the output face and the imaging device for focusing the radiation exiting from the output face.

28. The interactive input system of claim 27, wherein the extraction block and the optical waveguide are formed from the same material.

29. The interactive input system of claim 28, wherein the extraction block and the optical waveguide are a single unit.

30. The interactive input system of claim 20, wherein in the event that radiation emitted by at least one pointer is injected into and along the optical waveguide via one of the parallel surfaces, the image frames captured by the imaging device include the emitted radiation.

31. The interactive input system of claim 30, further comprising:

a processing structure for processing image frames to determine a location of the at least one pointer on the one parallel surface at which the radiation entered into the optical waveguide.

32. The interactive input system of claim 31, wherein the location for the at least one pointer is determined based on positions at which reflections of the respective radiation appear in an image frame being processed.

33. The interactive input system of claim 32, wherein the location for each of the at least one pointers is determined based on a frequency of the reflections of the respective radiation appearing in an image frame being processed.

34. The interactive input system of claim 33, wherein the location for each of the at least one pointers is also determined based on an angular position of the reflections with respect to the position of the imaging device.