Interactive input system and method

• US 9,442,607 B2
• Filed: 12/04/2006
• Issued: 09/13/2016
• Est. Priority Date: 12/04/2006
• Status: Active Grant

• Current Assignee: Smart Technologies Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Morrison, Gerald
• Primary Examiner(s): Eisen, Alexander
• Assistant Examiner(s): LAM, NELSON C
• Application Number:
  US11/566,515
• Publication Number:
  US 20080129700A1
• Time in Patent Office: 3,571 Days
• Field of Search: 345156-179, 178/18.09
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421

Abstract

An interactive input system comprises imaging devices with different viewpoints and having at least partially overlapping fields of view encompassing a region of interest. At least two of the imaging devices have different focal lengths. Processing structure processes image data acquired by the imaging devices to detect the existence of a pointer and determine the location of the pointer within the region of interest.

Claims

1. An interactive input system comprising:

imaging devices with different viewpoints and having at least partially overlapping fields of view of a touch surface, at least one of the imaging devices comprising first and second adjacent image sensors with different focal lengths, the first image sensor having a field of view encompassing generally the entirety of the touch surface and the second image sensor having a field of view encompassing only a portion of the touch surface; and

processing structure configured to process image data acquired by the imaging devices to determine if a pointer image exists in the image data with a desired level of confidence and generate pointer data,

wherein for each of said at least one imaging devices having said first and second adjacent image sensors with different focal lengths, said processing structure configured to generate the pointer data using image data acquired by only one of said first and second adjacent image sensors and to determine the location of a pointer on the touch surface based on the pointer data,

wherein for each pointer contact with said touch surface at a location that is proximate the at least one imaging device, the pointer image is determined to exist in the image data with the desired level of confidence in only image data acquired by the first image sensor, and

wherein for each pointer contact with said touch surface that is distant from the at least one imaging device, the pointer image is determined to exist in the image data with the desired level of confidence in only image data acquired by the second image sensor.

2. The interactive input system according to claim 1 wherein all of said imaging devices comprise first and second adjacent image sensors with different focal lengths.

3. The interactive input system according to claim 2 wherein the first and second adjacent image sensors are vertically stacked so that their optical axes are in line.

4. The interactive input system according to claim 2 wherein the first and second adjacent image sensors are side-by-side.

5. The interactive input system according to claim 2 wherein the imaging devices are positioned adjacent respective corners of the touch surface, the imaging devices looking generally across said touch surface.

6. The interactive input system according to claim 1 wherein the imaging devices are positioned adjacent respective corners of the touch surface, the imaging devices looking generally across said touch surface.

7. The interactive input system according to claim 1 wherein said desired level of confidence is existence of a pointer image having a size greater than a threshold size.

8. A touch system comprising:

a touch surface on which an image is visible;

imaging assemblies about the periphery of said touch surface, said imaging assemblies having at least partially overlapping fields of view encompassing said touch surface, each imaging assembly comprising at least two proximate imaging devices with each imaging device having a different focal length, a first of said two proximate imaging devices having a field of view encompassing the entirety of said touch surface and a second of said two proximate imaging devices having a field of view encompassing only a portion of said touch surface; and

processing structure configured to process image data generated by the imaging assemblies to determine the location of at least one pointer relative to the touch surface based on image data acquired by the imaging assemblies, wherein each imaging assembly generates said pointer data using image data acquired by only one of the first and second imaging devices thereof,

wherein said processing structure is configured to process image data acquired by each imaging device to determine if a pointer image exists in the image data with a desired level of confidence,

wherein when the pointer contacts the touch surface proximate a particular imaging assembly, the pointer image is detected with the desired level of confidence in only image data acquired by the first imaging device of the particular imaging assembly, and

wherein when the pointer contacts the touch surface distant the particular imaging assembly, the pointer image is detected with the desired level of confidence in only image data acquired by the second imaging device.

9. The touch system according to claim 8 wherein the first and second imaging devices of each imaging assembly are vertically stacked so that their optical axes are in line.

10. The touch system according to claim 8 wherein the first and second imaging devices of each imaging assembly are side-by-side.

11. The touch system according to claim 8 wherein said touch surface is rectangular and wherein imaging assemblies are positioned at least adjacent two opposite corners thereof.

12. An interactive input system comprising:

camera assemblies with different viewpoints and having fields of view encompassing a touch surface, each camera assembly comprising at least first and second adjacent image sensors with the image sensors having different focal lengths, the first image sensor having a field of view encompassing generally the entirety of the touch surface and the second image sensor having a field of view encompassing only a portion of the touch surface; and

processing structure configured to process image data received from said camera assemblies to determine the position of at least one pointer relative to said touch surface based on image data acquired by the camera assemblies, wherein the image data provided to the processing structure by each camera assembly is based only on image data acquired by one of the first and second adjacent image sensors thereof,

wherein said processing structure processes image data acquired by each image sensor to determine if a pointer image is believed to exist in the image data with a desired level of confidence,

wherein when the pointer contacts the touch surface proximate a particular camera assembly, the pointer image is detected with the desired level of confidence in only image data acquired by the first image sensor of the particular camera assembly, and

wherein when the pointer contacts the touch surface distant the particular camera assembly, the pointer image is detected with the desired level of confidence in only image data acquired by the second image sensor of the particular camera assembly.

13. The interactive input system according to claim 12 wherein said desired level of confidence is existence of a pointer image having a size greater than a threshold size.

14. The interactive input system according to claim 12 wherein the first and second adjacent image sensors of each camera assembly are vertically stacked so that their optical axes are in line.

15. The interactive input system according to claim 12 wherein the first and second adjacent image sensors of each camera assembly are side-by-side.

16. The interactive input system according to claim 12 wherein the camera assemblies are positioned adjacent corners of the touch surface, the first and second adjacent image sensors of each camera assembly looking generally across said touch surface.

17. An interactive input system comprising:

imaging assemblies at spaced locations about the periphery of a touch surface, said imaging assemblies having at least partially overlapping fields of view encompassing said touch surface and acquiring images looking generally across said touch surface, each imaging assembly comprising at least two proximate imaging devices with each imaging device having a different focal length, a first of said two proximate imaging devices having a field of view encompassing the entirety of said touch surface and a second of said two proximate imaging devices having a field of view encompassing only a portion of said touch surface, image data acquired by said imaging assemblies being processed to determine the location of at least one pointer relative to the touch surface based on the acquired image data, wherein image data acquired by only one of said first and second imaging devices of each imaging assembly is used to determine the location of the pointer,

wherein image data acquired by each image device is used to determine if a pointer image is believed to exist in the image data with a desired level of confidence,

wherein when the pointer contacts the touch surface proximate a particular imaging assembly, the pointer image is detected with the desired level of confidence in only image data acquired by the first imaging device of the particular imaging assembly, and

wherein when the pointer contacts the touch surface distant the particular imaging assembly, the pointer image is detected with the desired level of confidence in only image data acquired by the second imaging device of the particular imaging assembly.

18. The interactive input system according to claim 17 wherein the first and second imaging devices of each imaging assembly are vertically stacked so that their optical axes are in line.

19. The interactive input system according to claim 17 wherein the first and second imaging devices of each imaging assembly are side-by-side.

20. The interactive input system according to claim 17 wherein said touch surface is generally rectangular and wherein imaging assemblies are positioned at least adjacent two corners thereof.

21. The interactive input system according to claim 17 wherein said touch surface is generally rectangular and wherein imaging assemblies are positioned at least adjacent two corners thereof.

22. The interactive input system according to claim 17 wherein the imaging device that best sees the pointer is the imaging device that sees a largest pointer image having a size greater than a threshold size.

23. An interactive input system comprising:

camera assemblies with different viewpoints and having fields of view encompassing a touch surface, each camera assembly comprising at least first and second closely positioned image sensors with the image sensors having different focal lengths and acquiring images of said touch surface, the first image sensor having a field of view encompassing the entirety of the touch surface and the second image sensor having a field of view encompassing only a portion of the touch surface, image data acquired by said camera assemblies being processed to determine the location of at least one pointer relative to the touch surface based on the acquired image data, wherein image data acquired only one of said first and second image sensors of each imaging assembly is used to determine the location of the pointer,

wherein image data acquired by each image sensor is used to determine if a pointer image is believed to exist in the image data with a desired level of confidence,

wherein when the pointer contacts the touch surface proximate a particular camera assembly, the pointer image is detected with the desired level of confidence in only image data acquired by the first image sensor of the particular camera assembly, and

wherein when the pointer contacts the touch surface distant the particular camera assembly, the pointer image is detected with the desired level of confidence in only image data acquired by the second image sensor of the particular camera assembly.

24. The interactive input system according to claim 23 wherein the first and second image sensors of each camera assembly are vertically stacked so that their optical axes are in line.

25. The interactive input system according to claim 23 wherein the first and second image sensors of each camera assembly are side-by-side.

26. The interactive input system according to claim 23 wherein the camera assemblies are positioned adjacent corners of the touch surface, the first and second image sensors of each camera assembly looking generally across said touch surface.

27. An interactive input system comprising:

imaging assemblies with different viewpoints and having fields of view encompassing a touch surface, each imaging assembly comprising at least first and second imaging devices with each imaging device having a different focal length, the first imaging device of each imaging assembly having a focal length encompassing the entirety of the touch surface and the second imaging device of each imaging assembly having a focal length encompassing only a portion of the touch surface, wherein image data acquired only by either the first imaging device or by the second imaging device of each imaging assembly is processed to determine the location of at least one pointer within the region of interest,

wherein image data acquired by each imaging device is used to determine if a pointer image is believed to exist in the image data with a desired level of confidence,

wherein when a pointer contacts the touch surface proximate a particular imaging assembly, the pointer image is detected with the desired level of confidence in only image data acquired by the first imaging device of the particular imaging assembly, and

wherein when the pointer contacts the touch surface distant the particular imaging assembly, the pointer image is detected with the desired level of confidence in only image data acquired by the second imaging device of the particular imaging assembly.

28. The interactive input system according to claim 27 wherein the first and second imaging devices of each imaging assembly are vertically stacked so that their optical axes are in line.

29. The interactive input system according to claim 27 wherein the first and second imaging devices of each imaging assembly are side-by-side.

30. The interactive input system according to claim 27 wherein said region of interest is generally rectangular and wherein said imaging assemblies are positioned at least adjacent two corners thereof.