INTERACTIVE INPUT SYSTEM, CONTROLLER THEREFOR AND METHOD OF CONTROLLING AN APPLIANCE

• US 20090102800A1
• Filed: 10/17/2007
• Published: 04/23/2009
• Est. Priority Date: 10/17/2007
• Status: Active Grant

• Current Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: KEENAN, VAUGHN E.
• Granted Patent: US 8,487,881 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device
• CPC Class Codes: G08C 23/04 using light waves, e.g. infrared

Abstract

An interactive input system comprises a consumer electronic device and a controller for the consumer electronic device. The controller is operable in one of a touch input mode and a gesture input mode and controls the consumer electronic device in response to one of the detected user touch input and user gesture input depending on the operating mode of the controller.

Claims

1. An interactive input system comprising:

an appliance;

imaging structure; and

processing structure communicating with said appliance and said imaging structure, said processing structure processing image data received from said imaging structure to detect user touch input and user gesture input and outputting commands to said appliance corresponding to the detected user input.

2. An interactive input system according to claim 1 wherein said imaging structure captures images of a touch surface and images of a region remote from said touch surface, said processing structure processing the images of said touch surface to detect said user touch input and processing the images of said region to detect said user gesture input.

3. An interactive input system according to claim 2 wherein said processing structure is operable in one of a touch input mode and a gesture input mode, in said touch input mode, said processing structure only processing the images of said touch surface and in said gesture input mode, said processing structure only processing the images of said region.

4. An interactive input system according to claim 3 wherein said processing structure is automatically conditioned to said touch input mode when the existence of a pointer is detected in the captured images of said touch surface.

5. An interactive input system according to claim 4 wherein said imaging structure comprises at least two first cameras looking generally across said touch surface from different viewpoints and having overlapping fields of view and at least one second camera looking into said region.

6. An interactive input system according to claim 5 wherein said first and second cameras are mounted on a housing adjacent said touch surface.

7. An interactive input system according to claim 6 wherein said touch surface forms part of a display panel.

8. An interactive input system according to claim 7 wherein said display panel forms part of said appliance.

9. An interactive input system according to claim 7 wherein said display panel is separate from said appliance.

10. An interactive input system according to claim 6 wherein the region extends from about two feet to twenty feet in front of said touch surface.

11. An interactive input system according to claim 7 wherein said display panel provides visual feedback concerning detected user touch and user gesture input.

12. An interactive input system comprising:

a consumer electronic device; and

a controller for said consumer electronic device, said controller being operable in one of a touch input mode and a gesture input mode and controlling said consumer electronic device in response to one of detected user touch input and user gesture input depending on the operating mode of said controller.

13. An interactive input system according to claim 12 wherein said controller separately images an area in close proximity to a touch surface and a region beyond said area, said controller remaining in said gesture input mode until a pointer appears in images of said area at which time said controller is automatically conditioned to said touch input mode.

14. An interactive input system according to claim 13 wherein said controller comprises at least two spaced, first imaging devices having overlapping fields of view looking generally across said touch surface and processing structure processing acquired image data to detect pointer contacts on said touch surface.

15. An interactive input system according to claim 14 wherein said controller further comprises at least one second imaging device having overlapping fields of view looking into said region.

16. An interactive input system according to claim 12 wherein said controller is integral with said consumer electronic device.

17. An interactive input system according to claim 16 wherein said consumer electronic device comprises a display screen, at least a portion of said display screen constituting a touch surface.

18. An interactive input system according to claim 12 wherein said controller comprises a display panel, said display panel providing visual feedback concerning detected user touch and user gesture input.

19. An interactive input system according to claim 18 wherein said display panel defines a touch surface on which user touch input is made.

20. A method of controlling operation of an appliance comprising:

monitoring a touch surface to detect user touch input and capturing images of a region beyond the touch surface to detect user gesture input; and

in response to detected user touch or user gesture input, issuing at least one command to control said appliance.

21. The method of claim 20 further comprising presenting images on said touch surface to provide visual feedback concerning user input detection.