USER INTERFACE DEVICE AND METHOD FOR RECOGNIZING USER INTERACTION USING SAME

• US 20110254810A1
• Filed: 04/15/2011
• Published: 10/20/2011
• Est. Priority Date: 04/15/2010
• Status: Abandoned Application

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: LEE, Dong Woo, LIM, Jeong Mook, JEONG, Hyun Tae, SHIN, Hee Sook, CHO, IL YEON, KIM, Baesun, SON, Yong Ki
• Application Number:
  US13/087,897
• Publication Number:
  US 20110254810A1
• Time in Patent Office: Days
• US Class Current: 345/175
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0386 for light pen
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: H04N 9/3173 wherein the projection device is specially adapted for enhanced portability
• CPC Class Codes: H04N 9/3182 Colour adjustment, e.g. white balance, shading or gamut white balance per se H04N9/73; control of amplitude of colour signals H04N9/68; colour control circuits for displays in general G09G5/02, G09G3/2003, G09G3/3607
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

A user interface device includes a frame replacement unit configured to replace a frame of an input image signal by a pattern frame at a frame time; a projector module configured to project an image of the image signal with the pattern frame onto a target; an image acquisition unit configured to capture a pattern image of the pattern frame from the image projected onto the target; and an image recognition unit configured to recognize a user interaction by using the captured pattern image.

Claims

1. A user interface device comprising:

a frame replacement unit configured to replace a frame of an input image signal by a pattern frame at a frame time;

a projector module configured to project an image of the image signal with the pattern frame onto a target;

an image acquisition unit configured to capture a pattern image of the pattern frame from the image projected onto the target; and

an image recognition unit configured to recognize a user interaction by using the captured pattern image.

2. The user interface device of claim 1, wherein the pattern image includes a general-purpose image in unicolor and color and a constructed light in unicolor and color.

3. The user interface device of claim 1, wherein the pattern image includes an infrared image.

4. The user interface device of claim 1, wherein the pattern image has a grid pattern.

5. The user interface device of claim 4, wherein the image recognition unit detects the change in the grid pattern of the pattern image caused by a motion event on the image projected onto the target to recognize the user interaction.

6. The user interface device of claim 1, wherein the image recognition unit is further configured to detect a focus of the pattern image, and

the user interface device further comprises an optical controller configured to control the projector module to correct the focus of the projector module depending on the detected focus.

7. The user interface device of claim 1, wherein the image recognition unit is further configured to detect brightness, color and distortion of the pattern image, and

the user interface device further comprises an image control unit configured to correct the brightness, color and distortion of the image to be projected onto the target depending on the detected brightness, color and distortion.

8. A method for recognizing a user interaction, the method comprising:

replacing a frame of an input image signal by a pattern frame at a frame time;

projecting an image of the image signal with the pattern frame onto a target;

capturing a pattern image of the pattern frame from the image projected onto the target; and

recognizing the user interaction by using the captured pattern image.

9. The method of claim 8, wherein the pattern image includes a general-purpose image in unicolor and color and a structured light in unicolor and color.

10. The method of claim 8, wherein the pattern image includes an infrared image.

11. The method of claim 8, wherein the pattern image has a grid pattern.

12. The method of claim 8, further comprising:

detecting a focus of the pattern image; and

controlling said projecting the pattern image to correct the focus of the pattern image.

13. The method of claim 8, further comprising:

detecting the brightness, color and distortion of the pattern image, and

controlling said projecting an image of the image signal with the pattern image to correct the brightness, color and distortion of the image to be projected onto the target.

14. The method of claim 11, wherein said recognizing the user interaction comprises detecting the change in the grid pattern of the pattern image caused by a motion event on the image projected on the target.

15. A user interface device comprising:

a projector module configured to project an image onto a target;

a pattern image generator configured to generate a laser beam having a pattern through diffraction to project a pattern image thereof onto the target;

an image acquisition unit, in synchronization with the projection of the pattern image, configured to capture the pattern image projected onto the target on which the image is projected; and

an image recognition unit configured to recognize a user interaction by using the captured pattern image.

16. The user interface device of claim 15, wherein the pattern image generator includes a laser module to project the laser beam and a diffraction grating to pass the laser beam therethrough.

17. The user interface device of claim 15, wherein the image recognition unit detects the change in the pattern of the pattern image caused by a motion event to recognize the user interaction.

18. The user interface device of claim 15, wherein the image recognition unit is further configured to detect a focus of the pattern image, and

the user interface device further comprises an optical controller configured to control the projector module to correct the focus of the pattern image depending on the detected focus.

19. The user interface device of claim 15, wherein the image recognition unit is further configured to detect brightness, color and distortion of the pattern image, and

the user interface device further comprises an image correction unit configured to correct the brightness, color and distortion of the image projected onto the target depending on the detected brightness, color and distortion.