System for using mobile communication terminal as pointer and method and medium thereof

• US 20070243863A1
• Filed: 02/22/2007
• Published: 10/18/2007
• Est. Priority Date: 04/17/2006
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Lee, Sang-goog, Hong, Young-jin
• Granted Patent: US 8,135,440 B2
• Time in Patent Office: Days
• US Class Current: 455/418
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence

Abstract

A system for using a mobile communication terminal as a pointer and a method and medium thereof are disclosed, in which information displayed on a head mounted display (HMD) can be controlled by using the mobile communication terminal as the pointer. The system includes a head mounted display device receiving an input of an image of a background having a marker, and the mobile communication terminal searching for the position of the marker by detecting the marker from the image of the background having the marker transmitted from the head mounted display device, and providing the pointer to the searched position. The head mounted display device displays the pointer provided by the mobile communication terminal.

Claims

1. A mobile communication device comprising:

a controller to output a marker of a specified form on a screen;

a communicator to receive an image of a background that includes the marker from a head mounted display; and

a position detector to search for the position of the marker by detecting the marker from the received image.

2. The mobile communication device of claim 1, further comprising:

a signal input unit to receive a button signal generated by a user'"'"'s button manipulation;

a mode setter to set an operation mode requested by the user; and

a display to display the marker on the screen in accordance with a marker output request from the controller.

16. The device of claim 2, wherein the operation mode is a general mode or a pointer mode.

17. The device of claim 2, wherein the background further comprises a web browser, which is displayed on the display.

3. A head mounted display device comprising:

an image input unit to receive an image of a background that includes a marker;

a communicator to transmit the image of the background that includes the marker to a mobile communication device; and

a display to display a pointer provided by the mobile communication device.

4. The head mounted display device of claim 3, wherein the marker is outputted in a specified form on the screen of the mobile communication device.

18. The head mounted display device of claim 3, wherein the background further comprises a web browser, which is displayed on the display.

5. A system for using a mobile communication device as a pointer, comprising:

a head mounted display device to receive an input of an image of a background that includes a marker,

wherein the mobile communication device searches for a position of the marker by detecting the marker from the image of the background including the marker that is transmitted from the head mounted display device, and providing the pointer to the searched position, and

wherein the head mounted display device displays the pointer provided by the mobile communication device.

6. The system of claim 5, wherein the marker is outputted in a specified form on the screen of the mobile communication device.

19. The system of claim 5, wherein the background further comprises a web browser, which is displayed by the head mounted display device.

7. A method of using a mobile communication device as a pointer, comprising:

receiving an image of a background including a marker from a head mounted display device;

searching for a position of the marker by detecting the marker from the received image; and

displaying the pointer on the position of the searched marker.

8. The method of claim 7, further comprising displaying the marker in a specified form on a screen of the mobile communication device if a mode of the mobile communication device is set to a pointer mode.

9. The method of claim 7, further comprising updating changed position of the marker by detecting position of the marker at predetermined intervals.

10. The method of claim 7, further comprising:

moving the displayed pointer by moving the mobile communication device; and

selecting specified information provided at a point where the pointer is positioned by selecting a button of the mobile communication device.

11. The method of claim 10, wherein the mobile communication device moves in any one of X, Y, and Z directions.

12. The method of claim 11, wherein the mobile communication device generates a vibration to accurately recognize position of pointer when the mobile communication terminal moves in the Z-direction.

13. The method of claim 7, further comprising inputting a phone number and making a phone call if a mode of the mobile communication device is set to a general mode.

14. The method of claim 7, wherein the background further comprises a web browser

15. At least one computer readable medium storing computer readable instructions that control at least one processor to implement the method of claim 7.