TERMINAL AND METHOD FOR PROVIDING AUGMENTED REALITY

• US 20110187743A1
• Filed: 08/16/2010
• Published: 08/04/2011
• Est. Priority Date: 01/29/2010
• Status: Abandoned Application

• Current Assignee: Pantech Co. Ltd. (Pantech Incorporated)
• Original Assignee: Pantech Co. Ltd. (Pantech Incorporated)
• Inventors: YOO, Yong Gil, JANG, Seong Hwan, LEE, Yong Youn, KIM, Dae Yong, HWANG, Ju Hee, KANG, Moon Key, PARK, Sun Hyung, HONG, Jae Man, KONG, Kyoung Jin
• Application Number:
  US12/856,963
• Publication Number:
  US 20110187743A1
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 10/245 by locating a pattern; Special marks for positioning
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

A first terminal shares a digital marker edited in a digital marker editing mode and an object corresponding to the edited digital marker with a second terminal using a wireless communication technology. If a digital marker is displayed on an image display unit of the first terminal, the second terminal photographs the digital marker using a camera, and synthesizes an object corresponding to the photographed digital marker with a real-time video image obtained through the camera to display a merged image as augmented reality. Then, the second terminal receives input information for changing the digital marker from a user, and transmits the received input information to the first terminal. The first terminal changes a digital marker using the input information received from the second terminal. The second terminal photographs the changed digital marker, and displays an object corresponding to the changed digital marker.

Claims

1. A terminal to provide augmented reality, comprising:

a digital marker editing unit to edit a digital marker and to define an object corresponding to the edited digital marker;

a memory unit to store the digital marker edited by the digital marker editing unit and the object corresponding to the edited digital marker; and

an image display unit to display the digital marker edited by the digital marker editing unit.

2. The terminal according to claim 1, wherein the digital marker comprises:

an editable object selection area to define a kind of the object; and

an editable object motion selection area to define a motion of the object.

3. The terminal according to claim 2, wherein the digital marker further comprises:

a background color selection area to define a background color of a screen on which the object is displayed.

4. The terminal according to claim 1, further comprising:

a local area wireless communication unit to transmit the digital marker and the object corresponding to the digital marker to another terminal using a local area wireless communication technology, to receive input information to change the digital marker from the other terminal, and to send the received input information to the digital marker editing unit.

5. The terminal according to claim 4, wherein the digital marker editing unit changes the digital marker displayed on the image display unit using the received input information.

6. The terminal according to claim 1, further comprising:

a wired/wireless communication unit to transmit the digital marker and the object corresponding to the digital marker to a server through a wired/wireless communication network, to receive input information to change the digital marker from the server, and to send the received input information to the digital marker editing unit.

7. A terminal to provide augmented reality, comprising:

a camera unit to photograph a digital marker displayed on an image display unit of another terminal;

a memory unit to store the digital marker and an object corresponding to the digital marker;

a control unit to recognize the digital marker photographed by the camera unit, and to load the object corresponding to the digital marker from the memory unit;

a video processing unit to synthesize the object loaded by the control unit with a real-time video image obtained through the camera unit; and

an image display unit to display the synthesized object and real-time video image.

8. The terminal according to claim 7, further comprising:

a local area wireless communication unit to receive the digital marker and the object corresponding to the digital marker from the other terminal, and to transmit input information to the other terminal to change the digital marker displayed on the image display unit of the other terminal.

9. The terminal according to claim 7, further comprising:

a wired/wireless communication unit to download the digital marker and the object corresponding to the registered digital marker from a server, and to transmit input information to the server to change the digital marker displayed on the image display unit of the other terminal.

10. A terminal to provide augmented reality, comprising:

a digital marker editing unit to edit a first digital marker and to define a first object corresponding to the edited first digital marker;

a memory unit to store the first digital marker edited by the digital marker editing unit and the first object corresponding to the edited first digital marker;

an image display unit to display the first digital marker edited by the digital marker editing unit;

a camera unit to photograph a second digital marker displayed on an image display unit of another terminal;

a control unit to recognize the second digital marker photographed by the camera unit, and to load a second object corresponding to the recognized second digital marker from the memory unit;

a video processing unit to synthesize the second object loaded by the control unit with a real-time video image obtained through the camera unit; and

is an image display unit to display the synthesized object and real-time video image.

11. The terminal according to claim 10, further comprising:

a local area wireless communication unit to transmit the first digital marker and the first object corresponding to the first digital marker to the other terminal, to receive the second digital marker and the second object corresponding to the second digital marker from the other terminal to store the received second digital marker and the second object corresponding to the second digital maker to the memory unit, to receive input information to change the first digital marker from the other terminal, and to transmit input information to the other terminal to change the second digital marker displayed on the image display unit of the other terminal.

12. The terminal according to claim 10, further comprising:

a wired/wireless communication unit to transmit the first digital marker and the first object corresponding to the first digital marker to a server, to download the second digital marker and the second object corresponding to the second digital marker from the server to store the second digital marker and the second object corresponding to the second digital maker in the memory unit, to receive input information to change the first digital marker from the server, and to transmit input information to the server to change the second digital marker displayed on the image display unit of the other terminal.

13. The terminal according to claim 10, wherein the digital marker editing unit edits the first digital marker according to a user'"'"'s input comprising a key input or a touch input.

14. A method for providing augmented reality, comprising:

editing a digital marker in a digital marker editing mode and defining an object corresponding to the edited digital marker;

storing the digital marker and the object in a memory unit; and

displaying the digital marker on an image display unit.

15. The method according to claim 14, further comprising:

receiving input information for changing the digital marker displayed on the image display unit; and

changing the digital marker using the received input information.

16. The method according to claim 14, further comprising:

receiving input information for changing the digital marker displayed on the image display unit from another terminal via a local area wireless communication; and

changing the digital marker using the received input information.

17. The method according to claim 14, further comprising:

receiving input information for changing the digital marker displayed on the image display unit from a server via a wired/wireless communication network; and

changing the digital marker using the received input information.

18. The method according to claim 14, further comprising:

transmitting a selected digital marker from among digital markers stored in the memory unit and an object corresponding to the selected digital marker to another terminal via a local area wireless communication.

19. The method according to claim 18, further comprising:

storing the selected digital marker and the object corresponding to the selected digital marker in the memory unit in the other terminal.

20. The method according to claim 14, further comprising:

transmitting a selected digital marker from among digital markers stored in the memory unit and an object corresponding to the selected digital marker to a server via a wired/wireless communication network.

21. The method according to claim 20, further comprising:

downloading a registered digital marker and an object corresponding to the registered digital marker from the server via the wired/wireless communication network; and

storing the downloaded registered digital marker and the object corresponding to the downloaded registered digital marker in the memory unit.

22. A method for providing augmented reality, comprising:

photographing a digital marker displayed on an image display unit of another terminal using a camera;

recognizing the photographed digital marker, and loading a first object corresponding to the digital marker from a memory unit;

synthesizing the first object with a real-time video image obtained through the camera; and

displaying the synthesized first object and real-time video image on an image display unit.

23. The method according to claim 22, further comprising:

transmitting input information to the other terminal using a local area wireless communication technology to change the digital marker displayed on the image display unit of the other terminal;

photographing the changed digital marker displayed on the image display unit of the other terminal according to the input information;

recognizing the changed digital marker, and loading a second object corresponding to the changed digital marker from the memory unit;

synthesizing the second object with a real-time video image obtained through the camera; and

displaying the synthesized second object and real-time video image on the image display unit.