USER EQUIPMENT AND METHOD FOR PROVIDING AUGMENTED REALITY (AR) SERVICE

• US 20120092528A1
• Filed: 08/18/2011
• Published: 04/19/2012
• Est. Priority Date: 10/13/2010
• Status: Active Grant

• Current Assignee: MEC Resources, LLC (Three Affiliated Tribes of the Fort Berthold Reservation, North Dakota)
• Original Assignee: Pantech Corporation (Ideahub, Inc.)
• Inventors: HWANG, Ju Hee, JUNG, Ho Ryong, LEE, Ho Ryun, LEE, Seung Tek, CHOI, Jai Young, KIM, Jung Sick, HAN, Sang Keun
• Granted Patent: US 8,823,855 B2
• Time in Patent Office: Days
• US Class Current: 348/239
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 1/00244 with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/32101 Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 2201/3245 of image modifying data, e.g. handwritten addenda, highlights or augmented reality information
• CPC Class Codes: H04N 2201/3273 Display

Abstract

An augmented reality (AR) service including a photographing unit to capture an image of a target object, an information collecting unit to collect contextual information of the captured image of the target object, a tag generating unit to generate an AR tag of a first direction, the AR tag corresponding to the contextual information, and a display unit to display the image of the target object and the AR tag. A method for providing an AR service including capturing an image of a target object with a camera, collecting contextual information including location information of the captured image of the target object and a first azimuth information between the target object and the camera, generating an AR tag corresponding to the contextual information, and displaying the captured image of the target object and the generated AR tag.

Claims

1. A user equipment to provide an augmented reality (AR) service, the user equipment comprising:

a photographing unit to capture an image of a target object;

an information collecting unit to collect contextual information of the captured image of the target object, the contextual information comprising a location information of the photographing unit and a first azimuth information between the target object and the photographing unit;

a tag generating unit to generate an AR tag based on a first direction, the AR tag corresponding to the contextual information; and

a display unit to display the captured image of the target object and the AR tag.

2. The user equipment of claim 1, further comprising:

an AR information management server to store AR information corresponding to the contextual information;

a communication unit to communicate with the AR management server; and

a control unit to control the communication unit to transmit the AR information to the AR management server.

3. The user equipment of claim 1, further comprising:

a storage unit to store AR information corresponding to the contextual information,

wherein the tag generating unit generates the AR tag based on the AR information collected from the storage unit.

4. The user equipment of claim 1, wherein the tag generating unit generates a three-dimensional AR tag based on the AR information.

5. The user equipment of claim 4, wherein the tag generating unit generates an AR tag having one or more faces along a contour of the target object.

6. The user equipment of claim 5, wherein different AR information based on the azimuth between the target object and the photographing unit is displayed on the one or more faces of the AR tag.

7. The user equipment of claim 4, further comprising:

a user input unit to receive a user input to rotate the displayed AR tag,

wherein the tag generating unit provides AR information of the target object corresponding to a second azimuth by rotating the displayed AR tag according to the received user input.

8. The user equipment of claim 4, further comprising:

a user input unit to receive a selection of a second face displaying the AR tag; and

wherein the tag generating unit rotates the AR tag according to the selected second face so that the second face is facing the user to provide AR information of the target object corresponding to a second azimuth on the second face.

9. The user equipment of claim 1, wherein the tag generating unit generates an AR tag corresponding to the first azimuth toward the target object viewed in a second direction relative to the target object if the user equipment capturing the target object is moved in the second direction.

10. A user equipment to provide an augmented reality (AR) service, the user equipment comprising:

a photographing unit to capture an image of a target object;

an information collecting unit to collect contextual information of the captured image of the target object, the contextual information comprising location information of the photographing unit and image data of the target object;

a communication unit to transmit the collected contextual information to an AR management server and to receive AR information of the target object from the AR management server, wherein the AR management server stores the AR information of the target object based on azimuth information of the captured image;

a tag generating unit to generate an AR tag based on AR information corresponding to a first azimuth between the target object and the photographing unit; and

a display unit to display the captured image of the target object and the generated AR tag.

11. The user equipment of claim 10, wherein the information collecting unit further collects azimuth information of the first azimuth between the target object and the photographing unit,

wherein if the collected azimuth information is changed, the tag generating unit generates an AR tag based on AR information corresponding to a second azimuth information.

12. The user equipment of claim 10, wherein the tag generating unit generates a three-dimensional AR tag based on the AR information.

13. The user equipment of claim 12, wherein the tag generating unit generates an AR tag having one or more faces along a contour of the object.

14. The user equipment of claim 13, wherein the AR information based on an azimuth between the target object and the photographing unit is displayed on one or more faces on the AR tag.

15. The user equipment of claim 12, further comprising:

a user input unit to receive a user input to rotate the displayed AR tag, wherein the displayed AR tag is rotated to a second position according to the received user input, and

wherein the tag generating unit provides AR information of the target object corresponding to a second azimuth corresponding to the second position of the AR tag.

16. The user equipment of claim 10, wherein the tag generating unit generates an AR tag corresponding to a second azimuth toward the target object viewed in a second position relative to the target object if the user equipment is rotated.

17. A method for providing an augmented reality (AR) service, the method comprising:

capturing an image of a target object with a camera;

collecting contextual information including location information of the captured image of the target object and a first azimuth information between the target object and the camera;

generating an AR tag corresponding to the contextual information; and

displaying the captured image of the target object and the generated AR tag.

18. The method of claim 17, further comprising:

requesting an AR management server to provide AR information corresponding to the contextual information, wherein the AR management server stores the AR information; and

receiving the AR information from the AR management server.

19. The method of claim 17, wherein the generating of the AR tag comprises generating the AR tag based on AR information corresponding to the contextual information, wherein the contextual information is stored in the user equipment.

20. The method of claim 17, wherein the generating of the AR tag comprises generating a three-dimensional AR tag based on the AR information.

21. The method of claim 20, wherein the generating of the AR tag comprises generating the AR tag having one or more faces along a contour of the target object.

22. The method of claim 21, wherein the displaying comprises displaying the AR information based on the first azimuth between the target object and the camera on the one or more faces of the AR tag.

23. The method of claim 20, further comprising:

receiving a user input to rotate the displayed AR tag; and

providing the AR information of the target object corresponding to a second azimuth by rotating the displayed AR tag according to the received user input.

24. The method of claim 21, further comprising:

sensing a selection of a second face of the generated AR tag;

rotating the AR tag according to the selected second face so that the second face is facing the user; and

displaying the AR information of the target object corresponding to a second azimuth on the second face.

25. The method of claim 17, further comprising:

generating an AR tag corresponding to a second azimuth toward the target object viewed in a second position relative to the target object if the user equipment capturing the target object is rotated.

26. A method for providing an augmented reality (AR) service, the method comprising:

capturing an image of a target object;

collecting contextual information comprising location information of the captured image and image data of the captured image;

transmitting the collected contextual information to an AR management server to store AR information of the target object for a first azimuth;

receiving the AR information of the target object from the AR management server;

generating an AR tag based on the AR information corresponding to the first azimuth between the target object and the camera; and

displaying the captured image of the target object and the AR tag.

27. The method of claim 26, wherein contextual information further comprises azimuth information of a second azimuth between the target object and the camera, and

wherein the generating of the AR tag comprises generating the AR tag based on the AR information corresponding to the second azimuth information.

28. The method of claim 26, wherein the generating of the AR tag comprises generating a three-dimensional AR tag based on the AR information corresponding to the contextual information.

29. The method of claim 26, wherein the generating of the AR tag further comprises generating the AR tag having one or more faces along a contour of the target object, and displaying the AR information based on the first azimuth between the target object and the camera on one or more faces of the AR tag.