APPARATUS AND METHOD FOR PROVIDING SOCIAL NETWORK SERVICE USING AUGMENTED REALITY

• US 20140132630A1
• Filed: 10/03/2013
• Published: 05/15/2014
• Est. Priority Date: 11/13/2012
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: JUNG, Eun-Sung, MUN, Min-Young
• Application Number:
  US14/044,911
• Publication Number:
  US 20140132630A1
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 13/279 the virtual viewpoint locations being selected by the viewers or determined by tracking
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A system for providing a social network service (SNS) by utilizing augmented reality. The system includes a first device configured to receive image of a first user, to create a reference image based on the received images, and to transmit the reference image to a second device; and the second device is configured to receive the reference image from the first device, to generate a virtual image based on the reference image and the current context information of a second user, and to display the virtual image at predetermined locations.

Claims

1. A system for providing a social network service (SNS), the system comprising:

a first device configured to receive image of a first user, to create a reference image based on the received images, and to transmit the reference image to a second device; and

the second device is configured to receive the reference image from the first device, to generate a virtual image based on the reference image and the current context information of a second user, and to display the virtual image at predetermined locations.

2. The system of claim 1, wherein the first device comprises an image sensor configured to collect images of the second user, and to transmit the collected images to the first user.

3. The system of claim 1, the first device is further configured to receive a first audio of the first user and to output the first audio or to transmit the first audio to the second device, and to receive a second audio of the second user and to transmit the second audio to the first user.

4. The system of claim 1, wherein the first device is further configured to receive one or more control instructions to control the first device, the control instructions comprising instructions to show a list of friends of the second user currently watching a broadcast program, or to initiate a conversation with one or more friends of the second user.

5. The system of claim 1, wherein the context information comprises at least one of a viewing direction or viewing angle of the second user.

6. The system of claim 5, wherein the second device is further configured to determine a shape of the virtual image based on the context information and a location at which to display the virtual image.

7. The system of claim 1, wherein the first device is a television configured to receive and output TV signals, and the second device is a wearable device.

8. The system of claim 1, wherein the virtual image is displayed to overlap another image displayed on the first device.

9. A method of providing a social network service (SNS), the method comprising:

receiving, at a first device, an image of a first user of the SNS;

creating a reference image based on the received image;

transmitting the reference image to a second device;

generating, at the second device, a virtual image based on the reference image and the current context information of a second user; and

displaying the virtual image at predetermined locations.

10. The method of claim 9, further comprising:

receiving a first audio of the first user; and

outputting the first audio of the first user or transmitting the first audio to the second device.

11. The method of claim 9, further comprising transmitting images of the second user collected by an image sensor to the first user.

12. The method of claim 9, wherein the context information comprises at least one of a viewing direction or a viewing angle of the second user.

13. The method of claim 12, wherein the generating of the virtual image comprises determining a shape of the virtual image to be generated based on the context information and a location at which to display the virtual image.

14. The method of claim 9, wherein the first device is a television that is configured to receive and output TV signals, and the second device is a wearable device.

15. The method of claim 9, wherein the creating the reference image comprises creating the reference image based on the received image and a default image of the first user.

16. The method of claim 15, wherein the default image is based on at least one of an emotional state of the first user or a facial expression of the first user.

17. The method of claim 15, wherein the default image is stored in the default image database and comprises at least one of avatars, images of celebrities, real images of the first user, or images associated with the first user.

18. The system of claim 9, wherein the displaying the virtual image comprises displaying the virtual image to overlap another image displayed on the first device.

19. The method of claim 9, wherein the displaying the virtual image comprises displaying a portion of the virtual image of the first user.

20. A device comprising:

at least one image sensor, the image sensor configured to collect an image of a first user;

a first communication unit configured to transmit the image of the first user to a second user, and to receive an image of the second user;

an image creating unit configured to create a reference image based on the received image of the second user; and

a second communication unit configured to transmit the reference image to a second device; and

to generate a virtual image to be displayed to the first user using the reference image.

21. The device of claim 20, further comprising:

a user recognizing unit configured to recognize the first user; and

an instruction processing unit configured to receive various control instructions from the first user and to process corresponding operations in response to the control instructions.

22. The device of claim 21, wherein the control instructions comprises at least one of showing a list of all friends, showing a list of friends currently watching a broadcast program, or initiating a conversation with a particular friend.

23. The device of claim 20, further comprising:

a voice output unit configured to output a audio of the second user that is received through the first communication unit; and

a voice receiving unit configured to receive a audio of the first user and to transmit the audio of the first user to the second user through the first communication unit.

24. The device of claim 20, further comprising:

a default image database (DB) configured to store default images for creating the reference image,

wherein the image creating unit is configured to select one default image based on the received image of the second user to create the reference image.

25. A second device comprising:

a communication unit configured to receive a reference image of a second user from a first device;

a context recognizing unit configured to recognize a current contextual information of a first user watching content displayed on the first device;

a rendering unit configured to generate a virtual image based on the received reference image and the context information; and

a display unit configured to display the generated virtual image at a predetermined location.

26. The second device of claim 25, further comprising:

an image sensor configured to create an image of the first user; and

the context recognizing unit analyzes the image of the first user and generates the context information comprising at least one of a viewing direction or a viewing angle of the user.

27. The second device of claim 26, wherein the rendering unit is further configured to determine a shape of the virtual image based on the context information and a location at which to display the virtual image.

28. The second device of claim 25, further comprising:

a voice output unit configured to output a spoken voice of the second user which is received from the first device through the communication unit; and

a voice receiving unit configured to receive a spoken voice of the first user and to transmit the received voice to the first device through the communication unit.

29. The device of claim 25, wherein the second device is a wearable device.