Electronic device and server, and methods of controlling the electronic device and server

• US 9,118,804 B2
• Filed: 07/05/2012
• Issued: 08/25/2015
• Est. Priority Date: 09/30/2011
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kim, Kyunghwan, Ko, Hanyoung, Kim, Joomin, Baek, Sungmin
• Primary Examiner(s): Anwah, Olisa
• Application Number:
  US13/541,869
• Publication Number:
  US 20130083154A1
• Time in Patent Office: 1,146 Days
• Field of Search: 348/14.01, 348/14.03, 348/14.07, 348/14.1, 348/14.15, 348/14.16, 348/14.08
• US Class Current: 1/1
• CPC Class Codes: H04L 65/1069 Session establishment or de-establishment
• CPC Class Codes: H04L 65/4053 without floor control
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

An electronic device is provided including a communication unit configured to receive audio/video data (A/V data) streamed from a first electronic device, a display unit configured to display the video data of the A/V data, and a controller configured to obtain shape feature information of a first real object included in the video data, to determine whether there is first personal information of the first real object based on the shape feature information, and to display a first virtual object including the first personal information on the display unit in association with the first real object when there is the first personal information.

Claims

1. An electronic device comprising:

a communication unit configured to receive audio/video data (A/V data) streamed from a first electronic device;

a display unit configured to display the video data of the A/V data; and

a controller configured to obtain shape feature information of a first real object included in the video data, to determine availability of first personal information associated with the first real object based on the shape feature information, to display a first virtual object including the first personal information on the display unit in association with the first real object when the first personal information is available, to analyze the A/V data, to obtain second personal information associated with the first real object when the first personal information is unavailable, and to display a second virtual object including the second personal information on the display unit in association with the first real object,

wherein the controller is further configured to recognize a shape of a second real object positioned to satisfy a predetermined distance condition with the first real object, and obtain the second personal information based on the recognized shape.

2. The electronic device of claim 1, wherein the shape feature information includes face feature information.

3. The electronic device of claim 1, wherein the controller is configured to recognize the shape of the second real object based on a movement of the first real object.

4. The electronic device of claim 1, wherein the controller is configured to recognize audio data associated with a movement of the first real object and to obtain the second personal information based also on the recognized audio data.

5. The electronic device of claim 1, wherein the controller is configured to generate a control signal requesting that the obtained second personal information be stored corresponding to the shape feature information of the first real object.

6. The electronic device of claim 1, wherein when the A/V data includes a third real object, the controller is configured to select at least one of the first real object or the third real object depending on movement information of the first or third real object and to display the first virtual object only for the selected real object.

7. The electronic device of claim 1, wherein when the A/V data includes a third real object, the controller is configured to select at least one of the first real object or the third real object depending on movement information of the first or third real object and to change a display property of the first virtual object displayed for the selected real object.

8. The electronic device of claim 1, wherein when there is the first personal information, the controller is configured to transmit a message for confirmation on whether to display the first virtual object to at least one of a user terminal or a user email account based on at least one of an identification number of the user terminal or an address of the user email, wherein the identification number and the address are included in the first personal information, and the message includes the first personal information.

9. The electronic device of claim 1, wherein when there is the first personal information, the controller is configured to transmit a message including the first personal information to at least one of a user terminal or a user email account based on at least one of an identification number of the user terminal or an address of the user email, wherein the identification number and the address are included in the first personal information, configured to receive a response message responding to the transmitted message, and configured, when personal information included in the response message is different from the first personal information, to display a third virtual object including the personal information included in the response message in association with the first real object.

15. The electronic device of claim 1, wherein the first virtual object is relocated when a display region corresponding to another real object approaches the first virtual object.

16. The electronic device of claim 1, wherein the first virtual object is relocated when a display region corresponding to the first real object approaches the first virtual object.

10. A server comprising:

a database;

a communication unit configured to receive audio/video data (A/V data) transmitted from a first electronic device, the A/V data configured to cause display of video data on a display device; and

a controller configured to obtain shape feature information of a first real object included in the video data of the A/V data, to determine whether the database includes first personal information associated with the first real object based on the shape feature information, to generate a first virtual object including the first personal information, to update the A/V data to include the first virtual object such that the first virtual object is configured to be displayed at a first relative location with respect to the first real object, to transmit the updated A/V data to a second electronic device, to analyze the A/V data, and to obtain second personal information of the first real object when the database does not include the first personal information,

wherein the controller is further configured to recognize a shape of a second real object positioned to satisfy a predetermined distance condition with the first real object, and obtain the second personal information based on the recognized shape.

11. The server of claim 10, wherein the controller is configured to recognize a shape of the second real object based on a movement of the first real object.

12. The server of claim 10, wherein the controller is configured to recognize audio data associated with a movement of the first real object and to obtain the second personal information based also on the recognized audio data.

13. The server of claim 10, wherein the controller is configured to generate a second virtual object including the obtained second personal information, to change the A/V data to include the second virtual object, and to transmit the changed A/V data to the second electronic device.

14. A method of controlling an electronic device, the method comprising:

displaying video data of audio/video data (A/V data) streamed from a first electronic device;

obtaining shape feature information of a first real object included in the video data;

determining whether there is first personal information of the first real object based on the shape feature information;

displaying a first virtual object including the first personal information in association with the first real object when there is the first personal information;

analyzing the A/V data to recognize a shape of a second real object positioned to satisfy a predetermined distance condition with the first real object;

obtaining second personal information of the first real object when there is no first personal information, wherein the second personal information is obtained based on the recognized shape; and

displaying a second virtual object including the second personal information on a display unit in association with the first real object.