Method and apparatus for providing information about an identified object

• US 10,031,926 B2
• Filed: 09/01/2015
• Issued: 07/24/2018
• Est. Priority Date: 08/10/2010
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Duck-hoon, Park, Hee-seon, Choi, Yoon-hee, Yoon, Seok-hyun
• Primary Examiner(s): Coby, Frantz
• Application Number:
  US14/842,197
• Publication Number:
  US 20150370831A1
• Time in Patent Office: 1,057 Days
• Field of Search: 709204, 709203, 709201, 706 46, 707758, 707756, 707804, 707805, 707769, 707765, 707658
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/587 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06Q 50/01 Social networking

Abstract

A method and apparatus for identifying an object from an image or context aware information and providing information about the identified object. The method includes identifying at least one object included in an image being displayed or to be displayed on a user device, obtaining relationship information of an identified object based on identification information of the identified object, and outputting the relationship information to at least one of the user device and a device of the identified object.

Claims

1. A method of providing information in a first device, the method comprising:

receiving a user input to select an object of at least one object included in an image displayed on the first device;

obtaining identification information regarding the selected object;

obtaining relationship information which represents a relationship between a user of the first device and the selected object based on the identification information of the selected object;

obtaining recommendation information about the selected object based on the relationship information;

outputting the relationship information which represents the relationship between the user of the first device and the selected object, via at least one of the first device and a second device; and

outputting the recommendation information based on the relationship information, via at least one of the first device and the second device,

wherein the second device is a device of a user corresponding to the selected object.

2. The method of claim 1, wherein the second device is a device of a user corresponding to the selected object.

3. The method of claim 1, wherein the selected object is displayed separately in the image according to receiving the user input.

4. The method of claim 1, wherein the relationship information is displayed in a separate region within the image.

5. The method of claim 1, further comprising:

receiving a user input to select a plurality of objects included in the image displayed on the first device;

obtaining relationship information which represents a relationship of a group including a selected plurality of objects included in the image.

6. The method of claim 1, wherein obtaining the relationship information comprises searching a database stored in one of the first device and an external database of the first device.

7. The method of claim 1, wherein outputting the relationship information comprises transmitting the relationship information to the second device while outputting the relationship information via the first device.

8. The method of claim 1, wherein obtaining the recommendation information comprises searching one of a database stored in the first device and an external database of the first device.

9. The method of claim 1, further comprising:

obtaining context aware information relating to the first device; and

utilizing the context aware information when obtaining the recommendation information.

10. The method of claim 9, wherein the context aware information includes at least one of current time information and current location information relative to the first device.

11. The method of claim 1, further comprising:

obtaining context aware information relating to the first device; and

utilizing the context aware information when obtaining the relationship information.

12. A non-transitory computer-readable recording medium having recorded thereon a program for executing a method of providing information in a first device, the method comprising:

receiving a user input to select an object from among at least one object included in an image displayed on the first device;

obtaining identification information regarding a selected object;

obtaining relationship information which represents a relationship between a user of the first device and the selected object based on the identification information of the selected object;

obtaining recommendation information about the selected object based on the relationship information;

outputting the relationship information which represents the relationship between the user of the first device and the selected object, via at least one of the first device and a second device; and

outputting the recommendation information based on the relationship information, via at least one of the first device and the second device,

wherein the second device is a device of a user corresponding to the selected object.

13. A first device comprising:

a display configured to display an image; and

a processor configured to receive a user input to select an object of at least one object included in the image displayed on the first device, obtain identification information regarding the selected object included in the image displayed on the display, obtain relationship information which represents a relationship between a user of the first device and the selected object based on the identification information of the selected object, obtain recommendation information about the selected object based on the relationship information, output the relationship information which represents the relationship between the user of the first device and the selected object, via at least one of the display of the first device and a second device, and output the recommendation information based on the relationship information, via at least one of the display of the first device and the second device,

wherein the second device is a device of a user corresponding to the selected object.

14. The first device of claim 13, wherein the second device is a device of a user corresponding to the selected object.

15. The first device of claim 13, wherein the selected object is displayed separately in the image according to receiving the user input.

16. The first device of claim 13, wherein the relationship information is displayed in a separate region with the image.

17. The first device of claim 13, wherein the processor is further configured to receive a user input to select a plurality of objects included in the image displayed on the first device and obtain relationship information which represents a relationship of a group including a selected plurality of objects included in the image.

18. The first device of claim 13, wherein the processor obtains at least one of the relationship information and the recommendation information by searching an external database of the first device.

19. The first device of claim 13, wherein the processor transmits the relationship information to the second device while outputting the relationship information via the display of the first device.

20. The first device of claim 13, wherein the processor is further configured to collect context aware information regarding to the first device and obtain the relationship information of the selected object by further using the collected context aware information.