DEVICE AND METHOD FOR PROCESSING METADATA

• US 20200134397A1
• Filed: 12/26/2019
• Published: 04/30/2020
• Est. Priority Date: 11/11/2015
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: KIM, Woo-Chan, HEO, Jun-Seok
• Granted Patent: US 11,328,186 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/284 Relational databases
• CPC Class Codes: G06F 16/35 Clustering; Classification
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 18/25 Fusion techniques
• CPC Class Codes: G06T 1/0007 Image acquisition

Abstract

A method and an electronic device are disclosed. The method includes obtaining an image, obtaining information of the image, obtaining content information of content included in the image, obtaining related information which relates to the image based on at least one of the information of the image and the content information, and classifying the image into at least one category based on a plurality of defined information/data elements and a relation among the information/data elements and metadata of the image.

Claims

1. A method of electronic device comprising a processor, the method comprising:

obtaining an image;

obtaining information of the image;

obtaining content information of content included in the image;

obtaining related information which relates to the image based on at least one of the information of the image and the content information; and

classifying the image into at least one category based on a plurality of defined information/data elements and a relation among the information/data elements and metadata of the image.

2. The method of claim 1, wherein the content information is obtained in response to a preset condition being true.

3. The method of claim 2, wherein the preset condition comprises at least one of arrival of a preset period, usage of resources of the electronic device being not more than a preset threshold, a remaining battery power of the electronic device being not less than a preset threshold, passage of a preset time from a last time that a metadata model was produced, a number of new images obtained being not less than a preset threshold, the electronic device providing a service or function using the metadata, receiving a user input, the electronic device booting up, a transition from a sleep mode to a normal mode, a display screen/power-on after entry into the sleep mode, executing an application including a graphical element or item requiring a metadata model, displaying a screen including a graphical element requiring a metadata model, detecting a context associated with the electronic device matching a preset context, or detecting at least one word matching at least one preset word.

4. The method of claim 1, wherein the content information comprises at least one of a recognized person, a recognized thing, composition information of the image, information about text in the image, or color/chroma/lightness/brightness information about the image.

5. The method of claim 1, wherein the content information is obtained based on at least one of an ontology database, an image/metadata database, a metadata model database, or a target database.

6. The method of claim 5, wherein the ontology database includes a plurality of information/data elements and at least one relation among the plurality of information/data elements.

7. The method of claim 5,

wherein the image/metadata database includes a plurality of images and a plurality of metadata each corresponding to a respective one of the plurality of images, and

wherein the plurality of metadata are stored in a memory of the electronic device.

8. The method of claim 7, further comprising:

determining whether a preset condition is met;

upon meeting the preset condition, producing values indicating relevancy among information elements for the plurality of metadata; and

storing the produced values as a metadata model in the metadata model database.

9. The method of claim 7, wherein the plurality of metadata include at least one of a target captured, a date/time, a location/place, or ambient sounds when the corresponding image was captured.

10. The method of claim 5, wherein the target database includes target data for recognizing an object in the content.

11. The method of claim 10,

wherein the object comprises one of a whole or a part of a human or a whole or part of a thing, and

wherein the target data includes at least one of an image of the object, information about feature points of the object, a recognition reference defined by shape characteristics of the object, or a category of the object.

12. The method of claim 1, wherein the related information includes at least one of a person, a group, a location, an object, a context, an occasion, or an event.

13. The method of claim 1, further comprising generating at least one keyword based on the related information.

14. The method of claim 13, further comprising generating at least one candidate title of the image based at least in part on the at least one keyword.

15. The method of claim 1, further comprising:

counting a number of images in a category of the at least one category, and

displaying the number.

16. An electronic device comprising:

a memory; and

at least one processor configured to;

obtain an image,

obtain information of the image,

obtain content information of content included in the image,

obtain related information which relates to the image based on at least one of the information of the image and the content information, and

classifying the image into at least one category based on a plurality of defined information/data elements and a relation among the information/data elements and metadata of the image.

17. The device of claim 16, wherein the at least one processor is further configured to obtain the content information in response to a preset condition being true.

18. The device of claim 17, wherein the preset condition comprises at least one of arrival of a preset period, usage of resources of the electronic device being not more than a preset threshold, a remaining battery power of the electronic device being not less than a preset threshold, passage of a preset time from a last time that a metadata model was produced, a number of new images obtained being not less than a preset threshold, the electronic device providing a service or function using the metadata, receiving a user input, the electronic device booting up, a transition from a sleep mode to a normal mode, a display screen/power-on after entry into the sleep mode, executing an application including a graphical element or item requiring a metadata model, displaying a screen including a graphical element requiring a metadata model, detecting a context associated with the electronic device matching a preset context, or detecting at least one word matching at least one preset word.

19. The device of claim 16, wherein the content information comprises at least one of a recognized person, a recognized thing, composition information of the image, information about text in the image, or color/chroma/lightness/brightness information about the image.

20. The device of claim 16,

wherein the memory stores at least one of an ontology database, an image/metadata database, a metadata model database, or a target database, and

wherein the content information is obtained based on the at least one of the ontology database, the image/metadata database, the metadata model database, or the target database.