Digital image processing method and apparatus, and storage medium

• US 10,013,600 B2
• Filed: 06/28/2016
• Issued: 07/03/2018
• Est. Priority Date: 11/20/2015
• Status: Active Grant

• Current Assignee: Xiaomi Inc. (Xiaomi Corp.)
• Original Assignee: Xiaomi Inc. (Xiaomi Corp.)
• Inventors: Chen, Zhijun, Zhang, Tao, Wang, Pingze
• Primary Examiner(s): Bayat, Ali
• Application Number:
  US15/195,537
• Publication Number:
  US 20170147869A1
• Time in Patent Office: 735 Days
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5846 using extracted text
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06V 20/30 in albums, collections or shared content, e.g. social network photos or video
• CPC Class Codes: G06V 2201/10 Recognition assisted with metadata
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/173 face re-identification, e.g. recognising unknown faces across different face tracks
• CPC Class Codes: G06V 40/179 metadata assisted face recognition

Abstract

The present disclosure is related to a digital image processing method and apparatus for generating a description of contents depicted in a digital image based on at least one or more of identity information of a person depicted in the digital image and digital image information.

Claims

1. A method for generating a description based on content identified from a digital image by a mobile communication device, comprising:

identifying a face depicted in a digital image corresponding to a user;

determining identity information of a person corresponding to the identified face, the identity information comprising at least one of a name of the person and a relationship between the person and the user;

acquiring digital image information of the digital image, the digital image information comprising at least one of a digital image capturing time and a digital image capturing location; and

identifying an object in the digital image;

acquiring a name of the object identified in the digital image; and

generating a description of the digital image according to the identity information, the digital image information, and at least one of the name of the object, a weather information acquired for a day the digital image was captured, or a news event acquired for the digital image capturing time and the digital image capturing location.

2. The method of claim 1, wherein determining the identity information corresponding to the identified face comprises:

acquiring a personal information database through a communication network shared with the mobile communication device, the personal information database including correspondence relationships between facial recognition information and personal identities;

comparing the identified face with the facial recognition information in the personal information database to identify facial recognition information in the personal information database which matches the identified face; and

acquiring the identity information corresponding to the facial recognition information in the personal information database which matches the identified face.

3. The method of claim 1, wherein determining the identity information corresponding to the identified face comprises:

acquiring contact information corresponding to the user, the contact information including head portrait digital images and personal identities of contacts corresponding to the user;

comparing the identified face with the head portrait digital images of the contacts to identify a head portrait digital image of a contact which includes a face that matches the recognized face; and

acquiring a personal identity corresponding to the head portrait digital image of the contact which includes the face that matches the recognized face.

4. The method of claim 1, wherein generating the description of the digital image according to the identity information and the digital image information comprises:

generating the description of the digital image according to the identity information, the digital image information, and the name of the object.

5. The method of claim 1, further comprising:

grouping digital images of the user; and

generating a description of each group of digital images according to a description of each digital image in the group of digital images.

6. The method of claim 2, further comprising:

grouping digital images of the user; and

generating a description of each group of digital images according to a description of each digital image in the group of digital images.

7. The method of claim 3, further comprising:

grouping digital images of the user; and

generating a description of each group of digital images according to a description of each digital image in the group of digital images.

8. The method of claim 4, further comprising:

grouping digital images of the user; and

generating a description of each group of digital images according to a description of each digital image in the group of digital images.

9. The method of claim 5, wherein grouping the digital images of the user comprises:

grouping the digital images according to at least one of the following factors;

digital image capturing times of the digital images, digital image capturing locations of the digital images and faces in the digital images.

10. The method of claim 9, further comprising:

displaying the group of digital images and the description of each group of digital images upon reception of a browsing command input by the user.

11. The method of claim 10, wherein displaying the grouping and the description of each group of digital images comprises:

displaying the digital images in each group of digital images and the descriptions of the digital images in a slideshow manner.

12. A digital image processing apparatus, comprising:

a processor; and

a memory configured to store instructions executable by the processor,

wherein the processor is configured to execute the instructions to;

identify a face depicted in a digital image corresponding to a user;

determine identity information of a person corresponding to the identified face, the identity information comprising at least one of a name of the person and a relationship between the person and the user;

acquire digital image information of the digital image, the digital image information comprising at least one of a digital image capturing time and a digital image capturing location;

identify an object in the digital image;

acquire a name of the object identified in the digital image;

generate a description of the digital image according to the identity information, the digital image information, and at least one of the name of the object, a weather information acquired for a day the digital image was captured, or a news event acquired for the digital image capturing time and the digital image capturing location.

13. The apparatus of claim 12, wherein the processor is further configured to execute the instructions to:

acquire a personal information database through a communication network shared with the apparatus, the personal information database including correspondence relationships between facial recognition information and personal identities;

compare the identified face with the facial recognition information in the personal information database to identify facial recognition information in the personal information database which matches the identified face; and

acquire the identity information corresponding to the facial recognition information in the personal information database which matches the identified face.

14. The apparatus of claim 12, wherein the processor is further configured to execute the instructions to:

acquire contact information corresponding to the user, the contact information including head portrait digital images and personal identities of contacts corresponding to the user;

compare the identified face with the head portrait digital images of the contacts to identify a head portrait digital image of a contact which includes a face that matches the recognized face; and

acquire a personal identity corresponding to the head portrait digital image of the contact which includes the face that matches the recognized face.

15. The apparatus of claim 12, wherein the processor is further configured to execute the instructions to:

generate the description of the digital image according to the identity information, the digital image information, and the name of the object.

16. The apparatus of claim 12, wherein the processor is further configured to execute the instructions to:

group digital images of the user; and

generate a description of each group of digital images according to a description of each digital image in the group of digital images.

17. The apparatus of claim 16, wherein the processor is further configured to execute the instructions to:

group the digital images according to at least one of the following factors;

digital image capturing times of the digital images, digital image capturing locations of the digital images and faces in the digital images.

18. The apparatus of claim 17, wherein the processor is further configured to execute the instructions to:

display the group of digital images and the description of each group of digital images upon reception of a browsing command input by the user.

19. The apparatus of claim 18, wherein the processor is further configured to:

display the digital images in each group of digital images and the descriptions of the digital images in a slideshow manner.

20. A non-transitory computer-readable storage medium having stored therein instructions that, when executed by a processor of a mobile device, cause a mobile communication device to:

identify a face depicted in a digital image corresponding to a user;

determine identity information of a person corresponding to the identified face, the identity information comprising at least one of a name of the person and a relationship between the person and the user;

acquire digital image information of the digital image, the digital image information comprising at least one of a digital image capturing time and a digital image capturing location;

identify an object in the digital image;

acquire a name of the object identified in the digital image;

generate a description of the digital image according to the identity information, the digital image information, and at least one of the name of the object, a weather information acquired for a day the digital image was captured, or a news event acquired for the digital image capturing time and the digital image capturing location.