Tagging of images based on social network tags or comments

• US 9,778,817 B2
• Filed: 06/23/2014
• Issued: 10/03/2017
• Est. Priority Date: 12/31/2013
• Status: Expired due to Fees

• Current Assignee: Visier Solutions Inc. (Visier, Inc.)
• Original Assignee: Findo, Inc.
• Inventors: Yan, David, Anisimovich, Konstantin
• Primary Examiner(s): Jami, Hares
• Application Number:
  US14/311,952
• Publication Number:
  US 20150186420A1
• Time in Patent Office: 1,198 Days
• Field of Search: 707736, 707737
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/156 Query results presentation
• CPC Class Codes: G06F 16/16 File or folder operations, e.g. details of user interfaces specifically adapted to file systems
• CPC Class Codes: G06F 16/168 Details of user interfaces specifically adapted to file systems, e.g. browsing and visualisation, 2d or 3d GUIs query results presentation G06F16/156
• CPC Class Codes: G06F 16/2246 Trees, e.g. B+trees
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/26 Visual data mining; Browsing structured data
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/483 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/5846 using extracted text
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06F 40/12 Use of codes for handling textual entities
• CPC Class Codes: G06Q 10/107 Computer-aided management of electronic mailing [e-mailing]
• CPC Class Codes: G10L 15/1815 : Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning

Abstract

Various embodiments are provided for enabling tagging of image files based on tagging or commenting on images on a social networking site. The tagging or commenting on an image on the social networking site is detected by the system. The social network tag or comment is analyzed to determine a textual tag to be assigned to image files corresponding to the social network images that have been tagged or commented on. In some implementations semantic analysis of text component of the social network tags or comments is performed. In some implementations the textual tags are then propagated to other image files associated with the user.

Claims

1. A method comprising:

detecting, by a data processing apparatus, an association of a plurality of social network tags with one or more social network images within a social network system, wherein the social network images were posted to the social network system by a first user of the social networking system, and wherein the association of the social network tags with the social network images is provided by one or more second users of the social network system;

creating, by the data processing apparatus, one or more textual tags based on the social network tags comprising performing a semantic analysis on the social network tags to identify language-independent representations of the social network tags that provide for matching multiple different ones of the social network tags as a same one of the textual tags; and

assigning, by the data processing apparatus, the textual tags to one or more first image files stored in one or more storage media associated with the first user other than the social network system, wherein the first image files correspond to the social network images.

2. The method of claim 1, wherein the first image files are from a plurality of image files stored in the storage media, and wherein the method further comprises:

assigning the textual tags to a second image file from the plurality of image files based on a comparison of one or more properties of the first image files and the second image file.

3. The method of claim 2, wherein the properties of the first image files and the second image file comprise one or more of a file name, a file location, file metadata, a file creation date, a file size, a geographical location of a place where the first image files and the second image file were captured, or file image analysis results.

4. The method of claim 1, wherein the social network images comprise one or more of digital photographs or digital video files.

5. The method of claim 1, wherein the one or more second users comprise a plurality of users, and wherein the plurality of users comprises the first user.

6. The method of claim 1, wherein creating the textual tags comprises selecting the textual tags from a tag library.

7. A method comprising:

detecting, by a data processing apparatus, an association of a plurality of social network comments with one or more social network images within a social network system, wherein the social network images were posted to the social network system by a first user of the social networking system, and wherein the association of the social network comments with the social network images is provided by one or more second users of the social network system;

creating, by the data processing apparatus, one or more textual tags based on the social network comments comprising performance of a semantic analysis on the social network comments to identify language-independent representations of the social network comments that provide for matching multiple different ones of the social network comments as a same one of the textual tags; and

assigning, by the data processing apparatus, the textual tags to one or more first image files stored in one or more storage media associated with the first user other than the social network system, wherein the first image files correspond to the social network images.

8. The method of claim 7, wherein the social network comments comprise second level social network comments.

9. A system comprising:

a machine-readable storage device having instructions stored thereon; and

a data processing apparatus in communication with the machine-readable storage device and operable to execute the instructions to;

detect an association of a plurality of social network tags with one or more social network images within a social network system, wherein the social network images were posted to the social network system by a first user of the social networking system, and wherein the association of the social network tags with the social network images is provided by one or more second users of the social network system;

create one or more textual tags based on the social network tags comprising performance of a semantic analysis on the social network tags to identify language-independent representations of the social network tags that provide for matching multiple different ones of the social network tags as a same one of the textual tags; and

assign the textual tags to one or more first image files stored in one or more storage media associated with the first user other than the social network system, wherein the first image files correspond to the social network images.

10. The system of claim 9, wherein the first image files are from a plurality of image files stored in the storage media, and wherein the data processing apparatus is further to:

assign the textual tags to a second image file from the plurality of image files based on a comparison of one or more properties of the first image files and the second image file.

11. The system of claim 10, wherein the properties of the first image files and the second image file comprise one or more of a file name, a file location, file metadata, a file creation date, a file size, a geographical location of a place where the first image files and the second image file were captured, or file image analysis results.

12. The system of claim 9, wherein the social network images comprise one or more of digital photographs or digital video files.

13. The system of claim 9, wherein the one or more second users comprise a plurality of users, and wherein the plurality of users comprises the first user.

14. The system of claim 9, wherein, to create the textual tags, the data processing apparatus is further to select the textual tags from a tag library.

15. A system comprising:

a machine-readable storage device having instructions stored thereon; and

a data processing apparatus in communication with the machine-readable storage device and operable to execute the instructions to;

detect an association of a plurality of social network comments with one or more social network images within a social network system, wherein the social network images were posted to the social network system by a first user of the social networking system, and wherein the association of the social network comments with the social network images is provided by one or more second users of the social network system;

create one or more textual tags based on the social network comments comprising performance of a semantic analysis on the social network comments to identify language-independent representations of the social network comments that provide for matching multiple different ones of the social network comments as a same one of the textual tags; and

assign the textual tags to one or more first image files stored in one or more storage media associated with the first user other than the social network system, wherein the first image files correspond to the social network images.

16. The system of claim 15, wherein the social network comments comprise second level social network comments.

17. A storage device having instructions stored thereon that, when executed by a data processing apparatus, cause the data processing apparatus to:

detect, by the data processing apparatus, an association of a plurality of social network tags with one or more social network images within a social network system, wherein the social network images were posted to the social network system by a first user of the social networking system, and wherein the association of the social network tags with the social network images is provided by one or more second users of the social network system;

create, by the data processing apparatus, one or more textual tags based on the social network tags comprising performance of a semantic analysis on the social network tags to identify language-independent representations of the social network tags that provide for matching multiple different ones of the social network tags as a same one of the textual tags; and

assign, by the data processing apparatus, the textual tags to one or more first image files stored in one or more storage media associated with the first user other than the social network system, wherein the first image files correspond to the social network images.

18. The storage device of claim 17, wherein the first image files are from a plurality of image files stored in the storage media, and wherein the instructions are further to cause the data processing apparatus to:

assign the textual tags to a second image file from the plurality of image files based on a comparison of one or more properties of the first image files and the second image file.

19. The storage device of claim 18, wherein the properties of the first image files and the second image file comprise one or more of a file name, a file location, file metadata, a file creation date, a file size, a geographical location of a place where the first image files and the second image file were captured, or file image analysis results.

20. The storage device of claim 17, wherein the social network images comprise one or more of digital photographs or digital video files.

21. The storage device of claim 17, wherein the one or more second users comprise a plurality of users, and wherein the plurality of users comprises the first user.

22. The storage device of claim 17, wherein, to create the textual tags, the instructions are further to cause the data processing apparatus to select the textual tags from a tag library.

23. A storage device having instructions stored thereon that, when executed by a data processing apparatus, cause the data processing apparatus to:

detect, by the data processing apparatus, an association of a plurality of social network comments with one or more social network images within a social network system, wherein the social network images were posted to the social network system by a first user of the social networking system, and wherein the association of the social network comments with the social network images is provided by one or more second users of the social network system;

create, by the data processing apparatus, one or more textual tags based on the social network comments comprising performance of a semantic analysis on the social network comments to identify language-independent representations of the social network comments that provide for matching multiple different ones of the social network comments as a same one of the textual tags; and

assign, by the data processing apparatus, the textual tags to one or more first image files stored in one or more storage media associated with the first user other than the social network system, wherein the first image files correspond to the social network images.

24. The storage device of claim 23, wherein the social network comments comprise second level social network comments.