Management of smart tags via hierarchy

• US 8,200,669 B1
• Filed: 08/21/2008
• Issued: 06/12/2012
• Est. Priority Date: 08/21/2008
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Iampietro, Michael, Darbari, Abhinav, B, Ramesh P, Yadav, Ram Narain, Singh, Arvinder
• Primary Examiner(s): SOMERS, MARC S
• Application Number:
  US12/196,101
• Time in Patent Office: 1,391 Days
• Field of Search: 707/705, 707/736, 707/737, 707/738, 707/739, 707/740, 707/741, 707/722
• US Class Current: 707/737
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/783 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: Y10S 707/914 Video
• CPC Class Codes: Y10S 707/915 Image

Abstract

Embodiments herein include presenting smart tags describing characteristics of image content in a hierarchy, and performing operations on the hierarchy to find particular image content within a larger amount of image content. Image content and corresponding tags are maintained. The corresponding tags associated with the image content are presented in a hierarchy. Each tag type in the hierarchy represents a characteristic associated with the image content. Each tag in the hierarchy is derived based on image-based processing applied to the image content. In response to receiving a selection of at least one tag in the hierarchy, display of the image content associated with the at least one tag is initiated. A user is able to quickly and easily find desired image content by using the hierarchy to look at tags, select a type of tag from the hierarchy, and thereafter view any content tagged with the selected tag type.

Claims

1. A method comprising:

receiving, by a processor, analysis data descriptive of at least two quality parameters of image content;

determining, by the processor, quality tags for the image content based on the analysis data, wherein the quality tag identifies a portion of image content having a quality level, wherein the quality level is based on each of the at least two quality parameters having a respective value that is within a respective range;

presenting, by the processor, a plurality of tags associated with the image content in a hierarchy, wherein the plurality of tags comprises the quality tags and at least one additional tag, each additional tag type in the hierarchy representing a characteristic associated with the image content, each additional tag in the hierarchy being derived based on image-based processing applied to the image content; and

in response to receiving a selection of at least one tag in the hierarchy, initiating, by the processor, display of the image content associated with the at least one tag.

2. The method of claim 1 further comprising:

filtering, by the processor, the plurality of tags in the hierarchy into a sub-group of related tags, wherein the sub-group of related tags includes a first type of tags and a second type of tags;

receiving, by the processor, a selection of the sub-group of related tags; and

in response to receiving the selection, initiating, by the processor, display of image content tagged with the first type of tags and the second type of tags.

3. The method of claim 1 further comprising:

searching, by the processor, the hierarchy of tags to find tags indicating at least one event of interest captured by the image content; and

upon finding a group of tags indicating the at least one event of interest, automatically selecting, by the processor, the group of tags and corresponding portions of the image content tagged with the group of tags.

4. The method of claim 1, further comprising:

receiving, by the processor, event information defining a particular type of event of interest;

performing, by the processor, a search with respect to metadata information associated with the plurality of tags to locate portions of the image content in which the particular type of event of interest occurs for image content tagged with the plurality of tags; and

based on the search, displaying, by the processor, the portions of the image content in which the particular type of event of interest occurs in the image content.

5. The method of claim 1, wherein receiving the selection includes receiving a selection of a particular type of tag from the hierarchy;

and wherein initiating display of the image content includes;

identifying frames of a portion of image content comprising video content tagged with the particular type of tag; and

initiating display of only the frames of the video content tagged with the particular type of tag.

6. The method of claim 1, further comprising:

receiving metadata values associated with portions of the image content tagged with the plurality of tags; and

associating the metadata values with the plurality of tags.

7. The method of claim 6 further comprising:

searching, by the processor, within groups of the hierarchy of tags to find tags within a particular group that represent a range of values that describe an event of interest present in the image content associated with the tags; and

upon finding such tags, selecting, by the processor, the found tags and displaying the image content associated with the found tags.

8. The method of claim 1 wherein initiating display comprises:

in response to receiving a selection of a quality tag and at least one other tag, initiating presentation of a portion of image content that satisfies the quality level associated with the quality tag and includes characteristics described by the at least one other tag.

9. The method of claim 1 wherein initiating display comprises:

in response to receiving a selection of at least one tag in the hierarchy, presenting each portion of image content associated with the at least one tag;

in response to receiving a selection of a presented portion of image content, initiating playback of the selected portion of image content; and

upon completion of playback of the selected portion of image content, initiating playback of a successive presented portion of image content.

10. The method as in claim 1, wherein presenting the plurality of tags associated with the image content in the hierarchy further comprises:

initiating display of the hierarchy to multiple levels, a first tag level of the hierarchy representing tags of a particular type; and

initiating display of multiple tag sub-levels beneath the first tag level in the hierarchy, the multiple sub-levels including a first tag sub-level and a second tag sub-level, the first tag sub-level representing a first type of tags of the particular type, the second tag sub-level representing a second type of tags of the particular type.

11. The method as in claim 10 further comprising:

responsive to selection of the first tag level, initiating, by the processor, display of portions of the image content tagged with the first type of tags and the second types of tags; and

responsive to selection of the first tag sub-level beneath the first tag level, initiating, by the processor, display of portions of the image content tagged with the first type of tags; and

responsive to selection of the second tag sub-level, initiating, by the processor, display of portions of the image content tagged with the second type of tags.

12. The method as in claim 10 further comprising:

responsive to selection of the first tag level, initiating, by the processor, display of symbols on a respective timeline associated with the image content, the symbols representing tags in the hierarchy beneath the first tag level including tags beneath the first tag sub-level and tags beneath the second tag sub-level.

13. The method of claim 1 wherein presenting comprises:

initiating display of a respective tag associated with the image content;

receiving selection of the respective tag; and

in response to the selection of the respective tag, initiating display of metadata information associated with the respective tag.

14. The method as in claim 1 further comprising:

initiating, by the processor, display of metadata information including at least one parameter value that triggered generation of the respective tag to be created; and

initiating, by the processor, display of additional metadata information including at least one parameter value that did not trigger generation of the respective tag.

15. The method of claim 1, wherein receiving analysis data descriptive of at least two quality parameters of image content comprises receiving analysis data descriptive of at least two of focus, color saturation, blurriness, color adjustments, or brightness.

16. The method of claim 1, wherein a characteristic associated with the image content comprises at least one of a inclusion of a specified object in the image content, detection of motion between frames of the image content, or presence of sound associated with the image content.

17. A computer program product comprising a non-transitory computer-readable medium having instructions stored thereon for processing data information, such that the instructions, when carried out by a processing device, enable the processing device to perform operations of:

maintaining image content and corresponding tags;

receiving, for each tag within a plurality of tags associated with the image content, analysis data descriptive of a parameter of a portion of the image content associated with that tag;

deriving quality tags from an evaluation of combinations of the parameters described by the analysis data, a quality tag representing a portion of image content associated with a subset of the plurality of tags, each quality tag describing a quality level of the represented image content;

presenting the corresponding tags associated with the image content and the quality tags in a hierarchy, each tag type in the hierarchy representing a characteristic associated with the image content, each tag in the hierarchy being derived based on image-based processing applied to the image content and describing a characteristic of a portion of the image content; and

in response to receiving a selection of at least one tag in the hierarchy, initiating display of the image content associated with the at least one tag, wherein initiating display comprises initiating playback of a portion of image content associated with the at least one tag and, upon completion of playback of the first portion of image content, initiating playback of a successive portion of image content associated with the at least one tag.

18. The computer program product of claim 17 further comprising additional instructions that, when carried out by a processing device, enable the processing device to perform the additional operations of:

filtering tags in the hierarchy into a sub-group of related tags, wherein the sub-group of related tags includes a first type of tags and a second type of tags;

receiving a selection of the sub-group of related tags; and

in response to receiving the selection, initiating display of image content tagged with the first type of tags and the second type of tags.

19. The computer program product of claim 17, wherein maintaining the corresponding tags includes maintaining metadata information associated with the corresponding tags, the metadata information defining attributes of the image content tagged with the corresponding tags, the computer program product further comprising:

receiving event information defining a particular type of event of interest;

performing a search with respect to the metadata information associated with the corresponding tags to locate portions of the image content in which the particular type of event of interest occurs for image content tagged with the corresponding tags; and

in response to the search, displaying the portions of the image content in which the particular type of event of interest occurs in the image content.

20. The computer program product of claim 17 where initiating display comprises:

in response to receiving a selection of a quality tag and at least one other tag, initiating presentation of a portion of image content that satisfies the quality level associated with the quality tag and includes characteristics described by the at least one other tag.

21. The computer program product as in claim 17, wherein presenting the corresponding tags associated with the image content in the hierarchy further comprises:

initiating display of the hierarchy to multiple levels, a first tag level of the hierarchy representing tags of a particular type; and

initiating display of multiple tag sub-levels beneath the first tag level in the hierarchy, the multiple sub-levels including a first tag sub-level and a second tag sub-level, the first tag sub-level representing a first type of tags of the particular type, the second tag sub-level representing a second type of tags of the particular type.

22. The computer program product as in claim 21 further comprising additional instructions that, when carried out by a processing device, enable the processing device to perform the additional operations of:

responsive to selection of the first tag level, initiating display of portions of the image content tagged with the first type of tags and the second types of tags; and

responsive to selection of the first tag sub-level beneath the first tag level, initiating display of portions of the image content tagged with the first type of tags; and

responsive to selection of the second tag sub-level, initiating display of portions of the image content tagged with the second type of tags.

23. The computer program product of claim 17 wherein presenting comprises:

initiating display of a respective tag associated with the image content;

receiving selection of the respective tag; and

in response to the selection of the respective tag, initiating display of metadata information associated with the respective tag.

24. A computer system comprising:

a processor;

a memory unit that stores instructions associated with an application executed by the processor;

a display; and

an interconnect coupling the processor, the memory unit, and the display, enabling the computer system to execute the application and perform operations of;

receiving, by a processor, analysis data descriptive of at least two quality parameters of image content;

determining, by the processor, quality tags for the image content based on the analysis data, wherein the quality tag identifies a portion of image content having a quality level, wherein the quality level is based on each of the at least two quality parameters having a respective value that is within a respective range;

presenting a plurality of tags associated with the image content in a hierarchy, wherein the plurality of tags comprises the quality tags and at least one additional tag, each additional tag type in the hierarchy representing a characteristic associated with the image content, each additional tag in the hierarchy being derived based on image-based processing applied to the image content; and

in response to receiving a selection of at least one tag in the hierarchy, initiating display of the image content associated with the at least one tag.

25. The computer system of claim 24 comprising:

filtering tags in the hierarchy into a sub-group of related tags, wherein the sub-group of related tags includes a first type of tags and a second type of tags;

receiving a selection of the sub-group of related tags; and

in response to receiving the selection, initiating display of image content tagged with the first type of tags and the second type of tags.

26. The computer system of claim 24, the computer system configured to perform further operations comprising:

receiving event information defining a particular type of event of interest;

performing a search with respect to metadata information associated with the plurality of tags to locate portions of the image content in which the particular type of event of interest occurs for image content tagged with the plurality of tags; and

in response to the search, displaying the portions of the image content in which the particular type of event of interest occurs in the image content.

27. The computer system of claim 24 where initiating display comprises:

in response to receiving a selection of a quality tag and at least one other tag, initiating presentation of a portion of image content that satisfies the quality level associated with the quality tag and includes characteristics described by the at least one other tag.

28. The computer system as in claim 24, wherein presenting the plurality of tags associated with the image content in the hierarchy further comprises:

initiating display of the hierarchy to multiple levels, a first tag level of the hierarchy representing tags of a particular type; and

initiating display of multiple tag sub-levels beneath the first tag level in the hierarchy, the multiple sub-levels including a first tag sub-level and a second tag sub-level, the first tag sub-level representing a first type of tags of the particular type, the second tag sub-level representing a second type of tags of the particular type.

29. The computer system as in claim 28 configured to perform further operations comprising:

responsive to selection of the first tag level, initiating display of portions of the image content tagged with the first type of tags and the second types of tags; and

responsive to selection of the first tag sub-level beneath the first tag level, initiating display of portions of the image content tagged with the first type of tags; and

responsive to selection of the second tag sub-level, initiating display of portions of the image content tagged with the second type of tags.

30. The computer system of claim 24 wherein presenting comprises:

initiating display of a respective tag associated with the image content;

receiving selection of the respective tag; and

in response to the selection of the respective tag, initiating display of metadata information associated with the respective tag.