Methods and systems for crowd sourced tagging of multimedia

• US 8,904,271 B2
• Filed: 12/06/2013
• Issued: 12/02/2014
• Est. Priority Date: 01/03/2011
• Status: Active Grant

• Current Assignee: Curt Evans
• Original Assignee: Curt Evans
• Inventors: Evans, Curt
• Primary Examiner(s): Mills, Frank D
• Application Number:
  US14/099,125
• Publication Number:
  US 20140089798A1
• Time in Patent Office: 361 Days
• Field of Search: 715/206
• US Class Current: 715/206
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/44 Browsing; Visualisation therefor
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06K 19/06009 with optically detectable marking G06K19/063, G06K19/08 take precedence
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 20/1235 with control of digital rights management [DRM]
• CPC Class Codes: G06Q 20/3276 using a pictured code, e.g. barcode or QR-code, being read by the M-device
• CPC Class Codes: G06Q 20/384 using social networks
• CPC Class Codes: G06Q 20/401 Transaction verification
• CPC Class Codes: G06Q 50/18 Legal services
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/440236 by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 9/8233 : the additional signal being a character code signal

Abstract

The invention relates to deploying a synchronization index and associated multimedia, for manipulations to the synchronization index, for navigation between the synchronization index and associated multimedia, and for synchronous playback of the multimedia and associated text, using a computing device. The system may use multimedia with a synchronized text transcription, or a synchronization index, on a computing device for viewing and manipulating the multimedia, using the synchronized text transcription. The computing device may be used to navigate the multimedia, annotate the text transcription, achieve synchronous play of the multimedia, and communicate to another computer manipulations performed on the text or multimedia.

Claims

1. A method for indexing at least one occurrence-of-interest in a multimedia file, wherein an occurrence-of-interest comprises at least one item in the multimedia that is visible or audible and being selected from a pre-existing group comprising a brand, a trademark or servicemark, an indicia of source of origin, a product or good, a place, a person, an event, a character, and a business, the method comprising:

providing a facility for a user of multimedia to create a tag associated to at least one of the pre-existing group of occurrence-of-interest items, wherein said tag comprises a unique identifier that uniquely identifies an occurrence-of-interest tagged by the user, wherein said unique identifier comprises a combination of a brand key and a user key for tagging and facilitates ability to aggregate data relating to instances of its use;

determining a discrete time, t_x, within said multimedia file, wherein said multimedia file has a run duration of t₀ to t_end; and

indexing the multimedia file to indicate the discrete times, t_x, of the tagged occurrence items and the unique identifier,

wherein said facility for a user of multimedia to create a tag is provided by executable program code on a mobile computing device,

wherein said mobile computing device comprises a viewing screen and a touch-sensitive input interface,

wherein said viewing screen is able to display one or more linking elements,

wherein performing a gesture on a portion of said viewing screen corresponding to a linking element is recognized by said touch-sensitive input interface,

wherein said linking element comprises a brand, a trademark or servicemark, an indicia of source of origin, a product or good, a place, a person, an event, a character, and a business, and

wherein said linking element is selected from a palette of linking elements, wherein at least one linking element functions to specify a time duration for the tag defined by the type or duration of the gesture.

2. The method of claim 1, wherein said facility for a user of multimedia to create a tag is provided by a system comprising at least one mobile computing device and a second computing device to deliver or display multimedia.

3. The method of claim 1, wherein said unique identifier is associated with a unique identifier graphic, wherein said unique identifier graphic comprises a trademark or servicemark, and wherein said unique identifier graphic functions as a hyperlink.

4. The method of claim 1, wherein said unique identifier is associated with a unique identifier graphic, wherein said unique identifier graphic comprises a trademark or servicemark, and wherein said unique identifier graphic functions as a hyperlink, and

wherein said hyperlink links to executable program code to facilitate a purchase.

5. The method of claim 1, further comprising:

providing a transcript of said multimedia as a synchronization index, wherein said transcript is able to be displayed synchronously with said multimedia on a mobile computing device.

6. A method for advertising by indexing multimedia having occurrences-of-interest that can be tagged by at least one user, wherein an occurrence-of-interest comprises at least one item in the multimedia that is visible or audible and being selected from a pre-existing group comprising a brand, a trademark or servicemark, an indicia of source of origin, a product or good, a place, a person, an event, a character, and a business, the method comprising:

providing a facility for a user of multimedia to create a tag associated to at least one of the pre-existing group of occurrence-of-interest items,

wherein said tag is associated to a multimedia file and a discrete time, t_x, within said multimedia file,

wherein said multimedia file has a run duration of t₀ to t_end;

wherein said tag comprises a unique identifier, wherein said unique identifier comprises a combination of a brand key and a user key for tagging and facilitates ability to aggregate data relating to instances of its use;

wherein said facility for a user of multimedia to create a tag is provided by executable program code on a mobile computing device,

wherein said mobile computing device comprises a viewing screen and a touch-sensitive input interface,

wherein said viewing screen is able to display one or more linking elements,

wherein performing a gesture on a portion of said viewing screen corresponding to a linking element is recognized by said touch-sensitive input interface,

wherein said linking element comprises a brand, a trademark or servicemark, an indicia of source of origin, a product or good, a place, a person, an event, a character, and a business, and

wherein said linking element is selected from a palette of linking elements, wherein at least one linking element functions to specify a time duration for the tag defined by the type or duration of the gesture.

7. The method of claim 6, wherein said facility for a user of multimedia to create a tag is provided by a system comprising at least one mobile computing device and a second computing device to deliver or display multimedia.

8. The method of claim 6, wherein said unique identifier is associated with a unique identifier graphic, wherein said unique identifier graphic comprises a trademark or servicemark.

9. The method of claim 6, wherein said unique identifier is associated with a unique identifier graphic, wherein said unique identifier graphic comprises a trademark or servicemark, and wherein said unique identifier graphic functions as a hyperlink.

10. The method of claim 6, wherein said unique identifier is associated with a unique identifier graphic, wherein said unique identifier graphic comprises a trademark or servicemark, wherein said unique identifier graphic functions as a hyperlink, and wherein said hyperlink links to executable program code to facilitate a purchase.

11. The method of claim 6, further comprising:

providing a transcript of said multimedia as a synchronization index, wherein said transcript is able to be displayed synchronously with said multimedia; and

wherein said unique identifier is associated with a unique identifier graphic that appears upon playback of said multimedia at said discrete time, t_x.

12. The method of claim 6, further comprising:

providing a facility to share a tag with another user, another computer, another group of users, another group of computers, or a social network.

13. The method of claim 6, further comprising:

providing facility to aggregate tag data or metadata; and

providing facility to report said tag data or metadata.

14. A method for indexing multimedia based on a brand key, wherein said brand key has an owner and is associated to at least one item of a brand key group comprising a brand, a trademark or servicemark, an indicia of source of origin, a product or good, a place, a person, an event, a character, and a business, the method comprising:

providing a brand key;

providing a user key for tagging, wherein said user key for tagging is issued to a user;

combining said brand key with said user key for tagging to form a unique identifier for tagging, wherein said unique identifier facilitates ability to aggregate data relating to instances of its use;

providing a facility to associate said unique identifier to a discrete time, t_x, within a multimedia file having a run duration of t₀ to t_end, corresponding to at least one occurrence in a multimedia file of said at least one item;

providing a facility for a computer system to receive said unique identifier for at least one occurrence in a multimedia file of said at least one item;

providing a facility for a computer system to determine said user based on said unique identifier; and

indexing the multimedia by aggregating instances in which a unique identifier was used to indicate the discrete times, t_x, of the at least one occurrence in a multimedia file of said at least one item,

wherein said facility to associate said unique identifier is provided by executable program code on a mobile computing device,

wherein said mobile computing device comprises a viewing screen and a touch-sensitive input interface,

wherein said viewing screen is able to display one or more linking elements,

wherein performing a gesture on a portion of said viewing screen corresponding to a linking element is recognized by said touch-sensitive input interface,

wherein said linking element comprises a brand, a trademark or servicemark, an indicia of source of origin, a product or good, a place, a person, an event, a character, and a business, and

wherein said linking element is selected from a palette of linking elements, wherein at least one linking element functions to specify a time duration for the tag defined by the type or duration of the gesture.

15. The method of claim 14, further comprising:

associating said unique identifier with a unique identifier graphic.

16. The method of claim 14, further comprising:

providing a transcript of said multimedia as a synchronization index, and

wherein said transcript is able to be displayed synchronously with said multimedia on a mobile computing device.