Providing sketch annotations with multimedia programs

• US 9,275,684 B2
• Filed: 09/30/2008
• Issued: 03/01/2016
• Est. Priority Date: 09/12/2008
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Amento, Brian Scott, Stead, Larry, Nathan, Mukesh
• Primary Examiner(s): Bashore, William
• Assistant Examiner(s): SHREWSBURY, NATHAN K
• Application Number:
  US12/242,493
• Publication Number:
  US 20100070878A1
• Time in Patent Office: 2,709 Days
• Field of Search: 715/203, 715/230, 715/751
• US Class Current: 1/1
• CPC Class Codes: A63F 2300/572 Communication between players during game play of non game information, e.g. e-mail, chat, file transfer, streaming of audio and streaming of video
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics

Abstract

A method for collaborative sketch annotating of a program of multimedia content includes enabling a first user to create a sketch annotation, enabling the first user to store sketch annotation data related to the sketch annotation, and enabling a second user to access the sketch annotation. The second user may navigate the program using the sketch annotation and/or an indication of the sketch annotation. The first user may create the sketch annotation while viewing the program, for example, and the program may be paused for adding the sketch annotation to one or more paused frames. The sketch annotations may include chronological information indicative of a chronological location of the sketch annotation within the program.

Claims

1. A content annotation method, comprising:

receiving, from a first client associated with a first viewer viewing multimedia content selected from television content, pay-per-view content, and video on demand content, a first user input indicative of a first annotation including an image and a second user input indicative of a first annotation duration wherein annotations of the first viewer include source identification features indicative of the first viewer as a source of the annotations;

wherein the source identification features are selected from;

a source identification avatar and a source identification icon;

associating the first annotation with a first temporal location of the multimedia content;

providing, by a data processing system, the multimedia content, the first annotation, and the first temporal location to a second client associated with a second viewer of the multimedia content, wherein, upon displaying the multimedia content, the second client displays the first annotation at the first temporal location, for the first annotation duration, overlaying the multimedia content; and

responsive to receiving a second annotation, a second temporal location, and a second annotation duration from the second viewer, the first client, upon displaying the multimedia content, displays the second annotation at the second temporal location, for the second annotation duration, overlaying the multimedia content.

2. The method of claim 1, wherein:

associating the first annotation with the first temporal location includes storing chronological information indicative of the first temporal location within the multimedia content.

3. The method of claim 1, wherein the first annotation comprises an image of the multimedia content displaying at the time the first viewer asserted an annotation button or otherwise created the first annotation.

4. The method of claim 1, wherein:

the second client navigates to a segment of the multimedia content containing the sketch annotation responsive to detecting an indication of the sketch annotation.

5. The method of claim 1, wherein the user input comprises user assertion of an annotation button on a remote control device while the program is presented to the first user.

6. The method of claim 1, wherein the first annotation is color coded to further distinguish it from further annotations from sources.

7. The method of claim 1, wherein the first user input comprises user input to a cellular telephone communicatively coupled to the first client, wherein the first client is a set top box.

8. The method of claim 7, wherein the cellular telephone receives the first user input via a touch screen of the cellular telephone.

9. The method of claim 7, wherein the cellular telephone is enabled to receive the first user input via a stylus.

10. The method of claim 3, wherein elements of the first annotation align to elements of a current image of the multimedia content.

11. The method of claim 10, further comprising:

removing the first annotation when the first annotation no longer aligns to the image.

12. The method of claim 11, wherein:

removing the first annotation occurs in response to a change of scene in the multimedia content.

13. The method of claim 7, wherein the first annotation data includes textual information to further distinguish annotations of other sources.

14. The method of claim 10, wherein the first annotation emphasizes a visible element of the multimedia content.

15. A data processing system suitable for use in a multimedia content delivery network, the system comprising:

a processor;

a computer readable storage medium including program instructions which, when executed by a processor, cause the processor to perform operations for annotating multimedia content, the operations comprising;

generating an annotation, including an image, based on viewer input wherein annotations of a first viewer include source identification features indicative of the first viewer as a source of the annotations, wherein the annotation features are selected from;

a source identification avatar and a source identification icon;

associating the annotation with;

a temporal location of the multimedia content; and

a duration setting indicating an annotation duration;

storing data indicative of the annotation, the temporal location, and the annotation duration responsive to detecting an annotation request from a first client associated with a first viewer viewing the multimedia content, wherein the annotation is indicative of a path of motion of a hardware element affected by body movement of the first viewer;

recognizing a second viewer as a member of a collaboration group; and

providing the annotation and the temporal location to a second client associated with the second viewer in conjunction with the second viewer receiving the content wherein the second viewer views the annotation overlaying the multimedia content, for the annotation duration, during presentation of the multimedia content by the second client associated with the second viewer.

16. The system of claim 15, wherein the temporal location includes chronological information indicative of a chronological location within the multimedia content of the annotation.

17. The system of claim 15, wherein the annotation is color coded to further distinguish it from annotations from other sources.

18. The system of claim 16, wherein the first viewer input is provided to a mobile communication device.

19. The system of claim 18, wherein generating the annotation includes receiving viewer input from a touch screen coupled to the mobile communication device.

20. The system of claim 18, wherein the mobile communication device is a smart phone.

21. A content annotation method, comprising:

responsive to detecting viewer input indicating an annotation duration and including annotation input representing of an annotation, including an image, from a first viewer, the first viewer belonging to an annotation group, storing annotation data indicative of the annotation, wherein the annotation data is associated with a chronological location of multimedia content provided to the first viewer, wherein the multimedia content is selected from;

television content, pay-per-view content, and video on demand content;

wherein annotations of the first viewer include source identification features indicative of the first viewer as a source of the annotations, wherein the annotation features are selected from;

a source identification avatar and a source identification icon; and

responsive to a second viewer of the annotation group requesting the multimedia content, providing the annotation data and the multimedia content to the second viewer wherein, upon presentation to the second viewer, the annotation is displayed, overlaying the multimedia content, for a duration determined by the annotation duration.

22. The method of claim 21, wherein the annotation image is indicative of a frame of the multimedia content displayed when the first viewer annotated the multimedia content.

23. The method of claim 21, wherein the annotation includes chronological information indicative of a chronological location within the multimedia content of the annotation.

24. The method of claim 21, further comprising:

generating an annotation request responsive to the first viewer asserting an annotation button on a remote control device.

25. The method of claim 21, wherein the annotation is coded to further distinguish from annotations from other sources.

26. The method of claim 25, wherein the annotation includes textual annotations to further distinguish the annotation from annotations from other sources.

27. A collaborative sketch annotation method, comprising:

providing, by a first client, annotations, wherein each annotation includes a sketch image associated with a corresponding chronological position of a television program;

storing, by the first client, annotation data indicative of;

the annotations and the corresponding chronological positions; and

an annotation duration; and

sending the annotation data to a second client, wherein the second client, responsive to receiving the annotation data, asynchronously accesses the stored annotation data and displays the annotations overlaying the multimedia content for the annotation duration while receiving the television program;

wherein annotations of the first client include source identification features indicative of the first client as a source of the annotations, wherein the annotation features are selected from;

a source identification avatar and a source identification icon.

28. The method of claim 27, further comprising defining a plurality of users wherein the plurality of users includes the second client.

29. The method of claim 28, wherein the second client navigates the program by the annotations.

30. The method of claim 29, further comprising identifying a selected recipient as the second client.